2023-10-08T05:56:08.188 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc 2023-10-08T05:56:08.189 DEBUG:teuthology.run:Teuthology command: teuthology --owner scheduled_yuriw@teuthology --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_20.04} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/xfstests-dev} --name yuriw-2023-10-07_14:05:27-fs-main-distro-default-smithi --verbose --archive /home/teuthworker/archive/yuriw-2023-10-07_14:05:27-fs-main-distro-default-smithi/7417362 -- /home/teuthworker/archive/yuriw-2023-10-07_14:05:27-fs-main-distro-default-smithi/7417362/orig.config.yaml 2023-10-08T05:56:08.232 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-08T05:56:08.323 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/yuriw-2023-10-07_14:05:27-fs-main-distro-default-smithi/7417362 branch: main description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_20.04} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/xfstests-dev} email: yweinste@redhat.com first_in_suite: false job_id: '7417362' kernel: kdb: true sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: yuriw-2023-10-07_14:05:27-fs-main-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: ubuntu os_version: '20.04' overrides: admin_socket: branch: main ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: 9725b08fd801c82987c737f7e6d354878f036ee8 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 9725b08fd801c82987c737f7e6d354878f036ee8 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: main sha1: 9725b08fd801c82987c737f7e6d354878f036ee8 owner: scheduled_yuriw@teuthology priority: 75 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 9589 sha1: 9725b08fd801c82987c737f7e6d354878f036ee8 sleep_before_teardown: 0 subset: 111/12000 suite: fs suite_branch: main suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_9725b08fd801c82987c737f7e6d354878f036ee8/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 9725b08fd801c82987c737f7e6d354878f036ee8 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi032.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM= smithi040.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - ceph-fuse: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.tests_from_xfstests_dev teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 54e62bcbac4e53d9685e08328b790d3b20d71cae timestamp: 2023-10-07_14:05:27 tube: smithi user: yuriw verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2830 2023-10-08T05:56:08.324 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_9725b08fd801c82987c737f7e6d354878f036ee8/qa; will attempt to use it 2023-10-08T05:56:08.325 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_9725b08fd801c82987c737f7e6d354878f036ee8/qa/tasks 2023-10-08T05:56:08.325 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-10-08T05:56:08.327 INFO:teuthology.task.internal:Checking packages... 2023-10-08T05:56:08.350 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '9725b08fd801c82987c737f7e6d354878f036ee8' 2023-10-08T05:56:08.350 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-10-08T05:56:08.350 INFO:teuthology.packaging:ref: None 2023-10-08T05:56:08.350 INFO:teuthology.packaging:tag: None 2023-10-08T05:56:08.350 INFO:teuthology.packaging:branch: main 2023-10-08T05:56:08.350 INFO:teuthology.packaging:sha1: 9725b08fd801c82987c737f7e6d354878f036ee8 2023-10-08T05:56:08.351 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&ref=main 2023-10-08T05:56:08.587 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-6613-gb05d167b-1focal 2023-10-08T05:56:08.587 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-10-08T05:56:08.594 INFO:teuthology.task.internal:no buildpackages task found 2023-10-08T05:56:08.594 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-10-08T05:56:08.611 INFO:teuthology.task.internal:Saving configuration 2023-10-08T05:56:08.627 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-10-08T05:56:08.633 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-08T05:56:08.657 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi032.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-07_14:05:27-fs-main-distro-default-smithi/7417362', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-08 05:50:09.739273', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGETOy3xONfbx7kUFCNiUtRLNfkcrcEsWzPdq6Np/6Bw'} 2023-10-08T05:56:08.678 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi040.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-07_14:05:27-fs-main-distro-default-smithi/7417362', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-08 05:50:09.737406', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGETOy3xONfbx7kUFCNiUtRLNfkcrcEsWzPdq6Np/6Bw'} 2023-10-08T05:56:08.679 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-10-08T05:56:08.684 INFO:teuthology.task.internal:roles: ubuntu@smithi032.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2023-10-08T05:56:08.685 INFO:teuthology.task.internal:roles: ubuntu@smithi040.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2023-10-08T05:56:08.685 INFO:teuthology.run_tasks:Running task console_log... 2023-10-08T05:56:08.758 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fb6b02d6040>, signals=[15]) 2023-10-08T05:56:08.759 INFO:teuthology.run_tasks:Running task internal.connect... 2023-10-08T05:56:08.765 INFO:teuthology.task.internal:Opening connections... 2023-10-08T05:56:08.766 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi032.front.sepia.ceph.com 2023-10-08T05:56:08.767 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-08T05:56:08.815 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi040.front.sepia.ceph.com 2023-10-08T05:56:08.815 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-08T05:56:08.860 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-10-08T05:56:08.867 DEBUG:teuthology.orchestra.run.smithi032:> uname -m 2023-10-08T05:56:08.898 INFO:teuthology.orchestra.run.smithi032.stdout:x86_64 2023-10-08T05:56:08.898 DEBUG:teuthology.orchestra.run.smithi032:> cat /etc/os-release 2023-10-08T05:56:08.945 INFO:teuthology.orchestra.run.smithi032.stdout:NAME="Ubuntu" 2023-10-08T05:56:08.945 INFO:teuthology.orchestra.run.smithi032.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-10-08T05:56:08.945 INFO:teuthology.orchestra.run.smithi032.stdout:ID=ubuntu 2023-10-08T05:56:08.945 INFO:teuthology.orchestra.run.smithi032.stdout:ID_LIKE=debian 2023-10-08T05:56:08.945 INFO:teuthology.orchestra.run.smithi032.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-10-08T05:56:08.946 INFO:teuthology.orchestra.run.smithi032.stdout:VERSION_ID="20.04" 2023-10-08T05:56:08.946 INFO:teuthology.orchestra.run.smithi032.stdout:HOME_URL="https://www.ubuntu.com/" 2023-10-08T05:56:08.946 INFO:teuthology.orchestra.run.smithi032.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-10-08T05:56:08.946 INFO:teuthology.orchestra.run.smithi032.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-10-08T05:56:08.946 INFO:teuthology.orchestra.run.smithi032.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-10-08T05:56:08.946 INFO:teuthology.orchestra.run.smithi032.stdout:VERSION_CODENAME=focal 2023-10-08T05:56:08.946 INFO:teuthology.orchestra.run.smithi032.stdout:UBUNTU_CODENAME=focal 2023-10-08T05:56:08.947 INFO:teuthology.lock.ops:Updating smithi032.front.sepia.ceph.com on lock server 2023-10-08T05:56:08.973 DEBUG:teuthology.orchestra.run.smithi040:> uname -m 2023-10-08T05:56:08.981 INFO:teuthology.orchestra.run.smithi040.stdout:x86_64 2023-10-08T05:56:08.981 DEBUG:teuthology.orchestra.run.smithi040:> cat /etc/os-release 2023-10-08T05:56:09.028 INFO:teuthology.orchestra.run.smithi040.stdout:NAME="Ubuntu" 2023-10-08T05:56:09.028 INFO:teuthology.orchestra.run.smithi040.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-10-08T05:56:09.028 INFO:teuthology.orchestra.run.smithi040.stdout:ID=ubuntu 2023-10-08T05:56:09.028 INFO:teuthology.orchestra.run.smithi040.stdout:ID_LIKE=debian 2023-10-08T05:56:09.028 INFO:teuthology.orchestra.run.smithi040.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-10-08T05:56:09.028 INFO:teuthology.orchestra.run.smithi040.stdout:VERSION_ID="20.04" 2023-10-08T05:56:09.028 INFO:teuthology.orchestra.run.smithi040.stdout:HOME_URL="https://www.ubuntu.com/" 2023-10-08T05:56:09.029 INFO:teuthology.orchestra.run.smithi040.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-10-08T05:56:09.029 INFO:teuthology.orchestra.run.smithi040.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-10-08T05:56:09.029 INFO:teuthology.orchestra.run.smithi040.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-10-08T05:56:09.029 INFO:teuthology.orchestra.run.smithi040.stdout:VERSION_CODENAME=focal 2023-10-08T05:56:09.029 INFO:teuthology.orchestra.run.smithi040.stdout:UBUNTU_CODENAME=focal 2023-10-08T05:56:09.029 INFO:teuthology.lock.ops:Updating smithi040.front.sepia.ceph.com on lock server 2023-10-08T05:56:09.056 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-10-08T05:56:09.067 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-10-08T05:56:09.073 INFO:teuthology.task.internal:Checking for old test directory... 2023-10-08T05:56:09.073 DEBUG:teuthology.orchestra.run.smithi032:> test '!' -e /home/ubuntu/cephtest 2023-10-08T05:56:09.075 DEBUG:teuthology.orchestra.run.smithi040:> test '!' -e /home/ubuntu/cephtest 2023-10-08T05:56:09.082 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-10-08T05:56:09.088 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-10-08T05:56:09.089 DEBUG:teuthology.orchestra.run.smithi032:> test -z $(ls -A /var/lib/ceph) 2023-10-08T05:56:09.091 DEBUG:teuthology.orchestra.run.smithi040:> test -z $(ls -A /var/lib/ceph) 2023-10-08T05:56:09.140 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-10-08T05:56:09.196 INFO:teuthology.run_tasks:Running task kernel... 2023-10-08T05:56:09.211 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2023-10-08T05:56:09.211 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2023-10-08T05:56:09.212 DEBUG:teuthology.orchestra.run.smithi032:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-08T05:56:09.212 DEBUG:teuthology.orchestra.run.smithi040:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-08T05:56:09.217 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T05:56:09.218 DEBUG:teuthology.orchestra.run.smithi032:> uname -r 2023-10-08T05:56:09.218 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T05:56:09.219 DEBUG:teuthology.orchestra.run.smithi040:> uname -r 2023-10-08T05:56:09.225 INFO:teuthology.orchestra.run.smithi032.stdout:5.4.0-124-generic 2023-10-08T05:56:09.225 INFO:teuthology.task.kernel:Running kernel on smithi032: 5.4.0-124-generic 2023-10-08T05:56:09.225 DEBUG:teuthology.orchestra.run.smithi032:> sudo apt-get clean 2023-10-08T05:56:09.226 INFO:teuthology.orchestra.run.smithi040.stdout:5.4.0-124-generic 2023-10-08T05:56:09.226 INFO:teuthology.task.kernel:Running kernel on smithi040: 5.4.0-124-generic 2023-10-08T05:56:09.227 DEBUG:teuthology.orchestra.run.smithi040:> sudo apt-get clean 2023-10-08T05:56:09.339 DEBUG:teuthology.orchestra.run.smithi032:> sudo apt-get update 2023-10-08T05:56:09.377 DEBUG:teuthology.orchestra.run.smithi040:> sudo apt-get update 2023-10-08T05:56:09.505 INFO:teuthology.orchestra.run.smithi032.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2023-10-08T05:56:09.507 INFO:teuthology.orchestra.run.smithi032.stdout:Get:2 http://security.ubuntu.com/ubuntu focal-security InRelease [114 kB] 2023-10-08T05:56:09.511 INFO:teuthology.orchestra.run.smithi032.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease [114 kB] 2023-10-08T05:56:09.540 INFO:teuthology.orchestra.run.smithi040.stdout:Get:1 http://security.ubuntu.com/ubuntu focal-security InRelease [114 kB] 2023-10-08T05:56:09.593 INFO:teuthology.orchestra.run.smithi032.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease [108 kB] 2023-10-08T05:56:09.647 INFO:teuthology.orchestra.run.smithi040.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal InRelease 2023-10-08T05:56:09.729 INFO:teuthology.orchestra.run.smithi040.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease [114 kB] 2023-10-08T05:56:09.869 INFO:teuthology.orchestra.run.smithi040.stdout:Get:4 http://security.ubuntu.com/ubuntu focal-security/main amd64 Packages [2,500 kB] 2023-10-08T05:56:09.899 INFO:teuthology.orchestra.run.smithi032.stdout:Get:5 http://security.ubuntu.com/ubuntu focal-security/main amd64 Packages [2,500 kB] 2023-10-08T05:56:10.024 INFO:teuthology.orchestra.run.smithi032.stdout:Get:6 http://security.ubuntu.com/ubuntu focal-security/main i386 Packages [660 kB] 2023-10-08T05:56:10.029 INFO:teuthology.orchestra.run.smithi032.stdout:Get:7 http://security.ubuntu.com/ubuntu focal-security/main Translation-en [390 kB] 2023-10-08T05:56:10.031 INFO:teuthology.orchestra.run.smithi040.stdout:Get:5 http://security.ubuntu.com/ubuntu focal-security/main i386 Packages [660 kB] 2023-10-08T05:56:10.033 INFO:teuthology.orchestra.run.smithi032.stdout:Get:8 http://security.ubuntu.com/ubuntu focal-security/main amd64 c-n-f Metadata [13.2 kB] 2023-10-08T05:56:10.034 INFO:teuthology.orchestra.run.smithi032.stdout:Get:9 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 Packages [2,267 kB] 2023-10-08T05:56:10.038 INFO:teuthology.orchestra.run.smithi040.stdout:Get:6 http://security.ubuntu.com/ubuntu focal-security/main Translation-en [390 kB] 2023-10-08T05:56:10.043 INFO:teuthology.orchestra.run.smithi040.stdout:Get:7 http://security.ubuntu.com/ubuntu focal-security/main amd64 c-n-f Metadata [13.2 kB] 2023-10-08T05:56:10.044 INFO:teuthology.orchestra.run.smithi040.stdout:Get:8 http://security.ubuntu.com/ubuntu focal-security/restricted i386 Packages [33.3 kB] 2023-10-08T05:56:10.044 INFO:teuthology.orchestra.run.smithi040.stdout:Get:9 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 Packages [2,267 kB] 2023-10-08T05:56:10.053 INFO:teuthology.orchestra.run.smithi032.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 Packages [2,888 kB] 2023-10-08T05:56:10.055 INFO:teuthology.orchestra.run.smithi032.stdout:Get:11 http://security.ubuntu.com/ubuntu focal-security/restricted i386 Packages [33.3 kB] 2023-10-08T05:56:10.056 INFO:teuthology.orchestra.run.smithi032.stdout:Get:12 http://security.ubuntu.com/ubuntu focal-security/restricted Translation-en [317 kB] 2023-10-08T05:56:10.059 INFO:teuthology.orchestra.run.smithi032.stdout:Get:13 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 c-n-f Metadata [572 B] 2023-10-08T05:56:10.059 INFO:teuthology.orchestra.run.smithi032.stdout:Get:14 http://security.ubuntu.com/ubuntu focal-security/universe i386 Packages [616 kB] 2023-10-08T05:56:10.063 INFO:teuthology.orchestra.run.smithi032.stdout:Get:15 http://security.ubuntu.com/ubuntu focal-security/universe amd64 Packages [890 kB] 2023-10-08T05:56:10.071 INFO:teuthology.orchestra.run.smithi032.stdout:Get:16 http://security.ubuntu.com/ubuntu focal-security/universe Translation-en [186 kB] 2023-10-08T05:56:10.073 INFO:teuthology.orchestra.run.smithi040.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal-backports InRelease [108 kB] 2023-10-08T05:56:10.073 INFO:teuthology.orchestra.run.smithi040.stdout:Get:11 http://security.ubuntu.com/ubuntu focal-security/restricted Translation-en [317 kB] 2023-10-08T05:56:10.074 INFO:teuthology.orchestra.run.smithi032.stdout:Get:17 http://security.ubuntu.com/ubuntu focal-security/universe amd64 c-n-f Metadata [19.1 kB] 2023-10-08T05:56:10.074 INFO:teuthology.orchestra.run.smithi032.stdout:Get:18 http://security.ubuntu.com/ubuntu focal-security/multiverse i386 Packages [7,196 B] 2023-10-08T05:56:10.074 INFO:teuthology.orchestra.run.smithi032.stdout:Get:19 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 Packages [23.6 kB] 2023-10-08T05:56:10.076 INFO:teuthology.orchestra.run.smithi040.stdout:Get:12 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 c-n-f Metadata [572 B] 2023-10-08T05:56:10.076 INFO:teuthology.orchestra.run.smithi040.stdout:Get:13 http://security.ubuntu.com/ubuntu focal-security/universe amd64 Packages [890 kB] 2023-10-08T05:56:10.080 INFO:teuthology.orchestra.run.smithi032.stdout:Get:20 http://security.ubuntu.com/ubuntu focal-security/multiverse Translation-en [5,504 B] 2023-10-08T05:56:10.081 INFO:teuthology.orchestra.run.smithi032.stdout:Get:21 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 c-n-f Metadata [548 B] 2023-10-08T05:56:10.082 INFO:teuthology.orchestra.run.smithi040.stdout:Get:14 http://security.ubuntu.com/ubuntu focal-security/universe i386 Packages [616 kB] 2023-10-08T05:56:10.086 INFO:teuthology.orchestra.run.smithi040.stdout:Get:15 http://security.ubuntu.com/ubuntu focal-security/universe Translation-en [186 kB] 2023-10-08T05:56:10.088 INFO:teuthology.orchestra.run.smithi040.stdout:Get:16 http://security.ubuntu.com/ubuntu focal-security/universe amd64 c-n-f Metadata [19.1 kB] 2023-10-08T05:56:10.093 INFO:teuthology.orchestra.run.smithi040.stdout:Get:17 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 Packages [23.6 kB] 2023-10-08T05:56:10.093 INFO:teuthology.orchestra.run.smithi040.stdout:Get:18 http://security.ubuntu.com/ubuntu focal-security/multiverse i386 Packages [7,196 B] 2023-10-08T05:56:10.093 INFO:teuthology.orchestra.run.smithi040.stdout:Get:19 http://security.ubuntu.com/ubuntu focal-security/multiverse Translation-en [5,504 B] 2023-10-08T05:56:10.112 INFO:teuthology.orchestra.run.smithi040.stdout:Get:20 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 c-n-f Metadata [548 B] 2023-10-08T05:56:10.187 INFO:teuthology.orchestra.run.smithi032.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/main i386 Packages [893 kB] 2023-10-08T05:56:10.197 INFO:teuthology.orchestra.run.smithi032.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/main Translation-en [473 kB] 2023-10-08T05:56:10.201 INFO:teuthology.orchestra.run.smithi032.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 c-n-f Metadata [17.1 kB] 2023-10-08T05:56:10.201 INFO:teuthology.orchestra.run.smithi032.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 Packages [2,383 kB] 2023-10-08T05:56:10.219 INFO:teuthology.orchestra.run.smithi040.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 Packages [2,888 kB] 2023-10-08T05:56:10.225 INFO:teuthology.orchestra.run.smithi032.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-updates/restricted i386 Packages [34.6 kB] 2023-10-08T05:56:10.225 INFO:teuthology.orchestra.run.smithi032.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal-updates/restricted Translation-en [334 kB] 2023-10-08T05:56:10.228 INFO:teuthology.orchestra.run.smithi032.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 c-n-f Metadata [572 B] 2023-10-08T05:56:10.229 INFO:teuthology.orchestra.run.smithi032.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal-updates/universe i386 Packages [749 kB] 2023-10-08T05:56:10.236 INFO:teuthology.orchestra.run.smithi032.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 Packages [1,121 kB] 2023-10-08T05:56:10.247 INFO:teuthology.orchestra.run.smithi032.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/universe Translation-en [268 kB] 2023-10-08T05:56:10.250 INFO:teuthology.orchestra.run.smithi032.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 c-n-f Metadata [25.6 kB] 2023-10-08T05:56:10.253 INFO:teuthology.orchestra.run.smithi032.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-updates/multiverse i386 Packages [8,436 B] 2023-10-08T05:56:10.253 INFO:teuthology.orchestra.run.smithi032.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 Packages [25.8 kB] 2023-10-08T05:56:10.254 INFO:teuthology.orchestra.run.smithi032.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/multiverse Translation-en [7,484 B] 2023-10-08T05:56:10.254 INFO:teuthology.orchestra.run.smithi032.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 c-n-f Metadata [620 B] 2023-10-08T05:56:10.271 INFO:teuthology.orchestra.run.smithi032.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal-backports/main i386 Packages [36.1 kB] 2023-10-08T05:56:10.271 INFO:teuthology.orchestra.run.smithi032.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 Packages [45.7 kB] 2023-10-08T05:56:10.272 INFO:teuthology.orchestra.run.smithi032.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 c-n-f Metadata [1,420 B] 2023-10-08T05:56:10.272 INFO:teuthology.orchestra.run.smithi032.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal-backports/universe i386 Packages [13.8 kB] 2023-10-08T05:56:10.273 INFO:teuthology.orchestra.run.smithi032.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 Packages [25.0 kB] 2023-10-08T05:56:10.273 INFO:teuthology.orchestra.run.smithi032.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 c-n-f Metadata [880 B] 2023-10-08T05:56:10.600 INFO:teuthology.orchestra.run.smithi040.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/main i386 Packages [893 kB] 2023-10-08T05:56:10.630 INFO:teuthology.orchestra.run.smithi040.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/main Translation-en [473 kB] 2023-10-08T05:56:10.643 INFO:teuthology.orchestra.run.smithi040.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 c-n-f Metadata [17.1 kB] 2023-10-08T05:56:10.643 INFO:teuthology.orchestra.run.smithi040.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/restricted i386 Packages [34.6 kB] 2023-10-08T05:56:10.644 INFO:teuthology.orchestra.run.smithi040.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 Packages [2,383 kB] 2023-10-08T05:56:10.704 INFO:teuthology.orchestra.run.smithi040.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal-updates/restricted Translation-en [334 kB] 2023-10-08T05:56:10.725 INFO:teuthology.orchestra.run.smithi040.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 c-n-f Metadata [572 B] 2023-10-08T05:56:10.888 INFO:teuthology.orchestra.run.smithi040.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 Packages [1,121 kB] 2023-10-08T05:56:11.522 INFO:teuthology.orchestra.run.smithi040.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal-updates/universe i386 Packages [749 kB] 2023-10-08T05:56:11.560 INFO:teuthology.orchestra.run.smithi040.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/universe Translation-en [268 kB] 2023-10-08T05:56:11.574 INFO:teuthology.orchestra.run.smithi040.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 c-n-f Metadata [25.6 kB] 2023-10-08T05:56:11.575 INFO:teuthology.orchestra.run.smithi040.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-updates/multiverse i386 Packages [8,436 B] 2023-10-08T05:56:11.575 INFO:teuthology.orchestra.run.smithi040.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 Packages [25.8 kB] 2023-10-08T05:56:11.577 INFO:teuthology.orchestra.run.smithi040.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/multiverse Translation-en [7,484 B] 2023-10-08T05:56:11.577 INFO:teuthology.orchestra.run.smithi040.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 c-n-f Metadata [620 B] 2023-10-08T05:56:11.577 INFO:teuthology.orchestra.run.smithi040.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 Packages [45.7 kB] 2023-10-08T05:56:11.603 INFO:teuthology.orchestra.run.smithi040.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal-backports/main i386 Packages [36.1 kB] 2023-10-08T05:56:11.605 INFO:teuthology.orchestra.run.smithi040.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 c-n-f Metadata [1,420 B] 2023-10-08T05:56:11.769 INFO:teuthology.orchestra.run.smithi040.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal-backports/universe i386 Packages [13.8 kB] 2023-10-08T05:56:11.932 INFO:teuthology.orchestra.run.smithi040.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 Packages [25.0 kB] 2023-10-08T05:56:11.984 INFO:teuthology.orchestra.run.smithi040.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 c-n-f Metadata [880 B] 2023-10-08T05:56:14.040 INFO:teuthology.orchestra.run.smithi032.stdout:Fetched 17.6 MB in 3s (6,632 kB/s) 2023-10-08T05:56:14.149 INFO:teuthology.orchestra.run.smithi040.stdout:Fetched 17.6 MB in 3s (6,691 kB/s) 2023-10-08T05:56:15.550 INFO:teuthology.orchestra.run.smithi032.stdout:Reading package lists... 2023-10-08T05:56:15.578 DEBUG:teuthology.orchestra.run.smithi032:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2023-10-08T05:56:15.596 INFO:teuthology.orchestra.run.smithi040.stdout:Reading package lists... 2023-10-08T05:56:15.621 DEBUG:teuthology.orchestra.run.smithi040:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2023-10-08T05:56:15.654 INFO:teuthology.orchestra.run.smithi032.stdout:Reading package lists... 2023-10-08T05:56:15.701 INFO:teuthology.orchestra.run.smithi040.stdout:Reading package lists... 2023-10-08T05:56:15.860 INFO:teuthology.orchestra.run.smithi032.stdout:Building dependency tree... 2023-10-08T05:56:15.860 INFO:teuthology.orchestra.run.smithi032.stdout:Reading state information... 2023-10-08T05:56:15.908 INFO:teuthology.orchestra.run.smithi040.stdout:Building dependency tree... 2023-10-08T05:56:15.909 INFO:teuthology.orchestra.run.smithi040.stdout:Reading state information... 2023-10-08T05:56:16.062 INFO:teuthology.orchestra.run.smithi032.stdout:The following additional packages will be installed: 2023-10-08T05:56:16.063 INFO:teuthology.orchestra.run.smithi032.stdout: linux-generic linux-headers-5.4.0-164 linux-headers-5.4.0-164-generic 2023-10-08T05:56:16.063 INFO:teuthology.orchestra.run.smithi032.stdout: linux-headers-generic linux-image-5.4.0-164-generic 2023-10-08T05:56:16.063 INFO:teuthology.orchestra.run.smithi032.stdout: linux-modules-5.4.0-164-generic linux-modules-extra-5.4.0-164-generic 2023-10-08T05:56:16.064 INFO:teuthology.orchestra.run.smithi032.stdout:Suggested packages: 2023-10-08T05:56:16.064 INFO:teuthology.orchestra.run.smithi032.stdout: fdutils linux-doc | linux-source-5.4.0 linux-tools 2023-10-08T05:56:16.064 INFO:teuthology.orchestra.run.smithi032.stdout:Recommended packages: 2023-10-08T05:56:16.064 INFO:teuthology.orchestra.run.smithi032.stdout: thermald 2023-10-08T05:56:16.111 INFO:teuthology.orchestra.run.smithi032.stdout:The following NEW packages will be installed: 2023-10-08T05:56:16.111 INFO:teuthology.orchestra.run.smithi032.stdout: linux-headers-5.4.0-164 linux-headers-5.4.0-164-generic 2023-10-08T05:56:16.111 INFO:teuthology.orchestra.run.smithi032.stdout: linux-image-5.4.0-164-generic linux-modules-5.4.0-164-generic 2023-10-08T05:56:16.111 INFO:teuthology.orchestra.run.smithi032.stdout: linux-modules-extra-5.4.0-164-generic 2023-10-08T05:56:16.113 INFO:teuthology.orchestra.run.smithi032.stdout:The following packages will be upgraded: 2023-10-08T05:56:16.113 INFO:teuthology.orchestra.run.smithi032.stdout: linux-generic linux-headers-generic linux-image-generic 2023-10-08T05:56:16.113 INFO:teuthology.orchestra.run.smithi040.stdout:The following additional packages will be installed: 2023-10-08T05:56:16.113 INFO:teuthology.orchestra.run.smithi040.stdout: linux-generic linux-headers-5.4.0-164 linux-headers-5.4.0-164-generic 2023-10-08T05:56:16.114 INFO:teuthology.orchestra.run.smithi040.stdout: linux-headers-generic linux-image-5.4.0-164-generic 2023-10-08T05:56:16.114 INFO:teuthology.orchestra.run.smithi040.stdout: linux-modules-5.4.0-164-generic linux-modules-extra-5.4.0-164-generic 2023-10-08T05:56:16.114 INFO:teuthology.orchestra.run.smithi040.stdout:Suggested packages: 2023-10-08T05:56:16.114 INFO:teuthology.orchestra.run.smithi040.stdout: fdutils linux-doc | linux-source-5.4.0 linux-tools 2023-10-08T05:56:16.114 INFO:teuthology.orchestra.run.smithi040.stdout:Recommended packages: 2023-10-08T05:56:16.115 INFO:teuthology.orchestra.run.smithi040.stdout: thermald 2023-10-08T05:56:16.173 INFO:teuthology.orchestra.run.smithi040.stdout:The following NEW packages will be installed: 2023-10-08T05:56:16.173 INFO:teuthology.orchestra.run.smithi040.stdout: linux-headers-5.4.0-164 linux-headers-5.4.0-164-generic 2023-10-08T05:56:16.174 INFO:teuthology.orchestra.run.smithi040.stdout: linux-image-5.4.0-164-generic linux-modules-5.4.0-164-generic 2023-10-08T05:56:16.174 INFO:teuthology.orchestra.run.smithi040.stdout: linux-modules-extra-5.4.0-164-generic 2023-10-08T05:56:16.175 INFO:teuthology.orchestra.run.smithi040.stdout:The following packages will be upgraded: 2023-10-08T05:56:16.176 INFO:teuthology.orchestra.run.smithi040.stdout: linux-generic linux-headers-generic linux-image-generic 2023-10-08T05:56:16.230 INFO:teuthology.orchestra.run.smithi040.stdout:3 upgraded, 5 newly installed, 0 to remove and 271 not upgraded. 2023-10-08T05:56:16.230 INFO:teuthology.orchestra.run.smithi040.stdout:Need to get 77.0 MB of archives. 2023-10-08T05:56:16.230 INFO:teuthology.orchestra.run.smithi040.stdout:After this operation, 380 MB of additional disk space will be used. 2023-10-08T05:56:16.230 INFO:teuthology.orchestra.run.smithi040.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-5.4.0-164-generic amd64 5.4.0-164.181 [14.9 MB] 2023-10-08T05:56:16.292 INFO:teuthology.orchestra.run.smithi032.stdout:3 upgraded, 5 newly installed, 0 to remove and 271 not upgraded. 2023-10-08T05:56:16.292 INFO:teuthology.orchestra.run.smithi032.stdout:Need to get 77.0 MB of archives. 2023-10-08T05:56:16.293 INFO:teuthology.orchestra.run.smithi032.stdout:After this operation, 380 MB of additional disk space will be used. 2023-10-08T05:56:16.293 INFO:teuthology.orchestra.run.smithi032.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-5.4.0-164-generic amd64 5.4.0-164.181 [14.9 MB] 2023-10-08T05:56:16.545 INFO:teuthology.orchestra.run.smithi040.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-5.4.0-164-generic amd64 5.4.0-164.181 [10.5 MB] 2023-10-08T05:56:16.640 INFO:teuthology.orchestra.run.smithi040.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-extra-5.4.0-164-generic amd64 5.4.0-164.181 [39.2 MB] 2023-10-08T05:56:17.112 INFO:teuthology.orchestra.run.smithi040.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-generic amd64 5.4.0.164.161 [1,896 B] 2023-10-08T05:56:17.113 INFO:teuthology.orchestra.run.smithi040.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-generic amd64 5.4.0.164.161 [2,592 B] 2023-10-08T05:56:17.113 INFO:teuthology.orchestra.run.smithi040.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-164 all 5.4.0-164.181 [11.0 MB] 2023-10-08T05:56:17.209 INFO:teuthology.orchestra.run.smithi040.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-164-generic amd64 5.4.0-164.181 [1,360 kB] 2023-10-08T05:56:17.220 INFO:teuthology.orchestra.run.smithi040.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-generic amd64 5.4.0.164.161 [2,468 B] 2023-10-08T05:56:17.461 INFO:teuthology.orchestra.run.smithi032.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-5.4.0-164-generic amd64 5.4.0-164.181 [10.5 MB] 2023-10-08T05:56:17.730 INFO:teuthology.orchestra.run.smithi032.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-extra-5.4.0-164-generic amd64 5.4.0-164.181 [39.2 MB] 2023-10-08T05:56:17.956 INFO:teuthology.orchestra.run.smithi040.stdout:Fetched 77.0 MB in 1s (74.2 MB/s) 2023-10-08T05:56:18.147 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package linux-modules-5.4.0-164-generic. 2023-10-08T05:56:19.075 INFO:teuthology.orchestra.run.smithi032.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-generic amd64 5.4.0.164.161 [1,896 B] 2023-10-08T05:56:19.075 INFO:teuthology.orchestra.run.smithi032.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-generic amd64 5.4.0.164.161 [2,592 B] 2023-10-08T05:56:19.075 INFO:teuthology.orchestra.run.smithi032.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-164 all 5.4.0-164.181 [11.0 MB] 2023-10-08T05:56:19.364 INFO:teuthology.orchestra.run.smithi032.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-164-generic amd64 5.4.0-164.181 [1,360 kB] 2023-10-08T05:56:19.406 INFO:teuthology.orchestra.run.smithi032.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-generic amd64 5.4.0.164.161 [2,468 B] 2023-10-08T05:56:19.870 INFO:teuthology.orchestra.run.smithi040.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 104373 files and directories currently installed.) 2023-10-08T05:56:19.875 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../0-linux-modules-5.4.0-164-generic_5.4.0-164.181_amd64.deb ... 2023-10-08T05:56:20.019 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking linux-modules-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-08T05:56:20.047 INFO:teuthology.orchestra.run.smithi032.stdout:Fetched 77.0 MB in 3s (23.4 MB/s) 2023-10-08T05:56:20.257 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package linux-modules-5.4.0-164-generic. 2023-10-08T05:56:21.945 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package linux-image-5.4.0-164-generic. 2023-10-08T05:56:21.961 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../1-linux-image-5.4.0-164-generic_5.4.0-164.181_amd64.deb ... 2023-10-08T05:56:22.072 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking linux-image-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-08T05:56:22.074 INFO:teuthology.orchestra.run.smithi032.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 104373 files and directories currently installed.) 2023-10-08T05:56:22.079 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../0-linux-modules-5.4.0-164-generic_5.4.0-164.181_amd64.deb ... 2023-10-08T05:56:22.172 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking linux-modules-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-08T05:56:23.198 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package linux-modules-extra-5.4.0-164-generic. 2023-10-08T05:56:23.213 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../2-linux-modules-extra-5.4.0-164-generic_5.4.0-164.181_amd64.deb ... 2023-10-08T05:56:23.256 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking linux-modules-extra-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-08T05:56:24.140 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package linux-image-5.4.0-164-generic. 2023-10-08T05:56:24.157 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../1-linux-image-5.4.0-164-generic_5.4.0-164.181_amd64.deb ... 2023-10-08T05:56:24.290 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking linux-image-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-08T05:56:25.402 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package linux-modules-extra-5.4.0-164-generic. 2023-10-08T05:56:25.416 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../2-linux-modules-extra-5.4.0-164-generic_5.4.0-164.181_amd64.deb ... 2023-10-08T05:56:25.460 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking linux-modules-extra-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-08T05:56:28.245 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../3-linux-generic_5.4.0.164.161_amd64.deb ... 2023-10-08T05:56:28.379 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking linux-generic (5.4.0.164.161) over (5.4.0.124.125) ... 2023-10-08T05:56:28.716 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../4-linux-image-generic_5.4.0.164.161_amd64.deb ... 2023-10-08T05:56:28.841 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking linux-image-generic (5.4.0.164.161) over (5.4.0.124.125) ... 2023-10-08T05:56:29.178 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package linux-headers-5.4.0-164. 2023-10-08T05:56:29.194 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../5-linux-headers-5.4.0-164_5.4.0-164.181_all.deb ... 2023-10-08T05:56:29.236 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking linux-headers-5.4.0-164 (5.4.0-164.181) ... 2023-10-08T05:56:30.349 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../3-linux-generic_5.4.0.164.161_amd64.deb ... 2023-10-08T05:56:30.473 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking linux-generic (5.4.0.164.161) over (5.4.0.124.125) ... 2023-10-08T05:56:30.822 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../4-linux-image-generic_5.4.0.164.161_amd64.deb ... 2023-10-08T05:56:30.926 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking linux-image-generic (5.4.0.164.161) over (5.4.0.124.125) ... 2023-10-08T05:56:31.213 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package linux-headers-5.4.0-164. 2023-10-08T05:56:31.228 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../5-linux-headers-5.4.0-164_5.4.0-164.181_all.deb ... 2023-10-08T05:56:31.271 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking linux-headers-5.4.0-164 (5.4.0-164.181) ... 2023-10-08T05:56:35.389 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package linux-headers-5.4.0-164-generic. 2023-10-08T05:56:35.411 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../6-linux-headers-5.4.0-164-generic_5.4.0-164.181_amd64.deb ... 2023-10-08T05:56:35.486 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking linux-headers-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-08T05:56:36.760 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package linux-headers-5.4.0-164-generic. 2023-10-08T05:56:36.782 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../6-linux-headers-5.4.0-164-generic_5.4.0-164.181_amd64.deb ... 2023-10-08T05:56:36.826 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking linux-headers-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-08T05:56:38.352 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../7-linux-headers-generic_5.4.0.164.161_amd64.deb ... 2023-10-08T05:56:38.546 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking linux-headers-generic (5.4.0.164.161) over (5.4.0.124.125) ... 2023-10-08T05:56:38.888 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up linux-headers-5.4.0-164 (5.4.0-164.181) ... 2023-10-08T05:56:39.034 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up linux-headers-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-08T05:56:39.160 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up linux-modules-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-08T05:56:39.653 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../7-linux-headers-generic_5.4.0.164.161_amd64.deb ... 2023-10-08T05:56:39.788 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking linux-headers-generic (5.4.0.164.161) over (5.4.0.124.125) ... 2023-10-08T05:56:40.146 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up linux-headers-5.4.0-164 (5.4.0-164.181) ... 2023-10-08T05:56:40.276 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up linux-headers-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-08T05:56:40.436 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up linux-modules-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-08T05:56:40.453 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up linux-image-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-08T05:56:41.622 INFO:teuthology.orchestra.run.smithi040.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.4.0-164-generic 2023-10-08T05:56:41.622 INFO:teuthology.orchestra.run.smithi040.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.4.0-164-generic 2023-10-08T05:56:41.755 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up linux-headers-generic (5.4.0.164.161) ... 2023-10-08T05:56:41.906 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up linux-modules-extra-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-08T05:56:41.991 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up linux-image-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-08T05:56:43.150 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up linux-image-generic (5.4.0.164.161) ... 2023-10-08T05:56:43.417 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up linux-generic (5.4.0.164.161) ... 2023-10-08T05:56:43.558 INFO:teuthology.orchestra.run.smithi040.stdout:Processing triggers for linux-image-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-08T05:56:43.918 INFO:teuthology.orchestra.run.smithi032.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.4.0-164-generic 2023-10-08T05:56:43.919 INFO:teuthology.orchestra.run.smithi032.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.4.0-164-generic 2023-10-08T05:56:44.049 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up linux-headers-generic (5.4.0.164.161) ... 2023-10-08T05:56:44.317 INFO:teuthology.orchestra.run.smithi040.stdout:/etc/kernel/postinst.d/initramfs-tools: 2023-10-08T05:56:44.317 INFO:teuthology.orchestra.run.smithi040.stdout:update-initramfs: Generating /boot/initrd.img-5.4.0-164-generic 2023-10-08T05:56:44.334 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up linux-modules-extra-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-08T05:56:45.552 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up linux-image-generic (5.4.0.164.161) ... 2023-10-08T05:56:45.703 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up linux-generic (5.4.0.164.161) ... 2023-10-08T05:56:45.830 INFO:teuthology.orchestra.run.smithi032.stdout:Processing triggers for linux-image-5.4.0-164-generic (5.4.0-164.181) ... 2023-10-08T05:56:45.906 INFO:teuthology.orchestra.run.smithi032.stdout:/etc/kernel/postinst.d/initramfs-tools: 2023-10-08T05:56:45.906 INFO:teuthology.orchestra.run.smithi032.stdout:update-initramfs: Generating /boot/initrd.img-5.4.0-164-generic 2023-10-08T05:57:07.475 INFO:teuthology.orchestra.run.smithi040.stdout:/etc/kernel/postinst.d/zz-update-grub: 2023-10-08T05:57:07.475 INFO:teuthology.orchestra.run.smithi040.stdout:Sourcing file `/etc/default/grub' 2023-10-08T05:57:07.491 INFO:teuthology.orchestra.run.smithi040.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-10-08T05:57:07.503 INFO:teuthology.orchestra.run.smithi040.stdout:Generating grub configuration file ... 2023-10-08T05:57:07.910 INFO:teuthology.orchestra.run.smithi040.stdout:Found linux image: /boot/vmlinuz-5.4.0-164-generic 2023-10-08T05:57:07.933 INFO:teuthology.orchestra.run.smithi040.stdout:Found initrd image: /boot/initrd.img-5.4.0-164-generic 2023-10-08T05:57:08.395 INFO:teuthology.orchestra.run.smithi032.stdout:/etc/kernel/postinst.d/zz-update-grub: 2023-10-08T05:57:08.396 INFO:teuthology.orchestra.run.smithi032.stdout:Sourcing file `/etc/default/grub' 2023-10-08T05:57:08.406 INFO:teuthology.orchestra.run.smithi032.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-10-08T05:57:08.412 INFO:teuthology.orchestra.run.smithi040.stdout:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2023-10-08T05:57:08.424 INFO:teuthology.orchestra.run.smithi040.stdout:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2023-10-08T05:57:08.429 INFO:teuthology.orchestra.run.smithi032.stdout:Generating grub configuration file ... 2023-10-08T05:57:08.749 INFO:teuthology.orchestra.run.smithi032.stdout:Found linux image: /boot/vmlinuz-5.4.0-164-generic 2023-10-08T05:57:08.769 INFO:teuthology.orchestra.run.smithi032.stdout:Found initrd image: /boot/initrd.img-5.4.0-164-generic 2023-10-08T05:57:09.148 INFO:teuthology.orchestra.run.smithi032.stdout:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2023-10-08T05:57:09.160 INFO:teuthology.orchestra.run.smithi032.stdout:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2023-10-08T05:57:11.320 INFO:teuthology.orchestra.run.smithi040.stdout:done 2023-10-08T05:57:11.742 DEBUG:teuthology.orchestra.run.smithi040:> dpkg -s linux-image-generic 2023-10-08T05:57:11.794 INFO:teuthology.orchestra.run.smithi040.stdout:Package: linux-image-generic 2023-10-08T05:57:11.794 INFO:teuthology.orchestra.run.smithi040.stdout:Status: install ok installed 2023-10-08T05:57:11.794 INFO:teuthology.orchestra.run.smithi040.stdout:Priority: optional 2023-10-08T05:57:11.795 INFO:teuthology.orchestra.run.smithi040.stdout:Section: kernel 2023-10-08T05:57:11.795 INFO:teuthology.orchestra.run.smithi040.stdout:Installed-Size: 20 2023-10-08T05:57:11.795 INFO:teuthology.orchestra.run.smithi040.stdout:Maintainer: Ubuntu Kernel Team 2023-10-08T05:57:11.795 INFO:teuthology.orchestra.run.smithi040.stdout:Architecture: amd64 2023-10-08T05:57:11.795 INFO:teuthology.orchestra.run.smithi040.stdout:Source: linux-meta 2023-10-08T05:57:11.795 INFO:teuthology.orchestra.run.smithi040.stdout:Version: 5.4.0.164.161 2023-10-08T05:57:11.795 INFO:teuthology.orchestra.run.smithi040.stdout:Provides: virtualbox-guest-modules (= 6.1.38-dfsg-3~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.15) 2023-10-08T05:57:11.795 INFO:teuthology.orchestra.run.smithi040.stdout:Depends: linux-image-5.4.0-164-generic, linux-modules-extra-5.4.0-164-generic, linux-firmware, intel-microcode, amd64-microcode 2023-10-08T05:57:11.796 INFO:teuthology.orchestra.run.smithi040.stdout:Recommends: thermald 2023-10-08T05:57:11.796 INFO:teuthology.orchestra.run.smithi040.stdout:Description: Generic Linux kernel image 2023-10-08T05:57:11.796 INFO:teuthology.orchestra.run.smithi040.stdout: This package will always depend on the latest generic kernel image 2023-10-08T05:57:11.796 INFO:teuthology.orchestra.run.smithi040.stdout: available. 2023-10-08T05:57:11.796 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.4.0-124-generic Expected: 5.4.0-164-generic 2023-10-08T05:57:11.796 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-10-08T05:57:11.796 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-10-08T05:57:11.797 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2023-10-08T05:57:11.797 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi040.front.sepia.ceph.com, path=None, version=distro) 2023-10-08T05:57:11.797 DEBUG:teuthology.orchestra.run.smithi040:> sudo apt-get clean 2023-10-08T05:57:11.887 DEBUG:teuthology.orchestra.run.smithi040:> sudo apt-get update 2023-10-08T05:57:12.032 INFO:teuthology.orchestra.run.smithi040.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2023-10-08T05:57:12.032 INFO:teuthology.orchestra.run.smithi040.stdout:Hit:2 http://security.ubuntu.com/ubuntu focal-security InRelease 2023-10-08T05:57:12.040 INFO:teuthology.orchestra.run.smithi040.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2023-10-08T05:57:12.060 INFO:teuthology.orchestra.run.smithi040.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2023-10-08T05:57:12.134 INFO:teuthology.orchestra.run.smithi032.stdout:done 2023-10-08T05:57:12.601 DEBUG:teuthology.orchestra.run.smithi032:> dpkg -s linux-image-generic 2023-10-08T05:57:12.649 INFO:teuthology.orchestra.run.smithi032.stdout:Package: linux-image-generic 2023-10-08T05:57:12.649 INFO:teuthology.orchestra.run.smithi032.stdout:Status: install ok installed 2023-10-08T05:57:12.649 INFO:teuthology.orchestra.run.smithi032.stdout:Priority: optional 2023-10-08T05:57:12.649 INFO:teuthology.orchestra.run.smithi032.stdout:Section: kernel 2023-10-08T05:57:12.649 INFO:teuthology.orchestra.run.smithi032.stdout:Installed-Size: 20 2023-10-08T05:57:12.649 INFO:teuthology.orchestra.run.smithi032.stdout:Maintainer: Ubuntu Kernel Team 2023-10-08T05:57:12.649 INFO:teuthology.orchestra.run.smithi032.stdout:Architecture: amd64 2023-10-08T05:57:12.650 INFO:teuthology.orchestra.run.smithi032.stdout:Source: linux-meta 2023-10-08T05:57:12.650 INFO:teuthology.orchestra.run.smithi032.stdout:Version: 5.4.0.164.161 2023-10-08T05:57:12.650 INFO:teuthology.orchestra.run.smithi032.stdout:Provides: virtualbox-guest-modules (= 6.1.38-dfsg-3~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.15) 2023-10-08T05:57:12.650 INFO:teuthology.orchestra.run.smithi032.stdout:Depends: linux-image-5.4.0-164-generic, linux-modules-extra-5.4.0-164-generic, linux-firmware, intel-microcode, amd64-microcode 2023-10-08T05:57:12.650 INFO:teuthology.orchestra.run.smithi032.stdout:Recommends: thermald 2023-10-08T05:57:12.650 INFO:teuthology.orchestra.run.smithi032.stdout:Description: Generic Linux kernel image 2023-10-08T05:57:12.650 INFO:teuthology.orchestra.run.smithi032.stdout: This package will always depend on the latest generic kernel image 2023-10-08T05:57:12.650 INFO:teuthology.orchestra.run.smithi032.stdout: available. 2023-10-08T05:57:12.650 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.4.0-124-generic Expected: 5.4.0-164-generic 2023-10-08T05:57:12.650 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-10-08T05:57:12.651 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-10-08T05:57:12.651 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2023-10-08T05:57:12.651 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi032.front.sepia.ceph.com, path=None, version=distro) 2023-10-08T05:57:12.651 DEBUG:teuthology.orchestra.run.smithi032:> sudo apt-get clean 2023-10-08T05:57:12.722 DEBUG:teuthology.orchestra.run.smithi032:> sudo apt-get update 2023-10-08T05:57:12.852 INFO:teuthology.orchestra.run.smithi032.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2023-10-08T05:57:12.853 INFO:teuthology.orchestra.run.smithi032.stdout:Hit:2 http://security.ubuntu.com/ubuntu focal-security InRelease 2023-10-08T05:57:12.857 INFO:teuthology.orchestra.run.smithi032.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2023-10-08T05:57:12.875 INFO:teuthology.orchestra.run.smithi032.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2023-10-08T05:57:13.813 INFO:teuthology.orchestra.run.smithi040.stdout:Reading package lists... 2023-10-08T05:57:13.838 DEBUG:teuthology.orchestra.run.smithi040:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2023-10-08T05:57:13.906 INFO:teuthology.orchestra.run.smithi040.stdout:Reading package lists... 2023-10-08T05:57:14.091 INFO:teuthology.orchestra.run.smithi040.stdout:Building dependency tree... 2023-10-08T05:57:14.091 INFO:teuthology.orchestra.run.smithi040.stdout:Reading state information... 2023-10-08T05:57:14.307 INFO:teuthology.orchestra.run.smithi040.stdout:linux-image-generic is already the newest version (5.4.0.164.161). 2023-10-08T05:57:14.308 INFO:teuthology.orchestra.run.smithi040.stdout:0 upgraded, 0 newly installed, 0 to remove and 271 not upgraded. 2023-10-08T05:57:14.309 DEBUG:teuthology.orchestra.run.smithi040:> dpkg -s linux-image-generic 2023-10-08T05:57:14.330 INFO:teuthology.orchestra.run.smithi040.stdout:Package: linux-image-generic 2023-10-08T05:57:14.330 INFO:teuthology.orchestra.run.smithi040.stdout:Status: install ok installed 2023-10-08T05:57:14.330 INFO:teuthology.orchestra.run.smithi040.stdout:Priority: optional 2023-10-08T05:57:14.331 INFO:teuthology.orchestra.run.smithi040.stdout:Section: kernel 2023-10-08T05:57:14.331 INFO:teuthology.orchestra.run.smithi040.stdout:Installed-Size: 20 2023-10-08T05:57:14.331 INFO:teuthology.orchestra.run.smithi040.stdout:Maintainer: Ubuntu Kernel Team 2023-10-08T05:57:14.331 INFO:teuthology.orchestra.run.smithi040.stdout:Architecture: amd64 2023-10-08T05:57:14.331 INFO:teuthology.orchestra.run.smithi040.stdout:Source: linux-meta 2023-10-08T05:57:14.331 INFO:teuthology.orchestra.run.smithi040.stdout:Version: 5.4.0.164.161 2023-10-08T05:57:14.331 INFO:teuthology.orchestra.run.smithi040.stdout:Provides: virtualbox-guest-modules (= 6.1.38-dfsg-3~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.15) 2023-10-08T05:57:14.331 INFO:teuthology.orchestra.run.smithi040.stdout:Depends: linux-image-5.4.0-164-generic, linux-modules-extra-5.4.0-164-generic, linux-firmware, intel-microcode, amd64-microcode 2023-10-08T05:57:14.332 INFO:teuthology.orchestra.run.smithi040.stdout:Recommends: thermald 2023-10-08T05:57:14.332 INFO:teuthology.orchestra.run.smithi040.stdout:Description: Generic Linux kernel image 2023-10-08T05:57:14.332 INFO:teuthology.orchestra.run.smithi040.stdout: This package will always depend on the latest generic kernel image 2023-10-08T05:57:14.332 INFO:teuthology.orchestra.run.smithi040.stdout: available. 2023-10-08T05:57:14.332 DEBUG:teuthology.orchestra.run.smithi040:> mktemp 2023-10-08T05:57:14.338 INFO:teuthology.orchestra.run.smithi040.stdout:/tmp/tmp.SXehf8H2Uo 2023-10-08T05:57:14.339 DEBUG:teuthology.orchestra.run.smithi040:> sudo cp /boot/grub/grub.cfg /tmp/tmp.SXehf8H2Uo 2023-10-08T05:57:14.398 DEBUG:teuthology.orchestra.run.smithi040:> sudo chmod 0666 /tmp/tmp.SXehf8H2Uo 2023-10-08T05:57:14.445 DEBUG:teuthology.orchestra.remote:smithi040:/tmp/tmp.SXehf8H2Uo is 9KB 2023-10-08T05:57:14.459 DEBUG:teuthology.orchestra.run.smithi040:> rm -fr /tmp/tmp.SXehf8H2Uo 2023-10-08T05:57:14.465 DEBUG:teuthology.orchestra.run.smithi040:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2023-10-08T05:57:14.522 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-10-08T05:57:14.522 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd of=/etc/grub.d/01_ceph_kernel 2023-10-08T05:57:14.522 DEBUG:teuthology.orchestra.run.smithi040:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2023-10-08T05:57:14.552 INFO:teuthology.task.kernel:Distro Kernel Version: 5.4.0-164-generic 2023-10-08T05:57:14.552 DEBUG:teuthology.orchestra.run.smithi040:> sudo update-grub 2023-10-08T05:57:14.649 INFO:teuthology.orchestra.run.smithi032.stdout:Reading package lists... 2023-10-08T05:57:14.674 DEBUG:teuthology.orchestra.run.smithi032:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2023-10-08T05:57:14.750 INFO:teuthology.orchestra.run.smithi032.stdout:Reading package lists... 2023-10-08T05:57:14.953 INFO:teuthology.orchestra.run.smithi032.stdout:Building dependency tree... 2023-10-08T05:57:14.954 INFO:teuthology.orchestra.run.smithi032.stdout:Reading state information... 2023-10-08T05:57:15.183 INFO:teuthology.orchestra.run.smithi032.stdout:linux-image-generic is already the newest version (5.4.0.164.161). 2023-10-08T05:57:15.184 INFO:teuthology.orchestra.run.smithi032.stdout:0 upgraded, 0 newly installed, 0 to remove and 271 not upgraded. 2023-10-08T05:57:15.185 DEBUG:teuthology.orchestra.run.smithi032:> dpkg -s linux-image-generic 2023-10-08T05:57:15.206 INFO:teuthology.orchestra.run.smithi032.stdout:Package: linux-image-generic 2023-10-08T05:57:15.206 INFO:teuthology.orchestra.run.smithi032.stdout:Status: install ok installed 2023-10-08T05:57:15.206 INFO:teuthology.orchestra.run.smithi032.stdout:Priority: optional 2023-10-08T05:57:15.206 INFO:teuthology.orchestra.run.smithi032.stdout:Section: kernel 2023-10-08T05:57:15.206 INFO:teuthology.orchestra.run.smithi032.stdout:Installed-Size: 20 2023-10-08T05:57:15.206 INFO:teuthology.orchestra.run.smithi032.stdout:Maintainer: Ubuntu Kernel Team 2023-10-08T05:57:15.206 INFO:teuthology.orchestra.run.smithi032.stdout:Architecture: amd64 2023-10-08T05:57:15.206 INFO:teuthology.orchestra.run.smithi032.stdout:Source: linux-meta 2023-10-08T05:57:15.206 INFO:teuthology.orchestra.run.smithi032.stdout:Version: 5.4.0.164.161 2023-10-08T05:57:15.207 INFO:teuthology.orchestra.run.smithi032.stdout:Provides: virtualbox-guest-modules (= 6.1.38-dfsg-3~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.15) 2023-10-08T05:57:15.207 INFO:teuthology.orchestra.run.smithi032.stdout:Depends: linux-image-5.4.0-164-generic, linux-modules-extra-5.4.0-164-generic, linux-firmware, intel-microcode, amd64-microcode 2023-10-08T05:57:15.207 INFO:teuthology.orchestra.run.smithi032.stdout:Recommends: thermald 2023-10-08T05:57:15.207 INFO:teuthology.orchestra.run.smithi032.stdout:Description: Generic Linux kernel image 2023-10-08T05:57:15.207 INFO:teuthology.orchestra.run.smithi032.stdout: This package will always depend on the latest generic kernel image 2023-10-08T05:57:15.207 INFO:teuthology.orchestra.run.smithi032.stdout: available. 2023-10-08T05:57:15.208 DEBUG:teuthology.orchestra.run.smithi032:> mktemp 2023-10-08T05:57:15.212 INFO:teuthology.orchestra.run.smithi032.stdout:/tmp/tmp.OzAUuczkz9 2023-10-08T05:57:15.212 DEBUG:teuthology.orchestra.run.smithi032:> sudo cp /boot/grub/grub.cfg /tmp/tmp.OzAUuczkz9 2023-10-08T05:57:15.228 DEBUG:teuthology.orchestra.run.smithi032:> sudo chmod 0666 /tmp/tmp.OzAUuczkz9 2023-10-08T05:57:15.260 DEBUG:teuthology.orchestra.remote:smithi032:/tmp/tmp.OzAUuczkz9 is 9KB 2023-10-08T05:57:15.274 DEBUG:teuthology.orchestra.run.smithi032:> rm -fr /tmp/tmp.OzAUuczkz9 2023-10-08T05:57:15.280 DEBUG:teuthology.orchestra.run.smithi032:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2023-10-08T05:57:15.336 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2023-10-08T05:57:15.336 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd of=/etc/grub.d/01_ceph_kernel 2023-10-08T05:57:15.336 DEBUG:teuthology.orchestra.run.smithi032:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2023-10-08T05:57:15.375 INFO:teuthology.task.kernel:Distro Kernel Version: 5.4.0-164-generic 2023-10-08T05:57:15.375 DEBUG:teuthology.orchestra.run.smithi032:> sudo update-grub 2023-10-08T05:57:15.905 INFO:teuthology.orchestra.run.smithi040.stderr:Sourcing file `/etc/default/grub' 2023-10-08T05:57:15.915 INFO:teuthology.orchestra.run.smithi040.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-10-08T05:57:15.954 INFO:teuthology.orchestra.run.smithi040.stderr:Generating grub configuration file ... 2023-10-08T05:57:16.265 INFO:teuthology.orchestra.run.smithi040.stderr:Found linux image: /boot/vmlinuz-5.4.0-164-generic 2023-10-08T05:57:16.277 INFO:teuthology.orchestra.run.smithi040.stderr:Found initrd image: /boot/initrd.img-5.4.0-164-generic 2023-10-08T05:57:16.716 INFO:teuthology.orchestra.run.smithi032.stderr:Sourcing file `/etc/default/grub' 2023-10-08T05:57:17.588 INFO:teuthology.orchestra.run.smithi040.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2023-10-08T05:57:17.589 INFO:teuthology.orchestra.run.smithi040.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2023-10-08T05:57:17.589 INFO:teuthology.orchestra.run.smithi032.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-10-08T05:57:17.589 INFO:teuthology.orchestra.run.smithi032.stderr:Generating grub configuration file ... 2023-10-08T05:57:17.590 INFO:teuthology.orchestra.run.smithi032.stderr:Found linux image: /boot/vmlinuz-5.4.0-164-generic 2023-10-08T05:57:17.593 INFO:teuthology.orchestra.run.smithi032.stderr:Found initrd image: /boot/initrd.img-5.4.0-164-generic 2023-10-08T05:57:17.594 INFO:teuthology.orchestra.run.smithi032.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2023-10-08T05:57:17.594 INFO:teuthology.orchestra.run.smithi032.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2023-10-08T05:57:18.416 INFO:teuthology.orchestra.run.smithi040.stderr:done 2023-10-08T05:57:18.461 DEBUG:teuthology.orchestra.run.smithi040:> sudo shutdown -r now 2023-10-08T05:57:19.108 INFO:teuthology.orchestra.run.smithi032.stderr:done 2023-10-08T05:57:19.109 DEBUG:teuthology.orchestra.run.smithi032:> sudo shutdown -r now 2023-10-08T05:57:48.490 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2023-10-08T05:57:48.491 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi040.front.sepia.ceph.com' 2023-10-08T05:57:48.491 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-08T05:57:49.113 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2023-10-08T05:57:49.113 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi032.front.sepia.ceph.com' 2023-10-08T05:57:49.114 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-08T05:58:06.974 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.40 2023-10-08T05:58:07.482 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.32 2023-10-08T05:58:15.984 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi040.front.sepia.ceph.com' 2023-10-08T05:58:15.984 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-08T05:58:16.484 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi032.front.sepia.ceph.com' 2023-10-08T05:58:16.484 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-08T05:58:34.874 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.32 2023-10-08T05:58:46.886 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi032.front.sepia.ceph.com' 2023-10-08T05:58:46.887 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-08T05:58:49.946 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.32 2023-10-08T05:59:04.947 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi032.front.sepia.ceph.com' 2023-10-08T05:59:04.948 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-08T05:59:05.146 DEBUG:teuthology.orchestra.run.smithi032:> true 2023-10-08T05:59:05.738 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi032.front.sepia.ceph.com' 2023-10-08T05:59:05.738 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.4.0-164-generic"... 2023-10-08T05:59:05.738 DEBUG:teuthology.orchestra.run.smithi032:> uname -r 2023-10-08T05:59:05.746 INFO:teuthology.orchestra.run.smithi032.stdout:5.4.0-164-generic 2023-10-08T05:59:05.746 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-164-generic vs 5.4.0-164-generic 2023-10-08T05:59:05.746 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-10-08T05:59:05.746 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-10-08T05:59:06.747 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2023-10-08T05:59:06.747 DEBUG:teuthology.orchestra.run.smithi032:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-10-08T05:59:06.855 INFO:teuthology.orchestra.run.smithi032.stdout:ttyS1 2023-10-08T05:59:06.878 DEBUG:teuthology.parallel:result is None 2023-10-08T05:59:15.986 DEBUG:teuthology.orchestra.remote:timed out 2023-10-08T05:59:27.987 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi040.front.sepia.ceph.com' 2023-10-08T05:59:27.988 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-08T05:59:28.202 DEBUG:teuthology.orchestra.run.smithi040:> true 2023-10-08T05:59:28.800 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi040.front.sepia.ceph.com' 2023-10-08T05:59:28.801 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.4.0-164-generic"... 2023-10-08T05:59:28.801 DEBUG:teuthology.orchestra.run.smithi040:> uname -r 2023-10-08T05:59:28.807 INFO:teuthology.orchestra.run.smithi040.stdout:5.4.0-164-generic 2023-10-08T05:59:28.807 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-164-generic vs 5.4.0-164-generic 2023-10-08T05:59:28.807 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-10-08T05:59:28.808 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-10-08T05:59:29.808 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2023-10-08T05:59:29.808 DEBUG:teuthology.orchestra.run.smithi040:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-10-08T05:59:29.917 INFO:teuthology.orchestra.run.smithi040.stdout:ttyS1 2023-10-08T05:59:29.942 DEBUG:teuthology.parallel:result is None 2023-10-08T05:59:29.943 INFO:teuthology.run_tasks:Running task internal.base... 2023-10-08T05:59:29.949 INFO:teuthology.task.internal:Creating test directory... 2023-10-08T05:59:29.950 DEBUG:teuthology.orchestra.run.smithi032:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-08T05:59:29.952 DEBUG:teuthology.orchestra.run.smithi040:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-08T05:59:29.959 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-10-08T05:59:29.966 INFO:teuthology.run_tasks:Running task internal.archive... 2023-10-08T05:59:29.973 INFO:teuthology.task.internal:Creating archive directory... 2023-10-08T05:59:29.974 DEBUG:teuthology.orchestra.run.smithi032:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-08T05:59:29.976 DEBUG:teuthology.orchestra.run.smithi040:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-08T05:59:30.020 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-10-08T05:59:30.027 INFO:teuthology.task.internal:Enabling coredump saving... 2023-10-08T05:59:30.027 DEBUG:teuthology.orchestra.run.smithi032:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-08T05:59:30.029 DEBUG:teuthology.orchestra.run.smithi040:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-08T05:59:30.047 INFO:teuthology.orchestra.run.smithi040.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-08T05:59:30.049 INFO:teuthology.orchestra.run.smithi032.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-08T05:59:30.057 INFO:teuthology.orchestra.run.smithi040.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-08T05:59:30.060 INFO:teuthology.orchestra.run.smithi032.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-08T05:59:30.062 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-10-08T05:59:30.069 INFO:teuthology.task.internal:Configuring sudo... 2023-10-08T05:59:30.069 DEBUG:teuthology.orchestra.run.smithi032:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-08T05:59:30.105 DEBUG:teuthology.orchestra.run.smithi040:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-08T05:59:30.122 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-10-08T05:59:30.134 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-10-08T05:59:30.134 DEBUG:teuthology.orchestra.run.smithi032:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-08T05:59:30.136 DEBUG:teuthology.orchestra.run.smithi040:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-08T05:59:30.142 DEBUG:teuthology.orchestra.run.smithi032:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-08T05:59:30.190 DEBUG:teuthology.orchestra.run.smithi032:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-08T05:59:30.197 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2023-10-08T05:59:30.197 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-08T05:59:30.215 DEBUG:teuthology.orchestra.run.smithi040:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-08T05:59:30.222 DEBUG:teuthology.orchestra.run.smithi040:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-08T05:59:30.229 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-10-08T05:59:30.229 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-08T05:59:30.256 DEBUG:teuthology.orchestra.run.smithi032:> sudo service rsyslog restart 2023-10-08T05:59:30.258 DEBUG:teuthology.orchestra.run.smithi040:> sudo service rsyslog restart 2023-10-08T05:59:30.309 INFO:teuthology.run_tasks:Running task internal.timer... 2023-10-08T05:59:30.317 INFO:teuthology.task.internal:Starting timer... 2023-10-08T05:59:30.317 INFO:teuthology.run_tasks:Running task pcp... 2023-10-08T05:59:30.369 INFO:teuthology.run_tasks:Running task selinux... 2023-10-08T05:59:30.406 DEBUG:teuthology.task.selinux:Excluding smithi032: OS 'ubuntu' does not support SELinux 2023-10-08T05:59:30.406 DEBUG:teuthology.task.selinux:Excluding smithi040: OS 'ubuntu' does not support SELinux 2023-10-08T05:59:30.407 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-10-08T05:59:30.407 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2023-10-08T05:59:30.407 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-10-08T05:59:30.407 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-10-08T05:59:30.416 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2023-10-08T05:59:30.422 INFO:teuthology.repo_utils:Fetching main from origin 2023-10-08T05:59:30.536 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-10-08T05:59:30.556 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-10-08T05:59:30.557 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi032.front.sepia.ceph.com,smithi040.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-10-08T06:05:17.250 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi032.front.sepia.ceph.com'), Remote(name='ubuntu@smithi040.front.sepia.ceph.com')] 2023-10-08T06:05:17.251 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi032.front.sepia.ceph.com' 2023-10-08T06:05:17.252 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-08T06:05:17.301 DEBUG:teuthology.orchestra.run.smithi032:> true 2023-10-08T06:05:17.424 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi032.front.sepia.ceph.com' 2023-10-08T06:05:17.424 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi040.front.sepia.ceph.com' 2023-10-08T06:05:17.425 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-08T06:05:17.473 DEBUG:teuthology.orchestra.run.smithi040:> true 2023-10-08T06:05:17.600 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi040.front.sepia.ceph.com' 2023-10-08T06:05:17.601 INFO:teuthology.run_tasks:Running task clock... 2023-10-08T06:05:17.614 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-10-08T06:05:17.614 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-08T06:05:17.614 DEBUG:teuthology.orchestra.run.smithi032:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-08T06:05:17.616 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-08T06:05:17.617 DEBUG:teuthology.orchestra.run.smithi040:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-08T06:05:17.651 INFO:teuthology.orchestra.run.smithi032.stdout: 8 Oct 06:05:17 ntpd[22826]: ntpd 4.2.8p12@1.3728-o (1): Starting 2023-10-08T06:05:17.651 INFO:teuthology.orchestra.run.smithi032.stdout: 8 Oct 06:05:17 ntpd[22826]: Command line: ntpd -gq 2023-10-08T06:05:17.652 INFO:teuthology.orchestra.run.smithi032.stdout: 8 Oct 06:05:17 ntpd[22826]: proto: precision = 0.074 usec (-24) 2023-10-08T06:05:17.652 INFO:teuthology.orchestra.run.smithi032.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-10-08T06:05:17.653 INFO:teuthology.orchestra.run.smithi032.stdout: 8 Oct 06:05:17 ntpd[22826]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-10-08T06:05:17.653 INFO:teuthology.orchestra.run.smithi032.stderr:restrict ::: KOD does nothing without LIMITED. 2023-10-08T06:05:17.655 INFO:teuthology.orchestra.run.smithi032.stdout: 8 Oct 06:05:17 ntpd[22826]: restrict ::: KOD does nothing without LIMITED. 2023-10-08T06:05:17.655 INFO:teuthology.orchestra.run.smithi032.stdout: 8 Oct 06:05:17 ntpd[22826]: Listen and drop on 0 v6wildcard [::]:123 2023-10-08T06:05:17.655 INFO:teuthology.orchestra.run.smithi032.stdout: 8 Oct 06:05:17 ntpd[22826]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-10-08T06:05:17.655 INFO:teuthology.orchestra.run.smithi032.stdout: 8 Oct 06:05:17 ntpd[22826]: Listen normally on 2 lo 127.0.0.1:123 2023-10-08T06:05:17.655 INFO:teuthology.orchestra.run.smithi032.stdout: 8 Oct 06:05:17 ntpd[22826]: Listen normally on 3 ens1f0 172.21.15.32:123 2023-10-08T06:05:17.656 INFO:teuthology.orchestra.run.smithi032.stdout: 8 Oct 06:05:17 ntpd[22826]: Listen normally on 4 lo [::1]:123 2023-10-08T06:05:17.656 INFO:teuthology.orchestra.run.smithi032.stdout: 8 Oct 06:05:17 ntpd[22826]: Listen normally on 5 ens1f0 [fe80::ae1f:6bff:fef8:2602%4]:123 2023-10-08T06:05:17.656 INFO:teuthology.orchestra.run.smithi032.stdout: 8 Oct 06:05:17 ntpd[22826]: Listening on routing socket on fd #22 for interface updates 2023-10-08T06:05:17.676 INFO:teuthology.orchestra.run.smithi040.stdout: 8 Oct 06:05:17 ntpd[22784]: ntpd 4.2.8p12@1.3728-o (1): Starting 2023-10-08T06:05:17.676 INFO:teuthology.orchestra.run.smithi040.stdout: 8 Oct 06:05:17 ntpd[22784]: Command line: ntpd -gq 2023-10-08T06:05:17.677 INFO:teuthology.orchestra.run.smithi040.stdout: 8 Oct 06:05:17 ntpd[22784]: proto: precision = 0.186 usec (-22) 2023-10-08T06:05:17.677 INFO:teuthology.orchestra.run.smithi040.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-10-08T06:05:17.678 INFO:teuthology.orchestra.run.smithi040.stdout: 8 Oct 06:05:17 ntpd[22784]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-10-08T06:05:17.678 INFO:teuthology.orchestra.run.smithi040.stdout: 8 Oct 06:05:17 ntpd[22784]: restrict ::: KOD does nothing without LIMITED. 2023-10-08T06:05:17.678 INFO:teuthology.orchestra.run.smithi040.stderr:restrict ::: KOD does nothing without LIMITED. 2023-10-08T06:05:17.679 INFO:teuthology.orchestra.run.smithi040.stdout: 8 Oct 06:05:17 ntpd[22784]: Listen and drop on 0 v6wildcard [::]:123 2023-10-08T06:05:17.679 INFO:teuthology.orchestra.run.smithi040.stdout: 8 Oct 06:05:17 ntpd[22784]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-10-08T06:05:17.680 INFO:teuthology.orchestra.run.smithi040.stdout: 8 Oct 06:05:17 ntpd[22784]: Listen normally on 2 lo 127.0.0.1:123 2023-10-08T06:05:17.680 INFO:teuthology.orchestra.run.smithi040.stdout: 8 Oct 06:05:17 ntpd[22784]: Listen normally on 3 ens1f0 172.21.15.40:123 2023-10-08T06:05:17.680 INFO:teuthology.orchestra.run.smithi040.stdout: 8 Oct 06:05:17 ntpd[22784]: Listen normally on 4 lo [::1]:123 2023-10-08T06:05:17.680 INFO:teuthology.orchestra.run.smithi040.stdout: 8 Oct 06:05:17 ntpd[22784]: Listen normally on 5 ens1f0 [fe80::ec4:7aff:febd:12cc%4]:123 2023-10-08T06:05:17.680 INFO:teuthology.orchestra.run.smithi040.stdout: 8 Oct 06:05:17 ntpd[22784]: Listening on routing socket on fd #22 for interface updates 2023-10-08T06:05:18.652 INFO:teuthology.orchestra.run.smithi032.stderr: 8 Oct 06:05:18 ntpd[22826]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T06:05:18.652 INFO:teuthology.orchestra.run.smithi032.stderr: 8 Oct 06:05:18 ntpd[22826]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T06:05:18.677 INFO:teuthology.orchestra.run.smithi040.stderr: 8 Oct 06:05:18 ntpd[22784]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T06:05:18.677 INFO:teuthology.orchestra.run.smithi040.stderr: 8 Oct 06:05:18 ntpd[22784]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T06:05:18.677 INFO:teuthology.orchestra.run.smithi040.stderr: 8 Oct 06:05:18 ntpd[22784]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T06:05:18.677 INFO:teuthology.orchestra.run.smithi040.stderr: 8 Oct 06:05:18 ntpd[22784]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T06:05:18.677 INFO:teuthology.orchestra.run.smithi040.stderr: 8 Oct 06:05:18 ntpd[22784]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-08T06:05:18.677 INFO:teuthology.orchestra.run.smithi040.stderr: 8 Oct 06:05:18 ntpd[22784]: can't open /var/log/ntpstats/peerstats.20231008: Permission denied 2023-10-08T06:05:19.652 INFO:teuthology.orchestra.run.smithi032.stderr: 8 Oct 06:05:19 ntpd[22826]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T06:05:19.652 INFO:teuthology.orchestra.run.smithi032.stderr: 8 Oct 06:05:19 ntpd[22826]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T06:05:19.652 INFO:teuthology.orchestra.run.smithi032.stderr: 8 Oct 06:05:19 ntpd[22826]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T06:05:19.652 INFO:teuthology.orchestra.run.smithi032.stderr: 8 Oct 06:05:19 ntpd[22826]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T06:05:19.653 INFO:teuthology.orchestra.run.smithi032.stderr: 8 Oct 06:05:19 ntpd[22826]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-08T06:05:19.653 INFO:teuthology.orchestra.run.smithi032.stderr: 8 Oct 06:05:19 ntpd[22826]: can't open /var/log/ntpstats/peerstats.20231008: Permission denied 2023-10-08T06:05:19.677 INFO:teuthology.orchestra.run.smithi040.stderr: 8 Oct 06:05:19 ntpd[22784]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T06:05:19.677 INFO:teuthology.orchestra.run.smithi040.stderr: 8 Oct 06:05:19 ntpd[22784]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T06:05:19.677 INFO:teuthology.orchestra.run.smithi040.stderr: 8 Oct 06:05:19 ntpd[22784]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T06:05:19.677 INFO:teuthology.orchestra.run.smithi040.stderr: 8 Oct 06:05:19 ntpd[22784]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T06:05:19.677 INFO:teuthology.orchestra.run.smithi040.stderr: 8 Oct 06:05:19 ntpd[22784]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-08T06:05:19.677 INFO:teuthology.orchestra.run.smithi040.stderr: 8 Oct 06:05:19 ntpd[22784]: can't open /var/log/ntpstats/peerstats.20231008: Permission denied 2023-10-08T06:05:20.677 INFO:teuthology.orchestra.run.smithi040.stderr: 8 Oct 06:05:20 ntpd[22784]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T06:05:20.678 INFO:teuthology.orchestra.run.smithi040.stderr: 8 Oct 06:05:20 ntpd[22784]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T06:05:20.678 INFO:teuthology.orchestra.run.smithi040.stderr: 8 Oct 06:05:20 ntpd[22784]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T06:05:20.678 INFO:teuthology.orchestra.run.smithi040.stderr: 8 Oct 06:05:20 ntpd[22784]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T06:05:20.678 INFO:teuthology.orchestra.run.smithi040.stderr: 8 Oct 06:05:20 ntpd[22784]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T06:05:20.678 INFO:teuthology.orchestra.run.smithi040.stderr: 8 Oct 06:05:20 ntpd[22784]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T06:05:20.678 INFO:teuthology.orchestra.run.smithi040.stderr: 8 Oct 06:05:20 ntpd[22784]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T06:05:20.678 INFO:teuthology.orchestra.run.smithi040.stderr: 8 Oct 06:05:20 ntpd[22784]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T06:05:20.678 INFO:teuthology.orchestra.run.smithi040.stderr: 8 Oct 06:05:20 ntpd[22784]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-08T06:05:20.679 INFO:teuthology.orchestra.run.smithi040.stderr: 8 Oct 06:05:20 ntpd[22784]: can't open /var/log/ntpstats/peerstats.20231008: Permission denied 2023-10-08T06:05:20.679 INFO:teuthology.orchestra.run.smithi040.stderr: 8 Oct 06:05:20 ntpd[22784]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T06:05:20.679 INFO:teuthology.orchestra.run.smithi040.stderr: 8 Oct 06:05:20 ntpd[22784]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T06:05:20.679 INFO:teuthology.orchestra.run.smithi040.stderr: 8 Oct 06:05:20 ntpd[22784]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-08T06:05:20.679 INFO:teuthology.orchestra.run.smithi040.stderr: 8 Oct 06:05:20 ntpd[22784]: can't open /var/log/ntpstats/peerstats.20231008: Permission denied 2023-10-08T06:05:21.654 INFO:teuthology.orchestra.run.smithi032.stderr: 8 Oct 06:05:21 ntpd[22826]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T06:05:21.654 INFO:teuthology.orchestra.run.smithi032.stderr: 8 Oct 06:05:21 ntpd[22826]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T06:05:21.654 INFO:teuthology.orchestra.run.smithi032.stderr: 8 Oct 06:05:21 ntpd[22826]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T06:05:21.654 INFO:teuthology.orchestra.run.smithi032.stderr: 8 Oct 06:05:21 ntpd[22826]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T06:05:21.654 INFO:teuthology.orchestra.run.smithi032.stderr: 8 Oct 06:05:21 ntpd[22826]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T06:05:21.655 INFO:teuthology.orchestra.run.smithi032.stderr: 8 Oct 06:05:21 ntpd[22826]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T06:05:21.655 INFO:teuthology.orchestra.run.smithi032.stderr: 8 Oct 06:05:21 ntpd[22826]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T06:05:21.655 INFO:teuthology.orchestra.run.smithi032.stderr: 8 Oct 06:05:21 ntpd[22826]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T06:05:21.655 INFO:teuthology.orchestra.run.smithi032.stderr: 8 Oct 06:05:21 ntpd[22826]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-08T06:05:21.655 INFO:teuthology.orchestra.run.smithi032.stderr: 8 Oct 06:05:21 ntpd[22826]: can't open /var/log/ntpstats/peerstats.20231008: Permission denied 2023-10-08T06:05:21.655 INFO:teuthology.orchestra.run.smithi032.stderr: 8 Oct 06:05:21 ntpd[22826]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T06:05:21.655 INFO:teuthology.orchestra.run.smithi032.stderr: 8 Oct 06:05:21 ntpd[22826]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T06:05:21.655 INFO:teuthology.orchestra.run.smithi032.stderr: 8 Oct 06:05:21 ntpd[22826]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-08T06:05:21.655 INFO:teuthology.orchestra.run.smithi032.stderr: 8 Oct 06:05:21 ntpd[22826]: can't open /var/log/ntpstats/peerstats.20231008: Permission denied 2023-10-08T06:05:21.656 INFO:teuthology.orchestra.run.smithi032.stderr: 8 Oct 06:05:21 ntpd[22826]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T06:05:21.656 INFO:teuthology.orchestra.run.smithi032.stderr: 8 Oct 06:05:21 ntpd[22826]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T06:05:21.656 INFO:teuthology.orchestra.run.smithi032.stderr: 8 Oct 06:05:21 ntpd[22826]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-08T06:05:21.656 INFO:teuthology.orchestra.run.smithi032.stderr: 8 Oct 06:05:21 ntpd[22826]: can't open /var/log/ntpstats/peerstats.20231008: Permission denied 2023-10-08T06:05:21.678 INFO:teuthology.orchestra.run.smithi040.stderr: 8 Oct 06:05:21 ntpd[22784]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T06:05:21.679 INFO:teuthology.orchestra.run.smithi040.stderr: 8 Oct 06:05:21 ntpd[22784]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T06:05:21.679 INFO:teuthology.orchestra.run.smithi040.stderr: 8 Oct 06:05:21 ntpd[22784]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T06:05:21.679 INFO:teuthology.orchestra.run.smithi040.stderr: 8 Oct 06:05:21 ntpd[22784]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T06:05:21.679 INFO:teuthology.orchestra.run.smithi040.stderr: 8 Oct 06:05:21 ntpd[22784]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-08T06:05:21.679 INFO:teuthology.orchestra.run.smithi040.stderr: 8 Oct 06:05:21 ntpd[22784]: can't open /var/log/ntpstats/peerstats.20231008: Permission denied 2023-10-08T06:05:22.677 INFO:teuthology.orchestra.run.smithi040.stderr: 8 Oct 06:05:22 ntpd[22784]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T06:05:22.677 INFO:teuthology.orchestra.run.smithi040.stderr: 8 Oct 06:05:22 ntpd[22784]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T06:05:22.678 INFO:teuthology.orchestra.run.smithi040.stderr: 8 Oct 06:05:22 ntpd[22784]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T06:05:22.678 INFO:teuthology.orchestra.run.smithi040.stderr: 8 Oct 06:05:22 ntpd[22784]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T06:05:22.678 INFO:teuthology.orchestra.run.smithi040.stderr: 8 Oct 06:05:22 ntpd[22784]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T06:05:22.678 INFO:teuthology.orchestra.run.smithi040.stderr: 8 Oct 06:05:22 ntpd[22784]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T06:05:22.678 INFO:teuthology.orchestra.run.smithi040.stderr: 8 Oct 06:05:22 ntpd[22784]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-08T06:05:22.678 INFO:teuthology.orchestra.run.smithi040.stderr: 8 Oct 06:05:22 ntpd[22784]: can't open /var/log/ntpstats/peerstats.20231008: Permission denied 2023-10-08T06:05:22.678 INFO:teuthology.orchestra.run.smithi040.stderr: 8 Oct 06:05:22 ntpd[22784]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T06:05:22.678 INFO:teuthology.orchestra.run.smithi040.stderr: 8 Oct 06:05:22 ntpd[22784]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T06:05:22.678 INFO:teuthology.orchestra.run.smithi040.stderr: 8 Oct 06:05:22 ntpd[22784]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-08T06:05:22.678 INFO:teuthology.orchestra.run.smithi040.stderr: 8 Oct 06:05:22 ntpd[22784]: can't open /var/log/ntpstats/peerstats.20231008: Permission denied 2023-10-08T06:05:23.653 INFO:teuthology.orchestra.run.smithi032.stderr: 8 Oct 06:05:23 ntpd[22826]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T06:05:23.653 INFO:teuthology.orchestra.run.smithi032.stderr: 8 Oct 06:05:23 ntpd[22826]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T06:05:23.654 INFO:teuthology.orchestra.run.smithi032.stderr: 8 Oct 06:05:23 ntpd[22826]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T06:05:23.654 INFO:teuthology.orchestra.run.smithi032.stderr: 8 Oct 06:05:23 ntpd[22826]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T06:05:23.654 INFO:teuthology.orchestra.run.smithi032.stderr: 8 Oct 06:05:23 ntpd[22826]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T06:05:23.654 INFO:teuthology.orchestra.run.smithi032.stderr: 8 Oct 06:05:23 ntpd[22826]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T06:05:23.654 INFO:teuthology.orchestra.run.smithi032.stderr: 8 Oct 06:05:23 ntpd[22826]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T06:05:23.654 INFO:teuthology.orchestra.run.smithi032.stderr: 8 Oct 06:05:23 ntpd[22826]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T06:05:23.654 INFO:teuthology.orchestra.run.smithi032.stderr: 8 Oct 06:05:23 ntpd[22826]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-08T06:05:23.654 INFO:teuthology.orchestra.run.smithi032.stderr: 8 Oct 06:05:23 ntpd[22826]: can't open /var/log/ntpstats/peerstats.20231008: Permission denied 2023-10-08T06:05:23.654 INFO:teuthology.orchestra.run.smithi032.stderr: 8 Oct 06:05:23 ntpd[22826]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T06:05:23.655 INFO:teuthology.orchestra.run.smithi032.stderr: 8 Oct 06:05:23 ntpd[22826]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T06:05:23.655 INFO:teuthology.orchestra.run.smithi032.stderr: 8 Oct 06:05:23 ntpd[22826]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-08T06:05:23.655 INFO:teuthology.orchestra.run.smithi032.stderr: 8 Oct 06:05:23 ntpd[22826]: can't open /var/log/ntpstats/peerstats.20231008: Permission denied 2023-10-08T06:05:23.655 INFO:teuthology.orchestra.run.smithi032.stderr: 8 Oct 06:05:23 ntpd[22826]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T06:05:23.655 INFO:teuthology.orchestra.run.smithi032.stderr: 8 Oct 06:05:23 ntpd[22826]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T06:05:23.655 INFO:teuthology.orchestra.run.smithi032.stderr: 8 Oct 06:05:23 ntpd[22826]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-08T06:05:23.655 INFO:teuthology.orchestra.run.smithi032.stderr: 8 Oct 06:05:23 ntpd[22826]: can't open /var/log/ntpstats/peerstats.20231008: Permission denied 2023-10-08T06:05:23.677 INFO:teuthology.orchestra.run.smithi040.stderr: 8 Oct 06:05:23 ntpd[22784]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T06:05:23.677 INFO:teuthology.orchestra.run.smithi040.stderr: 8 Oct 06:05:23 ntpd[22784]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T06:05:23.677 INFO:teuthology.orchestra.run.smithi040.stderr: 8 Oct 06:05:23 ntpd[22784]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T06:05:23.677 INFO:teuthology.orchestra.run.smithi040.stderr: 8 Oct 06:05:23 ntpd[22784]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T06:05:23.677 INFO:teuthology.orchestra.run.smithi040.stderr: 8 Oct 06:05:23 ntpd[22784]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-08T06:05:23.677 INFO:teuthology.orchestra.run.smithi040.stderr: 8 Oct 06:05:23 ntpd[22784]: can't open /var/log/ntpstats/peerstats.20231008: Permission denied 2023-10-08T06:05:24.677 INFO:teuthology.orchestra.run.smithi040.stderr: 8 Oct 06:05:24 ntpd[22784]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T06:05:24.677 INFO:teuthology.orchestra.run.smithi040.stderr: 8 Oct 06:05:24 ntpd[22784]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T06:05:24.677 INFO:teuthology.orchestra.run.smithi040.stderr: 8 Oct 06:05:24 ntpd[22784]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T06:05:24.677 INFO:teuthology.orchestra.run.smithi040.stderr: 8 Oct 06:05:24 ntpd[22784]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T06:05:24.678 INFO:teuthology.orchestra.run.smithi040.stderr: 8 Oct 06:05:24 ntpd[22784]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T06:05:24.678 INFO:teuthology.orchestra.run.smithi040.stderr: 8 Oct 06:05:24 ntpd[22784]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T06:05:24.678 INFO:teuthology.orchestra.run.smithi040.stderr: 8 Oct 06:05:24 ntpd[22784]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-08T06:05:24.678 INFO:teuthology.orchestra.run.smithi040.stderr: 8 Oct 06:05:24 ntpd[22784]: can't open /var/log/ntpstats/peerstats.20231008: Permission denied 2023-10-08T06:05:24.678 INFO:teuthology.orchestra.run.smithi040.stderr: 8 Oct 06:05:24 ntpd[22784]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T06:05:24.678 INFO:teuthology.orchestra.run.smithi040.stderr: 8 Oct 06:05:24 ntpd[22784]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T06:05:24.678 INFO:teuthology.orchestra.run.smithi040.stderr: 8 Oct 06:05:24 ntpd[22784]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-08T06:05:24.678 INFO:teuthology.orchestra.run.smithi040.stderr: 8 Oct 06:05:24 ntpd[22784]: can't open /var/log/ntpstats/peerstats.20231008: Permission denied 2023-10-08T06:05:24.678 INFO:teuthology.orchestra.run.smithi040.stdout: 8 Oct 06:05:24 ntpd[22784]: ntpd: time slew +0.001906 s 2023-10-08T06:05:24.679 INFO:teuthology.orchestra.run.smithi040.stdout:ntpd: time slew +0.001906s 2023-10-08T06:05:24.679 INFO:teuthology.orchestra.run.smithi040.stderr: 8 Oct 06:05:24 ntpd[22784]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-10-08T06:05:24.679 INFO:teuthology.orchestra.run.smithi040.stderr: 8 Oct 06:05:24 ntpd[22784]: can't open /var/log/ntpstats/loopstats.20231008: Permission denied 2023-10-08T06:05:24.744 INFO:teuthology.orchestra.run.smithi040.stdout: remote refid st t when poll reach delay offset jitter 2023-10-08T06:05:24.744 INFO:teuthology.orchestra.run.smithi040.stdout:============================================================================== 2023-10-08T06:05:24.744 INFO:teuthology.orchestra.run.smithi040.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-10-08T06:05:24.744 INFO:teuthology.orchestra.run.smithi040.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-10-08T06:05:24.744 INFO:teuthology.orchestra.run.smithi040.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-10-08T06:05:24.745 INFO:teuthology.orchestra.run.smithi040.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-10-08T06:05:25.653 INFO:teuthology.orchestra.run.smithi032.stderr: 8 Oct 06:05:25 ntpd[22826]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T06:05:25.653 INFO:teuthology.orchestra.run.smithi032.stderr: 8 Oct 06:05:25 ntpd[22826]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T06:05:25.653 INFO:teuthology.orchestra.run.smithi032.stderr: 8 Oct 06:05:25 ntpd[22826]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T06:05:25.653 INFO:teuthology.orchestra.run.smithi032.stderr: 8 Oct 06:05:25 ntpd[22826]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T06:05:25.653 INFO:teuthology.orchestra.run.smithi032.stderr: 8 Oct 06:05:25 ntpd[22826]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T06:05:25.653 INFO:teuthology.orchestra.run.smithi032.stderr: 8 Oct 06:05:25 ntpd[22826]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T06:05:25.653 INFO:teuthology.orchestra.run.smithi032.stderr: 8 Oct 06:05:25 ntpd[22826]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T06:05:25.653 INFO:teuthology.orchestra.run.smithi032.stderr: 8 Oct 06:05:25 ntpd[22826]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T06:05:25.653 INFO:teuthology.orchestra.run.smithi032.stderr: 8 Oct 06:05:25 ntpd[22826]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-08T06:05:25.654 INFO:teuthology.orchestra.run.smithi032.stderr: 8 Oct 06:05:25 ntpd[22826]: can't open /var/log/ntpstats/peerstats.20231008: Permission denied 2023-10-08T06:05:25.654 INFO:teuthology.orchestra.run.smithi032.stderr: 8 Oct 06:05:25 ntpd[22826]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-08T06:05:25.654 INFO:teuthology.orchestra.run.smithi032.stderr: 8 Oct 06:05:25 ntpd[22826]: can't open /var/log/ntpstats/rawstats.20231008: Permission denied 2023-10-08T06:05:25.654 INFO:teuthology.orchestra.run.smithi032.stderr: 8 Oct 06:05:25 ntpd[22826]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-08T06:05:25.654 INFO:teuthology.orchestra.run.smithi032.stderr: 8 Oct 06:05:25 ntpd[22826]: can't open /var/log/ntpstats/peerstats.20231008: Permission denied 2023-10-08T06:05:25.654 INFO:teuthology.orchestra.run.smithi032.stdout: 8 Oct 06:05:25 ntpd[22826]: ntpd: time slew +0.000543 s 2023-10-08T06:05:25.654 INFO:teuthology.orchestra.run.smithi032.stdout:ntpd: time slew +0.000543s 2023-10-08T06:05:25.655 INFO:teuthology.orchestra.run.smithi032.stderr: 8 Oct 06:05:25 ntpd[22826]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-10-08T06:05:25.655 INFO:teuthology.orchestra.run.smithi032.stderr: 8 Oct 06:05:25 ntpd[22826]: can't open /var/log/ntpstats/loopstats.20231008: Permission denied 2023-10-08T06:05:25.717 INFO:teuthology.orchestra.run.smithi032.stdout: remote refid st t when poll reach delay offset jitter 2023-10-08T06:05:25.717 INFO:teuthology.orchestra.run.smithi032.stdout:============================================================================== 2023-10-08T06:05:25.717 INFO:teuthology.orchestra.run.smithi032.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-10-08T06:05:25.718 INFO:teuthology.orchestra.run.smithi032.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-10-08T06:05:25.718 INFO:teuthology.orchestra.run.smithi032.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-10-08T06:05:25.718 INFO:teuthology.orchestra.run.smithi032.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-10-08T06:05:25.719 INFO:teuthology.run_tasks:Running task install... 2023-10-08T06:05:25.727 DEBUG:teuthology.task.install:project ceph 2023-10-08T06:05:25.727 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '9725b08fd801c82987c737f7e6d354878f036ee8'}} 2023-10-08T06:05:25.727 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '9725b08fd801c82987c737f7e6d354878f036ee8'} 2023-10-08T06:05:25.728 INFO:teuthology.task.install:Using flavor: default 2023-10-08T06:05:25.733 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-10-08T06:05:25.734 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-10-08T06:05:25.735 DEBUG:teuthology.orchestra.run.smithi032:> sudo apt-key list | grep Ceph 2023-10-08T06:05:25.735 DEBUG:teuthology.orchestra.run.smithi040:> sudo apt-key list | grep Ceph 2023-10-08T06:05:25.843 INFO:teuthology.orchestra.run.smithi040.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2023-10-08T06:05:25.869 INFO:teuthology.orchestra.run.smithi032.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2023-10-08T06:05:25.904 INFO:teuthology.orchestra.run.smithi040.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-10-08T06:05:25.905 INFO:teuthology.orchestra.run.smithi040.stdout:uid [ unknown] Ceph.com (release key) 2023-10-08T06:05:25.906 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2023-10-08T06:05:25.906 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2023-10-08T06:05:25.906 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=9725b08fd801c82987c737f7e6d354878f036ee8 2023-10-08T06:05:25.938 INFO:teuthology.orchestra.run.smithi032.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-10-08T06:05:25.939 INFO:teuthology.orchestra.run.smithi032.stdout:uid [ unknown] Ceph.com (release key) 2023-10-08T06:05:25.939 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2023-10-08T06:05:25.939 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2023-10-08T06:05:25.939 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=9725b08fd801c82987c737f7e6d354878f036ee8 2023-10-08T06:05:26.058 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/main/9725b08fd801c82987c737f7e6d354878f036ee8/ubuntu/focal/flavors/default/ 2023-10-08T06:05:26.059 INFO:teuthology.task.install.deb:Package version is 18.0.0-6609-g9725b08f-1focal 2023-10-08T06:05:26.093 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/main/9725b08fd801c82987c737f7e6d354878f036ee8/ubuntu/focal/flavors/default/ 2023-10-08T06:05:26.093 INFO:teuthology.task.install.deb:Package version is 18.0.0-6609-g9725b08f-1focal 2023-10-08T06:05:26.205 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2023-10-08T06:05:26.205 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-10-08T06:05:26.222 DEBUG:teuthology.orchestra.run.smithi032:> sudo apt-get update 2023-10-08T06:05:26.234 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-10-08T06:05:26.234 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-10-08T06:05:26.251 DEBUG:teuthology.orchestra.run.smithi040:> sudo apt-get update 2023-10-08T06:05:26.415 INFO:teuthology.orchestra.run.smithi032.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2023-10-08T06:05:26.426 INFO:teuthology.orchestra.run.smithi032.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2023-10-08T06:05:26.444 INFO:teuthology.orchestra.run.smithi040.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2023-10-08T06:05:26.444 INFO:teuthology.orchestra.run.smithi040.stdout:Hit:2 http://security.ubuntu.com/ubuntu focal-security InRelease 2023-10-08T06:05:26.445 INFO:teuthology.orchestra.run.smithi032.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2023-10-08T06:05:26.447 INFO:teuthology.orchestra.run.smithi040.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2023-10-08T06:05:26.465 INFO:teuthology.orchestra.run.smithi040.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2023-10-08T06:05:26.527 INFO:teuthology.orchestra.run.smithi032.stdout:Ign:4 https://3.chacra.ceph.com/r/ceph/main/9725b08fd801c82987c737f7e6d354878f036ee8/ubuntu/focal/flavors/default focal InRelease 2023-10-08T06:05:26.554 INFO:teuthology.orchestra.run.smithi032.stdout:Hit:5 http://security.ubuntu.com/ubuntu focal-security InRelease 2023-10-08T06:05:26.564 INFO:teuthology.orchestra.run.smithi032.stdout:Get:6 https://3.chacra.ceph.com/r/ceph/main/9725b08fd801c82987c737f7e6d354878f036ee8/ubuntu/focal/flavors/default focal Release [7,662 B] 2023-10-08T06:05:26.564 INFO:teuthology.orchestra.run.smithi040.stdout:Ign:5 https://3.chacra.ceph.com/r/ceph/main/9725b08fd801c82987c737f7e6d354878f036ee8/ubuntu/focal/flavors/default focal InRelease 2023-10-08T06:05:26.602 INFO:teuthology.orchestra.run.smithi032.stdout:Ign:7 https://3.chacra.ceph.com/r/ceph/main/9725b08fd801c82987c737f7e6d354878f036ee8/ubuntu/focal/flavors/default focal Release.gpg 2023-10-08T06:05:26.603 INFO:teuthology.orchestra.run.smithi040.stdout:Get:6 https://3.chacra.ceph.com/r/ceph/main/9725b08fd801c82987c737f7e6d354878f036ee8/ubuntu/focal/flavors/default focal Release [7,662 B] 2023-10-08T06:05:26.638 INFO:teuthology.orchestra.run.smithi032.stdout:Get:8 https://3.chacra.ceph.com/r/ceph/main/9725b08fd801c82987c737f7e6d354878f036ee8/ubuntu/focal/flavors/default focal/main i386 Packages [3,415 B] 2023-10-08T06:05:26.640 INFO:teuthology.orchestra.run.smithi040.stdout:Ign:7 https://3.chacra.ceph.com/r/ceph/main/9725b08fd801c82987c737f7e6d354878f036ee8/ubuntu/focal/flavors/default focal Release.gpg 2023-10-08T06:05:26.677 INFO:teuthology.orchestra.run.smithi040.stdout:Get:8 https://3.chacra.ceph.com/r/ceph/main/9725b08fd801c82987c737f7e6d354878f036ee8/ubuntu/focal/flavors/default focal/main amd64 Packages [17.4 kB] 2023-10-08T06:05:26.704 INFO:teuthology.orchestra.run.smithi032.stdout:Get:9 https://3.chacra.ceph.com/r/ceph/main/9725b08fd801c82987c737f7e6d354878f036ee8/ubuntu/focal/flavors/default focal/main amd64 Packages [17.4 kB] 2023-10-08T06:05:26.738 INFO:teuthology.orchestra.run.smithi040.stdout:Get:9 https://3.chacra.ceph.com/r/ceph/main/9725b08fd801c82987c737f7e6d354878f036ee8/ubuntu/focal/flavors/default focal/main i386 Packages [3,415 B] 2023-10-08T06:05:27.069 INFO:teuthology.orchestra.run.smithi032.stdout:Fetched 28.5 kB in 1s (44.8 kB/s) 2023-10-08T06:05:27.119 INFO:teuthology.orchestra.run.smithi040.stdout:Fetched 28.5 kB in 1s (43.8 kB/s) 2023-10-08T06:05:28.142 INFO:teuthology.orchestra.run.smithi032.stdout:Reading package lists... 2023-10-08T06:05:28.167 DEBUG:teuthology.orchestra.run.smithi032:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.0.0-6609-g9725b08f-1focal cephadm=18.0.0-6609-g9725b08f-1focal ceph-mds=18.0.0-6609-g9725b08f-1focal ceph-mgr=18.0.0-6609-g9725b08f-1focal ceph-common=18.0.0-6609-g9725b08f-1focal ceph-fuse=18.0.0-6609-g9725b08f-1focal ceph-test=18.0.0-6609-g9725b08f-1focal ceph-volume=18.0.0-6609-g9725b08f-1focal radosgw=18.0.0-6609-g9725b08f-1focal python3-rados=18.0.0-6609-g9725b08f-1focal python3-rgw=18.0.0-6609-g9725b08f-1focal python3-cephfs=18.0.0-6609-g9725b08f-1focal python3-rbd=18.0.0-6609-g9725b08f-1focal libcephfs2=18.0.0-6609-g9725b08f-1focal libcephfs-dev=18.0.0-6609-g9725b08f-1focal librados2=18.0.0-6609-g9725b08f-1focal librbd1=18.0.0-6609-g9725b08f-1focal rbd-fuse=18.0.0-6609-g9725b08f-1focal python3-cephfs=18.0.0-6609-g9725b08f-1focal cephfs-shell=18.0.0-6609-g9725b08f-1focal cephfs-top=18.0.0-6609-g9725b08f-1focal cephfs-mirror=18.0.0-6609-g9725b08f-1focal 2023-10-08T06:05:28.200 INFO:teuthology.orchestra.run.smithi040.stdout:Reading package lists... 2023-10-08T06:05:28.225 DEBUG:teuthology.orchestra.run.smithi040:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.0.0-6609-g9725b08f-1focal cephadm=18.0.0-6609-g9725b08f-1focal ceph-mds=18.0.0-6609-g9725b08f-1focal ceph-mgr=18.0.0-6609-g9725b08f-1focal ceph-common=18.0.0-6609-g9725b08f-1focal ceph-fuse=18.0.0-6609-g9725b08f-1focal ceph-test=18.0.0-6609-g9725b08f-1focal ceph-volume=18.0.0-6609-g9725b08f-1focal radosgw=18.0.0-6609-g9725b08f-1focal python3-rados=18.0.0-6609-g9725b08f-1focal python3-rgw=18.0.0-6609-g9725b08f-1focal python3-cephfs=18.0.0-6609-g9725b08f-1focal python3-rbd=18.0.0-6609-g9725b08f-1focal libcephfs2=18.0.0-6609-g9725b08f-1focal libcephfs-dev=18.0.0-6609-g9725b08f-1focal librados2=18.0.0-6609-g9725b08f-1focal librbd1=18.0.0-6609-g9725b08f-1focal rbd-fuse=18.0.0-6609-g9725b08f-1focal python3-cephfs=18.0.0-6609-g9725b08f-1focal cephfs-shell=18.0.0-6609-g9725b08f-1focal cephfs-top=18.0.0-6609-g9725b08f-1focal cephfs-mirror=18.0.0-6609-g9725b08f-1focal 2023-10-08T06:05:28.238 INFO:teuthology.orchestra.run.smithi032.stdout:Reading package lists... 2023-10-08T06:05:28.297 INFO:teuthology.orchestra.run.smithi040.stdout:Reading package lists... 2023-10-08T06:05:28.444 INFO:teuthology.orchestra.run.smithi032.stdout:Building dependency tree... 2023-10-08T06:05:28.445 INFO:teuthology.orchestra.run.smithi032.stdout:Reading state information... 2023-10-08T06:05:28.481 INFO:teuthology.orchestra.run.smithi040.stdout:Building dependency tree... 2023-10-08T06:05:28.482 INFO:teuthology.orchestra.run.smithi040.stdout:Reading state information... 2023-10-08T06:05:28.632 INFO:teuthology.orchestra.run.smithi032.stdout:The following packages were automatically installed and are no longer required: 2023-10-08T06:05:28.634 INFO:teuthology.orchestra.run.smithi032.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2023-10-08T06:05:28.634 INFO:teuthology.orchestra.run.smithi032.stdout:Use 'sudo apt autoremove' to remove them. 2023-10-08T06:05:28.634 INFO:teuthology.orchestra.run.smithi032.stdout:The following additional packages will be installed: 2023-10-08T06:05:28.634 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-10-08T06:05:28.634 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd fonts-mathjax jq 2023-10-08T06:05:28.635 INFO:teuthology.orchestra.run.smithi032.stdout: libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc libjs-underscore 2023-10-08T06:05:28.635 INFO:teuthology.orchestra.run.smithi032.stdout: liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 libpcre2-16-0 2023-10-08T06:05:28.635 INFO:teuthology.orchestra.run.smithi032.stdout: libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 libradosstriper1 2023-10-08T06:05:28.636 INFO:teuthology.orchestra.run.smithi032.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 nvme-cli 2023-10-08T06:05:28.636 INFO:teuthology.orchestra.run.smithi032.stdout: python-asyncssh-doc python-natsort-doc python-pastedeploy-tpl 2023-10-08T06:05:28.637 INFO:teuthology.orchestra.run.smithi032.stdout: python3-asyncssh python3-atomicwrites python3-attr python3-bcrypt 2023-10-08T06:05:28.637 INFO:teuthology.orchestra.run.smithi032.stdout: python3-blinker python3-bs4 python3-cachetools python3-ceph-argparse 2023-10-08T06:05:28.637 INFO:teuthology.orchestra.run.smithi032.stdout: python3-ceph-common python3-cherrypy3 python3-cmd2 python3-colorama 2023-10-08T06:05:28.637 INFO:teuthology.orchestra.run.smithi032.stdout: python3-cryptography python3-decorator python3-google-auth python3-html5lib 2023-10-08T06:05:28.637 INFO:teuthology.orchestra.run.smithi032.stdout: python3-jinja2 python3-joblib python3-jwt python3-kubernetes 2023-10-08T06:05:28.637 INFO:teuthology.orchestra.run.smithi032.stdout: python3-logutils python3-lxml python3-mako python3-markupsafe 2023-10-08T06:05:28.638 INFO:teuthology.orchestra.run.smithi032.stdout: python3-natsort python3-oauthlib python3-openssl python3-packaging 2023-10-08T06:05:28.638 INFO:teuthology.orchestra.run.smithi032.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2023-10-08T06:05:28.638 INFO:teuthology.orchestra.run.smithi032.stdout: python3-pluggy python3-prettytable python3-psutil python3-py python3-pyasn1 2023-10-08T06:05:28.638 INFO:teuthology.orchestra.run.smithi032.stdout: python3-pyasn1-modules python3-pyinotify python3-pyperclip python3-pytest 2023-10-08T06:05:28.638 INFO:teuthology.orchestra.run.smithi032.stdout: python3-repoze.lru python3-requests-oauthlib python3-routes python3-rsa 2023-10-08T06:05:28.638 INFO:teuthology.orchestra.run.smithi032.stdout: python3-scipy python3-simplegeneric python3-simplejson 2023-10-08T06:05:28.639 INFO:teuthology.orchestra.run.smithi032.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2023-10-08T06:05:28.639 INFO:teuthology.orchestra.run.smithi032.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2023-10-08T06:05:28.639 INFO:teuthology.orchestra.run.smithi032.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2023-10-08T06:05:28.639 INFO:teuthology.orchestra.run.smithi032.stdout: qttranslations5-l10n socat xmlstarlet 2023-10-08T06:05:28.639 INFO:teuthology.orchestra.run.smithi032.stdout:Suggested packages: 2023-10-08T06:05:28.639 INFO:teuthology.orchestra.run.smithi032.stdout: python3-influxdb fonts-mathjax-extras fonts-stix libjs-mathjax-doc 2023-10-08T06:05:28.640 INFO:teuthology.orchestra.run.smithi032.stdout: python-attr-doc python-blinker-doc python-cryptography-doc 2023-10-08T06:05:28.640 INFO:teuthology.orchestra.run.smithi032.stdout: python3-cryptography-vectors python3-genshi python-jinja2-doc python3-crypto 2023-10-08T06:05:28.640 INFO:teuthology.orchestra.run.smithi032.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2023-10-08T06:05:28.640 INFO:teuthology.orchestra.run.smithi032.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2023-10-08T06:05:28.641 INFO:teuthology.orchestra.run.smithi032.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2023-10-08T06:05:28.641 INFO:teuthology.orchestra.run.smithi032.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2023-10-08T06:05:28.641 INFO:teuthology.orchestra.run.smithi032.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2023-10-08T06:05:28.641 INFO:teuthology.orchestra.run.smithi032.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2023-10-08T06:05:28.641 INFO:teuthology.orchestra.run.smithi032.stdout:Recommended packages: 2023-10-08T06:05:28.641 INFO:teuthology.orchestra.run.smithi032.stdout: btrfs-tools 2023-10-08T06:05:28.659 INFO:teuthology.orchestra.run.smithi040.stdout:The following packages were automatically installed and are no longer required: 2023-10-08T06:05:28.660 INFO:teuthology.orchestra.run.smithi040.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2023-10-08T06:05:28.660 INFO:teuthology.orchestra.run.smithi040.stdout:Use 'sudo apt autoremove' to remove them. 2023-10-08T06:05:28.660 INFO:teuthology.orchestra.run.smithi040.stdout:The following additional packages will be installed: 2023-10-08T06:05:28.660 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-10-08T06:05:28.660 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd fonts-mathjax jq 2023-10-08T06:05:28.660 INFO:teuthology.orchestra.run.smithi040.stdout: libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc libjs-underscore 2023-10-08T06:05:28.660 INFO:teuthology.orchestra.run.smithi040.stdout: liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 libpcre2-16-0 2023-10-08T06:05:28.660 INFO:teuthology.orchestra.run.smithi040.stdout: libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 libradosstriper1 2023-10-08T06:05:28.661 INFO:teuthology.orchestra.run.smithi040.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 nvme-cli 2023-10-08T06:05:28.662 INFO:teuthology.orchestra.run.smithi040.stdout: python-asyncssh-doc python-natsort-doc python-pastedeploy-tpl 2023-10-08T06:05:28.662 INFO:teuthology.orchestra.run.smithi040.stdout: python3-asyncssh python3-atomicwrites python3-attr python3-bcrypt 2023-10-08T06:05:28.662 INFO:teuthology.orchestra.run.smithi040.stdout: python3-blinker python3-bs4 python3-cachetools python3-ceph-argparse 2023-10-08T06:05:28.662 INFO:teuthology.orchestra.run.smithi040.stdout: python3-ceph-common python3-cherrypy3 python3-cmd2 python3-colorama 2023-10-08T06:05:28.662 INFO:teuthology.orchestra.run.smithi040.stdout: python3-cryptography python3-decorator python3-google-auth python3-html5lib 2023-10-08T06:05:28.662 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jinja2 python3-joblib python3-jwt python3-kubernetes 2023-10-08T06:05:28.662 INFO:teuthology.orchestra.run.smithi040.stdout: python3-logutils python3-lxml python3-mako python3-markupsafe 2023-10-08T06:05:28.663 INFO:teuthology.orchestra.run.smithi040.stdout: python3-natsort python3-oauthlib python3-openssl python3-packaging 2023-10-08T06:05:28.663 INFO:teuthology.orchestra.run.smithi040.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2023-10-08T06:05:28.664 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pluggy python3-prettytable python3-psutil python3-py python3-pyasn1 2023-10-08T06:05:28.664 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pyasn1-modules python3-pyinotify python3-pyperclip python3-pytest 2023-10-08T06:05:28.664 INFO:teuthology.orchestra.run.smithi040.stdout: python3-repoze.lru python3-requests-oauthlib python3-routes python3-rsa 2023-10-08T06:05:28.664 INFO:teuthology.orchestra.run.smithi040.stdout: python3-scipy python3-simplegeneric python3-simplejson 2023-10-08T06:05:28.665 INFO:teuthology.orchestra.run.smithi040.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2023-10-08T06:05:28.665 INFO:teuthology.orchestra.run.smithi040.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2023-10-08T06:05:28.665 INFO:teuthology.orchestra.run.smithi040.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2023-10-08T06:05:28.666 INFO:teuthology.orchestra.run.smithi040.stdout: qttranslations5-l10n socat xmlstarlet 2023-10-08T06:05:28.666 INFO:teuthology.orchestra.run.smithi040.stdout:Suggested packages: 2023-10-08T06:05:28.667 INFO:teuthology.orchestra.run.smithi040.stdout: python3-influxdb fonts-mathjax-extras fonts-stix libjs-mathjax-doc 2023-10-08T06:05:28.667 INFO:teuthology.orchestra.run.smithi040.stdout: python-attr-doc python-blinker-doc python-cryptography-doc 2023-10-08T06:05:28.667 INFO:teuthology.orchestra.run.smithi040.stdout: python3-cryptography-vectors python3-genshi python-jinja2-doc python3-crypto 2023-10-08T06:05:28.667 INFO:teuthology.orchestra.run.smithi040.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2023-10-08T06:05:28.668 INFO:teuthology.orchestra.run.smithi040.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2023-10-08T06:05:28.668 INFO:teuthology.orchestra.run.smithi040.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2023-10-08T06:05:28.668 INFO:teuthology.orchestra.run.smithi040.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2023-10-08T06:05:28.668 INFO:teuthology.orchestra.run.smithi040.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2023-10-08T06:05:28.669 INFO:teuthology.orchestra.run.smithi040.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2023-10-08T06:05:28.669 INFO:teuthology.orchestra.run.smithi040.stdout:Recommended packages: 2023-10-08T06:05:28.669 INFO:teuthology.orchestra.run.smithi040.stdout: btrfs-tools 2023-10-08T06:05:28.760 INFO:teuthology.orchestra.run.smithi032.stdout:The following NEW packages will be installed: 2023-10-08T06:05:28.760 INFO:teuthology.orchestra.run.smithi032.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-10-08T06:05:28.760 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-10-08T06:05:28.761 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-10-08T06:05:28.761 INFO:teuthology.orchestra.run.smithi032.stdout: cephfs-mirror cephfs-shell cephfs-top fonts-mathjax jq libcephfs-dev 2023-10-08T06:05:28.761 INFO:teuthology.orchestra.run.smithi032.stdout: libcephfs2 libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc 2023-10-08T06:05:28.761 INFO:teuthology.orchestra.run.smithi032.stdout: libjs-underscore liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 2023-10-08T06:05:28.762 INFO:teuthology.orchestra.run.smithi032.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 2023-10-08T06:05:28.762 INFO:teuthology.orchestra.run.smithi032.stdout: libradosstriper1 librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 2023-10-08T06:05:28.762 INFO:teuthology.orchestra.run.smithi032.stdout: nvme-cli python-asyncssh-doc python-natsort-doc python-pastedeploy-tpl 2023-10-08T06:05:28.762 INFO:teuthology.orchestra.run.smithi032.stdout: python3-asyncssh python3-atomicwrites python3-attr python3-bcrypt 2023-10-08T06:05:28.762 INFO:teuthology.orchestra.run.smithi032.stdout: python3-blinker python3-bs4 python3-cachetools python3-ceph-argparse 2023-10-08T06:05:28.762 INFO:teuthology.orchestra.run.smithi032.stdout: python3-ceph-common python3-cephfs python3-cherrypy3 python3-cmd2 2023-10-08T06:05:28.763 INFO:teuthology.orchestra.run.smithi032.stdout: python3-colorama python3-cryptography python3-decorator python3-google-auth 2023-10-08T06:05:28.763 INFO:teuthology.orchestra.run.smithi032.stdout: python3-html5lib python3-jinja2 python3-joblib python3-jwt 2023-10-08T06:05:28.763 INFO:teuthology.orchestra.run.smithi032.stdout: python3-kubernetes python3-logutils python3-lxml python3-mako 2023-10-08T06:05:28.763 INFO:teuthology.orchestra.run.smithi032.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2023-10-08T06:05:28.763 INFO:teuthology.orchestra.run.smithi032.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2023-10-08T06:05:28.764 INFO:teuthology.orchestra.run.smithi032.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2023-10-08T06:05:28.764 INFO:teuthology.orchestra.run.smithi032.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyperclip 2023-10-08T06:05:28.764 INFO:teuthology.orchestra.run.smithi032.stdout: python3-pytest python3-rados python3-rbd python3-repoze.lru 2023-10-08T06:05:28.764 INFO:teuthology.orchestra.run.smithi032.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2023-10-08T06:05:28.764 INFO:teuthology.orchestra.run.smithi032.stdout: python3-scipy python3-simplegeneric python3-simplejson 2023-10-08T06:05:28.765 INFO:teuthology.orchestra.run.smithi032.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2023-10-08T06:05:28.765 INFO:teuthology.orchestra.run.smithi032.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2023-10-08T06:05:28.765 INFO:teuthology.orchestra.run.smithi032.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2023-10-08T06:05:28.765 INFO:teuthology.orchestra.run.smithi032.stdout: qttranslations5-l10n radosgw rbd-fuse socat xmlstarlet 2023-10-08T06:05:28.766 INFO:teuthology.orchestra.run.smithi032.stdout:The following packages will be upgraded: 2023-10-08T06:05:28.767 INFO:teuthology.orchestra.run.smithi032.stdout: librados2 librbd1 2023-10-08T06:05:28.785 INFO:teuthology.orchestra.run.smithi040.stdout:The following NEW packages will be installed: 2023-10-08T06:05:28.786 INFO:teuthology.orchestra.run.smithi040.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-10-08T06:05:28.786 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-10-08T06:05:28.786 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-10-08T06:05:28.786 INFO:teuthology.orchestra.run.smithi040.stdout: cephfs-mirror cephfs-shell cephfs-top fonts-mathjax jq libcephfs-dev 2023-10-08T06:05:28.786 INFO:teuthology.orchestra.run.smithi040.stdout: libcephfs2 libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc 2023-10-08T06:05:28.786 INFO:teuthology.orchestra.run.smithi040.stdout: libjs-underscore liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 2023-10-08T06:05:28.786 INFO:teuthology.orchestra.run.smithi040.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 2023-10-08T06:05:28.786 INFO:teuthology.orchestra.run.smithi040.stdout: libradosstriper1 librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 2023-10-08T06:05:28.786 INFO:teuthology.orchestra.run.smithi040.stdout: nvme-cli python-asyncssh-doc python-natsort-doc python-pastedeploy-tpl 2023-10-08T06:05:28.787 INFO:teuthology.orchestra.run.smithi040.stdout: python3-asyncssh python3-atomicwrites python3-attr python3-bcrypt 2023-10-08T06:05:28.787 INFO:teuthology.orchestra.run.smithi040.stdout: python3-blinker python3-bs4 python3-cachetools python3-ceph-argparse 2023-10-08T06:05:28.787 INFO:teuthology.orchestra.run.smithi040.stdout: python3-ceph-common python3-cephfs python3-cherrypy3 python3-cmd2 2023-10-08T06:05:28.787 INFO:teuthology.orchestra.run.smithi040.stdout: python3-colorama python3-cryptography python3-decorator python3-google-auth 2023-10-08T06:05:28.787 INFO:teuthology.orchestra.run.smithi040.stdout: python3-html5lib python3-jinja2 python3-joblib python3-jwt 2023-10-08T06:05:28.787 INFO:teuthology.orchestra.run.smithi040.stdout: python3-kubernetes python3-logutils python3-lxml python3-mako 2023-10-08T06:05:28.787 INFO:teuthology.orchestra.run.smithi040.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2023-10-08T06:05:28.787 INFO:teuthology.orchestra.run.smithi040.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2023-10-08T06:05:28.787 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2023-10-08T06:05:28.787 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyperclip 2023-10-08T06:05:28.787 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pytest python3-rados python3-rbd python3-repoze.lru 2023-10-08T06:05:28.788 INFO:teuthology.orchestra.run.smithi040.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2023-10-08T06:05:28.788 INFO:teuthology.orchestra.run.smithi040.stdout: python3-scipy python3-simplegeneric python3-simplejson 2023-10-08T06:05:28.788 INFO:teuthology.orchestra.run.smithi040.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2023-10-08T06:05:28.788 INFO:teuthology.orchestra.run.smithi040.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2023-10-08T06:05:28.788 INFO:teuthology.orchestra.run.smithi040.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2023-10-08T06:05:28.788 INFO:teuthology.orchestra.run.smithi040.stdout: qttranslations5-l10n radosgw rbd-fuse socat xmlstarlet 2023-10-08T06:05:28.789 INFO:teuthology.orchestra.run.smithi040.stdout:The following packages will be upgraded: 2023-10-08T06:05:28.789 INFO:teuthology.orchestra.run.smithi040.stdout: librados2 librbd1 2023-10-08T06:05:28.831 INFO:teuthology.orchestra.run.smithi032.stdout:2 upgraded, 116 newly installed, 0 to remove and 253 not upgraded. 2023-10-08T06:05:28.831 INFO:teuthology.orchestra.run.smithi032.stdout:Need to get 211 MB of archives. 2023-10-08T06:05:28.831 INFO:teuthology.orchestra.run.smithi032.stdout:After this operation, 1,044 MB of additional disk space will be used. 2023-10-08T06:05:28.831 INFO:teuthology.orchestra.run.smithi032.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyperclip all 1.7.0-1 [10.5 kB] 2023-10-08T06:05:28.852 INFO:teuthology.orchestra.run.smithi032.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2023-10-08T06:05:28.854 INFO:teuthology.orchestra.run.smithi040.stdout:2 upgraded, 116 newly installed, 0 to remove and 253 not upgraded. 2023-10-08T06:05:28.854 INFO:teuthology.orchestra.run.smithi040.stdout:Need to get 211 MB of archives. 2023-10-08T06:05:28.854 INFO:teuthology.orchestra.run.smithi040.stdout:After this operation, 1,044 MB of additional disk space will be used. 2023-10-08T06:05:28.854 INFO:teuthology.orchestra.run.smithi040.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyperclip all 1.7.0-1 [10.5 kB] 2023-10-08T06:05:28.861 INFO:teuthology.orchestra.run.smithi032.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cmd2 all 0.8.5-2.1 [49.6 kB] 2023-10-08T06:05:28.873 INFO:teuthology.orchestra.run.smithi040.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2023-10-08T06:05:28.881 INFO:teuthology.orchestra.run.smithi040.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cmd2 all 0.8.5-2.1 [49.6 kB] 2023-10-08T06:05:28.891 INFO:teuthology.orchestra.run.smithi032.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2023-10-08T06:05:28.907 INFO:teuthology.orchestra.run.smithi040.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2023-10-08T06:05:28.910 INFO:teuthology.orchestra.run.smithi032.stdout:Get:5 https://3.chacra.ceph.com/r/ceph/main/9725b08fd801c82987c737f7e6d354878f036ee8/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 18.0.0-6609-g9725b08f-1focal [3,603 kB] 2023-10-08T06:05:28.924 INFO:teuthology.orchestra.run.smithi032.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal/universe amd64 libdouble-conversion3 amd64 3.1.5-4ubuntu1 [37.9 kB] 2023-10-08T06:05:28.930 INFO:teuthology.orchestra.run.smithi032.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpcre2-16-0 amd64 10.34-7ubuntu0.1 [181 kB] 2023-10-08T06:05:28.934 INFO:teuthology.orchestra.run.smithi040.stdout:Get:5 https://3.chacra.ceph.com/r/ceph/main/9725b08fd801c82987c737f7e6d354878f036ee8/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 18.0.0-6609-g9725b08f-1focal [3,603 kB] 2023-10-08T06:05:28.936 INFO:teuthology.orchestra.run.smithi040.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal/universe amd64 libdouble-conversion3 amd64 3.1.5-4ubuntu1 [37.9 kB] 2023-10-08T06:05:28.940 INFO:teuthology.orchestra.run.smithi040.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpcre2-16-0 amd64 10.34-7ubuntu0.1 [181 kB] 2023-10-08T06:05:28.944 INFO:teuthology.orchestra.run.smithi032.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5core5a amd64 5.12.8+dfsg-0ubuntu2.1 [2,006 kB] 2023-10-08T06:05:28.953 INFO:teuthology.orchestra.run.smithi040.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5core5a amd64 5.12.8+dfsg-0ubuntu2.1 [2,006 kB] 2023-10-08T06:05:28.992 INFO:teuthology.orchestra.run.smithi032.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5dbus5 amd64 5.12.8+dfsg-0ubuntu2.1 [208 kB] 2023-10-08T06:05:28.994 INFO:teuthology.orchestra.run.smithi032.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5network5 amd64 5.12.8+dfsg-0ubuntu2.1 [673 kB] 2023-10-08T06:05:28.995 INFO:teuthology.orchestra.run.smithi040.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5dbus5 amd64 5.12.8+dfsg-0ubuntu2.1 [208 kB] 2023-10-08T06:05:28.997 INFO:teuthology.orchestra.run.smithi040.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5network5 amd64 5.12.8+dfsg-0ubuntu2.1 [673 kB] 2023-10-08T06:05:29.001 INFO:teuthology.orchestra.run.smithi032.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal/universe amd64 libthrift-0.13.0 amd64 0.13.0-2build2 [249 kB] 2023-10-08T06:05:29.003 INFO:teuthology.orchestra.run.smithi040.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal/universe amd64 libthrift-0.13.0 amd64 0.13.0-2build2 [249 kB] 2023-10-08T06:05:29.004 INFO:teuthology.orchestra.run.smithi032.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2023-10-08T06:05:29.004 INFO:teuthology.orchestra.run.smithi032.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal/main amd64 liblua5.3-0 amd64 5.3.3-1.1ubuntu2 [116 kB] 2023-10-08T06:05:29.005 INFO:teuthology.orchestra.run.smithi032.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2023-10-08T06:05:29.005 INFO:teuthology.orchestra.run.smithi032.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2023-10-08T06:05:29.005 INFO:teuthology.orchestra.run.smithi040.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2023-10-08T06:05:29.006 INFO:teuthology.orchestra.run.smithi040.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal/main amd64 liblua5.3-0 amd64 5.3.3-1.1ubuntu2 [116 kB] 2023-10-08T06:05:29.006 INFO:teuthology.orchestra.run.smithi040.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2023-10-08T06:05:29.007 INFO:teuthology.orchestra.run.smithi040.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2023-10-08T06:05:29.009 INFO:teuthology.orchestra.run.smithi032.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2023-10-08T06:05:29.010 INFO:teuthology.orchestra.run.smithi032.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2023-10-08T06:05:29.011 INFO:teuthology.orchestra.run.smithi040.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2023-10-08T06:05:29.011 INFO:teuthology.orchestra.run.smithi040.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2023-10-08T06:05:29.012 INFO:teuthology.orchestra.run.smithi032.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-natsort all 7.0.1-1 [29.2 kB] 2023-10-08T06:05:29.013 INFO:teuthology.orchestra.run.smithi040.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-natsort all 7.0.1-1 [29.2 kB] 2023-10-08T06:05:29.029 INFO:teuthology.orchestra.run.smithi040.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2023-10-08T06:05:29.030 INFO:teuthology.orchestra.run.smithi040.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2023-10-08T06:05:29.030 INFO:teuthology.orchestra.run.smithi040.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2.1 [59.2 kB] 2023-10-08T06:05:29.032 INFO:teuthology.orchestra.run.smithi032.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2023-10-08T06:05:29.032 INFO:teuthology.orchestra.run.smithi032.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2023-10-08T06:05:29.032 INFO:teuthology.orchestra.run.smithi032.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2.1 [59.2 kB] 2023-10-08T06:05:29.033 INFO:teuthology.orchestra.run.smithi040.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-10-08T06:05:29.033 INFO:teuthology.orchestra.run.smithi040.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2023-10-08T06:05:29.033 INFO:teuthology.orchestra.run.smithi040.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webob all 1:1.8.5-2 [84.4 kB] 2023-10-08T06:05:29.034 INFO:teuthology.orchestra.run.smithi032.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-10-08T06:05:29.035 INFO:teuthology.orchestra.run.smithi032.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2023-10-08T06:05:29.035 INFO:teuthology.orchestra.run.smithi032.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webob all 1:1.8.5-2 [84.4 kB] 2023-10-08T06:05:29.035 INFO:teuthology.orchestra.run.smithi040.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2023-10-08T06:05:29.035 INFO:teuthology.orchestra.run.smithi040.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2023-10-08T06:05:29.035 INFO:teuthology.orchestra.run.smithi040.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-waitress all 1.4.1-1ubuntu0.1 [81.4 kB] 2023-10-08T06:05:29.035 INFO:teuthology.orchestra.run.smithi032.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2023-10-08T06:05:29.036 INFO:teuthology.orchestra.run.smithi032.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2023-10-08T06:05:29.037 INFO:teuthology.orchestra.run.smithi032.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-waitress all 1.4.1-1ubuntu0.1 [81.4 kB] 2023-10-08T06:05:29.047 INFO:teuthology.orchestra.run.smithi040.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2023-10-08T06:05:29.054 INFO:teuthology.orchestra.run.smithi032.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2023-10-08T06:05:29.054 INFO:teuthology.orchestra.run.smithi032.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2023-10-08T06:05:29.054 INFO:teuthology.orchestra.run.smithi040.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2023-10-08T06:05:29.059 INFO:teuthology.orchestra.run.smithi032.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2023-10-08T06:05:29.060 INFO:teuthology.orchestra.run.smithi040.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2023-10-08T06:05:29.060 INFO:teuthology.orchestra.run.smithi040.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2023-10-08T06:05:29.061 INFO:teuthology.orchestra.run.smithi040.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2023-10-08T06:05:29.062 INFO:teuthology.orchestra.run.smithi040.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2023-10-08T06:05:29.063 INFO:teuthology.orchestra.run.smithi040.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-werkzeug all 0.16.1+dfsg1-2ubuntu0.1 [183 kB] 2023-10-08T06:05:29.066 INFO:teuthology.orchestra.run.smithi040.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cryptography amd64 2.8-3ubuntu0.1 [211 kB] 2023-10-08T06:05:29.070 INFO:teuthology.orchestra.run.smithi040.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2023-10-08T06:05:29.070 INFO:teuthology.orchestra.run.smithi040.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-asyncssh all 1.12.2-1 [152 kB] 2023-10-08T06:05:29.072 INFO:teuthology.orchestra.run.smithi032.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2023-10-08T06:05:29.073 INFO:teuthology.orchestra.run.smithi032.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2023-10-08T06:05:29.073 INFO:teuthology.orchestra.run.smithi032.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2023-10-08T06:05:29.074 INFO:teuthology.orchestra.run.smithi032.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-werkzeug all 0.16.1+dfsg1-2ubuntu0.1 [183 kB] 2023-10-08T06:05:29.077 INFO:teuthology.orchestra.run.smithi032.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cryptography amd64 2.8-3ubuntu0.1 [211 kB] 2023-10-08T06:05:29.080 INFO:teuthology.orchestra.run.smithi040.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jinja2 all 2.10.1-2 [95.5 kB] 2023-10-08T06:05:29.081 INFO:teuthology.orchestra.run.smithi032.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2023-10-08T06:05:29.081 INFO:teuthology.orchestra.run.smithi032.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-asyncssh all 1.12.2-1 [152 kB] 2023-10-08T06:05:29.081 INFO:teuthology.orchestra.run.smithi040.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2023-10-08T06:05:29.082 INFO:teuthology.orchestra.run.smithi040.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jwt all 1.7.1-2ubuntu2.1 [18.0 kB] 2023-10-08T06:05:29.082 INFO:teuthology.orchestra.run.smithi040.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-10-08T06:05:29.083 INFO:teuthology.orchestra.run.smithi040.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjs-underscore all 1.9.1~dfsg-1ubuntu0.20.04.1 [99.5 kB] 2023-10-08T06:05:29.092 INFO:teuthology.orchestra.run.smithi032.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jinja2 all 2.10.1-2 [95.5 kB] 2023-10-08T06:05:29.093 INFO:teuthology.orchestra.run.smithi032.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2023-10-08T06:05:29.093 INFO:teuthology.orchestra.run.smithi032.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jwt all 1.7.1-2ubuntu2.1 [18.0 kB] 2023-10-08T06:05:29.097 INFO:teuthology.orchestra.run.smithi040.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2023-10-08T06:05:29.099 INFO:teuthology.orchestra.run.smithi040.stdout:Get:44 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2023-10-08T06:05:29.100 INFO:teuthology.orchestra.run.smithi040.stdout:Get:45 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2023-10-08T06:05:29.101 INFO:teuthology.orchestra.run.smithi040.stdout:Get:46 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2023-10-08T06:05:29.102 INFO:teuthology.orchestra.run.smithi040.stdout:Get:47 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2023-10-08T06:05:29.112 INFO:teuthology.orchestra.run.smithi032.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-10-08T06:05:29.112 INFO:teuthology.orchestra.run.smithi032.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjs-underscore all 1.9.1~dfsg-1ubuntu0.20.04.1 [99.5 kB] 2023-10-08T06:05:29.114 INFO:teuthology.orchestra.run.smithi032.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2023-10-08T06:05:29.116 INFO:teuthology.orchestra.run.smithi032.stdout:Get:44 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2023-10-08T06:05:29.118 INFO:teuthology.orchestra.run.smithi032.stdout:Get:45 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2023-10-08T06:05:29.118 INFO:teuthology.orchestra.run.smithi032.stdout:Get:46 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2023-10-08T06:05:29.120 INFO:teuthology.orchestra.run.smithi032.stdout:Get:47 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2023-10-08T06:05:29.154 INFO:teuthology.orchestra.run.smithi032.stdout:Get:48 https://3.chacra.ceph.com/r/ceph/main/9725b08fd801c82987c737f7e6d354878f036ee8/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 18.0.0-6609-g9725b08f-1focal [4,060 kB] 2023-10-08T06:05:29.179 INFO:teuthology.orchestra.run.smithi040.stdout:Get:48 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2023-10-08T06:05:29.196 INFO:teuthology.orchestra.run.smithi040.stdout:Get:49 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2023-10-08T06:05:29.197 INFO:teuthology.orchestra.run.smithi040.stdout:Get:50 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2023-10-08T06:05:29.208 INFO:teuthology.orchestra.run.smithi040.stdout:Get:51 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2023-10-08T06:05:29.209 INFO:teuthology.orchestra.run.smithi040.stdout:Get:52 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2023-10-08T06:05:29.209 INFO:teuthology.orchestra.run.smithi040.stdout:Get:53 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2023-10-08T06:05:29.215 INFO:teuthology.orchestra.run.smithi032.stdout:Get:49 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2023-10-08T06:05:29.236 INFO:teuthology.orchestra.run.smithi032.stdout:Get:50 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2023-10-08T06:05:29.237 INFO:teuthology.orchestra.run.smithi032.stdout:Get:51 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2023-10-08T06:05:29.254 INFO:teuthology.orchestra.run.smithi032.stdout:Get:52 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2023-10-08T06:05:29.254 INFO:teuthology.orchestra.run.smithi032.stdout:Get:53 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2023-10-08T06:05:29.254 INFO:teuthology.orchestra.run.smithi032.stdout:Get:54 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2023-10-08T06:05:29.254 INFO:teuthology.orchestra.run.smithi032.stdout:Get:55 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2023-10-08T06:05:29.255 INFO:teuthology.orchestra.run.smithi032.stdout:Get:56 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2023-10-08T06:05:29.263 INFO:teuthology.orchestra.run.smithi040.stdout:Get:54 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2023-10-08T06:05:29.264 INFO:teuthology.orchestra.run.smithi040.stdout:Get:55 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2023-10-08T06:05:29.265 INFO:teuthology.orchestra.run.smithi040.stdout:Get:56 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-blinker all 1.4+dfsg1-0.3ubuntu1 [13.2 kB] 2023-10-08T06:05:29.266 INFO:teuthology.orchestra.run.smithi040.stdout:Get:57 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-oauthlib all 3.1.0-1ubuntu2 [84.8 kB] 2023-10-08T06:05:29.268 INFO:teuthology.orchestra.run.smithi040.stdout:Get:58 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2023-10-08T06:05:29.269 INFO:teuthology.orchestra.run.smithi040.stdout:Get:59 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2023-10-08T06:05:29.270 INFO:teuthology.orchestra.run.smithi040.stdout:Get:60 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2023-10-08T06:05:29.274 INFO:teuthology.orchestra.run.smithi040.stdout:Get:61 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2023-10-08T06:05:29.280 INFO:teuthology.orchestra.run.smithi040.stdout:Get:62 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2023-10-08T06:05:29.293 INFO:teuthology.orchestra.run.smithi040.stdout:Get:63 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2023-10-08T06:05:29.295 INFO:teuthology.orchestra.run.smithi040.stdout:Get:64 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2023-10-08T06:05:29.298 INFO:teuthology.orchestra.run.smithi040.stdout:Get:65 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2023-10-08T06:05:29.301 INFO:teuthology.orchestra.run.smithi032.stdout:Get:57 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-blinker all 1.4+dfsg1-0.3ubuntu1 [13.2 kB] 2023-10-08T06:05:29.302 INFO:teuthology.orchestra.run.smithi032.stdout:Get:58 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-oauthlib all 3.1.0-1ubuntu2 [84.8 kB] 2023-10-08T06:05:29.303 INFO:teuthology.orchestra.run.smithi040.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-colorama all 0.4.3-1build1 [23.9 kB] 2023-10-08T06:05:29.303 INFO:teuthology.orchestra.run.smithi040.stdout:Get:67 http://archive.ubuntu.com/ubuntu focal/universe amd64 fonts-mathjax all 2.7.4+dfsg-1 [2,208 kB] 2023-10-08T06:05:29.304 INFO:teuthology.orchestra.run.smithi032.stdout:Get:59 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2023-10-08T06:05:29.304 INFO:teuthology.orchestra.run.smithi032.stdout:Get:60 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2023-10-08T06:05:29.305 INFO:teuthology.orchestra.run.smithi032.stdout:Get:61 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2023-10-08T06:05:29.309 INFO:teuthology.orchestra.run.smithi032.stdout:Get:62 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2023-10-08T06:05:29.311 INFO:teuthology.orchestra.run.smithi032.stdout:Get:63 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2023-10-08T06:05:29.314 INFO:teuthology.orchestra.run.smithi032.stdout:Get:64 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2023-10-08T06:05:29.320 INFO:teuthology.orchestra.run.smithi040.stdout:Get:68 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.1 [283 kB] 2023-10-08T06:05:29.321 INFO:teuthology.orchestra.run.smithi032.stdout:Get:65 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2023-10-08T06:05:29.323 INFO:teuthology.orchestra.run.smithi040.stdout:Get:69 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-asyncssh-doc all 1.12.2-1 [258 kB] 2023-10-08T06:05:29.325 INFO:teuthology.orchestra.run.smithi040.stdout:Get:70 http://archive.ubuntu.com/ubuntu focal/universe amd64 libjs-mathjax all 2.7.4+dfsg-1 [5,654 kB] 2023-10-08T06:05:29.335 INFO:teuthology.orchestra.run.smithi032.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2023-10-08T06:05:29.335 INFO:teuthology.orchestra.run.smithi032.stdout:Get:67 https://3.chacra.ceph.com/r/ceph/main/9725b08fd801c82987c737f7e6d354878f036ee8/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 18.0.0-6609-g9725b08f-1focal [755 kB] 2023-10-08T06:05:29.339 INFO:teuthology.orchestra.run.smithi032.stdout:Get:68 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-colorama all 0.4.3-1build1 [23.9 kB] 2023-10-08T06:05:29.340 INFO:teuthology.orchestra.run.smithi032.stdout:Get:69 http://archive.ubuntu.com/ubuntu focal/universe amd64 fonts-mathjax all 2.7.4+dfsg-1 [2,208 kB] 2023-10-08T06:05:29.359 INFO:teuthology.orchestra.run.smithi032.stdout:Get:70 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.1 [283 kB] 2023-10-08T06:05:29.360 INFO:teuthology.orchestra.run.smithi032.stdout:Get:71 https://3.chacra.ceph.com/r/ceph/main/9725b08fd801c82987c737f7e6d354878f036ee8/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 18.0.0-6609-g9725b08f-1focal [387 kB] 2023-10-08T06:05:29.361 INFO:teuthology.orchestra.run.smithi040.stdout:Get:71 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-natsort-doc all 7.0.1-1 [103 kB] 2023-10-08T06:05:29.361 INFO:teuthology.orchestra.run.smithi032.stdout:Get:72 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-asyncssh-doc all 1.12.2-1 [258 kB] 2023-10-08T06:05:29.362 INFO:teuthology.orchestra.run.smithi040.stdout:Get:72 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2023-10-08T06:05:29.362 INFO:teuthology.orchestra.run.smithi040.stdout:Get:73 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2023-10-08T06:05:29.363 INFO:teuthology.orchestra.run.smithi040.stdout:Get:74 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2023-10-08T06:05:29.363 INFO:teuthology.orchestra.run.smithi040.stdout:Get:75 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2023-10-08T06:05:29.364 INFO:teuthology.orchestra.run.smithi032.stdout:Get:73 http://archive.ubuntu.com/ubuntu focal/universe amd64 libjs-mathjax all 2.7.4+dfsg-1 [5,654 kB] 2023-10-08T06:05:29.367 INFO:teuthology.orchestra.run.smithi040.stdout:Get:76 https://3.chacra.ceph.com/r/ceph/main/9725b08fd801c82987c737f7e6d354878f036ee8/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 18.0.0-6609-g9725b08f-1focal [4,060 kB] 2023-10-08T06:05:29.397 INFO:teuthology.orchestra.run.smithi032.stdout:Get:74 https://3.chacra.ceph.com/r/ceph/main/9725b08fd801c82987c737f7e6d354878f036ee8/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 18.0.0-6609-g9725b08f-1focal [31.9 kB] 2023-10-08T06:05:29.398 INFO:teuthology.orchestra.run.smithi032.stdout:Get:75 https://3.chacra.ceph.com/r/ceph/main/9725b08fd801c82987c737f7e6d354878f036ee8/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 18.0.0-6609-g9725b08f-1focal [200 kB] 2023-10-08T06:05:29.405 INFO:teuthology.orchestra.run.smithi032.stdout:Get:76 https://3.chacra.ceph.com/r/ceph/main/9725b08fd801c82987c737f7e6d354878f036ee8/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 18.0.0-6609-g9725b08f-1focal [61.1 kB] 2023-10-08T06:05:29.407 INFO:teuthology.orchestra.run.smithi032.stdout:Get:77 https://3.chacra.ceph.com/r/ceph/main/9725b08fd801c82987c737f7e6d354878f036ee8/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 18.0.0-6609-g9725b08f-1focal [364 kB] 2023-10-08T06:05:29.410 INFO:teuthology.orchestra.run.smithi040.stdout:Get:77 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.5 [1,384 kB] 2023-10-08T06:05:29.415 INFO:teuthology.orchestra.run.smithi032.stdout:Get:78 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-natsort-doc all 7.0.1-1 [103 kB] 2023-10-08T06:05:29.416 INFO:teuthology.orchestra.run.smithi032.stdout:Get:79 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2023-10-08T06:05:29.416 INFO:teuthology.orchestra.run.smithi032.stdout:Get:80 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2023-10-08T06:05:29.417 INFO:teuthology.orchestra.run.smithi032.stdout:Get:81 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2023-10-08T06:05:29.417 INFO:teuthology.orchestra.run.smithi032.stdout:Get:82 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2023-10-08T06:05:29.418 INFO:teuthology.orchestra.run.smithi032.stdout:Get:83 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.5 [1,384 kB] 2023-10-08T06:05:29.419 INFO:teuthology.orchestra.run.smithi032.stdout:Get:84 https://3.chacra.ceph.com/r/ceph/main/9725b08fd801c82987c737f7e6d354878f036ee8/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 18.0.0-6609-g9725b08f-1focal [6,945 kB] 2023-10-08T06:05:29.431 INFO:teuthology.orchestra.run.smithi040.stdout:Get:78 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2023-10-08T06:05:29.431 INFO:teuthology.orchestra.run.smithi040.stdout:Get:79 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-10-08T06:05:29.431 INFO:teuthology.orchestra.run.smithi040.stdout:Get:80 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2023-10-08T06:05:29.431 INFO:teuthology.orchestra.run.smithi040.stdout:Get:81 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2023-10-08T06:05:29.433 INFO:teuthology.orchestra.run.smithi032.stdout:Get:85 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2023-10-08T06:05:29.433 INFO:teuthology.orchestra.run.smithi032.stdout:Get:86 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-10-08T06:05:29.433 INFO:teuthology.orchestra.run.smithi032.stdout:Get:87 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2023-10-08T06:05:29.434 INFO:teuthology.orchestra.run.smithi040.stdout:Get:82 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 python3-py all 1.8.1-1ubuntu0.1 [65.6 kB] 2023-10-08T06:05:29.434 INFO:teuthology.orchestra.run.smithi040.stdout:Get:83 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2023-10-08T06:05:29.434 INFO:teuthology.orchestra.run.smithi040.stdout:Get:84 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2023-10-08T06:05:29.435 INFO:teuthology.orchestra.run.smithi040.stdout:Get:85 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplejson amd64 3.16.0-2ubuntu2 [50.8 kB] 2023-10-08T06:05:29.435 INFO:teuthology.orchestra.run.smithi040.stdout:Get:86 http://archive.ubuntu.com/ubuntu focal/universe amd64 qttranslations5-l10n all 5.12.8-0ubuntu1 [1,486 kB] 2023-10-08T06:05:29.435 INFO:teuthology.orchestra.run.smithi032.stdout:Get:88 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2023-10-08T06:05:29.455 INFO:teuthology.orchestra.run.smithi032.stdout:Get:89 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 python3-py all 1.8.1-1ubuntu0.1 [65.6 kB] 2023-10-08T06:05:29.456 INFO:teuthology.orchestra.run.smithi032.stdout:Get:90 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2023-10-08T06:05:29.456 INFO:teuthology.orchestra.run.smithi032.stdout:Get:91 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2023-10-08T06:05:29.458 INFO:teuthology.orchestra.run.smithi032.stdout:Get:92 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplejson amd64 3.16.0-2ubuntu2 [50.8 kB] 2023-10-08T06:05:29.459 INFO:teuthology.orchestra.run.smithi032.stdout:Get:93 http://archive.ubuntu.com/ubuntu focal/universe amd64 qttranslations5-l10n all 5.12.8-0ubuntu1 [1,486 kB] 2023-10-08T06:05:29.751 INFO:teuthology.orchestra.run.smithi032.stdout:Get:94 https://3.chacra.ceph.com/r/ceph/main/9725b08fd801c82987c737f7e6d354878f036ee8/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 18.0.0-6609-g9725b08f-1focal [113 kB] 2023-10-08T06:05:29.753 INFO:teuthology.orchestra.run.smithi032.stdout:Get:95 https://3.chacra.ceph.com/r/ceph/main/9725b08fd801c82987c737f7e6d354878f036ee8/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 18.0.0-6609-g9725b08f-1focal [474 kB] 2023-10-08T06:05:29.771 INFO:teuthology.orchestra.run.smithi040.stdout:Get:87 https://3.chacra.ceph.com/r/ceph/main/9725b08fd801c82987c737f7e6d354878f036ee8/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 18.0.0-6609-g9725b08f-1focal [755 kB] 2023-10-08T06:05:29.788 INFO:teuthology.orchestra.run.smithi032.stdout:Get:96 https://3.chacra.ceph.com/r/ceph/main/9725b08fd801c82987c737f7e6d354878f036ee8/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 18.0.0-6609-g9725b08f-1focal [25.8 MB] 2023-10-08T06:05:29.836 INFO:teuthology.orchestra.run.smithi040.stdout:Get:88 https://3.chacra.ceph.com/r/ceph/main/9725b08fd801c82987c737f7e6d354878f036ee8/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 18.0.0-6609-g9725b08f-1focal [387 kB] 2023-10-08T06:05:29.890 INFO:teuthology.orchestra.run.smithi040.stdout:Get:89 https://3.chacra.ceph.com/r/ceph/main/9725b08fd801c82987c737f7e6d354878f036ee8/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 18.0.0-6609-g9725b08f-1focal [31.9 kB] 2023-10-08T06:05:29.891 INFO:teuthology.orchestra.run.smithi040.stdout:Get:90 https://3.chacra.ceph.com/r/ceph/main/9725b08fd801c82987c737f7e6d354878f036ee8/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 18.0.0-6609-g9725b08f-1focal [200 kB] 2023-10-08T06:05:29.897 INFO:teuthology.orchestra.run.smithi040.stdout:Get:91 https://3.chacra.ceph.com/r/ceph/main/9725b08fd801c82987c737f7e6d354878f036ee8/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 18.0.0-6609-g9725b08f-1focal [61.1 kB] 2023-10-08T06:05:29.899 INFO:teuthology.orchestra.run.smithi040.stdout:Get:92 https://3.chacra.ceph.com/r/ceph/main/9725b08fd801c82987c737f7e6d354878f036ee8/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 18.0.0-6609-g9725b08f-1focal [364 kB] 2023-10-08T06:05:29.953 INFO:teuthology.orchestra.run.smithi040.stdout:Get:93 https://3.chacra.ceph.com/r/ceph/main/9725b08fd801c82987c737f7e6d354878f036ee8/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 18.0.0-6609-g9725b08f-1focal [6,945 kB] 2023-10-08T06:05:30.661 INFO:teuthology.orchestra.run.smithi040.stdout:Get:94 https://3.chacra.ceph.com/r/ceph/main/9725b08fd801c82987c737f7e6d354878f036ee8/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 18.0.0-6609-g9725b08f-1focal [113 kB] 2023-10-08T06:05:30.663 INFO:teuthology.orchestra.run.smithi040.stdout:Get:95 https://3.chacra.ceph.com/r/ceph/main/9725b08fd801c82987c737f7e6d354878f036ee8/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 18.0.0-6609-g9725b08f-1focal [474 kB] 2023-10-08T06:05:30.724 INFO:teuthology.orchestra.run.smithi040.stdout:Get:96 https://3.chacra.ceph.com/r/ceph/main/9725b08fd801c82987c737f7e6d354878f036ee8/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 18.0.0-6609-g9725b08f-1focal [25.8 MB] 2023-10-08T06:05:31.112 INFO:teuthology.orchestra.run.smithi032.stdout:Get:97 https://3.chacra.ceph.com/r/ceph/main/9725b08fd801c82987c737f7e6d354878f036ee8/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 18.0.0-6609-g9725b08f-1focal [11.0 MB] 2023-10-08T06:05:31.640 INFO:teuthology.orchestra.run.smithi032.stdout:Get:98 https://3.chacra.ceph.com/r/ceph/main/9725b08fd801c82987c737f7e6d354878f036ee8/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 18.0.0-6609-g9725b08f-1focal [234 kB] 2023-10-08T06:05:31.645 INFO:teuthology.orchestra.run.smithi032.stdout:Get:99 https://3.chacra.ceph.com/r/ceph/main/9725b08fd801c82987c737f7e6d354878f036ee8/ubuntu/focal/flavors/default focal/main amd64 libsqlite3-mod-ceph amd64 18.0.0-6609-g9725b08f-1focal [145 kB] 2023-10-08T06:05:31.649 INFO:teuthology.orchestra.run.smithi032.stdout:Get:100 https://3.chacra.ceph.com/r/ceph/main/9725b08fd801c82987c737f7e6d354878f036ee8/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 18.0.0-6609-g9725b08f-1focal [1,584 kB] 2023-10-08T06:05:31.685 INFO:teuthology.orchestra.run.smithi032.stdout:Get:101 https://3.chacra.ceph.com/r/ceph/main/9725b08fd801c82987c737f7e6d354878f036ee8/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 18.0.0-6609-g9725b08f-1focal [9,404 kB] 2023-10-08T06:05:32.140 INFO:teuthology.orchestra.run.smithi032.stdout:Get:102 https://3.chacra.ceph.com/r/ceph/main/9725b08fd801c82987c737f7e6d354878f036ee8/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 18.0.0-6609-g9725b08f-1focal [31.6 MB] 2023-10-08T06:05:33.330 INFO:teuthology.orchestra.run.smithi040.stdout:Get:97 https://3.chacra.ceph.com/r/ceph/main/9725b08fd801c82987c737f7e6d354878f036ee8/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 18.0.0-6609-g9725b08f-1focal [11.0 MB] 2023-10-08T06:05:33.801 INFO:teuthology.orchestra.run.smithi032.stdout:Get:103 https://3.chacra.ceph.com/r/ceph/main/9725b08fd801c82987c737f7e6d354878f036ee8/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 18.0.0-6609-g9725b08f-1focal [13.6 kB] 2023-10-08T06:05:33.802 INFO:teuthology.orchestra.run.smithi032.stdout:Get:104 https://3.chacra.ceph.com/r/ceph/main/9725b08fd801c82987c737f7e6d354878f036ee8/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 18.0.0-6609-g9725b08f-1focal [864 kB] 2023-10-08T06:05:33.878 INFO:teuthology.orchestra.run.smithi032.stdout:Get:105 https://3.chacra.ceph.com/r/ceph/main/9725b08fd801c82987c737f7e6d354878f036ee8/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 18.0.0-6609-g9725b08f-1focal [2,284 kB] 2023-10-08T06:05:33.902 INFO:teuthology.orchestra.run.smithi032.stdout:Get:106 https://3.chacra.ceph.com/r/ceph/main/9725b08fd801c82987c737f7e6d354878f036ee8/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 18.0.0-6609-g9725b08f-1focal [282 kB] 2023-10-08T06:05:33.904 INFO:teuthology.orchestra.run.smithi032.stdout:Get:107 https://3.chacra.ceph.com/r/ceph/main/9725b08fd801c82987c737f7e6d354878f036ee8/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 18.0.0-6609-g9725b08f-1focal [136 kB] 2023-10-08T06:05:33.905 INFO:teuthology.orchestra.run.smithi032.stdout:Get:108 https://3.chacra.ceph.com/r/ceph/main/9725b08fd801c82987c737f7e6d354878f036ee8/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 18.0.0-6609-g9725b08f-1focal [1,840 kB] 2023-10-08T06:05:34.010 INFO:teuthology.orchestra.run.smithi032.stdout:Get:109 https://3.chacra.ceph.com/r/ceph/main/9725b08fd801c82987c737f7e6d354878f036ee8/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 18.0.0-6609-g9725b08f-1focal [7,876 kB] 2023-10-08T06:05:34.200 INFO:teuthology.orchestra.run.smithi040.stdout:Get:98 https://3.chacra.ceph.com/r/ceph/main/9725b08fd801c82987c737f7e6d354878f036ee8/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 18.0.0-6609-g9725b08f-1focal [234 kB] 2023-10-08T06:05:34.209 INFO:teuthology.orchestra.run.smithi040.stdout:Get:99 https://3.chacra.ceph.com/r/ceph/main/9725b08fd801c82987c737f7e6d354878f036ee8/ubuntu/focal/flavors/default focal/main amd64 libsqlite3-mod-ceph amd64 18.0.0-6609-g9725b08f-1focal [145 kB] 2023-10-08T06:05:34.213 INFO:teuthology.orchestra.run.smithi040.stdout:Get:100 https://3.chacra.ceph.com/r/ceph/main/9725b08fd801c82987c737f7e6d354878f036ee8/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 18.0.0-6609-g9725b08f-1focal [1,584 kB] 2023-10-08T06:05:34.345 INFO:teuthology.orchestra.run.smithi040.stdout:Get:101 https://3.chacra.ceph.com/r/ceph/main/9725b08fd801c82987c737f7e6d354878f036ee8/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 18.0.0-6609-g9725b08f-1focal [9,404 kB] 2023-10-08T06:05:34.435 INFO:teuthology.orchestra.run.smithi032.stdout:Get:110 https://3.chacra.ceph.com/r/ceph/main/9725b08fd801c82987c737f7e6d354878f036ee8/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 18.0.0-6609-g9725b08f-1focal [13.8 kB] 2023-10-08T06:05:34.444 INFO:teuthology.orchestra.run.smithi032.stdout:Get:111 https://3.chacra.ceph.com/r/ceph/main/9725b08fd801c82987c737f7e6d354878f036ee8/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 18.0.0-6609-g9725b08f-1focal [51.1 MB] 2023-10-08T06:05:35.140 INFO:teuthology.orchestra.run.smithi040.stdout:Get:102 https://3.chacra.ceph.com/r/ceph/main/9725b08fd801c82987c737f7e6d354878f036ee8/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 18.0.0-6609-g9725b08f-1focal [31.6 MB] 2023-10-08T06:05:37.448 INFO:teuthology.orchestra.run.smithi032.stdout:Get:112 https://3.chacra.ceph.com/r/ceph/main/9725b08fd801c82987c737f7e6d354878f036ee8/ubuntu/focal/flavors/default focal/main amd64 ceph-volume all 18.0.0-6609-g9725b08f-1focal [118 kB] 2023-10-08T06:05:37.451 INFO:teuthology.orchestra.run.smithi032.stdout:Get:113 https://3.chacra.ceph.com/r/ceph/main/9725b08fd801c82987c737f7e6d354878f036ee8/ubuntu/focal/flavors/default focal/main amd64 cephfs-mirror amd64 18.0.0-6609-g9725b08f-1focal [267 kB] 2023-10-08T06:05:37.458 INFO:teuthology.orchestra.run.smithi032.stdout:Get:114 https://3.chacra.ceph.com/r/ceph/main/9725b08fd801c82987c737f7e6d354878f036ee8/ubuntu/focal/flavors/default focal/main amd64 cephfs-shell all 18.0.0-6609-g9725b08f-1focal [32.9 kB] 2023-10-08T06:05:37.458 INFO:teuthology.orchestra.run.smithi032.stdout:Get:115 https://3.chacra.ceph.com/r/ceph/main/9725b08fd801c82987c737f7e6d354878f036ee8/ubuntu/focal/flavors/default focal/main amd64 cephfs-top all 18.0.0-6609-g9725b08f-1focal [22.7 kB] 2023-10-08T06:05:37.459 INFO:teuthology.orchestra.run.smithi032.stdout:Get:116 https://3.chacra.ceph.com/r/ceph/main/9725b08fd801c82987c737f7e6d354878f036ee8/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 18.0.0-6609-g9725b08f-1focal [37.4 kB] 2023-10-08T06:05:37.460 INFO:teuthology.orchestra.run.smithi032.stdout:Get:117 https://3.chacra.ceph.com/r/ceph/main/9725b08fd801c82987c737f7e6d354878f036ee8/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 18.0.0-6609-g9725b08f-1focal [14.1 MB] 2023-10-08T06:05:37.872 INFO:teuthology.orchestra.run.smithi040.stdout:Get:103 https://3.chacra.ceph.com/r/ceph/main/9725b08fd801c82987c737f7e6d354878f036ee8/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 18.0.0-6609-g9725b08f-1focal [13.6 kB] 2023-10-08T06:05:37.874 INFO:teuthology.orchestra.run.smithi040.stdout:Get:104 https://3.chacra.ceph.com/r/ceph/main/9725b08fd801c82987c737f7e6d354878f036ee8/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 18.0.0-6609-g9725b08f-1focal [864 kB] 2023-10-08T06:05:37.887 INFO:teuthology.orchestra.run.smithi040.stdout:Get:105 https://3.chacra.ceph.com/r/ceph/main/9725b08fd801c82987c737f7e6d354878f036ee8/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 18.0.0-6609-g9725b08f-1focal [2,284 kB] 2023-10-08T06:05:37.997 INFO:teuthology.orchestra.run.smithi040.stdout:Get:106 https://3.chacra.ceph.com/r/ceph/main/9725b08fd801c82987c737f7e6d354878f036ee8/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 18.0.0-6609-g9725b08f-1focal [282 kB] 2023-10-08T06:05:38.011 INFO:teuthology.orchestra.run.smithi040.stdout:Get:107 https://3.chacra.ceph.com/r/ceph/main/9725b08fd801c82987c737f7e6d354878f036ee8/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 18.0.0-6609-g9725b08f-1focal [136 kB] 2023-10-08T06:05:38.023 INFO:teuthology.orchestra.run.smithi040.stdout:Get:108 https://3.chacra.ceph.com/r/ceph/main/9725b08fd801c82987c737f7e6d354878f036ee8/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 18.0.0-6609-g9725b08f-1focal [1,840 kB] 2023-10-08T06:05:38.023 INFO:teuthology.orchestra.run.smithi032.stdout:Get:118 https://3.chacra.ceph.com/r/ceph/main/9725b08fd801c82987c737f7e6d354878f036ee8/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 18.0.0-6609-g9725b08f-1focal [106 kB] 2023-10-08T06:05:38.085 INFO:teuthology.orchestra.run.smithi040.stdout:Get:109 https://3.chacra.ceph.com/r/ceph/main/9725b08fd801c82987c737f7e6d354878f036ee8/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 18.0.0-6609-g9725b08f-1focal [7,876 kB] 2023-10-08T06:05:38.343 INFO:teuthology.orchestra.run.smithi040.stdout:Get:110 https://3.chacra.ceph.com/r/ceph/main/9725b08fd801c82987c737f7e6d354878f036ee8/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 18.0.0-6609-g9725b08f-1focal [13.8 kB] 2023-10-08T06:05:38.343 INFO:teuthology.orchestra.run.smithi040.stdout:Get:111 https://3.chacra.ceph.com/r/ceph/main/9725b08fd801c82987c737f7e6d354878f036ee8/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 18.0.0-6609-g9725b08f-1focal [51.1 MB] 2023-10-08T06:05:38.744 INFO:teuthology.orchestra.run.smithi032.stdout:Fetched 211 MB in 9s (22.7 MB/s) 2023-10-08T06:05:38.854 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-pyperclip. 2023-10-08T06:05:38.912 INFO:teuthology.orchestra.run.smithi032.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 141736 files and directories currently installed.) 2023-10-08T06:05:38.916 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../000-python3-pyperclip_1.7.0-1_all.deb ... 2023-10-08T06:05:38.952 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-pyperclip (1.7.0-1) ... 2023-10-08T06:05:39.230 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-wcwidth. 2023-10-08T06:05:39.249 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../001-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2023-10-08T06:05:39.288 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2023-10-08T06:05:39.599 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-cmd2. 2023-10-08T06:05:39.618 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../002-python3-cmd2_0.8.5-2.1_all.deb ... 2023-10-08T06:05:39.682 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-cmd2 (0.8.5-2.1) ... 2023-10-08T06:05:40.002 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2023-10-08T06:05:40.019 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../003-liblttng-ust0_2.11.0-1_amd64.deb ... 2023-10-08T06:05:40.085 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2023-10-08T06:05:40.277 INFO:teuthology.orchestra.run.smithi040.stdout:Get:112 https://3.chacra.ceph.com/r/ceph/main/9725b08fd801c82987c737f7e6d354878f036ee8/ubuntu/focal/flavors/default focal/main amd64 ceph-volume all 18.0.0-6609-g9725b08f-1focal [118 kB] 2023-10-08T06:05:40.279 INFO:teuthology.orchestra.run.smithi040.stdout:Get:113 https://3.chacra.ceph.com/r/ceph/main/9725b08fd801c82987c737f7e6d354878f036ee8/ubuntu/focal/flavors/default focal/main amd64 cephfs-mirror amd64 18.0.0-6609-g9725b08f-1focal [267 kB] 2023-10-08T06:05:40.285 INFO:teuthology.orchestra.run.smithi040.stdout:Get:114 https://3.chacra.ceph.com/r/ceph/main/9725b08fd801c82987c737f7e6d354878f036ee8/ubuntu/focal/flavors/default focal/main amd64 cephfs-shell all 18.0.0-6609-g9725b08f-1focal [32.9 kB] 2023-10-08T06:05:40.286 INFO:teuthology.orchestra.run.smithi040.stdout:Get:115 https://3.chacra.ceph.com/r/ceph/main/9725b08fd801c82987c737f7e6d354878f036ee8/ubuntu/focal/flavors/default focal/main amd64 cephfs-top all 18.0.0-6609-g9725b08f-1focal [22.7 kB] 2023-10-08T06:05:40.287 INFO:teuthology.orchestra.run.smithi040.stdout:Get:116 https://3.chacra.ceph.com/r/ceph/main/9725b08fd801c82987c737f7e6d354878f036ee8/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 18.0.0-6609-g9725b08f-1focal [37.4 kB] 2023-10-08T06:05:40.318 INFO:teuthology.orchestra.run.smithi040.stdout:Get:117 https://3.chacra.ceph.com/r/ceph/main/9725b08fd801c82987c737f7e6d354878f036ee8/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 18.0.0-6609-g9725b08f-1focal [14.1 MB] 2023-10-08T06:05:40.406 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-10-08T06:05:40.423 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.5-4ubuntu1_amd64.deb ... 2023-10-08T06:05:40.464 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2023-10-08T06:05:40.709 INFO:teuthology.orchestra.run.smithi040.stdout:Get:118 https://3.chacra.ceph.com/r/ceph/main/9725b08fd801c82987c737f7e6d354878f036ee8/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 18.0.0-6609-g9725b08f-1focal [106 kB] 2023-10-08T06:05:40.767 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-10-08T06:05:40.784 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../005-libpcre2-16-0_10.34-7ubuntu0.1_amd64.deb ... 2023-10-08T06:05:40.825 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2023-10-08T06:05:41.287 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-10-08T06:05:41.304 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../006-libqt5core5a_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-10-08T06:05:41.353 INFO:teuthology.orchestra.run.smithi040.stdout:Fetched 211 MB in 12s (17.7 MB/s) 2023-10-08T06:05:41.355 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-10-08T06:05:41.494 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-pyperclip. 2023-10-08T06:05:41.550 INFO:teuthology.orchestra.run.smithi040.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 141736 files and directories currently installed.) 2023-10-08T06:05:41.555 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../000-python3-pyperclip_1.7.0-1_all.deb ... 2023-10-08T06:05:41.592 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-pyperclip (1.7.0-1) ... 2023-10-08T06:05:41.865 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-10-08T06:05:41.884 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../007-libqt5dbus5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-10-08T06:05:41.904 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-wcwidth. 2023-10-08T06:05:41.914 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-10-08T06:05:41.923 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../001-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2023-10-08T06:05:41.987 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2023-10-08T06:05:42.235 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-10-08T06:05:42.254 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../008-libqt5network5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-10-08T06:05:42.285 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-10-08T06:05:42.298 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-cmd2. 2023-10-08T06:05:42.314 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../002-python3-cmd2_0.8.5-2.1_all.deb ... 2023-10-08T06:05:42.348 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-cmd2 (0.8.5-2.1) ... 2023-10-08T06:05:42.659 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2023-10-08T06:05:42.679 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../003-liblttng-ust0_2.11.0-1_amd64.deb ... 2023-10-08T06:05:42.705 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package libthrift-0.13.0. 2023-10-08T06:05:42.721 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../009-libthrift-0.13.0_0.13.0-2build2_amd64.deb ... 2023-10-08T06:05:42.742 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2023-10-08T06:05:42.764 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking libthrift-0.13.0 (0.13.0-2build2) ... 2023-10-08T06:05:43.104 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-10-08T06:05:43.110 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../010-librbd1_18.0.0-6609-g9725b08f-1focal_amd64.deb ... 2023-10-08T06:05:43.123 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.5-4ubuntu1_amd64.deb ... 2023-10-08T06:05:43.163 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2023-10-08T06:05:43.218 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking librbd1 (18.0.0-6609-g9725b08f-1focal) over (15.2.17-0ubuntu0.20.04.4) ... 2023-10-08T06:05:43.533 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-10-08T06:05:43.550 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../005-libpcre2-16-0_10.34-7ubuntu0.1_amd64.deb ... 2023-10-08T06:05:43.624 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2023-10-08T06:05:43.886 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../011-librados2_18.0.0-6609-g9725b08f-1focal_amd64.deb ... 2023-10-08T06:05:43.985 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking librados2 (18.0.0-6609-g9725b08f-1focal) over (15.2.17-0ubuntu0.20.04.4) ... 2023-10-08T06:05:44.153 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-10-08T06:05:44.169 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../006-libqt5core5a_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-10-08T06:05:44.221 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-10-08T06:05:44.756 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-10-08T06:05:44.773 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../007-libqt5dbus5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-10-08T06:05:44.814 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-10-08T06:05:44.890 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package libcephfs2. 2023-10-08T06:05:44.907 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../012-libcephfs2_18.0.0-6609-g9725b08f-1focal_amd64.deb ... 2023-10-08T06:05:44.948 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking libcephfs2 (18.0.0-6609-g9725b08f-1focal) ... 2023-10-08T06:05:45.184 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-10-08T06:05:45.201 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../008-libqt5network5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-10-08T06:05:45.275 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-10-08T06:05:45.276 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-rados. 2023-10-08T06:05:45.292 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../013-python3-rados_18.0.0-6609-g9725b08f-1focal_amd64.deb ... 2023-10-08T06:05:45.334 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-rados (18.0.0-6609-g9725b08f-1focal) ... 2023-10-08T06:05:45.697 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package libthrift-0.13.0. 2023-10-08T06:05:45.713 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../009-libthrift-0.13.0_0.13.0-2build2_amd64.deb ... 2023-10-08T06:05:45.729 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-10-08T06:05:45.744 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../014-python3-ceph-argparse_18.0.0-6609-g9725b08f-1focal_all.deb ... 2023-10-08T06:05:45.755 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking libthrift-0.13.0 (0.13.0-2build2) ... 2023-10-08T06:05:45.787 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-ceph-argparse (18.0.0-6609-g9725b08f-1focal) ... 2023-10-08T06:05:46.064 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-cephfs. 2023-10-08T06:05:46.082 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../015-python3-cephfs_18.0.0-6609-g9725b08f-1focal_amd64.deb ... 2023-10-08T06:05:46.122 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-cephfs (18.0.0-6609-g9725b08f-1focal) ... 2023-10-08T06:05:46.276 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../010-librbd1_18.0.0-6609-g9725b08f-1focal_amd64.deb ... 2023-10-08T06:05:46.401 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking librbd1 (18.0.0-6609-g9725b08f-1focal) over (15.2.17-0ubuntu0.20.04.4) ... 2023-10-08T06:05:46.476 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-ceph-common. 2023-10-08T06:05:46.494 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../016-python3-ceph-common_18.0.0-6609-g9725b08f-1focal_all.deb ... 2023-10-08T06:05:46.534 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-ceph-common (18.0.0-6609-g9725b08f-1focal) ... 2023-10-08T06:05:46.862 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-prettytable. 2023-10-08T06:05:46.881 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../017-python3-prettytable_0.7.2-5_all.deb ... 2023-10-08T06:05:46.920 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2023-10-08T06:05:47.164 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-rbd. 2023-10-08T06:05:47.182 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../018-python3-rbd_18.0.0-6609-g9725b08f-1focal_amd64.deb ... 2023-10-08T06:05:47.186 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../011-librados2_18.0.0-6609-g9725b08f-1focal_amd64.deb ... 2023-10-08T06:05:47.222 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-rbd (18.0.0-6609-g9725b08f-1focal) ... 2023-10-08T06:05:47.337 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking librados2 (18.0.0-6609-g9725b08f-1focal) over (15.2.17-0ubuntu0.20.04.4) ... 2023-10-08T06:05:47.601 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package liblua5.3-0:amd64. 2023-10-08T06:05:47.619 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../019-liblua5.3-0_5.3.3-1.1ubuntu2_amd64.deb ... 2023-10-08T06:05:47.659 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2023-10-08T06:05:48.003 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package librabbitmq4:amd64. 2023-10-08T06:05:48.020 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../020-librabbitmq4_0.10.0-1_amd64.deb ... 2023-10-08T06:05:48.062 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2023-10-08T06:05:48.099 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package libcephfs2. 2023-10-08T06:05:48.116 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../012-libcephfs2_18.0.0-6609-g9725b08f-1focal_amd64.deb ... 2023-10-08T06:05:48.157 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking libcephfs2 (18.0.0-6609-g9725b08f-1focal) ... 2023-10-08T06:05:48.398 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-10-08T06:05:48.415 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../021-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2023-10-08T06:05:48.448 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2023-10-08T06:05:48.469 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-rados. 2023-10-08T06:05:48.485 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../013-python3-rados_18.0.0-6609-g9725b08f-1focal_amd64.deb ... 2023-10-08T06:05:48.568 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-rados (18.0.0-6609-g9725b08f-1focal) ... 2023-10-08T06:05:48.793 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package librgw2. 2023-10-08T06:05:48.808 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../022-librgw2_18.0.0-6609-g9725b08f-1focal_amd64.deb ... 2023-10-08T06:05:48.851 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking librgw2 (18.0.0-6609-g9725b08f-1focal) ... 2023-10-08T06:05:48.955 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-10-08T06:05:48.971 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../014-python3-ceph-argparse_18.0.0-6609-g9725b08f-1focal_all.deb ... 2023-10-08T06:05:49.013 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-ceph-argparse (18.0.0-6609-g9725b08f-1focal) ... 2023-10-08T06:05:49.299 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-cephfs. 2023-10-08T06:05:49.315 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../015-python3-cephfs_18.0.0-6609-g9725b08f-1focal_amd64.deb ... 2023-10-08T06:05:49.357 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-cephfs (18.0.0-6609-g9725b08f-1focal) ... 2023-10-08T06:05:49.710 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-ceph-common. 2023-10-08T06:05:49.727 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../016-python3-ceph-common_18.0.0-6609-g9725b08f-1focal_all.deb ... 2023-10-08T06:05:49.746 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-rgw. 2023-10-08T06:05:49.763 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../023-python3-rgw_18.0.0-6609-g9725b08f-1focal_amd64.deb ... 2023-10-08T06:05:49.768 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-ceph-common (18.0.0-6609-g9725b08f-1focal) ... 2023-10-08T06:05:49.804 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-rgw (18.0.0-6609-g9725b08f-1focal) ... 2023-10-08T06:05:50.122 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-prettytable. 2023-10-08T06:05:50.141 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../017-python3-prettytable_0.7.2-5_all.deb ... 2023-10-08T06:05:50.157 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package liboath0. 2023-10-08T06:05:50.177 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../024-liboath0_2.6.1-1.3_amd64.deb ... 2023-10-08T06:05:50.180 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2023-10-08T06:05:50.215 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2023-10-08T06:05:50.450 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-rbd. 2023-10-08T06:05:50.466 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../018-python3-rbd_18.0.0-6609-g9725b08f-1focal_amd64.deb ... 2023-10-08T06:05:50.508 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-rbd (18.0.0-6609-g9725b08f-1focal) ... 2023-10-08T06:05:50.560 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package libradosstriper1. 2023-10-08T06:05:50.576 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../025-libradosstriper1_18.0.0-6609-g9725b08f-1focal_amd64.deb ... 2023-10-08T06:05:50.618 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking libradosstriper1 (18.0.0-6609-g9725b08f-1focal) ... 2023-10-08T06:05:50.911 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package liblua5.3-0:amd64. 2023-10-08T06:05:50.931 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../019-liblua5.3-0_5.3.3-1.1ubuntu2_amd64.deb ... 2023-10-08T06:05:50.969 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2023-10-08T06:05:51.080 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package ceph-common. 2023-10-08T06:05:51.096 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../026-ceph-common_18.0.0-6609-g9725b08f-1focal_amd64.deb ... 2023-10-08T06:05:51.137 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking ceph-common (18.0.0-6609-g9725b08f-1focal) ... 2023-10-08T06:05:51.348 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package librabbitmq4:amd64. 2023-10-08T06:05:51.365 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../020-librabbitmq4_0.10.0-1_amd64.deb ... 2023-10-08T06:05:51.397 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2023-10-08T06:05:51.767 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-10-08T06:05:51.783 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../021-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2023-10-08T06:05:51.825 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2023-10-08T06:05:52.215 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package librgw2. 2023-10-08T06:05:52.235 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../022-librgw2_18.0.0-6609-g9725b08f-1focal_amd64.deb ... 2023-10-08T06:05:52.286 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking librgw2 (18.0.0-6609-g9725b08f-1focal) ... 2023-10-08T06:05:53.364 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-rgw. 2023-10-08T06:05:53.381 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../023-python3-rgw_18.0.0-6609-g9725b08f-1focal_amd64.deb ... 2023-10-08T06:05:53.431 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-rgw (18.0.0-6609-g9725b08f-1focal) ... 2023-10-08T06:05:53.818 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package liboath0. 2023-10-08T06:05:53.818 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package ceph-base. 2023-10-08T06:05:53.834 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../024-liboath0_2.6.1-1.3_amd64.deb ... 2023-10-08T06:05:53.836 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../027-ceph-base_18.0.0-6609-g9725b08f-1focal_amd64.deb ... 2023-10-08T06:05:53.876 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2023-10-08T06:05:53.887 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking ceph-base (18.0.0-6609-g9725b08f-1focal) ... 2023-10-08T06:05:54.229 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package libradosstriper1. 2023-10-08T06:05:54.245 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../025-libradosstriper1_18.0.0-6609-g9725b08f-1focal_amd64.deb ... 2023-10-08T06:05:54.287 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking libradosstriper1 (18.0.0-6609-g9725b08f-1focal) ... 2023-10-08T06:05:54.783 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package ceph-common. 2023-10-08T06:05:54.799 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../026-ceph-common_18.0.0-6609-g9725b08f-1focal_amd64.deb ... 2023-10-08T06:05:54.857 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking ceph-common (18.0.0-6609-g9725b08f-1focal) ... 2023-10-08T06:05:55.239 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-cherrypy3. 2023-10-08T06:05:55.258 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../028-python3-cherrypy3_8.9.1-6_all.deb ... 2023-10-08T06:05:55.297 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2023-10-08T06:05:55.618 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-natsort. 2023-10-08T06:05:55.638 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../029-python3-natsort_7.0.1-1_all.deb ... 2023-10-08T06:05:55.676 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-natsort (7.0.1-1) ... 2023-10-08T06:05:55.988 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-logutils. 2023-10-08T06:05:56.004 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../030-python3-logutils_0.3.3-7_all.deb ... 2023-10-08T06:05:56.054 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-logutils (0.3.3-7) ... 2023-10-08T06:05:56.390 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-markupsafe. 2023-10-08T06:05:56.408 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../031-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2023-10-08T06:05:56.449 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2023-10-08T06:05:56.768 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-mako. 2023-10-08T06:05:56.784 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../032-python3-mako_1.1.0+ds1-1ubuntu2.1_all.deb ... 2023-10-08T06:05:56.826 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2023-10-08T06:05:57.205 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-simplegeneric. 2023-10-08T06:05:57.221 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../033-python3-simplegeneric_0.8.1-3_all.deb ... 2023-10-08T06:05:57.271 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-10-08T06:05:57.388 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package ceph-base. 2023-10-08T06:05:57.408 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../027-ceph-base_18.0.0-6609-g9725b08f-1focal_amd64.deb ... 2023-10-08T06:05:57.448 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking ceph-base (18.0.0-6609-g9725b08f-1focal) ... 2023-10-08T06:05:57.582 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-singledispatch. 2023-10-08T06:05:57.599 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../034-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2023-10-08T06:05:57.640 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2023-10-08T06:05:57.952 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-webob. 2023-10-08T06:05:57.971 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../035-python3-webob_1%3a1.8.5-2_all.deb ... 2023-10-08T06:05:58.010 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-webob (1:1.8.5-2) ... 2023-10-08T06:05:58.363 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-soupsieve. 2023-10-08T06:05:58.380 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../036-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2023-10-08T06:05:58.421 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2023-10-08T06:05:58.715 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-bs4. 2023-10-08T06:05:58.735 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../037-python3-bs4_4.8.2-1_all.deb ... 2023-10-08T06:05:58.765 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2023-10-08T06:05:59.001 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-cherrypy3. 2023-10-08T06:05:59.020 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../028-python3-cherrypy3_8.9.1-6_all.deb ... 2023-10-08T06:05:59.059 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2023-10-08T06:05:59.135 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-waitress. 2023-10-08T06:05:59.152 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../038-python3-waitress_1.4.1-1ubuntu0.1_all.deb ... 2023-10-08T06:05:59.196 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-waitress (1.4.1-1ubuntu0.1) ... 2023-10-08T06:05:59.379 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-natsort. 2023-10-08T06:05:59.399 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../029-python3-natsort_7.0.1-1_all.deb ... 2023-10-08T06:05:59.437 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-natsort (7.0.1-1) ... 2023-10-08T06:05:59.522 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-tempita. 2023-10-08T06:05:59.541 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../039-python3-tempita_0.5.2-6_all.deb ... 2023-10-08T06:05:59.580 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-tempita (0.5.2-6) ... 2023-10-08T06:05:59.774 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-logutils. 2023-10-08T06:05:59.792 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../030-python3-logutils_0.3.3-7_all.deb ... 2023-10-08T06:05:59.833 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-logutils (0.3.3-7) ... 2023-10-08T06:05:59.882 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-paste. 2023-10-08T06:05:59.900 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../040-python3-paste_3.4.0+dfsg1-1_all.deb ... 2023-10-08T06:05:59.940 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2023-10-08T06:06:00.177 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-markupsafe. 2023-10-08T06:06:00.194 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../031-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2023-10-08T06:06:00.260 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2023-10-08T06:06:00.589 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-mako. 2023-10-08T06:06:00.607 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../032-python3-mako_1.1.0+ds1-1ubuntu2.1_all.deb ... 2023-10-08T06:06:00.647 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2023-10-08T06:06:00.961 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-10-08T06:06:00.979 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../041-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2023-10-08T06:06:00.983 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-simplegeneric. 2023-10-08T06:06:01.001 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../033-python3-simplegeneric_0.8.1-3_all.deb ... 2023-10-08T06:06:01.019 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2023-10-08T06:06:01.042 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-10-08T06:06:01.322 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-pastedeploy. 2023-10-08T06:06:01.339 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../042-python3-pastedeploy_2.1.0-1_all.deb ... 2023-10-08T06:06:01.369 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-singledispatch. 2023-10-08T06:06:01.386 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../034-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2023-10-08T06:06:01.397 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2023-10-08T06:06:01.708 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-webtest. 2023-10-08T06:06:01.727 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../043-python3-webtest_2.0.32-2_all.deb ... 2023-10-08T06:06:01.753 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2023-10-08T06:06:01.766 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-webtest (2.0.32-2) ... 2023-10-08T06:06:02.094 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-pecan. 2023-10-08T06:06:02.114 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../044-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2023-10-08T06:06:02.161 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2023-10-08T06:06:02.482 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-werkzeug. 2023-10-08T06:06:02.502 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../045-python3-werkzeug_0.16.1+dfsg1-2ubuntu0.1_all.deb ... 2023-10-08T06:06:02.540 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2023-10-08T06:06:02.790 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-webob. 2023-10-08T06:06:02.807 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../035-python3-webob_1%3a1.8.5-2_all.deb ... 2023-10-08T06:06:02.835 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-10-08T06:06:02.847 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-webob (1:1.8.5-2) ... 2023-10-08T06:06:02.852 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../046-ceph-mgr-modules-core_18.0.0-6609-g9725b08f-1focal_all.deb ... 2023-10-08T06:06:02.910 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking ceph-mgr-modules-core (18.0.0-6609-g9725b08f-1focal) ... 2023-10-08T06:06:03.201 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-soupsieve. 2023-10-08T06:06:03.217 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../036-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2023-10-08T06:06:03.259 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2023-10-08T06:06:03.264 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-10-08T06:06:03.281 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../047-libsqlite3-mod-ceph_18.0.0-6609-g9725b08f-1focal_amd64.deb ... 2023-10-08T06:06:03.322 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking libsqlite3-mod-ceph (18.0.0-6609-g9725b08f-1focal) ... 2023-10-08T06:06:03.562 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-bs4. 2023-10-08T06:06:03.580 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../037-python3-bs4_4.8.2-1_all.deb ... 2023-10-08T06:06:03.620 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2023-10-08T06:06:03.642 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-cryptography. 2023-10-08T06:06:03.659 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../048-python3-cryptography_2.8-3ubuntu0.1_amd64.deb ... 2023-10-08T06:06:03.700 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-cryptography (2.8-3ubuntu0.1) ... 2023-10-08T06:06:03.998 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-waitress. 2023-10-08T06:06:04.014 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../038-python3-waitress_1.4.1-1ubuntu0.1_all.deb ... 2023-10-08T06:06:04.060 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-waitress (1.4.1-1ubuntu0.1) ... 2023-10-08T06:06:04.104 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-openssl. 2023-10-08T06:06:04.120 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../049-python3-openssl_19.0.0-1build1_all.deb ... 2023-10-08T06:06:04.162 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2023-10-08T06:06:04.418 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-tempita. 2023-10-08T06:06:04.434 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../039-python3-tempita_0.5.2-6_all.deb ... 2023-10-08T06:06:04.507 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package ceph-mgr. 2023-10-08T06:06:04.509 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-tempita (0.5.2-6) ... 2023-10-08T06:06:04.524 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../050-ceph-mgr_18.0.0-6609-g9725b08f-1focal_amd64.deb ... 2023-10-08T06:06:04.565 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking ceph-mgr (18.0.0-6609-g9725b08f-1focal) ... 2023-10-08T06:06:04.837 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-paste. 2023-10-08T06:06:04.856 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../040-python3-paste_3.4.0+dfsg1-1_all.deb ... 2023-10-08T06:06:04.896 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2023-10-08T06:06:05.085 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package ceph-mon. 2023-10-08T06:06:05.106 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../051-ceph-mon_18.0.0-6609-g9725b08f-1focal_amd64.deb ... 2023-10-08T06:06:05.143 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking ceph-mon (18.0.0-6609-g9725b08f-1focal) ... 2023-10-08T06:06:05.233 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-10-08T06:06:05.249 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../041-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2023-10-08T06:06:05.290 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2023-10-08T06:06:05.635 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-pastedeploy. 2023-10-08T06:06:05.655 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../042-python3-pastedeploy_2.1.0-1_all.deb ... 2023-10-08T06:06:05.693 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2023-10-08T06:06:06.032 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-webtest. 2023-10-08T06:06:06.049 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../043-python3-webtest_2.0.32-2_all.deb ... 2023-10-08T06:06:06.082 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-webtest (2.0.32-2) ... 2023-10-08T06:06:06.422 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package ceph-osd. 2023-10-08T06:06:06.426 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-pecan. 2023-10-08T06:06:06.438 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../052-ceph-osd_18.0.0-6609-g9725b08f-1focal_amd64.deb ... 2023-10-08T06:06:06.445 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../044-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2023-10-08T06:06:06.480 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking ceph-osd (18.0.0-6609-g9725b08f-1focal) ... 2023-10-08T06:06:06.551 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2023-10-08T06:06:06.881 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-werkzeug. 2023-10-08T06:06:06.901 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../045-python3-werkzeug_0.16.1+dfsg1-2ubuntu0.1_all.deb ... 2023-10-08T06:06:06.939 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2023-10-08T06:06:07.227 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-10-08T06:06:07.244 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../046-ceph-mgr-modules-core_18.0.0-6609-g9725b08f-1focal_all.deb ... 2023-10-08T06:06:07.275 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking ceph-mgr-modules-core (18.0.0-6609-g9725b08f-1focal) ... 2023-10-08T06:06:07.655 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-10-08T06:06:07.676 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../047-libsqlite3-mod-ceph_18.0.0-6609-g9725b08f-1focal_amd64.deb ... 2023-10-08T06:06:07.713 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking libsqlite3-mod-ceph (18.0.0-6609-g9725b08f-1focal) ... 2023-10-08T06:06:08.083 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-cryptography. 2023-10-08T06:06:08.103 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../048-python3-cryptography_2.8-3ubuntu0.1_amd64.deb ... 2023-10-08T06:06:08.166 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-cryptography (2.8-3ubuntu0.1) ... 2023-10-08T06:06:08.545 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-openssl. 2023-10-08T06:06:08.564 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../049-python3-openssl_19.0.0-1build1_all.deb ... 2023-10-08T06:06:08.603 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2023-10-08T06:06:08.956 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package ceph-mgr. 2023-10-08T06:06:08.973 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../050-ceph-mgr_18.0.0-6609-g9725b08f-1focal_amd64.deb ... 2023-10-08T06:06:09.014 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking ceph-mgr (18.0.0-6609-g9725b08f-1focal) ... 2023-10-08T06:06:09.558 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package ceph. 2023-10-08T06:06:09.559 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package ceph-mon. 2023-10-08T06:06:09.577 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../053-ceph_18.0.0-6609-g9725b08f-1focal_amd64.deb ... 2023-10-08T06:06:09.579 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../051-ceph-mon_18.0.0-6609-g9725b08f-1focal_amd64.deb ... 2023-10-08T06:06:09.617 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking ceph-mon (18.0.0-6609-g9725b08f-1focal) ... 2023-10-08T06:06:09.632 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking ceph (18.0.0-6609-g9725b08f-1focal) ... 2023-10-08T06:06:09.969 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package ceph-fuse. 2023-10-08T06:06:09.985 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../054-ceph-fuse_18.0.0-6609-g9725b08f-1focal_amd64.deb ... 2023-10-08T06:06:10.026 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking ceph-fuse (18.0.0-6609-g9725b08f-1focal) ... 2023-10-08T06:06:10.446 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package ceph-mds. 2023-10-08T06:06:10.463 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../055-ceph-mds_18.0.0-6609-g9725b08f-1focal_amd64.deb ... 2023-10-08T06:06:10.505 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking ceph-mds (18.0.0-6609-g9725b08f-1focal) ... 2023-10-08T06:06:10.921 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package ceph-osd. 2023-10-08T06:06:10.940 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../052-ceph-osd_18.0.0-6609-g9725b08f-1focal_amd64.deb ... 2023-10-08T06:06:10.979 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking ceph-osd (18.0.0-6609-g9725b08f-1focal) ... 2023-10-08T06:06:11.032 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package cephadm. 2023-10-08T06:06:11.051 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../056-cephadm_18.0.0-6609-g9725b08f-1focal_amd64.deb ... 2023-10-08T06:06:11.090 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking cephadm (18.0.0-6609-g9725b08f-1focal) ... 2023-10-08T06:06:11.435 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-asyncssh. 2023-10-08T06:06:11.452 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../057-python3-asyncssh_1.12.2-1_all.deb ... 2023-10-08T06:06:11.518 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-asyncssh (1.12.2-1) ... 2023-10-08T06:06:11.888 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-jinja2. 2023-10-08T06:06:11.904 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../058-python3-jinja2_2.10.1-2_all.deb ... 2023-10-08T06:06:11.946 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-jinja2 (2.10.1-2) ... 2023-10-08T06:06:12.274 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-10-08T06:06:12.294 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../059-ceph-mgr-cephadm_18.0.0-6609-g9725b08f-1focal_all.deb ... 2023-10-08T06:06:12.332 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking ceph-mgr-cephadm (18.0.0-6609-g9725b08f-1focal) ... 2023-10-08T06:06:12.702 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-bcrypt. 2023-10-08T06:06:12.722 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../060-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2023-10-08T06:06:12.760 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2023-10-08T06:06:13.055 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-jwt. 2023-10-08T06:06:13.071 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../061-python3-jwt_1.7.1-2ubuntu2.1_all.deb ... 2023-10-08T06:06:13.113 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-jwt (1.7.1-2ubuntu2.1) ... 2023-10-08T06:06:13.457 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-repoze.lru. 2023-10-08T06:06:13.478 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../062-python3-repoze.lru_0.7-2_all.deb ... 2023-10-08T06:06:13.515 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-10-08T06:06:13.768 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package libjs-underscore. 2023-10-08T06:06:13.786 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../063-libjs-underscore_1.9.1~dfsg-1ubuntu0.20.04.1_all.deb ... 2023-10-08T06:06:13.826 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2023-10-08T06:06:14.104 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package libjs-sphinxdoc. 2023-10-08T06:06:14.107 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package ceph. 2023-10-08T06:06:14.120 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../064-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2023-10-08T06:06:14.125 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../053-ceph_18.0.0-6609-g9725b08f-1focal_amd64.deb ... 2023-10-08T06:06:14.162 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2023-10-08T06:06:14.165 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking ceph (18.0.0-6609-g9725b08f-1focal) ... 2023-10-08T06:06:14.501 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package ceph-fuse. 2023-10-08T06:06:14.514 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-routes. 2023-10-08T06:06:14.520 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../054-ceph-fuse_18.0.0-6609-g9725b08f-1focal_amd64.deb ... 2023-10-08T06:06:14.532 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../065-python3-routes_2.4.1-2_all.deb ... 2023-10-08T06:06:14.559 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking ceph-fuse (18.0.0-6609-g9725b08f-1focal) ... 2023-10-08T06:06:14.572 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-routes (2.4.1-2) ... 2023-10-08T06:06:14.909 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-10-08T06:06:14.925 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../066-ceph-mgr-dashboard_18.0.0-6609-g9725b08f-1focal_all.deb ... 2023-10-08T06:06:14.975 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking ceph-mgr-dashboard (18.0.0-6609-g9725b08f-1focal) ... 2023-10-08T06:06:15.021 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package ceph-mds. 2023-10-08T06:06:15.038 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../055-ceph-mds_18.0.0-6609-g9725b08f-1focal_amd64.deb ... 2023-10-08T06:06:15.079 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking ceph-mds (18.0.0-6609-g9725b08f-1focal) ... 2023-10-08T06:06:15.471 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-decorator. 2023-10-08T06:06:15.490 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../067-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2023-10-08T06:06:15.529 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2023-10-08T06:06:15.657 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package cephadm. 2023-10-08T06:06:15.676 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../056-cephadm_18.0.0-6609-g9725b08f-1focal_amd64.deb ... 2023-10-08T06:06:15.715 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking cephadm (18.0.0-6609-g9725b08f-1focal) ... 2023-10-08T06:06:15.831 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2023-10-08T06:06:15.851 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../068-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2023-10-08T06:06:15.889 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2023-10-08T06:06:16.060 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-asyncssh. 2023-10-08T06:06:16.077 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../057-python3-asyncssh_1.12.2-1_all.deb ... 2023-10-08T06:06:16.117 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-asyncssh (1.12.2-1) ... 2023-10-08T06:06:16.184 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-scipy. 2023-10-08T06:06:16.202 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../069-python3-scipy_1.3.3-3build1_amd64.deb ... 2023-10-08T06:06:16.243 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2023-10-08T06:06:16.479 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-jinja2. 2023-10-08T06:06:16.499 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../058-python3-jinja2_2.10.1-2_all.deb ... 2023-10-08T06:06:16.537 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-jinja2 (2.10.1-2) ... 2023-10-08T06:06:16.882 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-10-08T06:06:16.901 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../059-ceph-mgr-cephadm_18.0.0-6609-g9725b08f-1focal_all.deb ... 2023-10-08T06:06:16.957 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking ceph-mgr-cephadm (18.0.0-6609-g9725b08f-1focal) ... 2023-10-08T06:06:17.294 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-bcrypt. 2023-10-08T06:06:17.312 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../060-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2023-10-08T06:06:17.343 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2023-10-08T06:06:17.629 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-jwt. 2023-10-08T06:06:17.648 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../061-python3-jwt_1.7.1-2ubuntu2.1_all.deb ... 2023-10-08T06:06:17.668 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-sklearn-lib. 2023-10-08T06:06:17.685 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../070-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2023-10-08T06:06:17.687 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-jwt (1.7.1-2ubuntu2.1) ... 2023-10-08T06:06:17.725 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2023-10-08T06:06:18.032 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-repoze.lru. 2023-10-08T06:06:18.049 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../062-python3-repoze.lru_0.7-2_all.deb ... 2023-10-08T06:06:18.090 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-10-08T06:06:18.296 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-joblib. 2023-10-08T06:06:18.314 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../071-python3-joblib_0.14.0-3_all.deb ... 2023-10-08T06:06:18.354 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-joblib (0.14.0-3) ... 2023-10-08T06:06:18.368 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package libjs-underscore. 2023-10-08T06:06:18.385 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../063-libjs-underscore_1.9.1~dfsg-1ubuntu0.20.04.1_all.deb ... 2023-10-08T06:06:18.426 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2023-10-08T06:06:18.724 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-sklearn. 2023-10-08T06:06:18.740 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../072-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2023-10-08T06:06:18.782 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2023-10-08T06:06:18.837 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package libjs-sphinxdoc. 2023-10-08T06:06:18.855 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../064-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2023-10-08T06:06:18.895 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2023-10-08T06:06:19.215 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-routes. 2023-10-08T06:06:19.234 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../065-python3-routes_2.4.1-2_all.deb ... 2023-10-08T06:06:19.265 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-routes (2.4.1-2) ... 2023-10-08T06:06:19.449 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-10-08T06:06:19.466 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../073-ceph-mgr-diskprediction-local_18.0.0-6609-g9725b08f-1focal_all.deb ... 2023-10-08T06:06:19.507 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking ceph-mgr-diskprediction-local (18.0.0-6609-g9725b08f-1focal) ... 2023-10-08T06:06:19.660 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-10-08T06:06:19.680 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../066-ceph-mgr-dashboard_18.0.0-6609-g9725b08f-1focal_all.deb ... 2023-10-08T06:06:19.718 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking ceph-mgr-dashboard (18.0.0-6609-g9725b08f-1focal) ... 2023-10-08T06:06:20.255 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-decorator. 2023-10-08T06:06:20.273 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../067-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2023-10-08T06:06:20.338 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2023-10-08T06:06:20.632 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2023-10-08T06:06:20.650 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../068-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2023-10-08T06:06:20.651 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-cachetools. 2023-10-08T06:06:20.669 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../074-python3-cachetools_4.0.0-1_all.deb ... 2023-10-08T06:06:20.707 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2023-10-08T06:06:20.709 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2023-10-08T06:06:21.012 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-pyasn1. 2023-10-08T06:06:21.029 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../075-python3-pyasn1_0.4.2-3build1_all.deb ... 2023-10-08T06:06:21.060 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-scipy. 2023-10-08T06:06:21.070 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2023-10-08T06:06:21.076 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../069-python3-scipy_1.3.3-3build1_amd64.deb ... 2023-10-08T06:06:21.118 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2023-10-08T06:06:21.432 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-10-08T06:06:21.449 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../076-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2023-10-08T06:06:21.482 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2023-10-08T06:06:21.801 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-rsa. 2023-10-08T06:06:21.818 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../077-python3-rsa_4.0-3_all.deb ... 2023-10-08T06:06:21.851 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-rsa (4.0-3) ... 2023-10-08T06:06:22.206 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-google-auth. 2023-10-08T06:06:22.223 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../078-python3-google-auth_1.5.1-2_all.deb ... 2023-10-08T06:06:22.264 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2023-10-08T06:06:22.477 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-sklearn-lib. 2023-10-08T06:06:22.494 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../070-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2023-10-08T06:06:22.535 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2023-10-08T06:06:22.592 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-blinker. 2023-10-08T06:06:22.609 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../079-python3-blinker_1.4+dfsg1-0.3ubuntu1_all.deb ... 2023-10-08T06:06:22.650 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2023-10-08T06:06:22.953 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-oauthlib. 2023-10-08T06:06:22.969 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../080-python3-oauthlib_3.1.0-1ubuntu2_all.deb ... 2023-10-08T06:06:23.011 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-oauthlib (3.1.0-1ubuntu2) ... 2023-10-08T06:06:23.105 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-joblib. 2023-10-08T06:06:23.124 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../071-python3-joblib_0.14.0-3_all.deb ... 2023-10-08T06:06:23.155 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-joblib (0.14.0-3) ... 2023-10-08T06:06:23.442 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-10-08T06:06:23.462 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../081-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2023-10-08T06:06:23.491 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2023-10-08T06:06:23.542 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-sklearn. 2023-10-08T06:06:23.561 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../072-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2023-10-08T06:06:23.600 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2023-10-08T06:06:23.803 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-websocket. 2023-10-08T06:06:23.822 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../082-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2023-10-08T06:06:23.869 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2023-10-08T06:06:24.206 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-kubernetes. 2023-10-08T06:06:24.222 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../083-python3-kubernetes_7.0.0~a1-2_all.deb ... 2023-10-08T06:06:24.264 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2023-10-08T06:06:24.367 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-10-08T06:06:24.386 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../073-ceph-mgr-diskprediction-local_18.0.0-6609-g9725b08f-1focal_all.deb ... 2023-10-08T06:06:24.425 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking ceph-mgr-diskprediction-local (18.0.0-6609-g9725b08f-1focal) ... 2023-10-08T06:06:24.836 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-10-08T06:06:24.853 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../084-ceph-mgr-k8sevents_18.0.0-6609-g9725b08f-1focal_all.deb ... 2023-10-08T06:06:24.894 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking ceph-mgr-k8sevents (18.0.0-6609-g9725b08f-1focal) ... 2023-10-08T06:06:25.255 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package libonig5:amd64. 2023-10-08T06:06:25.272 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../085-libonig5_6.9.4-1_amd64.deb ... 2023-10-08T06:06:25.313 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2023-10-08T06:06:25.561 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-cachetools. 2023-10-08T06:06:25.578 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../074-python3-cachetools_4.0.0-1_all.deb ... 2023-10-08T06:06:25.653 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2023-10-08T06:06:25.662 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package libjq1:amd64. 2023-10-08T06:06:25.680 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../086-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2023-10-08T06:06:25.721 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2023-10-08T06:06:25.989 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-pyasn1. 2023-10-08T06:06:26.007 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package jq. 2023-10-08T06:06:26.008 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../075-python3-pyasn1_0.4.2-3build1_all.deb ... 2023-10-08T06:06:26.024 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../087-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2023-10-08T06:06:26.047 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2023-10-08T06:06:26.073 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2023-10-08T06:06:26.301 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package socat. 2023-10-08T06:06:26.320 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../088-socat_1.7.3.3-2_amd64.deb ... 2023-10-08T06:06:26.351 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking socat (1.7.3.3-2) ... 2023-10-08T06:06:26.417 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-10-08T06:06:26.434 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../076-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2023-10-08T06:06:26.475 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2023-10-08T06:06:26.663 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package xmlstarlet. 2023-10-08T06:06:26.679 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../089-xmlstarlet_1.6.1-2build1_amd64.deb ... 2023-10-08T06:06:26.720 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2023-10-08T06:06:26.820 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-rsa. 2023-10-08T06:06:26.837 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../077-python3-rsa_4.0-3_all.deb ... 2023-10-08T06:06:26.878 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-rsa (4.0-3) ... 2023-10-08T06:06:27.100 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package ceph-test. 2023-10-08T06:06:27.117 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../090-ceph-test_18.0.0-6609-g9725b08f-1focal_amd64.deb ... 2023-10-08T06:06:27.158 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking ceph-test (18.0.0-6609-g9725b08f-1focal) ... 2023-10-08T06:06:27.231 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-google-auth. 2023-10-08T06:06:27.249 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../078-python3-google-auth_1.5.1-2_all.deb ... 2023-10-08T06:06:27.314 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2023-10-08T06:06:27.668 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-blinker. 2023-10-08T06:06:27.684 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../079-python3-blinker_1.4+dfsg1-0.3ubuntu1_all.deb ... 2023-10-08T06:06:27.726 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2023-10-08T06:06:28.045 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-oauthlib. 2023-10-08T06:06:28.064 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../080-python3-oauthlib_3.1.0-1ubuntu2_all.deb ... 2023-10-08T06:06:28.103 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-oauthlib (3.1.0-1ubuntu2) ... 2023-10-08T06:06:28.534 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-10-08T06:06:28.554 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../081-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2023-10-08T06:06:28.592 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2023-10-08T06:06:28.946 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-websocket. 2023-10-08T06:06:28.962 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../082-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2023-10-08T06:06:29.020 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2023-10-08T06:06:29.374 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-kubernetes. 2023-10-08T06:06:29.393 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../083-python3-kubernetes_7.0.0~a1-2_all.deb ... 2023-10-08T06:06:29.424 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2023-10-08T06:06:30.029 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-10-08T06:06:30.049 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../084-ceph-mgr-k8sevents_18.0.0-6609-g9725b08f-1focal_all.deb ... 2023-10-08T06:06:30.087 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking ceph-mgr-k8sevents (18.0.0-6609-g9725b08f-1focal) ... 2023-10-08T06:06:30.440 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package libonig5:amd64. 2023-10-08T06:06:30.458 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../085-libonig5_6.9.4-1_amd64.deb ... 2023-10-08T06:06:30.498 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2023-10-08T06:06:30.858 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package libjq1:amd64. 2023-10-08T06:06:30.877 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../086-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2023-10-08T06:06:30.916 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2023-10-08T06:06:31.227 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package jq. 2023-10-08T06:06:31.245 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../087-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2023-10-08T06:06:31.285 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2023-10-08T06:06:31.555 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package socat. 2023-10-08T06:06:31.573 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../088-socat_1.7.3.3-2_amd64.deb ... 2023-10-08T06:06:31.605 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking socat (1.7.3.3-2) ... 2023-10-08T06:06:31.812 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package ceph-volume. 2023-10-08T06:06:31.829 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../091-ceph-volume_18.0.0-6609-g9725b08f-1focal_all.deb ... 2023-10-08T06:06:31.895 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking ceph-volume (18.0.0-6609-g9725b08f-1focal) ... 2023-10-08T06:06:31.950 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package xmlstarlet. 2023-10-08T06:06:31.967 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../089-xmlstarlet_1.6.1-2build1_amd64.deb ... 2023-10-08T06:06:32.033 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2023-10-08T06:06:32.275 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package cephfs-mirror. 2023-10-08T06:06:32.292 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../092-cephfs-mirror_18.0.0-6609-g9725b08f-1focal_amd64.deb ... 2023-10-08T06:06:32.333 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking cephfs-mirror (18.0.0-6609-g9725b08f-1focal) ... 2023-10-08T06:06:32.438 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package ceph-test. 2023-10-08T06:06:32.456 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../090-ceph-test_18.0.0-6609-g9725b08f-1focal_amd64.deb ... 2023-10-08T06:06:32.495 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking ceph-test (18.0.0-6609-g9725b08f-1focal) ... 2023-10-08T06:06:32.681 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-colorama. 2023-10-08T06:06:32.699 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../093-python3-colorama_0.4.3-1build1_all.deb ... 2023-10-08T06:06:32.739 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-colorama (0.4.3-1build1) ... 2023-10-08T06:06:33.041 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package cephfs-shell. 2023-10-08T06:06:33.058 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../094-cephfs-shell_18.0.0-6609-g9725b08f-1focal_all.deb ... 2023-10-08T06:06:33.099 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking cephfs-shell (18.0.0-6609-g9725b08f-1focal) ... 2023-10-08T06:06:33.359 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package cephfs-top. 2023-10-08T06:06:33.378 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../095-cephfs-top_18.0.0-6609-g9725b08f-1focal_all.deb ... 2023-10-08T06:06:33.417 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking cephfs-top (18.0.0-6609-g9725b08f-1focal) ... 2023-10-08T06:06:33.678 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package fonts-mathjax. 2023-10-08T06:06:33.694 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../096-fonts-mathjax_2.7.4+dfsg-1_all.deb ... 2023-10-08T06:06:33.736 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking fonts-mathjax (2.7.4+dfsg-1) ... 2023-10-08T06:06:34.256 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package libcephfs-dev. 2023-10-08T06:06:34.275 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../097-libcephfs-dev_18.0.0-6609-g9725b08f-1focal_amd64.deb ... 2023-10-08T06:06:34.314 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking libcephfs-dev (18.0.0-6609-g9725b08f-1focal) ... 2023-10-08T06:06:34.738 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package nvme-cli. 2023-10-08T06:06:34.758 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../098-nvme-cli_1.9-1ubuntu0.1_amd64.deb ... 2023-10-08T06:06:34.818 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking nvme-cli (1.9-1ubuntu0.1) ... 2023-10-08T06:06:35.122 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python-asyncssh-doc. 2023-10-08T06:06:35.139 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../099-python-asyncssh-doc_1.12.2-1_all.deb ... 2023-10-08T06:06:35.180 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python-asyncssh-doc (1.12.2-1) ... 2023-10-08T06:06:35.533 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package libjs-mathjax. 2023-10-08T06:06:35.552 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../100-libjs-mathjax_2.7.4+dfsg-1_all.deb ... 2023-10-08T06:06:35.599 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking libjs-mathjax (2.7.4+dfsg-1) ... 2023-10-08T06:06:37.250 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python-natsort-doc. 2023-10-08T06:06:37.259 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package ceph-volume. 2023-10-08T06:06:37.269 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../101-python-natsort-doc_7.0.1-1_all.deb ... 2023-10-08T06:06:37.275 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../091-ceph-volume_18.0.0-6609-g9725b08f-1focal_all.deb ... 2023-10-08T06:06:37.308 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python-natsort-doc (7.0.1-1) ... 2023-10-08T06:06:37.342 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking ceph-volume (18.0.0-6609-g9725b08f-1focal) ... 2023-10-08T06:06:37.669 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-atomicwrites. 2023-10-08T06:06:37.686 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../102-python3-atomicwrites_1.1.5-2build1_all.deb ... 2023-10-08T06:06:37.728 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2023-10-08T06:06:37.748 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package cephfs-mirror. 2023-10-08T06:06:37.765 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../092-cephfs-mirror_18.0.0-6609-g9725b08f-1focal_amd64.deb ... 2023-10-08T06:06:37.806 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking cephfs-mirror (18.0.0-6609-g9725b08f-1focal) ... 2023-10-08T06:06:38.047 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-attr. 2023-10-08T06:06:38.067 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../103-python3-attr_19.3.0-2_all.deb ... 2023-10-08T06:06:38.105 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-attr (19.3.0-2) ... 2023-10-08T06:06:38.145 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-colorama. 2023-10-08T06:06:38.164 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../093-python3-colorama_0.4.3-1build1_all.deb ... 2023-10-08T06:06:38.194 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-colorama (0.4.3-1build1) ... 2023-10-08T06:06:38.442 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-webencodings. 2023-10-08T06:06:38.459 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../104-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2023-10-08T06:06:38.480 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package cephfs-shell. 2023-10-08T06:06:38.498 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../094-cephfs-shell_18.0.0-6609-g9725b08f-1focal_all.deb ... 2023-10-08T06:06:38.500 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2023-10-08T06:06:38.538 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking cephfs-shell (18.0.0-6609-g9725b08f-1focal) ... 2023-10-08T06:06:38.815 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package cephfs-top. 2023-10-08T06:06:38.835 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../095-cephfs-top_18.0.0-6609-g9725b08f-1focal_all.deb ... 2023-10-08T06:06:38.836 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-html5lib. 2023-10-08T06:06:38.853 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../105-python3-html5lib_1.0.1-2_all.deb ... 2023-10-08T06:06:38.873 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking cephfs-top (18.0.0-6609-g9725b08f-1focal) ... 2023-10-08T06:06:38.894 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2023-10-08T06:06:39.134 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package fonts-mathjax. 2023-10-08T06:06:39.153 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../096-fonts-mathjax_2.7.4+dfsg-1_all.deb ... 2023-10-08T06:06:39.192 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking fonts-mathjax (2.7.4+dfsg-1) ... 2023-10-08T06:06:39.239 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-lxml:amd64. 2023-10-08T06:06:39.259 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../106-python3-lxml_4.5.0-1ubuntu0.5_amd64.deb ... 2023-10-08T06:06:39.297 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2023-10-08T06:06:39.704 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package libcephfs-dev. 2023-10-08T06:06:39.724 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../097-libcephfs-dev_18.0.0-6609-g9725b08f-1focal_amd64.deb ... 2023-10-08T06:06:39.754 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking libcephfs-dev (18.0.0-6609-g9725b08f-1focal) ... 2023-10-08T06:06:39.775 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-packaging. 2023-10-08T06:06:39.793 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../107-python3-packaging_20.3-1_all.deb ... 2023-10-08T06:06:39.833 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-packaging (20.3-1) ... 2023-10-08T06:06:40.120 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-pastescript. 2023-10-08T06:06:40.137 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../108-python3-pastescript_2.0.2-4_all.deb ... 2023-10-08T06:06:40.177 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-10-08T06:06:40.199 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package nvme-cli. 2023-10-08T06:06:40.217 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../098-nvme-cli_1.9-1ubuntu0.1_amd64.deb ... 2023-10-08T06:06:40.274 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking nvme-cli (1.9-1ubuntu0.1) ... 2023-10-08T06:06:40.518 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-pluggy. 2023-10-08T06:06:40.539 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../109-python3-pluggy_0.13.0-2_all.deb ... 2023-10-08T06:06:40.601 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2023-10-08T06:06:40.613 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python-asyncssh-doc. 2023-10-08T06:06:40.630 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../099-python-asyncssh-doc_1.12.2-1_all.deb ... 2023-10-08T06:06:40.671 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python-asyncssh-doc (1.12.2-1) ... 2023-10-08T06:06:40.920 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-psutil. 2023-10-08T06:06:40.937 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../110-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2023-10-08T06:06:40.978 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2023-10-08T06:06:41.050 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package libjs-mathjax. 2023-10-08T06:06:41.066 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../100-libjs-mathjax_2.7.4+dfsg-1_all.deb ... 2023-10-08T06:06:41.098 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking libjs-mathjax (2.7.4+dfsg-1) ... 2023-10-08T06:06:41.314 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-py. 2023-10-08T06:06:41.335 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../111-python3-py_1.8.1-1ubuntu0.1_all.deb ... 2023-10-08T06:06:41.372 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-py (1.8.1-1ubuntu0.1) ... 2023-10-08T06:06:41.751 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-pyinotify. 2023-10-08T06:06:41.768 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../112-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2023-10-08T06:06:41.808 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2023-10-08T06:06:42.136 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-pytest. 2023-10-08T06:06:42.154 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../113-python3-pytest_4.6.9-1_all.deb ... 2023-10-08T06:06:42.203 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-pytest (4.6.9-1) ... 2023-10-08T06:06:42.565 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-simplejson. 2023-10-08T06:06:42.584 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../114-python3-simplejson_3.16.0-2ubuntu2_amd64.deb ... 2023-10-08T06:06:42.623 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-simplejson (3.16.0-2ubuntu2) ... 2023-10-08T06:06:42.798 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python-natsort-doc. 2023-10-08T06:06:42.819 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../101-python-natsort-doc_7.0.1-1_all.deb ... 2023-10-08T06:06:42.863 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python-natsort-doc (7.0.1-1) ... 2023-10-08T06:06:42.918 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-10-08T06:06:42.939 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.12.8-0ubuntu1_all.deb ... 2023-10-08T06:06:42.975 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking qttranslations5-l10n (5.12.8-0ubuntu1) ... 2023-10-08T06:06:43.209 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-atomicwrites. 2023-10-08T06:06:43.226 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../102-python3-atomicwrites_1.1.5-2build1_all.deb ... 2023-10-08T06:06:43.266 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2023-10-08T06:06:43.594 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-attr. 2023-10-08T06:06:43.611 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../103-python3-attr_19.3.0-2_all.deb ... 2023-10-08T06:06:43.652 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-attr (19.3.0-2) ... 2023-10-08T06:06:43.666 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package radosgw. 2023-10-08T06:06:43.684 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../116-radosgw_18.0.0-6609-g9725b08f-1focal_amd64.deb ... 2023-10-08T06:06:43.723 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking radosgw (18.0.0-6609-g9725b08f-1focal) ... 2023-10-08T06:06:44.014 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-webencodings. 2023-10-08T06:06:44.031 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../104-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2023-10-08T06:06:44.072 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2023-10-08T06:06:44.366 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-html5lib. 2023-10-08T06:06:44.385 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../105-python3-html5lib_1.0.1-2_all.deb ... 2023-10-08T06:06:44.424 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2023-10-08T06:06:44.811 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-lxml:amd64. 2023-10-08T06:06:44.833 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../106-python3-lxml_4.5.0-1ubuntu0.5_amd64.deb ... 2023-10-08T06:06:44.869 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2023-10-08T06:06:45.194 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package rbd-fuse. 2023-10-08T06:06:45.212 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../117-rbd-fuse_18.0.0-6609-g9725b08f-1focal_amd64.deb ... 2023-10-08T06:06:45.252 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking rbd-fuse (18.0.0-6609-g9725b08f-1focal) ... 2023-10-08T06:06:45.331 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-packaging. 2023-10-08T06:06:45.348 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../107-python3-packaging_20.3-1_all.deb ... 2023-10-08T06:06:45.389 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-packaging (20.3-1) ... 2023-10-08T06:06:45.592 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-attr (19.3.0-2) ... 2023-10-08T06:06:45.717 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-pastescript. 2023-10-08T06:06:45.735 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../108-python3-pastescript_2.0.2-4_all.deb ... 2023-10-08T06:06:45.785 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-10-08T06:06:45.902 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2023-10-08T06:06:46.045 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2023-10-08T06:06:46.157 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-pluggy. 2023-10-08T06:06:46.171 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up nvme-cli (1.9-1ubuntu0.1) ... 2023-10-08T06:06:46.175 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../109-python3-pluggy_0.13.0-2_all.deb ... 2023-10-08T06:06:46.215 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2023-10-08T06:06:46.389 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up cephadm (18.0.0-6609-g9725b08f-1focal) ... 2023-10-08T06:06:46.543 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-psutil. 2023-10-08T06:06:46.565 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../110-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2023-10-08T06:06:46.601 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2023-10-08T06:06:46.963 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-py. 2023-10-08T06:06:46.982 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../111-python3-py_1.8.1-1ubuntu0.1_all.deb ... 2023-10-08T06:06:47.021 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-py (1.8.1-1ubuntu0.1) ... 2023-10-08T06:06:47.313 INFO:teuthology.orchestra.run.smithi032.stdout:Adding system user cephadm....done 2023-10-08T06:06:47.391 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-pyinotify. 2023-10-08T06:06:47.410 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../112-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2023-10-08T06:06:47.449 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2023-10-08T06:06:47.586 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up fonts-mathjax (2.7.4+dfsg-1) ... 2023-10-08T06:06:47.712 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-waitress (1.4.1-1ubuntu0.1) ... 2023-10-08T06:06:47.785 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-pytest. 2023-10-08T06:06:47.803 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../113-python3-pytest_4.6.9-1_all.deb ... 2023-10-08T06:06:47.843 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-pytest (4.6.9-1) ... 2023-10-08T06:06:48.089 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-10-08T06:06:48.223 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-simplejson. 2023-10-08T06:06:48.240 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../114-python3-simplejson_3.16.0-2ubuntu2_amd64.deb ... 2023-10-08T06:06:48.281 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-simplejson (3.16.0-2ubuntu2) ... 2023-10-08T06:06:48.390 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up libjs-mathjax (2.7.4+dfsg-1) ... 2023-10-08T06:06:48.516 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up liboath0 (2.6.1-1.3) ... 2023-10-08T06:06:48.642 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-py (1.8.1-1ubuntu0.1) ... 2023-10-08T06:06:48.717 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-10-08T06:06:48.735 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.12.8-0ubuntu1_all.deb ... 2023-10-08T06:06:48.775 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking qttranslations5-l10n (5.12.8-0ubuntu1) ... 2023-10-08T06:06:48.985 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-joblib (0.14.0-3) ... 2023-10-08T06:06:49.413 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-jwt (1.7.1-2ubuntu2.1) ... 2023-10-08T06:06:49.541 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package radosgw. 2023-10-08T06:06:49.559 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../116-radosgw_18.0.0-6609-g9725b08f-1focal_amd64.deb ... 2023-10-08T06:06:49.599 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking radosgw (18.0.0-6609-g9725b08f-1focal) ... 2023-10-08T06:06:49.739 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-cachetools (4.0.0-1) ... 2023-10-08T06:06:50.039 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-colorama (0.4.3-1build1) ... 2023-10-08T06:06:50.349 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2023-10-08T06:06:50.650 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2023-10-08T06:06:50.960 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-ceph-argparse (18.0.0-6609-g9725b08f-1focal) ... 2023-10-08T06:06:51.078 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package rbd-fuse. 2023-10-08T06:06:51.096 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../117-rbd-fuse_18.0.0-6609-g9725b08f-1focal_amd64.deb ... 2023-10-08T06:06:51.136 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking rbd-fuse (18.0.0-6609-g9725b08f-1focal) ... 2023-10-08T06:06:51.269 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2023-10-08T06:06:51.403 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-pyperclip (1.7.0-1) ... 2023-10-08T06:06:51.463 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-attr (19.3.0-2) ... 2023-10-08T06:06:51.715 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2023-10-08T06:06:51.785 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2023-10-08T06:06:51.911 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2023-10-08T06:06:52.016 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2023-10-08T06:06:52.070 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up nvme-cli (1.9-1ubuntu0.1) ... 2023-10-08T06:06:52.280 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up cephadm (18.0.0-6609-g9725b08f-1focal) ... 2023-10-08T06:06:52.317 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2023-10-08T06:06:52.443 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2023-10-08T06:06:52.836 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-natsort (7.0.1-1) ... 2023-10-08T06:06:53.025 INFO:teuthology.orchestra.run.smithi040.stdout:Adding system user cephadm....done 2023-10-08T06:06:53.137 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2023-10-08T06:06:53.186 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up fonts-mathjax (2.7.4+dfsg-1) ... 2023-10-08T06:06:53.321 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-waitress (1.4.1-1ubuntu0.1) ... 2023-10-08T06:06:53.546 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-simplejson (3.16.0-2ubuntu2) ... 2023-10-08T06:06:53.664 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-10-08T06:06:53.916 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2023-10-08T06:06:53.990 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up libjs-mathjax (2.7.4+dfsg-1) ... 2023-10-08T06:06:54.124 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up liboath0 (2.6.1-1.3) ... 2023-10-08T06:06:54.218 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-jinja2 (2.10.1-2) ... 2023-10-08T06:06:54.284 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-py (1.8.1-1ubuntu0.1) ... 2023-10-08T06:06:54.578 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-tempita (0.5.2-6) ... 2023-10-08T06:06:54.652 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-joblib (0.14.0-3) ... 2023-10-08T06:06:54.879 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-packaging (20.3-1) ... 2023-10-08T06:06:55.079 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-jwt (1.7.1-2ubuntu2.1) ... 2023-10-08T06:06:55.180 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2023-10-08T06:06:55.306 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up qttranslations5-l10n (5.12.8-0ubuntu1) ... 2023-10-08T06:06:55.356 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-cachetools (4.0.0-1) ... 2023-10-08T06:06:55.432 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2023-10-08T06:06:55.690 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-colorama (0.4.3-1build1) ... 2023-10-08T06:06:55.733 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2023-10-08T06:06:56.017 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2023-10-08T06:06:56.145 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-cmd2 (0.8.5-2.1) ... 2023-10-08T06:06:56.454 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2023-10-08T06:06:56.459 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2023-10-08T06:06:56.793 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-ceph-argparse (18.0.0-6609-g9725b08f-1focal) ... 2023-10-08T06:06:56.830 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-cryptography (2.8-3ubuntu0.1) ... 2023-10-08T06:06:57.156 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2023-10-08T06:06:57.240 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up socat (1.7.3.3-2) ... 2023-10-08T06:06:57.282 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-pyperclip (1.7.0-1) ... 2023-10-08T06:06:57.366 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-ceph-common (18.0.0-6609-g9725b08f-1focal) ... 2023-10-08T06:06:57.575 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2023-10-08T06:06:57.701 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-10-08T06:06:57.835 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-html5lib (1.0.1-2) ... 2023-10-08T06:06:57.884 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2023-10-08T06:06:58.194 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2023-10-08T06:06:58.212 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2023-10-08T06:06:58.320 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2023-10-08T06:06:58.337 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2023-10-08T06:06:58.463 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-pluggy (0.13.0-2) ... 2023-10-08T06:06:58.704 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-natsort (7.0.1-1) ... 2023-10-08T06:06:58.764 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2023-10-08T06:06:59.040 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2023-10-08T06:06:59.116 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-10-08T06:06:59.242 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2023-10-08T06:06:59.367 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2023-10-08T06:06:59.385 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-simplejson (3.16.0-2ubuntu2) ... 2023-10-08T06:06:59.719 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2023-10-08T06:06:59.769 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2023-10-08T06:07:00.045 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-logutils (0.3.3-7) ... 2023-10-08T06:07:00.145 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-jinja2 (2.10.1-2) ... 2023-10-08T06:07:00.354 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2023-10-08T06:07:00.480 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-10-08T06:07:00.496 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-tempita (0.5.2-6) ... 2023-10-08T06:07:00.798 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-prettytable (0.7.2-5) ... 2023-10-08T06:07:00.814 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-packaging (20.3-1) ... 2023-10-08T06:07:01.082 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2023-10-08T06:07:01.124 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2023-10-08T06:07:01.250 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up qttranslations5-l10n (5.12.8-0ubuntu1) ... 2023-10-08T06:07:01.367 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2023-10-08T06:07:01.369 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2023-10-08T06:07:01.723 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2023-10-08T06:07:01.734 INFO:teuthology.orchestra.run.smithi032.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2023-10-08T06:07:02.003 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2023-10-08T06:07:02.129 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2023-10-08T06:07:02.148 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-cmd2 (0.8.5-2.1) ... 2023-10-08T06:07:02.440 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2023-10-08T06:07:02.446 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2023-10-08T06:07:02.806 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2023-10-08T06:07:02.825 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-cryptography (2.8-3ubuntu0.1) ... 2023-10-08T06:07:02.940 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2023-10-08T06:07:03.075 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-webob (1:1.8.5-2) ... 2023-10-08T06:07:03.177 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up socat (1.7.3.3-2) ... 2023-10-08T06:07:03.336 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-ceph-common (18.0.0-6609-g9725b08f-1focal) ... 2023-10-08T06:07:03.401 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2023-10-08T06:07:03.663 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-10-08T06:07:03.702 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2023-10-08T06:07:03.797 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-html5lib (1.0.1-2) ... 2023-10-08T06:07:04.174 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2023-10-08T06:07:04.325 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2023-10-08T06:07:04.451 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-pluggy (0.13.0-2) ... 2023-10-08T06:07:04.735 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2023-10-08T06:07:05.061 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-10-08T06:07:05.171 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2023-10-08T06:07:05.215 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2023-10-08T06:07:05.322 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2023-10-08T06:07:05.341 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-pytest (4.6.9-1) ... 2023-10-08T06:07:05.665 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2023-10-08T06:07:05.692 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2023-10-08T06:07:05.974 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-logutils (0.3.3-7) ... 2023-10-08T06:07:06.002 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2023-10-08T06:07:06.293 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2023-10-08T06:07:06.303 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-10-08T06:07:06.426 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-10-08T06:07:06.429 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-bs4 (4.8.2-1) ... 2023-10-08T06:07:06.719 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-prettytable (0.7.2-5) ... 2023-10-08T06:07:06.805 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-oauthlib (3.1.0-1ubuntu2) ... 2023-10-08T06:07:07.020 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2023-10-08T06:07:07.140 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-asyncssh (1.12.2-1) ... 2023-10-08T06:07:07.321 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2023-10-08T06:07:07.533 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2023-10-08T06:07:07.763 INFO:teuthology.orchestra.run.smithi040.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2023-10-08T06:07:07.842 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2023-10-08T06:07:08.032 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2023-10-08T06:07:08.158 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2023-10-08T06:07:08.526 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2023-10-08T06:07:08.923 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2023-10-08T06:07:08.944 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2023-10-08T06:07:09.049 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python-natsort-doc (7.0.1-1) ... 2023-10-08T06:07:09.174 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2023-10-08T06:07:09.309 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-rsa (4.0-3) ... 2023-10-08T06:07:09.462 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2023-10-08T06:07:09.571 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-webob (1:1.8.5-2) ... 2023-10-08T06:07:09.610 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up libthrift-0.13.0 (0.13.0-2build2) ... 2023-10-08T06:07:09.736 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-webtest (2.0.32-2) ... 2023-10-08T06:07:09.948 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2023-10-08T06:07:10.054 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2023-10-08T06:07:10.328 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2023-10-08T06:07:10.355 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-10-08T06:07:10.706 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2023-10-08T06:07:11.066 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up librados2 (18.0.0-6609-g9725b08f-1focal) ... 2023-10-08T06:07:11.269 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python-asyncssh-doc (1.12.2-1) ... 2023-10-08T06:07:11.412 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up librgw2 (18.0.0-6609-g9725b08f-1focal) ... 2023-10-08T06:07:11.538 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up libsqlite3-mod-ceph (18.0.0-6609-g9725b08f-1focal) ... 2023-10-08T06:07:11.665 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up libcephfs2 (18.0.0-6609-g9725b08f-1focal) ... 2023-10-08T06:07:11.793 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-routes (2.4.1-2) ... 2023-10-08T06:07:11.837 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2023-10-08T06:07:11.987 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-pytest (4.6.9-1) ... 2023-10-08T06:07:12.086 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up libradosstriper1 (18.0.0-6609-g9725b08f-1focal) ... 2023-10-08T06:07:12.212 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-google-auth (1.5.1-2) ... 2023-10-08T06:07:12.390 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2023-10-08T06:07:12.505 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up librbd1 (18.0.0-6609-g9725b08f-1focal) ... 2023-10-08T06:07:12.631 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up ceph-mgr-modules-core (18.0.0-6609-g9725b08f-1focal) ... 2023-10-08T06:07:12.708 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2023-10-08T06:07:12.757 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up ceph-fuse (18.0.0-6609-g9725b08f-1focal) ... 2023-10-08T06:07:13.009 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-10-08T06:07:13.012 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-10-08T06:07:13.012 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-10-08T06:07:13.135 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-bs4 (4.8.2-1) ... 2023-10-08T06:07:13.467 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up libcephfs-dev (18.0.0-6609-g9725b08f-1focal) ... 2023-10-08T06:07:13.486 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-oauthlib (3.1.0-1ubuntu2) ... 2023-10-08T06:07:13.592 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-rados (18.0.0-6609-g9725b08f-1focal) ... 2023-10-08T06:07:13.693 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up cephfs-top (18.0.0-6609-g9725b08f-1focal) ... 2023-10-08T06:07:13.794 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2023-10-08T06:07:13.846 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-asyncssh (1.12.2-1) ... 2023-10-08T06:07:14.298 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2023-10-08T06:07:14.649 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2023-10-08T06:07:14.717 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-rbd (18.0.0-6609-g9725b08f-1focal) ... 2023-10-08T06:07:14.826 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up rbd-fuse (18.0.0-6609-g9725b08f-1focal) ... 2023-10-08T06:07:14.936 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-rgw (18.0.0-6609-g9725b08f-1focal) ... 2023-10-08T06:07:15.045 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-cephfs (18.0.0-6609-g9725b08f-1focal) ... 2023-10-08T06:07:15.171 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up cephfs-shell (18.0.0-6609-g9725b08f-1focal) ... 2023-10-08T06:07:15.322 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up ceph-common (18.0.0-6609-g9725b08f-1focal) ... 2023-10-08T06:07:15.712 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2023-10-08T06:07:15.838 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python-natsort-doc (7.0.1-1) ... 2023-10-08T06:07:15.858 INFO:teuthology.orchestra.run.smithi032.stdout:Adding group ceph....done 2023-10-08T06:07:15.998 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2023-10-08T06:07:16.124 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-rsa (4.0-3) ... 2023-10-08T06:07:16.236 INFO:teuthology.orchestra.run.smithi032.stdout:Adding system user ceph....done 2023-10-08T06:07:16.414 INFO:teuthology.orchestra.run.smithi032.stdout:Setting system user ceph properties....done 2023-10-08T06:07:16.433 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up libthrift-0.13.0 (0.13.0-2build2) ... 2023-10-08T06:07:16.434 INFO:teuthology.orchestra.run.smithi032.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-10-08T06:07:16.559 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-webtest (2.0.32-2) ... 2023-10-08T06:07:16.600 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-10-08T06:07:16.910 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2023-10-08T06:07:16.920 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-10-08T06:07:17.245 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-10-08T06:07:17.375 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up cephfs-mirror (18.0.0-6609-g9725b08f-1focal) ... 2023-10-08T06:07:17.610 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-10-08T06:07:17.610 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-10-08T06:07:17.620 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2023-10-08T06:07:17.990 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up librados2 (18.0.0-6609-g9725b08f-1focal) ... 2023-10-08T06:07:18.210 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python-asyncssh-doc (1.12.2-1) ... 2023-10-08T06:07:18.335 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up ceph-test (18.0.0-6609-g9725b08f-1focal) ... 2023-10-08T06:07:18.372 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up librgw2 (18.0.0-6609-g9725b08f-1focal) ... 2023-10-08T06:07:18.486 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up radosgw (18.0.0-6609-g9725b08f-1focal) ... 2023-10-08T06:07:18.498 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up libsqlite3-mod-ceph (18.0.0-6609-g9725b08f-1focal) ... 2023-10-08T06:07:18.647 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up libcephfs2 (18.0.0-6609-g9725b08f-1focal) ... 2023-10-08T06:07:18.775 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-routes (2.4.1-2) ... 2023-10-08T06:07:18.969 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-10-08T06:07:18.969 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-10-08T06:07:19.077 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up libradosstriper1 (18.0.0-6609-g9725b08f-1focal) ... 2023-10-08T06:07:19.203 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-google-auth (1.5.1-2) ... 2023-10-08T06:07:19.405 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up ceph-base (18.0.0-6609-g9725b08f-1focal) ... 2023-10-08T06:07:19.555 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up librbd1 (18.0.0-6609-g9725b08f-1focal) ... 2023-10-08T06:07:19.699 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up ceph-mgr-modules-core (18.0.0-6609-g9725b08f-1focal) ... 2023-10-08T06:07:19.798 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-10-08T06:07:19.834 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up ceph-fuse (18.0.0-6609-g9725b08f-1focal) ... 2023-10-08T06:07:20.066 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-10-08T06:07:20.066 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-10-08T06:07:20.248 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up ceph-mds (18.0.0-6609-g9725b08f-1focal) ... 2023-10-08T06:07:20.478 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-10-08T06:07:20.478 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-10-08T06:07:20.552 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up libcephfs-dev (18.0.0-6609-g9725b08f-1focal) ... 2023-10-08T06:07:20.703 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-rados (18.0.0-6609-g9725b08f-1focal) ... 2023-10-08T06:07:20.829 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up cephfs-top (18.0.0-6609-g9725b08f-1focal) ... 2023-10-08T06:07:20.941 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up ceph-mgr (18.0.0-6609-g9725b08f-1focal) ... 2023-10-08T06:07:20.980 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2023-10-08T06:07:21.173 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-10-08T06:07:21.173 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-10-08T06:07:21.634 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up ceph-osd (18.0.0-6609-g9725b08f-1focal) ... 2023-10-08T06:07:21.936 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-rbd (18.0.0-6609-g9725b08f-1focal) ... 2023-10-08T06:07:22.062 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up rbd-fuse (18.0.0-6609-g9725b08f-1focal) ... 2023-10-08T06:07:22.128 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-10-08T06:07:22.128 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-10-08T06:07:22.214 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-rgw (18.0.0-6609-g9725b08f-1focal) ... 2023-10-08T06:07:22.323 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-cephfs (18.0.0-6609-g9725b08f-1focal) ... 2023-10-08T06:07:22.424 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up cephfs-shell (18.0.0-6609-g9725b08f-1focal) ... 2023-10-08T06:07:22.559 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up ceph-common (18.0.0-6609-g9725b08f-1focal) ... 2023-10-08T06:07:22.603 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up ceph-mgr-k8sevents (18.0.0-6609-g9725b08f-1focal) ... 2023-10-08T06:07:22.729 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up ceph-mgr-diskprediction-local (18.0.0-6609-g9725b08f-1focal) ... 2023-10-08T06:07:22.871 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up ceph-mon (18.0.0-6609-g9725b08f-1focal) ... 2023-10-08T06:07:23.105 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-10-08T06:07:23.106 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-10-08T06:07:23.146 INFO:teuthology.orchestra.run.smithi040.stdout:Adding group ceph....done 2023-10-08T06:07:23.548 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up ceph-mgr-cephadm (18.0.0-6609-g9725b08f-1focal) ... 2023-10-08T06:07:23.556 INFO:teuthology.orchestra.run.smithi040.stdout:Adding system user ceph....done 2023-10-08T06:07:23.691 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up ceph (18.0.0-6609-g9725b08f-1focal) ... 2023-10-08T06:07:23.732 INFO:teuthology.orchestra.run.smithi040.stdout:Setting system user ceph properties....done 2023-10-08T06:07:23.761 INFO:teuthology.orchestra.run.smithi040.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-10-08T06:07:23.817 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up ceph-mgr-dashboard (18.0.0-6609-g9725b08f-1focal) ... 2023-10-08T06:07:23.920 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-10-08T06:07:23.959 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up ceph-volume (18.0.0-6609-g9725b08f-1focal) ... 2023-10-08T06:07:24.238 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-10-08T06:07:24.354 INFO:teuthology.orchestra.run.smithi032.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2023-10-08T06:07:24.506 INFO:teuthology.orchestra.run.smithi032.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2023-10-08T06:07:24.703 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up cephfs-mirror (18.0.0-6609-g9725b08f-1focal) ... 2023-10-08T06:07:24.790 INFO:teuthology.orchestra.run.smithi032.stdout:Processing triggers for man-db (2.9.1-1) ... 2023-10-08T06:07:24.968 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-10-08T06:07:24.969 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-10-08T06:07:25.463 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up ceph-test (18.0.0-6609-g9725b08f-1focal) ... 2023-10-08T06:07:25.573 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up radosgw (18.0.0-6609-g9725b08f-1focal) ... 2023-10-08T06:07:26.021 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-10-08T06:07:26.021 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-10-08T06:07:26.484 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up ceph-base (18.0.0-6609-g9725b08f-1focal) ... 2023-10-08T06:07:26.876 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-10-08T06:07:27.310 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up ceph-mds (18.0.0-6609-g9725b08f-1focal) ... 2023-10-08T06:07:27.591 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-10-08T06:07:27.591 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-10-08T06:07:27.742 INFO:teuthology.orchestra.run.smithi032.stdout:Processing triggers for fontconfig (2.13.1-2ubuntu3) ... 2023-10-08T06:07:28.071 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up ceph-mgr (18.0.0-6609-g9725b08f-1focal) ... 2023-10-08T06:07:28.309 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-10-08T06:07:28.310 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-10-08T06:07:28.353 INFO:teuthology.orchestra.run.smithi032.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-10-08T06:07:28.355 DEBUG:teuthology.orchestra.run.smithi032:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2023-10-08T06:07:28.431 INFO:teuthology.orchestra.run.smithi032.stdout:Reading package lists... 2023-10-08T06:07:28.641 INFO:teuthology.orchestra.run.smithi032.stdout:Building dependency tree... 2023-10-08T06:07:28.642 INFO:teuthology.orchestra.run.smithi032.stdout:Reading state information... 2023-10-08T06:07:28.764 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up ceph-osd (18.0.0-6609-g9725b08f-1focal) ... 2023-10-08T06:07:28.854 INFO:teuthology.orchestra.run.smithi032.stdout:bison is already the newest version (2:3.5.1+dfsg-1). 2023-10-08T06:07:28.854 INFO:teuthology.orchestra.run.smithi032.stdout:flex is already the newest version (2.6.4-6.2). 2023-10-08T06:07:28.854 INFO:teuthology.orchestra.run.smithi032.stdout:iproute2 is already the newest version (5.5.0-1ubuntu1). 2023-10-08T06:07:28.854 INFO:teuthology.orchestra.run.smithi032.stdout:libtool-bin is already the newest version (2.4.6-14). 2023-10-08T06:07:28.854 INFO:teuthology.orchestra.run.smithi032.stdout:xfslibs-dev is already the newest version (5.3.0-1ubuntu2). 2023-10-08T06:07:28.854 INFO:teuthology.orchestra.run.smithi032.stdout:The following packages were automatically installed and are no longer required: 2023-10-08T06:07:28.855 INFO:teuthology.orchestra.run.smithi032.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2023-10-08T06:07:28.855 INFO:teuthology.orchestra.run.smithi032.stdout:Use 'sudo apt autoremove' to remove them. 2023-10-08T06:07:28.855 INFO:teuthology.orchestra.run.smithi032.stdout:The following additional packages will be installed: 2023-10-08T06:07:28.856 INFO:teuthology.orchestra.run.smithi032.stdout: libbluetooth3 libdw1 libelf1 liblzo2-2 libmbim-glib4 libmbim-proxy 2023-10-08T06:07:28.856 INFO:teuthology.orchestra.run.smithi032.stdout: libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl1.1 2023-10-08T06:07:28.856 INFO:teuthology.orchestra.run.smithi032.stdout: libteamdctl0 libuuid1 modemmanager network-manager-pptp postgresql-12 2023-10-08T06:07:28.856 INFO:teuthology.orchestra.run.smithi032.stdout: postgresql-client-12 postgresql-client-common ppp pptp-linux usb-modeswitch 2023-10-08T06:07:28.856 INFO:teuthology.orchestra.run.smithi032.stdout: usb-modeswitch-data wpasupplicant 2023-10-08T06:07:28.857 INFO:teuthology.orchestra.run.smithi032.stdout:Suggested packages: 2023-10-08T06:07:28.857 INFO:teuthology.orchestra.run.smithi032.stdout: indent-doc libssl-doc avahi-autoipd libteam-utils postgresql-doc 2023-10-08T06:07:28.857 INFO:teuthology.orchestra.run.smithi032.stdout: postgresql-doc-12 libjson-perl comgt wvdial util-linux-locales wpagui 2023-10-08T06:07:28.858 INFO:teuthology.orchestra.run.smithi032.stdout: libengine-pkcs11-openssl 2023-10-08T06:07:28.921 INFO:teuthology.orchestra.run.smithi032.stdout:The following NEW packages will be installed: 2023-10-08T06:07:28.921 INFO:teuthology.orchestra.run.smithi032.stdout: dump indent libaio-dev libbluetooth3 libelf-dev liblzo2-2 libmbim-glib4 2023-10-08T06:07:28.922 INFO:teuthology.orchestra.run.smithi032.stdout: libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy 2023-10-08T06:07:28.922 INFO:teuthology.orchestra.run.smithi032.stdout: libssl-dev libteamdctl0 modemmanager network-manager network-manager-pptp 2023-10-08T06:07:28.922 INFO:teuthology.orchestra.run.smithi032.stdout: postgresql postgresql-12 postgresql-client postgresql-client-12 2023-10-08T06:07:28.922 INFO:teuthology.orchestra.run.smithi032.stdout: postgresql-client-common postgresql-common postgresql-contrib ppp pptp-linux 2023-10-08T06:07:28.923 INFO:teuthology.orchestra.run.smithi032.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2023-10-08T06:07:28.923 INFO:teuthology.orchestra.run.smithi032.stdout:The following packages will be upgraded: 2023-10-08T06:07:28.924 INFO:teuthology.orchestra.run.smithi032.stdout: libdw1 libelf1 libssl1.1 libuuid1 util-linux uuid-dev 2023-10-08T06:07:28.979 INFO:teuthology.orchestra.run.smithi032.stdout:6 upgraded, 31 newly installed, 0 to remove and 247 not upgraded. 2023-10-08T06:07:28.979 INFO:teuthology.orchestra.run.smithi032.stdout:Need to get 25.3 MB of archives. 2023-10-08T06:07:28.979 INFO:teuthology.orchestra.run.smithi032.stdout:After this operation, 79.9 MB of additional disk space will be used. 2023-10-08T06:07:28.980 INFO:teuthology.orchestra.run.smithi032.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 util-linux amd64 2.34-0.1ubuntu9.4 [1,021 kB] 2023-10-08T06:07:29.110 INFO:teuthology.orchestra.run.smithi032.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 uuid-dev amd64 2.34-0.1ubuntu9.4 [33.6 kB] 2023-10-08T06:07:29.111 INFO:teuthology.orchestra.run.smithi032.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libuuid1 amd64 2.34-0.1ubuntu9.4 [20.0 kB] 2023-10-08T06:07:29.111 INFO:teuthology.orchestra.run.smithi032.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libdw1 amd64 0.176-1.1ubuntu0.1 [226 kB] 2023-10-08T06:07:29.117 INFO:teuthology.orchestra.run.smithi032.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libelf1 amd64 0.176-1.1ubuntu0.1 [44.2 kB] 2023-10-08T06:07:29.118 INFO:teuthology.orchestra.run.smithi032.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl1.1 amd64 1.1.1f-1ubuntu2.19 [1,321 kB] 2023-10-08T06:07:29.134 INFO:teuthology.orchestra.run.smithi032.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 liblzo2-2 amd64 2.10-2 [50.8 kB] 2023-10-08T06:07:29.135 INFO:teuthology.orchestra.run.smithi032.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/universe amd64 dump amd64 0.4b46-6 [130 kB] 2023-10-08T06:07:29.137 INFO:teuthology.orchestra.run.smithi032.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 indent amd64 2.2.12-1ubuntu0.20.04.1 [86.6 kB] 2023-10-08T06:07:29.138 INFO:teuthology.orchestra.run.smithi032.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/main amd64 libaio-dev amd64 0.3.112-5 [13.7 kB] 2023-10-08T06:07:29.138 INFO:teuthology.orchestra.run.smithi032.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libbluetooth3 amd64 5.53-0ubuntu3.6 [60.6 kB] 2023-10-08T06:07:29.143 INFO:teuthology.orchestra.run.smithi032.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libelf-dev amd64 0.176-1.1ubuntu0.1 [57.1 kB] 2023-10-08T06:07:29.144 INFO:teuthology.orchestra.run.smithi032.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-glib4 amd64 1.26.2-1~ubuntu20.04.1 [123 kB] 2023-10-08T06:07:29.145 INFO:teuthology.orchestra.run.smithi032.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-proxy amd64 1.26.2-1~ubuntu20.04.1 [6,012 B] 2023-10-08T06:07:29.146 INFO:teuthology.orchestra.run.smithi032.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmm-glib0 amd64 1.18.6-1~ubuntu20.04.1 [203 kB] 2023-10-08T06:07:29.160 INFO:teuthology.orchestra.run.smithi032.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal/main amd64 libndp0 amd64 1.7-0ubuntu1 [10.9 kB] 2023-10-08T06:07:29.161 INFO:teuthology.orchestra.run.smithi032.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libnm0 amd64 1.22.10-1ubuntu2.3 [370 kB] 2023-10-08T06:07:29.167 INFO:teuthology.orchestra.run.smithi032.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpq5 amd64 12.16-0ubuntu0.20.04.1 [115 kB] 2023-10-08T06:07:29.169 INFO:teuthology.orchestra.run.smithi032.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-glib5 amd64 1.30.4-1~ubuntu20.04.1 [642 kB] 2023-10-08T06:07:29.176 INFO:teuthology.orchestra.run.smithi032.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-proxy amd64 1.30.4-1~ubuntu20.04.1 [5,908 B] 2023-10-08T06:07:29.177 INFO:teuthology.orchestra.run.smithi032.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl-dev amd64 1.1.1f-1ubuntu2.19 [1,584 kB] 2023-10-08T06:07:29.190 INFO:teuthology.orchestra.run.smithi032.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal/main amd64 libteamdctl0 amd64 1.30-1 [11.8 kB] 2023-10-08T06:07:29.190 INFO:teuthology.orchestra.run.smithi032.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 modemmanager amd64 1.18.6-1~ubuntu20.04.1 [895 kB] 2023-10-08T06:07:29.198 INFO:teuthology.orchestra.run.smithi032.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 wpasupplicant amd64 2:2.9-1ubuntu4.3 [1,183 kB] 2023-10-08T06:07:29.208 INFO:teuthology.orchestra.run.smithi032.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 network-manager amd64 1.22.10-1ubuntu2.3 [1,855 kB] 2023-10-08T06:07:29.224 INFO:teuthology.orchestra.run.smithi032.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 ppp amd64 2.4.7-2+4.1ubuntu5.1 [328 kB] 2023-10-08T06:07:29.227 INFO:teuthology.orchestra.run.smithi032.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 pptp-linux amd64 1.10.0-1build1 [42.0 kB] 2023-10-08T06:07:29.227 INFO:teuthology.orchestra.run.smithi032.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 network-manager-pptp amd64 1.2.8-2 [30.1 kB] 2023-10-08T06:07:29.227 INFO:teuthology.orchestra.run.smithi032.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-client-common all 214ubuntu0.1 [28.2 kB] 2023-10-08T06:07:29.228 INFO:teuthology.orchestra.run.smithi032.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-client-12 amd64 12.16-0ubuntu0.20.04.1 [1,053 kB] 2023-10-08T06:07:29.236 INFO:teuthology.orchestra.run.smithi032.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-common all 214ubuntu0.1 [169 kB] 2023-10-08T06:07:29.238 INFO:teuthology.orchestra.run.smithi032.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-12 amd64 12.16-0ubuntu0.20.04.1 [13.5 MB] 2023-10-08T06:07:29.256 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-10-08T06:07:29.256 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-10-08T06:07:29.346 INFO:teuthology.orchestra.run.smithi032.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql all 12+214ubuntu0.1 [3,924 B] 2023-10-08T06:07:29.346 INFO:teuthology.orchestra.run.smithi032.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-client all 12+214ubuntu0.1 [3,940 B] 2023-10-08T06:07:29.414 INFO:teuthology.orchestra.run.smithi032.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-contrib all 12+214ubuntu0.1 [3,932 B] 2023-10-08T06:07:29.415 INFO:teuthology.orchestra.run.smithi032.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch-data all 20191128-3 [32.3 kB] 2023-10-08T06:07:29.415 INFO:teuthology.orchestra.run.smithi032.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch amd64 2.5.2+repack0-2ubuntu3 [53.1 kB] 2023-10-08T06:07:29.707 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up ceph-mgr-k8sevents (18.0.0-6609-g9725b08f-1focal) ... 2023-10-08T06:07:29.817 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up ceph-mgr-diskprediction-local (18.0.0-6609-g9725b08f-1focal) ... 2023-10-08T06:07:29.823 INFO:teuthology.orchestra.run.smithi032.stdout:Preconfiguring packages ... 2023-10-08T06:07:29.934 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up ceph-mon (18.0.0-6609-g9725b08f-1focal) ... 2023-10-08T06:07:30.023 INFO:teuthology.orchestra.run.smithi032.stdout:Fetched 25.3 MB in 0s (52.2 MB/s) 2023-10-08T06:07:30.252 INFO:teuthology.orchestra.run.smithi032.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 152792 files and directories currently installed.) 2023-10-08T06:07:30.257 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../util-linux_2.34-0.1ubuntu9.4_amd64.deb ... 2023-10-08T06:07:30.343 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-10-08T06:07:30.343 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-10-08T06:07:30.412 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking util-linux (2.34-0.1ubuntu9.4) over (2.34-0.1ubuntu9.3) ... 2023-10-08T06:07:30.812 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up ceph-mgr-cephadm (18.0.0-6609-g9725b08f-1focal) ... 2023-10-08T06:07:30.980 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up ceph (18.0.0-6609-g9725b08f-1focal) ... 2023-10-08T06:07:31.106 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up ceph-mgr-dashboard (18.0.0-6609-g9725b08f-1focal) ... 2023-10-08T06:07:31.240 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up ceph-volume (18.0.0-6609-g9725b08f-1focal) ... 2023-10-08T06:07:31.576 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up util-linux (2.34-0.1ubuntu9.4) ... 2023-10-08T06:07:31.643 INFO:teuthology.orchestra.run.smithi040.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2023-10-08T06:07:31.820 INFO:teuthology.orchestra.run.smithi040.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2023-10-08T06:07:32.096 INFO:teuthology.orchestra.run.smithi040.stdout:Processing triggers for man-db (2.9.1-1) ... 2023-10-08T06:07:33.014 INFO:teuthology.orchestra.run.smithi032.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 152792 files and directories currently installed.) 2023-10-08T06:07:33.019 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../uuid-dev_2.34-0.1ubuntu9.4_amd64.deb ... 2023-10-08T06:07:33.149 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking uuid-dev:amd64 (2.34-0.1ubuntu9.4) over (2.34-0.1ubuntu9.3) ... 2023-10-08T06:07:33.565 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../libuuid1_2.34-0.1ubuntu9.4_amd64.deb ... 2023-10-08T06:07:33.831 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking libuuid1:amd64 (2.34-0.1ubuntu9.4) over (2.34-0.1ubuntu9.3) ... 2023-10-08T06:07:34.156 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up libuuid1:amd64 (2.34-0.1ubuntu9.4) ... 2023-10-08T06:07:34.601 INFO:teuthology.orchestra.run.smithi032.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 152792 files and directories currently installed.) 2023-10-08T06:07:34.606 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../00-libdw1_0.176-1.1ubuntu0.1_amd64.deb ... 2023-10-08T06:07:34.755 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking libdw1:amd64 (0.176-1.1ubuntu0.1) over (0.176-1.1build1) ... 2023-10-08T06:07:35.132 INFO:teuthology.orchestra.run.smithi040.stdout:Processing triggers for fontconfig (2.13.1-2ubuntu3) ... 2023-10-08T06:07:35.210 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../01-libelf1_0.176-1.1ubuntu0.1_amd64.deb ... 2023-10-08T06:07:35.343 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking libelf1:amd64 (0.176-1.1ubuntu0.1) over (0.176-1.1build1) ... 2023-10-08T06:07:35.841 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../02-libssl1.1_1.1.1f-1ubuntu2.19_amd64.deb ... 2023-10-08T06:07:35.973 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking libssl1.1:amd64 (1.1.1f-1ubuntu2.19) over (1.1.1f-1ubuntu2.16) ... 2023-10-08T06:07:36.078 INFO:teuthology.orchestra.run.smithi040.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-10-08T06:07:36.080 DEBUG:teuthology.orchestra.run.smithi040:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2023-10-08T06:07:36.154 INFO:teuthology.orchestra.run.smithi040.stdout:Reading package lists... 2023-10-08T06:07:36.362 INFO:teuthology.orchestra.run.smithi040.stdout:Building dependency tree... 2023-10-08T06:07:36.363 INFO:teuthology.orchestra.run.smithi040.stdout:Reading state information... 2023-10-08T06:07:36.452 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package liblzo2-2:amd64. 2023-10-08T06:07:36.472 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../03-liblzo2-2_2.10-2_amd64.deb ... 2023-10-08T06:07:36.510 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking liblzo2-2:amd64 (2.10-2) ... 2023-10-08T06:07:36.562 INFO:teuthology.orchestra.run.smithi040.stdout:bison is already the newest version (2:3.5.1+dfsg-1). 2023-10-08T06:07:36.562 INFO:teuthology.orchestra.run.smithi040.stdout:flex is already the newest version (2.6.4-6.2). 2023-10-08T06:07:36.563 INFO:teuthology.orchestra.run.smithi040.stdout:iproute2 is already the newest version (5.5.0-1ubuntu1). 2023-10-08T06:07:36.563 INFO:teuthology.orchestra.run.smithi040.stdout:libtool-bin is already the newest version (2.4.6-14). 2023-10-08T06:07:36.563 INFO:teuthology.orchestra.run.smithi040.stdout:xfslibs-dev is already the newest version (5.3.0-1ubuntu2). 2023-10-08T06:07:36.563 INFO:teuthology.orchestra.run.smithi040.stdout:The following packages were automatically installed and are no longer required: 2023-10-08T06:07:36.563 INFO:teuthology.orchestra.run.smithi040.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2023-10-08T06:07:36.564 INFO:teuthology.orchestra.run.smithi040.stdout:Use 'sudo apt autoremove' to remove them. 2023-10-08T06:07:36.564 INFO:teuthology.orchestra.run.smithi040.stdout:The following additional packages will be installed: 2023-10-08T06:07:36.564 INFO:teuthology.orchestra.run.smithi040.stdout: libbluetooth3 libdw1 libelf1 liblzo2-2 libmbim-glib4 libmbim-proxy 2023-10-08T06:07:36.564 INFO:teuthology.orchestra.run.smithi040.stdout: libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl1.1 2023-10-08T06:07:36.564 INFO:teuthology.orchestra.run.smithi040.stdout: libteamdctl0 libuuid1 modemmanager network-manager-pptp postgresql-12 2023-10-08T06:07:36.565 INFO:teuthology.orchestra.run.smithi040.stdout: postgresql-client-12 postgresql-client-common ppp pptp-linux usb-modeswitch 2023-10-08T06:07:36.565 INFO:teuthology.orchestra.run.smithi040.stdout: usb-modeswitch-data wpasupplicant 2023-10-08T06:07:36.565 INFO:teuthology.orchestra.run.smithi040.stdout:Suggested packages: 2023-10-08T06:07:36.565 INFO:teuthology.orchestra.run.smithi040.stdout: indent-doc libssl-doc avahi-autoipd libteam-utils postgresql-doc 2023-10-08T06:07:36.565 INFO:teuthology.orchestra.run.smithi040.stdout: postgresql-doc-12 libjson-perl comgt wvdial util-linux-locales wpagui 2023-10-08T06:07:36.566 INFO:teuthology.orchestra.run.smithi040.stdout: libengine-pkcs11-openssl 2023-10-08T06:07:36.625 INFO:teuthology.orchestra.run.smithi040.stdout:The following NEW packages will be installed: 2023-10-08T06:07:36.627 INFO:teuthology.orchestra.run.smithi040.stdout: dump indent libaio-dev libbluetooth3 libelf-dev liblzo2-2 libmbim-glib4 2023-10-08T06:07:36.627 INFO:teuthology.orchestra.run.smithi040.stdout: libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy 2023-10-08T06:07:36.627 INFO:teuthology.orchestra.run.smithi040.stdout: libssl-dev libteamdctl0 modemmanager network-manager network-manager-pptp 2023-10-08T06:07:36.627 INFO:teuthology.orchestra.run.smithi040.stdout: postgresql postgresql-12 postgresql-client postgresql-client-12 2023-10-08T06:07:36.628 INFO:teuthology.orchestra.run.smithi040.stdout: postgresql-client-common postgresql-common postgresql-contrib ppp pptp-linux 2023-10-08T06:07:36.628 INFO:teuthology.orchestra.run.smithi040.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2023-10-08T06:07:36.628 INFO:teuthology.orchestra.run.smithi040.stdout:The following packages will be upgraded: 2023-10-08T06:07:36.628 INFO:teuthology.orchestra.run.smithi040.stdout: libdw1 libelf1 libssl1.1 libuuid1 util-linux uuid-dev 2023-10-08T06:07:36.813 INFO:teuthology.orchestra.run.smithi040.stdout:6 upgraded, 31 newly installed, 0 to remove and 247 not upgraded. 2023-10-08T06:07:36.813 INFO:teuthology.orchestra.run.smithi040.stdout:Need to get 25.3 MB of archives. 2023-10-08T06:07:36.813 INFO:teuthology.orchestra.run.smithi040.stdout:After this operation, 79.9 MB of additional disk space will be used. 2023-10-08T06:07:36.813 INFO:teuthology.orchestra.run.smithi040.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 util-linux amd64 2.34-0.1ubuntu9.4 [1,021 kB] 2023-10-08T06:07:36.879 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package dump. 2023-10-08T06:07:36.897 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../04-dump_0.4b46-6_amd64.deb ... 2023-10-08T06:07:36.937 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking dump (0.4b46-6) ... 2023-10-08T06:07:37.216 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package indent. 2023-10-08T06:07:37.235 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../05-indent_2.2.12-1ubuntu0.20.04.1_amd64.deb ... 2023-10-08T06:07:37.274 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking indent (2.2.12-1ubuntu0.20.04.1) ... 2023-10-08T06:07:37.433 INFO:teuthology.orchestra.run.smithi040.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 uuid-dev amd64 2.34-0.1ubuntu9.4 [33.6 kB] 2023-10-08T06:07:37.435 INFO:teuthology.orchestra.run.smithi040.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libuuid1 amd64 2.34-0.1ubuntu9.4 [20.0 kB] 2023-10-08T06:07:37.436 INFO:teuthology.orchestra.run.smithi040.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libdw1 amd64 0.176-1.1ubuntu0.1 [226 kB] 2023-10-08T06:07:37.448 INFO:teuthology.orchestra.run.smithi040.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libelf1 amd64 0.176-1.1ubuntu0.1 [44.2 kB] 2023-10-08T06:07:37.451 INFO:teuthology.orchestra.run.smithi040.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl1.1 amd64 1.1.1f-1ubuntu2.19 [1,321 kB] 2023-10-08T06:07:37.548 INFO:teuthology.orchestra.run.smithi040.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 liblzo2-2 amd64 2.10-2 [50.8 kB] 2023-10-08T06:07:37.551 INFO:teuthology.orchestra.run.smithi040.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/universe amd64 dump amd64 0.4b46-6 [130 kB] 2023-10-08T06:07:37.558 INFO:teuthology.orchestra.run.smithi040.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 indent amd64 2.2.12-1ubuntu0.20.04.1 [86.6 kB] 2023-10-08T06:07:37.563 INFO:teuthology.orchestra.run.smithi040.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/main amd64 libaio-dev amd64 0.3.112-5 [13.7 kB] 2023-10-08T06:07:37.563 INFO:teuthology.orchestra.run.smithi040.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libbluetooth3 amd64 5.53-0ubuntu3.6 [60.6 kB] 2023-10-08T06:07:37.577 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package libaio-dev:amd64. 2023-10-08T06:07:37.594 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../06-libaio-dev_0.3.112-5_amd64.deb ... 2023-10-08T06:07:37.626 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking libaio-dev:amd64 (0.3.112-5) ... 2023-10-08T06:07:37.730 INFO:teuthology.orchestra.run.smithi040.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libelf-dev amd64 0.176-1.1ubuntu0.1 [57.1 kB] 2023-10-08T06:07:37.955 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package libbluetooth3:amd64. 2023-10-08T06:07:37.973 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../07-libbluetooth3_5.53-0ubuntu3.6_amd64.deb ... 2023-10-08T06:07:38.001 INFO:teuthology.orchestra.run.smithi040.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-glib4 amd64 1.26.2-1~ubuntu20.04.1 [123 kB] 2023-10-08T06:07:38.013 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking libbluetooth3:amd64 (5.53-0ubuntu3.6) ... 2023-10-08T06:07:38.128 INFO:teuthology.orchestra.run.smithi040.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-proxy amd64 1.26.2-1~ubuntu20.04.1 [6,012 B] 2023-10-08T06:07:38.133 INFO:teuthology.orchestra.run.smithi040.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmm-glib0 amd64 1.18.6-1~ubuntu20.04.1 [203 kB] 2023-10-08T06:07:38.228 INFO:teuthology.orchestra.run.smithi040.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal/main amd64 libndp0 amd64 1.7-0ubuntu1 [10.9 kB] 2023-10-08T06:07:38.232 INFO:teuthology.orchestra.run.smithi040.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libnm0 amd64 1.22.10-1ubuntu2.3 [370 kB] 2023-10-08T06:07:38.282 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package libelf-dev:amd64. 2023-10-08T06:07:38.300 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../08-libelf-dev_0.176-1.1ubuntu0.1_amd64.deb ... 2023-10-08T06:07:38.315 INFO:teuthology.orchestra.run.smithi040.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpq5 amd64 12.16-0ubuntu0.20.04.1 [115 kB] 2023-10-08T06:07:38.332 INFO:teuthology.orchestra.run.smithi040.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-glib5 amd64 1.30.4-1~ubuntu20.04.1 [642 kB] 2023-10-08T06:07:38.341 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking libelf-dev:amd64 (0.176-1.1ubuntu0.1) ... 2023-10-08T06:07:38.398 INFO:teuthology.orchestra.run.smithi040.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-proxy amd64 1.30.4-1~ubuntu20.04.1 [5,908 B] 2023-10-08T06:07:38.399 INFO:teuthology.orchestra.run.smithi040.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl-dev amd64 1.1.1f-1ubuntu2.19 [1,584 kB] 2023-10-08T06:07:38.483 INFO:teuthology.orchestra.run.smithi040.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal/main amd64 libteamdctl0 amd64 1.30-1 [11.8 kB] 2023-10-08T06:07:38.647 INFO:teuthology.orchestra.run.smithi040.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 modemmanager amd64 1.18.6-1~ubuntu20.04.1 [895 kB] 2023-10-08T06:07:38.677 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2023-10-08T06:07:38.696 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../09-libmbim-glib4_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2023-10-08T06:07:38.930 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2023-10-08T06:07:39.254 INFO:teuthology.orchestra.run.smithi040.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 wpasupplicant amd64 2:2.9-1ubuntu4.3 [1,183 kB] 2023-10-08T06:07:39.354 INFO:teuthology.orchestra.run.smithi040.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 network-manager amd64 1.22.10-1ubuntu2.3 [1,855 kB] 2023-10-08T06:07:39.443 INFO:teuthology.orchestra.run.smithi040.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 ppp amd64 2.4.7-2+4.1ubuntu5.1 [328 kB] 2023-10-08T06:07:39.453 INFO:teuthology.orchestra.run.smithi040.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 pptp-linux amd64 1.10.0-1build1 [42.0 kB] 2023-10-08T06:07:39.453 INFO:teuthology.orchestra.run.smithi040.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 network-manager-pptp amd64 1.2.8-2 [30.1 kB] 2023-10-08T06:07:39.454 INFO:teuthology.orchestra.run.smithi040.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-client-common all 214ubuntu0.1 [28.2 kB] 2023-10-08T06:07:39.455 INFO:teuthology.orchestra.run.smithi040.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-client-12 amd64 12.16-0ubuntu0.20.04.1 [1,053 kB] 2023-10-08T06:07:39.487 INFO:teuthology.orchestra.run.smithi040.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-common all 214ubuntu0.1 [169 kB] 2023-10-08T06:07:39.492 INFO:teuthology.orchestra.run.smithi040.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-12 amd64 12.16-0ubuntu0.20.04.1 [13.5 MB] 2023-10-08T06:07:39.864 INFO:teuthology.orchestra.run.smithi040.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql all 12+214ubuntu0.1 [3,924 B] 2023-10-08T06:07:40.028 INFO:teuthology.orchestra.run.smithi040.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-client all 12+214ubuntu0.1 [3,940 B] 2023-10-08T06:07:40.111 INFO:teuthology.orchestra.run.smithi040.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-contrib all 12+214ubuntu0.1 [3,932 B] 2023-10-08T06:07:40.112 INFO:teuthology.orchestra.run.smithi040.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch-data all 20191128-3 [32.3 kB] 2023-10-08T06:07:40.224 INFO:teuthology.orchestra.run.smithi040.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch amd64 2.5.2+repack0-2ubuntu3 [53.1 kB] 2023-10-08T06:07:40.301 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package libmbim-proxy. 2023-10-08T06:07:40.320 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../10-libmbim-proxy_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2023-10-08T06:07:40.493 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2023-10-08T06:07:40.722 INFO:teuthology.orchestra.run.smithi040.stdout:Preconfiguring packages ... 2023-10-08T06:07:40.745 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package libmm-glib0:amd64. 2023-10-08T06:07:40.764 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../11-libmm-glib0_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2023-10-08T06:07:40.795 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2023-10-08T06:07:40.909 INFO:teuthology.orchestra.run.smithi040.stdout:Fetched 25.3 MB in 4s (6,881 kB/s) 2023-10-08T06:07:41.157 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package libndp0:amd64. 2023-10-08T06:07:41.173 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../12-libndp0_1.7-0ubuntu1_amd64.deb ... 2023-10-08T06:07:41.215 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking libndp0:amd64 (1.7-0ubuntu1) ... 2023-10-08T06:07:41.543 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package libnm0:amd64. 2023-10-08T06:07:41.563 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../13-libnm0_1.22.10-1ubuntu2.3_amd64.deb ... 2023-10-08T06:07:41.601 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking libnm0:amd64 (1.22.10-1ubuntu2.3) ... 2023-10-08T06:07:41.815 INFO:teuthology.orchestra.run.smithi040.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 152792 files and directories currently installed.) 2023-10-08T06:07:41.820 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../util-linux_2.34-0.1ubuntu9.4_amd64.deb ... 2023-10-08T06:07:41.937 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package libpq5:amd64. 2023-10-08T06:07:41.956 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../14-libpq5_12.16-0ubuntu0.20.04.1_amd64.deb ... 2023-10-08T06:07:41.987 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking libpq5:amd64 (12.16-0ubuntu0.20.04.1) ... 2023-10-08T06:07:42.306 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2023-10-08T06:07:42.320 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking util-linux (2.34-0.1ubuntu9.4) over (2.34-0.1ubuntu9.3) ... 2023-10-08T06:07:42.327 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../15-libqmi-glib5_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2023-10-08T06:07:42.383 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2023-10-08T06:07:42.717 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package libqmi-proxy. 2023-10-08T06:07:42.738 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../16-libqmi-proxy_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2023-10-08T06:07:42.775 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2023-10-08T06:07:43.028 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package libssl-dev:amd64. 2023-10-08T06:07:43.045 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../17-libssl-dev_1.1.1f-1ubuntu2.19_amd64.deb ... 2023-10-08T06:07:43.086 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking libssl-dev:amd64 (1.1.1f-1ubuntu2.19) ... 2023-10-08T06:07:43.543 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up util-linux (2.34-0.1ubuntu9.4) ... 2023-10-08T06:07:43.623 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package libteamdctl0:amd64. 2023-10-08T06:07:43.641 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../18-libteamdctl0_1.30-1_amd64.deb ... 2023-10-08T06:07:43.681 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking libteamdctl0:amd64 (1.30-1) ... 2023-10-08T06:07:44.068 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package modemmanager. 2023-10-08T06:07:44.087 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../19-modemmanager_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2023-10-08T06:07:44.137 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking modemmanager (1.18.6-1~ubuntu20.04.1) ... 2023-10-08T06:07:44.766 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package wpasupplicant. 2023-10-08T06:07:44.787 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../20-wpasupplicant_2%3a2.9-1ubuntu4.3_amd64.deb ... 2023-10-08T06:07:44.832 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking wpasupplicant (2:2.9-1ubuntu4.3) ... 2023-10-08T06:07:44.989 INFO:teuthology.orchestra.run.smithi040.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 152792 files and directories currently installed.) 2023-10-08T06:07:44.994 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../uuid-dev_2.34-0.1ubuntu9.4_amd64.deb ... 2023-10-08T06:07:45.151 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking uuid-dev:amd64 (2.34-0.1ubuntu9.4) over (2.34-0.1ubuntu9.3) ... 2023-10-08T06:07:45.567 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../libuuid1_2.34-0.1ubuntu9.4_amd64.deb ... 2023-10-08T06:07:45.589 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package network-manager. 2023-10-08T06:07:45.606 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../21-network-manager_1.22.10-1ubuntu2.3_amd64.deb ... 2023-10-08T06:07:45.672 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking network-manager (1.22.10-1ubuntu2.3) ... 2023-10-08T06:07:45.774 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking libuuid1:amd64 (2.34-0.1ubuntu9.4) over (2.34-0.1ubuntu9.3) ... 2023-10-08T06:07:46.135 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up libuuid1:amd64 (2.34-0.1ubuntu9.4) ... 2023-10-08T06:07:46.438 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package ppp. 2023-10-08T06:07:46.454 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../22-ppp_2.4.7-2+4.1ubuntu5.1_amd64.deb ... 2023-10-08T06:07:46.604 INFO:teuthology.orchestra.run.smithi040.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 152792 files and directories currently installed.) 2023-10-08T06:07:46.608 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../00-libdw1_0.176-1.1ubuntu0.1_amd64.deb ... 2023-10-08T06:07:46.738 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking ppp (2.4.7-2+4.1ubuntu5.1) ... 2023-10-08T06:07:46.783 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking libdw1:amd64 (0.176-1.1ubuntu0.1) over (0.176-1.1build1) ... 2023-10-08T06:07:47.076 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package pptp-linux. 2023-10-08T06:07:47.096 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../23-pptp-linux_1.10.0-1build1_amd64.deb ... 2023-10-08T06:07:47.134 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking pptp-linux (1.10.0-1build1) ... 2023-10-08T06:07:47.263 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../01-libelf1_0.176-1.1ubuntu0.1_amd64.deb ... 2023-10-08T06:07:47.512 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package network-manager-pptp. 2023-10-08T06:07:47.513 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking libelf1:amd64 (0.176-1.1ubuntu0.1) over (0.176-1.1build1) ... 2023-10-08T06:07:47.532 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../24-network-manager-pptp_1.2.8-2_amd64.deb ... 2023-10-08T06:07:47.588 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking network-manager-pptp (1.2.8-2) ... 2023-10-08T06:07:47.865 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package postgresql-client-common. 2023-10-08T06:07:47.883 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../25-postgresql-client-common_214ubuntu0.1_all.deb ... 2023-10-08T06:07:47.915 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking postgresql-client-common (214ubuntu0.1) ... 2023-10-08T06:07:48.253 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package postgresql-client-12. 2023-10-08T06:07:48.272 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../26-postgresql-client-12_12.16-0ubuntu0.20.04.1_amd64.deb ... 2023-10-08T06:07:48.311 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking postgresql-client-12 (12.16-0ubuntu0.20.04.1) ... 2023-10-08T06:07:48.487 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../02-libssl1.1_1.1.1f-1ubuntu2.19_amd64.deb ... 2023-10-08T06:07:48.619 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking libssl1.1:amd64 (1.1.1f-1ubuntu2.19) over (1.1.1f-1ubuntu2.16) ... 2023-10-08T06:07:48.824 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package postgresql-common. 2023-10-08T06:07:48.842 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../27-postgresql-common_214ubuntu0.1_all.deb ... 2023-10-08T06:07:48.899 INFO:teuthology.orchestra.run.smithi032.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2023-10-08T06:07:48.926 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking postgresql-common (214ubuntu0.1) ... 2023-10-08T06:07:49.123 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package liblzo2-2:amd64. 2023-10-08T06:07:49.143 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../03-liblzo2-2_2.10-2_amd64.deb ... 2023-10-08T06:07:49.173 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking liblzo2-2:amd64 (2.10-2) ... 2023-10-08T06:07:49.414 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package postgresql-12. 2023-10-08T06:07:49.431 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../28-postgresql-12_12.16-0ubuntu0.20.04.1_amd64.deb ... 2023-10-08T06:07:49.467 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking postgresql-12 (12.16-0ubuntu0.20.04.1) ... 2023-10-08T06:07:49.527 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package dump. 2023-10-08T06:07:49.544 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../04-dump_0.4b46-6_amd64.deb ... 2023-10-08T06:07:49.585 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking dump (0.4b46-6) ... 2023-10-08T06:07:49.922 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package indent. 2023-10-08T06:07:49.941 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../05-indent_2.2.12-1ubuntu0.20.04.1_amd64.deb ... 2023-10-08T06:07:49.980 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking indent (2.2.12-1ubuntu0.20.04.1) ... 2023-10-08T06:07:50.325 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package libaio-dev:amd64. 2023-10-08T06:07:50.343 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../06-libaio-dev_0.3.112-5_amd64.deb ... 2023-10-08T06:07:50.383 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking libaio-dev:amd64 (0.3.112-5) ... 2023-10-08T06:07:50.703 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package libbluetooth3:amd64. 2023-10-08T06:07:50.720 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../07-libbluetooth3_5.53-0ubuntu3.6_amd64.deb ... 2023-10-08T06:07:50.795 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking libbluetooth3:amd64 (5.53-0ubuntu3.6) ... 2023-10-08T06:07:51.080 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package libelf-dev:amd64. 2023-10-08T06:07:51.098 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../08-libelf-dev_0.176-1.1ubuntu0.1_amd64.deb ... 2023-10-08T06:07:51.139 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking libelf-dev:amd64 (0.176-1.1ubuntu0.1) ... 2023-10-08T06:07:51.525 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2023-10-08T06:07:51.543 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../09-libmbim-glib4_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2023-10-08T06:07:51.583 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2023-10-08T06:07:51.750 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package postgresql. 2023-10-08T06:07:51.769 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../29-postgresql_12+214ubuntu0.1_all.deb ... 2023-10-08T06:07:51.808 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking postgresql (12+214ubuntu0.1) ... 2023-10-08T06:07:51.836 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package libmbim-proxy. 2023-10-08T06:07:51.853 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../10-libmbim-proxy_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2023-10-08T06:07:51.886 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2023-10-08T06:07:52.036 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package postgresql-client. 2023-10-08T06:07:52.054 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../30-postgresql-client_12+214ubuntu0.1_all.deb ... 2023-10-08T06:07:52.114 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking postgresql-client (12+214ubuntu0.1) ... 2023-10-08T06:07:52.256 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package libmm-glib0:amd64. 2023-10-08T06:07:52.277 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../11-libmm-glib0_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2023-10-08T06:07:52.314 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2023-10-08T06:07:52.363 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package postgresql-contrib. 2023-10-08T06:07:52.380 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../31-postgresql-contrib_12+214ubuntu0.1_all.deb ... 2023-10-08T06:07:52.421 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking postgresql-contrib (12+214ubuntu0.1) ... 2023-10-08T06:07:52.690 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package usb-modeswitch-data. 2023-10-08T06:07:52.707 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../32-usb-modeswitch-data_20191128-3_all.deb ... 2023-10-08T06:07:52.748 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking usb-modeswitch-data (20191128-3) ... 2023-10-08T06:07:52.792 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package libndp0:amd64. 2023-10-08T06:07:52.813 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../12-libndp0_1.7-0ubuntu1_amd64.deb ... 2023-10-08T06:07:52.850 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking libndp0:amd64 (1.7-0ubuntu1) ... 2023-10-08T06:07:53.143 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package usb-modeswitch. 2023-10-08T06:07:53.163 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../33-usb-modeswitch_2.5.2+repack0-2ubuntu3_amd64.deb ... 2023-10-08T06:07:53.212 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2023-10-08T06:07:53.305 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package libnm0:amd64. 2023-10-08T06:07:53.326 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../13-libnm0_1.22.10-1ubuntu2.3_amd64.deb ... 2023-10-08T06:07:53.396 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking libnm0:amd64 (1.22.10-1ubuntu2.3) ... 2023-10-08T06:07:53.521 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up postgresql-client-common (214ubuntu0.1) ... 2023-10-08T06:07:53.732 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up libssl1.1:amd64 (1.1.1f-1ubuntu2.19) ... 2023-10-08T06:07:53.800 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package libpq5:amd64. 2023-10-08T06:07:53.821 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../14-libpq5_12.16-0ubuntu0.20.04.1_amd64.deb ... 2023-10-08T06:07:53.858 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking libpq5:amd64 (12.16-0ubuntu0.20.04.1) ... 2023-10-08T06:07:54.100 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up libpq5:amd64 (12.16-0ubuntu0.20.04.1) ... 2023-10-08T06:07:54.226 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up liblzo2-2:amd64 (2.10-2) ... 2023-10-08T06:07:54.244 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2023-10-08T06:07:54.261 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../15-libqmi-glib5_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2023-10-08T06:07:54.302 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2023-10-08T06:07:54.327 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up libaio-dev:amd64 (0.3.112-5) ... 2023-10-08T06:07:54.427 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up wpasupplicant (2:2.9-1ubuntu4.3) ... 2023-10-08T06:07:54.622 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package libqmi-proxy. 2023-10-08T06:07:54.639 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../16-libqmi-proxy_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2023-10-08T06:07:54.680 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2023-10-08T06:07:54.813 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2023-10-08T06:07:54.813 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2023-10-08T06:07:54.958 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package libssl-dev:amd64. 2023-10-08T06:07:54.975 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../17-libssl-dev_1.1.1f-1ubuntu2.19_amd64.deb ... 2023-10-08T06:07:55.016 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking libssl-dev:amd64 (1.1.1f-1ubuntu2.19) ... 2023-10-08T06:07:55.314 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up postgresql-client-12 (12.16-0ubuntu0.20.04.1) ... 2023-10-08T06:07:55.520 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package libteamdctl0:amd64. 2023-10-08T06:07:55.536 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../18-libteamdctl0_1.30-1_amd64.deb ... 2023-10-08T06:07:55.578 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking libteamdctl0:amd64 (1.30-1) ... 2023-10-08T06:07:55.981 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package modemmanager. 2023-10-08T06:07:55.999 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../19-modemmanager_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2023-10-08T06:07:56.083 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking modemmanager (1.18.6-1~ubuntu20.04.1) ... 2023-10-08T06:07:56.202 INFO:teuthology.orchestra.run.smithi032.stdout:update-alternatives: using /usr/share/postgresql/12/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2023-10-08T06:07:56.295 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up uuid-dev:amd64 (2.34-0.1ubuntu9.4) ... 2023-10-08T06:07:56.429 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up libteamdctl0:amd64 (1.30-1) ... 2023-10-08T06:07:56.563 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up postgresql-common (214ubuntu0.1) ... 2023-10-08T06:07:56.754 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package wpasupplicant. 2023-10-08T06:07:56.772 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../20-wpasupplicant_2%3a2.9-1ubuntu4.3_amd64.deb ... 2023-10-08T06:07:56.812 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking wpasupplicant (2:2.9-1ubuntu4.3) ... 2023-10-08T06:07:57.309 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package network-manager. 2023-10-08T06:07:57.327 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../21-network-manager_1.22.10-1ubuntu2.3_amd64.deb ... 2023-10-08T06:07:57.392 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking network-manager (1.22.10-1ubuntu2.3) ... 2023-10-08T06:07:57.694 INFO:teuthology.orchestra.run.smithi032.stdout:Adding user postgres to group ssl-cert 2023-10-08T06:07:57.945 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:07:57.945 INFO:teuthology.orchestra.run.smithi032.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2023-10-08T06:07:58.191 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package ppp. 2023-10-08T06:07:58.208 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../22-ppp_2.4.7-2+4.1ubuntu5.1_amd64.deb ... 2023-10-08T06:07:58.221 INFO:teuthology.orchestra.run.smithi032.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2023-10-08T06:07:58.222 INFO:teuthology.orchestra.run.smithi032.stdout:Removing obsolete dictionary files: 2023-10-08T06:07:58.468 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking ppp (2.4.7-2+4.1ubuntu5.1) ... 2023-10-08T06:07:58.559 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2023-10-08T06:07:58.847 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package pptp-linux. 2023-10-08T06:07:58.863 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../23-pptp-linux_1.10.0-1build1_amd64.deb ... 2023-10-08T06:07:58.905 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking pptp-linux (1.10.0-1build1) ... 2023-10-08T06:07:59.267 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package network-manager-pptp. 2023-10-08T06:07:59.286 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../24-network-manager-pptp_1.2.8-2_amd64.deb ... 2023-10-08T06:07:59.332 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up libssl-dev:amd64 (1.1.1f-1ubuntu2.19) ... 2023-10-08T06:07:59.360 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking network-manager-pptp (1.2.8-2) ... 2023-10-08T06:07:59.458 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up usb-modeswitch-data (20191128-3) ... 2023-10-08T06:07:59.584 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up libnm0:amd64 (1.22.10-1ubuntu2.3) ... 2023-10-08T06:07:59.678 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package postgresql-client-common. 2023-10-08T06:07:59.697 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../25-postgresql-client-common_214ubuntu0.1_all.deb ... 2023-10-08T06:07:59.710 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up ppp (2.4.7-2+4.1ubuntu5.1) ... 2023-10-08T06:07:59.736 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking postgresql-client-common (214ubuntu0.1) ... 2023-10-08T06:08:00.082 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package postgresql-client-12. 2023-10-08T06:08:00.102 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../26-postgresql-client-12_12.16-0ubuntu0.20.04.1_amd64.deb ... 2023-10-08T06:08:00.140 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking postgresql-client-12 (12.16-0ubuntu0.20.04.1) ... 2023-10-08T06:08:00.706 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/pppd-dns.service -> /lib/systemd/system/pppd-dns.service. 2023-10-08T06:08:00.804 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package postgresql-common. 2023-10-08T06:08:00.825 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../27-postgresql-common_214ubuntu0.1_all.deb ... 2023-10-08T06:08:00.886 INFO:teuthology.orchestra.run.smithi040.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2023-10-08T06:08:00.914 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking postgresql-common (214ubuntu0.1) ... 2023-10-08T06:08:00.949 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up dump (0.4b46-6) ... 2023-10-08T06:08:01.046 INFO:teuthology.orchestra.run.smithi032.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2023-10-08T06:08:01.109 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2023-10-08T06:08:01.235 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up libbluetooth3:amd64 (5.53-0ubuntu3.6) ... 2023-10-08T06:08:01.370 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up indent (2.2.12-1ubuntu0.20.04.1) ... 2023-10-08T06:08:01.428 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package postgresql-12. 2023-10-08T06:08:01.447 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../28-postgresql-12_12.16-0ubuntu0.20.04.1_amd64.deb ... 2023-10-08T06:08:01.489 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking postgresql-12 (12.16-0ubuntu0.20.04.1) ... 2023-10-08T06:08:01.495 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2023-10-08T06:08:01.663 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up libndp0:amd64 (1.7-0ubuntu1) ... 2023-10-08T06:08:02.207 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up postgresql-12 (12.16-0ubuntu0.20.04.1) ... 2023-10-08T06:08:02.589 INFO:teuthology.orchestra.run.smithi032.stdout:Creating new PostgreSQL cluster 12/main ... 2023-10-08T06:08:02.607 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/lib/postgresql/12/bin/initdb -D /var/lib/postgresql/12/main --auth-local peer --auth-host md5 2023-10-08T06:08:02.671 INFO:teuthology.orchestra.run.smithi032.stdout:The files belonging to this database system will be owned by user "postgres". 2023-10-08T06:08:02.671 INFO:teuthology.orchestra.run.smithi032.stdout:This user must also own the server process. 2023-10-08T06:08:02.671 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:08:02.671 INFO:teuthology.orchestra.run.smithi032.stdout:The database cluster will be initialized with locale "en_US". 2023-10-08T06:08:02.671 INFO:teuthology.orchestra.run.smithi032.stdout:The default database encoding has accordingly been set to "LATIN1". 2023-10-08T06:08:02.672 INFO:teuthology.orchestra.run.smithi032.stdout:The default text search configuration will be set to "english". 2023-10-08T06:08:02.672 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:08:02.672 INFO:teuthology.orchestra.run.smithi032.stdout:Data page checksums are disabled. 2023-10-08T06:08:02.672 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:08:02.672 INFO:teuthology.orchestra.run.smithi032.stdout:fixing permissions on existing directory /var/lib/postgresql/12/main ... ok 2023-10-08T06:08:02.672 INFO:teuthology.orchestra.run.smithi032.stdout:creating subdirectories ... ok 2023-10-08T06:08:02.673 INFO:teuthology.orchestra.run.smithi032.stdout:selecting dynamic shared memory implementation ... posix 2023-10-08T06:08:02.691 INFO:teuthology.orchestra.run.smithi032.stdout:selecting default max_connections ... 100 2023-10-08T06:08:02.717 INFO:teuthology.orchestra.run.smithi032.stdout:selecting default shared_buffers ... 128MB 2023-10-08T06:08:02.724 INFO:teuthology.orchestra.run.smithi032.stdout:selecting default time zone ... Etc/UTC 2023-10-08T06:08:02.724 INFO:teuthology.orchestra.run.smithi032.stdout:creating configuration files ... ok 2023-10-08T06:08:02.833 INFO:teuthology.orchestra.run.smithi032.stdout:running bootstrap script ... ok 2023-10-08T06:08:03.106 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package postgresql. 2023-10-08T06:08:03.126 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../29-postgresql_12+214ubuntu0.1_all.deb ... 2023-10-08T06:08:03.191 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking postgresql (12+214ubuntu0.1) ... 2023-10-08T06:08:03.382 INFO:teuthology.orchestra.run.smithi032.stdout:performing post-bootstrap initialization ... ok 2023-10-08T06:08:03.441 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package postgresql-client. 2023-10-08T06:08:03.459 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../30-postgresql-client_12+214ubuntu0.1_all.deb ... 2023-10-08T06:08:03.547 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking postgresql-client (12+214ubuntu0.1) ... 2023-10-08T06:08:03.802 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package postgresql-contrib. 2023-10-08T06:08:03.819 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../31-postgresql-contrib_12+214ubuntu0.1_all.deb ... 2023-10-08T06:08:03.885 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking postgresql-contrib (12+214ubuntu0.1) ... 2023-10-08T06:08:04.073 INFO:teuthology.orchestra.run.smithi032.stdout:syncing data to disk ... ok 2023-10-08T06:08:04.073 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:08:04.073 INFO:teuthology.orchestra.run.smithi032.stdout:Success. You can now start the database server using: 2023-10-08T06:08:04.074 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:08:04.074 INFO:teuthology.orchestra.run.smithi032.stdout: pg_ctlcluster 12 main start 2023-10-08T06:08:04.074 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:08:04.129 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package usb-modeswitch-data. 2023-10-08T06:08:04.150 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../32-usb-modeswitch-data_20191128-3_all.deb ... 2023-10-08T06:08:04.221 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking usb-modeswitch-data (20191128-3) ... 2023-10-08T06:08:04.413 INFO:teuthology.orchestra.run.smithi032.stdout:Ver Cluster Port Status Owner Data directory Log file 2023-10-08T06:08:04.413 INFO:teuthology.orchestra.run.smithi032.stdout:12 main 5432 down postgres /var/lib/postgresql/12/main /var/log/postgresql/postgresql-12-main.log 2023-10-08T06:08:04.501 INFO:teuthology.orchestra.run.smithi032.stdout:update-alternatives: using /usr/share/postgresql/12/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2023-10-08T06:08:04.616 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package usb-modeswitch. 2023-10-08T06:08:04.633 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../33-usb-modeswitch_2.5.2+repack0-2ubuntu3_amd64.deb ... 2023-10-08T06:08:04.684 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2023-10-08T06:08:05.011 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up postgresql-client-common (214ubuntu0.1) ... 2023-10-08T06:08:05.255 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up libssl1.1:amd64 (1.1.1f-1ubuntu2.19) ... 2023-10-08T06:08:05.598 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up libpq5:amd64 (12.16-0ubuntu0.20.04.1) ... 2023-10-08T06:08:05.724 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up liblzo2-2:amd64 (2.10-2) ... 2023-10-08T06:08:05.884 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up libaio-dev:amd64 (0.3.112-5) ... 2023-10-08T06:08:06.026 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up wpasupplicant (2:2.9-1ubuntu4.3) ... 2023-10-08T06:08:06.453 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2023-10-08T06:08:06.453 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2023-10-08T06:08:06.930 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up postgresql-client-12 (12.16-0ubuntu0.20.04.1) ... 2023-10-08T06:08:07.513 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up libelf1:amd64 (0.176-1.1ubuntu0.1) ... 2023-10-08T06:08:07.639 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2023-10-08T06:08:07.774 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up pptp-linux (1.10.0-1build1) ... 2023-10-08T06:08:07.835 INFO:teuthology.orchestra.run.smithi040.stdout:update-alternatives: using /usr/share/postgresql/12/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2023-10-08T06:08:07.936 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up uuid-dev:amd64 (2.34-0.1ubuntu9.4) ... 2023-10-08T06:08:07.950 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up libdw1:amd64 (0.176-1.1ubuntu0.1) ... 2023-10-08T06:08:08.061 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up libteamdctl0:amd64 (1.30-1) ... 2023-10-08T06:08:08.076 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up postgresql-client (12+214ubuntu0.1) ... 2023-10-08T06:08:08.210 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up network-manager (1.22.10-1ubuntu2.3) ... 2023-10-08T06:08:08.221 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up postgresql-common (214ubuntu0.1) ... 2023-10-08T06:08:08.944 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:08:08.944 INFO:teuthology.orchestra.run.smithi032.stdout:The following network interfaces were found in /etc/network/interfaces 2023-10-08T06:08:08.944 INFO:teuthology.orchestra.run.smithi032.stdout:which means they are currently configured by ifupdown: 2023-10-08T06:08:08.944 INFO:teuthology.orchestra.run.smithi032.stdout:- ens1f0 2023-10-08T06:08:08.944 INFO:teuthology.orchestra.run.smithi032.stdout:If you want to manage those interfaces with NetworkManager instead 2023-10-08T06:08:08.944 INFO:teuthology.orchestra.run.smithi032.stdout:remove their configuration from /etc/network/interfaces. 2023-10-08T06:08:08.944 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:08:09.110 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2023-10-08T06:08:09.449 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2023-10-08T06:08:09.647 INFO:teuthology.orchestra.run.smithi040.stdout:Adding user postgres to group ssl-cert 2023-10-08T06:08:09.895 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-10-08T06:08:09.895 INFO:teuthology.orchestra.run.smithi040.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2023-10-08T06:08:09.993 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2023-10-08T06:08:10.136 INFO:teuthology.orchestra.run.smithi040.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2023-10-08T06:08:10.136 INFO:teuthology.orchestra.run.smithi040.stdout:Removing obsolete dictionary files: 2023-10-08T06:08:10.464 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2023-10-08T06:08:10.514 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2023-10-08T06:08:10.648 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up network-manager-pptp (1.2.8-2) ... 2023-10-08T06:08:10.791 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up libelf-dev:amd64 (0.176-1.1ubuntu0.1) ... 2023-10-08T06:08:10.892 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up postgresql-contrib (12+214ubuntu0.1) ... 2023-10-08T06:08:10.993 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up postgresql (12+214ubuntu0.1) ... 2023-10-08T06:08:11.102 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2023-10-08T06:08:11.228 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2023-10-08T06:08:11.300 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up libssl-dev:amd64 (1.1.1f-1ubuntu2.19) ... 2023-10-08T06:08:11.413 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up modemmanager (1.18.6-1~ubuntu20.04.1) ... 2023-10-08T06:08:11.426 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up usb-modeswitch-data (20191128-3) ... 2023-10-08T06:08:11.543 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up libnm0:amd64 (1.22.10-1ubuntu2.3) ... 2023-10-08T06:08:11.698 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2023-10-08T06:08:11.698 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2023-10-08T06:08:11.703 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up ppp (2.4.7-2+4.1ubuntu5.1) ... 2023-10-08T06:08:12.280 INFO:teuthology.orchestra.run.smithi032.stdout:Processing triggers for mime-support (3.64ubuntu1) ... 2023-10-08T06:08:12.392 INFO:teuthology.orchestra.run.smithi032.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2023-10-08T06:08:12.509 INFO:teuthology.orchestra.run.smithi032.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2023-10-08T06:08:12.652 INFO:teuthology.orchestra.run.smithi032.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2023-10-08T06:08:12.694 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/pppd-dns.service -> /lib/systemd/system/pppd-dns.service. 2023-10-08T06:08:12.925 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up dump (0.4b46-6) ... 2023-10-08T06:08:12.937 INFO:teuthology.orchestra.run.smithi032.stdout:Processing triggers for man-db (2.9.1-1) ... 2023-10-08T06:08:13.022 INFO:teuthology.orchestra.run.smithi040.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2023-10-08T06:08:13.085 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2023-10-08T06:08:13.245 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up libbluetooth3:amd64 (5.53-0ubuntu3.6) ... 2023-10-08T06:08:13.371 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up indent (2.2.12-1ubuntu0.20.04.1) ... 2023-10-08T06:08:13.530 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2023-10-08T06:08:13.706 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up libndp0:amd64 (1.7-0ubuntu1) ... 2023-10-08T06:08:13.865 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up postgresql-12 (12.16-0ubuntu0.20.04.1) ... 2023-10-08T06:08:14.230 INFO:teuthology.orchestra.run.smithi040.stdout:Creating new PostgreSQL cluster 12/main ... 2023-10-08T06:08:14.244 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/lib/postgresql/12/bin/initdb -D /var/lib/postgresql/12/main --auth-local peer --auth-host md5 2023-10-08T06:08:14.292 INFO:teuthology.orchestra.run.smithi040.stdout:The files belonging to this database system will be owned by user "postgres". 2023-10-08T06:08:14.292 INFO:teuthology.orchestra.run.smithi040.stdout:This user must also own the server process. 2023-10-08T06:08:14.292 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-10-08T06:08:14.292 INFO:teuthology.orchestra.run.smithi040.stdout:The database cluster will be initialized with locale "en_US". 2023-10-08T06:08:14.292 INFO:teuthology.orchestra.run.smithi040.stdout:The default database encoding has accordingly been set to "LATIN1". 2023-10-08T06:08:14.292 INFO:teuthology.orchestra.run.smithi040.stdout:The default text search configuration will be set to "english". 2023-10-08T06:08:14.292 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-10-08T06:08:14.292 INFO:teuthology.orchestra.run.smithi040.stdout:Data page checksums are disabled. 2023-10-08T06:08:14.292 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-10-08T06:08:14.292 INFO:teuthology.orchestra.run.smithi040.stdout:fixing permissions on existing directory /var/lib/postgresql/12/main ... ok 2023-10-08T06:08:14.293 INFO:teuthology.orchestra.run.smithi040.stdout:creating subdirectories ... ok 2023-10-08T06:08:14.293 INFO:teuthology.orchestra.run.smithi040.stdout:selecting dynamic shared memory implementation ... posix 2023-10-08T06:08:14.316 INFO:teuthology.orchestra.run.smithi040.stdout:selecting default max_connections ... 100 2023-10-08T06:08:14.339 INFO:teuthology.orchestra.run.smithi040.stdout:selecting default shared_buffers ... 128MB 2023-10-08T06:08:14.352 INFO:teuthology.orchestra.run.smithi040.stdout:selecting default time zone ... Etc/UTC 2023-10-08T06:08:14.353 INFO:teuthology.orchestra.run.smithi040.stdout:creating configuration files ... ok 2023-10-08T06:08:14.461 INFO:teuthology.orchestra.run.smithi040.stdout:running bootstrap script ... ok 2023-10-08T06:08:14.994 INFO:teuthology.orchestra.run.smithi040.stdout:performing post-bootstrap initialization ... ok 2023-10-08T06:08:15.657 INFO:teuthology.orchestra.run.smithi040.stdout:syncing data to disk ... ok 2023-10-08T06:08:15.657 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-10-08T06:08:15.658 INFO:teuthology.orchestra.run.smithi040.stdout:Success. You can now start the database server using: 2023-10-08T06:08:15.658 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-10-08T06:08:15.658 INFO:teuthology.orchestra.run.smithi040.stdout: pg_ctlcluster 12 main start 2023-10-08T06:08:15.658 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-10-08T06:08:15.983 INFO:teuthology.orchestra.run.smithi040.stdout:Ver Cluster Port Status Owner Data directory Log file 2023-10-08T06:08:15.983 INFO:teuthology.orchestra.run.smithi040.stdout:12 main 5432 down postgres /var/lib/postgresql/12/main /var/log/postgresql/postgresql-12-main.log 2023-10-08T06:08:16.074 INFO:teuthology.orchestra.run.smithi040.stdout:update-alternatives: using /usr/share/postgresql/12/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2023-10-08T06:08:19.206 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up libelf1:amd64 (0.176-1.1ubuntu0.1) ... 2023-10-08T06:08:19.331 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2023-10-08T06:08:19.491 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up pptp-linux (1.10.0-1build1) ... 2023-10-08T06:08:19.659 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up libdw1:amd64 (0.176-1.1ubuntu0.1) ... 2023-10-08T06:08:19.818 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up postgresql-client (12+214ubuntu0.1) ... 2023-10-08T06:08:19.944 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up network-manager (1.22.10-1ubuntu2.3) ... 2023-10-08T06:08:20.517 INFO:teuthology.orchestra.run.smithi032.stdout:Processing triggers for dbus (1.12.16-2ubuntu2.2) ... 2023-10-08T06:08:20.625 INFO:teuthology.orchestra.run.smithi032.stdout:Processing triggers for install-info (6.7.0.dfsg.2-5) ... 2023-10-08T06:08:20.684 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-10-08T06:08:20.684 INFO:teuthology.orchestra.run.smithi040.stdout:The following network interfaces were found in /etc/network/interfaces 2023-10-08T06:08:20.684 INFO:teuthology.orchestra.run.smithi040.stdout:which means they are currently configured by ifupdown: 2023-10-08T06:08:20.685 INFO:teuthology.orchestra.run.smithi040.stdout:- ens1f0 2023-10-08T06:08:20.685 INFO:teuthology.orchestra.run.smithi040.stdout:If you want to manage those interfaces with NetworkManager instead 2023-10-08T06:08:20.685 INFO:teuthology.orchestra.run.smithi040.stdout:remove their configuration from /etc/network/interfaces. 2023-10-08T06:08:20.685 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-10-08T06:08:20.847 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2023-10-08T06:08:21.191 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2023-10-08T06:08:21.455 INFO:teuthology.orchestra.run.smithi032.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-10-08T06:08:21.458 DEBUG:teuthology.parallel:result is None 2023-10-08T06:08:21.731 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2023-10-08T06:08:22.231 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2023-10-08T06:08:22.374 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up network-manager-pptp (1.2.8-2) ... 2023-10-08T06:08:22.516 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up libelf-dev:amd64 (0.176-1.1ubuntu0.1) ... 2023-10-08T06:08:22.634 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up postgresql-contrib (12+214ubuntu0.1) ... 2023-10-08T06:08:22.794 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up postgresql (12+214ubuntu0.1) ... 2023-10-08T06:08:22.919 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2023-10-08T06:08:23.079 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2023-10-08T06:08:23.205 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up modemmanager (1.18.6-1~ubuntu20.04.1) ... 2023-10-08T06:08:23.478 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2023-10-08T06:08:23.479 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2023-10-08T06:08:24.041 INFO:teuthology.orchestra.run.smithi040.stdout:Processing triggers for mime-support (3.64ubuntu1) ... 2023-10-08T06:08:24.159 INFO:teuthology.orchestra.run.smithi040.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2023-10-08T06:08:24.293 INFO:teuthology.orchestra.run.smithi040.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2023-10-08T06:08:24.470 INFO:teuthology.orchestra.run.smithi040.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2023-10-08T06:08:24.755 INFO:teuthology.orchestra.run.smithi040.stdout:Processing triggers for man-db (2.9.1-1) ... 2023-10-08T06:08:32.142 INFO:teuthology.orchestra.run.smithi040.stdout:Processing triggers for dbus (1.12.16-2ubuntu2.2) ... 2023-10-08T06:08:32.276 INFO:teuthology.orchestra.run.smithi040.stdout:Processing triggers for install-info (6.7.0.dfsg.2-5) ... 2023-10-08T06:08:33.133 INFO:teuthology.orchestra.run.smithi040.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-10-08T06:08:33.135 DEBUG:teuthology.parallel:result is None 2023-10-08T06:08:33.136 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=9725b08fd801c82987c737f7e6d354878f036ee8 2023-10-08T06:08:33.279 DEBUG:teuthology.orchestra.run.smithi032:> dpkg-query -W -f '${Version}' ceph 2023-10-08T06:08:33.302 INFO:teuthology.orchestra.run.smithi032.stdout:18.0.0-6609-g9725b08f-1focal 2023-10-08T06:08:33.303 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-6609-g9725b08f-1focal 2023-10-08T06:08:33.303 INFO:teuthology.task.install:The correct ceph version 18.0.0-6609-g9725b08f-1focal is installed. 2023-10-08T06:08:33.303 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=9725b08fd801c82987c737f7e6d354878f036ee8 2023-10-08T06:08:33.446 DEBUG:teuthology.orchestra.run.smithi040:> dpkg-query -W -f '${Version}' ceph 2023-10-08T06:08:33.469 INFO:teuthology.orchestra.run.smithi040.stdout:18.0.0-6609-g9725b08f-1focal 2023-10-08T06:08:33.469 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-6609-g9725b08f-1focal 2023-10-08T06:08:33.470 INFO:teuthology.task.install:The correct ceph version 18.0.0-6609-g9725b08f-1focal is installed. 2023-10-08T06:08:33.470 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-10-08T06:08:33.470 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2023-10-08T06:08:33.470 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-08T06:08:33.490 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-10-08T06:08:33.490 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-08T06:08:33.527 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-10-08T06:08:33.527 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2023-10-08T06:08:33.527 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd of=/usr/bin/daemon-helper 2023-10-08T06:08:33.546 DEBUG:teuthology.orchestra.run.smithi032:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-08T06:08:33.560 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-10-08T06:08:33.560 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd of=/usr/bin/daemon-helper 2023-10-08T06:08:33.577 DEBUG:teuthology.orchestra.run.smithi040:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-08T06:08:33.634 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-10-08T06:08:33.634 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2023-10-08T06:08:33.635 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-08T06:08:33.650 DEBUG:teuthology.orchestra.run.smithi032:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-08T06:08:33.666 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-10-08T06:08:33.666 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-08T06:08:33.682 DEBUG:teuthology.orchestra.run.smithi040:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-08T06:08:33.738 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-10-08T06:08:33.738 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2023-10-08T06:08:33.738 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd of=/usr/bin/stdin-killer 2023-10-08T06:08:33.753 DEBUG:teuthology.orchestra.run.smithi032:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-08T06:08:33.768 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-10-08T06:08:33.768 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd of=/usr/bin/stdin-killer 2023-10-08T06:08:33.783 DEBUG:teuthology.orchestra.run.smithi040:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-08T06:08:33.842 INFO:teuthology.run_tasks:Running task ceph... 2023-10-08T06:08:33.906 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-10-08T06:08:33.906 DEBUG:teuthology.orchestra.run.smithi032:> sudo chmod 777 /var/log/ceph 2023-10-08T06:08:33.908 DEBUG:teuthology.orchestra.run.smithi040:> sudo chmod 777 /var/log/ceph 2023-10-08T06:08:33.922 INFO:tasks.ceph:Disabling ceph logrotate... 2023-10-08T06:08:33.922 DEBUG:teuthology.orchestra.run.smithi032:> sudo rm -f -- /etc/logrotate.d/ceph 2023-10-08T06:08:33.966 DEBUG:teuthology.orchestra.run.smithi040:> sudo rm -f -- /etc/logrotate.d/ceph 2023-10-08T06:08:33.982 INFO:tasks.ceph:Creating extra log directories... 2023-10-08T06:08:33.982 DEBUG:teuthology.orchestra.run.smithi032:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-10-08T06:08:33.984 DEBUG:teuthology.orchestra.run.smithi040:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-10-08T06:08:34.045 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-10-08T06:08:34.045 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-10-08T06:08:34.045 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-10-08T06:08:34.045 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2023-10-08T06:08:34.045 DEBUG:teuthology.orchestra.run.smithi032:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-10-08T06:08:34.052 DEBUG:teuthology.orchestra.run.smithi032:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-10-08T06:08:34.091 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-10-08T06:08:34.091 DEBUG:teuthology.orchestra.run.smithi040:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-10-08T06:08:34.097 DEBUG:teuthology.orchestra.run.smithi040:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-10-08T06:08:34.140 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-10-08T06:08:34.140 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-10-08T06:08:34.140 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/yuriw-2023-10-07_14:05:27-fs-main-distro-default-smithi/7417362', 'branch': 'main', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_20.04} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/xfstests-dev}', 'email': 'yweinste@redhat.com', 'first_in_suite': False, 'job_id': '7417362', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'yuriw-2023-10-07_14:05:27-fs-main-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '20.04', 'overrides': {'admin_socket': {'branch': 'main'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': '9725b08fd801c82987c737f7e6d354878f036ee8'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '9725b08fd801c82987c737f7e6d354878f036ee8'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'main', 'sha1': '9725b08fd801c82987c737f7e6d354878f036ee8'}}, 'owner': 'scheduled_yuriw@teuthology', 'priority': 75, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 9589, 'sha1': '9725b08fd801c82987c737f7e6d354878f036ee8', 'sleep_before_teardown': 0, 'subset': '111/12000', 'suite': 'fs', 'suite_branch': 'main', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_9725b08fd801c82987c737f7e6d354878f036ee8/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': '9725b08fd801c82987c737f7e6d354878f036ee8', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi032.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM=', 'smithi040.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '9725b08fd801c82987c737f7e6d354878f036ee8'}}, {'ceph': {'create_rbd_pool': False, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': '9725b08fd801c82987c737f7e6d354878f036ee8', 'cluster': 'ceph'}}, {'ceph-fuse': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.tests_from_xfstests_dev']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end"]}, 'teuthology_branch': 'main', 'teuthology_sha1': '54e62bcbac4e53d9685e08328b790d3b20d71cae', 'timestamp': '2023-10-07_14:05:27', 'tube': 'smithi', 'user': 'yuriw', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2830'} 2023-10-08T06:08:34.141 DEBUG:teuthology.orchestra.run.smithi032:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-10-08T06:08:34.143 DEBUG:teuthology.orchestra.run.smithi040:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-10-08T06:08:34.149 DEBUG:teuthology.orchestra.run.smithi032:> sudo install -d -m0777 -- /var/run/ceph 2023-10-08T06:08:34.194 DEBUG:teuthology.orchestra.run.smithi040:> sudo install -d -m0777 -- /var/run/ceph 2023-10-08T06:08:34.211 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2023-10-08T06:08:34.211 DEBUG:teuthology.orchestra.run.smithi032:> dd if=/scratch_devs of=/dev/stdout 2023-10-08T06:08:34.217 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-08T06:08:34.217 DEBUG:teuthology.orchestra.run.smithi032:> stat /dev/vg_nvme/lv_1 2023-10-08T06:08:34.267 INFO:teuthology.orchestra.run.smithi032.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-08T06:08:34.267 INFO:teuthology.orchestra.run.smithi032.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-08T06:08:34.267 INFO:teuthology.orchestra.run.smithi032.stdout:Device: 6h/6d Inode: 359 Links: 1 2023-10-08T06:08:34.268 INFO:teuthology.orchestra.run.smithi032.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-08T06:08:34.268 INFO:teuthology.orchestra.run.smithi032.stdout:Access: 2023-10-08 06:03:45.790852240 +0000 2023-10-08T06:08:34.268 INFO:teuthology.orchestra.run.smithi032.stdout:Modify: 2023-10-08 06:03:45.506858791 +0000 2023-10-08T06:08:34.268 INFO:teuthology.orchestra.run.smithi032.stdout:Change: 2023-10-08 06:03:45.506858791 +0000 2023-10-08T06:08:34.268 INFO:teuthology.orchestra.run.smithi032.stdout: Birth: - 2023-10-08T06:08:34.268 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-08T06:08:34.280 INFO:teuthology.orchestra.run.smithi032.stderr:1+0 records in 2023-10-08T06:08:34.280 INFO:teuthology.orchestra.run.smithi032.stderr:1+0 records out 2023-10-08T06:08:34.280 INFO:teuthology.orchestra.run.smithi032.stderr:512 bytes copied, 0.000310053 s, 1.7 MB/s 2023-10-08T06:08:34.281 DEBUG:teuthology.orchestra.run.smithi032:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-08T06:08:34.290 DEBUG:teuthology.orchestra.run.smithi032:> stat /dev/vg_nvme/lv_2 2023-10-08T06:08:34.297 INFO:teuthology.orchestra.run.smithi032.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-08T06:08:34.298 INFO:teuthology.orchestra.run.smithi032.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-08T06:08:34.298 INFO:teuthology.orchestra.run.smithi032.stdout:Device: 6h/6d Inode: 368 Links: 1 2023-10-08T06:08:34.298 INFO:teuthology.orchestra.run.smithi032.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-08T06:08:34.298 INFO:teuthology.orchestra.run.smithi032.stdout:Access: 2023-10-08 06:03:46.310840245 +0000 2023-10-08T06:08:34.298 INFO:teuthology.orchestra.run.smithi032.stdout:Modify: 2023-10-08 06:03:46.010847165 +0000 2023-10-08T06:08:34.298 INFO:teuthology.orchestra.run.smithi032.stdout:Change: 2023-10-08 06:03:46.010847165 +0000 2023-10-08T06:08:34.298 INFO:teuthology.orchestra.run.smithi032.stdout: Birth: - 2023-10-08T06:08:34.298 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-08T06:08:34.354 INFO:teuthology.orchestra.run.smithi032.stderr:1+0 records in 2023-10-08T06:08:34.355 INFO:teuthology.orchestra.run.smithi032.stderr:1+0 records out 2023-10-08T06:08:34.355 INFO:teuthology.orchestra.run.smithi032.stderr:512 bytes copied, 0.000299294 s, 1.7 MB/s 2023-10-08T06:08:34.356 DEBUG:teuthology.orchestra.run.smithi032:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-08T06:08:34.364 DEBUG:teuthology.orchestra.run.smithi032:> stat /dev/vg_nvme/lv_3 2023-10-08T06:08:34.369 INFO:teuthology.orchestra.run.smithi032.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-08T06:08:34.369 INFO:teuthology.orchestra.run.smithi032.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-08T06:08:34.369 INFO:teuthology.orchestra.run.smithi032.stdout:Device: 6h/6d Inode: 374 Links: 1 2023-10-08T06:08:34.369 INFO:teuthology.orchestra.run.smithi032.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-08T06:08:34.370 INFO:teuthology.orchestra.run.smithi032.stdout:Access: 2023-10-08 06:03:46.806828804 +0000 2023-10-08T06:08:34.370 INFO:teuthology.orchestra.run.smithi032.stdout:Modify: 2023-10-08 06:03:46.514835540 +0000 2023-10-08T06:08:34.370 INFO:teuthology.orchestra.run.smithi032.stdout:Change: 2023-10-08 06:03:46.514835540 +0000 2023-10-08T06:08:34.370 INFO:teuthology.orchestra.run.smithi032.stdout: Birth: - 2023-10-08T06:08:34.370 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-08T06:08:34.429 INFO:teuthology.orchestra.run.smithi032.stderr:1+0 records in 2023-10-08T06:08:34.429 INFO:teuthology.orchestra.run.smithi032.stderr:1+0 records out 2023-10-08T06:08:34.429 INFO:teuthology.orchestra.run.smithi032.stderr:512 bytes copied, 0.000294257 s, 1.7 MB/s 2023-10-08T06:08:34.430 DEBUG:teuthology.orchestra.run.smithi032:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-08T06:08:34.439 DEBUG:teuthology.orchestra.run.smithi032:> stat /dev/vg_nvme/lv_4 2023-10-08T06:08:34.446 INFO:teuthology.orchestra.run.smithi032.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-08T06:08:34.446 INFO:teuthology.orchestra.run.smithi032.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-08T06:08:34.446 INFO:teuthology.orchestra.run.smithi032.stdout:Device: 6h/6d Inode: 379 Links: 1 2023-10-08T06:08:34.446 INFO:teuthology.orchestra.run.smithi032.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-08T06:08:34.446 INFO:teuthology.orchestra.run.smithi032.stdout:Access: 2023-10-08 06:03:47.310817178 +0000 2023-10-08T06:08:34.446 INFO:teuthology.orchestra.run.smithi032.stdout:Modify: 2023-10-08 06:03:47.006824191 +0000 2023-10-08T06:08:34.447 INFO:teuthology.orchestra.run.smithi032.stdout:Change: 2023-10-08 06:03:47.006824191 +0000 2023-10-08T06:08:34.447 INFO:teuthology.orchestra.run.smithi032.stdout: Birth: - 2023-10-08T06:08:34.447 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-08T06:08:34.460 INFO:teuthology.orchestra.run.smithi032.stderr:1+0 records in 2023-10-08T06:08:34.460 INFO:teuthology.orchestra.run.smithi032.stderr:1+0 records out 2023-10-08T06:08:34.461 INFO:teuthology.orchestra.run.smithi032.stderr:512 bytes copied, 0.00029419 s, 1.7 MB/s 2023-10-08T06:08:34.461 DEBUG:teuthology.orchestra.run.smithi032:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-08T06:08:34.469 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-08T06:08:34.469 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-10-08T06:08:34.469 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/scratch_devs of=/dev/stdout 2023-10-08T06:08:34.476 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-08T06:08:34.476 DEBUG:teuthology.orchestra.run.smithi040:> stat /dev/vg_nvme/lv_1 2023-10-08T06:08:34.483 INFO:teuthology.orchestra.run.smithi040.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-08T06:08:34.484 INFO:teuthology.orchestra.run.smithi040.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-08T06:08:34.484 INFO:teuthology.orchestra.run.smithi040.stdout:Device: 6h/6d Inode: 360 Links: 1 2023-10-08T06:08:34.484 INFO:teuthology.orchestra.run.smithi040.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-08T06:08:34.484 INFO:teuthology.orchestra.run.smithi040.stdout:Access: 2023-10-08 06:03:46.083246877 +0000 2023-10-08T06:08:34.484 INFO:teuthology.orchestra.run.smithi040.stdout:Modify: 2023-10-08 06:03:45.807253228 +0000 2023-10-08T06:08:34.484 INFO:teuthology.orchestra.run.smithi040.stdout:Change: 2023-10-08 06:03:45.807253228 +0000 2023-10-08T06:08:34.484 INFO:teuthology.orchestra.run.smithi040.stdout: Birth: - 2023-10-08T06:08:34.485 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-08T06:08:34.497 INFO:teuthology.orchestra.run.smithi040.stderr:1+0 records in 2023-10-08T06:08:34.498 INFO:teuthology.orchestra.run.smithi040.stderr:1+0 records out 2023-10-08T06:08:34.498 INFO:teuthology.orchestra.run.smithi040.stderr:512 bytes copied, 0.000400952 s, 1.3 MB/s 2023-10-08T06:08:34.499 DEBUG:teuthology.orchestra.run.smithi040:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-08T06:08:34.552 DEBUG:teuthology.orchestra.run.smithi040:> stat /dev/vg_nvme/lv_2 2023-10-08T06:08:34.558 INFO:teuthology.orchestra.run.smithi040.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-08T06:08:34.558 INFO:teuthology.orchestra.run.smithi040.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-08T06:08:34.559 INFO:teuthology.orchestra.run.smithi040.stdout:Device: 6h/6d Inode: 364 Links: 1 2023-10-08T06:08:34.559 INFO:teuthology.orchestra.run.smithi040.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-08T06:08:34.559 INFO:teuthology.orchestra.run.smithi040.stdout:Access: 2023-10-08 06:03:46.587235279 +0000 2023-10-08T06:08:34.559 INFO:teuthology.orchestra.run.smithi040.stdout:Modify: 2023-10-08 06:03:46.303241815 +0000 2023-10-08T06:08:34.559 INFO:teuthology.orchestra.run.smithi040.stdout:Change: 2023-10-08 06:03:46.303241815 +0000 2023-10-08T06:08:34.559 INFO:teuthology.orchestra.run.smithi040.stdout: Birth: - 2023-10-08T06:08:34.559 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-08T06:08:34.571 INFO:teuthology.orchestra.run.smithi040.stderr:1+0 records in 2023-10-08T06:08:34.571 INFO:teuthology.orchestra.run.smithi040.stderr:1+0 records out 2023-10-08T06:08:34.572 INFO:teuthology.orchestra.run.smithi040.stderr:512 bytes copied, 0.00037093 s, 1.4 MB/s 2023-10-08T06:08:34.572 DEBUG:teuthology.orchestra.run.smithi040:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-08T06:08:34.581 DEBUG:teuthology.orchestra.run.smithi040:> stat /dev/vg_nvme/lv_3 2023-10-08T06:08:34.588 INFO:teuthology.orchestra.run.smithi040.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-08T06:08:34.588 INFO:teuthology.orchestra.run.smithi040.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-08T06:08:34.588 INFO:teuthology.orchestra.run.smithi040.stdout:Device: 6h/6d Inode: 372 Links: 1 2023-10-08T06:08:34.588 INFO:teuthology.orchestra.run.smithi040.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-08T06:08:34.588 INFO:teuthology.orchestra.run.smithi040.stdout:Access: 2023-10-08 06:03:46.799230401 +0000 2023-10-08T06:08:34.588 INFO:teuthology.orchestra.run.smithi040.stdout:Modify: 2023-10-08 06:03:46.795230492 +0000 2023-10-08T06:08:34.588 INFO:teuthology.orchestra.run.smithi040.stdout:Change: 2023-10-08 06:03:46.795230492 +0000 2023-10-08T06:08:34.589 INFO:teuthology.orchestra.run.smithi040.stdout: Birth: - 2023-10-08T06:08:34.589 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-08T06:08:34.645 INFO:teuthology.orchestra.run.smithi040.stderr:1+0 records in 2023-10-08T06:08:34.646 INFO:teuthology.orchestra.run.smithi040.stderr:1+0 records out 2023-10-08T06:08:34.646 INFO:teuthology.orchestra.run.smithi040.stderr:512 bytes copied, 0.000402596 s, 1.3 MB/s 2023-10-08T06:08:34.647 DEBUG:teuthology.orchestra.run.smithi040:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-08T06:08:34.654 DEBUG:teuthology.orchestra.run.smithi040:> stat /dev/vg_nvme/lv_4 2023-10-08T06:08:34.659 INFO:teuthology.orchestra.run.smithi040.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-08T06:08:34.659 INFO:teuthology.orchestra.run.smithi040.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-08T06:08:34.659 INFO:teuthology.orchestra.run.smithi040.stdout:Device: 6h/6d Inode: 379 Links: 1 2023-10-08T06:08:34.659 INFO:teuthology.orchestra.run.smithi040.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-08T06:08:34.659 INFO:teuthology.orchestra.run.smithi040.stdout:Access: 2023-10-08 06:03:47.755208400 +0000 2023-10-08T06:08:34.659 INFO:teuthology.orchestra.run.smithi040.stdout:Modify: 2023-10-08 06:03:47.463215120 +0000 2023-10-08T06:08:34.659 INFO:teuthology.orchestra.run.smithi040.stdout:Change: 2023-10-08 06:03:47.463215120 +0000 2023-10-08T06:08:34.659 INFO:teuthology.orchestra.run.smithi040.stdout: Birth: - 2023-10-08T06:08:34.659 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-08T06:08:34.670 INFO:teuthology.orchestra.run.smithi040.stderr:1+0 records in 2023-10-08T06:08:34.670 INFO:teuthology.orchestra.run.smithi040.stderr:1+0 records out 2023-10-08T06:08:34.670 INFO:teuthology.orchestra.run.smithi040.stderr:512 bytes copied, 0.000417937 s, 1.2 MB/s 2023-10-08T06:08:34.671 DEBUG:teuthology.orchestra.run.smithi040:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-08T06:08:34.724 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-08T06:08:34.724 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi032.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi040.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-10-08T06:08:34.724 INFO:tasks.ceph:Generating config... 2023-10-08T06:08:34.725 INFO:tasks.ceph:[client] client mount timeout = 600 2023-10-08T06:08:34.725 INFO:tasks.ceph:[client] debug client = 20 2023-10-08T06:08:34.726 INFO:tasks.ceph:[client] debug ms = 1 2023-10-08T06:08:34.726 INFO:tasks.ceph:[client] pid file = 2023-10-08T06:08:34.726 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-10-08T06:08:34.726 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-10-08T06:08:34.726 INFO:tasks.ceph:[mds] debug mds = 20 2023-10-08T06:08:34.726 INFO:tasks.ceph:[mds] debug mds balancer = 20 2023-10-08T06:08:34.726 INFO:tasks.ceph:[mds] debug ms = 1 2023-10-08T06:08:34.726 INFO:tasks.ceph:[mds] mds debug frag = True 2023-10-08T06:08:34.726 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-10-08T06:08:34.726 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-10-08T06:08:34.726 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-10-08T06:08:34.726 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-10-08T06:08:34.727 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-10-08T06:08:34.727 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-10-08T06:08:34.727 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-10-08T06:08:34.727 INFO:tasks.ceph:[mgr] debug ms = 1 2023-10-08T06:08:34.727 INFO:tasks.ceph:[mon] debug mon = 20 2023-10-08T06:08:34.727 INFO:tasks.ceph:[mon] debug ms = 1 2023-10-08T06:08:34.727 INFO:tasks.ceph:[mon] debug paxos = 20 2023-10-08T06:08:34.727 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-10-08T06:08:34.727 INFO:tasks.ceph:[osd] bdev async discard = True 2023-10-08T06:08:34.727 INFO:tasks.ceph:[osd] bdev enable discard = True 2023-10-08T06:08:34.727 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2023-10-08T06:08:34.727 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-10-08T06:08:34.728 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-10-08T06:08:34.728 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2023-10-08T06:08:34.728 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2023-10-08T06:08:34.728 INFO:tasks.ceph:[osd] debug ms = 1 2023-10-08T06:08:34.728 INFO:tasks.ceph:[osd] debug osd = 20 2023-10-08T06:08:34.728 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2023-10-08T06:08:34.728 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-10-08T06:08:34.728 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-10-08T06:08:34.728 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-10-08T06:08:34.728 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-10-08T06:08:34.728 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-10-08T06:08:34.728 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-10-08T06:08:34.729 INFO:tasks.ceph:Setting up mon.a... 2023-10-08T06:08:34.729 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-10-08T06:08:34.772 INFO:teuthology.orchestra.run.smithi032.stdout:creating /etc/ceph/ceph.keyring 2023-10-08T06:08:34.789 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-10-08T06:08:34.877 DEBUG:teuthology.orchestra.run.smithi032:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-08T06:08:34.892 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.32'), ('mon.b', '172.21.15.40'), ('mon.c', '[v2:172.21.15.40:3301,v1:172.21.15.40:6790]')] 2023-10-08T06:08:34.892 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.32,172.21.15.40,[v2:172.21.15.40:3301,v1:172.21.15.40:6790]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-10-08T06:08:34.893 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2023-10-08T06:08:34.893 DEBUG:teuthology.orchestra.run.smithi032:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-10-08T06:08:34.898 DEBUG:teuthology.orchestra.run.smithi032:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.32 --add b 172.21.15.40 --addv c '[v2:172.21.15.40:3301,v1:172.21.15.40:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-10-08T06:08:34.985 INFO:teuthology.orchestra.run.smithi032.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-10-08T06:08:34.985 INFO:teuthology.orchestra.run.smithi032.stdout:monmaptool: generated fsid ac672d87-96ae-41e0-9314-623ba2cdbbba 2023-10-08T06:08:34.985 INFO:teuthology.orchestra.run.smithi032.stdout:setting min_mon_release = pacific 2023-10-08T06:08:34.986 INFO:teuthology.orchestra.run.smithi032.stdout:epoch 0 2023-10-08T06:08:34.986 INFO:teuthology.orchestra.run.smithi032.stdout:fsid ac672d87-96ae-41e0-9314-623ba2cdbbba 2023-10-08T06:08:34.987 INFO:teuthology.orchestra.run.smithi032.stdout:last_changed 2023-10-08T06:08:34.985048+0000 2023-10-08T06:08:34.987 INFO:teuthology.orchestra.run.smithi032.stdout:created 2023-10-08T06:08:34.985048+0000 2023-10-08T06:08:34.987 INFO:teuthology.orchestra.run.smithi032.stdout:min_mon_release 16 (pacific) 2023-10-08T06:08:34.987 INFO:teuthology.orchestra.run.smithi032.stdout:election_strategy: 1 2023-10-08T06:08:34.987 INFO:teuthology.orchestra.run.smithi032.stdout:0: [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] mon.a 2023-10-08T06:08:34.987 INFO:teuthology.orchestra.run.smithi032.stdout:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.b 2023-10-08T06:08:34.987 INFO:teuthology.orchestra.run.smithi032.stdout:2: [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] mon.c 2023-10-08T06:08:34.987 INFO:teuthology.orchestra.run.smithi032.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-10-08T06:08:34.988 DEBUG:teuthology.orchestra.run.smithi032:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-10-08T06:08:34.994 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID ac672d87-96ae-41e0-9314-623ba2cdbbba... 2023-10-08T06:08:34.995 DEBUG:teuthology.orchestra.run.smithi032:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-08T06:08:34.997 DEBUG:teuthology.orchestra.run.smithi040:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-08T06:08:35.028 INFO:teuthology.orchestra.run.smithi032.stdout:[global] 2023-10-08T06:08:35.028 INFO:teuthology.orchestra.run.smithi032.stdout: chdir = "" 2023-10-08T06:08:35.028 INFO:teuthology.orchestra.run.smithi032.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-08T06:08:35.028 INFO:teuthology.orchestra.run.smithi032.stdout: auth supported = cephx 2023-10-08T06:08:35.029 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:08:35.029 INFO:teuthology.orchestra.run.smithi032.stdout: filestore xattr use omap = true 2023-10-08T06:08:35.029 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:08:35.029 INFO:teuthology.orchestra.run.smithi032.stdout: mon clock drift allowed = 1.000 2023-10-08T06:08:35.029 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:08:35.029 INFO:teuthology.orchestra.run.smithi032.stdout: osd crush chooseleaf type = 0 2023-10-08T06:08:35.029 INFO:teuthology.orchestra.run.smithi032.stdout: auth debug = true 2023-10-08T06:08:35.029 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:08:35.029 INFO:teuthology.orchestra.run.smithi032.stdout: ms die on old message = true 2023-10-08T06:08:35.029 INFO:teuthology.orchestra.run.smithi032.stdout: ms die on bug = true 2023-10-08T06:08:35.029 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:08:35.030 INFO:teuthology.orchestra.run.smithi032.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-08T06:08:35.030 INFO:teuthology.orchestra.run.smithi032.stdout: mon pg warn max object skew = 0 2023-10-08T06:08:35.030 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:08:35.030 INFO:teuthology.orchestra.run.smithi032.stdout: # disable pg_autoscaler by default for new pools 2023-10-08T06:08:35.030 INFO:teuthology.orchestra.run.smithi032.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-08T06:08:35.030 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:08:35.030 INFO:teuthology.orchestra.run.smithi032.stdout: osd pool default size = 2 2023-10-08T06:08:35.030 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:08:35.030 INFO:teuthology.orchestra.run.smithi032.stdout: mon osd allow primary affinity = true 2023-10-08T06:08:35.030 INFO:teuthology.orchestra.run.smithi032.stdout: mon osd allow pg remap = true 2023-10-08T06:08:35.030 INFO:teuthology.orchestra.run.smithi032.stdout: mon warn on legacy crush tunables = false 2023-10-08T06:08:35.030 INFO:teuthology.orchestra.run.smithi032.stdout: mon warn on crush straw calc version zero = false 2023-10-08T06:08:35.031 INFO:teuthology.orchestra.run.smithi032.stdout: mon warn on no sortbitwise = false 2023-10-08T06:08:35.031 INFO:teuthology.orchestra.run.smithi032.stdout: mon warn on osd down out interval zero = false 2023-10-08T06:08:35.031 INFO:teuthology.orchestra.run.smithi032.stdout: mon warn on too few osds = false 2023-10-08T06:08:35.031 INFO:teuthology.orchestra.run.smithi032.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-08T06:08:35.031 INFO:teuthology.orchestra.run.smithi032.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-08T06:08:35.031 INFO:teuthology.orchestra.run.smithi032.stdout: mon_allow_pool_size_one = true 2023-10-08T06:08:35.031 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:08:35.031 INFO:teuthology.orchestra.run.smithi032.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-08T06:08:35.031 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:08:35.031 INFO:teuthology.orchestra.run.smithi032.stdout: osd default data pool replay window = 5 2023-10-08T06:08:35.031 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:08:35.032 INFO:teuthology.orchestra.run.smithi032.stdout: mon allow pool delete = true 2023-10-08T06:08:35.032 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:08:35.032 INFO:teuthology.orchestra.run.smithi032.stdout: mon cluster log file level = debug 2023-10-08T06:08:35.032 INFO:teuthology.orchestra.run.smithi032.stdout: debug asserts on shutdown = true 2023-10-08T06:08:35.032 INFO:teuthology.orchestra.run.smithi032.stdout: mon health detail to clog = false 2023-10-08T06:08:35.032 INFO:teuthology.orchestra.run.smithi032.stdout: mon host = "172.21.15.32,172.21.15.40,[v2:172.21.15.40:3301,v1:172.21.15.40:6790]" 2023-10-08T06:08:35.032 INFO:teuthology.orchestra.run.smithi032.stdout: fsid = ac672d87-96ae-41e0-9314-623ba2cdbbba 2023-10-08T06:08:35.032 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:08:35.032 INFO:teuthology.orchestra.run.smithi032.stdout:[osd] 2023-10-08T06:08:35.032 INFO:teuthology.orchestra.run.smithi032.stdout: osd journal size = 100 2023-10-08T06:08:35.032 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:08:35.032 INFO:teuthology.orchestra.run.smithi032.stdout: osd scrub load threshold = 5.0 2023-10-08T06:08:35.033 INFO:teuthology.orchestra.run.smithi032.stdout: osd scrub max interval = 600 2023-10-08T06:08:35.033 INFO:teuthology.orchestra.run.smithi032.stdout: osd mclock profile = high_recovery_ops 2023-10-08T06:08:35.033 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:08:35.033 INFO:teuthology.orchestra.run.smithi032.stdout: osd recover clone overlap = true 2023-10-08T06:08:35.033 INFO:teuthology.orchestra.run.smithi032.stdout: osd recovery max chunk = 1048576 2023-10-08T06:08:35.033 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:08:35.033 INFO:teuthology.orchestra.run.smithi032.stdout: osd debug shutdown = true 2023-10-08T06:08:35.033 INFO:teuthology.orchestra.run.smithi032.stdout: osd debug op order = true 2023-10-08T06:08:35.033 INFO:teuthology.orchestra.run.smithi032.stdout: osd debug verify stray on activate = true 2023-10-08T06:08:35.033 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:08:35.033 INFO:teuthology.orchestra.run.smithi032.stdout: osd open classes on start = true 2023-10-08T06:08:35.033 INFO:teuthology.orchestra.run.smithi032.stdout: osd debug pg log writeout = true 2023-10-08T06:08:35.033 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:08:35.034 INFO:teuthology.orchestra.run.smithi032.stdout: osd deep scrub update digest min age = 30 2023-10-08T06:08:35.034 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:08:35.034 INFO:teuthology.orchestra.run.smithi032.stdout: osd map max advance = 10 2023-10-08T06:08:35.034 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:08:35.034 INFO:teuthology.orchestra.run.smithi032.stdout: journal zero on create = true 2023-10-08T06:08:35.034 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:08:35.034 INFO:teuthology.orchestra.run.smithi032.stdout: filestore ondisk finisher threads = 3 2023-10-08T06:08:35.034 INFO:teuthology.orchestra.run.smithi032.stdout: filestore apply finisher threads = 3 2023-10-08T06:08:35.034 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:08:35.034 INFO:teuthology.orchestra.run.smithi032.stdout: bdev debug aio = true 2023-10-08T06:08:35.035 INFO:teuthology.orchestra.run.smithi032.stdout: osd debug misdirected ops = true 2023-10-08T06:08:35.035 INFO:teuthology.orchestra.run.smithi032.stdout: bdev async discard = True 2023-10-08T06:08:35.035 INFO:teuthology.orchestra.run.smithi032.stdout: bdev enable discard = True 2023-10-08T06:08:35.035 INFO:teuthology.orchestra.run.smithi032.stdout: bluestore allocator = bitmap 2023-10-08T06:08:35.035 INFO:teuthology.orchestra.run.smithi032.stdout: bluestore block size = 96636764160 2023-10-08T06:08:35.035 INFO:teuthology.orchestra.run.smithi032.stdout: bluestore fsck on mount = True 2023-10-08T06:08:35.035 INFO:teuthology.orchestra.run.smithi032.stdout: debug bluefs = 1/20 2023-10-08T06:08:35.035 INFO:teuthology.orchestra.run.smithi032.stdout: debug bluestore = 1/20 2023-10-08T06:08:35.035 INFO:teuthology.orchestra.run.smithi032.stdout: debug ms = 1 2023-10-08T06:08:35.035 INFO:teuthology.orchestra.run.smithi032.stdout: debug osd = 20 2023-10-08T06:08:35.035 INFO:teuthology.orchestra.run.smithi032.stdout: debug rocksdb = 4/10 2023-10-08T06:08:35.037 INFO:teuthology.orchestra.run.smithi032.stdout: mon osd backfillfull_ratio = 0.85 2023-10-08T06:08:35.037 INFO:teuthology.orchestra.run.smithi032.stdout: mon osd full ratio = 0.9 2023-10-08T06:08:35.037 INFO:teuthology.orchestra.run.smithi032.stdout: mon osd nearfull ratio = 0.8 2023-10-08T06:08:35.037 INFO:teuthology.orchestra.run.smithi032.stdout: osd failsafe full ratio = 0.95 2023-10-08T06:08:35.037 INFO:teuthology.orchestra.run.smithi032.stdout: osd objectstore = bluestore 2023-10-08T06:08:35.037 INFO:teuthology.orchestra.run.smithi032.stdout: osd op complaint time = 180 2023-10-08T06:08:35.038 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:08:35.038 INFO:teuthology.orchestra.run.smithi032.stdout:[mgr] 2023-10-08T06:08:35.038 INFO:teuthology.orchestra.run.smithi032.stdout: debug ms = 1 2023-10-08T06:08:35.038 INFO:teuthology.orchestra.run.smithi032.stdout: debug mgr = 20 2023-10-08T06:08:35.038 INFO:teuthology.orchestra.run.smithi032.stdout: debug mon = 20 2023-10-08T06:08:35.038 INFO:teuthology.orchestra.run.smithi032.stdout: debug auth = 20 2023-10-08T06:08:35.038 INFO:teuthology.orchestra.run.smithi032.stdout: mon reweight min pgs per osd = 4 2023-10-08T06:08:35.038 INFO:teuthology.orchestra.run.smithi032.stdout: mon reweight min bytes per osd = 10 2023-10-08T06:08:35.038 INFO:teuthology.orchestra.run.smithi032.stdout: mgr/telemetry/nag = false 2023-10-08T06:08:35.038 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:08:35.038 INFO:teuthology.orchestra.run.smithi032.stdout:[mon] 2023-10-08T06:08:35.038 INFO:teuthology.orchestra.run.smithi032.stdout: debug ms = 1 2023-10-08T06:08:35.039 INFO:teuthology.orchestra.run.smithi032.stdout: debug mon = 20 2023-10-08T06:08:35.039 INFO:teuthology.orchestra.run.smithi032.stdout: debug paxos = 20 2023-10-08T06:08:35.039 INFO:teuthology.orchestra.run.smithi032.stdout: debug auth = 20 2023-10-08T06:08:35.039 INFO:teuthology.orchestra.run.smithi032.stdout: mon data avail warn = 5 2023-10-08T06:08:35.039 INFO:teuthology.orchestra.run.smithi032.stdout: mon mgr mkfs grace = 240 2023-10-08T06:08:35.039 INFO:teuthology.orchestra.run.smithi032.stdout: mon reweight min pgs per osd = 4 2023-10-08T06:08:35.039 INFO:teuthology.orchestra.run.smithi032.stdout: mon osd reporter subtree level = osd 2023-10-08T06:08:35.039 INFO:teuthology.orchestra.run.smithi032.stdout: mon osd prime pg temp = true 2023-10-08T06:08:35.039 INFO:teuthology.orchestra.run.smithi032.stdout: mon reweight min bytes per osd = 10 2023-10-08T06:08:35.039 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:08:35.039 INFO:teuthology.orchestra.run.smithi032.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-08T06:08:35.039 INFO:teuthology.orchestra.run.smithi032.stdout: auth mon ticket ttl = 660 # 11m 2023-10-08T06:08:35.040 INFO:teuthology.orchestra.run.smithi032.stdout: auth service ticket ttl = 240 # 4m 2023-10-08T06:08:35.040 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:08:35.040 INFO:teuthology.orchestra.run.smithi032.stdout: # don't complain about insecure global_id in the test suite 2023-10-08T06:08:35.040 INFO:teuthology.orchestra.run.smithi032.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-08T06:08:35.040 INFO:teuthology.orchestra.run.smithi032.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-08T06:08:35.040 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:08:35.040 INFO:teuthology.orchestra.run.smithi032.stdout: # 1m isn't quite enough 2023-10-08T06:08:35.040 INFO:teuthology.orchestra.run.smithi032.stdout: mon_down_mkfs_grace = 2m 2023-10-08T06:08:35.040 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:08:35.040 INFO:teuthology.orchestra.run.smithi032.stdout: mon_warn_on_filestore_osds = false 2023-10-08T06:08:35.041 INFO:teuthology.orchestra.run.smithi032.stdout: mon op complaint time = 120 2023-10-08T06:08:35.041 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:08:35.041 INFO:teuthology.orchestra.run.smithi032.stdout:[client] 2023-10-08T06:08:35.041 INFO:teuthology.orchestra.run.smithi032.stdout: rgw cache enabled = true 2023-10-08T06:08:35.041 INFO:teuthology.orchestra.run.smithi032.stdout: rgw enable ops log = true 2023-10-08T06:08:35.041 INFO:teuthology.orchestra.run.smithi032.stdout: rgw enable usage log = true 2023-10-08T06:08:35.041 INFO:teuthology.orchestra.run.smithi032.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-08T06:08:35.041 INFO:teuthology.orchestra.run.smithi032.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-08T06:08:35.041 INFO:teuthology.orchestra.run.smithi032.stdout: client mount timeout = 600 2023-10-08T06:08:35.041 INFO:teuthology.orchestra.run.smithi032.stdout: debug client = 20 2023-10-08T06:08:35.041 INFO:teuthology.orchestra.run.smithi032.stdout: debug ms = 1 2023-10-08T06:08:35.041 INFO:teuthology.orchestra.run.smithi032.stdout: pid file = "" 2023-10-08T06:08:35.042 INFO:teuthology.orchestra.run.smithi032.stdout: rados mon op timeout = 900 2023-10-08T06:08:35.042 INFO:teuthology.orchestra.run.smithi032.stdout: rados osd op timeout = 900 2023-10-08T06:08:35.042 INFO:teuthology.orchestra.run.smithi032.stdout:[mon.a] 2023-10-08T06:08:35.042 INFO:teuthology.orchestra.run.smithi032.stdout:[mon.b] 2023-10-08T06:08:35.042 INFO:teuthology.orchestra.run.smithi032.stdout:[mon.c] 2023-10-08T06:08:35.042 INFO:teuthology.orchestra.run.smithi032.stdout:[mds.a] 2023-10-08T06:08:35.042 INFO:teuthology.orchestra.run.smithi032.stdout:[mds.c] 2023-10-08T06:08:35.042 INFO:teuthology.orchestra.run.smithi032.stdout:[mds.b] 2023-10-08T06:08:35.042 INFO:teuthology.orchestra.run.smithi032.stdout:[mds.d] 2023-10-08T06:08:35.042 INFO:teuthology.orchestra.run.smithi032.stdout:[mds] 2023-10-08T06:08:35.042 INFO:teuthology.orchestra.run.smithi032.stdout: debug mds = 20 2023-10-08T06:08:35.042 INFO:teuthology.orchestra.run.smithi032.stdout: debug mds balancer = 20 2023-10-08T06:08:35.043 INFO:teuthology.orchestra.run.smithi032.stdout: debug ms = 1 2023-10-08T06:08:35.043 INFO:teuthology.orchestra.run.smithi032.stdout: mds debug frag = True 2023-10-08T06:08:35.043 INFO:teuthology.orchestra.run.smithi032.stdout: mds debug scatterstat = True 2023-10-08T06:08:35.043 INFO:teuthology.orchestra.run.smithi032.stdout: mds op complaint time = 180 2023-10-08T06:08:35.043 INFO:teuthology.orchestra.run.smithi032.stdout: mds verify scatter = True 2023-10-08T06:08:35.043 INFO:teuthology.orchestra.run.smithi032.stdout: osd op complaint time = 180 2023-10-08T06:08:35.043 INFO:teuthology.orchestra.run.smithi032.stdout: rados mon op timeout = 900 2023-10-08T06:08:35.043 INFO:teuthology.orchestra.run.smithi032.stdout: rados osd op timeout = 900 2023-10-08T06:08:35.044 INFO:teuthology.orchestra.run.smithi040.stdout:[global] 2023-10-08T06:08:35.045 INFO:teuthology.orchestra.run.smithi040.stdout: chdir = "" 2023-10-08T06:08:35.045 INFO:teuthology.orchestra.run.smithi040.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-08T06:08:35.045 INFO:teuthology.orchestra.run.smithi040.stdout: auth supported = cephx 2023-10-08T06:08:35.045 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-10-08T06:08:35.045 INFO:teuthology.orchestra.run.smithi040.stdout: filestore xattr use omap = true 2023-10-08T06:08:35.045 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-10-08T06:08:35.045 INFO:teuthology.orchestra.run.smithi040.stdout: mon clock drift allowed = 1.000 2023-10-08T06:08:35.045 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-10-08T06:08:35.045 INFO:teuthology.orchestra.run.smithi040.stdout: osd crush chooseleaf type = 0 2023-10-08T06:08:35.045 INFO:teuthology.orchestra.run.smithi040.stdout: auth debug = true 2023-10-08T06:08:35.046 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-10-08T06:08:35.046 INFO:teuthology.orchestra.run.smithi040.stdout: ms die on old message = true 2023-10-08T06:08:35.046 INFO:teuthology.orchestra.run.smithi040.stdout: ms die on bug = true 2023-10-08T06:08:35.046 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-10-08T06:08:35.046 INFO:teuthology.orchestra.run.smithi040.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-08T06:08:35.046 INFO:teuthology.orchestra.run.smithi040.stdout: mon pg warn max object skew = 0 2023-10-08T06:08:35.046 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-10-08T06:08:35.046 INFO:teuthology.orchestra.run.smithi040.stdout: # disable pg_autoscaler by default for new pools 2023-10-08T06:08:35.046 INFO:teuthology.orchestra.run.smithi040.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-08T06:08:35.046 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-10-08T06:08:35.046 INFO:teuthology.orchestra.run.smithi040.stdout: osd pool default size = 2 2023-10-08T06:08:35.046 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-10-08T06:08:35.047 INFO:teuthology.orchestra.run.smithi040.stdout: mon osd allow primary affinity = true 2023-10-08T06:08:35.047 INFO:teuthology.orchestra.run.smithi040.stdout: mon osd allow pg remap = true 2023-10-08T06:08:35.047 INFO:teuthology.orchestra.run.smithi040.stdout: mon warn on legacy crush tunables = false 2023-10-08T06:08:35.047 INFO:teuthology.orchestra.run.smithi040.stdout: mon warn on crush straw calc version zero = false 2023-10-08T06:08:35.047 INFO:teuthology.orchestra.run.smithi040.stdout: mon warn on no sortbitwise = false 2023-10-08T06:08:35.047 INFO:teuthology.orchestra.run.smithi040.stdout: mon warn on osd down out interval zero = false 2023-10-08T06:08:35.047 INFO:teuthology.orchestra.run.smithi040.stdout: mon warn on too few osds = false 2023-10-08T06:08:35.047 INFO:teuthology.orchestra.run.smithi040.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-08T06:08:35.047 INFO:teuthology.orchestra.run.smithi040.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-08T06:08:35.047 INFO:teuthology.orchestra.run.smithi040.stdout: mon_allow_pool_size_one = true 2023-10-08T06:08:35.048 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-10-08T06:08:35.048 INFO:teuthology.orchestra.run.smithi040.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-08T06:08:35.048 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-10-08T06:08:35.048 INFO:teuthology.orchestra.run.smithi040.stdout: osd default data pool replay window = 5 2023-10-08T06:08:35.048 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-10-08T06:08:35.048 INFO:teuthology.orchestra.run.smithi040.stdout: mon allow pool delete = true 2023-10-08T06:08:35.048 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-10-08T06:08:35.048 INFO:teuthology.orchestra.run.smithi040.stdout: mon cluster log file level = debug 2023-10-08T06:08:35.048 INFO:teuthology.orchestra.run.smithi040.stdout: debug asserts on shutdown = true 2023-10-08T06:08:35.048 INFO:teuthology.orchestra.run.smithi040.stdout: mon health detail to clog = false 2023-10-08T06:08:35.048 INFO:teuthology.orchestra.run.smithi040.stdout: mon host = "172.21.15.32,172.21.15.40,[v2:172.21.15.40:3301,v1:172.21.15.40:6790]" 2023-10-08T06:08:35.049 INFO:teuthology.orchestra.run.smithi040.stdout: fsid = ac672d87-96ae-41e0-9314-623ba2cdbbba 2023-10-08T06:08:35.049 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-10-08T06:08:35.049 INFO:teuthology.orchestra.run.smithi040.stdout:[osd] 2023-10-08T06:08:35.049 INFO:teuthology.orchestra.run.smithi040.stdout: osd journal size = 100 2023-10-08T06:08:35.049 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-10-08T06:08:35.049 INFO:teuthology.orchestra.run.smithi040.stdout: osd scrub load threshold = 5.0 2023-10-08T06:08:35.049 INFO:teuthology.orchestra.run.smithi040.stdout: osd scrub max interval = 600 2023-10-08T06:08:35.049 INFO:teuthology.orchestra.run.smithi040.stdout: osd mclock profile = high_recovery_ops 2023-10-08T06:08:35.049 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-10-08T06:08:35.049 INFO:teuthology.orchestra.run.smithi040.stdout: osd recover clone overlap = true 2023-10-08T06:08:35.049 INFO:teuthology.orchestra.run.smithi040.stdout: osd recovery max chunk = 1048576 2023-10-08T06:08:35.049 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-10-08T06:08:35.050 INFO:teuthology.orchestra.run.smithi040.stdout: osd debug shutdown = true 2023-10-08T06:08:35.050 INFO:teuthology.orchestra.run.smithi040.stdout: osd debug op order = true 2023-10-08T06:08:35.050 INFO:teuthology.orchestra.run.smithi040.stdout: osd debug verify stray on activate = true 2023-10-08T06:08:35.050 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-10-08T06:08:35.050 INFO:teuthology.orchestra.run.smithi040.stdout: osd open classes on start = true 2023-10-08T06:08:35.050 INFO:teuthology.orchestra.run.smithi040.stdout: osd debug pg log writeout = true 2023-10-08T06:08:35.050 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-10-08T06:08:35.050 INFO:teuthology.orchestra.run.smithi040.stdout: osd deep scrub update digest min age = 30 2023-10-08T06:08:35.050 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-10-08T06:08:35.050 INFO:teuthology.orchestra.run.smithi040.stdout: osd map max advance = 10 2023-10-08T06:08:35.050 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-10-08T06:08:35.050 INFO:teuthology.orchestra.run.smithi040.stdout: journal zero on create = true 2023-10-08T06:08:35.051 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-10-08T06:08:35.051 INFO:teuthology.orchestra.run.smithi040.stdout: filestore ondisk finisher threads = 3 2023-10-08T06:08:35.051 INFO:teuthology.orchestra.run.smithi040.stdout: filestore apply finisher threads = 3 2023-10-08T06:08:35.051 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-10-08T06:08:35.051 INFO:teuthology.orchestra.run.smithi040.stdout: bdev debug aio = true 2023-10-08T06:08:35.051 INFO:teuthology.orchestra.run.smithi040.stdout: osd debug misdirected ops = true 2023-10-08T06:08:35.051 INFO:teuthology.orchestra.run.smithi040.stdout: bdev async discard = True 2023-10-08T06:08:35.051 INFO:teuthology.orchestra.run.smithi040.stdout: bdev enable discard = True 2023-10-08T06:08:35.051 INFO:teuthology.orchestra.run.smithi040.stdout: bluestore allocator = bitmap 2023-10-08T06:08:35.051 INFO:teuthology.orchestra.run.smithi040.stdout: bluestore block size = 96636764160 2023-10-08T06:08:35.051 INFO:teuthology.orchestra.run.smithi040.stdout: bluestore fsck on mount = True 2023-10-08T06:08:35.051 INFO:teuthology.orchestra.run.smithi040.stdout: debug bluefs = 1/20 2023-10-08T06:08:35.052 INFO:teuthology.orchestra.run.smithi040.stdout: debug bluestore = 1/20 2023-10-08T06:08:35.052 INFO:teuthology.orchestra.run.smithi040.stdout: debug ms = 1 2023-10-08T06:08:35.052 INFO:teuthology.orchestra.run.smithi040.stdout: debug osd = 20 2023-10-08T06:08:35.052 INFO:teuthology.orchestra.run.smithi040.stdout: debug rocksdb = 4/10 2023-10-08T06:08:35.052 INFO:teuthology.orchestra.run.smithi040.stdout: mon osd backfillfull_ratio = 0.85 2023-10-08T06:08:35.052 INFO:teuthology.orchestra.run.smithi040.stdout: mon osd full ratio = 0.9 2023-10-08T06:08:35.052 INFO:teuthology.orchestra.run.smithi040.stdout: mon osd nearfull ratio = 0.8 2023-10-08T06:08:35.052 INFO:teuthology.orchestra.run.smithi040.stdout: osd failsafe full ratio = 0.95 2023-10-08T06:08:35.052 INFO:teuthology.orchestra.run.smithi040.stdout: osd objectstore = bluestore 2023-10-08T06:08:35.052 INFO:teuthology.orchestra.run.smithi040.stdout: osd op complaint time = 180 2023-10-08T06:08:35.052 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-10-08T06:08:35.052 INFO:teuthology.orchestra.run.smithi040.stdout:[mgr] 2023-10-08T06:08:35.053 INFO:teuthology.orchestra.run.smithi040.stdout: debug ms = 1 2023-10-08T06:08:35.053 INFO:teuthology.orchestra.run.smithi040.stdout: debug mgr = 20 2023-10-08T06:08:35.053 INFO:teuthology.orchestra.run.smithi040.stdout: debug mon = 20 2023-10-08T06:08:35.053 INFO:teuthology.orchestra.run.smithi040.stdout: debug auth = 20 2023-10-08T06:08:35.053 INFO:teuthology.orchestra.run.smithi040.stdout: mon reweight min pgs per osd = 4 2023-10-08T06:08:35.053 INFO:teuthology.orchestra.run.smithi040.stdout: mon reweight min bytes per osd = 10 2023-10-08T06:08:35.053 INFO:teuthology.orchestra.run.smithi040.stdout: mgr/telemetry/nag = false 2023-10-08T06:08:35.053 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-10-08T06:08:35.053 INFO:teuthology.orchestra.run.smithi040.stdout:[mon] 2023-10-08T06:08:35.053 INFO:teuthology.orchestra.run.smithi040.stdout: debug ms = 1 2023-10-08T06:08:35.053 INFO:teuthology.orchestra.run.smithi040.stdout: debug mon = 20 2023-10-08T06:08:35.053 INFO:teuthology.orchestra.run.smithi040.stdout: debug paxos = 20 2023-10-08T06:08:35.054 INFO:teuthology.orchestra.run.smithi040.stdout: debug auth = 20 2023-10-08T06:08:35.054 INFO:teuthology.orchestra.run.smithi040.stdout: mon data avail warn = 5 2023-10-08T06:08:35.054 INFO:teuthology.orchestra.run.smithi040.stdout: mon mgr mkfs grace = 240 2023-10-08T06:08:35.054 INFO:teuthology.orchestra.run.smithi040.stdout: mon reweight min pgs per osd = 4 2023-10-08T06:08:35.054 INFO:teuthology.orchestra.run.smithi040.stdout: mon osd reporter subtree level = osd 2023-10-08T06:08:35.054 INFO:teuthology.orchestra.run.smithi040.stdout: mon osd prime pg temp = true 2023-10-08T06:08:35.054 INFO:teuthology.orchestra.run.smithi040.stdout: mon reweight min bytes per osd = 10 2023-10-08T06:08:35.054 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-10-08T06:08:35.054 INFO:teuthology.orchestra.run.smithi040.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-08T06:08:35.054 INFO:teuthology.orchestra.run.smithi040.stdout: auth mon ticket ttl = 660 # 11m 2023-10-08T06:08:35.054 INFO:teuthology.orchestra.run.smithi040.stdout: auth service ticket ttl = 240 # 4m 2023-10-08T06:08:35.054 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-10-08T06:08:35.055 INFO:teuthology.orchestra.run.smithi040.stdout: # don't complain about insecure global_id in the test suite 2023-10-08T06:08:35.055 INFO:teuthology.orchestra.run.smithi040.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-08T06:08:35.055 INFO:teuthology.orchestra.run.smithi040.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-08T06:08:35.055 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-10-08T06:08:35.055 INFO:teuthology.orchestra.run.smithi040.stdout: # 1m isn't quite enough 2023-10-08T06:08:35.055 INFO:teuthology.orchestra.run.smithi040.stdout: mon_down_mkfs_grace = 2m 2023-10-08T06:08:35.055 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-10-08T06:08:35.055 INFO:teuthology.orchestra.run.smithi040.stdout: mon_warn_on_filestore_osds = false 2023-10-08T06:08:35.055 INFO:teuthology.orchestra.run.smithi040.stdout: mon op complaint time = 120 2023-10-08T06:08:35.055 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-10-08T06:08:35.055 INFO:teuthology.orchestra.run.smithi040.stdout:[client] 2023-10-08T06:08:35.055 INFO:teuthology.orchestra.run.smithi040.stdout: rgw cache enabled = true 2023-10-08T06:08:35.056 INFO:teuthology.orchestra.run.smithi040.stdout: rgw enable ops log = true 2023-10-08T06:08:35.056 INFO:teuthology.orchestra.run.smithi040.stdout: rgw enable usage log = true 2023-10-08T06:08:35.056 INFO:teuthology.orchestra.run.smithi040.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-08T06:08:35.056 INFO:teuthology.orchestra.run.smithi040.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-08T06:08:35.056 INFO:teuthology.orchestra.run.smithi040.stdout: client mount timeout = 600 2023-10-08T06:08:35.056 INFO:teuthology.orchestra.run.smithi040.stdout: debug client = 20 2023-10-08T06:08:35.056 INFO:teuthology.orchestra.run.smithi040.stdout: debug ms = 1 2023-10-08T06:08:35.056 INFO:teuthology.orchestra.run.smithi040.stdout: pid file = "" 2023-10-08T06:08:35.056 INFO:teuthology.orchestra.run.smithi040.stdout: rados mon op timeout = 900 2023-10-08T06:08:35.056 INFO:teuthology.orchestra.run.smithi040.stdout: rados osd op timeout = 900 2023-10-08T06:08:35.056 INFO:teuthology.orchestra.run.smithi040.stdout:[mon.a] 2023-10-08T06:08:35.056 INFO:teuthology.orchestra.run.smithi040.stdout:[mon.b] 2023-10-08T06:08:35.057 INFO:teuthology.orchestra.run.smithi040.stdout:[mon.c] 2023-10-08T06:08:35.057 INFO:teuthology.orchestra.run.smithi040.stdout:[mds.a] 2023-10-08T06:08:35.057 INFO:teuthology.orchestra.run.smithi040.stdout:[mds.c] 2023-10-08T06:08:35.057 INFO:teuthology.orchestra.run.smithi040.stdout:[mds.b] 2023-10-08T06:08:35.057 INFO:teuthology.orchestra.run.smithi040.stdout:[mds.d] 2023-10-08T06:08:35.057 INFO:teuthology.orchestra.run.smithi040.stdout:[mds] 2023-10-08T06:08:35.057 INFO:teuthology.orchestra.run.smithi040.stdout: debug mds = 20 2023-10-08T06:08:35.057 INFO:teuthology.orchestra.run.smithi040.stdout: debug mds balancer = 20 2023-10-08T06:08:35.057 INFO:teuthology.orchestra.run.smithi040.stdout: debug ms = 1 2023-10-08T06:08:35.057 INFO:teuthology.orchestra.run.smithi040.stdout: mds debug frag = True 2023-10-08T06:08:35.057 INFO:teuthology.orchestra.run.smithi040.stdout: mds debug scatterstat = True 2023-10-08T06:08:35.057 INFO:teuthology.orchestra.run.smithi040.stdout: mds op complaint time = 180 2023-10-08T06:08:35.058 INFO:teuthology.orchestra.run.smithi040.stdout: mds verify scatter = True 2023-10-08T06:08:35.058 INFO:teuthology.orchestra.run.smithi040.stdout: osd op complaint time = 180 2023-10-08T06:08:35.058 INFO:teuthology.orchestra.run.smithi040.stdout: rados mon op timeout = 900 2023-10-08T06:08:35.058 INFO:teuthology.orchestra.run.smithi040.stdout: rados osd op timeout = 900 2023-10-08T06:08:35.058 INFO:tasks.ceph:Creating admin key on mon.a... 2023-10-08T06:08:35.058 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-10-08T06:08:35.113 INFO:tasks.ceph:Copying monmap to all nodes... 2023-10-08T06:08:35.113 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2023-10-08T06:08:35.113 DEBUG:teuthology.orchestra.run.smithi032:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-10-08T06:08:35.118 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2023-10-08T06:08:35.118 DEBUG:teuthology.orchestra.run.smithi032:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-10-08T06:08:35.124 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi032.front.sepia.ceph.com 2023-10-08T06:08:35.124 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2023-10-08T06:08:35.124 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd of=/etc/ceph/ceph.keyring 2023-10-08T06:08:35.125 DEBUG:teuthology.orchestra.run.smithi032:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-08T06:08:35.148 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2023-10-08T06:08:35.148 DEBUG:teuthology.orchestra.run.smithi032:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-10-08T06:08:35.154 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi040.front.sepia.ceph.com 2023-10-08T06:08:35.155 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-10-08T06:08:35.155 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd of=/etc/ceph/ceph.keyring 2023-10-08T06:08:35.155 DEBUG:teuthology.orchestra.run.smithi040:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-08T06:08:35.180 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-10-08T06:08:35.181 DEBUG:teuthology.orchestra.run.smithi040:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-10-08T06:08:35.188 INFO:tasks.ceph:Setting up mon nodes... 2023-10-08T06:08:35.188 INFO:tasks.ceph:Setting up mgr nodes... 2023-10-08T06:08:35.188 DEBUG:teuthology.orchestra.run.smithi032:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-10-08T06:08:35.248 INFO:teuthology.orchestra.run.smithi032.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-10-08T06:08:35.251 DEBUG:teuthology.orchestra.run.smithi040:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-10-08T06:08:35.305 INFO:teuthology.orchestra.run.smithi040.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-10-08T06:08:35.322 INFO:tasks.ceph:Setting up mds nodes... 2023-10-08T06:08:35.322 DEBUG:teuthology.orchestra.run.smithi032:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-10-08T06:08:35.375 INFO:teuthology.orchestra.run.smithi032.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-10-08T06:08:35.378 DEBUG:teuthology.orchestra.run.smithi032:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-10-08T06:08:35.388 DEBUG:teuthology.orchestra.run.smithi032:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-10-08T06:08:35.481 INFO:teuthology.orchestra.run.smithi032.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-10-08T06:08:35.484 DEBUG:teuthology.orchestra.run.smithi032:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-10-08T06:08:35.500 DEBUG:teuthology.orchestra.run.smithi040:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-10-08T06:08:35.551 INFO:teuthology.orchestra.run.smithi040.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-10-08T06:08:35.555 DEBUG:teuthology.orchestra.run.smithi040:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-10-08T06:08:35.565 DEBUG:teuthology.orchestra.run.smithi040:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-10-08T06:08:35.616 INFO:teuthology.orchestra.run.smithi040.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-10-08T06:08:35.619 DEBUG:teuthology.orchestra.run.smithi040:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-10-08T06:08:35.629 INFO:tasks.ceph_client:Setting up client nodes... 2023-10-08T06:08:35.630 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-10-08T06:08:35.672 INFO:teuthology.orchestra.run.smithi032.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-10-08T06:08:35.687 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2023-10-08T06:08:35.772 INFO:teuthology.orchestra.run.smithi032.stdout:creating /etc/ceph/ceph.client.2.keyring 2023-10-08T06:08:35.785 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-10-08T06:08:35.829 INFO:teuthology.orchestra.run.smithi040.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-10-08T06:08:35.842 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2023-10-08T06:08:35.878 INFO:teuthology.orchestra.run.smithi040.stdout:creating /etc/ceph/ceph.client.3.keyring 2023-10-08T06:08:35.891 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-10-08T06:08:35.891 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi032.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi040.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-10-08T06:08:35.891 DEBUG:teuthology.orchestra.run.smithi032:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-10-08T06:08:35.908 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-08T06:08:35.908 INFO:tasks.ceph:role: osd.0 2023-10-08T06:08:35.908 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi032.front.sepia.ceph.com 2023-10-08T06:08:35.908 DEBUG:teuthology.orchestra.run.smithi032:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-10-08T06:08:35.992 INFO:teuthology.orchestra.run.smithi032.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-10-08T06:08:35.992 INFO:teuthology.orchestra.run.smithi032.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-08T06:08:35.992 INFO:teuthology.orchestra.run.smithi032.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-08T06:08:35.992 INFO:teuthology.orchestra.run.smithi032.stdout: = reflink=1 2023-10-08T06:08:35.992 INFO:teuthology.orchestra.run.smithi032.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-08T06:08:35.992 INFO:teuthology.orchestra.run.smithi032.stdout: = sunit=0 swidth=0 blks 2023-10-08T06:08:35.992 INFO:teuthology.orchestra.run.smithi032.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-08T06:08:35.993 INFO:teuthology.orchestra.run.smithi032.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-08T06:08:35.993 INFO:teuthology.orchestra.run.smithi032.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-08T06:08:35.993 INFO:teuthology.orchestra.run.smithi032.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-08T06:08:35.994 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi032.front.sepia.ceph.com -o noatime 2023-10-08T06:08:35.994 DEBUG:teuthology.orchestra.run.smithi032:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-10-08T06:08:36.016 DEBUG:teuthology.orchestra.run.smithi032:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-10-08T06:08:36.024 INFO:teuthology.orchestra.run.smithi032.stderr:sudo: /sbin/restorecon: command not found 2023-10-08T06:08:36.025 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T06:08:36.025 DEBUG:teuthology.orchestra.run.smithi032:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-10-08T06:08:36.037 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-08T06:08:36.037 INFO:tasks.ceph:role: osd.1 2023-10-08T06:08:36.037 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi032.front.sepia.ceph.com 2023-10-08T06:08:36.038 DEBUG:teuthology.orchestra.run.smithi032:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-10-08T06:08:36.079 INFO:teuthology.orchestra.run.smithi032.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-10-08T06:08:36.079 INFO:teuthology.orchestra.run.smithi032.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-08T06:08:36.079 INFO:teuthology.orchestra.run.smithi032.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-08T06:08:36.079 INFO:teuthology.orchestra.run.smithi032.stdout: = reflink=1 2023-10-08T06:08:36.080 INFO:teuthology.orchestra.run.smithi032.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-08T06:08:36.080 INFO:teuthology.orchestra.run.smithi032.stdout: = sunit=0 swidth=0 blks 2023-10-08T06:08:36.080 INFO:teuthology.orchestra.run.smithi032.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-08T06:08:36.080 INFO:teuthology.orchestra.run.smithi032.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-08T06:08:36.080 INFO:teuthology.orchestra.run.smithi032.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-08T06:08:36.080 INFO:teuthology.orchestra.run.smithi032.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-08T06:08:36.081 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi032.front.sepia.ceph.com -o noatime 2023-10-08T06:08:36.081 DEBUG:teuthology.orchestra.run.smithi032:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-10-08T06:08:36.147 DEBUG:teuthology.orchestra.run.smithi032:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-10-08T06:08:36.156 INFO:teuthology.orchestra.run.smithi032.stderr:sudo: /sbin/restorecon: command not found 2023-10-08T06:08:36.156 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T06:08:36.157 DEBUG:teuthology.orchestra.run.smithi032:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-10-08T06:08:36.168 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-08T06:08:36.168 INFO:tasks.ceph:role: osd.2 2023-10-08T06:08:36.169 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi032.front.sepia.ceph.com 2023-10-08T06:08:36.169 DEBUG:teuthology.orchestra.run.smithi032:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-10-08T06:08:36.211 INFO:teuthology.orchestra.run.smithi032.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-10-08T06:08:36.212 INFO:teuthology.orchestra.run.smithi032.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-08T06:08:36.212 INFO:teuthology.orchestra.run.smithi032.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-08T06:08:36.212 INFO:teuthology.orchestra.run.smithi032.stdout: = reflink=1 2023-10-08T06:08:36.212 INFO:teuthology.orchestra.run.smithi032.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-08T06:08:36.212 INFO:teuthology.orchestra.run.smithi032.stdout: = sunit=0 swidth=0 blks 2023-10-08T06:08:36.212 INFO:teuthology.orchestra.run.smithi032.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-08T06:08:36.212 INFO:teuthology.orchestra.run.smithi032.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-08T06:08:36.212 INFO:teuthology.orchestra.run.smithi032.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-08T06:08:36.212 INFO:teuthology.orchestra.run.smithi032.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-08T06:08:36.213 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi032.front.sepia.ceph.com -o noatime 2023-10-08T06:08:36.213 DEBUG:teuthology.orchestra.run.smithi032:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-10-08T06:08:36.278 DEBUG:teuthology.orchestra.run.smithi032:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-10-08T06:08:36.287 INFO:teuthology.orchestra.run.smithi032.stderr:sudo: /sbin/restorecon: command not found 2023-10-08T06:08:36.287 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T06:08:36.288 DEBUG:teuthology.orchestra.run.smithi032:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-10-08T06:08:36.297 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-08T06:08:36.297 INFO:tasks.ceph:role: osd.3 2023-10-08T06:08:36.298 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi032.front.sepia.ceph.com 2023-10-08T06:08:36.298 DEBUG:teuthology.orchestra.run.smithi032:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-10-08T06:08:36.384 INFO:teuthology.orchestra.run.smithi032.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-10-08T06:08:36.384 INFO:teuthology.orchestra.run.smithi032.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-08T06:08:36.385 INFO:teuthology.orchestra.run.smithi032.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-08T06:08:36.385 INFO:teuthology.orchestra.run.smithi032.stdout: = reflink=1 2023-10-08T06:08:36.385 INFO:teuthology.orchestra.run.smithi032.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-08T06:08:36.385 INFO:teuthology.orchestra.run.smithi032.stdout: = sunit=0 swidth=0 blks 2023-10-08T06:08:36.385 INFO:teuthology.orchestra.run.smithi032.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-08T06:08:36.385 INFO:teuthology.orchestra.run.smithi032.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-08T06:08:36.385 INFO:teuthology.orchestra.run.smithi032.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-08T06:08:36.385 INFO:teuthology.orchestra.run.smithi032.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-08T06:08:36.386 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi032.front.sepia.ceph.com -o noatime 2023-10-08T06:08:36.386 DEBUG:teuthology.orchestra.run.smithi032:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-10-08T06:08:36.404 DEBUG:teuthology.orchestra.run.smithi032:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-10-08T06:08:36.412 INFO:teuthology.orchestra.run.smithi032.stderr:sudo: /sbin/restorecon: command not found 2023-10-08T06:08:36.413 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T06:08:36.413 DEBUG:teuthology.orchestra.run.smithi032:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-08T06:08:36.489 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:08:36.480+0000 7f0832e70700 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-10-08T06:08:36.489 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:08:36.480+0000 7f0832e70700 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-10-08T06:08:36.489 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:08:36.484+0000 7f0832e70700 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-08T06:08:36.489 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:08:36.484+0000 7f0832e70700 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-08T06:08:36.489 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:08:36.484+0000 7f0832e70700 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-08T06:08:36.490 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:08:36.484+0000 7f0832e70700 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-10-08T06:08:39.505 DEBUG:teuthology.orchestra.run.smithi032:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-10-08T06:08:39.521 DEBUG:teuthology.orchestra.run.smithi032:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-08T06:08:39.568 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:08:39.560+0000 7f3be7dcf700 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-10-08T06:08:39.568 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:08:39.560+0000 7f3be7dcf700 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-10-08T06:08:39.568 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:08:39.560+0000 7f3be7dcf700 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-08T06:08:39.568 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:08:39.560+0000 7f3be7dcf700 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-08T06:08:39.568 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:08:39.560+0000 7f3be7dcf700 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-08T06:08:39.569 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:08:39.560+0000 7f3be7dcf700 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-10-08T06:08:42.581 DEBUG:teuthology.orchestra.run.smithi032:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-10-08T06:08:42.595 DEBUG:teuthology.orchestra.run.smithi032:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-08T06:08:42.638 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:08:42.636+0000 7fa112dcb700 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-10-08T06:08:42.639 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:08:42.636+0000 7fa112dcb700 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-10-08T06:08:42.639 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:08:42.636+0000 7fa112dcb700 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-08T06:08:42.639 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:08:42.636+0000 7fa112dcb700 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-08T06:08:42.639 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:08:42.636+0000 7fa112dcb700 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-08T06:08:42.639 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:08:42.636+0000 7fa112dcb700 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-10-08T06:08:45.660 DEBUG:teuthology.orchestra.run.smithi032:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-10-08T06:08:45.720 DEBUG:teuthology.orchestra.run.smithi032:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-08T06:08:45.763 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:08:45.756+0000 7f9bfa7e8700 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-10-08T06:08:45.764 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:08:45.756+0000 7f9bfa7e8700 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-10-08T06:08:45.764 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:08:45.756+0000 7f9bfa7e8700 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-08T06:08:45.764 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:08:45.756+0000 7f9bfa7e8700 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-08T06:08:45.764 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:08:45.756+0000 7f9bfa7e8700 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-08T06:08:45.764 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:08:45.756+0000 7f9bfa7e8700 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-10-08T06:08:48.763 DEBUG:teuthology.orchestra.run.smithi032:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-10-08T06:08:48.780 DEBUG:teuthology.orchestra.run.smithi040:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-10-08T06:08:48.797 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-08T06:08:48.797 INFO:tasks.ceph:role: osd.4 2023-10-08T06:08:48.798 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi040.front.sepia.ceph.com 2023-10-08T06:08:48.798 DEBUG:teuthology.orchestra.run.smithi040:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-10-08T06:08:49.336 INFO:teuthology.orchestra.run.smithi040.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-10-08T06:08:49.336 INFO:teuthology.orchestra.run.smithi040.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-08T06:08:49.337 INFO:teuthology.orchestra.run.smithi040.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-08T06:08:49.337 INFO:teuthology.orchestra.run.smithi040.stdout: = reflink=1 2023-10-08T06:08:49.337 INFO:teuthology.orchestra.run.smithi040.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-08T06:08:49.337 INFO:teuthology.orchestra.run.smithi040.stdout: = sunit=0 swidth=0 blks 2023-10-08T06:08:49.337 INFO:teuthology.orchestra.run.smithi040.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-08T06:08:49.337 INFO:teuthology.orchestra.run.smithi040.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-08T06:08:49.337 INFO:teuthology.orchestra.run.smithi040.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-08T06:08:49.337 INFO:teuthology.orchestra.run.smithi040.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-08T06:08:49.339 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi040.front.sepia.ceph.com -o noatime 2023-10-08T06:08:49.339 DEBUG:teuthology.orchestra.run.smithi040:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-10-08T06:08:49.451 DEBUG:teuthology.orchestra.run.smithi040:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-10-08T06:08:49.463 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T06:08:49.464 INFO:teuthology.orchestra.run.smithi040.stderr:sudo: /sbin/restorecon: command not found 2023-10-08T06:08:49.464 DEBUG:teuthology.orchestra.run.smithi040:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-10-08T06:08:49.479 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-08T06:08:49.479 INFO:tasks.ceph:role: osd.5 2023-10-08T06:08:49.479 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi040.front.sepia.ceph.com 2023-10-08T06:08:49.479 DEBUG:teuthology.orchestra.run.smithi040:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-10-08T06:08:49.989 INFO:teuthology.orchestra.run.smithi040.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-10-08T06:08:49.990 INFO:teuthology.orchestra.run.smithi040.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-08T06:08:49.990 INFO:teuthology.orchestra.run.smithi040.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-08T06:08:49.990 INFO:teuthology.orchestra.run.smithi040.stdout: = reflink=1 2023-10-08T06:08:49.990 INFO:teuthology.orchestra.run.smithi040.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-08T06:08:49.990 INFO:teuthology.orchestra.run.smithi040.stdout: = sunit=0 swidth=0 blks 2023-10-08T06:08:49.990 INFO:teuthology.orchestra.run.smithi040.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-08T06:08:49.990 INFO:teuthology.orchestra.run.smithi040.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-08T06:08:49.991 INFO:teuthology.orchestra.run.smithi040.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-08T06:08:49.991 INFO:teuthology.orchestra.run.smithi040.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-08T06:08:49.992 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi040.front.sepia.ceph.com -o noatime 2023-10-08T06:08:49.992 DEBUG:teuthology.orchestra.run.smithi040:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-10-08T06:08:50.023 DEBUG:teuthology.orchestra.run.smithi040:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-10-08T06:08:50.033 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T06:08:50.034 INFO:teuthology.orchestra.run.smithi040.stderr:sudo: /sbin/restorecon: command not found 2023-10-08T06:08:50.034 DEBUG:teuthology.orchestra.run.smithi040:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-10-08T06:08:50.045 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-08T06:08:50.045 INFO:tasks.ceph:role: osd.6 2023-10-08T06:08:50.045 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi040.front.sepia.ceph.com 2023-10-08T06:08:50.045 DEBUG:teuthology.orchestra.run.smithi040:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-10-08T06:08:50.562 INFO:teuthology.orchestra.run.smithi040.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-10-08T06:08:50.562 INFO:teuthology.orchestra.run.smithi040.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-08T06:08:50.562 INFO:teuthology.orchestra.run.smithi040.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-08T06:08:50.562 INFO:teuthology.orchestra.run.smithi040.stdout: = reflink=1 2023-10-08T06:08:50.562 INFO:teuthology.orchestra.run.smithi040.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-08T06:08:50.563 INFO:teuthology.orchestra.run.smithi040.stdout: = sunit=0 swidth=0 blks 2023-10-08T06:08:50.563 INFO:teuthology.orchestra.run.smithi040.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-08T06:08:50.563 INFO:teuthology.orchestra.run.smithi040.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-08T06:08:50.563 INFO:teuthology.orchestra.run.smithi040.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-08T06:08:50.563 INFO:teuthology.orchestra.run.smithi040.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-08T06:08:50.564 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi040.front.sepia.ceph.com -o noatime 2023-10-08T06:08:50.564 DEBUG:teuthology.orchestra.run.smithi040:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-10-08T06:08:50.607 DEBUG:teuthology.orchestra.run.smithi040:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-10-08T06:08:50.615 INFO:teuthology.orchestra.run.smithi040.stderr:sudo: /sbin/restorecon: command not found 2023-10-08T06:08:50.616 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T06:08:50.616 DEBUG:teuthology.orchestra.run.smithi040:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-10-08T06:08:50.675 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-08T06:08:50.676 INFO:tasks.ceph:role: osd.7 2023-10-08T06:08:50.676 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi040.front.sepia.ceph.com 2023-10-08T06:08:50.676 DEBUG:teuthology.orchestra.run.smithi040:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-10-08T06:08:51.192 INFO:teuthology.orchestra.run.smithi040.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-10-08T06:08:51.192 INFO:teuthology.orchestra.run.smithi040.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-08T06:08:51.192 INFO:teuthology.orchestra.run.smithi040.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-08T06:08:51.192 INFO:teuthology.orchestra.run.smithi040.stdout: = reflink=1 2023-10-08T06:08:51.192 INFO:teuthology.orchestra.run.smithi040.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-08T06:08:51.192 INFO:teuthology.orchestra.run.smithi040.stdout: = sunit=0 swidth=0 blks 2023-10-08T06:08:51.192 INFO:teuthology.orchestra.run.smithi040.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-08T06:08:51.192 INFO:teuthology.orchestra.run.smithi040.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-08T06:08:51.192 INFO:teuthology.orchestra.run.smithi040.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-08T06:08:51.192 INFO:teuthology.orchestra.run.smithi040.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-08T06:08:51.194 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi040.front.sepia.ceph.com -o noatime 2023-10-08T06:08:51.194 DEBUG:teuthology.orchestra.run.smithi040:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-10-08T06:08:51.255 DEBUG:teuthology.orchestra.run.smithi040:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-10-08T06:08:51.265 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T06:08:51.266 INFO:teuthology.orchestra.run.smithi040.stderr:sudo: /sbin/restorecon: command not found 2023-10-08T06:08:51.266 DEBUG:teuthology.orchestra.run.smithi040:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-08T06:08:51.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:08:51.346+0000 7f6798bd8700 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-10-08T06:08:51.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:08:51.346+0000 7f6798bd8700 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-10-08T06:08:51.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:08:51.346+0000 7f6798bd8700 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-10-08T06:08:51.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:08:51.346+0000 7f6798bd8700 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-10-08T06:08:51.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:08:51.346+0000 7f6798bd8700 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-10-08T06:08:51.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:08:51.354+0000 7f6798bd8700 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-10-08T06:08:54.620 DEBUG:teuthology.orchestra.run.smithi040:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-10-08T06:08:54.635 DEBUG:teuthology.orchestra.run.smithi040:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-08T06:08:54.683 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:08:54.674+0000 7fb1e9097700 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-10-08T06:08:54.683 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:08:54.678+0000 7fb1e9097700 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-10-08T06:08:54.683 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:08:54.678+0000 7fb1e9097700 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-10-08T06:08:54.684 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:08:54.678+0000 7fb1e9097700 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-10-08T06:08:54.684 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:08:54.678+0000 7fb1e9097700 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-10-08T06:08:54.684 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:08:54.678+0000 7fb1e9097700 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-10-08T06:08:57.922 DEBUG:teuthology.orchestra.run.smithi040:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-10-08T06:08:57.935 DEBUG:teuthology.orchestra.run.smithi040:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-08T06:08:57.980 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:08:57.974+0000 7fa61f035700 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-10-08T06:08:57.981 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:08:57.974+0000 7fa61f035700 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-10-08T06:08:57.981 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:08:57.974+0000 7fa61f035700 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-10-08T06:08:57.981 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:08:57.974+0000 7fa61f035700 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-10-08T06:08:57.981 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:08:57.974+0000 7fa61f035700 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-10-08T06:08:57.981 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:08:57.974+0000 7fa61f035700 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-10-08T06:09:00.990 DEBUG:teuthology.orchestra.run.smithi040:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-10-08T06:09:01.006 DEBUG:teuthology.orchestra.run.smithi040:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-08T06:09:01.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:01.042+0000 7f554eb51700 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-10-08T06:09:01.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:01.042+0000 7f554eb51700 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-10-08T06:09:01.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:01.042+0000 7f554eb51700 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-10-08T06:09:01.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:01.042+0000 7f554eb51700 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-10-08T06:09:01.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:01.042+0000 7f554eb51700 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-10-08T06:09:01.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:01.042+0000 7f554eb51700 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-10-08T06:09:04.033 DEBUG:teuthology.orchestra.run.smithi040:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-10-08T06:09:04.048 INFO:tasks.ceph:Reading keys from all nodes... 2023-10-08T06:09:04.048 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2023-10-08T06:09:04.048 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-10-08T06:09:04.065 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2023-10-08T06:09:04.065 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-10-08T06:09:04.080 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2023-10-08T06:09:04.081 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-10-08T06:09:04.093 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2023-10-08T06:09:04.093 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-10-08T06:09:04.142 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T06:09:04.144 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T06:09:04.150 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2023-10-08T06:09:04.150 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-10-08T06:09:04.166 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2023-10-08T06:09:04.166 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-10-08T06:09:04.180 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2023-10-08T06:09:04.181 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-10-08T06:09:04.189 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-10-08T06:09:04.190 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-10-08T06:09:04.206 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-10-08T06:09:04.206 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-10-08T06:09:04.216 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-10-08T06:09:04.216 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-10-08T06:09:04.273 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-10-08T06:09:04.274 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-10-08T06:09:04.284 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-10-08T06:09:04.284 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-10-08T06:09:04.295 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-10-08T06:09:04.295 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-10-08T06:09:04.306 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-10-08T06:09:04.306 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-10-08T06:09:04.317 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2023-10-08T06:09:04.317 DEBUG:teuthology.orchestra.run.smithi032:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-10-08T06:09:04.324 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2023-10-08T06:09:04.324 DEBUG:teuthology.orchestra.run.smithi032:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2023-10-08T06:09:04.374 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-10-08T06:09:04.374 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-10-08T06:09:04.381 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-10-08T06:09:04.381 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2023-10-08T06:09:04.388 INFO:tasks.ceph:Adding keys to all mons... 2023-10-08T06:09:04.388 DEBUG:teuthology.orchestra.run.smithi032:> sudo tee -a /etc/ceph/ceph.keyring 2023-10-08T06:09:04.390 DEBUG:teuthology.orchestra.run.smithi040:> sudo tee -a /etc/ceph/ceph.keyring 2023-10-08T06:09:04.401 INFO:teuthology.orchestra.run.smithi032.stdout:[mgr.y] 2023-10-08T06:09:04.401 INFO:teuthology.orchestra.run.smithi032.stdout: key = AQBjRyJlowrCDhAA7uyEy/ddM9ADWWblpjpDoQ== 2023-10-08T06:09:04.401 INFO:teuthology.orchestra.run.smithi032.stdout:[mds.a] 2023-10-08T06:09:04.402 INFO:teuthology.orchestra.run.smithi032.stdout: key = AQBjRyJlvORRFhAAZ9COCXQ86hsbHEr9NkFHmg== 2023-10-08T06:09:04.402 INFO:teuthology.orchestra.run.smithi032.stdout:[mds.c] 2023-10-08T06:09:04.402 INFO:teuthology.orchestra.run.smithi032.stdout: key = AQBjRyJlgt6nHBAAzHtV4VfFFM+6ShUPMlFf+w== 2023-10-08T06:09:04.402 INFO:teuthology.orchestra.run.smithi032.stdout:[osd.0] 2023-10-08T06:09:04.402 INFO:teuthology.orchestra.run.smithi032.stdout: key = AQBkRyJl0rgbHRAApabneNsWCIlgs8WhUzMtlg== 2023-10-08T06:09:04.402 INFO:teuthology.orchestra.run.smithi032.stdout:[osd.1] 2023-10-08T06:09:04.402 INFO:teuthology.orchestra.run.smithi032.stdout: key = AQBnRyJlnurPIRAA9cpYTYzj73O5yoBViRJmhw== 2023-10-08T06:09:04.402 INFO:teuthology.orchestra.run.smithi032.stdout:[osd.2] 2023-10-08T06:09:04.402 INFO:teuthology.orchestra.run.smithi032.stdout: key = AQBqRyJl9rwGJhAAUtE0vcl7UmetgoSKHg+1NQ== 2023-10-08T06:09:04.402 INFO:teuthology.orchestra.run.smithi032.stdout:[osd.3] 2023-10-08T06:09:04.402 INFO:teuthology.orchestra.run.smithi032.stdout: key = AQBtRyJlpsN2LRAAOvOV5J1kRzHSMNurHWWuHA== 2023-10-08T06:09:04.403 INFO:teuthology.orchestra.run.smithi032.stdout:[mgr.x] 2023-10-08T06:09:04.403 INFO:teuthology.orchestra.run.smithi032.stdout: key = AQBjRyJlfXcZEhAAjRoxbj//YUe7PWPJexMYCQ== 2023-10-08T06:09:04.403 INFO:teuthology.orchestra.run.smithi032.stdout:[mds.b] 2023-10-08T06:09:04.403 INFO:teuthology.orchestra.run.smithi032.stdout: key = AQBjRyJl++THIBAA98IgS2NszGlo8TGhVMAWvA== 2023-10-08T06:09:04.403 INFO:teuthology.orchestra.run.smithi032.stdout:[mds.d] 2023-10-08T06:09:04.403 INFO:teuthology.orchestra.run.smithi032.stdout: key = AQBjRyJlXXOdJBAAWB1DeSxEUItTLqe/RfrecA== 2023-10-08T06:09:04.403 INFO:teuthology.orchestra.run.smithi032.stdout:[osd.4] 2023-10-08T06:09:04.403 INFO:teuthology.orchestra.run.smithi032.stdout: key = AQBzRyJlO/XgFBAAMhZTH+xTiAubxzvwebdApw== 2023-10-08T06:09:04.403 INFO:teuthology.orchestra.run.smithi032.stdout:[osd.5] 2023-10-08T06:09:04.403 INFO:teuthology.orchestra.run.smithi032.stdout: key = AQB2RyJlHqCjKBAA9rhMXCwhv1kz+IzmceNMoA== 2023-10-08T06:09:04.403 INFO:teuthology.orchestra.run.smithi032.stdout:[osd.6] 2023-10-08T06:09:04.403 INFO:teuthology.orchestra.run.smithi032.stdout: key = AQB5RyJlTG1fOhAAe1TfJMpOEl0SSfVFcQR80g== 2023-10-08T06:09:04.404 INFO:teuthology.orchestra.run.smithi032.stdout:[osd.7] 2023-10-08T06:09:04.404 INFO:teuthology.orchestra.run.smithi032.stdout: key = AQB9RyJlLy3SAhAABRysNqQaO9Paow3CdfG/Cg== 2023-10-08T06:09:04.404 INFO:teuthology.orchestra.run.smithi032.stdout:[client.0] 2023-10-08T06:09:04.404 INFO:teuthology.orchestra.run.smithi032.stdout: key = AQBjRyJljskKKBAALCz7TUBic1qBcdHhz2xJFQ== 2023-10-08T06:09:04.404 INFO:teuthology.orchestra.run.smithi032.stdout:[client.2] 2023-10-08T06:09:04.404 INFO:teuthology.orchestra.run.smithi032.stdout: key = AQBjRyJlF039LRAA6b24sU4JB/lqjdqDl2bWXg== 2023-10-08T06:09:04.404 INFO:teuthology.orchestra.run.smithi032.stdout:[client.1] 2023-10-08T06:09:04.404 INFO:teuthology.orchestra.run.smithi032.stdout: key = AQBjRyJljexTMRAAtP/qnlz76ImthOacAp5G8g== 2023-10-08T06:09:04.404 INFO:teuthology.orchestra.run.smithi032.stdout:[client.3] 2023-10-08T06:09:04.404 INFO:teuthology.orchestra.run.smithi032.stdout: key = AQBjRyJlZ9hENBAAHx6cqN4InNUPTGKdNn41ZA== 2023-10-08T06:09:04.406 INFO:teuthology.orchestra.run.smithi040.stdout:[mgr.y] 2023-10-08T06:09:04.406 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQBjRyJlowrCDhAA7uyEy/ddM9ADWWblpjpDoQ== 2023-10-08T06:09:04.406 INFO:teuthology.orchestra.run.smithi040.stdout:[mds.a] 2023-10-08T06:09:04.406 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQBjRyJlvORRFhAAZ9COCXQ86hsbHEr9NkFHmg== 2023-10-08T06:09:04.406 INFO:teuthology.orchestra.run.smithi040.stdout:[mds.c] 2023-10-08T06:09:04.406 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQBjRyJlgt6nHBAAzHtV4VfFFM+6ShUPMlFf+w== 2023-10-08T06:09:04.406 INFO:teuthology.orchestra.run.smithi040.stdout:[osd.0] 2023-10-08T06:09:04.406 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQBkRyJl0rgbHRAApabneNsWCIlgs8WhUzMtlg== 2023-10-08T06:09:04.406 INFO:teuthology.orchestra.run.smithi040.stdout:[osd.1] 2023-10-08T06:09:04.407 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQBnRyJlnurPIRAA9cpYTYzj73O5yoBViRJmhw== 2023-10-08T06:09:04.407 INFO:teuthology.orchestra.run.smithi040.stdout:[osd.2] 2023-10-08T06:09:04.407 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQBqRyJl9rwGJhAAUtE0vcl7UmetgoSKHg+1NQ== 2023-10-08T06:09:04.407 INFO:teuthology.orchestra.run.smithi040.stdout:[osd.3] 2023-10-08T06:09:04.407 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQBtRyJlpsN2LRAAOvOV5J1kRzHSMNurHWWuHA== 2023-10-08T06:09:04.407 INFO:teuthology.orchestra.run.smithi040.stdout:[mgr.x] 2023-10-08T06:09:04.407 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQBjRyJlfXcZEhAAjRoxbj//YUe7PWPJexMYCQ== 2023-10-08T06:09:04.407 INFO:teuthology.orchestra.run.smithi040.stdout:[mds.b] 2023-10-08T06:09:04.407 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQBjRyJl++THIBAA98IgS2NszGlo8TGhVMAWvA== 2023-10-08T06:09:04.407 INFO:teuthology.orchestra.run.smithi040.stdout:[mds.d] 2023-10-08T06:09:04.407 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQBjRyJlXXOdJBAAWB1DeSxEUItTLqe/RfrecA== 2023-10-08T06:09:04.407 INFO:teuthology.orchestra.run.smithi040.stdout:[osd.4] 2023-10-08T06:09:04.408 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQBzRyJlO/XgFBAAMhZTH+xTiAubxzvwebdApw== 2023-10-08T06:09:04.408 INFO:teuthology.orchestra.run.smithi040.stdout:[osd.5] 2023-10-08T06:09:04.408 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQB2RyJlHqCjKBAA9rhMXCwhv1kz+IzmceNMoA== 2023-10-08T06:09:04.408 INFO:teuthology.orchestra.run.smithi040.stdout:[osd.6] 2023-10-08T06:09:04.408 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQB5RyJlTG1fOhAAe1TfJMpOEl0SSfVFcQR80g== 2023-10-08T06:09:04.408 INFO:teuthology.orchestra.run.smithi040.stdout:[osd.7] 2023-10-08T06:09:04.408 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQB9RyJlLy3SAhAABRysNqQaO9Paow3CdfG/Cg== 2023-10-08T06:09:04.408 INFO:teuthology.orchestra.run.smithi040.stdout:[client.0] 2023-10-08T06:09:04.408 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQBjRyJljskKKBAALCz7TUBic1qBcdHhz2xJFQ== 2023-10-08T06:09:04.408 INFO:teuthology.orchestra.run.smithi040.stdout:[client.2] 2023-10-08T06:09:04.408 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQBjRyJlF039LRAA6b24sU4JB/lqjdqDl2bWXg== 2023-10-08T06:09:04.409 INFO:teuthology.orchestra.run.smithi040.stdout:[client.1] 2023-10-08T06:09:04.409 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQBjRyJljexTMRAAtP/qnlz76ImthOacAp5G8g== 2023-10-08T06:09:04.409 INFO:teuthology.orchestra.run.smithi040.stdout:[client.3] 2023-10-08T06:09:04.409 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQBjRyJlZ9hENBAAHx6cqN4InNUPTGKdNn41ZA== 2023-10-08T06:09:04.409 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-08T06:09:04.449 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-08T06:09:04.503 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-08T06:09:04.504 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-08T06:09:04.556 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-08T06:09:04.558 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-08T06:09:04.611 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-08T06:09:04.613 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-08T06:09:04.661 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-08T06:09:04.702 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-08T06:09:04.754 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-08T06:09:04.756 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-08T06:09:04.805 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-08T06:09:04.807 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-08T06:09:04.855 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-08T06:09:04.857 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-08T06:09:04.906 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-08T06:09:04.908 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-08T06:09:04.960 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-08T06:09:04.962 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-08T06:09:05.018 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-08T06:09:05.020 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-08T06:09:05.070 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-08T06:09:05.072 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-08T06:09:05.120 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-08T06:09:05.122 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-08T06:09:05.169 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-08T06:09:05.171 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-08T06:09:05.223 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-08T06:09:05.224 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-08T06:09:05.387 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-08T06:09:05.389 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-08T06:09:05.497 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-08T06:09:05.499 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-08T06:09:05.566 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-08T06:09:05.568 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-08T06:09:05.622 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-10-08T06:09:05.622 DEBUG:teuthology.orchestra.run.smithi032:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-10-08T06:09:05.638 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-08T06:09:05.718 DEBUG:teuthology.orchestra.run.smithi032:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-10-08T06:09:05.733 DEBUG:teuthology.orchestra.run.smithi040:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-10-08T06:09:05.748 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-08T06:09:05.864 DEBUG:teuthology.orchestra.run.smithi040:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-10-08T06:09:05.879 DEBUG:teuthology.orchestra.run.smithi040:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-10-08T06:09:05.895 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-08T06:09:05.965 DEBUG:teuthology.orchestra.run.smithi040:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-10-08T06:09:05.979 DEBUG:teuthology.orchestra.run.smithi032:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-10-08T06:09:05.981 DEBUG:teuthology.orchestra.run.smithi040:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-10-08T06:09:05.986 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-10-08T06:09:05.986 INFO:tasks.ceph.mon.a:Restarting daemon 2023-10-08T06:09:05.986 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-10-08T06:09:05.988 INFO:tasks.ceph.mon.a:Started 2023-10-08T06:09:05.988 INFO:tasks.ceph.mon.b:Restarting daemon 2023-10-08T06:09:05.989 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-10-08T06:09:05.991 INFO:tasks.ceph.mon.b:Started 2023-10-08T06:09:05.991 INFO:tasks.ceph.mon.c:Restarting daemon 2023-10-08T06:09:05.991 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-10-08T06:09:05.993 INFO:tasks.ceph.mon.c:Started 2023-10-08T06:09:05.993 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-10-08T06:09:05.993 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-10-08T06:09:05.993 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-10-08T06:09:05.995 INFO:tasks.ceph.mgr.y:Started 2023-10-08T06:09:05.996 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-10-08T06:09:05.996 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-10-08T06:09:05.998 INFO:tasks.ceph.mgr.x:Started 2023-10-08T06:09:05.998 INFO:tasks.ceph:Setting crush tunables to default 2023-10-08T06:09:05.998 DEBUG:teuthology.orchestra.run.smithi032:> sudo ceph --cluster ceph osd crush tunables default 2023-10-08T06:09:06.112 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:06.108+0000 7f2a533db700 1 Processor -- start 2023-10-08T06:09:06.113 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:06.108+0000 7f2a533db700 1 -- start start 2023-10-08T06:09:06.115 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:06.108+0000 7f2a533db700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2a44033770 0x7f2a44038800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:06.115 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:06.108+0000 7f2a533db700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a44033fa0 con 0x7f2a440e10c0 2023-10-08T06:09:06.115 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:06.108+0000 7f2a533db700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a4404f980 con 0x7f2a4403a810 2023-10-08T06:09:06.115 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:06.108+0000 7f2a533db700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a44033cc0 con 0x7f2a44033770 2023-10-08T06:09:06.115 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:06.108+0000 7f2a523d9700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f2a440e10c0 0x7f2a4403a100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:47744/0 (socket says 172.21.15.32:47744) 2023-10-08T06:09:06.115 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:06.108+0000 7f2a523d9700 1 -- 172.21.15.32:0/3139016653 learned_addr learned my addr 172.21.15.32:0/3139016653 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-08T06:09:06.116 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:06.108+0000 7f2a52bda700 1 --2- 172.21.15.32:0/3139016653 >> v2:172.21.15.40:3300/0 conn(0x7f2a44033770 0x7f2a44038800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:06.116 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:06.108+0000 7f2a52bda700 1 -- 172.21.15.32:0/3139016653 >> v2:172.21.15.40:3300/0 conn(0x7f2a44033770 msgr2=0x7f2a44038800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-10-08T06:09:06.116 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:06.108+0000 7f2a52bda700 1 -- 172.21.15.32:0/3139016653 >> v2:172.21.15.40:3300/0 conn(0x7f2a44033770 msgr2=0x7f2a44038800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-08T06:09:06.116 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:06.108+0000 7f2a52bda700 1 --2- 172.21.15.32:0/3139016653 >> v2:172.21.15.40:3300/0 conn(0x7f2a44033770 0x7f2a44038800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-08T06:09:06.116 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:06.108+0000 7f2a52bda700 1 --2- 172.21.15.32:0/3139016653 >> v2:172.21.15.40:3300/0 conn(0x7f2a44033770 0x7f2a44038800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-08T06:09:06.316 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:06.308+0000 7f2a52bda700 1 --2- 172.21.15.32:0/3139016653 >> v2:172.21.15.40:3300/0 conn(0x7f2a44033770 0x7f2a44038800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:06.316 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:06.312+0000 7f2a52bda700 1 -- 172.21.15.32:0/3139016653 >> v2:172.21.15.40:3300/0 conn(0x7f2a44033770 msgr2=0x7f2a44038800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-10-08T06:09:06.316 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:06.312+0000 7f2a52bda700 1 -- 172.21.15.32:0/3139016653 >> v2:172.21.15.40:3300/0 conn(0x7f2a44033770 msgr2=0x7f2a44038800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-08T06:09:06.316 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:06.312+0000 7f2a52bda700 1 --2- 172.21.15.32:0/3139016653 >> v2:172.21.15.40:3300/0 conn(0x7f2a44033770 0x7f2a44038800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-08T06:09:06.317 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:06.312+0000 7f2a52bda700 1 --2- 172.21.15.32:0/3139016653 >> v2:172.21.15.40:3300/0 conn(0x7f2a44033770 0x7f2a44038800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-08T06:09:06.717 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:06.712+0000 7f2a52bda700 1 --2- 172.21.15.32:0/3139016653 >> v2:172.21.15.40:3300/0 conn(0x7f2a44033770 0x7f2a44038800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:06.718 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:06.712+0000 7f2a52bda700 1 -- 172.21.15.32:0/3139016653 >> v2:172.21.15.40:3300/0 conn(0x7f2a44033770 msgr2=0x7f2a44038800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-10-08T06:09:06.718 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:06.712+0000 7f2a52bda700 1 -- 172.21.15.32:0/3139016653 >> v2:172.21.15.40:3300/0 conn(0x7f2a44033770 msgr2=0x7f2a44038800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-08T06:09:06.718 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:06.712+0000 7f2a52bda700 1 --2- 172.21.15.32:0/3139016653 >> v2:172.21.15.40:3300/0 conn(0x7f2a44033770 0x7f2a44038800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-08T06:09:06.718 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:06.712+0000 7f2a52bda700 1 --2- 172.21.15.32:0/3139016653 >> v2:172.21.15.40:3300/0 conn(0x7f2a44033770 0x7f2a44038800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-10-08T06:09:07.519 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:07.512+0000 7f2a52bda700 1 --2- 172.21.15.32:0/3139016653 >> v2:172.21.15.40:3300/0 conn(0x7f2a44033770 0x7f2a44038800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:07.519 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:07.512+0000 7f2a52bda700 1 -- 172.21.15.32:0/3139016653 >> v2:172.21.15.40:3300/0 conn(0x7f2a44033770 msgr2=0x7f2a44038800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-10-08T06:09:07.519 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:07.512+0000 7f2a52bda700 1 -- 172.21.15.32:0/3139016653 >> v2:172.21.15.40:3300/0 conn(0x7f2a44033770 msgr2=0x7f2a44038800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-08T06:09:07.519 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:07.512+0000 7f2a52bda700 1 --2- 172.21.15.32:0/3139016653 >> v2:172.21.15.40:3300/0 conn(0x7f2a44033770 0x7f2a44038800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-08T06:09:07.520 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:07.512+0000 7f2a52bda700 1 --2- 172.21.15.32:0/3139016653 >> v2:172.21.15.40:3300/0 conn(0x7f2a44033770 0x7f2a44038800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-10-08T06:09:09.115 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:09.108+0000 7f2a43fff700 1 -- 172.21.15.32:0/3139016653 >> v2:172.21.15.40:3300/0 conn(0x7f2a44033770 msgr2=0x7f2a44038800 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-08T06:09:09.116 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:09.108+0000 7f2a43fff700 1 --2- 172.21.15.32:0/3139016653 >> v2:172.21.15.40:3300/0 conn(0x7f2a44033770 0x7f2a44038800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:09.116 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:09.108+0000 7f2a43fff700 1 -- 172.21.15.32:0/3139016653 >> v1:172.21.15.40:6789/0 conn(0x7f2a4403a810 legacy=0x7f2a44050160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:09.116 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:09.108+0000 7f2a43fff700 1 -- 172.21.15.32:0/3139016653 >> v1:172.21.15.32:6789/0 conn(0x7f2a440e10c0 legacy=0x7f2a4403a100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:09.116 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:09.108+0000 7f2a43fff700 1 --2- 172.21.15.32:0/3139016653 >> v2:172.21.15.32:3300/0 conn(0x7f2a30003740 0x7f2a30005bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:09.116 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:09.108+0000 7f2a43fff700 1 --2- 172.21.15.32:0/3139016653 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2a30006290 0x7f2a30008710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:09.116 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:09.108+0000 7f2a43fff700 1 -- 172.21.15.32:0/3139016653 --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a44033cc0 con 0x7f2a30003740 2023-10-08T06:09:09.116 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:09.108+0000 7f2a43fff700 1 -- 172.21.15.32:0/3139016653 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a30008e30 con 0x7f2a30006290 2023-10-08T06:09:09.116 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:09.108+0000 7f2a523d9700 1 --2- 172.21.15.32:0/3139016653 >> v2:172.21.15.32:3300/0 conn(0x7f2a30003740 0x7f2a30005bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:09.116 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:09.108+0000 7f2a51bd8700 1 --2- 172.21.15.32:0/3139016653 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2a30006290 0x7f2a30008710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:09.117 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:09.108+0000 7f2a523d9700 1 -- 172.21.15.32:0/3139016653 >> v2:172.21.15.32:3300/0 conn(0x7f2a30003740 msgr2=0x7f2a30005bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-10-08T06:09:09.117 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:09.108+0000 7f2a523d9700 1 -- 172.21.15.32:0/3139016653 >> v2:172.21.15.32:3300/0 conn(0x7f2a30003740 msgr2=0x7f2a30005bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-08T06:09:09.117 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:09.108+0000 7f2a523d9700 1 --2- 172.21.15.32:0/3139016653 >> v2:172.21.15.32:3300/0 conn(0x7f2a30003740 0x7f2a30005bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-08T06:09:09.117 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:09.108+0000 7f2a523d9700 1 --2- 172.21.15.32:0/3139016653 >> v2:172.21.15.32:3300/0 conn(0x7f2a30003740 0x7f2a30005bc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-08T06:09:09.117 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:09.108+0000 7f2a51bd8700 1 -- 172.21.15.32:0/3139016653 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2a30006290 msgr2=0x7f2a30008710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-10-08T06:09:09.117 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:09.108+0000 7f2a51bd8700 1 -- 172.21.15.32:0/3139016653 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2a30006290 msgr2=0x7f2a30008710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-08T06:09:09.117 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:09.108+0000 7f2a51bd8700 1 --2- 172.21.15.32:0/3139016653 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2a30006290 0x7f2a30008710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-08T06:09:09.117 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:09.108+0000 7f2a51bd8700 1 --2- 172.21.15.32:0/3139016653 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2a30006290 0x7f2a30008710 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-08T06:09:09.316 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:09.312+0000 7f2a523d9700 1 --2- 172.21.15.32:0/3139016653 >> v2:172.21.15.32:3300/0 conn(0x7f2a30003740 0x7f2a30005bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:09.317 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:09.312+0000 7f2a523d9700 1 -- 172.21.15.32:0/3139016653 >> v2:172.21.15.32:3300/0 conn(0x7f2a30003740 msgr2=0x7f2a30005bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-10-08T06:09:09.317 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:09.312+0000 7f2a523d9700 1 -- 172.21.15.32:0/3139016653 >> v2:172.21.15.32:3300/0 conn(0x7f2a30003740 msgr2=0x7f2a30005bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-08T06:09:09.317 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:09.312+0000 7f2a51bd8700 1 --2- 172.21.15.32:0/3139016653 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2a30006290 0x7f2a30008710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:09.317 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:09.312+0000 7f2a523d9700 1 --2- 172.21.15.32:0/3139016653 >> v2:172.21.15.32:3300/0 conn(0x7f2a30003740 0x7f2a30005bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-08T06:09:09.317 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:09.312+0000 7f2a523d9700 1 --2- 172.21.15.32:0/3139016653 >> v2:172.21.15.32:3300/0 conn(0x7f2a30003740 0x7f2a30005bc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-08T06:09:09.317 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:09.312+0000 7f2a51bd8700 1 -- 172.21.15.32:0/3139016653 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2a30006290 msgr2=0x7f2a30008710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-10-08T06:09:09.317 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:09.312+0000 7f2a51bd8700 1 -- 172.21.15.32:0/3139016653 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2a30006290 msgr2=0x7f2a30008710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-08T06:09:09.317 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:09.312+0000 7f2a51bd8700 1 --2- 172.21.15.32:0/3139016653 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2a30006290 0x7f2a30008710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-08T06:09:09.317 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:09.312+0000 7f2a51bd8700 1 --2- 172.21.15.32:0/3139016653 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2a30006290 0x7f2a30008710 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-08T06:09:09.718 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:09.716+0000 7f2a523d9700 1 --2- 172.21.15.32:0/3139016653 >> v2:172.21.15.32:3300/0 conn(0x7f2a30003740 0x7f2a30005bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:09.718 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:09.716+0000 7f2a523d9700 1 -- 172.21.15.32:0/3139016653 >> v2:172.21.15.32:3300/0 conn(0x7f2a30003740 msgr2=0x7f2a30005bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-10-08T06:09:09.718 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:09.716+0000 7f2a523d9700 1 -- 172.21.15.32:0/3139016653 >> v2:172.21.15.32:3300/0 conn(0x7f2a30003740 msgr2=0x7f2a30005bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-08T06:09:09.718 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:09.716+0000 7f2a523d9700 1 --2- 172.21.15.32:0/3139016653 >> v2:172.21.15.32:3300/0 conn(0x7f2a30003740 0x7f2a30005bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-08T06:09:09.718 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:09.716+0000 7f2a51bd8700 1 --2- 172.21.15.32:0/3139016653 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2a30006290 0x7f2a30008710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:09.718 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:09.716+0000 7f2a523d9700 1 --2- 172.21.15.32:0/3139016653 >> v2:172.21.15.32:3300/0 conn(0x7f2a30003740 0x7f2a30005bc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-10-08T06:09:09.718 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:09.716+0000 7f2a51bd8700 1 -- 172.21.15.32:0/3139016653 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2a30006290 msgr2=0x7f2a30008710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-10-08T06:09:09.719 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:09.716+0000 7f2a51bd8700 1 -- 172.21.15.32:0/3139016653 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2a30006290 msgr2=0x7f2a30008710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-08T06:09:09.719 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:09.716+0000 7f2a51bd8700 1 --2- 172.21.15.32:0/3139016653 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2a30006290 0x7f2a30008710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-08T06:09:09.719 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:09.716+0000 7f2a51bd8700 1 --2- 172.21.15.32:0/3139016653 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2a30006290 0x7f2a30008710 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-10-08T06:09:10.520 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:10.516+0000 7f2a523d9700 1 --2- 172.21.15.32:0/3139016653 >> v2:172.21.15.32:3300/0 conn(0x7f2a30003740 0x7f2a30005bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:10.520 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:10.516+0000 7f2a523d9700 1 -- 172.21.15.32:0/3139016653 >> v2:172.21.15.32:3300/0 conn(0x7f2a30003740 msgr2=0x7f2a30005bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-10-08T06:09:10.521 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:10.516+0000 7f2a523d9700 1 -- 172.21.15.32:0/3139016653 >> v2:172.21.15.32:3300/0 conn(0x7f2a30003740 msgr2=0x7f2a30005bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-08T06:09:10.521 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:10.516+0000 7f2a523d9700 1 --2- 172.21.15.32:0/3139016653 >> v2:172.21.15.32:3300/0 conn(0x7f2a30003740 0x7f2a30005bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-08T06:09:10.521 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:10.516+0000 7f2a523d9700 1 --2- 172.21.15.32:0/3139016653 >> v2:172.21.15.32:3300/0 conn(0x7f2a30003740 0x7f2a30005bc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-10-08T06:09:10.521 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:10.516+0000 7f2a51bd8700 1 --2- 172.21.15.32:0/3139016653 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2a30006290 0x7f2a30008710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:10.521 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:10.516+0000 7f2a51bd8700 1 -- 172.21.15.32:0/3139016653 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2a30006290 msgr2=0x7f2a30008710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-10-08T06:09:10.521 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:10.516+0000 7f2a51bd8700 1 -- 172.21.15.32:0/3139016653 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2a30006290 msgr2=0x7f2a30008710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-08T06:09:10.521 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:10.516+0000 7f2a51bd8700 1 --2- 172.21.15.32:0/3139016653 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2a30006290 0x7f2a30008710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-08T06:09:10.522 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:10.516+0000 7f2a51bd8700 1 --2- 172.21.15.32:0/3139016653 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2a30006290 0x7f2a30008710 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-10-08T06:09:12.115 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:12.108+0000 7f2a43fff700 1 -- 172.21.15.32:0/3139016653 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2a30006290 msgr2=0x7f2a30008710 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-08T06:09:12.116 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:12.108+0000 7f2a43fff700 1 --2- 172.21.15.32:0/3139016653 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2a30006290 0x7f2a30008710 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:12.116 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:12.108+0000 7f2a43fff700 1 -- 172.21.15.32:0/3139016653 >> v2:172.21.15.32:3300/0 conn(0x7f2a30003740 msgr2=0x7f2a30005bc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-08T06:09:12.116 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:12.108+0000 7f2a43fff700 1 --2- 172.21.15.32:0/3139016653 >> v2:172.21.15.32:3300/0 conn(0x7f2a30003740 0x7f2a30005bc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:12.116 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:12.108+0000 7f2a52bda700 1 -- 172.21.15.32:0/3139016653 reap_dead start 2023-10-08T06:09:12.116 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:12.108+0000 7f2a43fff700 1 --2- 172.21.15.32:0/3139016653 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2a30006290 0x7f2a30008710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:12.116 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:12.108+0000 7f2a43fff700 1 --2- 172.21.15.32:0/3139016653 >> v2:172.21.15.40:3300/0 conn(0x7f2a3000a950 0x7f2a3000cd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:12.116 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:12.108+0000 7f2a43fff700 1 -- 172.21.15.32:0/3139016653 --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a4404ece0 con 0x7f2a30003bb0 2023-10-08T06:09:12.116 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:12.108+0000 7f2a43fff700 1 -- 172.21.15.32:0/3139016653 --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a44033cc0 con 0x7f2a3000a950 2023-10-08T06:09:12.116 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:12.108+0000 7f2a43fff700 1 -- 172.21.15.32:0/3139016653 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a30008e30 con 0x7f2a30006290 2023-10-08T06:09:12.116 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:12.108+0000 7f2a523d9700 1 --2- 172.21.15.32:0/3139016653 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2a30006290 0x7f2a30008710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:12.116 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:12.108+0000 7f2a52bda700 1 --2- 172.21.15.32:0/3139016653 >> v2:172.21.15.40:3300/0 conn(0x7f2a3000a950 0x7f2a3000cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:12.117 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:12.112+0000 7f2a523d9700 1 -- 172.21.15.32:0/3139016653 >> v2:172.21.15.40:3300/0 conn(0x7f2a3000a950 msgr2=0x7f2a3000cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:09:12.117 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:12.112+0000 7f2a523d9700 1 --2- 172.21.15.32:0/3139016653 >> v2:172.21.15.40:3300/0 conn(0x7f2a3000a950 0x7f2a3000cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:12.117 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:12.112+0000 7f2a523d9700 1 -- 172.21.15.32:0/3139016653 >> v1:172.21.15.40:6789/0 conn(0x7f2a30003bb0 legacy=0x7f2a30009230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:12.117 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:12.112+0000 7f2a523d9700 1 -- 172.21.15.32:0/3139016653 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a3000e4b0 con 0x7f2a30006290 2023-10-08T06:09:12.118 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:12.112+0000 7f2a523d9700 1 --2- 172.21.15.32:0/3139016653 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2a30006290 0x7f2a30008710 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f2a48007dd0 tx=0x7f2a48007330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fe6b6a34826967c8 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:12.118 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:12.112+0000 7f2a513d7700 1 -- 172.21.15.32:0/3139016653 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a48005ea0 con 0x7f2a30006290 2023-10-08T06:09:12.118 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:12.112+0000 7f2a513d7700 1 -- 172.21.15.32:0/3139016653 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a48017460 con 0x7f2a30006290 2023-10-08T06:09:12.118 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:12.112+0000 7f2a513d7700 1 -- 172.21.15.32:0/3139016653 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a48017830 con 0x7f2a30006290 2023-10-08T06:09:12.119 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:12.112+0000 7f2a533db700 1 -- 172.21.15.32:0/3139016653 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2a30006290 msgr2=0x7f2a30008710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:12.119 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:12.112+0000 7f2a533db700 1 --2- 172.21.15.32:0/3139016653 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2a30006290 0x7f2a30008710 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f2a48007dd0 tx=0x7f2a48007330 comp rx=0 tx=0).stop 2023-10-08T06:09:12.119 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:12.112+0000 7f2a533db700 1 -- 172.21.15.32:0/3139016653 shutdown_connections 2023-10-08T06:09:12.119 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:12.112+0000 7f2a533db700 1 --2- 172.21.15.32:0/3139016653 >> v2:172.21.15.40:3300/0 conn(0x7f2a3000a950 0x7f2a3000cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:12.120 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:12.112+0000 7f2a533db700 1 --2- 172.21.15.32:0/3139016653 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2a30006290 0x7f2a30008710 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:12.120 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:12.112+0000 7f2a533db700 1 -- 172.21.15.32:0/3139016653 >> 172.21.15.32:0/3139016653 conn(0x7f2a44054c90 msgr2=0x7f2a440550a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:09:12.120 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:12.112+0000 7f2a533db700 1 -- 172.21.15.32:0/3139016653 shutdown_connections 2023-10-08T06:09:12.120 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:12.112+0000 7f2a533db700 1 -- 172.21.15.32:0/3139016653 wait complete. 2023-10-08T06:09:12.123 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:12.116+0000 7f2a533db700 1 Processor -- start 2023-10-08T06:09:12.123 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:12.116+0000 7f2a533db700 1 -- start start 2023-10-08T06:09:12.125 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:12.120+0000 7f2a533db700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2a30003bb0 0x7f2a440d2820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:12.125 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:12.120+0000 7f2a533db700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2a30006290 0x7f2a440df060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:12.126 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:12.120+0000 7f2a533db700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2a3000a950 0x7f2a440df5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:12.126 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:12.120+0000 7f2a533db700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a44035830 con 0x7f2a30006290 2023-10-08T06:09:12.126 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:12.120+0000 7f2a533db700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a440d7f90 con 0x7f2a3000a950 2023-10-08T06:09:12.126 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:12.120+0000 7f2a533db700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a440d8270 con 0x7f2a30003bb0 2023-10-08T06:09:12.127 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:12.120+0000 7f2a523d9700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2a30003bb0 0x7f2a440d2820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:12.127 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:12.120+0000 7f2a51bd8700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2a30006290 0x7f2a440df060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:12.127 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:12.120+0000 7f2a52bda700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2a3000a950 0x7f2a440df5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:12.128 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:12.120+0000 7f2a523d9700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2a30003bb0 0x7f2a440d2820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.32:40942/0 (socket says 172.21.15.32:40942) 2023-10-08T06:09:12.128 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:12.120+0000 7f2a523d9700 1 -- 172.21.15.32:0/1905172996 learned_addr learned my addr 172.21.15.32:0/1905172996 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:09:12.128 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:12.120+0000 7f2a52bda700 1 -- 172.21.15.32:0/1905172996 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2a30003bb0 msgr2=0x7f2a440d2820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:12.128 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:12.120+0000 7f2a52bda700 1 --2- 172.21.15.32:0/1905172996 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2a30003bb0 0x7f2a440d2820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:12.128 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:12.120+0000 7f2a52bda700 1 -- 172.21.15.32:0/1905172996 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2a30006290 msgr2=0x7f2a440df060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:12.128 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:12.120+0000 7f2a52bda700 1 --2- 172.21.15.32:0/1905172996 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2a30006290 0x7f2a440df060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:12.128 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:12.120+0000 7f2a52bda700 1 -- 172.21.15.32:0/1905172996 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a4800f040 con 0x7f2a3000a950 2023-10-08T06:09:12.128 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:12.120+0000 7f2a52bda700 1 --2- 172.21.15.32:0/1905172996 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2a3000a950 0x7f2a440df5a0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f2a4c064300 tx=0x7f2a4c066fe0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:12.128 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:12.120+0000 7f2a42ffd700 1 -- 172.21.15.32:0/1905172996 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a4c04ebc0 con 0x7f2a3000a950 2023-10-08T06:09:12.128 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:12.120+0000 7f2a42ffd700 1 -- 172.21.15.32:0/1905172996 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a4c072050 con 0x7f2a3000a950 2023-10-08T06:09:12.129 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:12.120+0000 7f2a533db700 1 -- 172.21.15.32:0/1905172996 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a440d8550 con 0x7f2a3000a950 2023-10-08T06:09:12.129 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:12.120+0000 7f2a42ffd700 1 -- 172.21.15.32:0/1905172996 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a4c0676a0 con 0x7f2a3000a950 2023-10-08T06:09:12.129 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:12.120+0000 7f2a533db700 1 -- 172.21.15.32:0/1905172996 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a440e14a0 con 0x7f2a3000a950 2023-10-08T06:09:12.129 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:12.120+0000 7f2a42ffd700 1 -- 172.21.15.32:0/1905172996 <== mon.1 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f2a4c0724c0 con 0x7f2a3000a950 2023-10-08T06:09:12.129 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:12.120+0000 7f2a42ffd700 1 -- 172.21.15.32:0/1905172996 <== mon.1 v2:172.21.15.40:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f2a4c096970 con 0x7f2a3000a950 2023-10-08T06:09:12.129 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:12.124+0000 7f2a533db700 1 -- 172.21.15.32:0/1905172996 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a4404fbf0 con 0x7f2a3000a950 2023-10-08T06:09:12.133 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:12.128+0000 7f2a42ffd700 1 -- 172.21.15.32:0/1905172996 <== mon.1 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f2a4c072770 con 0x7f2a3000a950 2023-10-08T06:09:12.203 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:12.196+0000 7f2a533db700 1 -- 172.21.15.32:0/1905172996 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f2a44008ba0 con 0x7f2a3000a950 2023-10-08T06:09:12.212 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:12.204+0000 7f2a42ffd700 1 -- 172.21.15.32:0/1905172996 <== mon.1 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f2a4c072910 con 0x7f2a3000a950 2023-10-08T06:09:12.213 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:12.208+0000 7f2a533db700 1 -- 172.21.15.32:0/1905172996 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2a3000a950 msgr2=0x7f2a440df5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:12.213 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:12.208+0000 7f2a533db700 1 --2- 172.21.15.32:0/1905172996 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2a3000a950 0x7f2a440df5a0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f2a4c064300 tx=0x7f2a4c066fe0 comp rx=0 tx=0).stop 2023-10-08T06:09:12.213 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:12.208+0000 7f2a533db700 1 -- 172.21.15.32:0/1905172996 shutdown_connections 2023-10-08T06:09:12.213 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:12.208+0000 7f2a533db700 1 --2- 172.21.15.32:0/1905172996 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2a30006290 0x7f2a440df060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:12.214 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:12.208+0000 7f2a533db700 1 --2- 172.21.15.32:0/1905172996 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2a3000a950 0x7f2a440df5a0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:12.214 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:12.208+0000 7f2a533db700 1 --2- 172.21.15.32:0/1905172996 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2a30003bb0 0x7f2a440d2820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:12.214 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:12.208+0000 7f2a533db700 1 -- 172.21.15.32:0/1905172996 >> 172.21.15.32:0/1905172996 conn(0x7f2a44054c90 msgr2=0x7f2a440062a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:09:12.214 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:12.208+0000 7f2a533db700 1 -- 172.21.15.32:0/1905172996 shutdown_connections 2023-10-08T06:09:12.214 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:12.208+0000 7f2a533db700 1 -- 172.21.15.32:0/1905172996 wait complete. 2023-10-08T06:09:12.214 INFO:teuthology.orchestra.run.smithi032.stderr:adjusted tunables profile to default 2023-10-08T06:09:12.227 INFO:tasks.ceph:check_enable_crimson: False 2023-10-08T06:09:12.227 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-10-08T06:09:12.227 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2023-10-08T06:09:12.227 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-10-08T06:09:12.238 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2023-10-08T06:09:12.238 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-10-08T06:09:12.248 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2023-10-08T06:09:12.248 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-10-08T06:09:12.258 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2023-10-08T06:09:12.258 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-10-08T06:09:12.268 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-10-08T06:09:12.269 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-10-08T06:09:12.285 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-10-08T06:09:12.285 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-10-08T06:09:12.294 INFO:tasks.ceph.mgr.y.smithi032.stderr:2023-10-08T06:09:12.288+0000 7fab4701d2c0 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-08T06:09:12.298 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-10-08T06:09:12.295+0000 7fa60cf292c0 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-08T06:09:12.313 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-10-08T06:09:12.313 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-10-08T06:09:12.367 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-10-08T06:09:12.367 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-10-08T06:09:12.376 DEBUG:teuthology.orchestra.run.smithi040:> sudo ceph --cluster ceph osd new 43433f0c-9592-4874-92d7-10f8f4acf07f 0 2023-10-08T06:09:12.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:12.483+0000 7f84e759e700 1 Processor -- start 2023-10-08T06:09:12.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:12.483+0000 7f84e759e700 1 -- start start 2023-10-08T06:09:12.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:12.483+0000 7f84e759e700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f84e815eda0 0x7f84e806a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:12.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:12.483+0000 7f84e759e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f84e806a7e0 0x7f84e815ba90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:12.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:12.483+0000 7f84e759e700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84e806ecb0 con 0x7f84e806e8d0 2023-10-08T06:09:12.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:12.483+0000 7f84e759e700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84e8155d30 con 0x7f84e815eda0 2023-10-08T06:09:12.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:12.483+0000 7f84e759e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84e806ac70 con 0x7f84e806a7e0 2023-10-08T06:09:12.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:12.483+0000 7f84e6d9d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f84e806a7e0 0x7f84e815ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:12.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:12.483+0000 7f84e659c700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f84e806e8d0 0x7f84e80cbd10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:34022/0 (socket says 172.21.15.40:34022) 2023-10-08T06:09:12.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:12.483+0000 7f84e659c700 1 -- 172.21.15.40:0/2470990210 learned_addr learned my addr 172.21.15.40:0/2470990210 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-10-08T06:09:12.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:12.483+0000 7f84e5d9b700 1 --2- 172.21.15.40:0/2470990210 >> v2:172.21.15.32:3300/0 conn(0x7f84e815eda0 0x7f84e806a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:12.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:12.483+0000 7f84e559a700 1 -- 172.21.15.40:0/2470990210 <== mon.1 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3043534905 0 0) 0x7f84e806ecb0 con 0x7f84e806e8d0 2023-10-08T06:09:12.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:12.483+0000 7f84e559a700 1 -- 172.21.15.40:0/2470990210 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f84d00035d0 con 0x7f84e806e8d0 2023-10-08T06:09:12.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:12.483+0000 7f84e6d9d700 1 -- 172.21.15.40:0/2470990210 >> v2:172.21.15.32:3300/0 conn(0x7f84e815eda0 msgr2=0x7f84e806a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:09:12.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:12.483+0000 7f84e6d9d700 1 --2- 172.21.15.40:0/2470990210 >> v2:172.21.15.32:3300/0 conn(0x7f84e815eda0 0x7f84e806a2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:12.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:12.483+0000 7f84e6d9d700 1 -- 172.21.15.40:0/2470990210 >> v1:172.21.15.40:6789/0 conn(0x7f84e806e8d0 legacy=0x7f84e80cbd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:12.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:12.483+0000 7f84e6d9d700 1 -- 172.21.15.40:0/2470990210 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84e80b1800 con 0x7f84e806a7e0 2023-10-08T06:09:12.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:12.487+0000 7f84e6d9d700 1 --2- 172.21.15.40:0/2470990210 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f84e806a7e0 0x7f84e815ba90 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f84e0009d90 tx=0x7f84e000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=801e16d66e646ad1 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:12.493 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:12.487+0000 7f84e559a700 1 -- 172.21.15.40:0/2470990210 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84e000e070 con 0x7f84e806a7e0 2023-10-08T06:09:12.493 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:12.487+0000 7f84e559a700 1 -- 172.21.15.40:0/2470990210 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84e000bb20 con 0x7f84e806a7e0 2023-10-08T06:09:12.493 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:12.487+0000 7f84e559a700 1 -- 172.21.15.40:0/2470990210 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84e0012430 con 0x7f84e806a7e0 2023-10-08T06:09:12.493 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:12.487+0000 7f84e759e700 1 -- 172.21.15.40:0/2470990210 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f84e806a7e0 msgr2=0x7f84e815ba90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:12.493 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:12.487+0000 7f84e759e700 1 --2- 172.21.15.40:0/2470990210 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f84e806a7e0 0x7f84e815ba90 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f84e0009d90 tx=0x7f84e000b330 comp rx=0 tx=0).stop 2023-10-08T06:09:12.493 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:12.487+0000 7f84e759e700 1 -- 172.21.15.40:0/2470990210 shutdown_connections 2023-10-08T06:09:12.493 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:12.487+0000 7f84e759e700 1 --2- 172.21.15.40:0/2470990210 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f84e806a7e0 0x7f84e815ba90 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:12.493 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:12.487+0000 7f84e759e700 1 --2- 172.21.15.40:0/2470990210 >> v2:172.21.15.32:3300/0 conn(0x7f84e815eda0 0x7f84e806a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:12.493 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:12.487+0000 7f84e759e700 1 -- 172.21.15.40:0/2470990210 >> 172.21.15.40:0/2470990210 conn(0x7f84e80cc800 msgr2=0x7f84e80ccbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:09:12.493 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:12.487+0000 7f84e759e700 1 -- 172.21.15.40:0/2470990210 shutdown_connections 2023-10-08T06:09:12.493 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:12.487+0000 7f84e759e700 1 -- 172.21.15.40:0/2470990210 wait complete. 2023-10-08T06:09:12.495 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:12.487+0000 7f84e759e700 1 Processor -- start 2023-10-08T06:09:12.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:12.487+0000 7f84e759e700 1 -- start start 2023-10-08T06:09:12.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:12.487+0000 7f84e759e700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f84e806a7e0 0x7f84e80c3ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:12.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:12.487+0000 7f84e759e700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f84e806e8d0 0x7f84e80c5640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:12.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:12.487+0000 7f84e759e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f84e815eda0 0x7f84e80c5b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:12.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:12.487+0000 7f84e759e700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84e80b2d60 con 0x7f84e806e8d0 2023-10-08T06:09:12.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:12.487+0000 7f84e759e700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84e80c8de0 con 0x7f84e806a7e0 2023-10-08T06:09:12.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:12.487+0000 7f84e759e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84e80c90c0 con 0x7f84e815eda0 2023-10-08T06:09:12.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:12.487+0000 7f84e659c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f84e806a7e0 0x7f84e80c3ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:12.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:12.487+0000 7f84e659c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f84e806a7e0 0x7f84e80c3ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:39722/0 (socket says 172.21.15.40:39722) 2023-10-08T06:09:12.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:12.487+0000 7f84e659c700 1 -- 172.21.15.40:0/2698554098 learned_addr learned my addr 172.21.15.40:0/2698554098 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-10-08T06:09:12.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:12.487+0000 7f84e6d9d700 1 --2- 172.21.15.40:0/2698554098 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f84e815eda0 0x7f84e80c5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:12.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:12.487+0000 7f84e5d9b700 1 --2- 172.21.15.40:0/2698554098 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f84e806e8d0 0x7f84e80c5640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:12.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:12.487+0000 7f84e6d9d700 1 -- 172.21.15.40:0/2698554098 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f84e806a7e0 msgr2=0x7f84e80c3ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:12.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:12.487+0000 7f84e6d9d700 1 --2- 172.21.15.40:0/2698554098 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f84e806a7e0 0x7f84e80c3ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:12.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:12.487+0000 7f84e6d9d700 1 -- 172.21.15.40:0/2698554098 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f84e806e8d0 msgr2=0x7f84e80c5640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:12.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:12.487+0000 7f84e6d9d700 1 --2- 172.21.15.40:0/2698554098 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f84e806e8d0 0x7f84e80c5640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:12.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:12.487+0000 7f84e6d9d700 1 -- 172.21.15.40:0/2698554098 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84e0009a70 con 0x7f84e815eda0 2023-10-08T06:09:12.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:12.487+0000 7f84e659c700 1 --2- 172.21.15.40:0/2698554098 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f84e806a7e0 0x7f84e80c3ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T06:09:12.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:12.491+0000 7f84e6d9d700 1 --2- 172.21.15.40:0/2698554098 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f84e815eda0 0x7f84e80c5b80 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f84e0009d90 tx=0x7f84e0004af0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:12.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:12.491+0000 7f84d6ffd700 1 -- 172.21.15.40:0/2698554098 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84e0012430 con 0x7f84e815eda0 2023-10-08T06:09:12.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:12.491+0000 7f84d6ffd700 1 -- 172.21.15.40:0/2698554098 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84e0020070 con 0x7f84e815eda0 2023-10-08T06:09:12.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:12.491+0000 7f84e759e700 1 -- 172.21.15.40:0/2698554098 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84e80c93a0 con 0x7f84e815eda0 2023-10-08T06:09:12.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:12.491+0000 7f84d6ffd700 1 -- 172.21.15.40:0/2698554098 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84e0004280 con 0x7f84e815eda0 2023-10-08T06:09:12.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:12.491+0000 7f84e759e700 1 -- 172.21.15.40:0/2698554098 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84e81f39d0 con 0x7f84e815eda0 2023-10-08T06:09:12.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:12.491+0000 7f84d6ffd700 1 -- 172.21.15.40:0/2698554098 <== mon.2 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f84e00046e0 con 0x7f84e815eda0 2023-10-08T06:09:12.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:12.491+0000 7f84d6ffd700 1 -- 172.21.15.40:0/2698554098 <== mon.2 v2:172.21.15.40:3301/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7f84e0022070 con 0x7f84e815eda0 2023-10-08T06:09:12.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:12.491+0000 7f84e759e700 1 -- 172.21.15.40:0/2698554098 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84e80b2ed0 con 0x7f84e815eda0 2023-10-08T06:09:12.499 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:12.495+0000 7f84d6ffd700 1 -- 172.21.15.40:0/2698554098 <== mon.2 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f84e0012e20 con 0x7f84e815eda0 2023-10-08T06:09:12.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:12.571+0000 7f84e759e700 1 -- 172.21.15.40:0/2698554098 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd new", "uuid": "43433f0c-9592-4874-92d7-10f8f4acf07f", "id": 0} v 0) v1 -- 0x7f84e80686a0 con 0x7f84e815eda0 2023-10-08T06:09:12.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:12.583+0000 7f84d6ffd700 1 -- 172.21.15.40:0/2698554098 <== mon.2 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "43433f0c-9592-4874-92d7-10f8f4acf07f", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f84e0003e30 con 0x7f84e815eda0 2023-10-08T06:09:12.589 INFO:teuthology.orchestra.run.smithi040.stdout:0 2023-10-08T06:09:12.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:12.583+0000 7f84e759e700 1 -- 172.21.15.40:0/2698554098 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f84e815eda0 msgr2=0x7f84e80c5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:12.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:12.583+0000 7f84e759e700 1 --2- 172.21.15.40:0/2698554098 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f84e815eda0 0x7f84e80c5b80 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f84e0009d90 tx=0x7f84e0004af0 comp rx=0 tx=0).stop 2023-10-08T06:09:12.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:12.583+0000 7f84e759e700 1 -- 172.21.15.40:0/2698554098 shutdown_connections 2023-10-08T06:09:12.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:12.583+0000 7f84e759e700 1 --2- 172.21.15.40:0/2698554098 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f84e806e8d0 0x7f84e80c5640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:12.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:12.583+0000 7f84e759e700 1 --2- 172.21.15.40:0/2698554098 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f84e815eda0 0x7f84e80c5b80 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:12.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:12.583+0000 7f84e759e700 1 --2- 172.21.15.40:0/2698554098 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f84e806a7e0 0x7f84e80c3ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:12.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:12.583+0000 7f84e759e700 1 -- 172.21.15.40:0/2698554098 >> 172.21.15.40:0/2698554098 conn(0x7f84e80cc800 msgr2=0x7f84e815c8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:09:12.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:12.583+0000 7f84e759e700 1 -- 172.21.15.40:0/2698554098 shutdown_connections 2023-10-08T06:09:12.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:12.583+0000 7f84e759e700 1 -- 172.21.15.40:0/2698554098 wait complete. 2023-10-08T06:09:12.604 DEBUG:teuthology.orchestra.run.smithi040:> sudo ceph --cluster ceph osd new 2ecb1008-b987-4ce7-b646-6cded55fc8d8 1 2023-10-08T06:09:12.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:12.719+0000 7f9aeb32f700 1 Processor -- start 2023-10-08T06:09:12.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:12.719+0000 7f9aeb32f700 1 -- start start 2023-10-08T06:09:12.727 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:12.719+0000 7f9aeb32f700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f9ae40b6280 0x7f9ae40cb4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:12.727 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:12.719+0000 7f9aeb32f700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f9ae40b3000 0x7f9ae40cea40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:12.727 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:12.723+0000 7f9aeb32f700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ae40d0cd0 con 0x7f9ae415c0c0 2023-10-08T06:09:12.727 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:12.723+0000 7f9aeb32f700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ae415c610 con 0x7f9ae40b6280 2023-10-08T06:09:12.727 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:12.723+0000 7f9aeb32f700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ae40d0560 con 0x7f9ae40b3000 2023-10-08T06:09:12.727 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:12.723+0000 7f9aeab2e700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f9ae40b3000 0x7f9ae40cea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:12.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:12.723+0000 7f9aeab2e700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f9ae40b3000 0x7f9ae40cea40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:39734/0 (socket says 172.21.15.40:39734) 2023-10-08T06:09:12.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:12.723+0000 7f9aeab2e700 1 -- 172.21.15.40:0/3576502163 learned_addr learned my addr 172.21.15.40:0/3576502163 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-10-08T06:09:12.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:12.723+0000 7f9aea32d700 1 --2- 172.21.15.40:0/3576502163 >> v2:172.21.15.32:3300/0 conn(0x7f9ae40b6280 0x7f9ae40cb4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:12.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:12.723+0000 7f9aeab2e700 1 -- 172.21.15.40:0/3576502163 >> v2:172.21.15.32:3300/0 conn(0x7f9ae40b6280 msgr2=0x7f9ae40cb4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:09:12.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:12.723+0000 7f9aeab2e700 1 --2- 172.21.15.40:0/3576502163 >> v2:172.21.15.32:3300/0 conn(0x7f9ae40b6280 0x7f9ae40cb4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:12.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:12.723+0000 7f9aeab2e700 1 -- 172.21.15.40:0/3576502163 >> v1:172.21.15.32:6789/0 conn(0x7f9ae415c0c0 legacy=0x7f9ae40b28f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:12.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:12.723+0000 7f9aeab2e700 1 -- 172.21.15.40:0/3576502163 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ae40cff00 con 0x7f9ae40b3000 2023-10-08T06:09:12.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:12.723+0000 7f9aeab2e700 1 --2- 172.21.15.40:0/3576502163 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9ae40b3000 0x7f9ae40cea40 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f9ae406fc50 tx=0x7f9adc00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c0c7dd79001e4636 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:12.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:12.723+0000 7f9ae932b700 1 -- 172.21.15.40:0/3576502163 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9adc00e070 con 0x7f9ae40b3000 2023-10-08T06:09:12.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:12.723+0000 7f9ae932b700 1 -- 172.21.15.40:0/3576502163 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9adc00b9c0 con 0x7f9ae40b3000 2023-10-08T06:09:12.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:12.723+0000 7f9ae932b700 1 -- 172.21.15.40:0/3576502163 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9adc00bd70 con 0x7f9ae40b3000 2023-10-08T06:09:12.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:12.723+0000 7f9aeb32f700 1 -- 172.21.15.40:0/3576502163 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9ae40b3000 msgr2=0x7f9ae40cea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:12.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:12.723+0000 7f9aeb32f700 1 --2- 172.21.15.40:0/3576502163 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9ae40b3000 0x7f9ae40cea40 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f9ae406fc50 tx=0x7f9adc00b330 comp rx=0 tx=0).stop 2023-10-08T06:09:12.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:12.723+0000 7f9aeb32f700 1 -- 172.21.15.40:0/3576502163 shutdown_connections 2023-10-08T06:09:12.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:12.723+0000 7f9aeb32f700 1 --2- 172.21.15.40:0/3576502163 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9ae40b3000 0x7f9ae40cea40 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:12.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:12.723+0000 7f9aeb32f700 1 --2- 172.21.15.40:0/3576502163 >> v2:172.21.15.32:3300/0 conn(0x7f9ae40b6280 0x7f9ae40cb4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:12.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:12.723+0000 7f9aeb32f700 1 -- 172.21.15.40:0/3576502163 >> 172.21.15.40:0/3576502163 conn(0x7f9ae406dfa0 msgr2=0x7f9ae406e380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:09:12.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:12.723+0000 7f9aeb32f700 1 -- 172.21.15.40:0/3576502163 shutdown_connections 2023-10-08T06:09:12.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:12.723+0000 7f9aeb32f700 1 -- 172.21.15.40:0/3576502163 wait complete. 2023-10-08T06:09:12.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:12.723+0000 7f9aeb32f700 1 Processor -- start 2023-10-08T06:09:12.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:12.723+0000 7f9aeb32f700 1 -- start start 2023-10-08T06:09:12.734 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:12.727+0000 7f9aeb32f700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9ae40b3000 0x7f9ae414a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:12.734 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:12.727+0000 7f9aeb32f700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9ae40b6280 0x7f9ae406c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:12.734 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:12.727+0000 7f9aeb32f700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9ae415c0c0 0x7f9ae41520e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:12.734 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:12.727+0000 7f9aeb32f700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ae415abc0 con 0x7f9ae40b6280 2023-10-08T06:09:12.734 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:12.727+0000 7f9aeb32f700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ae406ca30 con 0x7f9ae415c0c0 2023-10-08T06:09:12.734 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:12.727+0000 7f9aeb32f700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ae406b450 con 0x7f9ae40b3000 2023-10-08T06:09:12.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:12.727+0000 7f9aea32d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9ae40b3000 0x7f9ae414a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:12.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:12.727+0000 7f9aeab2e700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9ae415c0c0 0x7f9ae41520e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:12.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:12.727+0000 7f9aea32d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9ae40b3000 0x7f9ae414a3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:50858/0 (socket says 172.21.15.40:50858) 2023-10-08T06:09:12.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:12.727+0000 7f9ae9b2c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9ae40b6280 0x7f9ae406c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:12.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:12.727+0000 7f9aea32d700 1 -- 172.21.15.40:0/2014408981 learned_addr learned my addr 172.21.15.40:0/2014408981 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-10-08T06:09:12.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:12.727+0000 7f9aeab2e700 1 -- 172.21.15.40:0/2014408981 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9ae40b3000 msgr2=0x7f9ae414a3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:12.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:12.727+0000 7f9aeab2e700 1 --2- 172.21.15.40:0/2014408981 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9ae40b3000 0x7f9ae414a3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:12.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:12.727+0000 7f9aeab2e700 1 -- 172.21.15.40:0/2014408981 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9ae40b6280 msgr2=0x7f9ae406c4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:12.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:12.727+0000 7f9aeab2e700 1 --2- 172.21.15.40:0/2014408981 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9ae40b6280 0x7f9ae406c4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:12.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:12.727+0000 7f9aeab2e700 1 -- 172.21.15.40:0/2014408981 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9adc009b30 con 0x7f9ae415c0c0 2023-10-08T06:09:12.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:12.727+0000 7f9aeab2e700 1 --2- 172.21.15.40:0/2014408981 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9ae415c0c0 0x7f9ae41520e0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f9adc015000 tx=0x7f9adc004af0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:12.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:12.727+0000 7f9adaffd700 1 -- 172.21.15.40:0/2014408981 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9adc004880 con 0x7f9ae415c0c0 2023-10-08T06:09:12.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:12.727+0000 7f9adaffd700 1 -- 172.21.15.40:0/2014408981 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9adc0099b0 con 0x7f9ae415c0c0 2023-10-08T06:09:12.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:12.727+0000 7f9aeb32f700 1 -- 172.21.15.40:0/2014408981 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ae406b730 con 0x7f9ae415c0c0 2023-10-08T06:09:12.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:12.727+0000 7f9adaffd700 1 -- 172.21.15.40:0/2014408981 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9adc01b670 con 0x7f9ae415c0c0 2023-10-08T06:09:12.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:12.727+0000 7f9aeb32f700 1 -- 172.21.15.40:0/2014408981 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ae406bcf0 con 0x7f9ae415c0c0 2023-10-08T06:09:12.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:12.727+0000 7f9adaffd700 1 -- 172.21.15.40:0/2014408981 <== mon.1 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f9adc01bad0 con 0x7f9ae415c0c0 2023-10-08T06:09:12.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:12.727+0000 7f9adaffd700 1 -- 172.21.15.40:0/2014408981 <== mon.1 v2:172.21.15.40:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7f9adc024c40 con 0x7f9ae415c0c0 2023-10-08T06:09:12.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:12.727+0000 7f9aeb32f700 1 -- 172.21.15.40:0/2014408981 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ae40686a0 con 0x7f9ae415c0c0 2023-10-08T06:09:12.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:12.731+0000 7f9adaffd700 1 -- 172.21.15.40:0/2014408981 <== mon.1 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f9adc01f070 con 0x7f9ae415c0c0 2023-10-08T06:09:12.817 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:12.811+0000 7f9aeb32f700 1 -- 172.21.15.40:0/2014408981 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd new", "uuid": "2ecb1008-b987-4ce7-b646-6cded55fc8d8", "id": 1} v 0) v1 -- 0x7f9ae406ff40 con 0x7f9ae415c0c0 2023-10-08T06:09:12.825 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:12.819+0000 7f9adaffd700 1 -- 172.21.15.40:0/2014408981 <== mon.1 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "2ecb1008-b987-4ce7-b646-6cded55fc8d8", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f9adc024e50 con 0x7f9ae415c0c0 2023-10-08T06:09:12.826 INFO:teuthology.orchestra.run.smithi040.stdout:1 2023-10-08T06:09:12.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:12.819+0000 7f9aeb32f700 1 -- 172.21.15.40:0/2014408981 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9ae415c0c0 msgr2=0x7f9ae41520e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:12.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:12.819+0000 7f9aeb32f700 1 --2- 172.21.15.40:0/2014408981 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9ae415c0c0 0x7f9ae41520e0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f9adc015000 tx=0x7f9adc004af0 comp rx=0 tx=0).stop 2023-10-08T06:09:12.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:12.819+0000 7f9aeb32f700 1 -- 172.21.15.40:0/2014408981 shutdown_connections 2023-10-08T06:09:12.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:12.819+0000 7f9aeb32f700 1 --2- 172.21.15.40:0/2014408981 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9ae40b6280 0x7f9ae406c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:12.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:12.819+0000 7f9aeb32f700 1 --2- 172.21.15.40:0/2014408981 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9ae415c0c0 0x7f9ae41520e0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:12.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:12.819+0000 7f9aeb32f700 1 --2- 172.21.15.40:0/2014408981 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9ae40b3000 0x7f9ae414a3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:12.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:12.819+0000 7f9aeb32f700 1 -- 172.21.15.40:0/2014408981 >> 172.21.15.40:0/2014408981 conn(0x7f9ae406dfa0 msgr2=0x7f9ae40ccd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:09:12.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:12.819+0000 7f9aeb32f700 1 -- 172.21.15.40:0/2014408981 shutdown_connections 2023-10-08T06:09:12.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:12.819+0000 7f9aeb32f700 1 -- 172.21.15.40:0/2014408981 wait complete. 2023-10-08T06:09:12.840 DEBUG:teuthology.orchestra.run.smithi040:> sudo ceph --cluster ceph osd new 1b131c94-c09b-4e80-8746-bf1b7bac362d 2 2023-10-08T06:09:12.913 INFO:tasks.ceph.mgr.y.smithi032.stderr:2023-10-08T06:09:12.908+0000 7fab4701d2c0 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-08T06:09:12.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:12.951+0000 7fbdb369b700 1 Processor -- start 2023-10-08T06:09:12.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:12.951+0000 7fbdb369b700 1 -- start start 2023-10-08T06:09:12.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:12.955+0000 7fbdb369b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbdac06cff0 0x7fbdac06e930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:12.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:12.955+0000 7fbdb369b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fbdac0cc450 0x7fbdac06d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:12.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:12.955+0000 7fbdb369b700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdac06ee70 con 0x7fbdac06d910 2023-10-08T06:09:12.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:12.955+0000 7fbdb369b700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbdac0cbf70 con 0x7fbdac0cc450 2023-10-08T06:09:12.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:12.955+0000 7fbdb369b700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdac15f8e0 con 0x7fbdac06cff0 2023-10-08T06:09:12.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:12.955+0000 7fbdb0c36700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fbdac0cc450 0x7fbdac06d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:12.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:12.955+0000 7fbdb1c38700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fbdac06d910 0x7fbdac06a2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:34024/0 (socket says 172.21.15.40:34024) 2023-10-08T06:09:12.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:12.955+0000 7fbdb1c38700 1 -- 172.21.15.40:0/2752899014 learned_addr learned my addr 172.21.15.40:0/2752899014 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-10-08T06:09:12.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:12.955+0000 7fbdb1437700 1 --2- 172.21.15.40:0/2752899014 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbdac06cff0 0x7fbdac06e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:12.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:12.955+0000 7fbda3fff700 1 -- 172.21.15.40:0/2752899014 <== mon.1 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1622944113 0 0) 0x7fbdac06ee70 con 0x7fbdac06d910 2023-10-08T06:09:12.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:12.955+0000 7fbda3fff700 1 -- 172.21.15.40:0/2752899014 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbd980035d0 con 0x7fbdac06d910 2023-10-08T06:09:12.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:12.955+0000 7fbdb1437700 1 -- 172.21.15.40:0/2752899014 >> v2:172.21.15.40:3300/0 conn(0x7fbdac0cc450 msgr2=0x7fbdac06d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:09:12.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:12.955+0000 7fbdb1437700 1 --2- 172.21.15.40:0/2752899014 >> v2:172.21.15.40:3300/0 conn(0x7fbdac0cc450 0x7fbdac06d3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:12.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:12.955+0000 7fbdb1437700 1 -- 172.21.15.40:0/2752899014 >> v1:172.21.15.40:6789/0 conn(0x7fbdac06d910 legacy=0x7fbdac06a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:12.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:12.955+0000 7fbdb1437700 1 -- 172.21.15.40:0/2752899014 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdac15fbc0 con 0x7fbdac06cff0 2023-10-08T06:09:12.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:12.955+0000 7fbdb1437700 1 --2- 172.21.15.40:0/2752899014 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbdac06cff0 0x7fbdac06e930 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fbda8009850 tx=0x7fbda8009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1a19d755c4a99d49 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:12.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:12.955+0000 7fbda3fff700 1 -- 172.21.15.40:0/2752899014 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbda8011830 con 0x7fbdac06cff0 2023-10-08T06:09:12.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:12.955+0000 7fbda3fff700 1 -- 172.21.15.40:0/2752899014 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbda8011990 con 0x7fbdac06cff0 2023-10-08T06:09:12.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:12.955+0000 7fbda3fff700 1 -- 172.21.15.40:0/2752899014 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbda8011d40 con 0x7fbdac06cff0 2023-10-08T06:09:12.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:12.955+0000 7fbdb369b700 1 -- 172.21.15.40:0/2752899014 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbdac06cff0 msgr2=0x7fbdac06e930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:12.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:12.955+0000 7fbdb369b700 1 --2- 172.21.15.40:0/2752899014 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbdac06cff0 0x7fbdac06e930 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fbda8009850 tx=0x7fbda8009b60 comp rx=0 tx=0).stop 2023-10-08T06:09:12.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:12.955+0000 7fbdb369b700 1 -- 172.21.15.40:0/2752899014 shutdown_connections 2023-10-08T06:09:12.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:12.955+0000 7fbdb369b700 1 --2- 172.21.15.40:0/2752899014 >> v2:172.21.15.40:3300/0 conn(0x7fbdac0cc450 0x7fbdac06d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:12.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:12.955+0000 7fbdb369b700 1 --2- 172.21.15.40:0/2752899014 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbdac06cff0 0x7fbdac06e930 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:12.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:12.955+0000 7fbdb369b700 1 -- 172.21.15.40:0/2752899014 >> 172.21.15.40:0/2752899014 conn(0x7fbdac0cfea0 msgr2=0x7fbdac0d02b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:09:12.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:12.955+0000 7fbdb369b700 1 -- 172.21.15.40:0/2752899014 shutdown_connections 2023-10-08T06:09:12.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:12.955+0000 7fbdb369b700 1 -- 172.21.15.40:0/2752899014 wait complete. 2023-10-08T06:09:12.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:12.959+0000 7fbdb369b700 1 Processor -- start 2023-10-08T06:09:12.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:12.959+0000 7fbdb369b700 1 -- start start 2023-10-08T06:09:12.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:12.959+0000 7fbdb369b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbdac06cff0 0x7fbdac1f2220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:12.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:12.959+0000 7fbdb369b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbdac06d910 0x7fbdac15b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:12.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:12.959+0000 7fbdb369b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbdac0cc450 0x7fbdac0c91d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:12.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:12.959+0000 7fbdb369b700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdac1f2760 con 0x7fbdac06cff0 2023-10-08T06:09:12.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:12.959+0000 7fbdb369b700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdac0c2e60 con 0x7fbdac06d910 2023-10-08T06:09:12.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:12.959+0000 7fbdb369b700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdac15ba10 con 0x7fbdac0cc450 2023-10-08T06:09:12.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:12.959+0000 7fbdb1c38700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbdac0cc450 0x7fbdac0c91d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:12.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:12.959+0000 7fbdb1c38700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbdac0cc450 0x7fbdac0c91d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:50876/0 (socket says 172.21.15.40:50876) 2023-10-08T06:09:12.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:12.959+0000 7fbdb1c38700 1 -- 172.21.15.40:0/2072671441 learned_addr learned my addr 172.21.15.40:0/2072671441 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-10-08T06:09:12.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:12.959+0000 7fbdb0c36700 1 --2- 172.21.15.40:0/2072671441 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbdac06d910 0x7fbdac15b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:12.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:12.959+0000 7fbdb1437700 1 --2- 172.21.15.40:0/2072671441 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbdac06cff0 0x7fbdac1f2220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:12.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:12.959+0000 7fbdb1c38700 1 -- 172.21.15.40:0/2072671441 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbdac06d910 msgr2=0x7fbdac15b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:12.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:12.959+0000 7fbdb1c38700 1 --2- 172.21.15.40:0/2072671441 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbdac06d910 0x7fbdac15b4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:12.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:12.959+0000 7fbdb1c38700 1 -- 172.21.15.40:0/2072671441 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbdac06cff0 msgr2=0x7fbdac1f2220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:12.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:12.959+0000 7fbdb1c38700 1 --2- 172.21.15.40:0/2072671441 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbdac06cff0 0x7fbdac1f2220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:12.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:12.959+0000 7fbdb1c38700 1 -- 172.21.15.40:0/2072671441 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbda80094b0 con 0x7fbdac0cc450 2023-10-08T06:09:12.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:12.959+0000 7fbdb1c38700 1 --2- 172.21.15.40:0/2072671441 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbdac0cc450 0x7fbdac0c91d0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fbda400cb40 tx=0x7fbda400cb70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:12.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:12.959+0000 7fbda1ffb700 1 -- 172.21.15.40:0/2072671441 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbda4007500 con 0x7fbdac0cc450 2023-10-08T06:09:12.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:12.959+0000 7fbda1ffb700 1 -- 172.21.15.40:0/2072671441 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbda4007660 con 0x7fbdac0cc450 2023-10-08T06:09:12.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:12.959+0000 7fbdb369b700 1 -- 172.21.15.40:0/2072671441 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdac0cde50 con 0x7fbdac0cc450 2023-10-08T06:09:12.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:12.959+0000 7fbda1ffb700 1 -- 172.21.15.40:0/2072671441 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbda40079f0 con 0x7fbdac0cc450 2023-10-08T06:09:12.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:12.959+0000 7fbdb369b700 1 -- 172.21.15.40:0/2072671441 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdac0ce410 con 0x7fbdac0cc450 2023-10-08T06:09:12.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:12.959+0000 7fbda1ffb700 1 -- 172.21.15.40:0/2072671441 <== mon.2 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fbda401c440 con 0x7fbdac0cc450 2023-10-08T06:09:12.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:12.959+0000 7fbda1ffb700 1 -- 172.21.15.40:0/2072671441 <== mon.2 v2:172.21.15.40:3301/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7fbda40128c0 con 0x7fbdac0cc450 2023-10-08T06:09:12.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:12.963+0000 7fbdb369b700 1 -- 172.21.15.40:0/2072671441 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbdac0686a0 con 0x7fbdac0cc450 2023-10-08T06:09:12.970 INFO:tasks.ceph.mgr.y.smithi032.stderr:2023-10-08T06:09:12.964+0000 7fab4701d2c0 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-08T06:09:12.970 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:12.963+0000 7fbda1ffb700 1 -- 172.21.15.40:0/2072671441 <== mon.2 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7fbda4017070 con 0x7fbdac0cc450 2023-10-08T06:09:12.984 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-10-08T06:09:12.979+0000 7fa60cf292c0 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-08T06:09:13.045 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-10-08T06:09:13.039+0000 7fa60cf292c0 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-08T06:09:13.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.039+0000 7fbdb369b700 1 -- 172.21.15.40:0/2072671441 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd new", "uuid": "1b131c94-c09b-4e80-8746-bf1b7bac362d", "id": 2} v 0) v1 -- 0x7fbdac072200 con 0x7fbdac0cc450 2023-10-08T06:09:13.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.047+0000 7fbda1ffb700 1 -- 172.21.15.40:0/2072671441 <== mon.2 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "1b131c94-c09b-4e80-8746-bf1b7bac362d", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7fbda4012630 con 0x7fbdac0cc450 2023-10-08T06:09:13.052 INFO:teuthology.orchestra.run.smithi040.stdout:2 2023-10-08T06:09:13.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.047+0000 7fbdb369b700 1 -- 172.21.15.40:0/2072671441 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbdac0cc450 msgr2=0x7fbdac0c91d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:13.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.047+0000 7fbdb369b700 1 --2- 172.21.15.40:0/2072671441 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbdac0cc450 0x7fbdac0c91d0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fbda400cb40 tx=0x7fbda400cb70 comp rx=0 tx=0).stop 2023-10-08T06:09:13.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.047+0000 7fbdb369b700 1 -- 172.21.15.40:0/2072671441 shutdown_connections 2023-10-08T06:09:13.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.047+0000 7fbdb369b700 1 --2- 172.21.15.40:0/2072671441 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbdac0cc450 0x7fbdac0c91d0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:13.054 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.047+0000 7fbdb369b700 1 --2- 172.21.15.40:0/2072671441 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbdac06d910 0x7fbdac15b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:13.054 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.047+0000 7fbdb369b700 1 --2- 172.21.15.40:0/2072671441 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbdac06cff0 0x7fbdac1f2220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:13.054 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.047+0000 7fbdb369b700 1 -- 172.21.15.40:0/2072671441 >> 172.21.15.40:0/2072671441 conn(0x7fbdac0cfea0 msgr2=0x7fbdac06a2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:09:13.054 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.047+0000 7fbdb369b700 1 -- 172.21.15.40:0/2072671441 shutdown_connections 2023-10-08T06:09:13.054 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.047+0000 7fbdb369b700 1 -- 172.21.15.40:0/2072671441 wait complete. 2023-10-08T06:09:13.069 DEBUG:teuthology.orchestra.run.smithi040:> sudo ceph --cluster ceph osd new ad655af2-1f6f-4689-b21d-b07bbaeb68b8 3 2023-10-08T06:09:13.115 INFO:tasks.ceph.mgr.y.smithi032.stderr:2023-10-08T06:09:13.108+0000 7fab4701d2c0 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-08T06:09:13.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.175+0000 7fdfd8d1c700 1 Processor -- start 2023-10-08T06:09:13.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.175+0000 7fdfd8d1c700 1 -- start start 2023-10-08T06:09:13.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.175+0000 7fdfd8d1c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fdfd415cf80 0x7fdfd406cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:13.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.175+0000 7fdfd8d1c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdfd40cdd60 0x7fdfd40cc4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:13.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.175+0000 7fdfd8d1c700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfd40b2a90 con 0x7fdfd40b3530 2023-10-08T06:09:13.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.175+0000 7fdfd8d1c700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfd40d0cf0 con 0x7fdfd415cf80 2023-10-08T06:09:13.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.175+0000 7fdfd8d1c700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfd40d0a10 con 0x7fdfd40cdd60 2023-10-08T06:09:13.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.175+0000 7fdfd37fe700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fdfd415cf80 0x7fdfd406cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:13.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.175+0000 7fdfd37fe700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fdfd415cf80 0x7fdfd406cfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:39778/0 (socket says 172.21.15.40:39778) 2023-10-08T06:09:13.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.175+0000 7fdfd37fe700 1 -- 172.21.15.40:0/1459907095 learned_addr learned my addr 172.21.15.40:0/1459907095 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-10-08T06:09:13.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.175+0000 7fdfd3fff700 1 --2- 172.21.15.40:0/1459907095 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdfd40cdd60 0x7fdfd40cc4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:13.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.175+0000 7fdfd3fff700 1 -- 172.21.15.40:0/1459907095 >> v2:172.21.15.40:3300/0 conn(0x7fdfd415cf80 msgr2=0x7fdfd406cfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:09:13.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.175+0000 7fdfd3fff700 1 --2- 172.21.15.40:0/1459907095 >> v2:172.21.15.40:3300/0 conn(0x7fdfd415cf80 0x7fdfd406cfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:13.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.175+0000 7fdfd3fff700 1 -- 172.21.15.40:0/1459907095 >> v1:172.21.15.32:6789/0 conn(0x7fdfd40b3530 legacy=0x7fdfd40cd650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:13.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.175+0000 7fdfd3fff700 1 -- 172.21.15.40:0/1459907095 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfd40b2d30 con 0x7fdfd40cdd60 2023-10-08T06:09:13.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.175+0000 7fdfd37fe700 1 --2- 172.21.15.40:0/1459907095 >> v2:172.21.15.40:3300/0 conn(0x7fdfd415cf80 0x7fdfd406cfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T06:09:13.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.175+0000 7fdfd3fff700 1 --2- 172.21.15.40:0/1459907095 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdfd40cdd60 0x7fdfd40cc4d0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fdfcc009d90 tx=0x7fdfcc00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bcbbb7709d24a873 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:13.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.175+0000 7fdfd2ffd700 1 -- 172.21.15.40:0/1459907095 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfcc00e070 con 0x7fdfd40cdd60 2023-10-08T06:09:13.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.175+0000 7fdfd2ffd700 1 -- 172.21.15.40:0/1459907095 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfcc00bb20 con 0x7fdfd40cdd60 2023-10-08T06:09:13.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.175+0000 7fdfd2ffd700 1 -- 172.21.15.40:0/1459907095 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfcc012430 con 0x7fdfd40cdd60 2023-10-08T06:09:13.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.175+0000 7fdfd8d1c700 1 -- 172.21.15.40:0/1459907095 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdfd40cdd60 msgr2=0x7fdfd40cc4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:13.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.175+0000 7fdfd8d1c700 1 --2- 172.21.15.40:0/1459907095 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdfd40cdd60 0x7fdfd40cc4d0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fdfcc009d90 tx=0x7fdfcc00b330 comp rx=0 tx=0).stop 2023-10-08T06:09:13.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.179+0000 7fdfd8d1c700 1 -- 172.21.15.40:0/1459907095 shutdown_connections 2023-10-08T06:09:13.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.179+0000 7fdfd8d1c700 1 --2- 172.21.15.40:0/1459907095 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdfd40cdd60 0x7fdfd40cc4d0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:13.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.179+0000 7fdfd8d1c700 1 --2- 172.21.15.40:0/1459907095 >> v2:172.21.15.40:3300/0 conn(0x7fdfd415cf80 0x7fdfd406cfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:13.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.179+0000 7fdfd8d1c700 1 -- 172.21.15.40:0/1459907095 >> 172.21.15.40:0/1459907095 conn(0x7fdfd406dfa0 msgr2=0x7fdfd406e380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:09:13.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.179+0000 7fdfd8d1c700 1 -- 172.21.15.40:0/1459907095 shutdown_connections 2023-10-08T06:09:13.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.179+0000 7fdfd8d1c700 1 -- 172.21.15.40:0/1459907095 wait complete. 2023-10-08T06:09:13.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.179+0000 7fdfd8d1c700 1 Processor -- start 2023-10-08T06:09:13.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.179+0000 7fdfd8d1c700 1 -- start start 2023-10-08T06:09:13.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.179+0000 7fdfd8d1c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdfd40b3530 0x7fdfd40ac8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:13.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.179+0000 7fdfd8d1c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdfd40cdd60 0x7fdfd41f6720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:13.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.179+0000 7fdfd8d1c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdfd415cf80 0x7fdfd40af350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:13.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.179+0000 7fdfd8d1c700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfd41f6c60 con 0x7fdfd40b3530 2023-10-08T06:09:13.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.179+0000 7fdfd8d1c700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfd40ad1b0 con 0x7fdfd415cf80 2023-10-08T06:09:13.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.179+0000 7fdfd8d1c700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfd40aeec0 con 0x7fdfd40cdd60 2023-10-08T06:09:13.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.179+0000 7fdfd3fff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdfd415cf80 0x7fdfd40af350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:13.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.179+0000 7fdfcaffd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdfd40cdd60 0x7fdfd41f6720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:13.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.179+0000 7fdfd3fff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdfd415cf80 0x7fdfd40af350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:39792/0 (socket says 172.21.15.40:39792) 2023-10-08T06:09:13.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.179+0000 7fdfd3fff700 1 -- 172.21.15.40:0/722062950 learned_addr learned my addr 172.21.15.40:0/722062950 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-10-08T06:09:13.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.179+0000 7fdfd37fe700 1 --2- 172.21.15.40:0/722062950 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdfd40b3530 0x7fdfd40ac8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:13.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.179+0000 7fdfd3fff700 1 -- 172.21.15.40:0/722062950 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdfd40cdd60 msgr2=0x7fdfd41f6720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:13.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.179+0000 7fdfd3fff700 1 --2- 172.21.15.40:0/722062950 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdfd40cdd60 0x7fdfd41f6720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:13.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.179+0000 7fdfd3fff700 1 -- 172.21.15.40:0/722062950 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdfd40b3530 msgr2=0x7fdfd40ac8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:13.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.179+0000 7fdfd3fff700 1 --2- 172.21.15.40:0/722062950 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdfd40b3530 0x7fdfd40ac8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:13.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.179+0000 7fdfd3fff700 1 -- 172.21.15.40:0/722062950 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfc4009570 con 0x7fdfd415cf80 2023-10-08T06:09:13.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.179+0000 7fdfd3fff700 1 --2- 172.21.15.40:0/722062950 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdfd415cf80 0x7fdfd40af350 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fdfcc014040 tx=0x7fdfcc004af0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:13.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.179+0000 7fdfd0ff9700 1 -- 172.21.15.40:0/722062950 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfcc012430 con 0x7fdfd415cf80 2023-10-08T06:09:13.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.179+0000 7fdfd0ff9700 1 -- 172.21.15.40:0/722062950 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfcc020070 con 0x7fdfd415cf80 2023-10-08T06:09:13.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.179+0000 7fdfd8d1c700 1 -- 172.21.15.40:0/722062950 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfcc009a70 con 0x7fdfd415cf80 2023-10-08T06:09:13.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.179+0000 7fdfd0ff9700 1 -- 172.21.15.40:0/722062950 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfcc0098f0 con 0x7fdfd415cf80 2023-10-08T06:09:13.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.183+0000 7fdfd8d1c700 1 -- 172.21.15.40:0/722062950 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfd40aced0 con 0x7fdfd415cf80 2023-10-08T06:09:13.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.183+0000 7fdfd0ff9700 1 -- 172.21.15.40:0/722062950 <== mon.1 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fdfcc004340 con 0x7fdfd415cf80 2023-10-08T06:09:13.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.183+0000 7fdfd0ff9700 1 -- 172.21.15.40:0/722062950 <== mon.1 v2:172.21.15.40:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7fdfcc022070 con 0x7fdfd415cf80 2023-10-08T06:09:13.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.183+0000 7fdfd8d1c700 1 -- 172.21.15.40:0/722062950 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfd40686a0 con 0x7fdfd415cf80 2023-10-08T06:09:13.191 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.187+0000 7fdfd0ff9700 1 -- 172.21.15.40:0/722062950 <== mon.1 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7fdfcc0045f0 con 0x7fdfd415cf80 2023-10-08T06:09:13.216 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-10-08T06:09:13.211+0000 7fa60cf292c0 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-08T06:09:13.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.263+0000 7fdfd8d1c700 1 -- 172.21.15.40:0/722062950 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd new", "uuid": "ad655af2-1f6f-4689-b21d-b07bbaeb68b8", "id": 3} v 0) v1 -- 0x7fdfd40af000 con 0x7fdfd415cf80 2023-10-08T06:09:13.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.267+0000 7fdfd0ff9700 1 -- 172.21.15.40:0/722062950 <== mon.1 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ad655af2-1f6f-4689-b21d-b07bbaeb68b8", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7fdfcc004870 con 0x7fdfd415cf80 2023-10-08T06:09:13.273 INFO:teuthology.orchestra.run.smithi040.stdout:3 2023-10-08T06:09:13.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.271+0000 7fdfd8d1c700 1 -- 172.21.15.40:0/722062950 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdfd415cf80 msgr2=0x7fdfd40af350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:13.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.271+0000 7fdfd8d1c700 1 --2- 172.21.15.40:0/722062950 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdfd415cf80 0x7fdfd40af350 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fdfcc014040 tx=0x7fdfcc004af0 comp rx=0 tx=0).stop 2023-10-08T06:09:13.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.271+0000 7fdfd8d1c700 1 -- 172.21.15.40:0/722062950 shutdown_connections 2023-10-08T06:09:13.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.271+0000 7fdfd8d1c700 1 --2- 172.21.15.40:0/722062950 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdfd415cf80 0x7fdfd40af350 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:13.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.271+0000 7fdfd8d1c700 1 --2- 172.21.15.40:0/722062950 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdfd40cdd60 0x7fdfd41f6720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:13.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.271+0000 7fdfd8d1c700 1 --2- 172.21.15.40:0/722062950 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdfd40b3530 0x7fdfd40ac8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:13.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.271+0000 7fdfd8d1c700 1 -- 172.21.15.40:0/722062950 >> 172.21.15.40:0/722062950 conn(0x7fdfd406dfa0 msgr2=0x7fdfd40cd320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:09:13.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.271+0000 7fdfd8d1c700 1 -- 172.21.15.40:0/722062950 shutdown_connections 2023-10-08T06:09:13.276 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.271+0000 7fdfd8d1c700 1 -- 172.21.15.40:0/722062950 wait complete. 2023-10-08T06:09:13.286 DEBUG:teuthology.orchestra.run.smithi040:> sudo ceph --cluster ceph osd new 64a543a1-8c4f-458e-9aba-b35c1cd7dd03 4 2023-10-08T06:09:13.322 INFO:tasks.ceph.mgr.y.smithi032.stderr:2023-10-08T06:09:13.316+0000 7fab4701d2c0 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-08T06:09:13.375 INFO:tasks.ceph.mgr.y.smithi032.stderr:2023-10-08T06:09:13.368+0000 7fab4701d2c0 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-08T06:09:13.391 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.387+0000 7fb62959a700 1 Processor -- start 2023-10-08T06:09:13.391 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.387+0000 7fb62959a700 1 -- start start 2023-10-08T06:09:13.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.387+0000 7fb62959a700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb6240cc580 0x7fb6240ac0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:13.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.387+0000 7fb62959a700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6240723c0 con 0x7fb624066040 2023-10-08T06:09:13.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.387+0000 7fb62959a700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6240b0140 con 0x7fb62415b4f0 2023-10-08T06:09:13.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.387+0000 7fb62959a700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb624072710 con 0x7fb6240cc580 2023-10-08T06:09:13.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.387+0000 7fb628d99700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb6240cc580 0x7fb6240ac0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:13.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.387+0000 7fb623fff700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fb62415b4f0 0x7fb6240b42e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:34026/0 (socket says 172.21.15.40:34026) 2023-10-08T06:09:13.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.387+0000 7fb628d99700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb6240cc580 0x7fb6240ac0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:39806/0 (socket says 172.21.15.40:39806) 2023-10-08T06:09:13.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.387+0000 7fb623fff700 1 -- 172.21.15.40:0/4061834199 learned_addr learned my addr 172.21.15.40:0/4061834199 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-10-08T06:09:13.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.387+0000 7fb628d99700 1 -- 172.21.15.40:0/4061834199 >> v1:172.21.15.40:6789/0 conn(0x7fb62415b4f0 legacy=0x7fb6240b42e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:13.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.387+0000 7fb628d99700 1 -- 172.21.15.40:0/4061834199 >> v1:172.21.15.32:6789/0 conn(0x7fb624066040 legacy=0x7fb6240cbe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:13.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.387+0000 7fb628d99700 1 -- 172.21.15.40:0/4061834199 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6240b03c0 con 0x7fb6240cc580 2023-10-08T06:09:13.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.387+0000 7fb628d99700 1 --2- 172.21.15.40:0/4061834199 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb6240cc580 0x7fb6240ac0d0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fb61c009d90 tx=0x7fb61c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a37c340ad08b1f6b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:13.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.387+0000 7fb6237fe700 1 -- 172.21.15.40:0/4061834199 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb61c00e070 con 0x7fb6240cc580 2023-10-08T06:09:13.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.387+0000 7fb6237fe700 1 -- 172.21.15.40:0/4061834199 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb61c00bbd0 con 0x7fb6240cc580 2023-10-08T06:09:13.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.387+0000 7fb6237fe700 1 -- 172.21.15.40:0/4061834199 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb61c012430 con 0x7fb6240cc580 2023-10-08T06:09:13.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.391+0000 7fb62959a700 1 -- 172.21.15.40:0/4061834199 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb6240cc580 msgr2=0x7fb6240ac0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:13.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.391+0000 7fb62959a700 1 --2- 172.21.15.40:0/4061834199 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb6240cc580 0x7fb6240ac0d0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fb61c009d90 tx=0x7fb61c00b330 comp rx=0 tx=0).stop 2023-10-08T06:09:13.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.391+0000 7fb62959a700 1 -- 172.21.15.40:0/4061834199 shutdown_connections 2023-10-08T06:09:13.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.391+0000 7fb62959a700 1 --2- 172.21.15.40:0/4061834199 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb6240cc580 0x7fb6240ac0d0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:13.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.391+0000 7fb62959a700 1 -- 172.21.15.40:0/4061834199 >> 172.21.15.40:0/4061834199 conn(0x7fb6240718a0 msgr2=0x7fb624071cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:09:13.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.391+0000 7fb62959a700 1 -- 172.21.15.40:0/4061834199 shutdown_connections 2023-10-08T06:09:13.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.391+0000 7fb62959a700 1 -- 172.21.15.40:0/4061834199 wait complete. 2023-10-08T06:09:13.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.391+0000 7fb62959a700 1 Processor -- start 2023-10-08T06:09:13.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.391+0000 7fb62959a700 1 -- start start 2023-10-08T06:09:13.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.391+0000 7fb62959a700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb624066040 0x7fb6241f20e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:13.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.391+0000 7fb62959a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb6240cc580 0x7fb6241f5f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:13.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.391+0000 7fb62959a700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb62415b4f0 0x7fb6241f6470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:13.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.391+0000 7fb62959a700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb62414f7c0 con 0x7fb62415b4f0 2023-10-08T06:09:13.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.391+0000 7fb62959a700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb62415e270 con 0x7fb6240cc580 2023-10-08T06:09:13.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.391+0000 7fb62959a700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb62415e550 con 0x7fb624066040 2023-10-08T06:09:13.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.391+0000 7fb623fff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb624066040 0x7fb6241f20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:13.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.391+0000 7fb61bfff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb6240cc580 0x7fb6241f5f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:13.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.391+0000 7fb623fff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb624066040 0x7fb6241f20e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:50892/0 (socket says 172.21.15.40:50892) 2023-10-08T06:09:13.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.391+0000 7fb623fff700 1 -- 172.21.15.40:0/797540525 learned_addr learned my addr 172.21.15.40:0/797540525 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-10-08T06:09:13.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.395+0000 7fb628d99700 1 --2- 172.21.15.40:0/797540525 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb62415b4f0 0x7fb6241f6470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:13.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.395+0000 7fb623fff700 1 -- 172.21.15.40:0/797540525 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb6240cc580 msgr2=0x7fb6241f5f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:13.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.395+0000 7fb623fff700 1 --2- 172.21.15.40:0/797540525 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb6240cc580 0x7fb6241f5f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:13.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.395+0000 7fb623fff700 1 -- 172.21.15.40:0/797540525 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb62415b4f0 msgr2=0x7fb6241f6470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:13.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.395+0000 7fb623fff700 1 --2- 172.21.15.40:0/797540525 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb62415b4f0 0x7fb6241f6470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:13.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.395+0000 7fb623fff700 1 -- 172.21.15.40:0/797540525 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb61c009a70 con 0x7fb624066040 2023-10-08T06:09:13.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.395+0000 7fb628d99700 1 --2- 172.21.15.40:0/797540525 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb62415b4f0 0x7fb6241f6470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T06:09:13.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.395+0000 7fb623fff700 1 --2- 172.21.15.40:0/797540525 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb624066040 0x7fb6241f20e0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fb61400c700 tx=0x7fb61400ca10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:13.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.395+0000 7fb6217fa700 1 -- 172.21.15.40:0/797540525 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6140074e0 con 0x7fb624066040 2023-10-08T06:09:13.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.395+0000 7fb6217fa700 1 -- 172.21.15.40:0/797540525 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb614007640 con 0x7fb624066040 2023-10-08T06:09:13.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.395+0000 7fb62959a700 1 -- 172.21.15.40:0/797540525 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb62415e830 con 0x7fb624066040 2023-10-08T06:09:13.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.395+0000 7fb6217fa700 1 -- 172.21.15.40:0/797540525 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb614005a90 con 0x7fb624066040 2023-10-08T06:09:13.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.395+0000 7fb62959a700 1 -- 172.21.15.40:0/797540525 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6240cd8f0 con 0x7fb624066040 2023-10-08T06:09:13.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.395+0000 7fb6217fa700 1 -- 172.21.15.40:0/797540525 <== mon.2 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fb61401c440 con 0x7fb624066040 2023-10-08T06:09:13.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.395+0000 7fb6217fa700 1 -- 172.21.15.40:0/797540525 <== mon.2 v2:172.21.15.40:3301/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7fb614012910 con 0x7fb624066040 2023-10-08T06:09:13.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.395+0000 7fb62959a700 1 -- 172.21.15.40:0/797540525 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb608005310 con 0x7fb624066040 2023-10-08T06:09:13.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.399+0000 7fb6217fa700 1 -- 172.21.15.40:0/797540525 <== mon.2 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7fb614017070 con 0x7fb624066040 2023-10-08T06:09:13.433 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-10-08T06:09:13.427+0000 7fa60cf292c0 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-08T06:09:13.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.471+0000 7fb62959a700 1 -- 172.21.15.40:0/797540525 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd new", "uuid": "64a543a1-8c4f-458e-9aba-b35c1cd7dd03", "id": 4} v 0) v1 -- 0x7fb608005930 con 0x7fb624066040 2023-10-08T06:09:13.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.479+0000 7fb6217fa700 1 -- 172.21.15.40:0/797540525 <== mon.2 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "64a543a1-8c4f-458e-9aba-b35c1cd7dd03", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7fb614012b20 con 0x7fb624066040 2023-10-08T06:09:13.484 INFO:teuthology.orchestra.run.smithi040.stdout:4 2023-10-08T06:09:13.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.479+0000 7fb62959a700 1 -- 172.21.15.40:0/797540525 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb624066040 msgr2=0x7fb6241f20e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:13.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.479+0000 7fb62959a700 1 --2- 172.21.15.40:0/797540525 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb624066040 0x7fb6241f20e0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fb61400c700 tx=0x7fb61400ca10 comp rx=0 tx=0).stop 2023-10-08T06:09:13.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.479+0000 7fb62959a700 1 -- 172.21.15.40:0/797540525 shutdown_connections 2023-10-08T06:09:13.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.479+0000 7fb62959a700 1 --2- 172.21.15.40:0/797540525 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb62415b4f0 0x7fb6241f6470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:13.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.479+0000 7fb62959a700 1 --2- 172.21.15.40:0/797540525 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb6240cc580 0x7fb6241f5f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:13.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.479+0000 7fb62959a700 1 --2- 172.21.15.40:0/797540525 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb624066040 0x7fb6241f20e0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:13.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.483+0000 7fb62959a700 1 -- 172.21.15.40:0/797540525 >> 172.21.15.40:0/797540525 conn(0x7fb6240718a0 msgr2=0x7fb62406da70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:09:13.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.483+0000 7fb62959a700 1 -- 172.21.15.40:0/797540525 shutdown_connections 2023-10-08T06:09:13.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.483+0000 7fb62959a700 1 -- 172.21.15.40:0/797540525 wait complete. 2023-10-08T06:09:13.489 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-10-08T06:09:13.483+0000 7fa60cf292c0 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-08T06:09:13.501 DEBUG:teuthology.orchestra.run.smithi040:> sudo ceph --cluster ceph osd new 0fef3e54-edb4-4678-878e-944663c51638 5 2023-10-08T06:09:13.553 INFO:tasks.ceph.mgr.y.smithi032.stderr:2023-10-08T06:09:13.548+0000 7fab4701d2c0 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-08T06:09:13.616 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.611+0000 7fe3a5e28700 1 Processor -- start 2023-10-08T06:09:13.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.611+0000 7fe3a5e28700 1 -- start start 2023-10-08T06:09:13.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.615+0000 7fe3a5e28700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe39803a3c0 0x7fe3980ead00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:13.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.615+0000 7fe3a5e28700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3980e05d0 con 0x7fe398053a70 2023-10-08T06:09:13.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.615+0000 7fe3a5e28700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe398053f70 con 0x7fe39804fb70 2023-10-08T06:09:13.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.615+0000 7fe3a5e28700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe398006a60 con 0x7fe39803a3c0 2023-10-08T06:09:13.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.615+0000 7fe3a5627700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe39803a3c0 0x7fe3980ead00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:13.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.615+0000 7fe3a4e26700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fe39804fb70 0x7fe398006350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:34028/0 (socket says 172.21.15.40:34028) 2023-10-08T06:09:13.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.615+0000 7fe3a4e26700 1 -- 172.21.15.40:0/1901663586 learned_addr learned my addr 172.21.15.40:0/1901663586 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-10-08T06:09:13.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.615+0000 7fe3a5627700 1 -- 172.21.15.40:0/1901663586 >> v1:172.21.15.40:6789/0 conn(0x7fe39804fb70 legacy=0x7fe398006350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:13.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.615+0000 7fe3a5627700 1 -- 172.21.15.40:0/1901663586 >> v1:172.21.15.32:6789/0 conn(0x7fe398053a70 legacy=0x7fe39804ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:09:13.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.615+0000 7fe3a5627700 1 -- 172.21.15.40:0/1901663586 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe398054250 con 0x7fe39803a3c0 2023-10-08T06:09:13.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.615+0000 7fe3a5627700 1 --2- 172.21.15.40:0/1901663586 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe39803a3c0 0x7fe3980ead00 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fe3a004e920 tx=0x7fe3a0074710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d5dda694be53d1ef server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:13.620 INFO:tasks.ceph.mgr.y.smithi032.stderr:2023-10-08T06:09:13.612+0000 7fab4701d2c0 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-08T06:09:13.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.615+0000 7fe39f7fe700 1 -- 172.21.15.40:0/1901663586 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3a004ef60 con 0x7fe39803a3c0 2023-10-08T06:09:13.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.615+0000 7fe39f7fe700 1 -- 172.21.15.40:0/1901663586 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3a008e070 con 0x7fe39803a3c0 2023-10-08T06:09:13.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.615+0000 7fe39f7fe700 1 -- 172.21.15.40:0/1901663586 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3a00684b0 con 0x7fe39803a3c0 2023-10-08T06:09:13.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.615+0000 7fe3a5e28700 1 -- 172.21.15.40:0/1901663586 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe39803a3c0 msgr2=0x7fe3980ead00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:13.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.615+0000 7fe3a5e28700 1 --2- 172.21.15.40:0/1901663586 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe39803a3c0 0x7fe3980ead00 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fe3a004e920 tx=0x7fe3a0074710 comp rx=0 tx=0).stop 2023-10-08T06:09:13.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.615+0000 7fe3a5e28700 1 -- 172.21.15.40:0/1901663586 shutdown_connections 2023-10-08T06:09:13.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.615+0000 7fe3a5e28700 1 --2- 172.21.15.40:0/1901663586 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe39803a3c0 0x7fe3980ead00 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:13.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.615+0000 7fe3a5e28700 1 -- 172.21.15.40:0/1901663586 >> 172.21.15.40:0/1901663586 conn(0x7fe39800aa10 msgr2=0x7fe39800adf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:09:13.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.615+0000 7fe3a5e28700 1 -- 172.21.15.40:0/1901663586 shutdown_connections 2023-10-08T06:09:13.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.615+0000 7fe3a5e28700 1 -- 172.21.15.40:0/1901663586 wait complete. 2023-10-08T06:09:13.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.615+0000 7fe3a5e28700 1 Processor -- start 2023-10-08T06:09:13.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.619+0000 7fe3a5e28700 1 -- start start 2023-10-08T06:09:13.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.619+0000 7fe3a5e28700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe39803a3c0 0x7fe39802f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:13.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.619+0000 7fe3a5e28700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe39804fb70 0x7fe3980debe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:13.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.619+0000 7fe3a5e28700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe398053a70 0x7fe3980338b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:13.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.619+0000 7fe3a5e28700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe39802f970 con 0x7fe398053a70 2023-10-08T06:09:13.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.619+0000 7fe3a5e28700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe398032dd0 con 0x7fe39803a3c0 2023-10-08T06:09:13.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.619+0000 7fe3a5e28700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3980330b0 con 0x7fe39804fb70 2023-10-08T06:09:13.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.619+0000 7fe3a4e26700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe39803a3c0 0x7fe39802f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:13.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.619+0000 7fe3a4e26700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe39803a3c0 0x7fe39802f0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:39828/0 (socket says 172.21.15.40:39828) 2023-10-08T06:09:13.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.619+0000 7fe3a4e26700 1 -- 172.21.15.40:0/2876073989 learned_addr learned my addr 172.21.15.40:0/2876073989 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-10-08T06:09:13.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.619+0000 7fe39ffff700 1 --2- 172.21.15.40:0/2876073989 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe39804fb70 0x7fe3980debe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:13.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.619+0000 7fe3a5627700 1 --2- 172.21.15.40:0/2876073989 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe398053a70 0x7fe3980338b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:13.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.619+0000 7fe3a4e26700 1 -- 172.21.15.40:0/2876073989 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe39804fb70 msgr2=0x7fe3980debe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:13.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.619+0000 7fe3a4e26700 1 --2- 172.21.15.40:0/2876073989 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe39804fb70 0x7fe3980debe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:13.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.619+0000 7fe3a4e26700 1 -- 172.21.15.40:0/2876073989 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe398053a70 msgr2=0x7fe3980338b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:13.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.619+0000 7fe3a4e26700 1 --2- 172.21.15.40:0/2876073989 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe398053a70 0x7fe3980338b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:13.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.619+0000 7fe3a4e26700 1 -- 172.21.15.40:0/2876073989 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3a0066ea0 con 0x7fe39803a3c0 2023-10-08T06:09:13.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.619+0000 7fe3a5627700 1 --2- 172.21.15.40:0/2876073989 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe398053a70 0x7fe3980338b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T06:09:13.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.619+0000 7fe39ffff700 1 --2- 172.21.15.40:0/2876073989 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe39804fb70 0x7fe3980debe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T06:09:13.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.619+0000 7fe3a4e26700 1 --2- 172.21.15.40:0/2876073989 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe39803a3c0 0x7fe39802f0d0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fe39400c700 tx=0x7fe39400cac0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:13.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.619+0000 7fe39d7fa700 1 -- 172.21.15.40:0/2876073989 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe394005d90 con 0x7fe39803a3c0 2023-10-08T06:09:13.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.619+0000 7fe39d7fa700 1 -- 172.21.15.40:0/2876073989 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3940070d0 con 0x7fe39803a3c0 2023-10-08T06:09:13.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.619+0000 7fe39d7fa700 1 -- 172.21.15.40:0/2876073989 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe394007440 con 0x7fe39803a3c0 2023-10-08T06:09:13.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.619+0000 7fe3a5e28700 1 -- 172.21.15.40:0/2876073989 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe398033390 con 0x7fe39803a3c0 2023-10-08T06:09:13.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.619+0000 7fe3a5e28700 1 -- 172.21.15.40:0/2876073989 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe39802f610 con 0x7fe39803a3c0 2023-10-08T06:09:13.627 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.619+0000 7fe39d7fa700 1 -- 172.21.15.40:0/2876073989 <== mon.1 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fe39401c440 con 0x7fe39803a3c0 2023-10-08T06:09:13.627 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.619+0000 7fe39d7fa700 1 -- 172.21.15.40:0/2876073989 <== mon.1 v2:172.21.15.40:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7fe394012980 con 0x7fe39803a3c0 2023-10-08T06:09:13.627 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.619+0000 7fe3a5e28700 1 -- 172.21.15.40:0/2876073989 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3980058d0 con 0x7fe39803a3c0 2023-10-08T06:09:13.629 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.623+0000 7fe39d7fa700 1 -- 172.21.15.40:0/2876073989 <== mon.1 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7fe394021060 con 0x7fe39803a3c0 2023-10-08T06:09:13.685 INFO:tasks.ceph.mgr.y.smithi032.stderr:2023-10-08T06:09:13.680+0000 7fab4701d2c0 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-08T06:09:13.697 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-10-08T06:09:13.691+0000 7fa60cf292c0 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-08T06:09:13.703 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.699+0000 7fe3a5e28700 1 -- 172.21.15.40:0/2876073989 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd new", "uuid": "0fef3e54-edb4-4678-878e-944663c51638", "id": 5} v 0) v1 -- 0x7fe39803ae50 con 0x7fe39803a3c0 2023-10-08T06:09:13.709 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.703+0000 7fe39d7fa700 1 -- 172.21.15.40:0/2876073989 <== mon.1 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "0fef3e54-edb4-4678-878e-944663c51638", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7fe394017070 con 0x7fe39803a3c0 2023-10-08T06:09:13.709 INFO:teuthology.orchestra.run.smithi040.stdout:5 2023-10-08T06:09:13.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.707+0000 7fe3a5e28700 1 -- 172.21.15.40:0/2876073989 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe39803a3c0 msgr2=0x7fe39802f0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:13.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.707+0000 7fe3a5e28700 1 --2- 172.21.15.40:0/2876073989 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe39803a3c0 0x7fe39802f0d0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fe39400c700 tx=0x7fe39400cac0 comp rx=0 tx=0).stop 2023-10-08T06:09:13.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.707+0000 7fe3a5e28700 1 -- 172.21.15.40:0/2876073989 shutdown_connections 2023-10-08T06:09:13.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.707+0000 7fe3a5e28700 1 --2- 172.21.15.40:0/2876073989 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe398053a70 0x7fe3980338b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:13.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.707+0000 7fe3a5e28700 1 --2- 172.21.15.40:0/2876073989 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe39804fb70 0x7fe3980debe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:13.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.707+0000 7fe3a5e28700 1 --2- 172.21.15.40:0/2876073989 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe39803a3c0 0x7fe39802f0d0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:13.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.707+0000 7fe3a5e28700 1 -- 172.21.15.40:0/2876073989 >> 172.21.15.40:0/2876073989 conn(0x7fe39800aa10 msgr2=0x7fe398007e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:09:13.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.707+0000 7fe3a5e28700 1 -- 172.21.15.40:0/2876073989 shutdown_connections 2023-10-08T06:09:13.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.707+0000 7fe3a5e28700 1 -- 172.21.15.40:0/2876073989 wait complete. 2023-10-08T06:09:13.727 DEBUG:teuthology.orchestra.run.smithi040:> sudo ceph --cluster ceph osd new 2eeb0472-6096-469d-9b2c-cab4bf41c31a 6 2023-10-08T06:09:13.762 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-10-08T06:09:13.759+0000 7fa60cf292c0 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-08T06:09:13.832 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-10-08T06:09:13.827+0000 7fa60cf292c0 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-08T06:09:13.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.827+0000 7fe88f59e700 1 Processor -- start 2023-10-08T06:09:13.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.827+0000 7fe88f59e700 1 -- start start 2023-10-08T06:09:13.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.827+0000 7fe88f59e700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fe89006e8d0 0x7fe89015eda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:13.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.827+0000 7fe88f59e700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe89006a9b0 0x7fe8900cc180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:13.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.827+0000 7fe88f59e700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe89006ecb0 con 0x7fe8900cbd10 2023-10-08T06:09:13.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.827+0000 7fe88f59e700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe890155d30 con 0x7fe89006e8d0 2023-10-08T06:09:13.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.827+0000 7fe88f59e700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8900b1800 con 0x7fe89006a9b0 2023-10-08T06:09:13.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.827+0000 7fe88ed9d700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe89006a9b0 0x7fe8900cc180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:13.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.827+0000 7fe88dd9b700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fe8900cbd10 0x7fe89006a2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:34032/0 (socket says 172.21.15.40:34032) 2023-10-08T06:09:13.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.827+0000 7fe88dd9b700 1 -- 172.21.15.40:0/2190182375 learned_addr learned my addr 172.21.15.40:0/2190182375 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-10-08T06:09:13.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.827+0000 7fe88e59c700 1 --2- 172.21.15.40:0/2190182375 >> v2:172.21.15.32:3300/0 conn(0x7fe89006e8d0 0x7fe89015eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:13.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.827+0000 7fe88ed9d700 1 -- 172.21.15.40:0/2190182375 >> v2:172.21.15.32:3300/0 conn(0x7fe89006e8d0 msgr2=0x7fe89015eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:09:13.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.827+0000 7fe88ed9d700 1 --2- 172.21.15.40:0/2190182375 >> v2:172.21.15.32:3300/0 conn(0x7fe89006e8d0 0x7fe89015eda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:13.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.827+0000 7fe88ed9d700 1 -- 172.21.15.40:0/2190182375 >> v1:172.21.15.40:6789/0 conn(0x7fe8900cbd10 legacy=0x7fe89006a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:13.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.831+0000 7fe88ed9d700 1 -- 172.21.15.40:0/2190182375 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8900b1a50 con 0x7fe89006a9b0 2023-10-08T06:09:13.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.827+0000 7fe88d59a700 1 -- 172.21.15.40:0/2190182375 <== mon.1 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3438354253 0 0) 0x7fe89006ecb0 con 0x7fe8900cbd10 2023-10-08T06:09:13.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.831+0000 7fe88ed9d700 1 --2- 172.21.15.40:0/2190182375 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe89006a9b0 0x7fe8900cc180 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fe8900cb570 tx=0x7fe88800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b1849348a7b36fbc server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:13.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.831+0000 7fe88d59a700 1 -- 172.21.15.40:0/2190182375 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe88800e070 con 0x7fe89006a9b0 2023-10-08T06:09:13.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.831+0000 7fe88d59a700 1 -- 172.21.15.40:0/2190182375 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe88800bbd0 con 0x7fe89006a9b0 2023-10-08T06:09:13.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.831+0000 7fe88d59a700 1 -- 172.21.15.40:0/2190182375 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe888012430 con 0x7fe89006a9b0 2023-10-08T06:09:13.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.831+0000 7fe88f59e700 1 -- 172.21.15.40:0/2190182375 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe89006a9b0 msgr2=0x7fe8900cc180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:13.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.831+0000 7fe88f59e700 1 --2- 172.21.15.40:0/2190182375 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe89006a9b0 0x7fe8900cc180 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fe8900cb570 tx=0x7fe88800b330 comp rx=0 tx=0).stop 2023-10-08T06:09:13.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.831+0000 7fe88f59e700 1 -- 172.21.15.40:0/2190182375 shutdown_connections 2023-10-08T06:09:13.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.831+0000 7fe88f59e700 1 --2- 172.21.15.40:0/2190182375 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe89006a9b0 0x7fe8900cc180 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:13.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.831+0000 7fe88f59e700 1 --2- 172.21.15.40:0/2190182375 >> v2:172.21.15.32:3300/0 conn(0x7fe89006e8d0 0x7fe89015eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:13.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.831+0000 7fe88f59e700 1 -- 172.21.15.40:0/2190182375 >> 172.21.15.40:0/2190182375 conn(0x7fe8900cc800 msgr2=0x7fe8900ccbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:09:13.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.831+0000 7fe88f59e700 1 -- 172.21.15.40:0/2190182375 shutdown_connections 2023-10-08T06:09:13.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.831+0000 7fe88f59e700 1 -- 172.21.15.40:0/2190182375 wait complete. 2023-10-08T06:09:13.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.831+0000 7fe88f59e700 1 Processor -- start 2023-10-08T06:09:13.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.831+0000 7fe88f59e700 1 -- start start 2023-10-08T06:09:13.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.831+0000 7fe88f59e700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe89006a9b0 0x7fe8900c6490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:13.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.831+0000 7fe88f59e700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe89006e8d0 0x7fe89015c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:13.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.831+0000 7fe88f59e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe8900cbd10 0x7fe8900b44d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:13.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.831+0000 7fe88f59e700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8900cf250 con 0x7fe89006a9b0 2023-10-08T06:09:13.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.831+0000 7fe88f59e700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8900b2e10 con 0x7fe89006e8d0 2023-10-08T06:09:13.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.831+0000 7fe88f59e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8900cf4a0 con 0x7fe8900cbd10 2023-10-08T06:09:13.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.831+0000 7fe88dd9b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe89006e8d0 0x7fe89015c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:13.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.831+0000 7fe88dd9b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe89006e8d0 0x7fe89015c9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:39840/0 (socket says 172.21.15.40:39840) 2023-10-08T06:09:13.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.831+0000 7fe88dd9b700 1 -- 172.21.15.40:0/3996342778 learned_addr learned my addr 172.21.15.40:0/3996342778 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-10-08T06:09:13.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.831+0000 7fe88ed9d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe8900cbd10 0x7fe8900b44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:13.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.831+0000 7fe88e59c700 1 --2- 172.21.15.40:0/3996342778 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe89006a9b0 0x7fe8900c6490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:13.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.835+0000 7fe88dd9b700 1 -- 172.21.15.40:0/3996342778 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe8900cbd10 msgr2=0x7fe8900b44d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:13.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.835+0000 7fe88dd9b700 1 --2- 172.21.15.40:0/3996342778 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe8900cbd10 0x7fe8900b44d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:13.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.835+0000 7fe88dd9b700 1 -- 172.21.15.40:0/3996342778 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe89006a9b0 msgr2=0x7fe8900c6490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:13.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.835+0000 7fe88dd9b700 1 --2- 172.21.15.40:0/3996342778 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe89006a9b0 0x7fe8900c6490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:13.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.835+0000 7fe88dd9b700 1 -- 172.21.15.40:0/3996342778 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe888009a70 con 0x7fe89006e8d0 2023-10-08T06:09:13.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.835+0000 7fe88dd9b700 1 --2- 172.21.15.40:0/3996342778 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe89006e8d0 0x7fe89015c9a0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fe88400c4e0 tx=0x7fe88400c7f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:13.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.835+0000 7fe87effd700 1 -- 172.21.15.40:0/3996342778 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe884004ca0 con 0x7fe89006e8d0 2023-10-08T06:09:13.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.835+0000 7fe87effd700 1 -- 172.21.15.40:0/3996342778 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe884004e20 con 0x7fe89006e8d0 2023-10-08T06:09:13.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.835+0000 7fe88f59e700 1 -- 172.21.15.40:0/3996342778 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8900cf780 con 0x7fe89006e8d0 2023-10-08T06:09:13.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.835+0000 7fe87effd700 1 -- 172.21.15.40:0/3996342778 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe884007310 con 0x7fe89006e8d0 2023-10-08T06:09:13.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.835+0000 7fe88f59e700 1 -- 172.21.15.40:0/3996342778 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8900b4a10 con 0x7fe89006e8d0 2023-10-08T06:09:13.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.835+0000 7fe87effd700 1 -- 172.21.15.40:0/3996342778 <== mon.1 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fe88401d3f0 con 0x7fe89006e8d0 2023-10-08T06:09:13.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.835+0000 7fe87effd700 1 -- 172.21.15.40:0/3996342778 <== mon.1 v2:172.21.15.40:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7fe8840139b0 con 0x7fe89006e8d0 2023-10-08T06:09:13.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.835+0000 7fe88f59e700 1 -- 172.21.15.40:0/3996342778 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8900b22d0 con 0x7fe89006e8d0 2023-10-08T06:09:13.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.839+0000 7fe87effd700 1 -- 172.21.15.40:0/3996342778 <== mon.1 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7fe8900b22d0 con 0x7fe89006e8d0 2023-10-08T06:09:13.916 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.911+0000 7fe88f59e700 1 -- 172.21.15.40:0/3996342778 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd new", "uuid": "2eeb0472-6096-469d-9b2c-cab4bf41c31a", "id": 6} v 0) v1 -- 0x7fe8900cf970 con 0x7fe89006e8d0 2023-10-08T06:09:13.924 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.919+0000 7fe87effd700 1 -- 172.21.15.40:0/3996342778 <== mon.1 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "2eeb0472-6096-469d-9b2c-cab4bf41c31a", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7fe884013d20 con 0x7fe89006e8d0 2023-10-08T06:09:13.924 INFO:teuthology.orchestra.run.smithi040.stdout:6 2023-10-08T06:09:13.925 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.919+0000 7fe88f59e700 1 -- 172.21.15.40:0/3996342778 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe89006e8d0 msgr2=0x7fe89015c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:13.925 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.919+0000 7fe88f59e700 1 --2- 172.21.15.40:0/3996342778 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe89006e8d0 0x7fe89015c9a0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fe88400c4e0 tx=0x7fe88400c7f0 comp rx=0 tx=0).stop 2023-10-08T06:09:13.925 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.919+0000 7fe88f59e700 1 -- 172.21.15.40:0/3996342778 shutdown_connections 2023-10-08T06:09:13.925 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.919+0000 7fe88f59e700 1 --2- 172.21.15.40:0/3996342778 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe8900cbd10 0x7fe8900b44d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:13.925 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.919+0000 7fe88f59e700 1 --2- 172.21.15.40:0/3996342778 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe89006e8d0 0x7fe89015c9a0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:13.925 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.919+0000 7fe88f59e700 1 --2- 172.21.15.40:0/3996342778 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe89006a9b0 0x7fe8900c6490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:13.925 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.919+0000 7fe88f59e700 1 -- 172.21.15.40:0/3996342778 >> 172.21.15.40:0/3996342778 conn(0x7fe8900cc800 msgr2=0x7fe8900ccbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:09:13.926 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.919+0000 7fe88f59e700 1 -- 172.21.15.40:0/3996342778 shutdown_connections 2023-10-08T06:09:13.926 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:13.919+0000 7fe88f59e700 1 -- 172.21.15.40:0/3996342778 wait complete. 2023-10-08T06:09:13.936 DEBUG:teuthology.orchestra.run.smithi040:> sudo ceph --cluster ceph osd new cf76e4c7-96a6-401f-a280-91aad4641940 7 2023-10-08T06:09:14.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:14.031+0000 7f129ffff700 1 Processor -- start 2023-10-08T06:09:14.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:14.031+0000 7f129ffff700 1 -- start start 2023-10-08T06:09:14.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:14.035+0000 7f129ffff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f12a0159c90 0x7f12a00b4b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:14.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:14.035+0000 7f129ffff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f12a00b50c0 0x7f12a00cd380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:14.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:14.035+0000 7f129ffff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12a00b4130 con 0x7f12a00cd8c0 2023-10-08T06:09:14.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:14.035+0000 7f129ffff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12a00cdd30 con 0x7f12a0159c90 2023-10-08T06:09:14.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:14.035+0000 7f129ffff700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12a00b0940 con 0x7f12a00b50c0 2023-10-08T06:09:14.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:14.035+0000 7f129effd700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f12a0159c90 0x7f12a00b4b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:14.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:14.035+0000 7f129e7fc700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f12a00b50c0 0x7f12a00cd380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:14.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:14.035+0000 7f129f7fe700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f12a00cd8c0 0x7f12a00cf3f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:34048/0 (socket says 172.21.15.40:34048) 2023-10-08T06:09:14.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:14.035+0000 7f129f7fe700 1 -- 172.21.15.40:0/2102257650 learned_addr learned my addr 172.21.15.40:0/2102257650 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-10-08T06:09:14.041 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:14.035+0000 7f129effd700 1 -- 172.21.15.40:0/2102257650 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f12a00b50c0 msgr2=0x7f12a00cd380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:09:14.041 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:14.035+0000 7f129effd700 1 --2- 172.21.15.40:0/2102257650 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f12a00b50c0 0x7f12a00cd380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:14.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:14.035+0000 7f129effd700 1 -- 172.21.15.40:0/2102257650 >> v1:172.21.15.40:6789/0 conn(0x7f12a00cd8c0 legacy=0x7f12a00cf3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:14.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:14.035+0000 7f129effd700 1 -- 172.21.15.40:0/2102257650 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12a00b0c20 con 0x7f12a0159c90 2023-10-08T06:09:14.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:14.035+0000 7f129dffb700 1 -- 172.21.15.40:0/2102257650 <== mon.1 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4120287254 0 0) 0x7f12a00b4130 con 0x7f12a00cd8c0 2023-10-08T06:09:14.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:14.035+0000 7f129effd700 1 --2- 172.21.15.40:0/2102257650 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f12a0159c90 0x7f12a00b4b80 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f1290009840 tx=0x7f1290009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7a4d3223dafab01a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:14.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:14.035+0000 7f129dffb700 1 -- 172.21.15.40:0/2102257650 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1290005e50 con 0x7f12a0159c90 2023-10-08T06:09:14.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:14.035+0000 7f129dffb700 1 -- 172.21.15.40:0/2102257650 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1290006030 con 0x7f12a0159c90 2023-10-08T06:09:14.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:14.035+0000 7f129dffb700 1 -- 172.21.15.40:0/2102257650 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12900063c0 con 0x7f12a0159c90 2023-10-08T06:09:14.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:14.035+0000 7f129ffff700 1 -- 172.21.15.40:0/2102257650 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f12a0159c90 msgr2=0x7f12a00b4b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:14.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:14.035+0000 7f129ffff700 1 --2- 172.21.15.40:0/2102257650 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f12a0159c90 0x7f12a00b4b80 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f1290009840 tx=0x7f1290009b50 comp rx=0 tx=0).stop 2023-10-08T06:09:14.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:14.039+0000 7f129ffff700 1 -- 172.21.15.40:0/2102257650 shutdown_connections 2023-10-08T06:09:14.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:14.039+0000 7f129ffff700 1 --2- 172.21.15.40:0/2102257650 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f12a00b50c0 0x7f12a00cd380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:14.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:14.039+0000 7f129ffff700 1 --2- 172.21.15.40:0/2102257650 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f12a0159c90 0x7f12a00b4b80 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:14.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:14.039+0000 7f129ffff700 1 -- 172.21.15.40:0/2102257650 >> 172.21.15.40:0/2102257650 conn(0x7f12a00718a0 msgr2=0x7f12a0071cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:09:14.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:14.039+0000 7f129ffff700 1 -- 172.21.15.40:0/2102257650 shutdown_connections 2023-10-08T06:09:14.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:14.039+0000 7f129ffff700 1 -- 172.21.15.40:0/2102257650 wait complete. 2023-10-08T06:09:14.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:14.039+0000 7f129ffff700 1 Processor -- start 2023-10-08T06:09:14.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:14.039+0000 7f129ffff700 1 -- start start 2023-10-08T06:09:14.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:14.039+0000 7f129ffff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f12a00cd8c0 0x7f12a00c73f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:14.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:14.039+0000 7f129ffff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f12a0159c90 0x7f12a0153700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:14.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:14.039+0000 7f129ffff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f12a0153ee0 0x7f12a00b0f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:14.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:14.039+0000 7f129ffff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12a00c8650 con 0x7f12a0153ee0 2023-10-08T06:09:14.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:14.039+0000 7f129ffff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12a00c7a40 con 0x7f12a0159c90 2023-10-08T06:09:14.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:14.039+0000 7f129ffff700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12a00c7d20 con 0x7f12a00cd8c0 2023-10-08T06:09:14.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:14.039+0000 7f129effd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f12a00cd8c0 0x7f12a00c73f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:14.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:14.039+0000 7f129e7fc700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f12a0159c90 0x7f12a0153700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:14.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:14.039+0000 7f129e7fc700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f12a0159c90 0x7f12a0153700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:39846/0 (socket says 172.21.15.40:39846) 2023-10-08T06:09:14.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:14.039+0000 7f129effd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f12a00cd8c0 0x7f12a00c73f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:50924/0 (socket says 172.21.15.40:50924) 2023-10-08T06:09:14.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:14.039+0000 7f129e7fc700 1 -- 172.21.15.40:0/1451669191 learned_addr learned my addr 172.21.15.40:0/1451669191 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-10-08T06:09:14.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:14.043+0000 7f129f7fe700 1 --2- 172.21.15.40:0/1451669191 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f12a0153ee0 0x7f12a00b0f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:14.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:14.043+0000 7f129effd700 1 -- 172.21.15.40:0/1451669191 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f12a0159c90 msgr2=0x7f12a0153700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:14.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:14.043+0000 7f129effd700 1 --2- 172.21.15.40:0/1451669191 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f12a0159c90 0x7f12a0153700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:14.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:14.043+0000 7f129effd700 1 -- 172.21.15.40:0/1451669191 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f12a0153ee0 msgr2=0x7f12a00b0f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:14.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:14.043+0000 7f129effd700 1 --2- 172.21.15.40:0/1451669191 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f12a0153ee0 0x7f12a00b0f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:14.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:14.043+0000 7f129effd700 1 -- 172.21.15.40:0/1451669191 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1290009450 con 0x7f12a00cd8c0 2023-10-08T06:09:14.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:14.043+0000 7f129effd700 1 --2- 172.21.15.40:0/1451669191 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f12a00cd8c0 0x7f12a00c73f0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f1290017000 tx=0x7f1290004770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:14.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:14.043+0000 7f12877fe700 1 -- 172.21.15.40:0/1451669191 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f129001f070 con 0x7f12a00cd8c0 2023-10-08T06:09:14.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:14.043+0000 7f12877fe700 1 -- 172.21.15.40:0/1451669191 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f129000c070 con 0x7f12a00cd8c0 2023-10-08T06:09:14.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:14.043+0000 7f12877fe700 1 -- 172.21.15.40:0/1451669191 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1290004250 con 0x7f12a00cd8c0 2023-10-08T06:09:14.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:14.043+0000 7f129ffff700 1 -- 172.21.15.40:0/1451669191 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12a00c8000 con 0x7f12a00cd8c0 2023-10-08T06:09:14.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:14.043+0000 7f129ffff700 1 -- 172.21.15.40:0/1451669191 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12a0153c40 con 0x7f12a00cd8c0 2023-10-08T06:09:14.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:14.043+0000 7f12877fe700 1 -- 172.21.15.40:0/1451669191 <== mon.2 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f12900043b0 con 0x7f12a00cd8c0 2023-10-08T06:09:14.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:14.043+0000 7f12877fe700 1 -- 172.21.15.40:0/1451669191 <== mon.2 v2:172.21.15.40:3301/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7f129000dbd0 con 0x7f12a00cd8c0 2023-10-08T06:09:14.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:14.043+0000 7f129ffff700 1 -- 172.21.15.40:0/1451669191 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12a00686a0 con 0x7f12a00cd8c0 2023-10-08T06:09:14.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:14.047+0000 7f12877fe700 1 -- 172.21.15.40:0/1451669191 <== mon.2 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f129002a060 con 0x7f12a00cd8c0 2023-10-08T06:09:14.102 INFO:tasks.ceph.mgr.y.smithi032.stderr:2023-10-08T06:09:14.096+0000 7fab4701d2c0 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-08T06:09:14.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:14.123+0000 7f129ffff700 1 -- 172.21.15.40:0/1451669191 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd new", "uuid": "cf76e4c7-96a6-401f-a280-91aad4641940", "id": 7} v 0) v1 -- 0x7f12a00c7e60 con 0x7f12a00cd8c0 2023-10-08T06:09:14.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:14.131+0000 7f12877fe700 1 -- 172.21.15.40:0/1451669191 <== mon.2 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "cf76e4c7-96a6-401f-a280-91aad4641940", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f12a00c7e60 con 0x7f12a00cd8c0 2023-10-08T06:09:14.138 INFO:teuthology.orchestra.run.smithi040.stdout:7 2023-10-08T06:09:14.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:14.135+0000 7f129ffff700 1 -- 172.21.15.40:0/1451669191 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f12a00cd8c0 msgr2=0x7f12a00c73f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:14.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:14.135+0000 7f129ffff700 1 --2- 172.21.15.40:0/1451669191 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f12a00cd8c0 0x7f12a00c73f0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f1290017000 tx=0x7f1290004770 comp rx=0 tx=0).stop 2023-10-08T06:09:14.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:14.135+0000 7f129ffff700 1 -- 172.21.15.40:0/1451669191 shutdown_connections 2023-10-08T06:09:14.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:14.135+0000 7f129ffff700 1 --2- 172.21.15.40:0/1451669191 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f12a0153ee0 0x7f12a00b0f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:14.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:14.135+0000 7f129ffff700 1 --2- 172.21.15.40:0/1451669191 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f12a0159c90 0x7f12a0153700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:14.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:14.135+0000 7f129ffff700 1 --2- 172.21.15.40:0/1451669191 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f12a00cd8c0 0x7f12a00c73f0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:14.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:14.135+0000 7f129ffff700 1 -- 172.21.15.40:0/1451669191 >> 172.21.15.40:0/1451669191 conn(0x7f12a00718a0 msgr2=0x7f12a0065e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:09:14.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:14.135+0000 7f129ffff700 1 -- 172.21.15.40:0/1451669191 shutdown_connections 2023-10-08T06:09:14.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:14.135+0000 7f129ffff700 1 -- 172.21.15.40:0/1451669191 wait complete. 2023-10-08T06:09:14.151 INFO:tasks.ceph.osd.0:Restarting daemon 2023-10-08T06:09:14.151 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-10-08T06:09:14.153 INFO:tasks.ceph.osd.0:Started 2023-10-08T06:09:14.153 INFO:tasks.ceph.osd.1:Restarting daemon 2023-10-08T06:09:14.154 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-10-08T06:09:14.155 INFO:tasks.ceph.osd.1:Started 2023-10-08T06:09:14.156 INFO:tasks.ceph.osd.2:Restarting daemon 2023-10-08T06:09:14.156 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-10-08T06:09:14.158 INFO:tasks.ceph.osd.2:Started 2023-10-08T06:09:14.158 INFO:tasks.ceph.osd.3:Restarting daemon 2023-10-08T06:09:14.158 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-10-08T06:09:14.161 INFO:tasks.ceph.osd.3:Started 2023-10-08T06:09:14.161 INFO:tasks.ceph.osd.4:Restarting daemon 2023-10-08T06:09:14.161 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-10-08T06:09:14.163 INFO:tasks.ceph.osd.4:Started 2023-10-08T06:09:14.163 INFO:tasks.ceph.osd.5:Restarting daemon 2023-10-08T06:09:14.163 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-10-08T06:09:14.165 INFO:tasks.ceph.osd.5:Started 2023-10-08T06:09:14.165 INFO:tasks.ceph.osd.6:Restarting daemon 2023-10-08T06:09:14.165 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-10-08T06:09:14.167 INFO:tasks.ceph.osd.6:Started 2023-10-08T06:09:14.167 INFO:tasks.ceph.osd.7:Restarting daemon 2023-10-08T06:09:14.167 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-10-08T06:09:14.168 INFO:tasks.ceph.osd.7:Started 2023-10-08T06:09:14.169 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T06:09:14.240 INFO:tasks.ceph.mgr.y.smithi032.stderr:2023-10-08T06:09:14.236+0000 7fab4701d2c0 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-08T06:09:14.269 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-10-08T06:09:14.263+0000 7fa60cf292c0 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-08T06:09:14.284 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:14.280+0000 7f6e33497700 1 Processor -- start 2023-10-08T06:09:14.284 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:14.280+0000 7f6e33497700 1 -- start start 2023-10-08T06:09:14.287 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:14.280+0000 7f6e33497700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f6e2c0b0f50 0x7f6e2c06fda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:14.287 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:14.280+0000 7f6e33497700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6e2c0ae360 0x7f6e2c0ad300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:14.287 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:14.280+0000 7f6e33497700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e2c161f30 con 0x7f6e2c15d420 2023-10-08T06:09:14.288 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:14.280+0000 7f6e33497700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e2c161040 con 0x7f6e2c0b0f50 2023-10-08T06:09:14.288 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:14.280+0000 7f6e33497700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e2c161320 con 0x7f6e2c0ae360 2023-10-08T06:09:14.288 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:14.280+0000 7f6e31233700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f6e2c15d420 0x7f6e2c0b0840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:55484/0 (socket says 172.21.15.32:55484) 2023-10-08T06:09:14.288 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:14.280+0000 7f6e30a32700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f6e2c0b0f50 0x7f6e2c06fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:14.288 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:14.280+0000 7f6e31233700 1 -- 172.21.15.32:0/3202779415 learned_addr learned my addr 172.21.15.32:0/3202779415 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-08T06:09:14.288 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:14.280+0000 7f6e31a34700 1 --2- 172.21.15.32:0/3202779415 >> v2:172.21.15.40:3300/0 conn(0x7f6e2c0ae360 0x7f6e2c0ad300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:14.288 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:14.280+0000 7f6e30a32700 1 -- 172.21.15.32:0/3202779415 >> v2:172.21.15.40:3300/0 conn(0x7f6e2c0ae360 msgr2=0x7f6e2c0ad300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:09:14.288 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:14.280+0000 7f6e30a32700 1 --2- 172.21.15.32:0/3202779415 >> v2:172.21.15.40:3300/0 conn(0x7f6e2c0ae360 0x7f6e2c0ad300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:14.288 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:14.280+0000 7f6e30a32700 1 -- 172.21.15.32:0/3202779415 >> v1:172.21.15.32:6789/0 conn(0x7f6e2c15d420 legacy=0x7f6e2c0b0840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:14.288 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:14.280+0000 7f6e30a32700 1 -- 172.21.15.32:0/3202779415 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e2c161600 con 0x7f6e2c0b0f50 2023-10-08T06:09:14.289 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:14.280+0000 7f6e31a34700 1 --2- 172.21.15.32:0/3202779415 >> v2:172.21.15.40:3300/0 conn(0x7f6e2c0ae360 0x7f6e2c0ad300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T06:09:14.289 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:14.280+0000 7f6e30a32700 1 --2- 172.21.15.32:0/3202779415 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6e2c0b0f50 0x7f6e2c06fda0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f6e2c0c9410 tx=0x7f6e1c009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98fe5017dc81d76a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:14.289 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:14.280+0000 7f6e23fff700 1 -- 172.21.15.32:0/3202779415 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e1c011830 con 0x7f6e2c0b0f50 2023-10-08T06:09:14.289 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:14.280+0000 7f6e23fff700 1 -- 172.21.15.32:0/3202779415 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e1c011990 con 0x7f6e2c0b0f50 2023-10-08T06:09:14.289 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:14.280+0000 7f6e23fff700 1 -- 172.21.15.32:0/3202779415 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e1c011d40 con 0x7f6e2c0b0f50 2023-10-08T06:09:14.289 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:14.280+0000 7f6e33497700 1 -- 172.21.15.32:0/3202779415 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6e2c0b0f50 msgr2=0x7f6e2c06fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:14.289 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:14.280+0000 7f6e33497700 1 --2- 172.21.15.32:0/3202779415 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6e2c0b0f50 0x7f6e2c06fda0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f6e2c0c9410 tx=0x7f6e1c009b30 comp rx=0 tx=0).stop 2023-10-08T06:09:14.289 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:14.280+0000 7f6e33497700 1 -- 172.21.15.32:0/3202779415 shutdown_connections 2023-10-08T06:09:14.289 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:14.280+0000 7f6e33497700 1 --2- 172.21.15.32:0/3202779415 >> v2:172.21.15.40:3300/0 conn(0x7f6e2c0ae360 0x7f6e2c0ad300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:14.290 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:14.280+0000 7f6e33497700 1 --2- 172.21.15.32:0/3202779415 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6e2c0b0f50 0x7f6e2c06fda0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:14.290 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:14.280+0000 7f6e33497700 1 -- 172.21.15.32:0/3202779415 >> 172.21.15.32:0/3202779415 conn(0x7f6e2c0cb840 msgr2=0x7f6e2c0cbc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:09:14.290 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:14.280+0000 7f6e33497700 1 -- 172.21.15.32:0/3202779415 shutdown_connections 2023-10-08T06:09:14.290 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:14.280+0000 7f6e33497700 1 -- 172.21.15.32:0/3202779415 wait complete. 2023-10-08T06:09:14.292 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:14.284+0000 7f6e33497700 1 Processor -- start 2023-10-08T06:09:14.292 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:14.284+0000 7f6e33497700 1 -- start start 2023-10-08T06:09:14.293 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:14.284+0000 7f6e33497700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6e2c0ae360 0x7f6e2c1544d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:14.293 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:14.284+0000 7f6e33497700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6e2c0b0f50 0x7f6e2c0b3a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:14.293 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:14.284+0000 7f6e33497700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6e2c15d420 0x7f6e2c0b3f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:14.293 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:14.284+0000 7f6e33497700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e2c1580e0 con 0x7f6e2c0b0f50 2023-10-08T06:09:14.293 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:14.284+0000 7f6e33497700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e2c15fdd0 con 0x7f6e2c0ae360 2023-10-08T06:09:14.293 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:14.284+0000 7f6e33497700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e2c1600b0 con 0x7f6e2c15d420 2023-10-08T06:09:14.293 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:14.284+0000 7f6e30a32700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6e2c0b0f50 0x7f6e2c0b3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:14.293 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:14.284+0000 7f6e30a32700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6e2c0b0f50 0x7f6e2c0b3a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:36546/0 (socket says 172.21.15.32:36546) 2023-10-08T06:09:14.293 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:14.284+0000 7f6e30a32700 1 -- 172.21.15.32:0/2603223763 learned_addr learned my addr 172.21.15.32:0/2603223763 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:09:14.293 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:14.284+0000 7f6e31233700 1 --2- 172.21.15.32:0/2603223763 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6e2c0ae360 0x7f6e2c1544d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:14.293 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:14.284+0000 7f6e31a34700 1 --2- 172.21.15.32:0/2603223763 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6e2c15d420 0x7f6e2c0b3f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:14.294 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:14.284+0000 7f6e30a32700 1 -- 172.21.15.32:0/2603223763 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6e2c15d420 msgr2=0x7f6e2c0b3f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:14.294 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:14.284+0000 7f6e30a32700 1 --2- 172.21.15.32:0/2603223763 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6e2c15d420 0x7f6e2c0b3f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:14.294 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:14.284+0000 7f6e30a32700 1 -- 172.21.15.32:0/2603223763 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6e2c0ae360 msgr2=0x7f6e2c1544d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:14.294 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:14.284+0000 7f6e30a32700 1 --2- 172.21.15.32:0/2603223763 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6e2c0ae360 0x7f6e2c1544d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:14.294 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:14.284+0000 7f6e30a32700 1 -- 172.21.15.32:0/2603223763 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e1c0094b0 con 0x7f6e2c0b0f50 2023-10-08T06:09:14.294 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:14.284+0000 7f6e30a32700 1 --2- 172.21.15.32:0/2603223763 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6e2c0b0f50 0x7f6e2c0b3a40 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f6e1c014040 tx=0x7f6e1c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:14.294 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:14.284+0000 7f6e21ffb700 1 -- 172.21.15.32:0/2603223763 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e1c0038c0 con 0x7f6e2c0b0f50 2023-10-08T06:09:14.294 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:14.284+0000 7f6e21ffb700 1 -- 172.21.15.32:0/2603223763 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e1c01e070 con 0x7f6e2c0b0f50 2023-10-08T06:09:14.294 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:14.284+0000 7f6e33497700 1 -- 172.21.15.32:0/2603223763 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e2c160390 con 0x7f6e2c0b0f50 2023-10-08T06:09:14.294 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:14.284+0000 7f6e21ffb700 1 -- 172.21.15.32:0/2603223763 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e1c003c80 con 0x7f6e2c0b0f50 2023-10-08T06:09:14.295 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:14.284+0000 7f6e33497700 1 -- 172.21.15.32:0/2603223763 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e2c15fac0 con 0x7f6e2c0b0f50 2023-10-08T06:09:14.295 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:14.284+0000 7f6e21ffb700 1 -- 172.21.15.32:0/2603223763 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f6e1c025780 con 0x7f6e2c0b0f50 2023-10-08T06:09:14.295 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:14.284+0000 7f6e21ffb700 1 -- 172.21.15.32:0/2603223763 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f6e1c020070 con 0x7f6e2c0b0f50 2023-10-08T06:09:14.295 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:14.284+0000 7f6e33497700 1 -- 172.21.15.32:0/2603223763 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e2c073f00 con 0x7f6e2c0b0f50 2023-10-08T06:09:14.300 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:14.296+0000 7f6e21ffb700 1 -- 172.21.15.32:0/2603223763 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f6e1c015020 con 0x7f6e2c0b0f50 2023-10-08T06:09:14.362 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:14.356+0000 7f6e33497700 1 -- 172.21.15.32:0/2603223763 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6e2c161b90 con 0x7f6e2c0b0f50 2023-10-08T06:09:14.362 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:14.356+0000 7f6e21ffb700 1 -- 172.21.15.32:0/2603223763 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f6e1c025a30 con 0x7f6e2c0b0f50 2023-10-08T06:09:14.363 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:09:14.363 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":10,"fsid":"ac672d87-96ae-41e0-9314-623ba2cdbbba","created":"2023-10-08T06:09:11.175626+0000","modified":"2023-10-08T06:09:14.131580+0000","last_up_change":"0.000000","last_in_change":"2023-10-08T06:09:14.131580+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"43433f0c-9592-4874-92d7-10f8f4acf07f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"2ecb1008-b987-4ce7-b646-6cded55fc8d8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"1b131c94-c09b-4e80-8746-bf1b7bac362d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"ad655af2-1f6f-4689-b21d-b07bbaeb68b8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"64a543a1-8c4f-458e-9aba-b35c1cd7dd03","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"0fef3e54-edb4-4678-878e-944663c51638","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"2eeb0472-6096-469d-9b2c-cab4bf41c31a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"cf76e4c7-96a6-401f-a280-91aad4641940","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T06:09:14.364 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:14.356+0000 7f6e33497700 1 -- 172.21.15.32:0/2603223763 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6e2c0b0f50 msgr2=0x7f6e2c0b3a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:14.364 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:14.356+0000 7f6e33497700 1 --2- 172.21.15.32:0/2603223763 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6e2c0b0f50 0x7f6e2c0b3a40 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f6e1c014040 tx=0x7f6e1c004770 comp rx=0 tx=0).stop 2023-10-08T06:09:14.364 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:14.356+0000 7f6e33497700 1 -- 172.21.15.32:0/2603223763 shutdown_connections 2023-10-08T06:09:14.364 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:14.360+0000 7f6e33497700 1 --2- 172.21.15.32:0/2603223763 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6e2c0b0f50 0x7f6e2c0b3a40 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:14.364 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:14.360+0000 7f6e33497700 1 --2- 172.21.15.32:0/2603223763 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6e2c15d420 0x7f6e2c0b3f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:14.365 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:14.360+0000 7f6e33497700 1 --2- 172.21.15.32:0/2603223763 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6e2c0ae360 0x7f6e2c1544d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:14.365 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:14.360+0000 7f6e33497700 1 -- 172.21.15.32:0/2603223763 >> 172.21.15.32:0/2603223763 conn(0x7f6e2c0cb840 msgr2=0x7f6e2c0c94c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:09:14.365 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:14.360+0000 7f6e33497700 1 -- 172.21.15.32:0/2603223763 shutdown_connections 2023-10-08T06:09:14.365 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:14.360+0000 7f6e33497700 1 -- 172.21.15.32:0/2603223763 wait complete. 2023-10-08T06:09:14.375 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-10-08T06:09:14.375 INFO:tasks.ceph:Waiting for OSDs to come up 2023-10-08T06:09:14.391 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-10-08T06:09:14.387+0000 7fa60cf292c0 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-08T06:09:14.540 INFO:tasks.ceph.osd.4.smithi040.stderr:2023-10-08T06:09:14.535+0000 7ff100a9d700 -1 Falling back to public interface 2023-10-08T06:09:14.544 INFO:tasks.ceph.osd.6.smithi040.stderr:2023-10-08T06:09:14.539+0000 7f1becb2f700 -1 Falling back to public interface 2023-10-08T06:09:14.554 INFO:tasks.ceph.osd.0.smithi032.stderr:2023-10-08T06:09:14.548+0000 7f51a2933700 -1 Falling back to public interface 2023-10-08T06:09:14.554 INFO:tasks.ceph.osd.3.smithi032.stderr:2023-10-08T06:09:14.548+0000 7ff6451e8700 -1 Falling back to public interface 2023-10-08T06:09:14.560 INFO:tasks.ceph.osd.7.smithi040.stderr:2023-10-08T06:09:14.555+0000 7f411040f700 -1 Falling back to public interface 2023-10-08T06:09:14.619 INFO:tasks.ceph.mgr.y.smithi032.stderr:2023-10-08T06:09:14.612+0000 7fab4701d2c0 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-08T06:09:14.739 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-10-08T06:09:14.735+0000 7fa60cf292c0 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-08T06:09:14.790 INFO:tasks.ceph.osd.1.smithi032.stderr:2023-10-08T06:09:14.784+0000 7efe8e709700 -1 Falling back to public interface 2023-10-08T06:09:14.800 INFO:tasks.ceph.mgr.y.smithi032.stderr:2023-10-08T06:09:14.796+0000 7fab4701d2c0 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-08T06:09:14.817 INFO:tasks.ceph.osd.2.smithi032.stderr:2023-10-08T06:09:14.812+0000 7fe8a6d4b700 -1 Falling back to public interface 2023-10-08T06:09:14.820 INFO:tasks.ceph.osd.5.smithi040.stderr:2023-10-08T06:09:14.815+0000 7f5e0262b700 -1 Falling back to public interface 2023-10-08T06:09:14.871 INFO:tasks.ceph.mgr.y.smithi032.stderr:2023-10-08T06:09:14.864+0000 7fab4701d2c0 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-08T06:09:14.913 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-10-08T06:09:14.907+0000 7fa60cf292c0 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-08T06:09:14.927 INFO:tasks.ceph.mgr.y.smithi032.stderr:2023-10-08T06:09:14.920+0000 7fab4701d2c0 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-08T06:09:14.982 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-10-08T06:09:14.975+0000 7fa60cf292c0 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-08T06:09:15.039 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-10-08T06:09:15.035+0000 7fa60cf292c0 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-08T06:09:15.181 DEBUG:teuthology.orchestra.run.smithi032:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-08T06:09:15.278 INFO:teuthology.misc.health.smithi032.stderr:2023-10-08T06:09:15.272+0000 7fc55e26c700 1 Processor -- start 2023-10-08T06:09:15.278 INFO:teuthology.misc.health.smithi032.stderr:2023-10-08T06:09:15.272+0000 7fc55e26c700 1 -- start start 2023-10-08T06:09:15.280 INFO:teuthology.misc.health.smithi032.stderr:2023-10-08T06:09:15.272+0000 7fc55e26c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc5581652b0 0x7fc5580cb7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:15.280 INFO:teuthology.misc.health.smithi032.stderr:2023-10-08T06:09:15.272+0000 7fc55e26c700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc55806c200 con 0x7fc558165740 2023-10-08T06:09:15.280 INFO:teuthology.misc.health.smithi032.stderr:2023-10-08T06:09:15.272+0000 7fc55e26c700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc558165d00 con 0x7fc5580c21a0 2023-10-08T06:09:15.280 INFO:teuthology.misc.health.smithi032.stderr:2023-10-08T06:09:15.272+0000 7fc55e26c700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5581662c0 con 0x7fc5581652b0 2023-10-08T06:09:15.280 INFO:teuthology.misc.health.smithi032.stderr:2023-10-08T06:09:15.272+0000 7fc55da6b700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fc558165740 0x7fc5580cc9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:55492/0 (socket says 172.21.15.32:55492) 2023-10-08T06:09:15.280 INFO:teuthology.misc.health.smithi032.stderr:2023-10-08T06:09:15.272+0000 7fc55da6b700 1 -- 172.21.15.32:0/1303091192 learned_addr learned my addr 172.21.15.32:0/1303091192 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-08T06:09:15.280 INFO:teuthology.misc.health.smithi032.stderr:2023-10-08T06:09:15.272+0000 7fc55ca69700 1 --2- 172.21.15.32:0/1303091192 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc5581652b0 0x7fc5580cb7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:15.282 INFO:teuthology.misc.health.smithi032.stderr:2023-10-08T06:09:15.276+0000 7fc557fff700 1 -- 172.21.15.32:0/1303091192 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2706306570 0 0) 0x7fc55806c200 con 0x7fc558165740 2023-10-08T06:09:15.282 INFO:teuthology.misc.health.smithi032.stderr:2023-10-08T06:09:15.276+0000 7fc55ca69700 1 -- 172.21.15.32:0/1303091192 >> v1:172.21.15.40:6789/0 conn(0x7fc5580c21a0 legacy=0x7fc55806c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:15.282 INFO:teuthology.misc.health.smithi032.stderr:2023-10-08T06:09:15.276+0000 7fc55ca69700 1 -- 172.21.15.32:0/1303091192 >> v1:172.21.15.32:6789/0 conn(0x7fc558165740 legacy=0x7fc5580cc9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:15.283 INFO:teuthology.misc.health.smithi032.stderr:2023-10-08T06:09:15.276+0000 7fc55ca69700 1 -- 172.21.15.32:0/1303091192 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc558165fe0 con 0x7fc5581652b0 2023-10-08T06:09:15.283 INFO:teuthology.misc.health.smithi032.stderr:2023-10-08T06:09:15.276+0000 7fc55ca69700 1 --2- 172.21.15.32:0/1303091192 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc5581652b0 0x7fc5580cb7e0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fc54c009800 tx=0x7fc54c009b10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b46db9e04dd862a9 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:15.283 INFO:teuthology.misc.health.smithi032.stderr:2023-10-08T06:09:15.276+0000 7fc557fff700 1 -- 172.21.15.32:0/1303091192 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc54c004230 con 0x7fc5581652b0 2023-10-08T06:09:15.283 INFO:teuthology.misc.health.smithi032.stderr:2023-10-08T06:09:15.276+0000 7fc557fff700 1 -- 172.21.15.32:0/1303091192 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc54c004390 con 0x7fc5581652b0 2023-10-08T06:09:15.283 INFO:teuthology.misc.health.smithi032.stderr:2023-10-08T06:09:15.276+0000 7fc557fff700 1 -- 172.21.15.32:0/1303091192 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc54c0036c0 con 0x7fc5581652b0 2023-10-08T06:09:15.283 INFO:teuthology.misc.health.smithi032.stderr:2023-10-08T06:09:15.276+0000 7fc55e26c700 1 -- 172.21.15.32:0/1303091192 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc5581652b0 msgr2=0x7fc5580cb7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:15.283 INFO:teuthology.misc.health.smithi032.stderr:2023-10-08T06:09:15.276+0000 7fc55e26c700 1 --2- 172.21.15.32:0/1303091192 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc5581652b0 0x7fc5580cb7e0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fc54c009800 tx=0x7fc54c009b10 comp rx=0 tx=0).stop 2023-10-08T06:09:15.283 INFO:teuthology.misc.health.smithi032.stderr:2023-10-08T06:09:15.276+0000 7fc55e26c700 1 -- 172.21.15.32:0/1303091192 shutdown_connections 2023-10-08T06:09:15.283 INFO:teuthology.misc.health.smithi032.stderr:2023-10-08T06:09:15.276+0000 7fc55e26c700 1 --2- 172.21.15.32:0/1303091192 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc5581652b0 0x7fc5580cb7e0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:15.283 INFO:teuthology.misc.health.smithi032.stderr:2023-10-08T06:09:15.276+0000 7fc55e26c700 1 -- 172.21.15.32:0/1303091192 >> 172.21.15.32:0/1303091192 conn(0x7fc5580b0900 msgr2=0x7fc5580b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:09:15.284 INFO:teuthology.misc.health.smithi032.stderr:2023-10-08T06:09:15.276+0000 7fc55e26c700 1 -- 172.21.15.32:0/1303091192 shutdown_connections 2023-10-08T06:09:15.284 INFO:teuthology.misc.health.smithi032.stderr:2023-10-08T06:09:15.276+0000 7fc55e26c700 1 -- 172.21.15.32:0/1303091192 wait complete. 2023-10-08T06:09:15.284 INFO:teuthology.misc.health.smithi032.stderr:2023-10-08T06:09:15.280+0000 7fc55e26c700 1 Processor -- start 2023-10-08T06:09:15.284 INFO:teuthology.misc.health.smithi032.stderr:2023-10-08T06:09:15.280+0000 7fc55e26c700 1 -- start start 2023-10-08T06:09:15.285 INFO:teuthology.misc.health.smithi032.stderr:2023-10-08T06:09:15.280+0000 7fc55e26c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc5580c21a0 0x7fc5581f7990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:15.286 INFO:teuthology.misc.health.smithi032.stderr:2023-10-08T06:09:15.280+0000 7fc55e26c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc5581652b0 0x7fc5580c5ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:15.286 INFO:teuthology.misc.health.smithi032.stderr:2023-10-08T06:09:15.280+0000 7fc55e26c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc558165740 0x7fc5580c42f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:15.286 INFO:teuthology.misc.health.smithi032.stderr:2023-10-08T06:09:15.280+0000 7fc55e26c700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5581f71c0 con 0x7fc5581652b0 2023-10-08T06:09:15.286 INFO:teuthology.misc.health.smithi032.stderr:2023-10-08T06:09:15.280+0000 7fc55e26c700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5580c8d10 con 0x7fc558165740 2023-10-08T06:09:15.286 INFO:teuthology.misc.health.smithi032.stderr:2023-10-08T06:09:15.280+0000 7fc55e26c700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5580c8750 con 0x7fc5580c21a0 2023-10-08T06:09:15.286 INFO:teuthology.misc.health.smithi032.stderr:2023-10-08T06:09:15.280+0000 7fc55ca69700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc5581652b0 0x7fc5580c5ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:15.286 INFO:teuthology.misc.health.smithi032.stderr:2023-10-08T06:09:15.280+0000 7fc55ca69700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc5581652b0 0x7fc5580c5ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:36562/0 (socket says 172.21.15.32:36562) 2023-10-08T06:09:15.287 INFO:teuthology.misc.health.smithi032.stderr:2023-10-08T06:09:15.280+0000 7fc55d26a700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc5580c21a0 0x7fc5581f7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:15.287 INFO:teuthology.misc.health.smithi032.stderr:2023-10-08T06:09:15.280+0000 7fc55ca69700 1 -- 172.21.15.32:0/1484840317 learned_addr learned my addr 172.21.15.32:0/1484840317 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:09:15.287 INFO:teuthology.misc.health.smithi032.stderr:2023-10-08T06:09:15.280+0000 7fc55da6b700 1 --2- 172.21.15.32:0/1484840317 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc558165740 0x7fc5580c42f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:15.288 INFO:teuthology.misc.health.smithi032.stderr:2023-10-08T06:09:15.280+0000 7fc55ca69700 1 -- 172.21.15.32:0/1484840317 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc5580c21a0 msgr2=0x7fc5581f7990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:15.288 INFO:teuthology.misc.health.smithi032.stderr:2023-10-08T06:09:15.280+0000 7fc55ca69700 1 --2- 172.21.15.32:0/1484840317 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc5580c21a0 0x7fc5581f7990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:15.289 INFO:teuthology.misc.health.smithi032.stderr:2023-10-08T06:09:15.280+0000 7fc55ca69700 1 -- 172.21.15.32:0/1484840317 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc558165740 msgr2=0x7fc5580c42f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:15.289 INFO:teuthology.misc.health.smithi032.stderr:2023-10-08T06:09:15.280+0000 7fc55ca69700 1 --2- 172.21.15.32:0/1484840317 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc558165740 0x7fc5580c42f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:15.289 INFO:teuthology.misc.health.smithi032.stderr:2023-10-08T06:09:15.280+0000 7fc55ca69700 1 -- 172.21.15.32:0/1484840317 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc54c0094b0 con 0x7fc5581652b0 2023-10-08T06:09:15.289 INFO:teuthology.misc.health.smithi032.stderr:2023-10-08T06:09:15.280+0000 7fc55d26a700 1 --2- 172.21.15.32:0/1484840317 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc5580c21a0 0x7fc5581f7990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T06:09:15.289 INFO:teuthology.misc.health.smithi032.stderr:2023-10-08T06:09:15.280+0000 7fc55da6b700 1 --2- 172.21.15.32:0/1484840317 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc558165740 0x7fc5580c42f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T06:09:15.289 INFO:teuthology.misc.health.smithi032.stderr:2023-10-08T06:09:15.280+0000 7fc55ca69700 1 --2- 172.21.15.32:0/1484840317 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc5581652b0 0x7fc5580c5ea0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fc54c0090b0 tx=0x7fc54c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:15.289 INFO:teuthology.misc.health.smithi032.stderr:2023-10-08T06:09:15.280+0000 7fc555ffb700 1 -- 172.21.15.32:0/1484840317 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc54c011630 con 0x7fc5581652b0 2023-10-08T06:09:15.289 INFO:teuthology.misc.health.smithi032.stderr:2023-10-08T06:09:15.280+0000 7fc555ffb700 1 -- 172.21.15.32:0/1484840317 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc54c01f070 con 0x7fc5581652b0 2023-10-08T06:09:15.289 INFO:teuthology.misc.health.smithi032.stderr:2023-10-08T06:09:15.280+0000 7fc55e26c700 1 -- 172.21.15.32:0/1484840317 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5580c8a30 con 0x7fc5581652b0 2023-10-08T06:09:15.289 INFO:teuthology.misc.health.smithi032.stderr:2023-10-08T06:09:15.280+0000 7fc555ffb700 1 -- 172.21.15.32:0/1484840317 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc54c0119d0 con 0x7fc5581652b0 2023-10-08T06:09:15.290 INFO:teuthology.misc.health.smithi032.stderr:2023-10-08T06:09:15.280+0000 7fc55e26c700 1 -- 172.21.15.32:0/1484840317 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5580c3dd0 con 0x7fc5581652b0 2023-10-08T06:09:15.290 INFO:teuthology.misc.health.smithi032.stderr:2023-10-08T06:09:15.280+0000 7fc555ffb700 1 -- 172.21.15.32:0/1484840317 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fc54c026480 con 0x7fc5581652b0 2023-10-08T06:09:15.290 INFO:teuthology.misc.health.smithi032.stderr:2023-10-08T06:09:15.280+0000 7fc555ffb700 1 -- 172.21.15.32:0/1484840317 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7fc54c021070 con 0x7fc5581652b0 2023-10-08T06:09:15.290 INFO:teuthology.misc.health.smithi032.stderr:2023-10-08T06:09:15.284+0000 7fc55e26c700 1 -- 172.21.15.32:0/1484840317 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5580c3950 con 0x7fc5581652b0 2023-10-08T06:09:15.295 INFO:teuthology.misc.health.smithi032.stderr:2023-10-08T06:09:15.288+0000 7fc555ffb700 1 -- 172.21.15.32:0/1484840317 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7fc54c044b40 con 0x7fc5581652b0 2023-10-08T06:09:15.359 INFO:teuthology.misc.health.smithi032.stderr:2023-10-08T06:09:15.352+0000 7fc55e26c700 1 -- 172.21.15.32:0/1484840317 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc55806be60 con 0x7fc5581652b0 2023-10-08T06:09:15.360 INFO:teuthology.misc.health.smithi032.stderr:2023-10-08T06:09:15.356+0000 7fc555ffb700 1 -- 172.21.15.32:0/1484840317 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7fc54c033070 con 0x7fc5581652b0 2023-10-08T06:09:15.360 INFO:teuthology.misc.health.smithi032.stdout: 2023-10-08T06:09:15.360 INFO:teuthology.misc.health.smithi032.stdout:{"epoch":10,"fsid":"ac672d87-96ae-41e0-9314-623ba2cdbbba","created":"2023-10-08T06:09:11.175626+0000","modified":"2023-10-08T06:09:14.131580+0000","last_up_change":"0.000000","last_in_change":"2023-10-08T06:09:14.131580+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"43433f0c-9592-4874-92d7-10f8f4acf07f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"2ecb1008-b987-4ce7-b646-6cded55fc8d8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"1b131c94-c09b-4e80-8746-bf1b7bac362d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"ad655af2-1f6f-4689-b21d-b07bbaeb68b8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"64a543a1-8c4f-458e-9aba-b35c1cd7dd03","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"0fef3e54-edb4-4678-878e-944663c51638","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"2eeb0472-6096-469d-9b2c-cab4bf41c31a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"cf76e4c7-96a6-401f-a280-91aad4641940","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T06:09:15.361 INFO:teuthology.misc.health.smithi032.stderr:2023-10-08T06:09:15.356+0000 7fc55e26c700 1 -- 172.21.15.32:0/1484840317 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc5581652b0 msgr2=0x7fc5580c5ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:15.361 INFO:teuthology.misc.health.smithi032.stderr:2023-10-08T06:09:15.356+0000 7fc55e26c700 1 --2- 172.21.15.32:0/1484840317 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc5581652b0 0x7fc5580c5ea0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fc54c0090b0 tx=0x7fc54c004770 comp rx=0 tx=0).stop 2023-10-08T06:09:15.362 INFO:teuthology.misc.health.smithi032.stderr:2023-10-08T06:09:15.356+0000 7fc55e26c700 1 -- 172.21.15.32:0/1484840317 shutdown_connections 2023-10-08T06:09:15.362 INFO:teuthology.misc.health.smithi032.stderr:2023-10-08T06:09:15.356+0000 7fc55e26c700 1 --2- 172.21.15.32:0/1484840317 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc5581652b0 0x7fc5580c5ea0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:15.362 INFO:teuthology.misc.health.smithi032.stderr:2023-10-08T06:09:15.356+0000 7fc55e26c700 1 --2- 172.21.15.32:0/1484840317 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc558165740 0x7fc5580c42f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:15.362 INFO:teuthology.misc.health.smithi032.stderr:2023-10-08T06:09:15.356+0000 7fc55e26c700 1 --2- 172.21.15.32:0/1484840317 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc5580c21a0 0x7fc5581f7990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:15.362 INFO:teuthology.misc.health.smithi032.stderr:2023-10-08T06:09:15.356+0000 7fc55e26c700 1 -- 172.21.15.32:0/1484840317 >> 172.21.15.32:0/1484840317 conn(0x7fc5580b0900 msgr2=0x7fc5580b0070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:09:15.362 INFO:teuthology.misc.health.smithi032.stderr:2023-10-08T06:09:15.356+0000 7fc55e26c700 1 -- 172.21.15.32:0/1484840317 shutdown_connections 2023-10-08T06:09:15.362 INFO:teuthology.misc.health.smithi032.stderr:2023-10-08T06:09:15.356+0000 7fc55e26c700 1 -- 172.21.15.32:0/1484840317 wait complete. 2023-10-08T06:09:15.371 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-10-08T06:09:15.732 INFO:tasks.ceph.mgr.y.smithi032.stderr:2023-10-08T06:09:15.728+0000 7fab4701d2c0 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-08T06:09:15.804 INFO:tasks.ceph.mgr.y.smithi032.stderr:2023-10-08T06:09:15.800+0000 7fab4701d2c0 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-08T06:09:15.948 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-10-08T06:09:15.943+0000 7fa60cf292c0 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-08T06:09:15.972 INFO:tasks.ceph.mgr.y.smithi032.stderr:2023-10-08T06:09:15.968+0000 7fab4701d2c0 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-08T06:09:16.019 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-10-08T06:09:16.015+0000 7fa60cf292c0 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-08T06:09:16.041 INFO:tasks.ceph.mgr.y.smithi032.stderr:2023-10-08T06:09:16.036+0000 7fab4701d2c0 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-08T06:09:16.116 INFO:tasks.ceph.mgr.y.smithi032.stderr:2023-10-08T06:09:16.112+0000 7fab4701d2c0 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-08T06:09:16.158 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-10-08T06:09:16.155+0000 7fa60cf292c0 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-08T06:09:16.270 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-10-08T06:09:16.219+0000 7fa60cf292c0 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-08T06:09:16.297 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-10-08T06:09:16.291+0000 7fa60cf292c0 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-08T06:09:16.298 INFO:tasks.ceph.mgr.y.smithi032.stderr:2023-10-08T06:09:16.292+0000 7fab4701d2c0 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-08T06:09:16.466 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-10-08T06:09:16.463+0000 7fa60cf292c0 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-08T06:09:16.523 INFO:tasks.ceph.mgr.y.smithi032.stderr:2023-10-08T06:09:16.516+0000 7fab4701d2c0 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-08T06:09:16.672 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-10-08T06:09:16.667+0000 7fa60cf292c0 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-08T06:09:17.215 INFO:tasks.ceph.mgr.y.smithi032.stderr:2023-10-08T06:09:17.208+0000 7fab4701d2c0 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-08T06:09:17.357 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-10-08T06:09:17.351+0000 7fa60cf292c0 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-08T06:09:18.204 INFO:tasks.ceph.osd.3.smithi032.stderr:2023-10-08T06:09:18.196+0000 7ff6451e8700 -1 osd.3 0 log_to_monitors true 2023-10-08T06:09:18.258 INFO:tasks.ceph.mgr.y.smithi032.stderr:2023-10-08T06:09:18.252+0000 7fab2e00d700 -1 mgr.server handle_report got status from non-daemon mon.c 2023-10-08T06:09:18.262 INFO:tasks.ceph.mgr.y.smithi032.stderr:2023-10-08T06:09:18.256+0000 7fab2e00d700 -1 mgr.server handle_report got status from non-daemon mon.b 2023-10-08T06:09:18.350 INFO:tasks.ceph.osd.6.smithi040.stderr:2023-10-08T06:09:18.343+0000 7f1becb2f700 -1 osd.6 0 log_to_monitors true 2023-10-08T06:09:18.380 INFO:tasks.ceph.osd.0.smithi032.stderr:2023-10-08T06:09:18.376+0000 7f51a2933700 -1 osd.0 0 log_to_monitors true 2023-10-08T06:09:18.381 INFO:tasks.ceph.osd.4.smithi040.stderr:2023-10-08T06:09:18.375+0000 7ff100a9d700 -1 osd.4 0 log_to_monitors true 2023-10-08T06:09:18.398 INFO:tasks.ceph.osd.7.smithi040.stderr:2023-10-08T06:09:18.395+0000 7f411040f700 -1 osd.7 0 log_to_monitors true 2023-10-08T06:09:18.450 INFO:tasks.ceph.osd.5.smithi040.stderr:2023-10-08T06:09:18.443+0000 7f5e0262b700 -1 osd.5 0 log_to_monitors true 2023-10-08T06:09:18.629 INFO:tasks.ceph.osd.1.smithi032.stderr:2023-10-08T06:09:18.624+0000 7efe8e709700 -1 osd.1 0 log_to_monitors true 2023-10-08T06:09:18.643 INFO:tasks.ceph.osd.2.smithi032.stderr:2023-10-08T06:09:18.636+0000 7fe8a6d4b700 -1 osd.2 0 log_to_monitors true 2023-10-08T06:09:20.551 INFO:tasks.ceph.osd.3.smithi032.stderr:2023-10-08T06:09:20.544+0000 7ff6421af700 -1 osd.3 0 waiting for initial osdmap 2023-10-08T06:09:20.566 INFO:tasks.ceph.osd.3.smithi032.stderr:2023-10-08T06:09:20.560+0000 7ff638adc700 -1 osd.3 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-08T06:09:21.740 INFO:tasks.ceph.osd.1.smithi032.stderr:2023-10-08T06:09:21.736+0000 7efe89d25700 -1 osd.1 0 waiting for initial osdmap 2023-10-08T06:09:21.745 INFO:tasks.ceph.osd.1.smithi032.stderr:2023-10-08T06:09:21.740+0000 7efe81ffd700 -1 osd.1 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-08T06:09:21.750 INFO:tasks.ceph.osd.2.smithi032.stderr:2023-10-08T06:09:21.744+0000 7fe8a3d12700 -1 osd.2 0 waiting for initial osdmap 2023-10-08T06:09:21.756 INFO:tasks.ceph.osd.2.smithi032.stderr:2023-10-08T06:09:21.752+0000 7fe89a63f700 -1 osd.2 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-08T06:09:21.779 INFO:tasks.ceph.osd.0.smithi032.stderr:2023-10-08T06:09:21.772+0000 7f519df4f700 -1 osd.0 0 waiting for initial osdmap 2023-10-08T06:09:21.787 INFO:tasks.ceph.osd.0.smithi032.stderr:2023-10-08T06:09:21.780+0000 7f5196227700 -1 osd.0 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-08T06:09:22.177 DEBUG:teuthology.orchestra.run.smithi032:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-08T06:09:22.283 INFO:teuthology.misc.health.smithi032.stderr:2023-10-08T06:09:22.276+0000 7f9759e52700 1 Processor -- start 2023-10-08T06:09:22.284 INFO:teuthology.misc.health.smithi032.stderr:2023-10-08T06:09:22.276+0000 7f9759e52700 1 -- start start 2023-10-08T06:09:22.285 INFO:teuthology.misc.health.smithi032.stderr:2023-10-08T06:09:22.280+0000 7f9759e52700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f975415b210 0x7f975415f540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:22.285 INFO:teuthology.misc.health.smithi032.stderr:2023-10-08T06:09:22.280+0000 7f9759e52700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f97540ca3a0 0x7f975406cd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:22.285 INFO:teuthology.misc.health.smithi032.stderr:2023-10-08T06:09:22.280+0000 7f9759e52700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97540cbd70 con 0x7f975406d2c0 2023-10-08T06:09:22.285 INFO:teuthology.misc.health.smithi032.stderr:2023-10-08T06:09:22.280+0000 7f9759e52700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f975406c2f0 con 0x7f97540ca3a0 2023-10-08T06:09:22.285 INFO:teuthology.misc.health.smithi032.stderr:2023-10-08T06:09:22.280+0000 7f9759e52700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f975415fa80 con 0x7f975415b210 2023-10-08T06:09:22.285 INFO:teuthology.misc.health.smithi032.stderr:2023-10-08T06:09:22.280+0000 7f9753fff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f97540ca3a0 0x7f975406cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:22.286 INFO:teuthology.misc.health.smithi032.stderr:2023-10-08T06:09:22.280+0000 7f9758e50700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f975415b210 0x7f975415f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:22.286 INFO:teuthology.misc.health.smithi032.stderr:2023-10-08T06:09:22.280+0000 7f9753fff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f97540ca3a0 0x7f975406cd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.32:36152/0 (socket says 172.21.15.32:36152) 2023-10-08T06:09:22.286 INFO:teuthology.misc.health.smithi032.stderr:2023-10-08T06:09:22.280+0000 7f9753fff700 1 -- 172.21.15.32:0/204722133 learned_addr learned my addr 172.21.15.32:0/204722133 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:09:22.287 INFO:teuthology.misc.health.smithi032.stderr:2023-10-08T06:09:22.280+0000 7f9753fff700 1 -- 172.21.15.32:0/204722133 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f975415b210 msgr2=0x7f975415f540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:09:22.287 INFO:teuthology.misc.health.smithi032.stderr:2023-10-08T06:09:22.280+0000 7f9753fff700 1 --2- 172.21.15.32:0/204722133 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f975415b210 0x7f975415f540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:22.287 INFO:teuthology.misc.health.smithi032.stderr:2023-10-08T06:09:22.280+0000 7f9753fff700 1 -- 172.21.15.32:0/204722133 >> v1:172.21.15.40:6789/0 conn(0x7f975406d2c0 legacy=0x7f975406a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:22.287 INFO:teuthology.misc.health.smithi032.stderr:2023-10-08T06:09:22.280+0000 7f9753fff700 1 -- 172.21.15.32:0/204722133 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97540cc310 con 0x7f97540ca3a0 2023-10-08T06:09:22.287 INFO:teuthology.misc.health.smithi032.stderr:2023-10-08T06:09:22.280+0000 7f9753fff700 1 --2- 172.21.15.32:0/204722133 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f97540ca3a0 0x7f975406cd80 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f9744009910 tx=0x7f9744009c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1211d86d5ae8ec57 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:22.287 INFO:teuthology.misc.health.smithi032.stderr:2023-10-08T06:09:22.280+0000 7f97537fe700 1 -- 172.21.15.32:0/204722133 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9744011830 con 0x7f97540ca3a0 2023-10-08T06:09:22.287 INFO:teuthology.misc.health.smithi032.stderr:2023-10-08T06:09:22.280+0000 7f97537fe700 1 -- 172.21.15.32:0/204722133 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9744011990 con 0x7f97540ca3a0 2023-10-08T06:09:22.288 INFO:teuthology.misc.health.smithi032.stderr:2023-10-08T06:09:22.280+0000 7f97537fe700 1 -- 172.21.15.32:0/204722133 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9744011d40 con 0x7f97540ca3a0 2023-10-08T06:09:22.288 INFO:teuthology.misc.health.smithi032.stderr:2023-10-08T06:09:22.280+0000 7f9759e52700 1 -- 172.21.15.32:0/204722133 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f97540ca3a0 msgr2=0x7f975406cd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:22.289 INFO:teuthology.misc.health.smithi032.stderr:2023-10-08T06:09:22.280+0000 7f9759e52700 1 --2- 172.21.15.32:0/204722133 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f97540ca3a0 0x7f975406cd80 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f9744009910 tx=0x7f9744009c20 comp rx=0 tx=0).stop 2023-10-08T06:09:22.289 INFO:teuthology.misc.health.smithi032.stderr:2023-10-08T06:09:22.284+0000 7f9759e52700 1 -- 172.21.15.32:0/204722133 shutdown_connections 2023-10-08T06:09:22.289 INFO:teuthology.misc.health.smithi032.stderr:2023-10-08T06:09:22.284+0000 7f9759e52700 1 --2- 172.21.15.32:0/204722133 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f97540ca3a0 0x7f975406cd80 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:22.289 INFO:teuthology.misc.health.smithi032.stderr:2023-10-08T06:09:22.284+0000 7f9759e52700 1 --2- 172.21.15.32:0/204722133 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f975415b210 0x7f975415f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:22.289 INFO:teuthology.misc.health.smithi032.stderr:2023-10-08T06:09:22.284+0000 7f9759e52700 1 -- 172.21.15.32:0/204722133 >> 172.21.15.32:0/204722133 conn(0x7f97540cc7d0 msgr2=0x7f97540ccbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:09:22.289 INFO:teuthology.misc.health.smithi032.stderr:2023-10-08T06:09:22.284+0000 7f9759e52700 1 -- 172.21.15.32:0/204722133 shutdown_connections 2023-10-08T06:09:22.289 INFO:teuthology.misc.health.smithi032.stderr:2023-10-08T06:09:22.284+0000 7f9759e52700 1 -- 172.21.15.32:0/204722133 wait complete. 2023-10-08T06:09:22.290 INFO:teuthology.misc.health.smithi032.stderr:2023-10-08T06:09:22.284+0000 7f9759e52700 1 Processor -- start 2023-10-08T06:09:22.290 INFO:teuthology.misc.health.smithi032.stderr:2023-10-08T06:09:22.284+0000 7f9759e52700 1 -- start start 2023-10-08T06:09:22.293 INFO:teuthology.misc.health.smithi032.stderr:2023-10-08T06:09:22.284+0000 7f9759e52700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f975406d2c0 0x7f9754157c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:22.293 INFO:teuthology.misc.health.smithi032.stderr:2023-10-08T06:09:22.284+0000 7f9759e52700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f97540ca3a0 0x7f97540ac8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:22.293 INFO:teuthology.misc.health.smithi032.stderr:2023-10-08T06:09:22.284+0000 7f9759e52700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f975415b210 0x7f9754157480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:22.293 INFO:teuthology.misc.health.smithi032.stderr:2023-10-08T06:09:22.284+0000 7f9759e52700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97540ce6c0 con 0x7f975406d2c0 2023-10-08T06:09:22.293 INFO:teuthology.misc.health.smithi032.stderr:2023-10-08T06:09:22.284+0000 7f9759e52700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97540cdb10 con 0x7f97540ca3a0 2023-10-08T06:09:22.293 INFO:teuthology.misc.health.smithi032.stderr:2023-10-08T06:09:22.284+0000 7f9759e52700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97540cdd20 con 0x7f975415b210 2023-10-08T06:09:22.293 INFO:teuthology.misc.health.smithi032.stderr:2023-10-08T06:09:22.288+0000 7f9753fff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f97540ca3a0 0x7f97540ac8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:22.293 INFO:teuthology.misc.health.smithi032.stderr:2023-10-08T06:09:22.288+0000 7f9753fff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f97540ca3a0 0x7f97540ac8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.32:36158/0 (socket says 172.21.15.32:36158) 2023-10-08T06:09:22.294 INFO:teuthology.misc.health.smithi032.stderr:2023-10-08T06:09:22.288+0000 7f9753fff700 1 -- 172.21.15.32:0/3147076193 learned_addr learned my addr 172.21.15.32:0/3147076193 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:09:22.294 INFO:teuthology.misc.health.smithi032.stderr:2023-10-08T06:09:22.288+0000 7f9758e50700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f975406d2c0 0x7f9754157c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:22.294 INFO:teuthology.misc.health.smithi032.stderr:2023-10-08T06:09:22.288+0000 7f9759651700 1 --2- 172.21.15.32:0/3147076193 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f975415b210 0x7f9754157480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:22.294 INFO:teuthology.misc.health.smithi032.stderr:2023-10-08T06:09:22.288+0000 7f9753fff700 1 -- 172.21.15.32:0/3147076193 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f975415b210 msgr2=0x7f9754157480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:22.294 INFO:teuthology.misc.health.smithi032.stderr:2023-10-08T06:09:22.288+0000 7f9753fff700 1 --2- 172.21.15.32:0/3147076193 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f975415b210 0x7f9754157480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:22.294 INFO:teuthology.misc.health.smithi032.stderr:2023-10-08T06:09:22.288+0000 7f9753fff700 1 -- 172.21.15.32:0/3147076193 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f975406d2c0 msgr2=0x7f9754157c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:22.294 INFO:teuthology.misc.health.smithi032.stderr:2023-10-08T06:09:22.288+0000 7f9753fff700 1 --2- 172.21.15.32:0/3147076193 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f975406d2c0 0x7f9754157c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:22.294 INFO:teuthology.misc.health.smithi032.stderr:2023-10-08T06:09:22.288+0000 7f9753fff700 1 -- 172.21.15.32:0/3147076193 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9744009570 con 0x7f97540ca3a0 2023-10-08T06:09:22.294 INFO:teuthology.misc.health.smithi032.stderr:2023-10-08T06:09:22.288+0000 7f9753fff700 1 --2- 172.21.15.32:0/3147076193 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f97540ca3a0 0x7f97540ac8f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f975406cae0 tx=0x7f9744004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:22.295 INFO:teuthology.misc.health.smithi032.stderr:2023-10-08T06:09:22.288+0000 7f97517fa700 1 -- 172.21.15.32:0/3147076193 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9744004450 con 0x7f97540ca3a0 2023-10-08T06:09:22.295 INFO:teuthology.misc.health.smithi032.stderr:2023-10-08T06:09:22.288+0000 7f97517fa700 1 -- 172.21.15.32:0/3147076193 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f974401f070 con 0x7f97540ca3a0 2023-10-08T06:09:22.296 INFO:teuthology.misc.health.smithi032.stderr:2023-10-08T06:09:22.288+0000 7f9759e52700 1 -- 172.21.15.32:0/3147076193 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97540ce000 con 0x7f97540ca3a0 2023-10-08T06:09:22.296 INFO:teuthology.misc.health.smithi032.stderr:2023-10-08T06:09:22.288+0000 7f97517fa700 1 -- 172.21.15.32:0/3147076193 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9744003900 con 0x7f97540ca3a0 2023-10-08T06:09:22.296 INFO:teuthology.misc.health.smithi032.stderr:2023-10-08T06:09:22.288+0000 7f9759e52700 1 -- 172.21.15.32:0/3147076193 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97540ace30 con 0x7f97540ca3a0 2023-10-08T06:09:22.296 INFO:teuthology.misc.health.smithi032.stderr:2023-10-08T06:09:22.288+0000 7f9759e52700 1 -- 172.21.15.32:0/3147076193 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97540686a0 con 0x7f97540ca3a0 2023-10-08T06:09:22.297 INFO:teuthology.misc.health.smithi032.stderr:2023-10-08T06:09:22.292+0000 7f97517fa700 1 -- 172.21.15.32:0/3147076193 <== mon.1 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 4) v1 ==== 85794+0+0 (secure 0 0 0) 0x7f9744003a60 con 0x7f97540ca3a0 2023-10-08T06:09:22.297 INFO:teuthology.misc.health.smithi032.stderr:2023-10-08T06:09:22.292+0000 7f97517fa700 1 --2- 172.21.15.32:0/3147076193 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f9740066480 0x7f9740068940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:22.297 INFO:teuthology.misc.health.smithi032.stderr:2023-10-08T06:09:22.292+0000 7f97517fa700 1 -- 172.21.15.32:0/3147076193 <== mon.1 v2:172.21.15.40:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 2511+0+0 (secure 0 0 0) 0x7f9744021070 con 0x7f97540ca3a0 2023-10-08T06:09:22.297 INFO:teuthology.misc.health.smithi032.stderr:2023-10-08T06:09:22.292+0000 7f9758e50700 1 --2- 172.21.15.32:0/3147076193 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f9740066480 0x7f9740068940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:22.298 INFO:teuthology.misc.health.smithi032.stderr:2023-10-08T06:09:22.292+0000 7f9758e50700 1 --2- 172.21.15.32:0/3147076193 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f9740066480 0x7f9740068940 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f97541f6750 tx=0x7f9748009240 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:22.305 INFO:teuthology.misc.health.smithi032.stderr:2023-10-08T06:09:22.300+0000 7f97517fa700 1 -- 172.21.15.32:0/3147076193 <== mon.1 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f9744052a60 con 0x7f97540ca3a0 2023-10-08T06:09:22.473 INFO:teuthology.misc.health.smithi032.stderr:2023-10-08T06:09:22.468+0000 7f9759e52700 1 -- 172.21.15.32:0/3147076193 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f97540cd510 con 0x7f97540ca3a0 2023-10-08T06:09:22.474 INFO:teuthology.misc.health.smithi032.stderr:2023-10-08T06:09:22.468+0000 7f97517fa700 1 -- 172.21.15.32:0/3147076193 <== mon.1 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) v1 ==== 74+0+7554 (secure 0 0 0) 0x7f9744015090 con 0x7f97540ca3a0 2023-10-08T06:09:22.474 INFO:teuthology.misc.health.smithi032.stdout: 2023-10-08T06:09:22.475 INFO:teuthology.misc.health.smithi032.stdout:{"epoch":14,"fsid":"ac672d87-96ae-41e0-9314-623ba2cdbbba","created":"2023-10-08T06:09:11.175626+0000","modified":"2023-10-08T06:09:21.369005+0000","last_up_change":"2023-10-08T06:09:21.369005+0000","last_in_change":"2023-10-08T06:09:14.131580+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"43433f0c-9592-4874-92d7-10f8f4acf07f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"2ecb1008-b987-4ce7-b646-6cded55fc8d8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"1b131c94-c09b-4e80-8746-bf1b7bac362d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"ad655af2-1f6f-4689-b21d-b07bbaeb68b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":3672614802},{"type":"v1","addr":"172.21.15.32:6806","nonce":3672614802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6809","nonce":3672614802},{"type":"v1","addr":"172.21.15.32:6811","nonce":3672614802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":3672614802},{"type":"v1","addr":"172.21.15.32:6815","nonce":3672614802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":3672614802},{"type":"v1","addr":"172.21.15.32:6813","nonce":3672614802}]},"public_addr":"172.21.15.32:6806/3672614802","cluster_addr":"172.21.15.32:6811/3672614802","heartbeat_back_addr":"172.21.15.32:6815/3672614802","heartbeat_front_addr":"172.21.15.32:6813/3672614802","state":["exists","up"]},{"osd":4,"uuid":"64a543a1-8c4f-458e-9aba-b35c1cd7dd03","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"0fef3e54-edb4-4678-878e-944663c51638","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"2eeb0472-6096-469d-9b2c-cab4bf41c31a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"cf76e4c7-96a6-401f-a280-91aad4641940","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T06:09:22.477 INFO:teuthology.misc.health.smithi032.stderr:2023-10-08T06:09:22.472+0000 7f9759e52700 1 -- 172.21.15.32:0/3147076193 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f9740066480 msgr2=0x7f9740068940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:22.477 INFO:teuthology.misc.health.smithi032.stderr:2023-10-08T06:09:22.472+0000 7f9759e52700 1 --2- 172.21.15.32:0/3147076193 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f9740066480 0x7f9740068940 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f97541f6750 tx=0x7f9748009240 comp rx=0 tx=0).stop 2023-10-08T06:09:22.477 INFO:teuthology.misc.health.smithi032.stderr:2023-10-08T06:09:22.472+0000 7f9759e52700 1 -- 172.21.15.32:0/3147076193 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f97540ca3a0 msgr2=0x7f97540ac8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:22.477 INFO:teuthology.misc.health.smithi032.stderr:2023-10-08T06:09:22.472+0000 7f9759e52700 1 --2- 172.21.15.32:0/3147076193 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f97540ca3a0 0x7f97540ac8f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f975406cae0 tx=0x7f9744004770 comp rx=0 tx=0).stop 2023-10-08T06:09:22.477 INFO:teuthology.misc.health.smithi032.stderr:2023-10-08T06:09:22.472+0000 7f9759e52700 1 -- 172.21.15.32:0/3147076193 shutdown_connections 2023-10-08T06:09:22.477 INFO:teuthology.misc.health.smithi032.stderr:2023-10-08T06:09:22.472+0000 7f9759e52700 1 --2- 172.21.15.32:0/3147076193 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f9740066480 0x7f9740068940 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:22.478 INFO:teuthology.misc.health.smithi032.stderr:2023-10-08T06:09:22.472+0000 7f9759e52700 1 --2- 172.21.15.32:0/3147076193 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f975415b210 0x7f9754157480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:22.478 INFO:teuthology.misc.health.smithi032.stderr:2023-10-08T06:09:22.472+0000 7f9759e52700 1 --2- 172.21.15.32:0/3147076193 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f97540ca3a0 0x7f97540ac8f0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:22.478 INFO:teuthology.misc.health.smithi032.stderr:2023-10-08T06:09:22.472+0000 7f9759e52700 1 --2- 172.21.15.32:0/3147076193 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f975406d2c0 0x7f9754157c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:22.478 INFO:teuthology.misc.health.smithi032.stderr:2023-10-08T06:09:22.472+0000 7f9759e52700 1 -- 172.21.15.32:0/3147076193 >> 172.21.15.32:0/3147076193 conn(0x7f97540cc7d0 msgr2=0x7f97540b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:09:22.478 INFO:teuthology.misc.health.smithi032.stderr:2023-10-08T06:09:22.472+0000 7f9759e52700 1 -- 172.21.15.32:0/3147076193 shutdown_connections 2023-10-08T06:09:22.478 INFO:teuthology.misc.health.smithi032.stderr:2023-10-08T06:09:22.472+0000 7f9759e52700 1 -- 172.21.15.32:0/3147076193 wait complete. 2023-10-08T06:09:22.487 DEBUG:teuthology.misc:1 of 8 OSDs are up 2023-10-08T06:09:22.602 INFO:tasks.ceph.osd.5.smithi040.stderr:2023-10-08T06:09:22.595+0000 7f5dfdc47700 -1 osd.5 0 waiting for initial osdmap 2023-10-08T06:09:22.604 INFO:tasks.ceph.osd.7.smithi040.stderr:2023-10-08T06:09:22.599+0000 7f410ba2b700 -1 osd.7 0 waiting for initial osdmap 2023-10-08T06:09:22.607 INFO:tasks.ceph.osd.5.smithi040.stderr:2023-10-08T06:09:22.603+0000 7f5df5f1f700 -1 osd.5 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-08T06:09:22.609 INFO:tasks.ceph.osd.6.smithi040.stderr:2023-10-08T06:09:22.603+0000 7f1be814b700 -1 osd.6 0 waiting for initial osdmap 2023-10-08T06:09:22.609 INFO:tasks.ceph.osd.7.smithi040.stderr:2023-10-08T06:09:22.603+0000 7f4103d03700 -1 osd.7 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-08T06:09:22.613 INFO:tasks.ceph.osd.6.smithi040.stderr:2023-10-08T06:09:22.607+0000 7f1be0423700 -1 osd.6 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-08T06:09:22.615 INFO:tasks.ceph.osd.4.smithi040.stderr:2023-10-08T06:09:22.611+0000 7ff0fda64700 -1 osd.4 0 waiting for initial osdmap 2023-10-08T06:09:22.621 INFO:tasks.ceph.osd.4.smithi040.stderr:2023-10-08T06:09:22.615+0000 7ff0f4391700 -1 osd.4 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-08T06:09:29.292 DEBUG:teuthology.orchestra.run.smithi032:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-08T06:09:29.406 INFO:teuthology.misc.health.smithi032.stderr:2023-10-08T06:09:29.400+0000 7f831c879700 1 Processor -- start 2023-10-08T06:09:29.406 INFO:teuthology.misc.health.smithi032.stderr:2023-10-08T06:09:29.400+0000 7f831c879700 1 -- start start 2023-10-08T06:09:29.407 INFO:teuthology.misc.health.smithi032.stderr:2023-10-08T06:09:29.400+0000 7f831c879700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f83180cf150 0x7f831815f550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:29.407 INFO:teuthology.misc.health.smithi032.stderr:2023-10-08T06:09:29.400+0000 7f831c879700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f83180cb4c0 0x7f831815b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:29.407 INFO:teuthology.misc.health.smithi032.stderr:2023-10-08T06:09:29.400+0000 7f831c879700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83180d04d0 con 0x7f8318158aa0 2023-10-08T06:09:29.407 INFO:teuthology.misc.health.smithi032.stderr:2023-10-08T06:09:29.400+0000 7f831c879700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83180cfc60 con 0x7f83180cb4c0 2023-10-08T06:09:29.407 INFO:teuthology.misc.health.smithi032.stderr:2023-10-08T06:09:29.400+0000 7f831c879700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83180d0c60 con 0x7f83180cf150 2023-10-08T06:09:29.408 INFO:teuthology.misc.health.smithi032.stderr:2023-10-08T06:09:29.400+0000 7f831659c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f83180cf150 0x7f831815f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:29.408 INFO:teuthology.misc.health.smithi032.stderr:2023-10-08T06:09:29.400+0000 7f831759e700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f83180cb4c0 0x7f831815b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:29.408 INFO:teuthology.misc.health.smithi032.stderr:2023-10-08T06:09:29.400+0000 7f831659c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f83180cf150 0x7f831815f550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.32:51364/0 (socket says 172.21.15.32:51364) 2023-10-08T06:09:29.408 INFO:teuthology.misc.health.smithi032.stderr:2023-10-08T06:09:29.400+0000 7f831659c700 1 -- 172.21.15.32:0/1979697652 learned_addr learned my addr 172.21.15.32:0/1979697652 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:09:29.408 INFO:teuthology.misc.health.smithi032.stderr:2023-10-08T06:09:29.404+0000 7f831759e700 1 -- 172.21.15.32:0/1979697652 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f83180cf150 msgr2=0x7f831815f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:09:29.409 INFO:teuthology.misc.health.smithi032.stderr:2023-10-08T06:09:29.404+0000 7f831759e700 1 --2- 172.21.15.32:0/1979697652 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f83180cf150 0x7f831815f550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:29.409 INFO:teuthology.misc.health.smithi032.stderr:2023-10-08T06:09:29.404+0000 7f831759e700 1 -- 172.21.15.32:0/1979697652 >> v1:172.21.15.40:6789/0 conn(0x7f8318158aa0 legacy=0x7f83180cea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:29.409 INFO:teuthology.misc.health.smithi032.stderr:2023-10-08T06:09:29.404+0000 7f831759e700 1 -- 172.21.15.32:0/1979697652 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83180cfe70 con 0x7f83180cb4c0 2023-10-08T06:09:29.409 INFO:teuthology.misc.health.smithi032.stderr:2023-10-08T06:09:29.404+0000 7f831759e700 1 --2- 172.21.15.32:0/1979697652 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f83180cb4c0 0x7f831815b550 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f8310009d90 tx=0x7f831000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1dcdfa9684c5d33a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:29.409 INFO:teuthology.misc.health.smithi032.stderr:2023-10-08T06:09:29.404+0000 7f8315d9b700 1 -- 172.21.15.32:0/1979697652 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f831000e070 con 0x7f83180cb4c0 2023-10-08T06:09:29.409 INFO:teuthology.misc.health.smithi032.stderr:2023-10-08T06:09:29.404+0000 7f8315d9b700 1 -- 172.21.15.32:0/1979697652 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f831000bb20 con 0x7f83180cb4c0 2023-10-08T06:09:29.410 INFO:teuthology.misc.health.smithi032.stderr:2023-10-08T06:09:29.404+0000 7f8315d9b700 1 -- 172.21.15.32:0/1979697652 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8310012430 con 0x7f83180cb4c0 2023-10-08T06:09:29.410 INFO:teuthology.misc.health.smithi032.stderr:2023-10-08T06:09:29.404+0000 7f831c879700 1 -- 172.21.15.32:0/1979697652 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f83180cb4c0 msgr2=0x7f831815b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:29.411 INFO:teuthology.misc.health.smithi032.stderr:2023-10-08T06:09:29.404+0000 7f831c879700 1 --2- 172.21.15.32:0/1979697652 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f83180cb4c0 0x7f831815b550 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f8310009d90 tx=0x7f831000b330 comp rx=0 tx=0).stop 2023-10-08T06:09:29.411 INFO:teuthology.misc.health.smithi032.stderr:2023-10-08T06:09:29.404+0000 7f831c879700 1 -- 172.21.15.32:0/1979697652 shutdown_connections 2023-10-08T06:09:29.412 INFO:teuthology.misc.health.smithi032.stderr:2023-10-08T06:09:29.404+0000 7f831c879700 1 --2- 172.21.15.32:0/1979697652 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f83180cb4c0 0x7f831815b550 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:29.412 INFO:teuthology.misc.health.smithi032.stderr:2023-10-08T06:09:29.404+0000 7f831c879700 1 --2- 172.21.15.32:0/1979697652 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f83180cf150 0x7f831815f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:29.412 INFO:teuthology.misc.health.smithi032.stderr:2023-10-08T06:09:29.404+0000 7f831c879700 1 -- 172.21.15.32:0/1979697652 >> 172.21.15.32:0/1979697652 conn(0x7f831806df60 msgr2=0x7f831806e340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:09:29.412 INFO:teuthology.misc.health.smithi032.stderr:2023-10-08T06:09:29.404+0000 7f831c879700 1 -- 172.21.15.32:0/1979697652 shutdown_connections 2023-10-08T06:09:29.412 INFO:teuthology.misc.health.smithi032.stderr:2023-10-08T06:09:29.404+0000 7f831c879700 1 -- 172.21.15.32:0/1979697652 wait complete. 2023-10-08T06:09:29.413 INFO:teuthology.misc.health.smithi032.stderr:2023-10-08T06:09:29.408+0000 7f831c879700 1 Processor -- start 2023-10-08T06:09:29.413 INFO:teuthology.misc.health.smithi032.stderr:2023-10-08T06:09:29.408+0000 7f831c879700 1 -- start start 2023-10-08T06:09:29.414 INFO:teuthology.misc.health.smithi032.stderr:2023-10-08T06:09:29.408+0000 7f831c879700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f83180cb4c0 0x7f83180c7170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:29.415 INFO:teuthology.misc.health.smithi032.stderr:2023-10-08T06:09:29.408+0000 7f831c879700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f83180cf150 0x7f831815db30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:29.415 INFO:teuthology.misc.health.smithi032.stderr:2023-10-08T06:09:29.408+0000 7f831c879700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8318158aa0 0x7f83180c1160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:29.415 INFO:teuthology.misc.health.smithi032.stderr:2023-10-08T06:09:29.408+0000 7f831c879700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83180c49a0 con 0x7f8318158aa0 2023-10-08T06:09:29.415 INFO:teuthology.misc.health.smithi032.stderr:2023-10-08T06:09:29.408+0000 7f831c879700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83180c51b0 con 0x7f83180cb4c0 2023-10-08T06:09:29.415 INFO:teuthology.misc.health.smithi032.stderr:2023-10-08T06:09:29.408+0000 7f831c879700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83180c4bf0 con 0x7f83180cf150 2023-10-08T06:09:29.415 INFO:teuthology.misc.health.smithi032.stderr:2023-10-08T06:09:29.408+0000 7f831759e700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8318158aa0 0x7f83180c1160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:29.415 INFO:teuthology.misc.health.smithi032.stderr:2023-10-08T06:09:29.408+0000 7f831759e700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8318158aa0 0x7f83180c1160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:43436/0 (socket says 172.21.15.32:43436) 2023-10-08T06:09:29.415 INFO:teuthology.misc.health.smithi032.stderr:2023-10-08T06:09:29.408+0000 7f831759e700 1 -- 172.21.15.32:0/4126163914 learned_addr learned my addr 172.21.15.32:0/4126163914 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:09:29.415 INFO:teuthology.misc.health.smithi032.stderr:2023-10-08T06:09:29.408+0000 7f831659c700 1 --2- 172.21.15.32:0/4126163914 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f83180cf150 0x7f831815db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:29.415 INFO:teuthology.misc.health.smithi032.stderr:2023-10-08T06:09:29.408+0000 7f8316d9d700 1 --2- 172.21.15.32:0/4126163914 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f83180cb4c0 0x7f83180c7170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:29.417 INFO:teuthology.misc.health.smithi032.stderr:2023-10-08T06:09:29.408+0000 7f831759e700 1 -- 172.21.15.32:0/4126163914 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f83180cf150 msgr2=0x7f831815db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:29.417 INFO:teuthology.misc.health.smithi032.stderr:2023-10-08T06:09:29.408+0000 7f831759e700 1 --2- 172.21.15.32:0/4126163914 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f83180cf150 0x7f831815db30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:29.417 INFO:teuthology.misc.health.smithi032.stderr:2023-10-08T06:09:29.408+0000 7f831759e700 1 -- 172.21.15.32:0/4126163914 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f83180cb4c0 msgr2=0x7f83180c7170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:29.417 INFO:teuthology.misc.health.smithi032.stderr:2023-10-08T06:09:29.408+0000 7f831759e700 1 --2- 172.21.15.32:0/4126163914 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f83180cb4c0 0x7f83180c7170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:29.417 INFO:teuthology.misc.health.smithi032.stderr:2023-10-08T06:09:29.408+0000 7f831759e700 1 -- 172.21.15.32:0/4126163914 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8310009a70 con 0x7f8318158aa0 2023-10-08T06:09:29.417 INFO:teuthology.misc.health.smithi032.stderr:2023-10-08T06:09:29.412+0000 7f831759e700 1 --2- 172.21.15.32:0/4126163914 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8318158aa0 0x7f83180c1160 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f8310014040 tx=0x7f8310004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:29.417 INFO:teuthology.misc.health.smithi032.stderr:2023-10-08T06:09:29.412+0000 7f830f7fe700 1 -- 172.21.15.32:0/4126163914 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8310012430 con 0x7f8318158aa0 2023-10-08T06:09:29.417 INFO:teuthology.misc.health.smithi032.stderr:2023-10-08T06:09:29.412+0000 7f830f7fe700 1 -- 172.21.15.32:0/4126163914 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8310020070 con 0x7f8318158aa0 2023-10-08T06:09:29.417 INFO:teuthology.misc.health.smithi032.stderr:2023-10-08T06:09:29.412+0000 7f831c879700 1 -- 172.21.15.32:0/4126163914 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83180c4ed0 con 0x7f8318158aa0 2023-10-08T06:09:29.417 INFO:teuthology.misc.health.smithi032.stderr:2023-10-08T06:09:29.412+0000 7f830f7fe700 1 -- 172.21.15.32:0/4126163914 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83100098f0 con 0x7f8318158aa0 2023-10-08T06:09:29.418 INFO:teuthology.misc.health.smithi032.stderr:2023-10-08T06:09:29.412+0000 7f831c879700 1 -- 172.21.15.32:0/4126163914 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83180c76b0 con 0x7f8318158aa0 2023-10-08T06:09:29.418 INFO:teuthology.misc.health.smithi032.stderr:2023-10-08T06:09:29.412+0000 7f831c879700 1 -- 172.21.15.32:0/4126163914 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83180b1920 con 0x7f8318158aa0 2023-10-08T06:09:29.421 INFO:teuthology.misc.health.smithi032.stderr:2023-10-08T06:09:29.412+0000 7f830f7fe700 1 -- 172.21.15.32:0/4126163914 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f8310004040 con 0x7f8318158aa0 2023-10-08T06:09:29.421 INFO:teuthology.misc.health.smithi032.stderr:2023-10-08T06:09:29.412+0000 7f830f7fe700 1 --2- 172.21.15.32:0/4126163914 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f82f8066540 0x7f82f8068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:29.421 INFO:teuthology.misc.health.smithi032.stderr:2023-10-08T06:09:29.412+0000 7f830f7fe700 1 -- 172.21.15.32:0/4126163914 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f8310022070 con 0x7f8318158aa0 2023-10-08T06:09:29.422 INFO:teuthology.misc.health.smithi032.stderr:2023-10-08T06:09:29.412+0000 7f8316d9d700 1 --2- 172.21.15.32:0/4126163914 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f82f8066540 0x7f82f8068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:29.422 INFO:teuthology.misc.health.smithi032.stderr:2023-10-08T06:09:29.416+0000 7f8316d9d700 1 --2- 172.21.15.32:0/4126163914 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f82f8066540 0x7f82f8068a00 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f8308000f60 tx=0x7f8308009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:29.429 INFO:teuthology.misc.health.smithi032.stderr:2023-10-08T06:09:29.424+0000 7f830f7fe700 1 -- 172.21.15.32:0/4126163914 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f83180b1920 con 0x7f8318158aa0 2023-10-08T06:09:29.599 INFO:teuthology.misc.health.smithi032.stderr:2023-10-08T06:09:29.592+0000 7f831c879700 1 -- 172.21.15.32:0/4126163914 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f83180b1d00 con 0x7f8318158aa0 2023-10-08T06:09:29.601 INFO:teuthology.misc.health.smithi032.stderr:2023-10-08T06:09:29.596+0000 7f830f7fe700 1 -- 172.21.15.32:0/4126163914 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+12790 (secure 0 0 0) 0x7f83180b1d00 con 0x7f8318158aa0 2023-10-08T06:09:29.602 INFO:teuthology.misc.health.smithi032.stdout: 2023-10-08T06:09:29.602 INFO:teuthology.misc.health.smithi032.stdout:{"epoch":18,"fsid":"ac672d87-96ae-41e0-9314-623ba2cdbbba","created":"2023-10-08T06:09:11.175626+0000","modified":"2023-10-08T06:09:25.768642+0000","last_up_change":"2023-10-08T06:09:22.744643+0000","last_in_change":"2023-10-08T06:09:14.131580+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T06:09:23.307843+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"43433f0c-9592-4874-92d7-10f8f4acf07f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":587888964},{"type":"v1","addr":"172.21.15.32:6801","nonce":587888964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":587888964},{"type":"v1","addr":"172.21.15.32:6803","nonce":587888964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":587888964},{"type":"v1","addr":"172.21.15.32:6810","nonce":587888964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6805","nonce":587888964},{"type":"v1","addr":"172.21.15.32:6807","nonce":587888964}]},"public_addr":"172.21.15.32:6801/587888964","cluster_addr":"172.21.15.32:6803/587888964","heartbeat_back_addr":"172.21.15.32:6810/587888964","heartbeat_front_addr":"172.21.15.32:6807/587888964","state":["exists","up"]},{"osd":1,"uuid":"2ecb1008-b987-4ce7-b646-6cded55fc8d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":990576767},{"type":"v1","addr":"172.21.15.32:6817","nonce":990576767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":990576767},{"type":"v1","addr":"172.21.15.32:6819","nonce":990576767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":990576767},{"type":"v1","addr":"172.21.15.32:6823","nonce":990576767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":990576767},{"type":"v1","addr":"172.21.15.32:6821","nonce":990576767}]},"public_addr":"172.21.15.32:6817/990576767","cluster_addr":"172.21.15.32:6819/990576767","heartbeat_back_addr":"172.21.15.32:6823/990576767","heartbeat_front_addr":"172.21.15.32:6821/990576767","state":["exists","up"]},{"osd":2,"uuid":"1b131c94-c09b-4e80-8746-bf1b7bac362d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6824","nonce":1566874440},{"type":"v1","addr":"172.21.15.32:6825","nonce":1566874440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":1566874440},{"type":"v1","addr":"172.21.15.32:6827","nonce":1566874440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":1566874440},{"type":"v1","addr":"172.21.15.32:6831","nonce":1566874440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":1566874440},{"type":"v1","addr":"172.21.15.32:6829","nonce":1566874440}]},"public_addr":"172.21.15.32:6825/1566874440","cluster_addr":"172.21.15.32:6827/1566874440","heartbeat_back_addr":"172.21.15.32:6831/1566874440","heartbeat_front_addr":"172.21.15.32:6829/1566874440","state":["exists","up"]},{"osd":3,"uuid":"ad655af2-1f6f-4689-b21d-b07bbaeb68b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":3672614802},{"type":"v1","addr":"172.21.15.32:6806","nonce":3672614802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6809","nonce":3672614802},{"type":"v1","addr":"172.21.15.32:6811","nonce":3672614802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":3672614802},{"type":"v1","addr":"172.21.15.32:6815","nonce":3672614802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":3672614802},{"type":"v1","addr":"172.21.15.32:6813","nonce":3672614802}]},"public_addr":"172.21.15.32:6806/3672614802","cluster_addr":"172.21.15.32:6811/3672614802","heartbeat_back_addr":"172.21.15.32:6815/3672614802","heartbeat_front_addr":"172.21.15.32:6813/3672614802","state":["exists","up"]},{"osd":4,"uuid":"64a543a1-8c4f-458e-9aba-b35c1cd7dd03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":3369928244},{"type":"v1","addr":"172.21.15.40:6801","nonce":3369928244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":3369928244},{"type":"v1","addr":"172.21.15.40:6803","nonce":3369928244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":3369928244},{"type":"v1","addr":"172.21.15.40:6807","nonce":3369928244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":3369928244},{"type":"v1","addr":"172.21.15.40:6805","nonce":3369928244}]},"public_addr":"172.21.15.40:6801/3369928244","cluster_addr":"172.21.15.40:6803/3369928244","heartbeat_back_addr":"172.21.15.40:6807/3369928244","heartbeat_front_addr":"172.21.15.40:6805/3369928244","state":["exists","up"]},{"osd":5,"uuid":"0fef3e54-edb4-4678-878e-944663c51638","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":2395850297},{"type":"v1","addr":"172.21.15.40:6825","nonce":2395850297}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":2395850297},{"type":"v1","addr":"172.21.15.40:6827","nonce":2395850297}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":2395850297},{"type":"v1","addr":"172.21.15.40:6831","nonce":2395850297}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":2395850297},{"type":"v1","addr":"172.21.15.40:6829","nonce":2395850297}]},"public_addr":"172.21.15.40:6825/2395850297","cluster_addr":"172.21.15.40:6827/2395850297","heartbeat_back_addr":"172.21.15.40:6831/2395850297","heartbeat_front_addr":"172.21.15.40:6829/2395850297","state":["exists","up"]},{"osd":6,"uuid":"2eeb0472-6096-469d-9b2c-cab4bf41c31a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":4145283410},{"type":"v1","addr":"172.21.15.40:6809","nonce":4145283410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":4145283410},{"type":"v1","addr":"172.21.15.40:6811","nonce":4145283410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":4145283410},{"type":"v1","addr":"172.21.15.40:6815","nonce":4145283410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":4145283410},{"type":"v1","addr":"172.21.15.40:6813","nonce":4145283410}]},"public_addr":"172.21.15.40:6809/4145283410","cluster_addr":"172.21.15.40:6811/4145283410","heartbeat_back_addr":"172.21.15.40:6815/4145283410","heartbeat_front_addr":"172.21.15.40:6813/4145283410","state":["exists","up"]},{"osd":7,"uuid":"cf76e4c7-96a6-401f-a280-91aad4641940","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":2943297416},{"type":"v1","addr":"172.21.15.40:6817","nonce":2943297416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":2943297416},{"type":"v1","addr":"172.21.15.40:6819","nonce":2943297416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":2943297416},{"type":"v1","addr":"172.21.15.40:6823","nonce":2943297416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":2943297416},{"type":"v1","addr":"172.21.15.40:6821","nonce":2943297416}]},"public_addr":"172.21.15.40:6817/2943297416","cluster_addr":"172.21.15.40:6819/2943297416","heartbeat_back_addr":"172.21.15.40:6823/2943297416","heartbeat_front_addr":"172.21.15.40:6821/2943297416","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.411475+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.628841+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.599055+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.166100+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.384135+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.488403+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.307648+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.363541+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T06:09:29.604 INFO:teuthology.misc.health.smithi032.stderr:2023-10-08T06:09:29.596+0000 7f831c879700 1 -- 172.21.15.32:0/4126163914 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f82f8066540 msgr2=0x7f82f8068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:29.604 INFO:teuthology.misc.health.smithi032.stderr:2023-10-08T06:09:29.596+0000 7f831c879700 1 --2- 172.21.15.32:0/4126163914 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f82f8066540 0x7f82f8068a00 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f8308000f60 tx=0x7f8308009040 comp rx=0 tx=0).stop 2023-10-08T06:09:29.604 INFO:teuthology.misc.health.smithi032.stderr:2023-10-08T06:09:29.596+0000 7f831c879700 1 -- 172.21.15.32:0/4126163914 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8318158aa0 msgr2=0x7f83180c1160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:29.604 INFO:teuthology.misc.health.smithi032.stderr:2023-10-08T06:09:29.596+0000 7f831c879700 1 --2- 172.21.15.32:0/4126163914 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8318158aa0 0x7f83180c1160 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f8310014040 tx=0x7f8310004af0 comp rx=0 tx=0).stop 2023-10-08T06:09:29.604 INFO:teuthology.misc.health.smithi032.stderr:2023-10-08T06:09:29.600+0000 7f831c879700 1 -- 172.21.15.32:0/4126163914 shutdown_connections 2023-10-08T06:09:29.604 INFO:teuthology.misc.health.smithi032.stderr:2023-10-08T06:09:29.600+0000 7f831c879700 1 --2- 172.21.15.32:0/4126163914 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f82f8066540 0x7f82f8068a00 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:29.604 INFO:teuthology.misc.health.smithi032.stderr:2023-10-08T06:09:29.600+0000 7f831c879700 1 --2- 172.21.15.32:0/4126163914 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8318158aa0 0x7f83180c1160 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:29.605 INFO:teuthology.misc.health.smithi032.stderr:2023-10-08T06:09:29.600+0000 7f831c879700 1 --2- 172.21.15.32:0/4126163914 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f83180cf150 0x7f831815db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:29.605 INFO:teuthology.misc.health.smithi032.stderr:2023-10-08T06:09:29.600+0000 7f831c879700 1 --2- 172.21.15.32:0/4126163914 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f83180cb4c0 0x7f83180c7170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:29.605 INFO:teuthology.misc.health.smithi032.stderr:2023-10-08T06:09:29.600+0000 7f831c879700 1 -- 172.21.15.32:0/4126163914 >> 172.21.15.32:0/4126163914 conn(0x7f831806df60 msgr2=0x7f831806b4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:09:29.605 INFO:teuthology.misc.health.smithi032.stderr:2023-10-08T06:09:29.600+0000 7f831c879700 1 -- 172.21.15.32:0/4126163914 shutdown_connections 2023-10-08T06:09:29.605 INFO:teuthology.misc.health.smithi032.stderr:2023-10-08T06:09:29.600+0000 7f831c879700 1 -- 172.21.15.32:0/4126163914 wait complete. 2023-10-08T06:09:29.615 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-10-08T06:09:29.615 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-10-08T06:09:29.616 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-08T06:09:29.616 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-08T06:09:29.618 INFO:tasks.ceph.mds.a:Started 2023-10-08T06:09:29.618 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-08T06:09:29.618 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-08T06:09:29.620 INFO:tasks.ceph.mds.c:Started 2023-10-08T06:09:29.620 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-08T06:09:29.620 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-08T06:09:29.622 INFO:tasks.ceph.mds.b:Started 2023-10-08T06:09:29.623 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-08T06:09:29.623 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-08T06:09:29.625 INFO:tasks.ceph.mds.d:Started 2023-10-08T06:09:29.625 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-10-08T06:09:29.625 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T06:09:29.689 INFO:tasks.ceph.mds.c.smithi032.stdout:starting mds.c at 2023-10-08T06:09:29.694 INFO:tasks.ceph.mds.a.smithi032.stdout:starting mds.a at 2023-10-08T06:09:29.717 INFO:tasks.ceph.mds.d.smithi040.stdout:starting mds.d at 2023-10-08T06:09:29.722 INFO:tasks.ceph.mds.b.smithi040.stdout:starting mds.b at 2023-10-08T06:09:29.734 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:29.728+0000 7f6bb5b59700 1 Processor -- start 2023-10-08T06:09:29.734 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:29.728+0000 7f6bb5b59700 1 -- start start 2023-10-08T06:09:29.737 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:29.732+0000 7f6bb5b59700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6bb006c410 0x7f6bb015aa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:29.737 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:29.732+0000 7f6bb5b59700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f6bb00cc990 0x7f6bb00ccdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:29.737 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:29.732+0000 7f6bb5b59700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bb00ca2c0 con 0x7f6bb006c030 2023-10-08T06:09:29.737 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:29.732+0000 7f6bb5b59700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bb0159e50 con 0x7f6bb00cc990 2023-10-08T06:09:29.738 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:29.732+0000 7f6bb5b59700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bb00ceb20 con 0x7f6bb006c410 2023-10-08T06:09:29.738 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:29.732+0000 7f6baeffd700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6bb006c410 0x7f6bb015aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:29.738 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:29.732+0000 7f6baffff700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f6bb00cc990 0x7f6bb00ccdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:29.738 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:29.732+0000 7f6baeffd700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6bb006c410 0x7f6bb015aa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.32:36228/0 (socket says 172.21.15.32:36228) 2023-10-08T06:09:29.738 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:29.732+0000 7f6baeffd700 1 -- 172.21.15.32:0/865448748 learned_addr learned my addr 172.21.15.32:0/865448748 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:09:29.738 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:29.732+0000 7f6baf7fe700 1 --1- 172.21.15.32:0/865448748 >> v1:172.21.15.40:6789/0 conn(0x7f6bb006c030 0x7f6bb00ce010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.32:42238/0 (socket says 172.21.15.32:42238) 2023-10-08T06:09:29.738 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:29.732+0000 7f6baeffd700 1 -- 172.21.15.32:0/865448748 >> v2:172.21.15.32:3300/0 conn(0x7f6bb00cc990 msgr2=0x7f6bb00ccdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:09:29.738 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:29.732+0000 7f6baeffd700 1 --2- 172.21.15.32:0/865448748 >> v2:172.21.15.32:3300/0 conn(0x7f6bb00cc990 0x7f6bb00ccdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:29.738 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:29.732+0000 7f6baeffd700 1 -- 172.21.15.32:0/865448748 >> v1:172.21.15.40:6789/0 conn(0x7f6bb006c030 legacy=0x7f6bb00ce010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:29.738 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:29.732+0000 7f6baeffd700 1 -- 172.21.15.32:0/865448748 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bb00ce840 con 0x7f6bb006c410 2023-10-08T06:09:29.738 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:29.732+0000 7f6baeffd700 1 --2- 172.21.15.32:0/865448748 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6bb006c410 0x7f6bb015aa70 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f6bb015e600 tx=0x7f6ba000d430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ce054e2cc48cc22d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:29.739 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:29.732+0000 7f6bae7fc700 1 -- 172.21.15.32:0/865448748 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ba0010070 con 0x7f6bb006c410 2023-10-08T06:09:29.740 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:29.732+0000 7f6bae7fc700 1 -- 172.21.15.32:0/865448748 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ba000dad0 con 0x7f6bb006c410 2023-10-08T06:09:29.740 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:29.732+0000 7f6bae7fc700 1 -- 172.21.15.32:0/865448748 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ba000de60 con 0x7f6bb006c410 2023-10-08T06:09:29.740 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:29.732+0000 7f6bb5b59700 1 -- 172.21.15.32:0/865448748 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6bb006c410 msgr2=0x7f6bb015aa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:29.740 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:29.732+0000 7f6bb5b59700 1 --2- 172.21.15.32:0/865448748 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6bb006c410 0x7f6bb015aa70 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f6bb015e600 tx=0x7f6ba000d430 comp rx=0 tx=0).stop 2023-10-08T06:09:29.740 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:29.732+0000 7f6bb5b59700 1 -- 172.21.15.32:0/865448748 shutdown_connections 2023-10-08T06:09:29.740 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:29.732+0000 7f6bb5b59700 1 --2- 172.21.15.32:0/865448748 >> v2:172.21.15.32:3300/0 conn(0x7f6bb00cc990 0x7f6bb00ccdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:29.740 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:29.732+0000 7f6bb5b59700 1 --2- 172.21.15.32:0/865448748 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6bb006c410 0x7f6bb015aa70 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:29.740 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:29.732+0000 7f6bb5b59700 1 -- 172.21.15.32:0/865448748 >> 172.21.15.32:0/865448748 conn(0x7f6bb00cb840 msgr2=0x7f6bb00cbc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:09:29.740 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:29.732+0000 7f6bb5b59700 1 -- 172.21.15.32:0/865448748 shutdown_connections 2023-10-08T06:09:29.740 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:29.732+0000 7f6bb5b59700 1 -- 172.21.15.32:0/865448748 wait complete. 2023-10-08T06:09:29.741 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:29.736+0000 7f6bb5b59700 1 Processor -- start 2023-10-08T06:09:29.741 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:29.736+0000 7f6bb5b59700 1 -- start start 2023-10-08T06:09:29.743 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:29.736+0000 7f6bb5b59700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6bb006c030 0x7f6bb01ee940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:29.743 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:29.736+0000 7f6bb5b59700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6bb006c410 0x7f6bb00b3d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:29.743 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:29.736+0000 7f6bb5b59700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6bb00cc990 0x7f6bb014f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:29.744 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:29.736+0000 7f6bb5b59700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bb00b4990 con 0x7f6bb006c410 2023-10-08T06:09:29.744 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:29.736+0000 7f6bb5b59700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bb00b46b0 con 0x7f6bb00cc990 2023-10-08T06:09:29.744 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:29.736+0000 7f6bb5b59700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bb00c28a0 con 0x7f6bb006c030 2023-10-08T06:09:29.744 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:29.736+0000 7f6baeffd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6bb006c410 0x7f6bb00b3d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:29.744 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:29.736+0000 7f6baeffd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6bb006c410 0x7f6bb00b3d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:43484/0 (socket says 172.21.15.32:43484) 2023-10-08T06:09:29.744 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:29.736+0000 7f6baeffd700 1 -- 172.21.15.32:0/1068058748 learned_addr learned my addr 172.21.15.32:0/1068058748 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:09:29.744 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:29.736+0000 7f6baf7fe700 1 --2- 172.21.15.32:0/1068058748 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6bb006c030 0x7f6bb01ee940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:29.744 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:29.736+0000 7f6baffff700 1 --2- 172.21.15.32:0/1068058748 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6bb00cc990 0x7f6bb014f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:29.745 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:29.740+0000 7f6baeffd700 1 -- 172.21.15.32:0/1068058748 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6bb006c030 msgr2=0x7f6bb01ee940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:29.745 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:29.740+0000 7f6baeffd700 1 --2- 172.21.15.32:0/1068058748 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6bb006c030 0x7f6bb01ee940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:29.745 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:29.740+0000 7f6baeffd700 1 -- 172.21.15.32:0/1068058748 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6bb00cc990 msgr2=0x7f6bb014f9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:29.746 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:29.740+0000 7f6baeffd700 1 --2- 172.21.15.32:0/1068058748 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6bb00cc990 0x7f6bb014f9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:29.746 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:29.740+0000 7f6baeffd700 1 -- 172.21.15.32:0/1068058748 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ba000bd40 con 0x7f6bb006c410 2023-10-08T06:09:29.746 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:29.740+0000 7f6baf7fe700 1 --2- 172.21.15.32:0/1068058748 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6bb006c030 0x7f6bb01ee940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T06:09:29.746 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:29.740+0000 7f6baeffd700 1 --2- 172.21.15.32:0/1068058748 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6bb006c410 0x7f6bb00b3d40 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f6ba000bc40 tx=0x7f6ba0004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:29.746 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:29.740+0000 7f6ba7fff700 1 -- 172.21.15.32:0/1068058748 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ba0004880 con 0x7f6bb006c410 2023-10-08T06:09:29.746 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:29.740+0000 7f6ba7fff700 1 -- 172.21.15.32:0/1068058748 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ba001f440 con 0x7f6bb006c410 2023-10-08T06:09:29.746 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:29.740+0000 7f6bb5b59700 1 -- 172.21.15.32:0/1068058748 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bb00c2b80 con 0x7f6bb006c410 2023-10-08T06:09:29.746 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:29.740+0000 7f6ba7fff700 1 -- 172.21.15.32:0/1068058748 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ba001f7f0 con 0x7f6bb006c410 2023-10-08T06:09:29.746 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:29.740+0000 7f6bb5b59700 1 -- 172.21.15.32:0/1068058748 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bb01eee80 con 0x7f6bb006c410 2023-10-08T06:09:29.747 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:29.740+0000 7f6ba7fff700 1 -- 172.21.15.32:0/1068058748 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f6ba001f950 con 0x7f6bb006c410 2023-10-08T06:09:29.748 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:29.744+0000 7f6bb5b59700 1 -- 172.21.15.32:0/1068058748 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bb00c2700 con 0x7f6bb006c410 2023-10-08T06:09:29.748 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:29.744+0000 7f6ba7fff700 1 --2- 172.21.15.32:0/1068058748 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f6b90066510 0x7f6b900689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:29.748 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:29.744+0000 7f6ba7fff700 1 -- 172.21.15.32:0/1068058748 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f6ba00875e0 con 0x7f6bb006c410 2023-10-08T06:09:29.749 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:29.744+0000 7f6baf7fe700 1 --2- 172.21.15.32:0/1068058748 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f6b90066510 0x7f6b900689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:29.749 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:29.744+0000 7f6baf7fe700 1 --2- 172.21.15.32:0/1068058748 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f6b90066510 0x7f6b900689d0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f6b98000f60 tx=0x7f6b98007ef0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:29.755 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:29.748+0000 7f6ba7fff700 1 -- 172.21.15.32:0/1068058748 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f6bb00c2700 con 0x7f6bb006c410 2023-10-08T06:09:29.922 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:29.916+0000 7f6bb5b59700 1 -- 172.21.15.32:0/1068058748 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6bb00c30a0 con 0x7f6bb006c410 2023-10-08T06:09:29.924 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:29.920+0000 7f6ba7fff700 1 -- 172.21.15.32:0/1068058748 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+12790 (secure 0 0 0) 0x7f6bb00c30a0 con 0x7f6bb006c410 2023-10-08T06:09:29.924 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:09:29.924 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":18,"fsid":"ac672d87-96ae-41e0-9314-623ba2cdbbba","created":"2023-10-08T06:09:11.175626+0000","modified":"2023-10-08T06:09:25.768642+0000","last_up_change":"2023-10-08T06:09:22.744643+0000","last_in_change":"2023-10-08T06:09:14.131580+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T06:09:23.307843+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"43433f0c-9592-4874-92d7-10f8f4acf07f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":587888964},{"type":"v1","addr":"172.21.15.32:6801","nonce":587888964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":587888964},{"type":"v1","addr":"172.21.15.32:6803","nonce":587888964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":587888964},{"type":"v1","addr":"172.21.15.32:6810","nonce":587888964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6805","nonce":587888964},{"type":"v1","addr":"172.21.15.32:6807","nonce":587888964}]},"public_addr":"172.21.15.32:6801/587888964","cluster_addr":"172.21.15.32:6803/587888964","heartbeat_back_addr":"172.21.15.32:6810/587888964","heartbeat_front_addr":"172.21.15.32:6807/587888964","state":["exists","up"]},{"osd":1,"uuid":"2ecb1008-b987-4ce7-b646-6cded55fc8d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":990576767},{"type":"v1","addr":"172.21.15.32:6817","nonce":990576767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":990576767},{"type":"v1","addr":"172.21.15.32:6819","nonce":990576767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":990576767},{"type":"v1","addr":"172.21.15.32:6823","nonce":990576767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":990576767},{"type":"v1","addr":"172.21.15.32:6821","nonce":990576767}]},"public_addr":"172.21.15.32:6817/990576767","cluster_addr":"172.21.15.32:6819/990576767","heartbeat_back_addr":"172.21.15.32:6823/990576767","heartbeat_front_addr":"172.21.15.32:6821/990576767","state":["exists","up"]},{"osd":2,"uuid":"1b131c94-c09b-4e80-8746-bf1b7bac362d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6824","nonce":1566874440},{"type":"v1","addr":"172.21.15.32:6825","nonce":1566874440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":1566874440},{"type":"v1","addr":"172.21.15.32:6827","nonce":1566874440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":1566874440},{"type":"v1","addr":"172.21.15.32:6831","nonce":1566874440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":1566874440},{"type":"v1","addr":"172.21.15.32:6829","nonce":1566874440}]},"public_addr":"172.21.15.32:6825/1566874440","cluster_addr":"172.21.15.32:6827/1566874440","heartbeat_back_addr":"172.21.15.32:6831/1566874440","heartbeat_front_addr":"172.21.15.32:6829/1566874440","state":["exists","up"]},{"osd":3,"uuid":"ad655af2-1f6f-4689-b21d-b07bbaeb68b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":3672614802},{"type":"v1","addr":"172.21.15.32:6806","nonce":3672614802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6809","nonce":3672614802},{"type":"v1","addr":"172.21.15.32:6811","nonce":3672614802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":3672614802},{"type":"v1","addr":"172.21.15.32:6815","nonce":3672614802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":3672614802},{"type":"v1","addr":"172.21.15.32:6813","nonce":3672614802}]},"public_addr":"172.21.15.32:6806/3672614802","cluster_addr":"172.21.15.32:6811/3672614802","heartbeat_back_addr":"172.21.15.32:6815/3672614802","heartbeat_front_addr":"172.21.15.32:6813/3672614802","state":["exists","up"]},{"osd":4,"uuid":"64a543a1-8c4f-458e-9aba-b35c1cd7dd03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":3369928244},{"type":"v1","addr":"172.21.15.40:6801","nonce":3369928244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":3369928244},{"type":"v1","addr":"172.21.15.40:6803","nonce":3369928244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":3369928244},{"type":"v1","addr":"172.21.15.40:6807","nonce":3369928244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":3369928244},{"type":"v1","addr":"172.21.15.40:6805","nonce":3369928244}]},"public_addr":"172.21.15.40:6801/3369928244","cluster_addr":"172.21.15.40:6803/3369928244","heartbeat_back_addr":"172.21.15.40:6807/3369928244","heartbeat_front_addr":"172.21.15.40:6805/3369928244","state":["exists","up"]},{"osd":5,"uuid":"0fef3e54-edb4-4678-878e-944663c51638","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":2395850297},{"type":"v1","addr":"172.21.15.40:6825","nonce":2395850297}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":2395850297},{"type":"v1","addr":"172.21.15.40:6827","nonce":2395850297}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":2395850297},{"type":"v1","addr":"172.21.15.40:6831","nonce":2395850297}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":2395850297},{"type":"v1","addr":"172.21.15.40:6829","nonce":2395850297}]},"public_addr":"172.21.15.40:6825/2395850297","cluster_addr":"172.21.15.40:6827/2395850297","heartbeat_back_addr":"172.21.15.40:6831/2395850297","heartbeat_front_addr":"172.21.15.40:6829/2395850297","state":["exists","up"]},{"osd":6,"uuid":"2eeb0472-6096-469d-9b2c-cab4bf41c31a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":4145283410},{"type":"v1","addr":"172.21.15.40:6809","nonce":4145283410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":4145283410},{"type":"v1","addr":"172.21.15.40:6811","nonce":4145283410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":4145283410},{"type":"v1","addr":"172.21.15.40:6815","nonce":4145283410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":4145283410},{"type":"v1","addr":"172.21.15.40:6813","nonce":4145283410}]},"public_addr":"172.21.15.40:6809/4145283410","cluster_addr":"172.21.15.40:6811/4145283410","heartbeat_back_addr":"172.21.15.40:6815/4145283410","heartbeat_front_addr":"172.21.15.40:6813/4145283410","state":["exists","up"]},{"osd":7,"uuid":"cf76e4c7-96a6-401f-a280-91aad4641940","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":2943297416},{"type":"v1","addr":"172.21.15.40:6817","nonce":2943297416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":2943297416},{"type":"v1","addr":"172.21.15.40:6819","nonce":2943297416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":2943297416},{"type":"v1","addr":"172.21.15.40:6823","nonce":2943297416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":2943297416},{"type":"v1","addr":"172.21.15.40:6821","nonce":2943297416}]},"public_addr":"172.21.15.40:6817/2943297416","cluster_addr":"172.21.15.40:6819/2943297416","heartbeat_back_addr":"172.21.15.40:6823/2943297416","heartbeat_front_addr":"172.21.15.40:6821/2943297416","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.411475+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.628841+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.599055+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.166100+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.384135+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.488403+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.307648+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.363541+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T06:09:29.927 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:29.920+0000 7f6bb5b59700 1 -- 172.21.15.32:0/1068058748 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f6b90066510 msgr2=0x7f6b900689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:29.927 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:29.920+0000 7f6bb5b59700 1 --2- 172.21.15.32:0/1068058748 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f6b90066510 0x7f6b900689d0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f6b98000f60 tx=0x7f6b98007ef0 comp rx=0 tx=0).stop 2023-10-08T06:09:29.927 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:29.920+0000 7f6bb5b59700 1 -- 172.21.15.32:0/1068058748 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6bb006c410 msgr2=0x7f6bb00b3d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:29.927 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:29.920+0000 7f6bb5b59700 1 --2- 172.21.15.32:0/1068058748 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6bb006c410 0x7f6bb00b3d40 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f6ba000bc40 tx=0x7f6ba0004af0 comp rx=0 tx=0).stop 2023-10-08T06:09:29.927 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:29.920+0000 7f6bb5b59700 1 -- 172.21.15.32:0/1068058748 shutdown_connections 2023-10-08T06:09:29.927 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:29.920+0000 7f6bb5b59700 1 --2- 172.21.15.32:0/1068058748 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f6b90066510 0x7f6b900689d0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:29.927 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:29.920+0000 7f6bb5b59700 1 --2- 172.21.15.32:0/1068058748 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6bb006c410 0x7f6bb00b3d40 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:29.927 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:29.920+0000 7f6bb5b59700 1 --2- 172.21.15.32:0/1068058748 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6bb00cc990 0x7f6bb014f9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:29.927 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:29.920+0000 7f6bb5b59700 1 --2- 172.21.15.32:0/1068058748 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6bb006c030 0x7f6bb01ee940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:29.928 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:29.920+0000 7f6bb5b59700 1 -- 172.21.15.32:0/1068058748 >> 172.21.15.32:0/1068058748 conn(0x7f6bb00cb840 msgr2=0x7f6bb01512c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:09:29.928 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:29.920+0000 7f6bb5b59700 1 -- 172.21.15.32:0/1068058748 shutdown_connections 2023-10-08T06:09:29.928 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:29.920+0000 7f6bb5b59700 1 -- 172.21.15.32:0/1068058748 wait complete. 2023-10-08T06:09:29.938 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T06:09:23.307843+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-08T06:09:29.939 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T06:09:30.063 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:30.056+0000 7f35e1b9e700 1 Processor -- start 2023-10-08T06:09:30.063 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:30.056+0000 7f35e1b9e700 1 -- start start 2023-10-08T06:09:30.065 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:30.060+0000 7f35e1b9e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f35d404fb80 0x7f35d4006360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:30.065 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:30.060+0000 7f35e1b9e700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35d40e05e0 con 0x7f35d4050f70 2023-10-08T06:09:30.065 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:30.060+0000 7f35e1b9e700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35d4053f80 con 0x7f35d4053a80 2023-10-08T06:09:30.065 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:30.060+0000 7f35e1b9e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35d4054260 con 0x7f35d404fb80 2023-10-08T06:09:30.065 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:30.060+0000 7f35e139d700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f35d4050f70 0x7f35d4039ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:52990/0 (socket says 172.21.15.32:52990) 2023-10-08T06:09:30.065 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:30.060+0000 7f35e139d700 1 -- 172.21.15.32:0/3528482245 learned_addr learned my addr 172.21.15.32:0/3528482245 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-08T06:09:30.066 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:30.060+0000 7f35e0b9c700 1 --2- 172.21.15.32:0/3528482245 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f35d404fb80 0x7f35d4006360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:30.067 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:30.060+0000 7f35db7fe700 1 -- 172.21.15.32:0/3528482245 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 785444514 0 0) 0x7f35d40e05e0 con 0x7f35d4050f70 2023-10-08T06:09:30.067 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:30.060+0000 7f35db7fe700 1 -- 172.21.15.32:0/3528482245 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f35c40035d0 con 0x7f35d4050f70 2023-10-08T06:09:30.067 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:30.060+0000 7f35db7fe700 1 -- 172.21.15.32:0/3528482245 <== mon.1 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2932425244 0 0) 0x7f35d4053f80 con 0x7f35d4053a80 2023-10-08T06:09:30.067 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:30.060+0000 7f35db7fe700 1 -- 172.21.15.32:0/3528482245 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f35d40e05e0 con 0x7f35d4053a80 2023-10-08T06:09:30.067 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:30.060+0000 7f35e0b9c700 1 -- 172.21.15.32:0/3528482245 >> v1:172.21.15.40:6789/0 conn(0x7f35d4053a80 legacy=0x7f35d40393c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:30.067 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:30.060+0000 7f35e0b9c700 1 -- 172.21.15.32:0/3528482245 >> v1:172.21.15.32:6789/0 conn(0x7f35d4050f70 legacy=0x7f35d4039ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:30.067 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:30.060+0000 7f35e0b9c700 1 -- 172.21.15.32:0/3528482245 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35d4054540 con 0x7f35d404fb80 2023-10-08T06:09:30.067 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:30.060+0000 7f35e0b9c700 1 --2- 172.21.15.32:0/3528482245 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f35d404fb80 0x7f35d4006360 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f35cc009880 tx=0x7f35cc009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=664fdeb0720c61b6 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:30.068 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:30.060+0000 7f35db7fe700 1 -- 172.21.15.32:0/3528482245 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35cc011830 con 0x7f35d404fb80 2023-10-08T06:09:30.068 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:30.060+0000 7f35db7fe700 1 -- 172.21.15.32:0/3528482245 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35cc011990 con 0x7f35d404fb80 2023-10-08T06:09:30.068 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:30.060+0000 7f35db7fe700 1 -- 172.21.15.32:0/3528482245 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35cc011d20 con 0x7f35d404fb80 2023-10-08T06:09:30.069 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:30.064+0000 7f35e1b9e700 1 -- 172.21.15.32:0/3528482245 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f35d404fb80 msgr2=0x7f35d4006360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:30.069 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:30.064+0000 7f35e1b9e700 1 --2- 172.21.15.32:0/3528482245 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f35d404fb80 0x7f35d4006360 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f35cc009880 tx=0x7f35cc009b90 comp rx=0 tx=0).stop 2023-10-08T06:09:30.069 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:30.064+0000 7f35e1b9e700 1 -- 172.21.15.32:0/3528482245 shutdown_connections 2023-10-08T06:09:30.069 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:30.064+0000 7f35e1b9e700 1 --2- 172.21.15.32:0/3528482245 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f35d404fb80 0x7f35d4006360 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:30.069 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:30.064+0000 7f35e1b9e700 1 -- 172.21.15.32:0/3528482245 >> 172.21.15.32:0/3528482245 conn(0x7f35d400aa20 msgr2=0x7f35d400ae00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:09:30.069 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:30.064+0000 7f35e1b9e700 1 -- 172.21.15.32:0/3528482245 shutdown_connections 2023-10-08T06:09:30.070 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:30.064+0000 7f35e1b9e700 1 -- 172.21.15.32:0/3528482245 wait complete. 2023-10-08T06:09:30.070 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:30.064+0000 7f35e1b9e700 1 Processor -- start 2023-10-08T06:09:30.070 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:30.064+0000 7f35e1b9e700 1 -- start start 2023-10-08T06:09:30.072 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:30.064+0000 7f35e1b9e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f35d404fb80 0x7f35d40dde70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:30.073 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:30.064+0000 7f35e1b9e700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f35d4050f70 0x7f35d404d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:30.073 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:30.064+0000 7f35e1b9e700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f35d4053a80 0x7f35d4034f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:30.073 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:30.064+0000 7f35e1b9e700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35d4175df0 con 0x7f35d4053a80 2023-10-08T06:09:30.073 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:30.064+0000 7f35e1b9e700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35d404ccf0 con 0x7f35d4050f70 2023-10-08T06:09:30.073 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:30.064+0000 7f35e1b9e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35d404cfd0 con 0x7f35d404fb80 2023-10-08T06:09:30.073 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:30.068+0000 7f35e139d700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f35d4053a80 0x7f35d4034f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:30.073 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:30.068+0000 7f35e0b9c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f35d404fb80 0x7f35d40dde70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:30.073 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:30.068+0000 7f35e139d700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f35d4053a80 0x7f35d4034f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:43486/0 (socket says 172.21.15.32:43486) 2023-10-08T06:09:30.073 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:30.068+0000 7f35e139d700 1 -- 172.21.15.32:0/1080171421 learned_addr learned my addr 172.21.15.32:0/1080171421 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:09:30.073 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:30.068+0000 7f35dbfff700 1 --2- 172.21.15.32:0/1080171421 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f35d4050f70 0x7f35d404d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:30.073 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:30.068+0000 7f35e139d700 1 -- 172.21.15.32:0/1080171421 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f35d404fb80 msgr2=0x7f35d40dde70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:30.074 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:30.068+0000 7f35e139d700 1 --2- 172.21.15.32:0/1080171421 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f35d404fb80 0x7f35d40dde70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:30.074 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:30.068+0000 7f35e139d700 1 -- 172.21.15.32:0/1080171421 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f35d4050f70 msgr2=0x7f35d404d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:30.074 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:30.068+0000 7f35e139d700 1 --2- 172.21.15.32:0/1080171421 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f35d4050f70 0x7f35d404d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:30.074 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:30.068+0000 7f35e139d700 1 -- 172.21.15.32:0/1080171421 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35cc0094b0 con 0x7f35d4053a80 2023-10-08T06:09:30.074 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:30.068+0000 7f35e139d700 1 --2- 172.21.15.32:0/1080171421 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f35d4053a80 0x7f35d4034f90 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f35dc068e50 tx=0x7f35dc068250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:30.075 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:30.068+0000 7f35d97fa700 1 -- 172.21.15.32:0/1080171421 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35dc072910 con 0x7f35d4053a80 2023-10-08T06:09:30.075 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:30.068+0000 7f35e1b9e700 1 -- 172.21.15.32:0/1080171421 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35d404d2b0 con 0x7f35d4053a80 2023-10-08T06:09:30.075 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:30.068+0000 7f35d97fa700 1 -- 172.21.15.32:0/1080171421 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35dc08e070 con 0x7f35d4053a80 2023-10-08T06:09:30.075 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:30.068+0000 7f35d97fa700 1 -- 172.21.15.32:0/1080171421 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35dc067490 con 0x7f35d4053a80 2023-10-08T06:09:30.075 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:30.068+0000 7f35e1b9e700 1 -- 172.21.15.32:0/1080171421 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35d40de400 con 0x7f35d4053a80 2023-10-08T06:09:30.076 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:30.072+0000 7f35d97fa700 1 -- 172.21.15.32:0/1080171421 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f35dc0675f0 con 0x7f35d4053a80 2023-10-08T06:09:30.076 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:30.072+0000 7f35e1b9e700 1 -- 172.21.15.32:0/1080171421 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35d404cb50 con 0x7f35d4053a80 2023-10-08T06:09:30.077 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:30.072+0000 7f35d97fa700 1 --2- 172.21.15.32:0/1080171421 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f35c8066510 0x7f35c80689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:30.077 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:30.072+0000 7f35d97fa700 1 -- 172.21.15.32:0/1080171421 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f35dc0fea40 con 0x7f35d4053a80 2023-10-08T06:09:30.077 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:30.072+0000 7f35e0b9c700 1 --2- 172.21.15.32:0/1080171421 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f35c8066510 0x7f35c80689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:30.077 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:30.072+0000 7f35e0b9c700 1 --2- 172.21.15.32:0/1080171421 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f35c8066510 0x7f35c80689d0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f35cc0090b0 tx=0x7f35cc010000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:30.081 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:30.076+0000 7f35d97fa700 1 -- 172.21.15.32:0/1080171421 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f35d404cb50 con 0x7f35d4053a80 2023-10-08T06:09:30.245 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:30.240+0000 7f35e1b9e700 1 -- 172.21.15.32:0/1080171421 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f35d404d110 con 0x7f35d4053a80 2023-10-08T06:09:30.245 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:30.240+0000 7f35d97fa700 1 -- 172.21.15.32:0/1080171421 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v18) v1 ==== 93+0+10 (secure 0 0 0) 0x7f35d404d110 con 0x7f35d4053a80 2023-10-08T06:09:30.246 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 1 2023-10-08T06:09:30.248 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:30.240+0000 7f35e1b9e700 1 -- 172.21.15.32:0/1080171421 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f35c8066510 msgr2=0x7f35c80689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:30.248 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:30.240+0000 7f35e1b9e700 1 --2- 172.21.15.32:0/1080171421 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f35c8066510 0x7f35c80689d0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f35cc0090b0 tx=0x7f35cc010000 comp rx=0 tx=0).stop 2023-10-08T06:09:30.248 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:30.240+0000 7f35e1b9e700 1 -- 172.21.15.32:0/1080171421 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f35d4053a80 msgr2=0x7f35d4034f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:30.248 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:30.240+0000 7f35e1b9e700 1 --2- 172.21.15.32:0/1080171421 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f35d4053a80 0x7f35d4034f90 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f35dc068e50 tx=0x7f35dc068250 comp rx=0 tx=0).stop 2023-10-08T06:09:30.248 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:30.244+0000 7f35e1b9e700 1 -- 172.21.15.32:0/1080171421 shutdown_connections 2023-10-08T06:09:30.248 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:30.244+0000 7f35e1b9e700 1 --2- 172.21.15.32:0/1080171421 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f35c8066510 0x7f35c80689d0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:30.248 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:30.244+0000 7f35e1b9e700 1 --2- 172.21.15.32:0/1080171421 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f35d4053a80 0x7f35d4034f90 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:30.249 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:30.244+0000 7f35e1b9e700 1 --2- 172.21.15.32:0/1080171421 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f35d4050f70 0x7f35d404d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:30.249 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:30.244+0000 7f35e1b9e700 1 --2- 172.21.15.32:0/1080171421 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f35d404fb80 0x7f35d40dde70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:30.249 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:30.244+0000 7f35e1b9e700 1 -- 172.21.15.32:0/1080171421 >> 172.21.15.32:0/1080171421 conn(0x7f35d400aa20 msgr2=0x7f35d4053070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:09:30.249 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:30.244+0000 7f35e1b9e700 1 -- 172.21.15.32:0/1080171421 shutdown_connections 2023-10-08T06:09:30.249 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:30.244+0000 7f35e1b9e700 1 -- 172.21.15.32:0/1080171421 wait complete. 2023-10-08T06:09:30.261 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T06:09:30.373 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:30.368+0000 7f1a9f7bb700 1 Processor -- start 2023-10-08T06:09:30.373 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:30.368+0000 7f1a9f7bb700 1 -- start start 2023-10-08T06:09:30.377 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:30.368+0000 7f1a9f7bb700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f1a9815d980 0x7f1a980b4d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:30.377 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:30.368+0000 7f1a9f7bb700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f1a980b5270 0x7f1a980d1760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:30.377 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:30.368+0000 7f1a9f7bb700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a980b6750 con 0x7f1a980d1ca0 2023-10-08T06:09:30.377 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:30.368+0000 7f1a9f7bb700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a980d2a30 con 0x7f1a9815d980 2023-10-08T06:09:30.377 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:30.368+0000 7f1a9f7bb700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a980b6980 con 0x7f1a980b5270 2023-10-08T06:09:30.377 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:30.368+0000 7f1a9d557700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f1a9815d980 0x7f1a980b4d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:30.378 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:30.368+0000 7f1a9d557700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f1a9815d980 0x7f1a980b4d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:37176/0 (socket says 172.21.15.32:37176) 2023-10-08T06:09:30.378 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:30.368+0000 7f1a9d557700 1 -- 172.21.15.32:0/1528422300 learned_addr learned my addr 172.21.15.32:0/1528422300 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:09:30.378 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:30.368+0000 7f1a9cd56700 1 --2- 172.21.15.32:0/1528422300 >> v2:172.21.15.40:3300/0 conn(0x7f1a980b5270 0x7f1a980d1760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:30.378 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:30.368+0000 7f1a9d557700 1 -- 172.21.15.32:0/1528422300 >> v2:172.21.15.40:3300/0 conn(0x7f1a980b5270 msgr2=0x7f1a980d1760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:09:30.378 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:30.368+0000 7f1a9d557700 1 --2- 172.21.15.32:0/1528422300 >> v2:172.21.15.40:3300/0 conn(0x7f1a980b5270 0x7f1a980d1760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:30.379 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:30.368+0000 7f1a9d557700 1 -- 172.21.15.32:0/1528422300 >> v1:172.21.15.40:6789/0 conn(0x7f1a980d1ca0 legacy=0x7f1a9806ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:30.379 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:30.368+0000 7f1a9d557700 1 -- 172.21.15.32:0/1528422300 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a980b56d0 con 0x7f1a9815d980 2023-10-08T06:09:30.379 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:30.368+0000 7f1a9d557700 1 --2- 172.21.15.32:0/1528422300 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1a9815d980 0x7f1a980b4d30 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f1a980b5ea0 tx=0x7f1a8800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=122e60db7cf8a640 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:30.379 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:30.368+0000 7f1a97fff700 1 -- 172.21.15.32:0/1528422300 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a8800e070 con 0x7f1a9815d980 2023-10-08T06:09:30.379 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:30.368+0000 7f1a97fff700 1 -- 172.21.15.32:0/1528422300 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a8800b9c0 con 0x7f1a9815d980 2023-10-08T06:09:30.379 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:30.368+0000 7f1a97fff700 1 -- 172.21.15.32:0/1528422300 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a8800bd70 con 0x7f1a9815d980 2023-10-08T06:09:30.380 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:30.368+0000 7f1a9f7bb700 1 -- 172.21.15.32:0/1528422300 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1a9815d980 msgr2=0x7f1a980b4d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:30.380 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:30.368+0000 7f1a9f7bb700 1 --2- 172.21.15.32:0/1528422300 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1a9815d980 0x7f1a980b4d30 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f1a980b5ea0 tx=0x7f1a8800b330 comp rx=0 tx=0).stop 2023-10-08T06:09:30.380 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:30.372+0000 7f1a9f7bb700 1 -- 172.21.15.32:0/1528422300 shutdown_connections 2023-10-08T06:09:30.380 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:30.372+0000 7f1a9f7bb700 1 --2- 172.21.15.32:0/1528422300 >> v2:172.21.15.40:3300/0 conn(0x7f1a980b5270 0x7f1a980d1760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:30.380 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:30.372+0000 7f1a9f7bb700 1 --2- 172.21.15.32:0/1528422300 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1a9815d980 0x7f1a980b4d30 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:30.380 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:30.372+0000 7f1a9f7bb700 1 -- 172.21.15.32:0/1528422300 >> 172.21.15.32:0/1528422300 conn(0x7f1a980cfd30 msgr2=0x7f1a980d0110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:09:30.380 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:30.372+0000 7f1a9f7bb700 1 -- 172.21.15.32:0/1528422300 shutdown_connections 2023-10-08T06:09:30.381 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:30.372+0000 7f1a9f7bb700 1 -- 172.21.15.32:0/1528422300 wait complete. 2023-10-08T06:09:30.385 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:30.372+0000 7f1a9f7bb700 1 Processor -- start 2023-10-08T06:09:30.385 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:30.372+0000 7f1a9f7bb700 1 -- start start 2023-10-08T06:09:30.385 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:30.372+0000 7f1a9f7bb700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1a980b5270 0x7f1a98151c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:30.385 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:30.372+0000 7f1a9f7bb700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1a980d1ca0 0x7f1a9815f930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:30.385 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:30.372+0000 7f1a9f7bb700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1a9815fe70 0x7f1a981559a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:30.385 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:30.372+0000 7f1a9f7bb700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a981f7210 con 0x7f1a980b5270 2023-10-08T06:09:30.386 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:30.372+0000 7f1a9f7bb700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a981573a0 con 0x7f1a9815fe70 2023-10-08T06:09:30.386 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:30.372+0000 7f1a9f7bb700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a981f68b0 con 0x7f1a980d1ca0 2023-10-08T06:09:30.386 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:30.372+0000 7f1a9d557700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1a980b5270 0x7f1a98151c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:30.386 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:30.372+0000 7f1a9d557700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1a980b5270 0x7f1a98151c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:37186/0 (socket says 172.21.15.32:37186) 2023-10-08T06:09:30.386 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:30.372+0000 7f1a9d557700 1 -- 172.21.15.32:0/1997939522 learned_addr learned my addr 172.21.15.32:0/1997939522 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:09:30.386 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:30.372+0000 7f1a9dd58700 1 --2- 172.21.15.32:0/1997939522 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1a9815fe70 0x7f1a981559a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:30.386 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:30.372+0000 7f1a9cd56700 1 --2- 172.21.15.32:0/1997939522 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1a980d1ca0 0x7f1a9815f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:30.387 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:30.372+0000 7f1a9d557700 1 -- 172.21.15.32:0/1997939522 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1a980d1ca0 msgr2=0x7f1a9815f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:30.387 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:30.372+0000 7f1a9d557700 1 --2- 172.21.15.32:0/1997939522 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1a980d1ca0 0x7f1a9815f930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:30.387 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:30.372+0000 7f1a9d557700 1 -- 172.21.15.32:0/1997939522 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1a9815fe70 msgr2=0x7f1a981559a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:30.387 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:30.372+0000 7f1a9d557700 1 --2- 172.21.15.32:0/1997939522 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1a9815fe70 0x7f1a981559a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:30.387 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:30.372+0000 7f1a9d557700 1 -- 172.21.15.32:0/1997939522 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a88009b30 con 0x7f1a980b5270 2023-10-08T06:09:30.387 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:30.372+0000 7f1a9dd58700 1 --2- 172.21.15.32:0/1997939522 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1a9815fe70 0x7f1a981559a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T06:09:30.387 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:30.372+0000 7f1a9cd56700 1 --2- 172.21.15.32:0/1997939522 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1a980d1ca0 0x7f1a9815f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T06:09:30.387 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:30.372+0000 7f1a9d557700 1 --2- 172.21.15.32:0/1997939522 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1a980b5270 0x7f1a98151c80 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f1a980b59c0 tx=0x7f1a88004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:30.387 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:30.376+0000 7f1a95ffb700 1 -- 172.21.15.32:0/1997939522 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a880099b0 con 0x7f1a980b5270 2023-10-08T06:09:30.387 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:30.376+0000 7f1a95ffb700 1 -- 172.21.15.32:0/1997939522 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a880092e0 con 0x7f1a980b5270 2023-10-08T06:09:30.387 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:30.376+0000 7f1a9f7bb700 1 -- 172.21.15.32:0/1997939522 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a981f6b50 con 0x7f1a980b5270 2023-10-08T06:09:30.387 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:30.376+0000 7f1a95ffb700 1 -- 172.21.15.32:0/1997939522 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a8801c660 con 0x7f1a980b5270 2023-10-08T06:09:30.388 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:30.376+0000 7f1a9f7bb700 1 -- 172.21.15.32:0/1997939522 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a981521c0 con 0x7f1a980b5270 2023-10-08T06:09:30.388 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:30.376+0000 7f1a9f7bb700 1 -- 172.21.15.32:0/1997939522 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a98160250 con 0x7f1a980b5270 2023-10-08T06:09:30.388 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:30.376+0000 7f1a95ffb700 1 -- 172.21.15.32:0/1997939522 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f1a8801c7c0 con 0x7f1a980b5270 2023-10-08T06:09:30.388 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:30.376+0000 7f1a95ffb700 1 --2- 172.21.15.32:0/1997939522 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f1a78066510 0x7f1a780689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:30.388 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:30.376+0000 7f1a95ffb700 1 -- 172.21.15.32:0/1997939522 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f1a880855a0 con 0x7f1a980b5270 2023-10-08T06:09:30.388 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:30.376+0000 7f1a9cd56700 1 --2- 172.21.15.32:0/1997939522 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f1a78066510 0x7f1a780689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:30.388 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:30.380+0000 7f1a9cd56700 1 --2- 172.21.15.32:0/1997939522 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f1a78066510 0x7f1a780689d0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f1a9815f160 tx=0x7f1a80008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:30.390 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:30.384+0000 7f1a95ffb700 1 -- 172.21.15.32:0/1997939522 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f1a88052d60 con 0x7f1a980b5270 2023-10-08T06:09:30.600 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:30.596+0000 7f1a9f7bb700 1 -- 172.21.15.32:0/1997939522 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1a98073f00 con 0x7f1a980b5270 2023-10-08T06:09:30.601 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:30.596+0000 7f1a95ffb700 1 -- 172.21.15.32:0/1997939522 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1324 (secure 0 0 0) 0x7f1a88056380 con 0x7f1a980b5270 2023-10-08T06:09:30.601 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:09:30.601 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4254,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6835/1810658720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6834","nonce":1810658720},{"type":"v1","addr":"172.21.15.32:6835","nonce":1810658720}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2023-10-08T06:09:30.602 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:30.596+0000 7f1a9f7bb700 1 -- 172.21.15.32:0/1997939522 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f1a78066510 msgr2=0x7f1a780689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:30.603 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:30.596+0000 7f1a9f7bb700 1 --2- 172.21.15.32:0/1997939522 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f1a78066510 0x7f1a780689d0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f1a9815f160 tx=0x7f1a80008040 comp rx=0 tx=0).stop 2023-10-08T06:09:30.603 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:30.596+0000 7f1a9f7bb700 1 -- 172.21.15.32:0/1997939522 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1a980b5270 msgr2=0x7f1a98151c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:30.603 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:30.596+0000 7f1a9f7bb700 1 --2- 172.21.15.32:0/1997939522 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1a980b5270 0x7f1a98151c80 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f1a980b59c0 tx=0x7f1a88004af0 comp rx=0 tx=0).stop 2023-10-08T06:09:30.604 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:30.596+0000 7f1a9f7bb700 1 -- 172.21.15.32:0/1997939522 shutdown_connections 2023-10-08T06:09:30.604 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:30.596+0000 7f1a9f7bb700 1 --2- 172.21.15.32:0/1997939522 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f1a78066510 0x7f1a780689d0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:30.604 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:30.596+0000 7f1a9f7bb700 1 --2- 172.21.15.32:0/1997939522 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1a9815fe70 0x7f1a981559a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:30.604 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:30.596+0000 7f1a9f7bb700 1 --2- 172.21.15.32:0/1997939522 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1a980d1ca0 0x7f1a9815f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:30.604 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:30.596+0000 7f1a9f7bb700 1 --2- 172.21.15.32:0/1997939522 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1a980b5270 0x7f1a98151c80 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:30.604 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:30.596+0000 7f1a9f7bb700 1 -- 172.21.15.32:0/1997939522 >> 172.21.15.32:0/1997939522 conn(0x7f1a980cfd30 msgr2=0x7f1a980d36b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:09:30.604 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:30.596+0000 7f1a9f7bb700 1 -- 172.21.15.32:0/1997939522 shutdown_connections 2023-10-08T06:09:30.604 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:30.596+0000 7f1a9f7bb700 1 -- 172.21.15.32:0/1997939522 wait complete. 2023-10-08T06:09:30.605 INFO:teuthology.orchestra.run.smithi032.stderr:dumped fsmap epoch 2 2023-10-08T06:09:32.616 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T06:09:32.739 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:32.732+0000 7fd944e39700 1 Processor -- start 2023-10-08T06:09:32.739 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:32.732+0000 7fd944e39700 1 -- start start 2023-10-08T06:09:32.741 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:32.732+0000 7fd944e39700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd94006b3b0 0x7fd94006b790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:32.741 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:32.732+0000 7fd944e39700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fd94006d990 0x7fd94015da80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:32.741 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:32.732+0000 7fd944e39700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd94015e940 con 0x7fd94015dfc0 2023-10-08T06:09:32.741 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:32.732+0000 7fd944e39700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd94015a830 con 0x7fd94006d990 2023-10-08T06:09:32.741 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:32.732+0000 7fd944e39700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd94015e3c0 con 0x7fd94006b3b0 2023-10-08T06:09:32.741 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:32.736+0000 7fd93effd700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fd94006d990 0x7fd94015da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:32.741 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:32.736+0000 7fd93effd700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fd94006d990 0x7fd94015da80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:37188/0 (socket says 172.21.15.32:37188) 2023-10-08T06:09:32.741 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:32.736+0000 7fd93effd700 1 -- 172.21.15.32:0/1580183367 learned_addr learned my addr 172.21.15.32:0/1580183367 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:09:32.741 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:32.736+0000 7fd93f7fe700 1 --2- 172.21.15.32:0/1580183367 >> v2:172.21.15.40:3300/0 conn(0x7fd94006b3b0 0x7fd94006b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:32.742 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:32.736+0000 7fd93effd700 1 -- 172.21.15.32:0/1580183367 >> v2:172.21.15.40:3300/0 conn(0x7fd94006b3b0 msgr2=0x7fd94006b790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:09:32.742 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:32.736+0000 7fd93effd700 1 --2- 172.21.15.32:0/1580183367 >> v2:172.21.15.40:3300/0 conn(0x7fd94006b3b0 0x7fd94006b790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:32.742 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:32.736+0000 7fd93effd700 1 -- 172.21.15.32:0/1580183367 >> v1:172.21.15.40:6789/0 conn(0x7fd94015dfc0 legacy=0x7fd94015aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:32.742 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:32.736+0000 7fd93effd700 1 -- 172.21.15.32:0/1580183367 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd94006bcd0 con 0x7fd94006d990 2023-10-08T06:09:32.742 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:32.736+0000 7fd93effd700 1 --2- 172.21.15.32:0/1580183367 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd94006d990 0x7fd94015da80 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fd940070920 tx=0x7fd92800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adb411985b10def3 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:32.742 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:32.736+0000 7fd93e7fc700 1 -- 172.21.15.32:0/1580183367 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd92800e070 con 0x7fd94006d990 2023-10-08T06:09:32.742 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:32.736+0000 7fd93e7fc700 1 -- 172.21.15.32:0/1580183367 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd928003a40 con 0x7fd94006d990 2023-10-08T06:09:32.742 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:32.736+0000 7fd93e7fc700 1 -- 172.21.15.32:0/1580183367 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd928003df0 con 0x7fd94006d990 2023-10-08T06:09:32.743 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:32.736+0000 7fd944e39700 1 -- 172.21.15.32:0/1580183367 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd94006d990 msgr2=0x7fd94015da80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:32.743 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:32.736+0000 7fd944e39700 1 --2- 172.21.15.32:0/1580183367 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd94006d990 0x7fd94015da80 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fd940070920 tx=0x7fd92800b330 comp rx=0 tx=0).stop 2023-10-08T06:09:32.743 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:32.736+0000 7fd944e39700 1 -- 172.21.15.32:0/1580183367 shutdown_connections 2023-10-08T06:09:32.743 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:32.736+0000 7fd944e39700 1 --2- 172.21.15.32:0/1580183367 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd94006d990 0x7fd94015da80 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:32.743 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:32.736+0000 7fd944e39700 1 --2- 172.21.15.32:0/1580183367 >> v2:172.21.15.40:3300/0 conn(0x7fd94006b3b0 0x7fd94006b790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:32.744 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:32.736+0000 7fd944e39700 1 -- 172.21.15.32:0/1580183367 >> 172.21.15.32:0/1580183367 conn(0x7fd9400cc7d0 msgr2=0x7fd9400ccbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:09:32.744 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:32.736+0000 7fd944e39700 1 -- 172.21.15.32:0/1580183367 shutdown_connections 2023-10-08T06:09:32.744 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:32.736+0000 7fd944e39700 1 -- 172.21.15.32:0/1580183367 wait complete. 2023-10-08T06:09:32.745 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:32.740+0000 7fd944e39700 1 Processor -- start 2023-10-08T06:09:32.745 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:32.740+0000 7fd944e39700 1 -- start start 2023-10-08T06:09:32.749 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:32.740+0000 7fd944e39700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd94006b3b0 0x7fd94014e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:32.750 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:32.740+0000 7fd944e39700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd94006d990 0x7fd9401f0a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:32.750 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:32.740+0000 7fd944e39700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd94015dfc0 0x7fd9400b3230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:32.750 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:32.740+0000 7fd944e39700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9400c38f0 con 0x7fd94006b3b0 2023-10-08T06:09:32.750 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:32.740+0000 7fd944e39700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd94014ea30 con 0x7fd94006d990 2023-10-08T06:09:32.750 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:32.740+0000 7fd944e39700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9400b2da0 con 0x7fd94015dfc0 2023-10-08T06:09:32.751 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:32.740+0000 7fd93f7fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd94006b3b0 0x7fd94014e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:32.751 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:32.740+0000 7fd93f7fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd94006b3b0 0x7fd94014e4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:37198/0 (socket says 172.21.15.32:37198) 2023-10-08T06:09:32.751 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:32.740+0000 7fd93f7fe700 1 -- 172.21.15.32:0/3898085703 learned_addr learned my addr 172.21.15.32:0/3898085703 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:09:32.751 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:32.740+0000 7fd93ffff700 1 --2- 172.21.15.32:0/3898085703 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd94015dfc0 0x7fd9400b3230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:32.751 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:32.740+0000 7fd93effd700 1 --2- 172.21.15.32:0/3898085703 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd94006d990 0x7fd9401f0a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:32.751 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:32.740+0000 7fd93f7fe700 1 -- 172.21.15.32:0/3898085703 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd94015dfc0 msgr2=0x7fd9400b3230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:32.751 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:32.740+0000 7fd93f7fe700 1 --2- 172.21.15.32:0/3898085703 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd94015dfc0 0x7fd9400b3230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:32.751 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:32.740+0000 7fd93f7fe700 1 -- 172.21.15.32:0/3898085703 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd94006d990 msgr2=0x7fd9401f0a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:32.752 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:32.740+0000 7fd93f7fe700 1 --2- 172.21.15.32:0/3898085703 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd94006d990 0x7fd9401f0a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:32.752 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:32.740+0000 7fd93f7fe700 1 -- 172.21.15.32:0/3898085703 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd928009b30 con 0x7fd94006b3b0 2023-10-08T06:09:32.752 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:32.744+0000 7fd93f7fe700 1 --2- 172.21.15.32:0/3898085703 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd94006b3b0 0x7fd94014e4f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fd93800d800 tx=0x7fd93800db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:32.752 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:32.744+0000 7fd937fff700 1 -- 172.21.15.32:0/3898085703 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9380125f0 con 0x7fd94006b3b0 2023-10-08T06:09:32.752 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:32.744+0000 7fd937fff700 1 -- 172.21.15.32:0/3898085703 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd938012750 con 0x7fd94006b3b0 2023-10-08T06:09:32.752 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:32.744+0000 7fd944e39700 1 -- 172.21.15.32:0/3898085703 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9401f1350 con 0x7fd94006b3b0 2023-10-08T06:09:32.752 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:32.744+0000 7fd937fff700 1 -- 172.21.15.32:0/3898085703 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd938012ac0 con 0x7fd94006b3b0 2023-10-08T06:09:32.752 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:32.744+0000 7fd944e39700 1 -- 172.21.15.32:0/3898085703 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9401f1910 con 0x7fd94006b3b0 2023-10-08T06:09:32.753 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:32.744+0000 7fd937fff700 1 -- 172.21.15.32:0/3898085703 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fd938012c20 con 0x7fd94006b3b0 2023-10-08T06:09:32.753 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:32.744+0000 7fd944e39700 1 -- 172.21.15.32:0/3898085703 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9400686a0 con 0x7fd94006b3b0 2023-10-08T06:09:32.753 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:32.744+0000 7fd937fff700 1 --2- 172.21.15.32:0/3898085703 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fd924066540 0x7fd924068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:32.753 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:32.744+0000 7fd937fff700 1 -- 172.21.15.32:0/3898085703 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fd938083ba0 con 0x7fd94006b3b0 2023-10-08T06:09:32.754 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:32.744+0000 7fd93effd700 1 --2- 172.21.15.32:0/3898085703 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fd924066540 0x7fd924068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:32.754 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:32.748+0000 7fd93effd700 1 --2- 172.21.15.32:0/3898085703 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fd924066540 0x7fd924068a00 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fd928000f80 tx=0x7fd928009000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:32.758 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:32.752+0000 7fd937fff700 1 -- 172.21.15.32:0/3898085703 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fd9380512e0 con 0x7fd94006b3b0 2023-10-08T06:09:32.963 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:32.956+0000 7fd944e39700 1 -- 172.21.15.32:0/3898085703 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd9400b5cd0 con 0x7fd94006b3b0 2023-10-08T06:09:32.964 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:32.960+0000 7fd937fff700 1 -- 172.21.15.32:0/3898085703 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3694 (secure 0 0 0) 0x7fd938054900 con 0x7fd94006b3b0 2023-10-08T06:09:32.965 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:09:32.965 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6833/2405386193","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":2405386193},{"type":"v1","addr":"172.21.15.40:6833","nonce":2405386193}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4254,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6835/1810658720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6834","nonce":1810658720},{"type":"v1","addr":"172.21.15.32:6835","nonce":1810658720}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4257,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6837/2286934165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6836","nonce":2286934165},{"type":"v1","addr":"172.21.15.32:6837","nonce":2286934165}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4318,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/3325966535","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":3325966535},{"type":"v1","addr":"172.21.15.40:6835","nonce":3325966535}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[]} 2023-10-08T06:09:32.967 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:32.960+0000 7fd944e39700 1 -- 172.21.15.32:0/3898085703 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fd924066540 msgr2=0x7fd924068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:32.967 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:32.960+0000 7fd944e39700 1 --2- 172.21.15.32:0/3898085703 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fd924066540 0x7fd924068a00 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fd928000f80 tx=0x7fd928009000 comp rx=0 tx=0).stop 2023-10-08T06:09:32.967 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:32.960+0000 7fd944e39700 1 -- 172.21.15.32:0/3898085703 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd94006b3b0 msgr2=0x7fd94014e4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:32.967 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:32.960+0000 7fd944e39700 1 --2- 172.21.15.32:0/3898085703 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd94006b3b0 0x7fd94014e4f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fd93800d800 tx=0x7fd93800db10 comp rx=0 tx=0).stop 2023-10-08T06:09:32.968 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:32.960+0000 7fd944e39700 1 -- 172.21.15.32:0/3898085703 shutdown_connections 2023-10-08T06:09:32.968 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:32.960+0000 7fd944e39700 1 --2- 172.21.15.32:0/3898085703 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fd924066540 0x7fd924068a00 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:32.968 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:32.960+0000 7fd944e39700 1 --2- 172.21.15.32:0/3898085703 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd94015dfc0 0x7fd9400b3230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:32.968 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:32.960+0000 7fd944e39700 1 --2- 172.21.15.32:0/3898085703 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd94006d990 0x7fd9401f0a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:32.968 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:32.960+0000 7fd944e39700 1 --2- 172.21.15.32:0/3898085703 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd94006b3b0 0x7fd94014e4f0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:32.968 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:32.960+0000 7fd944e39700 1 -- 172.21.15.32:0/3898085703 >> 172.21.15.32:0/3898085703 conn(0x7fd9400cc7d0 msgr2=0x7fd940070c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:09:32.968 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:32.960+0000 7fd944e39700 1 -- 172.21.15.32:0/3898085703 shutdown_connections 2023-10-08T06:09:32.968 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:32.960+0000 7fd944e39700 1 -- 172.21.15.32:0/3898085703 wait complete. 2023-10-08T06:09:32.969 INFO:teuthology.orchestra.run.smithi032.stderr:dumped fsmap epoch 3 2023-10-08T06:09:32.979 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T06:09:33.092 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.088+0000 7fe05bf48700 1 Processor -- start 2023-10-08T06:09:33.093 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.088+0000 7fe05bf48700 1 -- start start 2023-10-08T06:09:33.094 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.088+0000 7fe05bf48700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fe05415d980 0x7fe0540b4d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:33.094 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.088+0000 7fe05bf48700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe0540b5270 0x7fe0540d1760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:33.094 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.088+0000 7fe05bf48700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0540b6750 con 0x7fe0540d1ca0 2023-10-08T06:09:33.095 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.088+0000 7fe05bf48700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0540d2a30 con 0x7fe05415d980 2023-10-08T06:09:33.095 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.088+0000 7fe05bf48700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0540b6980 con 0x7fe0540b5270 2023-10-08T06:09:33.095 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.088+0000 7fe059ce4700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fe05415d980 0x7fe0540b4d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:33.095 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.088+0000 7fe059ce4700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fe05415d980 0x7fe0540b4d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:37200/0 (socket says 172.21.15.32:37200) 2023-10-08T06:09:33.095 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.088+0000 7fe0594e3700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe0540b5270 0x7fe0540d1760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:33.095 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.088+0000 7fe059ce4700 1 -- 172.21.15.32:0/2391150449 learned_addr learned my addr 172.21.15.32:0/2391150449 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:09:33.095 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.088+0000 7fe059ce4700 1 -- 172.21.15.32:0/2391150449 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe0540b5270 msgr2=0x7fe0540d1760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:09:33.095 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.088+0000 7fe059ce4700 1 --2- 172.21.15.32:0/2391150449 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe0540b5270 0x7fe0540d1760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:33.095 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.088+0000 7fe059ce4700 1 -- 172.21.15.32:0/2391150449 >> v1:172.21.15.40:6789/0 conn(0x7fe0540d1ca0 legacy=0x7fe05406ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:33.096 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.088+0000 7fe059ce4700 1 -- 172.21.15.32:0/2391150449 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0540b56d0 con 0x7fe05415d980 2023-10-08T06:09:33.096 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.088+0000 7fe059ce4700 1 --2- 172.21.15.32:0/2391150449 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe05415d980 0x7fe0540b4d30 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fe044009910 tx=0x7fe044009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9ff56ee8d4e8c21 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:33.097 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.088+0000 7fe058ce2700 1 -- 172.21.15.32:0/2391150449 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe044011830 con 0x7fe05415d980 2023-10-08T06:09:33.097 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.088+0000 7fe058ce2700 1 -- 172.21.15.32:0/2391150449 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe044011990 con 0x7fe05415d980 2023-10-08T06:09:33.097 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.088+0000 7fe058ce2700 1 -- 172.21.15.32:0/2391150449 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe044011d40 con 0x7fe05415d980 2023-10-08T06:09:33.097 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.092+0000 7fe05bf48700 1 -- 172.21.15.32:0/2391150449 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe05415d980 msgr2=0x7fe0540b4d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:33.097 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.092+0000 7fe05bf48700 1 --2- 172.21.15.32:0/2391150449 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe05415d980 0x7fe0540b4d30 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fe044009910 tx=0x7fe044009c20 comp rx=0 tx=0).stop 2023-10-08T06:09:33.097 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.092+0000 7fe05bf48700 1 -- 172.21.15.32:0/2391150449 shutdown_connections 2023-10-08T06:09:33.098 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.092+0000 7fe05bf48700 1 --2- 172.21.15.32:0/2391150449 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe0540b5270 0x7fe0540d1760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:33.098 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.092+0000 7fe05bf48700 1 --2- 172.21.15.32:0/2391150449 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe05415d980 0x7fe0540b4d30 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:33.098 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.092+0000 7fe05bf48700 1 -- 172.21.15.32:0/2391150449 >> 172.21.15.32:0/2391150449 conn(0x7fe0540cfd30 msgr2=0x7fe0540d0110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:09:33.098 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.092+0000 7fe05bf48700 1 -- 172.21.15.32:0/2391150449 shutdown_connections 2023-10-08T06:09:33.098 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.092+0000 7fe05bf48700 1 -- 172.21.15.32:0/2391150449 wait complete. 2023-10-08T06:09:33.103 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.092+0000 7fe05bf48700 1 Processor -- start 2023-10-08T06:09:33.103 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.092+0000 7fe05bf48700 1 -- start start 2023-10-08T06:09:33.104 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.092+0000 7fe05bf48700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe0540b5270 0x7fe054160a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:33.104 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.092+0000 7fe05bf48700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe0540d1ca0 0x7fe0541f2f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:33.104 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.092+0000 7fe05bf48700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe0541f34b0 0x7fe054155590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:33.104 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.092+0000 7fe05bf48700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0540cb3d0 con 0x7fe0540b5270 2023-10-08T06:09:33.104 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.092+0000 7fe05bf48700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0541f3930 con 0x7fe0541f34b0 2023-10-08T06:09:33.104 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.092+0000 7fe05bf48700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe054156380 con 0x7fe0540d1ca0 2023-10-08T06:09:33.104 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.092+0000 7fe059ce4700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe0540b5270 0x7fe054160a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:33.104 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.092+0000 7fe059ce4700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe0540b5270 0x7fe054160a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:37204/0 (socket says 172.21.15.32:37204) 2023-10-08T06:09:33.104 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.092+0000 7fe059ce4700 1 -- 172.21.15.32:0/4031664642 learned_addr learned my addr 172.21.15.32:0/4031664642 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:09:33.104 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.092+0000 7fe05a4e5700 1 --2- 172.21.15.32:0/4031664642 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe0541f34b0 0x7fe054155590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:33.105 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.092+0000 7fe0594e3700 1 --2- 172.21.15.32:0/4031664642 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe0540d1ca0 0x7fe0541f2f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:33.105 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.092+0000 7fe059ce4700 1 -- 172.21.15.32:0/4031664642 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe0540d1ca0 msgr2=0x7fe0541f2f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:33.105 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.092+0000 7fe059ce4700 1 --2- 172.21.15.32:0/4031664642 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe0540d1ca0 0x7fe0541f2f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:33.105 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.092+0000 7fe059ce4700 1 -- 172.21.15.32:0/4031664642 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe0541f34b0 msgr2=0x7fe054155590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:33.105 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.092+0000 7fe059ce4700 1 --2- 172.21.15.32:0/4031664642 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe0541f34b0 0x7fe054155590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:33.105 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.092+0000 7fe059ce4700 1 -- 172.21.15.32:0/4031664642 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe044009570 con 0x7fe0540b5270 2023-10-08T06:09:33.105 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.092+0000 7fe0594e3700 1 --2- 172.21.15.32:0/4031664642 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe0540d1ca0 0x7fe0541f2f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T06:09:33.105 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.092+0000 7fe05a4e5700 1 --2- 172.21.15.32:0/4031664642 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe0541f34b0 0x7fe054155590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T06:09:33.105 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.096+0000 7fe059ce4700 1 --2- 172.21.15.32:0/4031664642 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe0540b5270 0x7fe054160a70 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fe044000c00 tx=0x7fe044004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:33.105 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.096+0000 7fe0527fc700 1 -- 172.21.15.32:0/4031664642 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe044004610 con 0x7fe0540b5270 2023-10-08T06:09:33.105 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.096+0000 7fe0527fc700 1 -- 172.21.15.32:0/4031664642 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0440036c0 con 0x7fe0540b5270 2023-10-08T06:09:33.105 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.096+0000 7fe05bf48700 1 -- 172.21.15.32:0/4031664642 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe054156660 con 0x7fe0540b5270 2023-10-08T06:09:33.106 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.096+0000 7fe0527fc700 1 -- 172.21.15.32:0/4031664642 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe044003a50 con 0x7fe0540b5270 2023-10-08T06:09:33.106 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.096+0000 7fe05bf48700 1 -- 172.21.15.32:0/4031664642 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0540cb5e0 con 0x7fe0540b5270 2023-10-08T06:09:33.106 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.096+0000 7fe05bf48700 1 -- 172.21.15.32:0/4031664642 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe054073f00 con 0x7fe0540b5270 2023-10-08T06:09:33.106 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.096+0000 7fe0527fc700 1 -- 172.21.15.32:0/4031664642 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fe044003bb0 con 0x7fe0540b5270 2023-10-08T06:09:33.106 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.096+0000 7fe0527fc700 1 --2- 172.21.15.32:0/4031664642 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fe034066510 0x7fe0340689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:33.106 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.096+0000 7fe0527fc700 1 -- 172.21.15.32:0/4031664642 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fe044021030 con 0x7fe0540b5270 2023-10-08T06:09:33.106 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.096+0000 7fe0594e3700 1 --2- 172.21.15.32:0/4031664642 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fe034066510 0x7fe0340689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:33.106 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.100+0000 7fe0594e3700 1 --2- 172.21.15.32:0/4031664642 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fe034066510 0x7fe0340689d0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fe05415c640 tx=0x7fe03c00b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:33.112 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.108+0000 7fe0527fc700 1 -- 172.21.15.32:0/4031664642 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fe044052a40 con 0x7fe0540b5270 2023-10-08T06:09:33.272 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.264+0000 7fe05bf48700 1 -- 172.21.15.32:0/4031664642 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe0540d2c00 con 0x7fe0540b5270 2023-10-08T06:09:33.273 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.268+0000 7fe0527fc700 1 -- 172.21.15.32:0/4031664642 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+12790 (secure 0 0 0) 0x7fe044003e60 con 0x7fe0540b5270 2023-10-08T06:09:33.274 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:09:33.274 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":18,"fsid":"ac672d87-96ae-41e0-9314-623ba2cdbbba","created":"2023-10-08T06:09:11.175626+0000","modified":"2023-10-08T06:09:25.768642+0000","last_up_change":"2023-10-08T06:09:22.744643+0000","last_in_change":"2023-10-08T06:09:14.131580+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T06:09:23.307843+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"43433f0c-9592-4874-92d7-10f8f4acf07f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":587888964},{"type":"v1","addr":"172.21.15.32:6801","nonce":587888964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":587888964},{"type":"v1","addr":"172.21.15.32:6803","nonce":587888964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":587888964},{"type":"v1","addr":"172.21.15.32:6810","nonce":587888964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6805","nonce":587888964},{"type":"v1","addr":"172.21.15.32:6807","nonce":587888964}]},"public_addr":"172.21.15.32:6801/587888964","cluster_addr":"172.21.15.32:6803/587888964","heartbeat_back_addr":"172.21.15.32:6810/587888964","heartbeat_front_addr":"172.21.15.32:6807/587888964","state":["exists","up"]},{"osd":1,"uuid":"2ecb1008-b987-4ce7-b646-6cded55fc8d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":990576767},{"type":"v1","addr":"172.21.15.32:6817","nonce":990576767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":990576767},{"type":"v1","addr":"172.21.15.32:6819","nonce":990576767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":990576767},{"type":"v1","addr":"172.21.15.32:6823","nonce":990576767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":990576767},{"type":"v1","addr":"172.21.15.32:6821","nonce":990576767}]},"public_addr":"172.21.15.32:6817/990576767","cluster_addr":"172.21.15.32:6819/990576767","heartbeat_back_addr":"172.21.15.32:6823/990576767","heartbeat_front_addr":"172.21.15.32:6821/990576767","state":["exists","up"]},{"osd":2,"uuid":"1b131c94-c09b-4e80-8746-bf1b7bac362d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6824","nonce":1566874440},{"type":"v1","addr":"172.21.15.32:6825","nonce":1566874440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":1566874440},{"type":"v1","addr":"172.21.15.32:6827","nonce":1566874440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":1566874440},{"type":"v1","addr":"172.21.15.32:6831","nonce":1566874440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":1566874440},{"type":"v1","addr":"172.21.15.32:6829","nonce":1566874440}]},"public_addr":"172.21.15.32:6825/1566874440","cluster_addr":"172.21.15.32:6827/1566874440","heartbeat_back_addr":"172.21.15.32:6831/1566874440","heartbeat_front_addr":"172.21.15.32:6829/1566874440","state":["exists","up"]},{"osd":3,"uuid":"ad655af2-1f6f-4689-b21d-b07bbaeb68b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":3672614802},{"type":"v1","addr":"172.21.15.32:6806","nonce":3672614802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6809","nonce":3672614802},{"type":"v1","addr":"172.21.15.32:6811","nonce":3672614802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":3672614802},{"type":"v1","addr":"172.21.15.32:6815","nonce":3672614802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":3672614802},{"type":"v1","addr":"172.21.15.32:6813","nonce":3672614802}]},"public_addr":"172.21.15.32:6806/3672614802","cluster_addr":"172.21.15.32:6811/3672614802","heartbeat_back_addr":"172.21.15.32:6815/3672614802","heartbeat_front_addr":"172.21.15.32:6813/3672614802","state":["exists","up"]},{"osd":4,"uuid":"64a543a1-8c4f-458e-9aba-b35c1cd7dd03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":3369928244},{"type":"v1","addr":"172.21.15.40:6801","nonce":3369928244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":3369928244},{"type":"v1","addr":"172.21.15.40:6803","nonce":3369928244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":3369928244},{"type":"v1","addr":"172.21.15.40:6807","nonce":3369928244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":3369928244},{"type":"v1","addr":"172.21.15.40:6805","nonce":3369928244}]},"public_addr":"172.21.15.40:6801/3369928244","cluster_addr":"172.21.15.40:6803/3369928244","heartbeat_back_addr":"172.21.15.40:6807/3369928244","heartbeat_front_addr":"172.21.15.40:6805/3369928244","state":["exists","up"]},{"osd":5,"uuid":"0fef3e54-edb4-4678-878e-944663c51638","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":2395850297},{"type":"v1","addr":"172.21.15.40:6825","nonce":2395850297}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":2395850297},{"type":"v1","addr":"172.21.15.40:6827","nonce":2395850297}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":2395850297},{"type":"v1","addr":"172.21.15.40:6831","nonce":2395850297}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":2395850297},{"type":"v1","addr":"172.21.15.40:6829","nonce":2395850297}]},"public_addr":"172.21.15.40:6825/2395850297","cluster_addr":"172.21.15.40:6827/2395850297","heartbeat_back_addr":"172.21.15.40:6831/2395850297","heartbeat_front_addr":"172.21.15.40:6829/2395850297","state":["exists","up"]},{"osd":6,"uuid":"2eeb0472-6096-469d-9b2c-cab4bf41c31a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":4145283410},{"type":"v1","addr":"172.21.15.40:6809","nonce":4145283410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":4145283410},{"type":"v1","addr":"172.21.15.40:6811","nonce":4145283410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":4145283410},{"type":"v1","addr":"172.21.15.40:6815","nonce":4145283410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":4145283410},{"type":"v1","addr":"172.21.15.40:6813","nonce":4145283410}]},"public_addr":"172.21.15.40:6809/4145283410","cluster_addr":"172.21.15.40:6811/4145283410","heartbeat_back_addr":"172.21.15.40:6815/4145283410","heartbeat_front_addr":"172.21.15.40:6813/4145283410","state":["exists","up"]},{"osd":7,"uuid":"cf76e4c7-96a6-401f-a280-91aad4641940","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":2943297416},{"type":"v1","addr":"172.21.15.40:6817","nonce":2943297416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":2943297416},{"type":"v1","addr":"172.21.15.40:6819","nonce":2943297416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":2943297416},{"type":"v1","addr":"172.21.15.40:6823","nonce":2943297416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":2943297416},{"type":"v1","addr":"172.21.15.40:6821","nonce":2943297416}]},"public_addr":"172.21.15.40:6817/2943297416","cluster_addr":"172.21.15.40:6819/2943297416","heartbeat_back_addr":"172.21.15.40:6823/2943297416","heartbeat_front_addr":"172.21.15.40:6821/2943297416","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.411475+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.628841+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.599055+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.166100+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.384135+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.488403+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.307648+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.363541+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T06:09:33.276 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.272+0000 7fe05bf48700 1 -- 172.21.15.32:0/4031664642 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fe034066510 msgr2=0x7fe0340689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:33.276 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.272+0000 7fe05bf48700 1 --2- 172.21.15.32:0/4031664642 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fe034066510 0x7fe0340689d0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fe05415c640 tx=0x7fe03c00b040 comp rx=0 tx=0).stop 2023-10-08T06:09:33.276 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.272+0000 7fe05bf48700 1 -- 172.21.15.32:0/4031664642 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe0540b5270 msgr2=0x7fe054160a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:33.276 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.272+0000 7fe05bf48700 1 --2- 172.21.15.32:0/4031664642 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe0540b5270 0x7fe054160a70 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fe044000c00 tx=0x7fe044004770 comp rx=0 tx=0).stop 2023-10-08T06:09:33.277 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.272+0000 7fe05bf48700 1 -- 172.21.15.32:0/4031664642 shutdown_connections 2023-10-08T06:09:33.277 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.272+0000 7fe05bf48700 1 --2- 172.21.15.32:0/4031664642 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fe034066510 0x7fe0340689d0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:33.277 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.272+0000 7fe05bf48700 1 --2- 172.21.15.32:0/4031664642 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe0541f34b0 0x7fe054155590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:33.277 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.272+0000 7fe05bf48700 1 --2- 172.21.15.32:0/4031664642 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe0540d1ca0 0x7fe0541f2f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:33.277 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.272+0000 7fe05bf48700 1 --2- 172.21.15.32:0/4031664642 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe0540b5270 0x7fe054160a70 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:33.277 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.272+0000 7fe05bf48700 1 -- 172.21.15.32:0/4031664642 >> 172.21.15.32:0/4031664642 conn(0x7fe0540cfd30 msgr2=0x7fe0540d3740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:09:33.277 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.272+0000 7fe05bf48700 1 -- 172.21.15.32:0/4031664642 shutdown_connections 2023-10-08T06:09:33.277 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.272+0000 7fe05bf48700 1 -- 172.21.15.32:0/4031664642 wait complete. 2023-10-08T06:09:33.288 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T06:09:23.307843+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-08T06:09:33.289 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T06:09:33.413 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.408+0000 7f06cf59e700 1 Processor -- start 2023-10-08T06:09:33.413 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.408+0000 7f06cf59e700 1 -- start start 2023-10-08T06:09:33.414 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.408+0000 7f06cf59e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f06d015b3b0 0x7f06d00ca460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:33.415 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.408+0000 7f06cf59e700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f06d00cbda0 0x7f06d006a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:33.415 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.408+0000 7f06cf59e700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06d00c38d0 con 0x7f06d006a7e0 2023-10-08T06:09:33.415 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.408+0000 7f06cf59e700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06d006ac70 con 0x7f06d00cbda0 2023-10-08T06:09:33.415 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.408+0000 7f06cf59e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06d015fdb0 con 0x7f06d015b3b0 2023-10-08T06:09:33.416 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.408+0000 7f06cdd9b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f06d00cbda0 0x7f06d006a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:33.416 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.408+0000 7f06ce59c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f06d015b3b0 0x7f06d00ca460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:33.416 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.408+0000 7f06cdd9b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f06d00cbda0 0x7f06d006a2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.32:58014/0 (socket says 172.21.15.32:58014) 2023-10-08T06:09:33.416 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.408+0000 7f06ce59c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f06d015b3b0 0x7f06d00ca460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.32:54570/0 (socket says 172.21.15.32:54570) 2023-10-08T06:09:33.416 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.408+0000 7f06cdd9b700 1 -- 172.21.15.32:0/304043258 learned_addr learned my addr 172.21.15.32:0/304043258 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:09:33.416 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.412+0000 7f06cdd9b700 1 -- 172.21.15.32:0/304043258 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f06d015b3b0 msgr2=0x7f06d00ca460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:09:33.416 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.412+0000 7f06cdd9b700 1 --2- 172.21.15.32:0/304043258 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f06d015b3b0 0x7f06d00ca460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:33.416 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.412+0000 7f06cdd9b700 1 -- 172.21.15.32:0/304043258 >> v1:172.21.15.40:6789/0 conn(0x7f06d006a7e0 legacy=0x7f06d00b1800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:33.416 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.412+0000 7f06cdd9b700 1 -- 172.21.15.32:0/304043258 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06d015b790 con 0x7f06d00cbda0 2023-10-08T06:09:33.416 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.412+0000 7f06ce59c700 1 --2- 172.21.15.32:0/304043258 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f06d015b3b0 0x7f06d00ca460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T06:09:33.418 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.412+0000 7f06cdd9b700 1 --2- 172.21.15.32:0/304043258 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f06d00cbda0 0x7f06d006a2a0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f06c4009910 tx=0x7f06c4009c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a74c995c8ea1217 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:33.418 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.412+0000 7f06cd59a700 1 -- 172.21.15.32:0/304043258 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06c4011830 con 0x7f06d00cbda0 2023-10-08T06:09:33.418 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.412+0000 7f06cd59a700 1 -- 172.21.15.32:0/304043258 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06c4011990 con 0x7f06d00cbda0 2023-10-08T06:09:33.418 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.412+0000 7f06cd59a700 1 -- 172.21.15.32:0/304043258 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06c4011d40 con 0x7f06d00cbda0 2023-10-08T06:09:33.418 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.412+0000 7f06cf59e700 1 -- 172.21.15.32:0/304043258 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f06d00cbda0 msgr2=0x7f06d006a2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:33.418 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.412+0000 7f06cf59e700 1 --2- 172.21.15.32:0/304043258 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f06d00cbda0 0x7f06d006a2a0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f06c4009910 tx=0x7f06c4009c20 comp rx=0 tx=0).stop 2023-10-08T06:09:33.418 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.412+0000 7f06cf59e700 1 -- 172.21.15.32:0/304043258 shutdown_connections 2023-10-08T06:09:33.418 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.412+0000 7f06cf59e700 1 --2- 172.21.15.32:0/304043258 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f06d00cbda0 0x7f06d006a2a0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:33.418 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.412+0000 7f06cf59e700 1 --2- 172.21.15.32:0/304043258 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f06d015b3b0 0x7f06d00ca460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:33.418 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.412+0000 7f06cf59e700 1 -- 172.21.15.32:0/304043258 >> 172.21.15.32:0/304043258 conn(0x7f06d00cc800 msgr2=0x7f06d00ccbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:09:33.418 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.412+0000 7f06cf59e700 1 -- 172.21.15.32:0/304043258 shutdown_connections 2023-10-08T06:09:33.419 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.412+0000 7f06cf59e700 1 -- 172.21.15.32:0/304043258 wait complete. 2023-10-08T06:09:33.420 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.416+0000 7f06cf59e700 1 Processor -- start 2023-10-08T06:09:33.420 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.416+0000 7f06cf59e700 1 -- start start 2023-10-08T06:09:33.422 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.416+0000 7f06cf59e700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f06d006a7e0 0x7f06d014d500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:33.422 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.416+0000 7f06cf59e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f06d00cbda0 0x7f06d00c4800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:33.422 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.416+0000 7f06cf59e700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f06d015b3b0 0x7f06d00c8650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:33.422 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.416+0000 7f06cf59e700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06d0155990 con 0x7f06d015b3b0 2023-10-08T06:09:33.422 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.416+0000 7f06cf59e700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06d00cf250 con 0x7f06d006a7e0 2023-10-08T06:09:33.422 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.416+0000 7f06cf59e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06d00ce360 con 0x7f06d00cbda0 2023-10-08T06:09:33.422 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.416+0000 7f06ced9d700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f06d015b3b0 0x7f06d00c8650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:33.422 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.416+0000 7f06ce59c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f06d006a7e0 0x7f06d014d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:33.423 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.416+0000 7f06cdd9b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f06d00cbda0 0x7f06d00c4800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:33.423 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.416+0000 7f06ced9d700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f06d015b3b0 0x7f06d00c8650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:37206/0 (socket says 172.21.15.32:37206) 2023-10-08T06:09:33.423 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.416+0000 7f06ced9d700 1 -- 172.21.15.32:0/184013981 learned_addr learned my addr 172.21.15.32:0/184013981 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:09:33.424 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.416+0000 7f06ced9d700 1 -- 172.21.15.32:0/184013981 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f06d00cbda0 msgr2=0x7f06d00c4800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:33.424 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.416+0000 7f06ced9d700 1 --2- 172.21.15.32:0/184013981 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f06d00cbda0 0x7f06d00c4800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:33.424 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.416+0000 7f06ced9d700 1 -- 172.21.15.32:0/184013981 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f06d006a7e0 msgr2=0x7f06d014d500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:33.424 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.416+0000 7f06ced9d700 1 --2- 172.21.15.32:0/184013981 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f06d006a7e0 0x7f06d014d500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:33.424 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.416+0000 7f06ced9d700 1 -- 172.21.15.32:0/184013981 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06c00094b0 con 0x7f06d015b3b0 2023-10-08T06:09:33.424 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.416+0000 7f06ced9d700 1 --2- 172.21.15.32:0/184013981 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f06d015b3b0 0x7f06d00c8650 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f06c800cc50 tx=0x7f06c800cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:33.424 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.416+0000 7f06beffd700 1 -- 172.21.15.32:0/184013981 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06c8003c20 con 0x7f06d015b3b0 2023-10-08T06:09:33.424 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.416+0000 7f06beffd700 1 -- 172.21.15.32:0/184013981 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06c8003d80 con 0x7f06d015b3b0 2023-10-08T06:09:33.424 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.416+0000 7f06cf59e700 1 -- 172.21.15.32:0/184013981 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06c4009570 con 0x7f06d015b3b0 2023-10-08T06:09:33.424 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.416+0000 7f06beffd700 1 -- 172.21.15.32:0/184013981 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06c800aab0 con 0x7f06d015b3b0 2023-10-08T06:09:33.425 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.416+0000 7f06cf59e700 1 -- 172.21.15.32:0/184013981 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06d00ce920 con 0x7f06d015b3b0 2023-10-08T06:09:33.425 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.420+0000 7f06cf59e700 1 -- 172.21.15.32:0/184013981 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06d00cf3c0 con 0x7f06d015b3b0 2023-10-08T06:09:33.426 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.420+0000 7f06beffd700 1 -- 172.21.15.32:0/184013981 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f06c800ac10 con 0x7f06d015b3b0 2023-10-08T06:09:33.426 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.420+0000 7f06beffd700 1 --2- 172.21.15.32:0/184013981 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f06b0066510 0x7f06b00689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:33.427 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.420+0000 7f06beffd700 1 -- 172.21.15.32:0/184013981 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f06c8083a70 con 0x7f06d015b3b0 2023-10-08T06:09:33.427 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.420+0000 7f06ce59c700 1 --2- 172.21.15.32:0/184013981 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f06b0066510 0x7f06b00689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:33.427 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.420+0000 7f06ce59c700 1 --2- 172.21.15.32:0/184013981 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f06b0066510 0x7f06b00689d0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f06c0009ce0 tx=0x7f06c0009240 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:33.433 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.428+0000 7f06beffd700 1 -- 172.21.15.32:0/184013981 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f06c8051230 con 0x7f06d015b3b0 2023-10-08T06:09:33.608 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.604+0000 7f06cf59e700 1 -- 172.21.15.32:0/184013981 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f06d00686a0 con 0x7f06d015b3b0 2023-10-08T06:09:33.609 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.604+0000 7f06beffd700 1 -- 172.21.15.32:0/184013981 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v18) v1 ==== 93+0+10 (secure 0 0 0) 0x7f06c8054850 con 0x7f06d015b3b0 2023-10-08T06:09:33.609 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 1 2023-10-08T06:09:33.613 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.608+0000 7f06cf59e700 1 -- 172.21.15.32:0/184013981 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f06b0066510 msgr2=0x7f06b00689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:33.613 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.608+0000 7f06cf59e700 1 --2- 172.21.15.32:0/184013981 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f06b0066510 0x7f06b00689d0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f06c0009ce0 tx=0x7f06c0009240 comp rx=0 tx=0).stop 2023-10-08T06:09:33.613 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.608+0000 7f06cf59e700 1 -- 172.21.15.32:0/184013981 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f06d015b3b0 msgr2=0x7f06d00c8650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:33.613 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.608+0000 7f06cf59e700 1 --2- 172.21.15.32:0/184013981 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f06d015b3b0 0x7f06d00c8650 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f06c800cc50 tx=0x7f06c800cf60 comp rx=0 tx=0).stop 2023-10-08T06:09:33.613 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.608+0000 7f06cf59e700 1 -- 172.21.15.32:0/184013981 shutdown_connections 2023-10-08T06:09:33.613 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.608+0000 7f06cf59e700 1 --2- 172.21.15.32:0/184013981 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f06b0066510 0x7f06b00689d0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:33.614 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.608+0000 7f06cf59e700 1 --2- 172.21.15.32:0/184013981 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f06d015b3b0 0x7f06d00c8650 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:33.614 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.608+0000 7f06cf59e700 1 --2- 172.21.15.32:0/184013981 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f06d00cbda0 0x7f06d00c4800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:33.614 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.608+0000 7f06cf59e700 1 --2- 172.21.15.32:0/184013981 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f06d006a7e0 0x7f06d014d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:33.614 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.608+0000 7f06cf59e700 1 -- 172.21.15.32:0/184013981 >> 172.21.15.32:0/184013981 conn(0x7f06d00cc800 msgr2=0x7f06d00c5990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:09:33.614 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.608+0000 7f06cf59e700 1 -- 172.21.15.32:0/184013981 shutdown_connections 2023-10-08T06:09:33.614 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.608+0000 7f06cf59e700 1 -- 172.21.15.32:0/184013981 wait complete. 2023-10-08T06:09:33.629 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-08T06:09:33.740 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.736+0000 7f76121fe700 1 Processor -- start 2023-10-08T06:09:33.741 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.736+0000 7f76121fe700 1 -- start start 2023-10-08T06:09:33.742 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.736+0000 7f76121fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f760c15d5b0 0x7f760c0d1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:33.742 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.736+0000 7f76121fe700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f760c0b37e0 con 0x7f760c0d1a50 2023-10-08T06:09:33.742 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.736+0000 7f76121fe700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f760c0d1080 con 0x7f760c0cdd00 2023-10-08T06:09:33.742 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.736+0000 7f76121fe700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f760c15e760 con 0x7f760c15d5b0 2023-10-08T06:09:33.742 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.736+0000 7f76109fb700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f760c0d1a50 0x7f760c0cd5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:58442/0 (socket says 172.21.15.32:58442) 2023-10-08T06:09:33.742 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.736+0000 7f76109fb700 1 -- 172.21.15.32:0/657755108 learned_addr learned my addr 172.21.15.32:0/657755108 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-08T06:09:33.742 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.736+0000 7f76111fc700 1 --2- 172.21.15.32:0/657755108 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f760c15d5b0 0x7f760c0d1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:33.743 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.736+0000 7f760bfff700 1 -- 172.21.15.32:0/657755108 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3526402440 0 0) 0x7f760c0b37e0 con 0x7f760c0d1a50 2023-10-08T06:09:33.744 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.736+0000 7f760bfff700 1 -- 172.21.15.32:0/657755108 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f75f40035d0 con 0x7f760c0d1a50 2023-10-08T06:09:33.744 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.736+0000 7f760bfff700 1 -- 172.21.15.32:0/657755108 <== mon.1 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2888556432 0 0) 0x7f760c0d1080 con 0x7f760c0cdd00 2023-10-08T06:09:33.744 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.736+0000 7f76111fc700 1 -- 172.21.15.32:0/657755108 >> v1:172.21.15.40:6789/0 conn(0x7f760c0cdd00 legacy=0x7f760c0cb510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:33.744 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.736+0000 7f76111fc700 1 -- 172.21.15.32:0/657755108 >> v1:172.21.15.32:6789/0 conn(0x7f760c0d1a50 legacy=0x7f760c0cd5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:33.744 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.736+0000 7f76111fc700 1 -- 172.21.15.32:0/657755108 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f760c15ea40 con 0x7f760c15d5b0 2023-10-08T06:09:33.744 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.736+0000 7f76111fc700 1 --2- 172.21.15.32:0/657755108 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f760c15d5b0 0x7f760c0d1510 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f75fc009880 tx=0x7f75fc009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=523cbbe959b828f3 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:33.744 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.736+0000 7f760bfff700 1 -- 172.21.15.32:0/657755108 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75fc011830 con 0x7f760c15d5b0 2023-10-08T06:09:33.744 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.740+0000 7f760bfff700 1 -- 172.21.15.32:0/657755108 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75fc011990 con 0x7f760c15d5b0 2023-10-08T06:09:33.744 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.740+0000 7f760bfff700 1 -- 172.21.15.32:0/657755108 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75fc011d20 con 0x7f760c15d5b0 2023-10-08T06:09:33.745 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.740+0000 7f76121fe700 1 -- 172.21.15.32:0/657755108 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f760c15d5b0 msgr2=0x7f760c0d1510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:33.745 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.740+0000 7f76121fe700 1 --2- 172.21.15.32:0/657755108 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f760c15d5b0 0x7f760c0d1510 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f75fc009880 tx=0x7f75fc009b90 comp rx=0 tx=0).stop 2023-10-08T06:09:33.746 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.740+0000 7f76121fe700 1 -- 172.21.15.32:0/657755108 shutdown_connections 2023-10-08T06:09:33.746 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.740+0000 7f76121fe700 1 --2- 172.21.15.32:0/657755108 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f760c15d5b0 0x7f760c0d1510 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:33.746 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.740+0000 7f76121fe700 1 -- 172.21.15.32:0/657755108 >> 172.21.15.32:0/657755108 conn(0x7f760c065e90 msgr2=0x7f760c066270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:09:33.746 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.740+0000 7f76121fe700 1 -- 172.21.15.32:0/657755108 shutdown_connections 2023-10-08T06:09:33.746 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.740+0000 7f76121fe700 1 -- 172.21.15.32:0/657755108 wait complete. 2023-10-08T06:09:33.747 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.740+0000 7f76121fe700 1 Processor -- start 2023-10-08T06:09:33.747 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.740+0000 7f76121fe700 1 -- start start 2023-10-08T06:09:33.749 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.744+0000 7f76121fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f760c0cdd00 0x7f760c0af430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:33.749 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.744+0000 7f76121fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f760c15d5b0 0x7f760c0b5a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:33.749 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.744+0000 7f76121fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f760c14ee60 0x7f760c14e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:33.749 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.744+0000 7f76121fe700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f760c14be70 con 0x7f760c14ee60 2023-10-08T06:09:33.749 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.744+0000 7f76121fe700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f760c0b5580 con 0x7f760c15d5b0 2023-10-08T06:09:33.750 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.744+0000 7f76121fe700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f760c0b5250 con 0x7f760c0cdd00 2023-10-08T06:09:33.750 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.744+0000 7f76111fc700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f760c0cdd00 0x7f760c0af430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:33.750 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.744+0000 7f76119fd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f760c14ee60 0x7f760c14e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:33.750 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.744+0000 7f76111fc700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f760c0cdd00 0x7f760c0af430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.32:54608/0 (socket says 172.21.15.32:54608) 2023-10-08T06:09:33.750 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.744+0000 7f76111fc700 1 -- 172.21.15.32:0/1181467252 learned_addr learned my addr 172.21.15.32:0/1181467252 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:09:33.750 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.744+0000 7f76109fb700 1 --2- 172.21.15.32:0/1181467252 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f760c15d5b0 0x7f760c0b5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:33.751 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.744+0000 7f76119fd700 1 -- 172.21.15.32:0/1181467252 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f760c0cdd00 msgr2=0x7f760c0af430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:33.751 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.744+0000 7f76119fd700 1 --2- 172.21.15.32:0/1181467252 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f760c0cdd00 0x7f760c0af430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:33.751 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.744+0000 7f76119fd700 1 -- 172.21.15.32:0/1181467252 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f760c15d5b0 msgr2=0x7f760c0b5a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:33.751 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.744+0000 7f76119fd700 1 --2- 172.21.15.32:0/1181467252 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f760c15d5b0 0x7f760c0b5a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:33.751 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.744+0000 7f76119fd700 1 -- 172.21.15.32:0/1181467252 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75fc0094b0 con 0x7f760c14ee60 2023-10-08T06:09:33.752 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.744+0000 7f76111fc700 1 --2- 172.21.15.32:0/1181467252 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f760c0cdd00 0x7f760c0af430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T06:09:33.752 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.744+0000 7f76119fd700 1 --2- 172.21.15.32:0/1181467252 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f760c14ee60 0x7f760c14e130 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f76040011e0 tx=0x7f760400c730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:33.752 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.744+0000 7f7609ffb700 1 -- 172.21.15.32:0/1181467252 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76040054e0 con 0x7f760c14ee60 2023-10-08T06:09:33.752 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.744+0000 7f7609ffb700 1 -- 172.21.15.32:0/1181467252 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f760400ce30 con 0x7f760c14ee60 2023-10-08T06:09:33.752 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.744+0000 7f76121fe700 1 -- 172.21.15.32:0/1181467252 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f760c0c4b90 con 0x7f760c14ee60 2023-10-08T06:09:33.752 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.744+0000 7f7609ffb700 1 -- 172.21.15.32:0/1181467252 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76040038e0 con 0x7f760c14ee60 2023-10-08T06:09:33.752 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.744+0000 7f76121fe700 1 -- 172.21.15.32:0/1181467252 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f760c0c5150 con 0x7f760c14ee60 2023-10-08T06:09:33.752 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.748+0000 7f76121fe700 1 -- 172.21.15.32:0/1181467252 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f760c0b5710 con 0x7f760c14ee60 2023-10-08T06:09:33.753 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.748+0000 7f7609ffb700 1 -- 172.21.15.32:0/1181467252 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f7604003a40 con 0x7f760c14ee60 2023-10-08T06:09:33.754 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.748+0000 7f7609ffb700 1 --2- 172.21.15.32:0/1181467252 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f75f8066510 0x7f75f80689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:33.754 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.748+0000 7f76111fc700 1 --2- 172.21.15.32:0/1181467252 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f75f8066510 0x7f75f80689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:33.755 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.748+0000 7f7609ffb700 1 -- 172.21.15.32:0/1181467252 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f7604082dd0 con 0x7f760c14ee60 2023-10-08T06:09:33.755 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.748+0000 7f76111fc700 1 --2- 172.21.15.32:0/1181467252 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f75f8066510 0x7f75f80689d0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f75fc0097d0 tx=0x7f75fc01c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:33.762 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.756+0000 7f7609ffb700 1 -- 172.21.15.32:0/1181467252 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f76040505b0 con 0x7f760c14ee60 2023-10-08T06:09:33.930 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.924+0000 7f76121fe700 1 -- 172.21.15.32:0/1181467252 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f760c073f00 con 0x7f760c14ee60 2023-10-08T06:09:33.930 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.924+0000 7f7609ffb700 1 -- 172.21.15.32:0/1181467252 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v18) v1 ==== 84+0+65 (secure 0 0 0) 0x7f7604017060 con 0x7f760c14ee60 2023-10-08T06:09:33.930 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:09:33.931 INFO:teuthology.orchestra.run.smithi032.stdout:[ 2023-10-08T06:09:33.931 INFO:teuthology.orchestra.run.smithi032.stdout: { 2023-10-08T06:09:33.931 INFO:teuthology.orchestra.run.smithi032.stdout: "poolnum": 1, 2023-10-08T06:09:33.931 INFO:teuthology.orchestra.run.smithi032.stdout: "poolname": ".mgr" 2023-10-08T06:09:33.931 INFO:teuthology.orchestra.run.smithi032.stdout: } 2023-10-08T06:09:33.931 INFO:teuthology.orchestra.run.smithi032.stdout:] 2023-10-08T06:09:33.933 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.928+0000 7f76121fe700 1 -- 172.21.15.32:0/1181467252 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f75f8066510 msgr2=0x7f75f80689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:33.933 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.928+0000 7f76121fe700 1 --2- 172.21.15.32:0/1181467252 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f75f8066510 0x7f75f80689d0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f75fc0097d0 tx=0x7f75fc01c040 comp rx=0 tx=0).stop 2023-10-08T06:09:33.933 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.928+0000 7f76121fe700 1 -- 172.21.15.32:0/1181467252 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f760c14ee60 msgr2=0x7f760c14e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:33.933 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.928+0000 7f76121fe700 1 --2- 172.21.15.32:0/1181467252 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f760c14ee60 0x7f760c14e130 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f76040011e0 tx=0x7f760400c730 comp rx=0 tx=0).stop 2023-10-08T06:09:33.934 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.928+0000 7f76121fe700 1 -- 172.21.15.32:0/1181467252 shutdown_connections 2023-10-08T06:09:33.934 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.928+0000 7f76121fe700 1 --2- 172.21.15.32:0/1181467252 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f75f8066510 0x7f75f80689d0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:33.934 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.928+0000 7f76121fe700 1 --2- 172.21.15.32:0/1181467252 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f760c14ee60 0x7f760c14e130 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:33.934 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.928+0000 7f76121fe700 1 --2- 172.21.15.32:0/1181467252 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f760c15d5b0 0x7f760c0b5a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:33.934 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.928+0000 7f76121fe700 1 --2- 172.21.15.32:0/1181467252 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f760c0cdd00 0x7f760c0af430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:33.934 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.928+0000 7f76121fe700 1 -- 172.21.15.32:0/1181467252 >> 172.21.15.32:0/1181467252 conn(0x7f760c065e90 msgr2=0x7f760c06cd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:09:33.934 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.928+0000 7f76121fe700 1 -- 172.21.15.32:0/1181467252 shutdown_connections 2023-10-08T06:09:33.934 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:33.928+0000 7f76121fe700 1 -- 172.21.15.32:0/1181467252 wait complete. 2023-10-08T06:09:33.945 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-08T06:09:33.945 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-08T06:09:34.067 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:34.060+0000 7f024acbf700 1 Processor -- start 2023-10-08T06:09:34.067 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:34.060+0000 7f024acbf700 1 -- start start 2023-10-08T06:09:34.069 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:34.064+0000 7f024acbf700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f024415d380 0x7f02440cf8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:34.069 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:34.064+0000 7f024acbf700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f02440cfdf0 0x7f02440d2f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:34.069 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:34.064+0000 7f024acbf700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02440d0930 con 0x7f02440d34d0 2023-10-08T06:09:34.069 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:34.064+0000 7f024acbf700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02440cee50 con 0x7f024415d380 2023-10-08T06:09:34.069 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:34.064+0000 7f024acbf700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02440d3900 con 0x7f02440cfdf0 2023-10-08T06:09:34.069 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:34.064+0000 7f0249cbd700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f024415d380 0x7f02440cf8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:34.070 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:34.064+0000 7f024a4be700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f02440d34d0 0x7f02440d1a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:58448/0 (socket says 172.21.15.32:58448) 2023-10-08T06:09:34.070 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:34.064+0000 7f024a4be700 1 -- 172.21.15.32:0/2453567535 learned_addr learned my addr 172.21.15.32:0/2453567535 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-08T06:09:34.070 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:34.064+0000 7f02494bc700 1 --2- 172.21.15.32:0/2453567535 >> v2:172.21.15.40:3300/0 conn(0x7f02440cfdf0 0x7f02440d2f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:34.070 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:34.064+0000 7f0248cbb700 1 -- 172.21.15.32:0/2453567535 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 694236280 0 0) 0x7f02440d0930 con 0x7f02440d34d0 2023-10-08T06:09:34.070 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:34.064+0000 7f0248cbb700 1 -- 172.21.15.32:0/2453567535 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f02300035d0 con 0x7f02440d34d0 2023-10-08T06:09:34.070 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:34.064+0000 7f0249cbd700 1 -- 172.21.15.32:0/2453567535 >> v2:172.21.15.40:3300/0 conn(0x7f02440cfdf0 msgr2=0x7f02440d2f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:09:34.070 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:34.064+0000 7f0249cbd700 1 --2- 172.21.15.32:0/2453567535 >> v2:172.21.15.40:3300/0 conn(0x7f02440cfdf0 0x7f02440d2f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:34.070 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:34.064+0000 7f0249cbd700 1 -- 172.21.15.32:0/2453567535 >> v1:172.21.15.32:6789/0 conn(0x7f02440d34d0 legacy=0x7f02440d1a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:34.071 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:34.064+0000 7f0249cbd700 1 -- 172.21.15.32:0/2453567535 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02440d0370 con 0x7f024415d380 2023-10-08T06:09:34.072 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:34.064+0000 7f02494bc700 1 --2- 172.21.15.32:0/2453567535 >> v2:172.21.15.40:3300/0 conn(0x7f02440cfdf0 0x7f02440d2f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T06:09:34.072 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:34.064+0000 7f0249cbd700 1 --2- 172.21.15.32:0/2453567535 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f024415d380 0x7f02440cf8b0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f024408c4b0 tx=0x7f0234009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d64f3bda7e90eba server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:34.072 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:34.064+0000 7f0248cbb700 1 -- 172.21.15.32:0/2453567535 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0234011830 con 0x7f024415d380 2023-10-08T06:09:34.072 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:34.064+0000 7f0248cbb700 1 -- 172.21.15.32:0/2453567535 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0234011990 con 0x7f024415d380 2023-10-08T06:09:34.072 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:34.064+0000 7f0248cbb700 1 -- 172.21.15.32:0/2453567535 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0234011d20 con 0x7f024415d380 2023-10-08T06:09:34.072 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:34.064+0000 7f024acbf700 1 -- 172.21.15.32:0/2453567535 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f024415d380 msgr2=0x7f02440cf8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:34.072 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:34.064+0000 7f024acbf700 1 --2- 172.21.15.32:0/2453567535 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f024415d380 0x7f02440cf8b0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f024408c4b0 tx=0x7f0234009b30 comp rx=0 tx=0).stop 2023-10-08T06:09:34.072 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:34.064+0000 7f024acbf700 1 -- 172.21.15.32:0/2453567535 shutdown_connections 2023-10-08T06:09:34.072 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:34.064+0000 7f024acbf700 1 --2- 172.21.15.32:0/2453567535 >> v2:172.21.15.40:3300/0 conn(0x7f02440cfdf0 0x7f02440d2f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:34.072 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:34.064+0000 7f024acbf700 1 --2- 172.21.15.32:0/2453567535 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f024415d380 0x7f02440cf8b0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:34.072 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:34.064+0000 7f024acbf700 1 -- 172.21.15.32:0/2453567535 >> 172.21.15.32:0/2453567535 conn(0x7f024406ab80 msgr2=0x7f024406af90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:09:34.073 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:34.064+0000 7f024acbf700 1 -- 172.21.15.32:0/2453567535 shutdown_connections 2023-10-08T06:09:34.073 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:34.064+0000 7f024acbf700 1 -- 172.21.15.32:0/2453567535 wait complete. 2023-10-08T06:09:34.073 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:34.068+0000 7f024acbf700 1 Processor -- start 2023-10-08T06:09:34.073 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:34.068+0000 7f024acbf700 1 -- start start 2023-10-08T06:09:34.076 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:34.068+0000 7f024acbf700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f02440cfdf0 0x7f02440c92a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:34.076 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:34.068+0000 7f024acbf700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f02440d34d0 0x7f0244154880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:34.076 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:34.068+0000 7f024acbf700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f024415d380 0x7f02440cc680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:34.076 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:34.068+0000 7f024acbf700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02440c97e0 con 0x7f024415d380 2023-10-08T06:09:34.076 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:34.068+0000 7f024acbf700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0244155260 con 0x7f02440cfdf0 2023-10-08T06:09:34.076 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:34.068+0000 7f024acbf700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f024415ac20 con 0x7f02440d34d0 2023-10-08T06:09:34.076 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:34.068+0000 7f024a4be700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f024415d380 0x7f02440cc680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:34.077 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:34.068+0000 7f024a4be700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f024415d380 0x7f02440cc680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:37240/0 (socket says 172.21.15.32:37240) 2023-10-08T06:09:34.077 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:34.068+0000 7f024a4be700 1 -- 172.21.15.32:0/3219700593 learned_addr learned my addr 172.21.15.32:0/3219700593 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:09:34.077 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:34.068+0000 7f02494bc700 1 --2- 172.21.15.32:0/3219700593 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f02440d34d0 0x7f0244154880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:34.077 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:34.068+0000 7f0249cbd700 1 --2- 172.21.15.32:0/3219700593 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f02440cfdf0 0x7f02440c92a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:34.077 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:34.072+0000 7f024a4be700 1 -- 172.21.15.32:0/3219700593 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f02440d34d0 msgr2=0x7f0244154880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:34.077 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:34.072+0000 7f024a4be700 1 --2- 172.21.15.32:0/3219700593 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f02440d34d0 0x7f0244154880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:34.077 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:34.072+0000 7f024a4be700 1 -- 172.21.15.32:0/3219700593 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f02440cfdf0 msgr2=0x7f02440c92a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:34.077 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:34.072+0000 7f024a4be700 1 --2- 172.21.15.32:0/3219700593 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f02440cfdf0 0x7f02440c92a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:34.077 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:34.072+0000 7f024a4be700 1 -- 172.21.15.32:0/3219700593 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02340094b0 con 0x7f024415d380 2023-10-08T06:09:34.077 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:34.072+0000 7f024a4be700 1 --2- 172.21.15.32:0/3219700593 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f024415d380 0x7f02440cc680 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f023c00cb40 tx=0x7f023c00cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:34.078 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:34.072+0000 7f023a7fc700 1 -- 172.21.15.32:0/3219700593 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f023c007500 con 0x7f024415d380 2023-10-08T06:09:34.078 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:34.072+0000 7f023a7fc700 1 -- 172.21.15.32:0/3219700593 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f023c007660 con 0x7f024415d380 2023-10-08T06:09:34.078 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:34.072+0000 7f024acbf700 1 -- 172.21.15.32:0/3219700593 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f024415af00 con 0x7f024415d380 2023-10-08T06:09:34.079 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:34.072+0000 7f023a7fc700 1 -- 172.21.15.32:0/3219700593 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f023c0079f0 con 0x7f024415d380 2023-10-08T06:09:34.079 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:34.072+0000 7f024acbf700 1 -- 172.21.15.32:0/3219700593 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f024415b4c0 con 0x7f024415d380 2023-10-08T06:09:34.079 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:34.072+0000 7f024acbf700 1 -- 172.21.15.32:0/3219700593 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f024415b6e0 con 0x7f024415d380 2023-10-08T06:09:34.080 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:34.076+0000 7f023a7fc700 1 -- 172.21.15.32:0/3219700593 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f023c01b3b0 con 0x7f024415d380 2023-10-08T06:09:34.081 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:34.076+0000 7f023a7fc700 1 --2- 172.21.15.32:0/3219700593 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f0228066510 0x7f02280689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:34.081 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:34.076+0000 7f0249cbd700 1 --2- 172.21.15.32:0/3219700593 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f0228066510 0x7f02280689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:34.081 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:34.076+0000 7f023a7fc700 1 -- 172.21.15.32:0/3219700593 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f023c083910 con 0x7f024415d380 2023-10-08T06:09:34.082 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:34.076+0000 7f0249cbd700 1 --2- 172.21.15.32:0/3219700593 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f0228066510 0x7f02280689d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f0234000c00 tx=0x7f0234008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:34.084 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:34.080+0000 7f023a7fc700 1 -- 172.21.15.32:0/3219700593 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f023c051150 con 0x7f024415d380 2023-10-08T06:09:34.213 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T06:09:34.215 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T06:09:34.255 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:34.248+0000 7f024acbf700 1 -- 172.21.15.32:0/3219700593 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f024404eea0 con 0x7f024415d380 2023-10-08T06:09:35.137 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:35.132+0000 7f023a7fc700 1 -- 172.21.15.32:0/3219700593 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v19) v1 ==== 138+0+0 (secure 0 0 0) 0x7f023c054770 con 0x7f024415d380 2023-10-08T06:09:35.141 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:35.136+0000 7f024acbf700 1 -- 172.21.15.32:0/3219700593 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f0228066510 msgr2=0x7f02280689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:35.141 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:35.136+0000 7f024acbf700 1 --2- 172.21.15.32:0/3219700593 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f0228066510 0x7f02280689d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f0234000c00 tx=0x7f0234008030 comp rx=0 tx=0).stop 2023-10-08T06:09:35.141 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:35.136+0000 7f024acbf700 1 -- 172.21.15.32:0/3219700593 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f024415d380 msgr2=0x7f02440cc680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:35.141 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:35.136+0000 7f024acbf700 1 --2- 172.21.15.32:0/3219700593 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f024415d380 0x7f02440cc680 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f023c00cb40 tx=0x7f023c00cb70 comp rx=0 tx=0).stop 2023-10-08T06:09:35.142 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:35.136+0000 7f024acbf700 1 -- 172.21.15.32:0/3219700593 shutdown_connections 2023-10-08T06:09:35.142 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:35.136+0000 7f024acbf700 1 --2- 172.21.15.32:0/3219700593 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f0228066510 0x7f02280689d0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:35.142 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:35.136+0000 7f024acbf700 1 --2- 172.21.15.32:0/3219700593 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f024415d380 0x7f02440cc680 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:35.143 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:35.136+0000 7f024acbf700 1 --2- 172.21.15.32:0/3219700593 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f02440d34d0 0x7f0244154880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:35.143 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:35.136+0000 7f024acbf700 1 --2- 172.21.15.32:0/3219700593 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f02440cfdf0 0x7f02440c92a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:35.143 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:35.136+0000 7f024acbf700 1 -- 172.21.15.32:0/3219700593 >> 172.21.15.32:0/3219700593 conn(0x7f024406ab80 msgr2=0x7f024415d760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:09:35.143 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:35.136+0000 7f024acbf700 1 -- 172.21.15.32:0/3219700593 shutdown_connections 2023-10-08T06:09:35.143 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:35.136+0000 7f024acbf700 1 -- 172.21.15.32:0/3219700593 wait complete. 2023-10-08T06:09:35.143 INFO:teuthology.orchestra.run.smithi032.stderr:pool 'cephfs_metadata' created 2023-10-08T06:09:35.160 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-08T06:09:35.282 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:35.276+0000 7f9f28b99700 1 Processor -- start 2023-10-08T06:09:35.282 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:35.276+0000 7f9f28b99700 1 -- start start 2023-10-08T06:09:35.284 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:35.276+0000 7f9f28b99700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f9f240b5440 0x7f9f240d1760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:35.284 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:35.280+0000 7f9f28b99700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f240b6750 con 0x7f9f240d1ca0 2023-10-08T06:09:35.284 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:35.280+0000 7f9f28b99700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f240d2a30 con 0x7f9f2415d980 2023-10-08T06:09:35.284 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:35.280+0000 7f9f28b99700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f240b6980 con 0x7f9f240b5440 2023-10-08T06:09:35.284 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:35.280+0000 7f9f21d9b700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f9f240b5440 0x7f9f240d1760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:35.284 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:35.280+0000 7f9f22d9d700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f9f240d1ca0 0x7f9f240b7140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:58460/0 (socket says 172.21.15.32:58460) 2023-10-08T06:09:35.284 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:35.280+0000 7f9f22d9d700 1 -- 172.21.15.32:0/2335729089 learned_addr learned my addr 172.21.15.32:0/2335729089 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-08T06:09:35.285 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:35.280+0000 7f9f2159a700 1 -- 172.21.15.32:0/2335729089 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 837705854 0 0) 0x7f9f240b6750 con 0x7f9f240d1ca0 2023-10-08T06:09:35.286 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:35.280+0000 7f9f2159a700 1 -- 172.21.15.32:0/2335729089 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9f100035d0 con 0x7f9f240d1ca0 2023-10-08T06:09:35.286 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:35.280+0000 7f9f21d9b700 1 -- 172.21.15.32:0/2335729089 >> v1:172.21.15.40:6789/0 conn(0x7f9f2415d980 legacy=0x7f9f240b4d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:35.286 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:35.280+0000 7f9f2159a700 1 -- 172.21.15.32:0/2335729089 <== mon.1 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2352285082 0 0) 0x7f9f240d2a30 con 0x7f9f2415d980 2023-10-08T06:09:35.286 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:35.280+0000 7f9f21d9b700 1 -- 172.21.15.32:0/2335729089 >> v1:172.21.15.32:6789/0 conn(0x7f9f240d1ca0 legacy=0x7f9f240b7140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:35.286 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:35.280+0000 7f9f21d9b700 1 -- 172.21.15.32:0/2335729089 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f240d2470 con 0x7f9f240b5440 2023-10-08T06:09:35.286 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:35.280+0000 7f9f21d9b700 1 --2- 172.21.15.32:0/2335729089 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9f240b5440 0x7f9f240d1760 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f9f14009850 tx=0x7f9f14009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7dd56f6617b57073 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:35.286 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:35.280+0000 7f9f2159a700 1 -- 172.21.15.32:0/2335729089 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f14011830 con 0x7f9f240b5440 2023-10-08T06:09:35.286 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:35.280+0000 7f9f2159a700 1 -- 172.21.15.32:0/2335729089 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f14011990 con 0x7f9f240b5440 2023-10-08T06:09:35.286 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:35.280+0000 7f9f2159a700 1 -- 172.21.15.32:0/2335729089 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f14011d40 con 0x7f9f240b5440 2023-10-08T06:09:35.287 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:35.280+0000 7f9f28b99700 1 -- 172.21.15.32:0/2335729089 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9f240b5440 msgr2=0x7f9f240d1760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:35.287 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:35.280+0000 7f9f28b99700 1 --2- 172.21.15.32:0/2335729089 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9f240b5440 0x7f9f240d1760 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f9f14009850 tx=0x7f9f14009b60 comp rx=0 tx=0).stop 2023-10-08T06:09:35.287 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:35.280+0000 7f9f28b99700 1 -- 172.21.15.32:0/2335729089 shutdown_connections 2023-10-08T06:09:35.287 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:35.280+0000 7f9f28b99700 1 --2- 172.21.15.32:0/2335729089 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9f240b5440 0x7f9f240d1760 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:35.287 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:35.280+0000 7f9f28b99700 1 -- 172.21.15.32:0/2335729089 >> 172.21.15.32:0/2335729089 conn(0x7f9f240cfd30 msgr2=0x7f9f240d0110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:09:35.288 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:35.280+0000 7f9f28b99700 1 -- 172.21.15.32:0/2335729089 shutdown_connections 2023-10-08T06:09:35.288 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:35.280+0000 7f9f28b99700 1 -- 172.21.15.32:0/2335729089 wait complete. 2023-10-08T06:09:35.288 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:35.284+0000 7f9f28b99700 1 Processor -- start 2023-10-08T06:09:35.289 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:35.284+0000 7f9f28b99700 1 -- start start 2023-10-08T06:09:35.291 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:35.284+0000 7f9f28b99700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9f240b5440 0x7f9f241f42a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:35.291 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:35.284+0000 7f9f28b99700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9f240d1ca0 0x7f9f2415f750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:35.291 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:35.284+0000 7f9f28b99700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9f2415fc90 0x7f9f24153220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:35.291 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:35.284+0000 7f9f28b99700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f24152210 con 0x7f9f240b5440 2023-10-08T06:09:35.291 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:35.284+0000 7f9f28b99700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f24160120 con 0x7f9f240d1ca0 2023-10-08T06:09:35.291 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:35.284+0000 7f9f28b99700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f24152460 con 0x7f9f2415fc90 2023-10-08T06:09:35.291 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:35.284+0000 7f9f2259c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9f240b5440 0x7f9f241f42a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:35.291 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:35.284+0000 7f9f2259c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9f240b5440 0x7f9f241f42a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:37254/0 (socket says 172.21.15.32:37254) 2023-10-08T06:09:35.292 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:35.284+0000 7f9f2259c700 1 -- 172.21.15.32:0/2787655449 learned_addr learned my addr 172.21.15.32:0/2787655449 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:09:35.292 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:35.284+0000 7f9f21d9b700 1 --2- 172.21.15.32:0/2787655449 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9f240d1ca0 0x7f9f2415f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:35.292 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:35.284+0000 7f9f22d9d700 1 --2- 172.21.15.32:0/2787655449 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9f2415fc90 0x7f9f24153220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:35.292 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:35.284+0000 7f9f2259c700 1 -- 172.21.15.32:0/2787655449 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9f2415fc90 msgr2=0x7f9f24153220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:35.292 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:35.284+0000 7f9f2259c700 1 --2- 172.21.15.32:0/2787655449 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9f2415fc90 0x7f9f24153220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:35.292 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:35.284+0000 7f9f2259c700 1 -- 172.21.15.32:0/2787655449 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9f240d1ca0 msgr2=0x7f9f2415f750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:35.292 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:35.284+0000 7f9f2259c700 1 --2- 172.21.15.32:0/2787655449 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9f240d1ca0 0x7f9f2415f750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:35.292 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:35.284+0000 7f9f2259c700 1 -- 172.21.15.32:0/2787655449 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f140094b0 con 0x7f9f240b5440 2023-10-08T06:09:35.293 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:35.284+0000 7f9f2259c700 1 --2- 172.21.15.32:0/2787655449 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9f240b5440 0x7f9f241f42a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f9f0c0011e0 tx=0x7f9f0c00ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:35.293 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:35.284+0000 7f9f1affd700 1 -- 172.21.15.32:0/2787655449 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f0c0054e0 con 0x7f9f240b5440 2023-10-08T06:09:35.293 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:35.288+0000 7f9f1affd700 1 -- 172.21.15.32:0/2787655449 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f0c0036a0 con 0x7f9f240b5440 2023-10-08T06:09:35.293 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:35.288+0000 7f9f28b99700 1 -- 172.21.15.32:0/2787655449 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f24152740 con 0x7f9f240b5440 2023-10-08T06:09:35.293 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:35.288+0000 7f9f1affd700 1 -- 172.21.15.32:0/2787655449 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f0c003a50 con 0x7f9f240b5440 2023-10-08T06:09:35.293 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:35.288+0000 7f9f28b99700 1 -- 172.21.15.32:0/2787655449 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f24152d00 con 0x7f9f240b5440 2023-10-08T06:09:35.294 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:35.288+0000 7f9f28b99700 1 -- 172.21.15.32:0/2787655449 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f24073f00 con 0x7f9f240b5440 2023-10-08T06:09:35.294 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:35.288+0000 7f9f1affd700 1 -- 172.21.15.32:0/2787655449 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f9f0c003bb0 con 0x7f9f240b5440 2023-10-08T06:09:35.295 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:35.288+0000 7f9f1affd700 1 --2- 172.21.15.32:0/2787655449 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f9f04066510 0x7f9f040689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:35.295 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:35.288+0000 7f9f1affd700 1 -- 172.21.15.32:0/2787655449 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f9f0c0830d0 con 0x7f9f240b5440 2023-10-08T06:09:35.295 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:35.288+0000 7f9f21d9b700 1 --2- 172.21.15.32:0/2787655449 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f9f04066510 0x7f9f040689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:35.295 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:35.288+0000 7f9f21d9b700 1 --2- 172.21.15.32:0/2787655449 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f9f04066510 0x7f9f040689d0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f9f140090b0 tx=0x7f9f1401c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:35.304 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:35.300+0000 7f9f1affd700 1 -- 172.21.15.32:0/2787655449 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f9f0c050740 con 0x7f9f240b5440 2023-10-08T06:09:35.476 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:35.468+0000 7f9f28b99700 1 -- 172.21.15.32:0/2787655449 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f9f240b84e0 con 0x7f9f240b5440 2023-10-08T06:09:36.149 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:36.144+0000 7f9f1affd700 1 -- 172.21.15.32:0/2787655449 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v20) v1 ==== 170+0+0 (secure 0 0 0) 0x7f9f0c003e60 con 0x7f9f240b5440 2023-10-08T06:09:36.156 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:36.152+0000 7f9f28b99700 1 -- 172.21.15.32:0/2787655449 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f9f04066510 msgr2=0x7f9f040689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:36.156 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:36.152+0000 7f9f28b99700 1 --2- 172.21.15.32:0/2787655449 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f9f04066510 0x7f9f040689d0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f9f140090b0 tx=0x7f9f1401c040 comp rx=0 tx=0).stop 2023-10-08T06:09:36.156 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:36.152+0000 7f9f28b99700 1 -- 172.21.15.32:0/2787655449 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9f240b5440 msgr2=0x7f9f241f42a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:36.156 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:36.152+0000 7f9f28b99700 1 --2- 172.21.15.32:0/2787655449 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9f240b5440 0x7f9f241f42a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f9f0c0011e0 tx=0x7f9f0c00ca30 comp rx=0 tx=0).stop 2023-10-08T06:09:36.157 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:36.152+0000 7f9f28b99700 1 -- 172.21.15.32:0/2787655449 shutdown_connections 2023-10-08T06:09:36.157 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:36.152+0000 7f9f28b99700 1 --2- 172.21.15.32:0/2787655449 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f9f04066510 0x7f9f040689d0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:36.157 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:36.152+0000 7f9f28b99700 1 --2- 172.21.15.32:0/2787655449 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9f2415fc90 0x7f9f24153220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:36.157 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:36.152+0000 7f9f28b99700 1 --2- 172.21.15.32:0/2787655449 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9f240d1ca0 0x7f9f2415f750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:36.157 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:36.152+0000 7f9f28b99700 1 --2- 172.21.15.32:0/2787655449 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9f240b5440 0x7f9f241f42a0 secure :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f9f0c0011e0 tx=0x7f9f0c00ca30 comp rx=0 tx=0).stop 2023-10-08T06:09:36.157 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:36.152+0000 7f9f28b99700 1 -- 172.21.15.32:0/2787655449 >> 172.21.15.32:0/2787655449 conn(0x7f9f240cfd30 msgr2=0x7f9f240b7dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:09:36.162 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:36.156+0000 7f9f28b99700 1 -- 172.21.15.32:0/2787655449 shutdown_connections 2023-10-08T06:09:36.164 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:36.160+0000 7f9f28b99700 1 -- 172.21.15.32:0/2787655449 wait complete. 2023-10-08T06:09:36.171 INFO:teuthology.orchestra.run.smithi032.stderr:pool 'cephfs_data' created 2023-10-08T06:09:36.187 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-08T06:09:36.303 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:36.296+0000 7f2b9521a700 1 Processor -- start 2023-10-08T06:09:36.303 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:36.296+0000 7f2b9521a700 1 -- start start 2023-10-08T06:09:36.306 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:36.300+0000 7f2b9521a700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f2b9015a4c0 0x7f2b900cd380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:36.306 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:36.300+0000 7f2b9521a700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2b9006a330 0x7f2b900cd8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:36.306 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:36.300+0000 7f2b9521a700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b900664f0 con 0x7f2b9006a880 2023-10-08T06:09:36.306 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:36.300+0000 7f2b9521a700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b9015a8a0 con 0x7f2b9015a4c0 2023-10-08T06:09:36.306 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:36.300+0000 7f2b9521a700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b90065f30 con 0x7f2b9006a330 2023-10-08T06:09:36.306 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:36.300+0000 7f2b877fe700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f2b9006a880 0x7f2b900b04a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:58464/0 (socket says 172.21.15.32:58464) 2023-10-08T06:09:36.306 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:36.300+0000 7f2b877fe700 1 -- 172.21.15.32:0/3919068817 learned_addr learned my addr 172.21.15.32:0/3919068817 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-08T06:09:36.306 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:36.300+0000 7f2b8ffff700 1 --2- 172.21.15.32:0/3919068817 >> v2:172.21.15.32:3300/0 conn(0x7f2b9015a4c0 0x7f2b900cd380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:36.306 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:36.300+0000 7f2b94a19700 1 --2- 172.21.15.32:0/3919068817 >> v2:172.21.15.40:3300/0 conn(0x7f2b9006a330 0x7f2b900cd8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:36.307 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:36.300+0000 7f2b8f7fe700 1 -- 172.21.15.32:0/3919068817 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2381763096 0 0) 0x7f2b900664f0 con 0x7f2b9006a880 2023-10-08T06:09:36.307 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:36.300+0000 7f2b8f7fe700 1 -- 172.21.15.32:0/3919068817 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2b7c0035d0 con 0x7f2b9006a880 2023-10-08T06:09:36.307 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:36.300+0000 7f2b8ffff700 1 -- 172.21.15.32:0/3919068817 >> v2:172.21.15.40:3300/0 conn(0x7f2b9006a330 msgr2=0x7f2b900cd8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:09:36.307 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:36.300+0000 7f2b8ffff700 1 --2- 172.21.15.32:0/3919068817 >> v2:172.21.15.40:3300/0 conn(0x7f2b9006a330 0x7f2b900cd8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:36.307 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:36.300+0000 7f2b8ffff700 1 -- 172.21.15.32:0/3919068817 >> v1:172.21.15.32:6789/0 conn(0x7f2b9006a880 legacy=0x7f2b900b04a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:36.307 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:36.300+0000 7f2b8ffff700 1 -- 172.21.15.32:0/3919068817 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b90066210 con 0x7f2b9015a4c0 2023-10-08T06:09:36.307 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:36.300+0000 7f2b8ffff700 1 --2- 172.21.15.32:0/3919068817 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2b9015a4c0 0x7f2b900cd380 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f2b90070440 tx=0x7f2b80009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5c1930df83869db server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:36.308 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:36.300+0000 7f2b8f7fe700 1 -- 172.21.15.32:0/3919068817 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b80005e50 con 0x7f2b9015a4c0 2023-10-08T06:09:36.308 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:36.300+0000 7f2b8f7fe700 1 -- 172.21.15.32:0/3919068817 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b80006030 con 0x7f2b9015a4c0 2023-10-08T06:09:36.309 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:36.300+0000 7f2b8f7fe700 1 -- 172.21.15.32:0/3919068817 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b800063a0 con 0x7f2b9015a4c0 2023-10-08T06:09:36.309 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:36.300+0000 7f2b9521a700 1 -- 172.21.15.32:0/3919068817 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2b9015a4c0 msgr2=0x7f2b900cd380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:36.309 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:36.300+0000 7f2b9521a700 1 --2- 172.21.15.32:0/3919068817 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2b9015a4c0 0x7f2b900cd380 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f2b90070440 tx=0x7f2b80009b20 comp rx=0 tx=0).stop 2023-10-08T06:09:36.309 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:36.300+0000 7f2b9521a700 1 -- 172.21.15.32:0/3919068817 shutdown_connections 2023-10-08T06:09:36.309 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:36.300+0000 7f2b9521a700 1 --2- 172.21.15.32:0/3919068817 >> v2:172.21.15.40:3300/0 conn(0x7f2b9006a330 0x7f2b900cd8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:36.309 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:36.300+0000 7f2b9521a700 1 --2- 172.21.15.32:0/3919068817 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2b9015a4c0 0x7f2b900cd380 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:36.309 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:36.304+0000 7f2b9521a700 1 -- 172.21.15.32:0/3919068817 >> 172.21.15.32:0/3919068817 conn(0x7f2b900718a0 msgr2=0x7f2b90071cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:09:36.309 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:36.304+0000 7f2b9521a700 1 -- 172.21.15.32:0/3919068817 shutdown_connections 2023-10-08T06:09:36.309 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:36.304+0000 7f2b9521a700 1 -- 172.21.15.32:0/3919068817 wait complete. 2023-10-08T06:09:36.311 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:36.304+0000 7f2b9521a700 1 Processor -- start 2023-10-08T06:09:36.311 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:36.304+0000 7f2b9521a700 1 -- start start 2023-10-08T06:09:36.314 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:36.308+0000 7f2b9521a700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2b9006a330 0x7f2b900c5c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:36.314 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:36.308+0000 7f2b9521a700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2b9006a880 0x7f2b900ae2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:36.314 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:36.308+0000 7f2b9521a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2b9015a4c0 0x7f2b900ae7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:36.314 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:36.308+0000 7f2b9521a700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b9006c8a0 con 0x7f2b9006a330 2023-10-08T06:09:36.314 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:36.308+0000 7f2b9521a700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b900c3440 con 0x7f2b9015a4c0 2023-10-08T06:09:36.314 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:36.308+0000 7f2b9521a700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b900c3720 con 0x7f2b9006a880 2023-10-08T06:09:36.314 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:36.308+0000 7f2b8ffff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2b9006a330 0x7f2b900c5c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:36.315 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:36.308+0000 7f2b8ffff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2b9006a330 0x7f2b900c5c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:37270/0 (socket says 172.21.15.32:37270) 2023-10-08T06:09:36.315 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:36.308+0000 7f2b8ffff700 1 -- 172.21.15.32:0/1422884159 learned_addr learned my addr 172.21.15.32:0/1422884159 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:09:36.315 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:36.308+0000 7f2b877fe700 1 --2- 172.21.15.32:0/1422884159 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2b9006a880 0x7f2b900ae2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:36.315 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:36.308+0000 7f2b94a19700 1 --2- 172.21.15.32:0/1422884159 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2b9015a4c0 0x7f2b900ae7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:36.315 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:36.308+0000 7f2b8ffff700 1 -- 172.21.15.32:0/1422884159 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2b9006a880 msgr2=0x7f2b900ae2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:36.315 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:36.308+0000 7f2b8ffff700 1 --2- 172.21.15.32:0/1422884159 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2b9006a880 0x7f2b900ae2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:36.315 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:36.308+0000 7f2b8ffff700 1 -- 172.21.15.32:0/1422884159 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2b9015a4c0 msgr2=0x7f2b900ae7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:36.315 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:36.308+0000 7f2b8ffff700 1 --2- 172.21.15.32:0/1422884159 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2b9015a4c0 0x7f2b900ae7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:36.315 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:36.308+0000 7f2b8ffff700 1 -- 172.21.15.32:0/1422884159 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b80009450 con 0x7f2b9006a330 2023-10-08T06:09:36.316 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:36.308+0000 7f2b8ffff700 1 --2- 172.21.15.32:0/1422884159 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2b9006a330 0x7f2b900c5c40 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f2b80000c00 tx=0x7f2b80004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:36.316 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:36.308+0000 7f2b8d7fa700 1 -- 172.21.15.32:0/1422884159 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b800063a0 con 0x7f2b9006a330 2023-10-08T06:09:36.316 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:36.308+0000 7f2b8d7fa700 1 -- 172.21.15.32:0/1422884159 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b80006500 con 0x7f2b9006a330 2023-10-08T06:09:36.316 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:36.308+0000 7f2b9521a700 1 -- 172.21.15.32:0/1422884159 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b900c3a00 con 0x7f2b9006a330 2023-10-08T06:09:36.316 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:36.308+0000 7f2b8d7fa700 1 -- 172.21.15.32:0/1422884159 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b800068b0 con 0x7f2b9006a330 2023-10-08T06:09:36.317 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:36.308+0000 7f2b9521a700 1 -- 172.21.15.32:0/1422884159 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b900c6180 con 0x7f2b9006a330 2023-10-08T06:09:36.317 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:36.312+0000 7f2b9521a700 1 -- 172.21.15.32:0/1422884159 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b900c3c40 con 0x7f2b9006a330 2023-10-08T06:09:36.317 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:36.312+0000 7f2b8d7fa700 1 -- 172.21.15.32:0/1422884159 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f2b80022070 con 0x7f2b9006a330 2023-10-08T06:09:36.318 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:36.312+0000 7f2b8d7fa700 1 --2- 172.21.15.32:0/1422884159 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f2b70066510 0x7f2b700689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:36.318 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:36.312+0000 7f2b8d7fa700 1 -- 172.21.15.32:0/1422884159 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f2b80085570 con 0x7f2b9006a330 2023-10-08T06:09:36.318 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:36.312+0000 7f2b877fe700 1 --2- 172.21.15.32:0/1422884159 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f2b70066510 0x7f2b700689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:36.319 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:36.312+0000 7f2b877fe700 1 --2- 172.21.15.32:0/1422884159 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f2b70066510 0x7f2b700689d0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f2b90159eb0 tx=0x7f2b78009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:36.328 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:36.324+0000 7f2b8d7fa700 1 -- 172.21.15.32:0/1422884159 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f2b900c3c40 con 0x7f2b9006a330 2023-10-08T06:09:36.526 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:36.520+0000 7f2b9521a700 1 -- 172.21.15.32:0/1422884159 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f2b901f0cb0 con 0x7f2b9006a330 2023-10-08T06:09:37.153 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.148+0000 7f2b8d7fa700 1 -- 172.21.15.32:0/1422884159 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f2b901f0cb0 con 0x7f2b9006a330 2023-10-08T06:09:37.158 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.152+0000 7f2b9521a700 1 -- 172.21.15.32:0/1422884159 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f2b70066510 msgr2=0x7f2b700689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:37.159 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.152+0000 7f2b9521a700 1 --2- 172.21.15.32:0/1422884159 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f2b70066510 0x7f2b700689d0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f2b90159eb0 tx=0x7f2b78009040 comp rx=0 tx=0).stop 2023-10-08T06:09:37.159 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.152+0000 7f2b9521a700 1 -- 172.21.15.32:0/1422884159 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2b9006a330 msgr2=0x7f2b900c5c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:37.159 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.152+0000 7f2b9521a700 1 --2- 172.21.15.32:0/1422884159 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2b9006a330 0x7f2b900c5c40 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f2b80000c00 tx=0x7f2b80004770 comp rx=0 tx=0).stop 2023-10-08T06:09:37.159 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.152+0000 7f2b9521a700 1 -- 172.21.15.32:0/1422884159 shutdown_connections 2023-10-08T06:09:37.159 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.152+0000 7f2b9521a700 1 --2- 172.21.15.32:0/1422884159 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f2b70066510 0x7f2b700689d0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:37.159 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.152+0000 7f2b9521a700 1 --2- 172.21.15.32:0/1422884159 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2b9015a4c0 0x7f2b900ae7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:37.159 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.152+0000 7f2b9521a700 1 --2- 172.21.15.32:0/1422884159 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2b9006a880 0x7f2b900ae2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:37.159 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.152+0000 7f2b9521a700 1 --2- 172.21.15.32:0/1422884159 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2b9006a330 0x7f2b900c5c40 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:37.159 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.152+0000 7f2b9521a700 1 -- 172.21.15.32:0/1422884159 >> 172.21.15.32:0/1422884159 conn(0x7f2b900718a0 msgr2=0x7f2b90158bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:09:37.160 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.152+0000 7f2b9521a700 1 -- 172.21.15.32:0/1422884159 shutdown_connections 2023-10-08T06:09:37.160 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.156+0000 7f2b9521a700 1 -- 172.21.15.32:0/1422884159 wait complete. 2023-10-08T06:09:37.165 INFO:teuthology.orchestra.run.smithi032.stderr:new fs with metadata pool 2 and data pool 3 2023-10-08T06:09:37.192 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T06:09:37.292 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.284+0000 7f2ee759e700 1 Processor -- start 2023-10-08T06:09:37.292 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.288+0000 7f2ee759e700 1 -- start start 2023-10-08T06:09:37.293 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.288+0000 7f2ee759e700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2ee815d490 0x7f2ee80b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:37.293 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.288+0000 7f2ee759e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2ee80d13d0 0x7f2ee80cddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:37.293 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.288+0000 7f2ee759e700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ee80ce770 con 0x7f2ee80ce310 2023-10-08T06:09:37.293 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.288+0000 7f2ee759e700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ee80d1bb0 con 0x7f2ee815d490 2023-10-08T06:09:37.294 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.288+0000 7f2ee759e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ee80d1e90 con 0x7f2ee80d13d0 2023-10-08T06:09:37.294 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.288+0000 7f2ee6d9d700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f2ee80ce310 0x7f2ee80b4a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:58466/0 (socket says 172.21.15.32:58466) 2023-10-08T06:09:37.294 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.288+0000 7f2ee6d9d700 1 -- 172.21.15.32:0/2860082546 learned_addr learned my addr 172.21.15.32:0/2860082546 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-08T06:09:37.294 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.288+0000 7f2ee5d9b700 1 --2- 172.21.15.32:0/2860082546 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2ee80d13d0 0x7f2ee80cddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:37.294 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.288+0000 7f2ee659c700 1 --2- 172.21.15.32:0/2860082546 >> v2:172.21.15.40:3300/0 conn(0x7f2ee815d490 0x7f2ee80b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:37.294 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.288+0000 7f2ee559a700 1 -- 172.21.15.32:0/2860082546 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2214691167 0 0) 0x7f2ee80ce770 con 0x7f2ee80ce310 2023-10-08T06:09:37.294 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.288+0000 7f2ee559a700 1 -- 172.21.15.32:0/2860082546 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2ed40035d0 con 0x7f2ee80ce310 2023-10-08T06:09:37.297 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.288+0000 7f2ee559a700 1 -- 172.21.15.32:0/2860082546 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1767466329 0 0) 0x7f2ed40035d0 con 0x7f2ee80ce310 2023-10-08T06:09:37.297 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.288+0000 7f2ee559a700 1 -- 172.21.15.32:0/2860082546 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2ee80d13d0 msgr2=0x7f2ee80cddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:09:37.297 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.288+0000 7f2ee559a700 1 --2- 172.21.15.32:0/2860082546 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2ee80d13d0 0x7f2ee80cddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:37.297 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.288+0000 7f2ee559a700 1 -- 172.21.15.32:0/2860082546 >> v2:172.21.15.40:3300/0 conn(0x7f2ee815d490 msgr2=0x7f2ee80b8bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:09:37.297 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.288+0000 7f2ee559a700 1 --2- 172.21.15.32:0/2860082546 >> v2:172.21.15.40:3300/0 conn(0x7f2ee815d490 0x7f2ee80b8bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:37.297 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.288+0000 7f2ee559a700 1 -- 172.21.15.32:0/2860082546 --> v1:172.21.15.32:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ee80d2170 con 0x7f2ee80ce310 2023-10-08T06:09:37.297 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.288+0000 7f2ee559a700 1 -- 172.21.15.32:0/2860082546 <== mon.0 v1:172.21.15.32:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2364763317 0 0) 0x7f2ee0001670 con 0x7f2ee80ce310 2023-10-08T06:09:37.297 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.288+0000 7f2ee559a700 1 -- 172.21.15.32:0/2860082546 >> v1:172.21.15.32:6789/0 conn(0x7f2ee80ce310 legacy=0x7f2ee80b4a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:37.298 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.288+0000 7f2ee559a700 1 --2- 172.21.15.32:0/2860082546 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2ed4003a20 0x7f2ed4003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:37.298 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.288+0000 7f2ee559a700 1 --2- 172.21.15.32:0/2860082546 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2ed4004870 0x7f2ed4004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:37.298 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.288+0000 7f2ee559a700 1 --2- 172.21.15.32:0/2860082546 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2ee80d13d0 0x7f2ed4005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:37.298 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.288+0000 7f2ee559a700 1 -- 172.21.15.32:0/2860082546 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ee80d1bb0 con 0x7f2ed4004870 2023-10-08T06:09:37.298 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.288+0000 7f2ee559a700 1 -- 172.21.15.32:0/2860082546 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ee80d1e90 con 0x7f2ed4003a20 2023-10-08T06:09:37.298 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.288+0000 7f2ee559a700 1 -- 172.21.15.32:0/2860082546 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ed400ba30 con 0x7f2ee80d13d0 2023-10-08T06:09:37.298 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.288+0000 7f2ee5d9b700 1 --2- 172.21.15.32:0/2860082546 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2ed4004870 0x7f2ed4004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:37.298 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.288+0000 7f2ee659c700 1 --2- 172.21.15.32:0/2860082546 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2ed4003a20 0x7f2ed4003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:37.298 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.288+0000 7f2ee6d9d700 1 --2- 172.21.15.32:0/2860082546 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2ee80d13d0 0x7f2ed4005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:37.299 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.288+0000 7f2ee5d9b700 1 -- 172.21.15.32:0/2860082546 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2ee80d13d0 msgr2=0x7f2ed4005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:09:37.299 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.288+0000 7f2ee5d9b700 1 --2- 172.21.15.32:0/2860082546 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2ee80d13d0 0x7f2ed4005230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:37.299 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.288+0000 7f2ee5d9b700 1 -- 172.21.15.32:0/2860082546 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2ed4003a20 msgr2=0x7f2ed4003e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:09:37.299 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.288+0000 7f2ee5d9b700 1 --2- 172.21.15.32:0/2860082546 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2ed4003a20 0x7f2ed4003e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:37.299 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.288+0000 7f2ee5d9b700 1 -- 172.21.15.32:0/2860082546 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ed40035d0 con 0x7f2ed4004870 2023-10-08T06:09:37.299 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.288+0000 7f2ee659c700 1 --2- 172.21.15.32:0/2860082546 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2ed4003a20 0x7f2ed4003e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T06:09:37.299 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.288+0000 7f2ee6d9d700 1 --2- 172.21.15.32:0/2860082546 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2ee80d13d0 0x7f2ed4005230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T06:09:37.299 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.288+0000 7f2ee5d9b700 1 --2- 172.21.15.32:0/2860082546 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2ed4004870 0x7f2ed4004cf0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f2ed0009b70 tx=0x7f2ed40058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=635663b16bfe124d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:37.299 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.288+0000 7f2ee559a700 1 -- 172.21.15.32:0/2860082546 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ed000e6c0 con 0x7f2ed4004870 2023-10-08T06:09:37.299 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.288+0000 7f2ee559a700 1 -- 172.21.15.32:0/2860082546 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ed000e820 con 0x7f2ed4004870 2023-10-08T06:09:37.300 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.288+0000 7f2ee559a700 1 -- 172.21.15.32:0/2860082546 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ed000eb90 con 0x7f2ed4004870 2023-10-08T06:09:37.300 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.292+0000 7f2ee759e700 1 -- 172.21.15.32:0/2860082546 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2ed4004870 msgr2=0x7f2ed4004cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:37.300 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.292+0000 7f2ee759e700 1 --2- 172.21.15.32:0/2860082546 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2ed4004870 0x7f2ed4004cf0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f2ed0009b70 tx=0x7f2ed40058a0 comp rx=0 tx=0).stop 2023-10-08T06:09:37.300 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.292+0000 7f2ee6d9d700 1 -- 172.21.15.32:0/2860082546 reap_dead start 2023-10-08T06:09:37.300 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.292+0000 7f2ee759e700 1 -- 172.21.15.32:0/2860082546 shutdown_connections 2023-10-08T06:09:37.300 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.292+0000 7f2ee759e700 1 -- 172.21.15.32:0/2860082546 >> 172.21.15.32:0/2860082546 conn(0x7f2ee806ab40 msgr2=0x7f2ee806af20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:09:37.300 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.292+0000 7f2ee759e700 1 -- 172.21.15.32:0/2860082546 shutdown_connections 2023-10-08T06:09:37.300 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.292+0000 7f2ee759e700 1 -- 172.21.15.32:0/2860082546 wait complete. 2023-10-08T06:09:37.301 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.292+0000 7f2ee759e700 1 Processor -- start 2023-10-08T06:09:37.301 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.296+0000 7f2ee759e700 1 -- start start 2023-10-08T06:09:37.303 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.296+0000 7f2ee759e700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2ed4004870 0x7f2ee815f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:37.303 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.296+0000 7f2ee759e700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2ee8145550 0x7f2ee815e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:37.303 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.296+0000 7f2ee759e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2ee80c8570 0x7f2ee80c8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:37.303 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.296+0000 7f2ee759e700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ee80c8f60 con 0x7f2ed4004870 2023-10-08T06:09:37.304 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.296+0000 7f2ee759e700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ee815e7e0 con 0x7f2ee8145550 2023-10-08T06:09:37.304 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.296+0000 7f2ee759e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ee815f9b0 con 0x7f2ee80c8570 2023-10-08T06:09:37.304 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.296+0000 7f2ee659c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2ed4004870 0x7f2ee815f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:37.304 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.296+0000 7f2ee659c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2ed4004870 0x7f2ee815f320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:37292/0 (socket says 172.21.15.32:37292) 2023-10-08T06:09:37.304 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.296+0000 7f2ee659c700 1 -- 172.21.15.32:0/2354171284 learned_addr learned my addr 172.21.15.32:0/2354171284 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:09:37.304 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.296+0000 7f2ee5d9b700 1 --2- 172.21.15.32:0/2354171284 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2ee8145550 0x7f2ee815e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:37.304 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.296+0000 7f2ee6d9d700 1 --2- 172.21.15.32:0/2354171284 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2ee80c8570 0x7f2ee80c8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:37.304 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.296+0000 7f2ee659c700 1 -- 172.21.15.32:0/2354171284 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2ee80c8570 msgr2=0x7f2ee80c8a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:37.304 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.296+0000 7f2ee659c700 1 --2- 172.21.15.32:0/2354171284 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2ee80c8570 0x7f2ee80c8a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:37.305 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.296+0000 7f2ee659c700 1 -- 172.21.15.32:0/2354171284 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2ee8145550 msgr2=0x7f2ee815e2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:37.305 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.296+0000 7f2ee659c700 1 --2- 172.21.15.32:0/2354171284 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2ee8145550 0x7f2ee815e2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:37.305 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.296+0000 7f2ee659c700 1 -- 172.21.15.32:0/2354171284 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ee815fc90 con 0x7f2ed4004870 2023-10-08T06:09:37.305 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.296+0000 7f2ee6d9d700 1 --2- 172.21.15.32:0/2354171284 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2ee80c8570 0x7f2ee80c8a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T06:09:37.305 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.296+0000 7f2ee659c700 1 --2- 172.21.15.32:0/2354171284 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2ed4004870 0x7f2ee815f320 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f2ed80101c0 tx=0x7f2ed8010580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:37.305 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.296+0000 7f2edeffd700 1 -- 172.21.15.32:0/2354171284 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ed800e050 con 0x7f2ed4004870 2023-10-08T06:09:37.305 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.296+0000 7f2edeffd700 1 -- 172.21.15.32:0/2354171284 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ed800f040 con 0x7f2ed4004870 2023-10-08T06:09:37.305 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.296+0000 7f2ee759e700 1 -- 172.21.15.32:0/2354171284 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ee81540b0 con 0x7f2ed4004870 2023-10-08T06:09:37.305 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.296+0000 7f2edeffd700 1 -- 172.21.15.32:0/2354171284 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ed8003c60 con 0x7f2ed4004870 2023-10-08T06:09:37.305 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.296+0000 7f2ee759e700 1 -- 172.21.15.32:0/2354171284 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ee8154670 con 0x7f2ed4004870 2023-10-08T06:09:37.306 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.300+0000 7f2ee759e700 1 -- 172.21.15.32:0/2354171284 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ee8067b90 con 0x7f2ed4004870 2023-10-08T06:09:37.306 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.300+0000 7f2edeffd700 1 -- 172.21.15.32:0/2354171284 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f2ed8004020 con 0x7f2ed4004870 2023-10-08T06:09:37.307 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.300+0000 7f2edeffd700 1 --2- 172.21.15.32:0/2354171284 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f2ec8066540 0x7f2ec8068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:37.308 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.304+0000 7f2edeffd700 1 -- 172.21.15.32:0/2354171284 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2ed8084af0 con 0x7f2ed4004870 2023-10-08T06:09:37.308 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.304+0000 7f2ee5d9b700 1 --2- 172.21.15.32:0/2354171284 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f2ec8066540 0x7f2ec8068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:37.308 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.304+0000 7f2ee5d9b700 1 --2- 172.21.15.32:0/2354171284 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f2ec8066540 0x7f2ec8068a00 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f2ed00090b0 tx=0x7f2ed0008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:37.316 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.312+0000 7f2edeffd700 1 -- 172.21.15.32:0/2354171284 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f2ed8051f70 con 0x7f2ed4004870 2023-10-08T06:09:37.478 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.472+0000 7f2ee759e700 1 -- 172.21.15.32:0/2354171284 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2ee8073f00 con 0x7f2ed4004870 2023-10-08T06:09:37.481 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.476+0000 7f2edeffd700 1 -- 172.21.15.32:0/2354171284 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16458 (secure 0 0 0) 0x7f2ed8055590 con 0x7f2ed4004870 2023-10-08T06:09:37.482 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:09:37.482 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":21,"fsid":"ac672d87-96ae-41e0-9314-623ba2cdbbba","created":"2023-10-08T06:09:11.175626+0000","modified":"2023-10-08T06:09:36.527565+0000","last_up_change":"2023-10-08T06:09:22.744643+0000","last_in_change":"2023-10-08T06:09:14.131580+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T06:09:23.307843+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T06:09:34.295012+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T06:09:35.515590+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"43433f0c-9592-4874-92d7-10f8f4acf07f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":587888964},{"type":"v1","addr":"172.21.15.32:6801","nonce":587888964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":587888964},{"type":"v1","addr":"172.21.15.32:6803","nonce":587888964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":587888964},{"type":"v1","addr":"172.21.15.32:6810","nonce":587888964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6805","nonce":587888964},{"type":"v1","addr":"172.21.15.32:6807","nonce":587888964}]},"public_addr":"172.21.15.32:6801/587888964","cluster_addr":"172.21.15.32:6803/587888964","heartbeat_back_addr":"172.21.15.32:6810/587888964","heartbeat_front_addr":"172.21.15.32:6807/587888964","state":["exists","up"]},{"osd":1,"uuid":"2ecb1008-b987-4ce7-b646-6cded55fc8d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":990576767},{"type":"v1","addr":"172.21.15.32:6817","nonce":990576767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":990576767},{"type":"v1","addr":"172.21.15.32:6819","nonce":990576767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":990576767},{"type":"v1","addr":"172.21.15.32:6823","nonce":990576767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":990576767},{"type":"v1","addr":"172.21.15.32:6821","nonce":990576767}]},"public_addr":"172.21.15.32:6817/990576767","cluster_addr":"172.21.15.32:6819/990576767","heartbeat_back_addr":"172.21.15.32:6823/990576767","heartbeat_front_addr":"172.21.15.32:6821/990576767","state":["exists","up"]},{"osd":2,"uuid":"1b131c94-c09b-4e80-8746-bf1b7bac362d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6824","nonce":1566874440},{"type":"v1","addr":"172.21.15.32:6825","nonce":1566874440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":1566874440},{"type":"v1","addr":"172.21.15.32:6827","nonce":1566874440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":1566874440},{"type":"v1","addr":"172.21.15.32:6831","nonce":1566874440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":1566874440},{"type":"v1","addr":"172.21.15.32:6829","nonce":1566874440}]},"public_addr":"172.21.15.32:6825/1566874440","cluster_addr":"172.21.15.32:6827/1566874440","heartbeat_back_addr":"172.21.15.32:6831/1566874440","heartbeat_front_addr":"172.21.15.32:6829/1566874440","state":["exists","up"]},{"osd":3,"uuid":"ad655af2-1f6f-4689-b21d-b07bbaeb68b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":3672614802},{"type":"v1","addr":"172.21.15.32:6806","nonce":3672614802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6809","nonce":3672614802},{"type":"v1","addr":"172.21.15.32:6811","nonce":3672614802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":3672614802},{"type":"v1","addr":"172.21.15.32:6815","nonce":3672614802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":3672614802},{"type":"v1","addr":"172.21.15.32:6813","nonce":3672614802}]},"public_addr":"172.21.15.32:6806/3672614802","cluster_addr":"172.21.15.32:6811/3672614802","heartbeat_back_addr":"172.21.15.32:6815/3672614802","heartbeat_front_addr":"172.21.15.32:6813/3672614802","state":["exists","up"]},{"osd":4,"uuid":"64a543a1-8c4f-458e-9aba-b35c1cd7dd03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":3369928244},{"type":"v1","addr":"172.21.15.40:6801","nonce":3369928244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":3369928244},{"type":"v1","addr":"172.21.15.40:6803","nonce":3369928244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":3369928244},{"type":"v1","addr":"172.21.15.40:6807","nonce":3369928244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":3369928244},{"type":"v1","addr":"172.21.15.40:6805","nonce":3369928244}]},"public_addr":"172.21.15.40:6801/3369928244","cluster_addr":"172.21.15.40:6803/3369928244","heartbeat_back_addr":"172.21.15.40:6807/3369928244","heartbeat_front_addr":"172.21.15.40:6805/3369928244","state":["exists","up"]},{"osd":5,"uuid":"0fef3e54-edb4-4678-878e-944663c51638","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":2395850297},{"type":"v1","addr":"172.21.15.40:6825","nonce":2395850297}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":2395850297},{"type":"v1","addr":"172.21.15.40:6827","nonce":2395850297}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":2395850297},{"type":"v1","addr":"172.21.15.40:6831","nonce":2395850297}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":2395850297},{"type":"v1","addr":"172.21.15.40:6829","nonce":2395850297}]},"public_addr":"172.21.15.40:6825/2395850297","cluster_addr":"172.21.15.40:6827/2395850297","heartbeat_back_addr":"172.21.15.40:6831/2395850297","heartbeat_front_addr":"172.21.15.40:6829/2395850297","state":["exists","up"]},{"osd":6,"uuid":"2eeb0472-6096-469d-9b2c-cab4bf41c31a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":4145283410},{"type":"v1","addr":"172.21.15.40:6809","nonce":4145283410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":4145283410},{"type":"v1","addr":"172.21.15.40:6811","nonce":4145283410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":4145283410},{"type":"v1","addr":"172.21.15.40:6815","nonce":4145283410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":4145283410},{"type":"v1","addr":"172.21.15.40:6813","nonce":4145283410}]},"public_addr":"172.21.15.40:6809/4145283410","cluster_addr":"172.21.15.40:6811/4145283410","heartbeat_back_addr":"172.21.15.40:6815/4145283410","heartbeat_front_addr":"172.21.15.40:6813/4145283410","state":["exists","up"]},{"osd":7,"uuid":"cf76e4c7-96a6-401f-a280-91aad4641940","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":2943297416},{"type":"v1","addr":"172.21.15.40:6817","nonce":2943297416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":2943297416},{"type":"v1","addr":"172.21.15.40:6819","nonce":2943297416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":2943297416},{"type":"v1","addr":"172.21.15.40:6823","nonce":2943297416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":2943297416},{"type":"v1","addr":"172.21.15.40:6821","nonce":2943297416}]},"public_addr":"172.21.15.40:6817/2943297416","cluster_addr":"172.21.15.40:6819/2943297416","heartbeat_back_addr":"172.21.15.40:6823/2943297416","heartbeat_front_addr":"172.21.15.40:6821/2943297416","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.411475+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.628841+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.599055+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.166100+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.384135+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.488403+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.307648+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.363541+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T06:09:37.483 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.476+0000 7f2ee759e700 1 -- 172.21.15.32:0/2354171284 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f2ec8066540 msgr2=0x7f2ec8068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:37.484 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.476+0000 7f2ee759e700 1 --2- 172.21.15.32:0/2354171284 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f2ec8066540 0x7f2ec8068a00 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f2ed00090b0 tx=0x7f2ed0008030 comp rx=0 tx=0).stop 2023-10-08T06:09:37.484 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.476+0000 7f2ee759e700 1 -- 172.21.15.32:0/2354171284 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2ed4004870 msgr2=0x7f2ee815f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:37.484 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.476+0000 7f2ee759e700 1 --2- 172.21.15.32:0/2354171284 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2ed4004870 0x7f2ee815f320 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f2ed80101c0 tx=0x7f2ed8010580 comp rx=0 tx=0).stop 2023-10-08T06:09:37.484 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.476+0000 7f2ee759e700 1 -- 172.21.15.32:0/2354171284 shutdown_connections 2023-10-08T06:09:37.484 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.476+0000 7f2ee759e700 1 --2- 172.21.15.32:0/2354171284 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f2ec8066540 0x7f2ec8068a00 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:37.484 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.476+0000 7f2ee759e700 1 --2- 172.21.15.32:0/2354171284 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2ee80c8570 0x7f2ee80c8a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:37.484 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.476+0000 7f2ee759e700 1 --2- 172.21.15.32:0/2354171284 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2ee8145550 0x7f2ee815e2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:37.484 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.476+0000 7f2ee759e700 1 --2- 172.21.15.32:0/2354171284 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2ed4004870 0x7f2ee815f320 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:37.484 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.480+0000 7f2ee759e700 1 -- 172.21.15.32:0/2354171284 >> 172.21.15.32:0/2354171284 conn(0x7f2ee806ab40 msgr2=0x7f2ee80b65d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:09:37.484 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.480+0000 7f2ee759e700 1 -- 172.21.15.32:0/2354171284 shutdown_connections 2023-10-08T06:09:37.484 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.480+0000 7f2ee759e700 1 -- 172.21.15.32:0/2354171284 wait complete. 2023-10-08T06:09:37.502 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T06:09:37.622 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.616+0000 7f4eec8df700 1 Processor -- start 2023-10-08T06:09:37.623 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.616+0000 7f4eec8df700 1 -- start start 2023-10-08T06:09:37.624 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.616+0000 7f4eec8df700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4ee815a2b0 0x7f4ee80ca9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:37.624 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.616+0000 7f4eec8df700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f4ee80c98c0 0x7f4ee80cb510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:37.624 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.616+0000 7f4eec8df700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ee80cca40 con 0x7f4ee8159ed0 2023-10-08T06:09:37.624 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.616+0000 7f4eec8df700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ee80ccdb0 con 0x7f4ee80c98c0 2023-10-08T06:09:37.624 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.616+0000 7f4eec8df700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ee80caef0 con 0x7f4ee815a2b0 2023-10-08T06:09:37.624 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.616+0000 7f4ee7fff700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f4ee80c98c0 0x7f4ee80cb510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:37.624 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.616+0000 7f4ee77fe700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f4ee8159ed0 0x7f4ee80706f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:58482/0 (socket says 172.21.15.32:58482) 2023-10-08T06:09:37.624 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.620+0000 7f4ee77fe700 1 -- 172.21.15.32:0/4084639085 learned_addr learned my addr 172.21.15.32:0/4084639085 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-08T06:09:37.624 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.620+0000 7f4ee6ffd700 1 --2- 172.21.15.32:0/4084639085 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4ee815a2b0 0x7f4ee80ca9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:37.626 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.620+0000 7f4ee7fff700 1 -- 172.21.15.32:0/4084639085 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4ee815a2b0 msgr2=0x7f4ee80ca9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:09:37.626 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.620+0000 7f4ee7fff700 1 --2- 172.21.15.32:0/4084639085 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4ee815a2b0 0x7f4ee80ca9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:37.626 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.620+0000 7f4ee7fff700 1 -- 172.21.15.32:0/4084639085 >> v1:172.21.15.32:6789/0 conn(0x7f4ee8159ed0 legacy=0x7f4ee80706f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:37.627 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.620+0000 7f4ee7fff700 1 -- 172.21.15.32:0/4084639085 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ee80cdf60 con 0x7f4ee80c98c0 2023-10-08T06:09:37.627 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.620+0000 7f4ee6ffd700 1 --2- 172.21.15.32:0/4084639085 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4ee815a2b0 0x7f4ee80ca9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T06:09:37.627 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.620+0000 7f4ee7fff700 1 --2- 172.21.15.32:0/4084639085 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4ee80c98c0 0x7f4ee80cb510 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f4ee0009850 tx=0x7f4ee0009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86f54888870726ef server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:37.627 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.620+0000 7f4ee67fc700 1 -- 172.21.15.32:0/4084639085 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ee0011830 con 0x7f4ee80c98c0 2023-10-08T06:09:37.627 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.620+0000 7f4ee67fc700 1 -- 172.21.15.32:0/4084639085 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ee0011990 con 0x7f4ee80c98c0 2023-10-08T06:09:37.627 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.620+0000 7f4ee67fc700 1 -- 172.21.15.32:0/4084639085 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ee0011d40 con 0x7f4ee80c98c0 2023-10-08T06:09:37.627 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.620+0000 7f4eec8df700 1 -- 172.21.15.32:0/4084639085 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4ee80c98c0 msgr2=0x7f4ee80cb510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:37.627 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.620+0000 7f4eec8df700 1 --2- 172.21.15.32:0/4084639085 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4ee80c98c0 0x7f4ee80cb510 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f4ee0009850 tx=0x7f4ee0009b60 comp rx=0 tx=0).stop 2023-10-08T06:09:37.627 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.620+0000 7f4eec8df700 1 -- 172.21.15.32:0/4084639085 shutdown_connections 2023-10-08T06:09:37.627 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.620+0000 7f4eec8df700 1 --2- 172.21.15.32:0/4084639085 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4ee80c98c0 0x7f4ee80cb510 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:37.627 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.620+0000 7f4eec8df700 1 --2- 172.21.15.32:0/4084639085 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4ee815a2b0 0x7f4ee80ca9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:37.628 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.620+0000 7f4eec8df700 1 -- 172.21.15.32:0/4084639085 >> 172.21.15.32:0/4084639085 conn(0x7f4ee80b0900 msgr2=0x7f4ee80b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:09:37.628 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.620+0000 7f4eec8df700 1 -- 172.21.15.32:0/4084639085 shutdown_connections 2023-10-08T06:09:37.628 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.620+0000 7f4eec8df700 1 -- 172.21.15.32:0/4084639085 wait complete. 2023-10-08T06:09:37.629 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.624+0000 7f4eec8df700 1 Processor -- start 2023-10-08T06:09:37.629 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.624+0000 7f4eec8df700 1 -- start start 2023-10-08T06:09:37.633 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.624+0000 7f4eec8df700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4ee80c98c0 0x7f4ee8157380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:37.633 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.624+0000 7f4eec8df700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4ee8159ed0 0x7f4ee80c8780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:37.633 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.624+0000 7f4eec8df700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4ee815a2b0 0x7f4ee80c6ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:37.633 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.624+0000 7f4eec8df700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ee80c8cc0 con 0x7f4ee80c98c0 2023-10-08T06:09:37.633 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.624+0000 7f4eec8df700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ee81f0bf0 con 0x7f4ee815a2b0 2023-10-08T06:09:37.633 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.624+0000 7f4eec8df700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ee81f0ed0 con 0x7f4ee8159ed0 2023-10-08T06:09:37.633 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.628+0000 7f4ee77fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4ee80c98c0 0x7f4ee8157380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:37.634 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.628+0000 7f4ee77fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4ee80c98c0 0x7f4ee8157380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:37304/0 (socket says 172.21.15.32:37304) 2023-10-08T06:09:37.634 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.628+0000 7f4ee77fe700 1 -- 172.21.15.32:0/4166840504 learned_addr learned my addr 172.21.15.32:0/4166840504 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:09:37.634 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.628+0000 7f4ee6ffd700 1 --2- 172.21.15.32:0/4166840504 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4ee8159ed0 0x7f4ee80c8780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:37.634 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.628+0000 7f4ee7fff700 1 --2- 172.21.15.32:0/4166840504 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4ee815a2b0 0x7f4ee80c6ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:37.634 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.628+0000 7f4ee77fe700 1 -- 172.21.15.32:0/4166840504 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4ee8159ed0 msgr2=0x7f4ee80c8780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:37.634 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.628+0000 7f4ee77fe700 1 --2- 172.21.15.32:0/4166840504 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4ee8159ed0 0x7f4ee80c8780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:37.634 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.628+0000 7f4ee77fe700 1 -- 172.21.15.32:0/4166840504 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4ee815a2b0 msgr2=0x7f4ee80c6ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:37.634 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.628+0000 7f4ee77fe700 1 --2- 172.21.15.32:0/4166840504 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4ee815a2b0 0x7f4ee80c6ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:37.634 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.628+0000 7f4ee77fe700 1 -- 172.21.15.32:0/4166840504 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ed8009a70 con 0x7f4ee80c98c0 2023-10-08T06:09:37.634 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.628+0000 7f4ee6ffd700 1 --2- 172.21.15.32:0/4166840504 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4ee8159ed0 0x7f4ee80c8780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T06:09:37.635 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.628+0000 7f4ee77fe700 1 --2- 172.21.15.32:0/4166840504 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4ee80c98c0 0x7f4ee8157380 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f4edc00c500 tx=0x7f4edc00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:37.635 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.628+0000 7f4ecffff700 1 -- 172.21.15.32:0/4166840504 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4edc005d90 con 0x7f4ee80c98c0 2023-10-08T06:09:37.635 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.628+0000 7f4ecffff700 1 -- 172.21.15.32:0/4166840504 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4edc0070d0 con 0x7f4ee80c98c0 2023-10-08T06:09:37.635 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.628+0000 7f4eec8df700 1 -- 172.21.15.32:0/4166840504 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ee00094b0 con 0x7f4ee80c98c0 2023-10-08T06:09:37.635 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.628+0000 7f4ecffff700 1 -- 172.21.15.32:0/4166840504 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4edc007460 con 0x7f4ee80c98c0 2023-10-08T06:09:37.635 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.628+0000 7f4eec8df700 1 -- 172.21.15.32:0/4166840504 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ee81f1490 con 0x7f4ee80c98c0 2023-10-08T06:09:37.636 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.628+0000 7f4eec8df700 1 -- 172.21.15.32:0/4166840504 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ee8073f00 con 0x7f4ee80c98c0 2023-10-08T06:09:37.636 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.628+0000 7f4ecffff700 1 -- 172.21.15.32:0/4166840504 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f4edc0075c0 con 0x7f4ee80c98c0 2023-10-08T06:09:37.636 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.628+0000 7f4ecffff700 1 --2- 172.21.15.32:0/4166840504 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f4ed4066510 0x7f4ed40689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:37.636 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.628+0000 7f4ecffff700 1 -- 172.21.15.32:0/4166840504 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4edc0832c0 con 0x7f4ee80c98c0 2023-10-08T06:09:37.636 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.628+0000 7f4ee6ffd700 1 --2- 172.21.15.32:0/4166840504 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f4ed4066510 0x7f4ed40689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:37.636 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.632+0000 7f4ee6ffd700 1 --2- 172.21.15.32:0/4166840504 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f4ed4066510 0x7f4ed40689d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f4ed8009fd0 tx=0x7f4ed800b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:37.641 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.636+0000 7f4ecffff700 1 -- 172.21.15.32:0/4166840504 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f4edc0507d0 con 0x7f4ee80c98c0 2023-10-08T06:09:37.804 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.800+0000 7f4eec8df700 1 -- 172.21.15.32:0/4166840504 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4ee81f3de0 con 0x7f4ee80c98c0 2023-10-08T06:09:37.807 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.800+0000 7f4ecffff700 1 -- 172.21.15.32:0/4166840504 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16458 (secure 0 0 0) 0x7f4edc053df0 con 0x7f4ee80c98c0 2023-10-08T06:09:37.808 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:09:37.808 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":21,"fsid":"ac672d87-96ae-41e0-9314-623ba2cdbbba","created":"2023-10-08T06:09:11.175626+0000","modified":"2023-10-08T06:09:36.527565+0000","last_up_change":"2023-10-08T06:09:22.744643+0000","last_in_change":"2023-10-08T06:09:14.131580+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T06:09:23.307843+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T06:09:34.295012+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T06:09:35.515590+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"43433f0c-9592-4874-92d7-10f8f4acf07f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":587888964},{"type":"v1","addr":"172.21.15.32:6801","nonce":587888964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":587888964},{"type":"v1","addr":"172.21.15.32:6803","nonce":587888964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":587888964},{"type":"v1","addr":"172.21.15.32:6810","nonce":587888964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6805","nonce":587888964},{"type":"v1","addr":"172.21.15.32:6807","nonce":587888964}]},"public_addr":"172.21.15.32:6801/587888964","cluster_addr":"172.21.15.32:6803/587888964","heartbeat_back_addr":"172.21.15.32:6810/587888964","heartbeat_front_addr":"172.21.15.32:6807/587888964","state":["exists","up"]},{"osd":1,"uuid":"2ecb1008-b987-4ce7-b646-6cded55fc8d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":990576767},{"type":"v1","addr":"172.21.15.32:6817","nonce":990576767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":990576767},{"type":"v1","addr":"172.21.15.32:6819","nonce":990576767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":990576767},{"type":"v1","addr":"172.21.15.32:6823","nonce":990576767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":990576767},{"type":"v1","addr":"172.21.15.32:6821","nonce":990576767}]},"public_addr":"172.21.15.32:6817/990576767","cluster_addr":"172.21.15.32:6819/990576767","heartbeat_back_addr":"172.21.15.32:6823/990576767","heartbeat_front_addr":"172.21.15.32:6821/990576767","state":["exists","up"]},{"osd":2,"uuid":"1b131c94-c09b-4e80-8746-bf1b7bac362d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6824","nonce":1566874440},{"type":"v1","addr":"172.21.15.32:6825","nonce":1566874440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":1566874440},{"type":"v1","addr":"172.21.15.32:6827","nonce":1566874440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":1566874440},{"type":"v1","addr":"172.21.15.32:6831","nonce":1566874440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":1566874440},{"type":"v1","addr":"172.21.15.32:6829","nonce":1566874440}]},"public_addr":"172.21.15.32:6825/1566874440","cluster_addr":"172.21.15.32:6827/1566874440","heartbeat_back_addr":"172.21.15.32:6831/1566874440","heartbeat_front_addr":"172.21.15.32:6829/1566874440","state":["exists","up"]},{"osd":3,"uuid":"ad655af2-1f6f-4689-b21d-b07bbaeb68b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":3672614802},{"type":"v1","addr":"172.21.15.32:6806","nonce":3672614802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6809","nonce":3672614802},{"type":"v1","addr":"172.21.15.32:6811","nonce":3672614802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":3672614802},{"type":"v1","addr":"172.21.15.32:6815","nonce":3672614802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":3672614802},{"type":"v1","addr":"172.21.15.32:6813","nonce":3672614802}]},"public_addr":"172.21.15.32:6806/3672614802","cluster_addr":"172.21.15.32:6811/3672614802","heartbeat_back_addr":"172.21.15.32:6815/3672614802","heartbeat_front_addr":"172.21.15.32:6813/3672614802","state":["exists","up"]},{"osd":4,"uuid":"64a543a1-8c4f-458e-9aba-b35c1cd7dd03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":3369928244},{"type":"v1","addr":"172.21.15.40:6801","nonce":3369928244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":3369928244},{"type":"v1","addr":"172.21.15.40:6803","nonce":3369928244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":3369928244},{"type":"v1","addr":"172.21.15.40:6807","nonce":3369928244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":3369928244},{"type":"v1","addr":"172.21.15.40:6805","nonce":3369928244}]},"public_addr":"172.21.15.40:6801/3369928244","cluster_addr":"172.21.15.40:6803/3369928244","heartbeat_back_addr":"172.21.15.40:6807/3369928244","heartbeat_front_addr":"172.21.15.40:6805/3369928244","state":["exists","up"]},{"osd":5,"uuid":"0fef3e54-edb4-4678-878e-944663c51638","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":2395850297},{"type":"v1","addr":"172.21.15.40:6825","nonce":2395850297}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":2395850297},{"type":"v1","addr":"172.21.15.40:6827","nonce":2395850297}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":2395850297},{"type":"v1","addr":"172.21.15.40:6831","nonce":2395850297}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":2395850297},{"type":"v1","addr":"172.21.15.40:6829","nonce":2395850297}]},"public_addr":"172.21.15.40:6825/2395850297","cluster_addr":"172.21.15.40:6827/2395850297","heartbeat_back_addr":"172.21.15.40:6831/2395850297","heartbeat_front_addr":"172.21.15.40:6829/2395850297","state":["exists","up"]},{"osd":6,"uuid":"2eeb0472-6096-469d-9b2c-cab4bf41c31a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":4145283410},{"type":"v1","addr":"172.21.15.40:6809","nonce":4145283410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":4145283410},{"type":"v1","addr":"172.21.15.40:6811","nonce":4145283410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":4145283410},{"type":"v1","addr":"172.21.15.40:6815","nonce":4145283410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":4145283410},{"type":"v1","addr":"172.21.15.40:6813","nonce":4145283410}]},"public_addr":"172.21.15.40:6809/4145283410","cluster_addr":"172.21.15.40:6811/4145283410","heartbeat_back_addr":"172.21.15.40:6815/4145283410","heartbeat_front_addr":"172.21.15.40:6813/4145283410","state":["exists","up"]},{"osd":7,"uuid":"cf76e4c7-96a6-401f-a280-91aad4641940","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":2943297416},{"type":"v1","addr":"172.21.15.40:6817","nonce":2943297416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":2943297416},{"type":"v1","addr":"172.21.15.40:6819","nonce":2943297416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":2943297416},{"type":"v1","addr":"172.21.15.40:6823","nonce":2943297416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":2943297416},{"type":"v1","addr":"172.21.15.40:6821","nonce":2943297416}]},"public_addr":"172.21.15.40:6817/2943297416","cluster_addr":"172.21.15.40:6819/2943297416","heartbeat_back_addr":"172.21.15.40:6823/2943297416","heartbeat_front_addr":"172.21.15.40:6821/2943297416","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.411475+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.628841+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.599055+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.166100+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.384135+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.488403+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.307648+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.363541+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T06:09:37.810 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.804+0000 7f4eec8df700 1 -- 172.21.15.32:0/4166840504 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f4ed4066510 msgr2=0x7f4ed40689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:37.810 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.804+0000 7f4eec8df700 1 --2- 172.21.15.32:0/4166840504 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f4ed4066510 0x7f4ed40689d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f4ed8009fd0 tx=0x7f4ed800b040 comp rx=0 tx=0).stop 2023-10-08T06:09:37.810 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.804+0000 7f4eec8df700 1 -- 172.21.15.32:0/4166840504 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4ee80c98c0 msgr2=0x7f4ee8157380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:37.811 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.804+0000 7f4eec8df700 1 --2- 172.21.15.32:0/4166840504 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4ee80c98c0 0x7f4ee8157380 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f4edc00c500 tx=0x7f4edc00c8c0 comp rx=0 tx=0).stop 2023-10-08T06:09:37.811 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.804+0000 7f4eec8df700 1 -- 172.21.15.32:0/4166840504 shutdown_connections 2023-10-08T06:09:37.811 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.804+0000 7f4eec8df700 1 --2- 172.21.15.32:0/4166840504 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f4ed4066510 0x7f4ed40689d0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:37.811 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.804+0000 7f4eec8df700 1 --2- 172.21.15.32:0/4166840504 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4ee815a2b0 0x7f4ee80c6ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:37.811 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.804+0000 7f4eec8df700 1 --2- 172.21.15.32:0/4166840504 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4ee8159ed0 0x7f4ee80c8780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:37.811 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.804+0000 7f4eec8df700 1 --2- 172.21.15.32:0/4166840504 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4ee80c98c0 0x7f4ee8157380 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:37.811 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.804+0000 7f4eec8df700 1 -- 172.21.15.32:0/4166840504 >> 172.21.15.32:0/4166840504 conn(0x7f4ee80b0900 msgr2=0x7f4ee8159190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:09:37.811 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.804+0000 7f4eec8df700 1 -- 172.21.15.32:0/4166840504 shutdown_connections 2023-10-08T06:09:37.811 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.804+0000 7f4eec8df700 1 -- 172.21.15.32:0/4166840504 wait complete. 2023-10-08T06:09:37.824 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-08T06:09:37.945 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.940+0000 7fa05fffc700 1 Processor -- start 2023-10-08T06:09:37.945 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.940+0000 7fa05fffc700 1 -- start start 2023-10-08T06:09:37.946 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.940+0000 7fa05fffc700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa05815d980 0x7fa0580b4d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:37.946 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.940+0000 7fa05fffc700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa0580b5270 0x7fa0580d1760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:37.946 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.940+0000 7fa05fffc700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0580b6750 con 0x7fa0580d1ca0 2023-10-08T06:09:37.946 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.940+0000 7fa05fffc700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0580d2a30 con 0x7fa05815d980 2023-10-08T06:09:37.946 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.940+0000 7fa05fffc700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0580b6980 con 0x7fa0580b5270 2023-10-08T06:09:37.948 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.940+0000 7fa05dd98700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa05815d980 0x7fa0580b4d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:37.948 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.940+0000 7fa05dd98700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa05815d980 0x7fa0580b4d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.32:58108/0 (socket says 172.21.15.32:58108) 2023-10-08T06:09:37.948 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.940+0000 7fa05dd98700 1 -- 172.21.15.32:0/4091886471 learned_addr learned my addr 172.21.15.32:0/4091886471 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:09:37.948 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.940+0000 7fa05d597700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa0580b5270 0x7fa0580d1760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:37.948 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.940+0000 7fa05e599700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fa0580d1ca0 0x7fa05806ab00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.32:38482/0 (socket says 172.21.15.32:38482) 2023-10-08T06:09:37.948 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.940+0000 7fa05cd96700 1 -- 172.21.15.32:0/4091886471 <== mon.1 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1446179063 0 0) 0x7fa0580b6750 con 0x7fa0580d1ca0 2023-10-08T06:09:37.948 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.940+0000 7fa05cd96700 1 -- 172.21.15.32:0/4091886471 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa0440035d0 con 0x7fa0580d1ca0 2023-10-08T06:09:37.948 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.940+0000 7fa05dd98700 1 -- 172.21.15.32:0/4091886471 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa0580b5270 msgr2=0x7fa0580d1760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:09:37.949 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.940+0000 7fa05dd98700 1 --2- 172.21.15.32:0/4091886471 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa0580b5270 0x7fa0580d1760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:37.949 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.940+0000 7fa05dd98700 1 -- 172.21.15.32:0/4091886471 >> v1:172.21.15.40:6789/0 conn(0x7fa0580d1ca0 legacy=0x7fa05806ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:37.949 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.940+0000 7fa05dd98700 1 -- 172.21.15.32:0/4091886471 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0580b56d0 con 0x7fa05815d980 2023-10-08T06:09:37.949 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.940+0000 7fa05dd98700 1 --2- 172.21.15.32:0/4091886471 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa05815d980 0x7fa0580b4d30 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fa054009e50 tx=0x7fa05400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=edbd44f99305629e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:37.949 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.944+0000 7fa05cd96700 1 -- 172.21.15.32:0/4091886471 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa05400e070 con 0x7fa05815d980 2023-10-08T06:09:37.949 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.944+0000 7fa05cd96700 1 -- 172.21.15.32:0/4091886471 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa05400b910 con 0x7fa05815d980 2023-10-08T06:09:37.949 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.944+0000 7fa05cd96700 1 -- 172.21.15.32:0/4091886471 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa05400bcc0 con 0x7fa05815d980 2023-10-08T06:09:37.950 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.944+0000 7fa05fffc700 1 -- 172.21.15.32:0/4091886471 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa05815d980 msgr2=0x7fa0580b4d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:37.950 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.944+0000 7fa05fffc700 1 --2- 172.21.15.32:0/4091886471 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa05815d980 0x7fa0580b4d30 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fa054009e50 tx=0x7fa05400b330 comp rx=0 tx=0).stop 2023-10-08T06:09:37.950 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.944+0000 7fa05fffc700 1 -- 172.21.15.32:0/4091886471 shutdown_connections 2023-10-08T06:09:37.951 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.944+0000 7fa05fffc700 1 --2- 172.21.15.32:0/4091886471 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa0580b5270 0x7fa0580d1760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:37.951 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.944+0000 7fa05fffc700 1 --2- 172.21.15.32:0/4091886471 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa05815d980 0x7fa0580b4d30 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:37.951 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.944+0000 7fa05fffc700 1 -- 172.21.15.32:0/4091886471 >> 172.21.15.32:0/4091886471 conn(0x7fa0580cfd30 msgr2=0x7fa0580d0110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:09:37.951 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.944+0000 7fa05fffc700 1 -- 172.21.15.32:0/4091886471 shutdown_connections 2023-10-08T06:09:37.951 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.944+0000 7fa05fffc700 1 -- 172.21.15.32:0/4091886471 wait complete. 2023-10-08T06:09:37.951 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.944+0000 7fa05fffc700 1 Processor -- start 2023-10-08T06:09:37.951 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.944+0000 7fa05fffc700 1 -- start start 2023-10-08T06:09:37.953 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.948+0000 7fa05fffc700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa0580b5270 0x7fa0581f2740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:37.953 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.948+0000 7fa05fffc700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa0580d1ca0 0x7fa0580ccd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:37.953 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.948+0000 7fa05fffc700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa0580abe50 0x7fa0580ac2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:37.953 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.948+0000 7fa05fffc700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0580ac820 con 0x7fa0580d1ca0 2023-10-08T06:09:37.953 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.948+0000 7fa05fffc700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa058159280 con 0x7fa0580abe50 2023-10-08T06:09:37.954 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.948+0000 7fa05fffc700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0580cd250 con 0x7fa0580b5270 2023-10-08T06:09:37.954 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.948+0000 7fa05d597700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa0580d1ca0 0x7fa0580ccd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:37.954 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.948+0000 7fa05d597700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa0580d1ca0 0x7fa0580ccd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:37320/0 (socket says 172.21.15.32:37320) 2023-10-08T06:09:37.954 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.948+0000 7fa05d597700 1 -- 172.21.15.32:0/4281639896 learned_addr learned my addr 172.21.15.32:0/4281639896 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:09:37.954 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.948+0000 7fa05e599700 1 --2- 172.21.15.32:0/4281639896 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa0580abe50 0x7fa0580ac2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:37.954 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.948+0000 7fa05dd98700 1 --2- 172.21.15.32:0/4281639896 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa0580b5270 0x7fa0581f2740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:37.954 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.948+0000 7fa05d597700 1 -- 172.21.15.32:0/4281639896 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa0580b5270 msgr2=0x7fa0581f2740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:37.954 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.948+0000 7fa05d597700 1 --2- 172.21.15.32:0/4281639896 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa0580b5270 0x7fa0581f2740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:37.954 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.948+0000 7fa05d597700 1 -- 172.21.15.32:0/4281639896 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa0580abe50 msgr2=0x7fa0580ac2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:37.954 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.948+0000 7fa05d597700 1 --2- 172.21.15.32:0/4281639896 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa0580abe50 0x7fa0580ac2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:37.954 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.948+0000 7fa05d597700 1 -- 172.21.15.32:0/4281639896 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa054009b30 con 0x7fa0580d1ca0 2023-10-08T06:09:37.955 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.948+0000 7fa05d597700 1 --2- 172.21.15.32:0/4281639896 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa0580d1ca0 0x7fa0580ccd10 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fa04c00e840 tx=0x7fa04c00ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:37.955 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.948+0000 7fa04a7fc700 1 -- 172.21.15.32:0/4281639896 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa04c0095a0 con 0x7fa0580d1ca0 2023-10-08T06:09:37.955 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.948+0000 7fa04a7fc700 1 -- 172.21.15.32:0/4281639896 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa04c013680 con 0x7fa0580d1ca0 2023-10-08T06:09:37.955 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.948+0000 7fa05fffc700 1 -- 172.21.15.32:0/4281639896 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0580aaf30 con 0x7fa0580d1ca0 2023-10-08T06:09:37.955 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.948+0000 7fa04a7fc700 1 -- 172.21.15.32:0/4281639896 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa04c0139f0 con 0x7fa0580d1ca0 2023-10-08T06:09:37.955 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.948+0000 7fa05fffc700 1 -- 172.21.15.32:0/4281639896 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0580aac50 con 0x7fa0580d1ca0 2023-10-08T06:09:37.955 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.948+0000 7fa05fffc700 1 -- 172.21.15.32:0/4281639896 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa058073f00 con 0x7fa0580d1ca0 2023-10-08T06:09:37.955 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.948+0000 7fa04a7fc700 1 -- 172.21.15.32:0/4281639896 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fa04c013b50 con 0x7fa0580d1ca0 2023-10-08T06:09:37.956 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.952+0000 7fa04a7fc700 1 --2- 172.21.15.32:0/4281639896 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fa03c066510 0x7fa03c0689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:37.956 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.952+0000 7fa05dd98700 1 --2- 172.21.15.32:0/4281639896 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fa03c066510 0x7fa03c0689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:37.956 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.952+0000 7fa04a7fc700 1 -- 172.21.15.32:0/4281639896 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa04c083d10 con 0x7fa0580d1ca0 2023-10-08T06:09:37.957 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.952+0000 7fa05dd98700 1 --2- 172.21.15.32:0/4281639896 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fa03c066510 0x7fa03c0689d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fa05400b370 tx=0x7fa054009000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:37.962 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:37.956+0000 7fa04a7fc700 1 -- 172.21.15.32:0/4281639896 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fa04c051220 con 0x7fa0580d1ca0 2023-10-08T06:09:38.168 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:38.164+0000 7fa05fffc700 1 -- 172.21.15.32:0/4281639896 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fa0580d08a0 con 0x7fa0580d1ca0 2023-10-08T06:09:38.181 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:38.176+0000 7fa04a7fc700 1 -- 172.21.15.32:0/4281639896 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v5) v1 ==== 118+0+0 (secure 0 0 0) 0x7fa04c054840 con 0x7fa0580d1ca0 2023-10-08T06:09:38.184 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:38.176+0000 7fa05fffc700 1 -- 172.21.15.32:0/4281639896 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fa03c066510 msgr2=0x7fa03c0689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:38.184 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:38.176+0000 7fa05fffc700 1 --2- 172.21.15.32:0/4281639896 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fa03c066510 0x7fa03c0689d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fa05400b370 tx=0x7fa054009000 comp rx=0 tx=0).stop 2023-10-08T06:09:38.184 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:38.176+0000 7fa05fffc700 1 -- 172.21.15.32:0/4281639896 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa0580d1ca0 msgr2=0x7fa0580ccd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:38.184 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:38.176+0000 7fa05fffc700 1 --2- 172.21.15.32:0/4281639896 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa0580d1ca0 0x7fa0580ccd10 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fa04c00e840 tx=0x7fa04c00ec00 comp rx=0 tx=0).stop 2023-10-08T06:09:38.184 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:38.180+0000 7fa05fffc700 1 -- 172.21.15.32:0/4281639896 shutdown_connections 2023-10-08T06:09:38.184 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:38.180+0000 7fa05fffc700 1 --2- 172.21.15.32:0/4281639896 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fa03c066510 0x7fa03c0689d0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:38.184 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:38.180+0000 7fa05fffc700 1 --2- 172.21.15.32:0/4281639896 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa0580d1ca0 0x7fa0580ccd10 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:38.184 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:38.180+0000 7fa05fffc700 1 --2- 172.21.15.32:0/4281639896 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa0580abe50 0x7fa0580ac2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:38.185 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:38.180+0000 7fa05fffc700 1 --2- 172.21.15.32:0/4281639896 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa0580b5270 0x7fa0581f2740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:38.185 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:38.180+0000 7fa05fffc700 1 -- 172.21.15.32:0/4281639896 >> 172.21.15.32:0/4281639896 conn(0x7fa0580cfd30 msgr2=0x7fa0580b8ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:09:38.185 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:38.180+0000 7fa05fffc700 1 -- 172.21.15.32:0/4281639896 shutdown_connections 2023-10-08T06:09:38.185 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:38.180+0000 7fa05fffc700 1 -- 172.21.15.32:0/4281639896 wait complete. 2023-10-08T06:09:38.199 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-10-08T06:09:38.199 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-08T06:09:38.312 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:38.308+0000 7f1ddb59e700 1 Processor -- start 2023-10-08T06:09:38.312 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:38.308+0000 7f1ddb59e700 1 -- start start 2023-10-08T06:09:38.313 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:38.308+0000 7f1ddb59e700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f1ddc15b980 0x7f1ddc15f780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:38.313 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:38.308+0000 7f1ddb59e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1ddc0c9b30 0x7f1ddc15bd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:38.313 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:38.308+0000 7f1ddb59e700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ddc06fc20 con 0x7f1ddc0719e0 2023-10-08T06:09:38.313 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:38.308+0000 7f1ddb59e700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ddc070430 con 0x7f1ddc15b980 2023-10-08T06:09:38.313 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:38.308+0000 7f1ddb59e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ddc15ed70 con 0x7f1ddc0c9b30 2023-10-08T06:09:38.313 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:38.308+0000 7f1dda59c700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f1ddc15b980 0x7f1ddc15f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:38.313 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:38.308+0000 7f1dd9d9b700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f1ddc0719e0 0x7f1ddc0c9420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:58492/0 (socket says 172.21.15.32:58492) 2023-10-08T06:09:38.314 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:38.308+0000 7f1dd9d9b700 1 -- 172.21.15.32:0/1508845369 learned_addr learned my addr 172.21.15.32:0/1508845369 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-08T06:09:38.314 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:38.308+0000 7f1ddad9d700 1 --2- 172.21.15.32:0/1508845369 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1ddc0c9b30 0x7f1ddc15bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:38.315 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:38.308+0000 7f1dd959a700 1 -- 172.21.15.32:0/1508845369 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2951170862 0 0) 0x7f1ddc06fc20 con 0x7f1ddc0719e0 2023-10-08T06:09:38.316 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:38.308+0000 7f1dda59c700 1 -- 172.21.15.32:0/1508845369 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1ddc0c9b30 msgr2=0x7f1ddc15bd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:09:38.316 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:38.308+0000 7f1dda59c700 1 --2- 172.21.15.32:0/1508845369 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1ddc0c9b30 0x7f1ddc15bd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:38.316 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:38.308+0000 7f1dda59c700 1 -- 172.21.15.32:0/1508845369 >> v1:172.21.15.32:6789/0 conn(0x7f1ddc0719e0 legacy=0x7f1ddc0c9420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:38.316 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:38.308+0000 7f1dda59c700 1 -- 172.21.15.32:0/1508845369 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ddc15fcc0 con 0x7f1ddc15b980 2023-10-08T06:09:38.316 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:38.308+0000 7f1dda59c700 1 --2- 172.21.15.32:0/1508845369 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1ddc15b980 0x7f1ddc15f780 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f1dc4009850 tx=0x7f1dc4009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=522113d12ab50841 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:38.316 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:38.308+0000 7f1dd959a700 1 -- 172.21.15.32:0/1508845369 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dc4011830 con 0x7f1ddc15b980 2023-10-08T06:09:38.316 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:38.308+0000 7f1dd959a700 1 -- 172.21.15.32:0/1508845369 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dc4011990 con 0x7f1ddc15b980 2023-10-08T06:09:38.317 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:38.308+0000 7f1dd959a700 1 -- 172.21.15.32:0/1508845369 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dc4011d40 con 0x7f1ddc15b980 2023-10-08T06:09:38.317 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:38.308+0000 7f1ddb59e700 1 -- 172.21.15.32:0/1508845369 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1ddc15b980 msgr2=0x7f1ddc15f780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:38.317 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:38.308+0000 7f1ddb59e700 1 --2- 172.21.15.32:0/1508845369 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1ddc15b980 0x7f1ddc15f780 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f1dc4009850 tx=0x7f1dc4009b60 comp rx=0 tx=0).stop 2023-10-08T06:09:38.317 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:38.308+0000 7f1ddb59e700 1 -- 172.21.15.32:0/1508845369 shutdown_connections 2023-10-08T06:09:38.317 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:38.308+0000 7f1ddb59e700 1 --2- 172.21.15.32:0/1508845369 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1ddc0c9b30 0x7f1ddc15bd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:38.317 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:38.308+0000 7f1ddb59e700 1 --2- 172.21.15.32:0/1508845369 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1ddc15b980 0x7f1ddc15f780 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:38.317 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:38.308+0000 7f1ddb59e700 1 -- 172.21.15.32:0/1508845369 >> 172.21.15.32:0/1508845369 conn(0x7f1ddc0b0900 msgr2=0x7f1ddc0b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:09:38.317 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:38.308+0000 7f1ddb59e700 1 -- 172.21.15.32:0/1508845369 shutdown_connections 2023-10-08T06:09:38.318 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:38.308+0000 7f1ddb59e700 1 -- 172.21.15.32:0/1508845369 wait complete. 2023-10-08T06:09:38.320 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:38.312+0000 7f1ddb59e700 1 Processor -- start 2023-10-08T06:09:38.320 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:38.312+0000 7f1ddb59e700 1 -- start start 2023-10-08T06:09:38.320 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:38.312+0000 7f1ddb59e700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1ddc0719e0 0x7f1ddc150fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:38.320 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:38.312+0000 7f1ddb59e700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1ddc0c9b30 0x7f1ddc1f0fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:38.320 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:38.312+0000 7f1ddb59e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1ddc15b980 0x7f1ddc0cb460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:38.320 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:38.312+0000 7f1ddb59e700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ddc0c2670 con 0x7f1ddc0c9b30 2023-10-08T06:09:38.320 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:38.312+0000 7f1ddb59e700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ddc1f1520 con 0x7f1ddc0719e0 2023-10-08T06:09:38.320 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:38.312+0000 7f1ddb59e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ddc1f4080 con 0x7f1ddc15b980 2023-10-08T06:09:38.320 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:38.312+0000 7f1dd9d9b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1ddc0c9b30 0x7f1ddc1f0fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:38.321 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:38.312+0000 7f1dd9d9b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1ddc0c9b30 0x7f1ddc1f0fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:37332/0 (socket says 172.21.15.32:37332) 2023-10-08T06:09:38.321 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:38.312+0000 7f1dd9d9b700 1 -- 172.21.15.32:0/4072684590 learned_addr learned my addr 172.21.15.32:0/4072684590 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:09:38.321 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:38.312+0000 7f1ddad9d700 1 --2- 172.21.15.32:0/4072684590 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1ddc15b980 0x7f1ddc0cb460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:38.321 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:38.312+0000 7f1dda59c700 1 --2- 172.21.15.32:0/4072684590 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1ddc0719e0 0x7f1ddc150fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:38.321 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:38.312+0000 7f1dd9d9b700 1 -- 172.21.15.32:0/4072684590 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1ddc15b980 msgr2=0x7f1ddc0cb460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:38.321 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:38.312+0000 7f1dd9d9b700 1 --2- 172.21.15.32:0/4072684590 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1ddc15b980 0x7f1ddc0cb460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:38.321 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:38.312+0000 7f1dd9d9b700 1 -- 172.21.15.32:0/4072684590 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1ddc0719e0 msgr2=0x7f1ddc150fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:38.321 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:38.312+0000 7f1dd9d9b700 1 --2- 172.21.15.32:0/4072684590 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1ddc0719e0 0x7f1ddc150fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:38.321 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:38.312+0000 7f1dd9d9b700 1 -- 172.21.15.32:0/4072684590 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dc40094b0 con 0x7f1ddc0c9b30 2023-10-08T06:09:38.321 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:38.312+0000 7f1dd9d9b700 1 --2- 172.21.15.32:0/4072684590 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1ddc0c9b30 0x7f1ddc1f0fe0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f1dcc00c580 tx=0x7f1dcc00c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:38.322 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:38.312+0000 7f1dd2ffd700 1 -- 172.21.15.32:0/4072684590 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dcc004ca0 con 0x7f1ddc0c9b30 2023-10-08T06:09:38.322 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:38.312+0000 7f1dd2ffd700 1 -- 172.21.15.32:0/4072684590 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dcc004e20 con 0x7f1ddc0c9b30 2023-10-08T06:09:38.322 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:38.312+0000 7f1ddb59e700 1 -- 172.21.15.32:0/4072684590 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ddc1f4360 con 0x7f1ddc0c9b30 2023-10-08T06:09:38.322 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:38.312+0000 7f1dd2ffd700 1 -- 172.21.15.32:0/4072684590 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dcc007310 con 0x7f1ddc0c9b30 2023-10-08T06:09:38.322 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:38.312+0000 7f1ddb59e700 1 -- 172.21.15.32:0/4072684590 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ddc1f4920 con 0x7f1ddc0c9b30 2023-10-08T06:09:38.323 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:38.316+0000 7f1ddb59e700 1 -- 172.21.15.32:0/4072684590 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ddc073f00 con 0x7f1ddc0c9b30 2023-10-08T06:09:38.323 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:38.316+0000 7f1dd2ffd700 1 -- 172.21.15.32:0/4072684590 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f1dcc007470 con 0x7f1ddc0c9b30 2023-10-08T06:09:38.323 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:38.316+0000 7f1dd2ffd700 1 --2- 172.21.15.32:0/4072684590 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f1dbc066510 0x7f1dbc0689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:38.323 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:38.316+0000 7f1dd2ffd700 1 -- 172.21.15.32:0/4072684590 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1dcc083a80 con 0x7f1ddc0c9b30 2023-10-08T06:09:38.323 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:38.316+0000 7f1dda59c700 1 --2- 172.21.15.32:0/4072684590 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f1dbc066510 0x7f1dbc0689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:38.323 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:38.320+0000 7f1dda59c700 1 --2- 172.21.15.32:0/4072684590 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f1dbc066510 0x7f1dbc0689d0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f1dc40090b0 tx=0x7f1dc401c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:38.330 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:38.324+0000 7f1dd2ffd700 1 -- 172.21.15.32:0/4072684590 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f1dcc050f10 con 0x7f1ddc0c9b30 2023-10-08T06:09:38.532 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:38.528+0000 7f1ddb59e700 1 -- 172.21.15.32:0/4072684590 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f1ddc0cc690 con 0x7f1ddc0c9b30 2023-10-08T06:09:39.193 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:39.188+0000 7f1dd2ffd700 1 -- 172.21.15.32:0/4072684590 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v6) v1 ==== 122+0+0 (secure 0 0 0) 0x7f1dcc007720 con 0x7f1ddc0c9b30 2023-10-08T06:09:39.198 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:39.192+0000 7f1ddb59e700 1 -- 172.21.15.32:0/4072684590 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f1dbc066510 msgr2=0x7f1dbc0689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:39.198 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:39.192+0000 7f1ddb59e700 1 --2- 172.21.15.32:0/4072684590 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f1dbc066510 0x7f1dbc0689d0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f1dc40090b0 tx=0x7f1dc401c040 comp rx=0 tx=0).stop 2023-10-08T06:09:39.198 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:39.192+0000 7f1ddb59e700 1 -- 172.21.15.32:0/4072684590 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1ddc0c9b30 msgr2=0x7f1ddc1f0fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:39.199 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:39.192+0000 7f1ddb59e700 1 --2- 172.21.15.32:0/4072684590 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1ddc0c9b30 0x7f1ddc1f0fe0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f1dcc00c580 tx=0x7f1dcc00c890 comp rx=0 tx=0).stop 2023-10-08T06:09:39.199 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:39.192+0000 7f1ddb59e700 1 -- 172.21.15.32:0/4072684590 shutdown_connections 2023-10-08T06:09:39.199 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:39.192+0000 7f1ddb59e700 1 --2- 172.21.15.32:0/4072684590 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f1dbc066510 0x7f1dbc0689d0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:39.199 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:39.192+0000 7f1ddb59e700 1 --2- 172.21.15.32:0/4072684590 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1ddc0c9b30 0x7f1ddc1f0fe0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:39.199 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:39.192+0000 7f1ddb59e700 1 --2- 172.21.15.32:0/4072684590 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1ddc15b980 0x7f1ddc0cb460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:39.199 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:39.192+0000 7f1ddb59e700 1 --2- 172.21.15.32:0/4072684590 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1ddc0719e0 0x7f1ddc150fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:39.199 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:39.192+0000 7f1ddb59e700 1 -- 172.21.15.32:0/4072684590 >> 172.21.15.32:0/4072684590 conn(0x7f1ddc0b0900 msgr2=0x7f1ddc154d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:09:39.199 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:39.192+0000 7f1ddb59e700 1 -- 172.21.15.32:0/4072684590 shutdown_connections 2023-10-08T06:09:39.199 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:39.192+0000 7f1ddb59e700 1 -- 172.21.15.32:0/4072684590 wait complete. 2023-10-08T06:09:39.215 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-10-08T06:09:39.216 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T06:09:39.336 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:39.328+0000 7ff53b59e700 1 Processor -- start 2023-10-08T06:09:39.336 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:39.328+0000 7ff53b59e700 1 -- start start 2023-10-08T06:09:39.337 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:39.332+0000 7ff53b59e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff53c0ce4e0 0x7ff53c167e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:39.337 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:39.332+0000 7ff53b59e700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff53c0b9000 con 0x7ff53c0b8bc0 2023-10-08T06:09:39.337 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:39.332+0000 7ff53b59e700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff53c0d1bb0 con 0x7ff53c15d490 2023-10-08T06:09:39.337 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:39.332+0000 7ff53b59e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff53c0d1e90 con 0x7ff53c0ce4e0 2023-10-08T06:09:39.337 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:39.332+0000 7ff533fff700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7ff53c0b8bc0 0x7ff53c0cddd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:58500/0 (socket says 172.21.15.32:58500) 2023-10-08T06:09:39.338 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:39.332+0000 7ff533fff700 1 -- 172.21.15.32:0/237592018 learned_addr learned my addr 172.21.15.32:0/237592018 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-08T06:09:39.338 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:39.332+0000 7ff53ad9d700 1 --2- 172.21.15.32:0/237592018 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff53c0ce4e0 0x7ff53c167e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:39.339 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:39.332+0000 7ff539d9b700 1 -- 172.21.15.32:0/237592018 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 874434 0 0) 0x7ff524001110 con 0x7ff53c0b8bc0 2023-10-08T06:09:39.339 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:39.332+0000 7ff539d9b700 1 -- 172.21.15.32:0/237592018 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff5280035d0 con 0x7ff53c0b8bc0 2023-10-08T06:09:39.339 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:39.332+0000 7ff53ad9d700 1 -- 172.21.15.32:0/237592018 >> v1:172.21.15.40:6789/0 conn(0x7ff53c15d490 legacy=0x7ff53c0d13d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:39.339 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:39.332+0000 7ff53ad9d700 1 -- 172.21.15.32:0/237592018 >> v1:172.21.15.32:6789/0 conn(0x7ff53c0b8bc0 legacy=0x7ff53c0cddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:39.339 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:39.332+0000 7ff53ad9d700 1 -- 172.21.15.32:0/237592018 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff53c0d2170 con 0x7ff53c0ce4e0 2023-10-08T06:09:39.339 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:39.332+0000 7ff53ad9d700 1 --2- 172.21.15.32:0/237592018 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff53c0ce4e0 0x7ff53c167e20 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7ff534009dc0 tx=0x7ff53400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e29bebb3cab2b6f7 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:39.339 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:39.332+0000 7ff539d9b700 1 -- 172.21.15.32:0/237592018 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff53400e070 con 0x7ff53c0ce4e0 2023-10-08T06:09:39.339 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:39.332+0000 7ff539d9b700 1 -- 172.21.15.32:0/237592018 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff53400bb20 con 0x7ff53c0ce4e0 2023-10-08T06:09:39.340 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:39.332+0000 7ff539d9b700 1 -- 172.21.15.32:0/237592018 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff53400be90 con 0x7ff53c0ce4e0 2023-10-08T06:09:39.340 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:39.336+0000 7ff53b59e700 1 -- 172.21.15.32:0/237592018 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff53c0ce4e0 msgr2=0x7ff53c167e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:39.341 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:39.336+0000 7ff53b59e700 1 --2- 172.21.15.32:0/237592018 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff53c0ce4e0 0x7ff53c167e20 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7ff534009dc0 tx=0x7ff53400b330 comp rx=0 tx=0).stop 2023-10-08T06:09:39.341 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:39.336+0000 7ff53b59e700 1 -- 172.21.15.32:0/237592018 shutdown_connections 2023-10-08T06:09:39.341 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:39.336+0000 7ff53b59e700 1 --2- 172.21.15.32:0/237592018 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff53c0ce4e0 0x7ff53c167e20 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:39.341 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:39.336+0000 7ff53b59e700 1 -- 172.21.15.32:0/237592018 >> 172.21.15.32:0/237592018 conn(0x7ff53c06ab40 msgr2=0x7ff53c06af20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:09:39.341 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:39.336+0000 7ff53b59e700 1 -- 172.21.15.32:0/237592018 shutdown_connections 2023-10-08T06:09:39.341 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:39.336+0000 7ff53b59e700 1 -- 172.21.15.32:0/237592018 wait complete. 2023-10-08T06:09:39.343 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:39.336+0000 7ff53b59e700 1 Processor -- start 2023-10-08T06:09:39.343 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:39.336+0000 7ff53b59e700 1 -- start start 2023-10-08T06:09:39.346 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:39.340+0000 7ff53b59e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff53c0b8bc0 0x7ff53c1f2980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:39.346 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:39.340+0000 7ff53b59e700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff53c0ce4e0 0x7ff53c160230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:39.346 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:39.340+0000 7ff53b59e700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff53c15d490 0x7ff53c154f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:39.346 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:39.340+0000 7ff53b59e700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff53c0cc0e0 con 0x7ff53c15d490 2023-10-08T06:09:39.346 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:39.340+0000 7ff53b59e700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff53c0cb210 con 0x7ff53c0ce4e0 2023-10-08T06:09:39.346 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:39.340+0000 7ff53b59e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff53c0cb4d0 con 0x7ff53c0b8bc0 2023-10-08T06:09:39.346 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:39.340+0000 7ff53ad9d700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff53c15d490 0x7ff53c154f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:39.346 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:39.340+0000 7ff53a59c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff53c0b8bc0 0x7ff53c1f2980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:39.347 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:39.340+0000 7ff533fff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff53c0ce4e0 0x7ff53c160230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:39.347 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:39.340+0000 7ff53a59c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff53c0b8bc0 0x7ff53c1f2980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.32:54744/0 (socket says 172.21.15.32:54744) 2023-10-08T06:09:39.347 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:39.340+0000 7ff53a59c700 1 -- 172.21.15.32:0/1623078696 learned_addr learned my addr 172.21.15.32:0/1623078696 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:09:39.347 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:39.340+0000 7ff53ad9d700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff53c15d490 0x7ff53c154f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:37338/0 (socket says 172.21.15.32:37338) 2023-10-08T06:09:39.348 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:39.340+0000 7ff53a59c700 1 -- 172.21.15.32:0/1623078696 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff53c0ce4e0 msgr2=0x7ff53c160230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:39.348 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:39.340+0000 7ff53a59c700 1 --2- 172.21.15.32:0/1623078696 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff53c0ce4e0 0x7ff53c160230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:39.348 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:39.340+0000 7ff53a59c700 1 -- 172.21.15.32:0/1623078696 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff53c15d490 msgr2=0x7ff53c154f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:39.348 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:39.340+0000 7ff53a59c700 1 --2- 172.21.15.32:0/1623078696 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff53c15d490 0x7ff53c154f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:39.348 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:39.340+0000 7ff53a59c700 1 -- 172.21.15.32:0/1623078696 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff534009a70 con 0x7ff53c0b8bc0 2023-10-08T06:09:39.348 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:39.340+0000 7ff533fff700 1 --2- 172.21.15.32:0/1623078696 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff53c0ce4e0 0x7ff53c160230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T06:09:39.348 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:39.340+0000 7ff53ad9d700 1 --2- 172.21.15.32:0/1623078696 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff53c15d490 0x7ff53c154f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T06:09:39.349 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:39.340+0000 7ff53a59c700 1 --2- 172.21.15.32:0/1623078696 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff53c0b8bc0 0x7ff53c1f2980 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7ff52c00c500 tx=0x7ff52c00c810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:39.349 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:39.340+0000 7ff532ffd700 1 -- 172.21.15.32:0/1623078696 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff52c0052d0 con 0x7ff53c0b8bc0 2023-10-08T06:09:39.349 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:39.340+0000 7ff532ffd700 1 -- 172.21.15.32:0/1623078696 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff52c005430 con 0x7ff53c0b8bc0 2023-10-08T06:09:39.349 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:39.340+0000 7ff53b59e700 1 -- 172.21.15.32:0/1623078696 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff53c0cb7b0 con 0x7ff53c0b8bc0 2023-10-08T06:09:39.349 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:39.340+0000 7ff532ffd700 1 -- 172.21.15.32:0/1623078696 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff52c0055a0 con 0x7ff53c0b8bc0 2023-10-08T06:09:39.349 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:39.344+0000 7ff53b59e700 1 -- 172.21.15.32:0/1623078696 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff53c0cbd70 con 0x7ff53c0b8bc0 2023-10-08T06:09:39.349 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:39.344+0000 7ff53b59e700 1 -- 172.21.15.32:0/1623078696 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff53c073f00 con 0x7ff53c0b8bc0 2023-10-08T06:09:39.350 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:39.344+0000 7ff532ffd700 1 -- 172.21.15.32:0/1623078696 <== mon.2 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7ff52c0036a0 con 0x7ff53c0b8bc0 2023-10-08T06:09:39.351 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:39.344+0000 7ff532ffd700 1 --2- 172.21.15.32:0/1623078696 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7ff51c066510 0x7ff51c0689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:39.352 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:39.348+0000 7ff532ffd700 1 -- 172.21.15.32:0/1623078696 <== mon.2 v2:172.21.15.40:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff52c083260 con 0x7ff53c0b8bc0 2023-10-08T06:09:39.352 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:39.348+0000 7ff533fff700 1 --2- 172.21.15.32:0/1623078696 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7ff51c066510 0x7ff51c0689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:39.352 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:39.348+0000 7ff533fff700 1 --2- 172.21.15.32:0/1623078696 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7ff51c066510 0x7ff51c0689d0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff53c0cad20 tx=0x7ff524007c60 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:39.363 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:39.356+0000 7ff532ffd700 1 -- 172.21.15.32:0/1623078696 <== mon.2 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7ff52c050750 con 0x7ff53c0b8bc0 2023-10-08T06:09:39.565 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:39.560+0000 7ff53b59e700 1 -- 172.21.15.32:0/1623078696 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff53c0ce220 con 0x7ff53c0b8bc0 2023-10-08T06:09:39.567 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:39.560+0000 7ff532ffd700 1 -- 172.21.15.32:0/1623078696 <== mon.2 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4907 (secure 0 0 0) 0x7ff52c053d70 con 0x7ff53c0b8bc0 2023-10-08T06:09:39.567 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:09:39.567 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6833/2405386193","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":2405386193},{"type":"v1","addr":"172.21.15.40:6833","nonce":2405386193}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4254,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6835/1810658720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6834","nonce":1810658720},{"type":"v1","addr":"172.21.15.32:6835","nonce":1810658720}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4257,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6837/2286934165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6836","nonce":2286934165},{"type":"v1","addr":"172.21.15.32:6837","nonce":2286934165}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T06:09:36.528026+0000","modified":"2023-10-08T06:09:38.533661+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4318},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4318":{"gid":4318,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.40:6835/3325966535","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":3325966535},{"type":"v1","addr":"172.21.15.40:6835","nonce":3325966535}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-08T06:09:39.569 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:39.564+0000 7ff53b59e700 1 -- 172.21.15.32:0/1623078696 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7ff51c066510 msgr2=0x7ff51c0689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:39.569 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:39.564+0000 7ff53b59e700 1 --2- 172.21.15.32:0/1623078696 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7ff51c066510 0x7ff51c0689d0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff53c0cad20 tx=0x7ff524007c60 comp rx=0 tx=0).stop 2023-10-08T06:09:39.569 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:39.564+0000 7ff53b59e700 1 -- 172.21.15.32:0/1623078696 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff53c0b8bc0 msgr2=0x7ff53c1f2980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:39.570 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:39.564+0000 7ff53b59e700 1 --2- 172.21.15.32:0/1623078696 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff53c0b8bc0 0x7ff53c1f2980 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7ff52c00c500 tx=0x7ff52c00c810 comp rx=0 tx=0).stop 2023-10-08T06:09:39.570 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:39.564+0000 7ff53b59e700 1 -- 172.21.15.32:0/1623078696 shutdown_connections 2023-10-08T06:09:39.570 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:39.564+0000 7ff53b59e700 1 --2- 172.21.15.32:0/1623078696 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7ff51c066510 0x7ff51c0689d0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:39.570 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:39.564+0000 7ff53b59e700 1 --2- 172.21.15.32:0/1623078696 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff53c15d490 0x7ff53c154f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:39.570 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:39.564+0000 7ff53b59e700 1 --2- 172.21.15.32:0/1623078696 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff53c0ce4e0 0x7ff53c160230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:39.570 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:39.564+0000 7ff53b59e700 1 --2- 172.21.15.32:0/1623078696 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff53c0b8bc0 0x7ff53c1f2980 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:39.570 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:39.564+0000 7ff53b59e700 1 -- 172.21.15.32:0/1623078696 >> 172.21.15.32:0/1623078696 conn(0x7ff53c06ab40 msgr2=0x7ff53c0cd6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:09:39.570 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:39.564+0000 7ff53b59e700 1 -- 172.21.15.32:0/1623078696 shutdown_connections 2023-10-08T06:09:39.570 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:39.564+0000 7ff53b59e700 1 -- 172.21.15.32:0/1623078696 wait complete. 2023-10-08T06:09:39.571 INFO:teuthology.orchestra.run.smithi032.stderr:dumped fsmap epoch 6 2023-10-08T06:09:39.582 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T06:09:39.699 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:39.692+0000 7f01c13b1700 1 Processor -- start 2023-10-08T06:09:39.699 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:39.692+0000 7f01c13b1700 1 -- start start 2023-10-08T06:09:39.701 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:39.696+0000 7f01c13b1700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f01bc159ed0 0x7f01bc0ca9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:39.701 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:39.696+0000 7f01c13b1700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f01bc0c98c0 0x7f01bc0cb510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:39.701 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:39.696+0000 7f01c13b1700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01bc0cca40 con 0x7f01bc15a2b0 2023-10-08T06:09:39.701 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:39.696+0000 7f01c13b1700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01bc0ccdb0 con 0x7f01bc159ed0 2023-10-08T06:09:39.701 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:39.696+0000 7f01c13b1700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01bc0caef0 con 0x7f01bc0c98c0 2023-10-08T06:09:39.701 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:39.696+0000 7f01bbfff700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f01bc159ed0 0x7f01bc0ca9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:39.702 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:39.696+0000 7f01bbfff700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f01bc159ed0 0x7f01bc0ca9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:37354/0 (socket says 172.21.15.32:37354) 2023-10-08T06:09:39.702 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:39.696+0000 7f01bbfff700 1 -- 172.21.15.32:0/928168124 learned_addr learned my addr 172.21.15.32:0/928168124 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:09:39.702 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:39.696+0000 7f01c0bb0700 1 --2- 172.21.15.32:0/928168124 >> v2:172.21.15.40:3300/0 conn(0x7f01bc0c98c0 0x7f01bc0cb510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:39.702 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:39.696+0000 7f01bbfff700 1 -- 172.21.15.32:0/928168124 >> v2:172.21.15.40:3300/0 conn(0x7f01bc0c98c0 msgr2=0x7f01bc0cb510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:09:39.702 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:39.696+0000 7f01bbfff700 1 --2- 172.21.15.32:0/928168124 >> v2:172.21.15.40:3300/0 conn(0x7f01bc0c98c0 0x7f01bc0cb510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:39.702 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:39.696+0000 7f01bbfff700 1 -- 172.21.15.32:0/928168124 >> v1:172.21.15.40:6789/0 conn(0x7f01bc15a2b0 legacy=0x7f01bc0706f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:39.702 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:39.696+0000 7f01bbfff700 1 -- 172.21.15.32:0/928168124 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01bc0cdf60 con 0x7f01bc159ed0 2023-10-08T06:09:39.702 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:39.696+0000 7f01c0bb0700 1 --2- 172.21.15.32:0/928168124 >> v2:172.21.15.40:3300/0 conn(0x7f01bc0c98c0 0x7f01bc0cb510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T06:09:39.702 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:39.696+0000 7f01bbfff700 1 --2- 172.21.15.32:0/928168124 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f01bc159ed0 0x7f01bc0ca9b0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f01bc0ae820 tx=0x7f01b0009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b468b8b9bccf5a03 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:39.702 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:39.696+0000 7f01baffd700 1 -- 172.21.15.32:0/928168124 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01b000b8a0 con 0x7f01bc159ed0 2023-10-08T06:09:39.702 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:39.696+0000 7f01baffd700 1 -- 172.21.15.32:0/928168124 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01b000ba00 con 0x7f01bc159ed0 2023-10-08T06:09:39.702 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:39.696+0000 7f01baffd700 1 -- 172.21.15.32:0/928168124 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01b000bd90 con 0x7f01bc159ed0 2023-10-08T06:09:39.703 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:39.696+0000 7f01c13b1700 1 -- 172.21.15.32:0/928168124 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f01bc159ed0 msgr2=0x7f01bc0ca9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:39.704 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:39.696+0000 7f01c13b1700 1 --2- 172.21.15.32:0/928168124 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f01bc159ed0 0x7f01bc0ca9b0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f01bc0ae820 tx=0x7f01b0009bf0 comp rx=0 tx=0).stop 2023-10-08T06:09:39.704 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:39.696+0000 7f01c13b1700 1 -- 172.21.15.32:0/928168124 shutdown_connections 2023-10-08T06:09:39.704 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:39.696+0000 7f01c13b1700 1 --2- 172.21.15.32:0/928168124 >> v2:172.21.15.40:3300/0 conn(0x7f01bc0c98c0 0x7f01bc0cb510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:39.704 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:39.696+0000 7f01c13b1700 1 --2- 172.21.15.32:0/928168124 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f01bc159ed0 0x7f01bc0ca9b0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:39.704 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:39.696+0000 7f01c13b1700 1 -- 172.21.15.32:0/928168124 >> 172.21.15.32:0/928168124 conn(0x7f01bc0b0900 msgr2=0x7f01bc0b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:09:39.704 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:39.696+0000 7f01c13b1700 1 -- 172.21.15.32:0/928168124 shutdown_connections 2023-10-08T06:09:39.704 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:39.696+0000 7f01c13b1700 1 -- 172.21.15.32:0/928168124 wait complete. 2023-10-08T06:09:39.704 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:39.696+0000 7f01c13b1700 1 Processor -- start 2023-10-08T06:09:39.704 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:39.700+0000 7f01c13b1700 1 -- start start 2023-10-08T06:09:39.706 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:39.700+0000 7f01c13b1700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f01bc0c98c0 0x7f01bc0b4260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:39.707 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:39.700+0000 7f01c13b1700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f01bc159ed0 0x7f01bc1493a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:39.707 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:39.700+0000 7f01c13b1700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f01bc15a2b0 0x7f01bc0b2010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:39.707 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:39.700+0000 7f01c13b1700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01bc0b3890 con 0x7f01bc0c98c0 2023-10-08T06:09:39.707 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:39.700+0000 7f01c13b1700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01bc1498e0 con 0x7f01bc159ed0 2023-10-08T06:09:39.707 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:39.700+0000 7f01c13b1700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01bc0b3400 con 0x7f01bc15a2b0 2023-10-08T06:09:39.707 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:39.700+0000 7f01bbfff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f01bc0c98c0 0x7f01bc0b4260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:39.707 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:39.700+0000 7f01bbfff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f01bc0c98c0 0x7f01bc0b4260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:37360/0 (socket says 172.21.15.32:37360) 2023-10-08T06:09:39.707 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:39.700+0000 7f01bbfff700 1 -- 172.21.15.32:0/1209699805 learned_addr learned my addr 172.21.15.32:0/1209699805 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:09:39.707 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:39.700+0000 7f01c0bb0700 1 --2- 172.21.15.32:0/1209699805 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f01bc15a2b0 0x7f01bc0b2010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:39.707 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:39.700+0000 7f01bb7fe700 1 --2- 172.21.15.32:0/1209699805 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f01bc159ed0 0x7f01bc1493a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:39.708 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:39.700+0000 7f01bbfff700 1 -- 172.21.15.32:0/1209699805 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f01bc15a2b0 msgr2=0x7f01bc0b2010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:39.708 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:39.700+0000 7f01bbfff700 1 --2- 172.21.15.32:0/1209699805 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f01bc15a2b0 0x7f01bc0b2010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:39.708 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:39.700+0000 7f01bbfff700 1 -- 172.21.15.32:0/1209699805 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f01bc159ed0 msgr2=0x7f01bc1493a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:39.708 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:39.700+0000 7f01bbfff700 1 --2- 172.21.15.32:0/1209699805 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f01bc159ed0 0x7f01bc1493a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:39.708 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:39.700+0000 7f01bbfff700 1 -- 172.21.15.32:0/1209699805 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01b0009570 con 0x7f01bc0c98c0 2023-10-08T06:09:39.708 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:39.700+0000 7f01bbfff700 1 --2- 172.21.15.32:0/1209699805 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f01bc0c98c0 0x7f01bc0b4260 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f01bc06b7d0 tx=0x7f01b0004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:39.708 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:39.700+0000 7f01b8ff9700 1 -- 172.21.15.32:0/1209699805 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01b00036c0 con 0x7f01bc0c98c0 2023-10-08T06:09:39.708 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:39.700+0000 7f01b8ff9700 1 -- 172.21.15.32:0/1209699805 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01b001f070 con 0x7f01bc0c98c0 2023-10-08T06:09:39.708 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:39.700+0000 7f01b8ff9700 1 -- 172.21.15.32:0/1209699805 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01b0003a80 con 0x7f01bc0c98c0 2023-10-08T06:09:39.708 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:39.700+0000 7f01c13b1700 1 -- 172.21.15.32:0/1209699805 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01bc0b2550 con 0x7f01bc0c98c0 2023-10-08T06:09:39.709 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:39.700+0000 7f01c13b1700 1 -- 172.21.15.32:0/1209699805 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01bc0b2ad0 con 0x7f01bc0c98c0 2023-10-08T06:09:39.709 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:39.704+0000 7f01c13b1700 1 -- 172.21.15.32:0/1209699805 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01bc073f00 con 0x7f01bc0c98c0 2023-10-08T06:09:39.709 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:39.704+0000 7f01b8ff9700 1 -- 172.21.15.32:0/1209699805 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f01b0021030 con 0x7f01bc0c98c0 2023-10-08T06:09:39.710 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:39.704+0000 7f01b8ff9700 1 --2- 172.21.15.32:0/1209699805 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f01a8066540 0x7f01a8068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:39.710 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:39.704+0000 7f01b8ff9700 1 -- 172.21.15.32:0/1209699805 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f01b0085520 con 0x7f01bc0c98c0 2023-10-08T06:09:39.710 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:39.704+0000 7f01bb7fe700 1 --2- 172.21.15.32:0/1209699805 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f01a8066540 0x7f01a8068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:39.710 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:39.704+0000 7f01bb7fe700 1 --2- 172.21.15.32:0/1209699805 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f01a8066540 0x7f01a8068a00 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f01bc0c54a0 tx=0x7f01ac009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:39.716 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:39.712+0000 7f01b8ff9700 1 -- 172.21.15.32:0/1209699805 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f01b0052b10 con 0x7f01bc0c98c0 2023-10-08T06:09:39.883 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:39.876+0000 7f01c13b1700 1 -- 172.21.15.32:0/1209699805 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f01bc0b4d50 con 0x7f01bc0c98c0 2023-10-08T06:09:39.886 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:39.880+0000 7f01b8ff9700 1 -- 172.21.15.32:0/1209699805 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16445 (secure 0 0 0) 0x7f01b0056130 con 0x7f01bc0c98c0 2023-10-08T06:09:39.886 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:09:39.887 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":22,"fsid":"ac672d87-96ae-41e0-9314-623ba2cdbbba","created":"2023-10-08T06:09:11.175626+0000","modified":"2023-10-08T06:09:38.153256+0000","last_up_change":"2023-10-08T06:09:22.744643+0000","last_in_change":"2023-10-08T06:09:14.131580+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T06:09:23.307843+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T06:09:34.295012+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T06:09:35.515590+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"43433f0c-9592-4874-92d7-10f8f4acf07f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":587888964},{"type":"v1","addr":"172.21.15.32:6801","nonce":587888964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":587888964},{"type":"v1","addr":"172.21.15.32:6803","nonce":587888964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":587888964},{"type":"v1","addr":"172.21.15.32:6810","nonce":587888964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6805","nonce":587888964},{"type":"v1","addr":"172.21.15.32:6807","nonce":587888964}]},"public_addr":"172.21.15.32:6801/587888964","cluster_addr":"172.21.15.32:6803/587888964","heartbeat_back_addr":"172.21.15.32:6810/587888964","heartbeat_front_addr":"172.21.15.32:6807/587888964","state":["exists","up"]},{"osd":1,"uuid":"2ecb1008-b987-4ce7-b646-6cded55fc8d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":990576767},{"type":"v1","addr":"172.21.15.32:6817","nonce":990576767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":990576767},{"type":"v1","addr":"172.21.15.32:6819","nonce":990576767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":990576767},{"type":"v1","addr":"172.21.15.32:6823","nonce":990576767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":990576767},{"type":"v1","addr":"172.21.15.32:6821","nonce":990576767}]},"public_addr":"172.21.15.32:6817/990576767","cluster_addr":"172.21.15.32:6819/990576767","heartbeat_back_addr":"172.21.15.32:6823/990576767","heartbeat_front_addr":"172.21.15.32:6821/990576767","state":["exists","up"]},{"osd":2,"uuid":"1b131c94-c09b-4e80-8746-bf1b7bac362d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6824","nonce":1566874440},{"type":"v1","addr":"172.21.15.32:6825","nonce":1566874440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":1566874440},{"type":"v1","addr":"172.21.15.32:6827","nonce":1566874440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":1566874440},{"type":"v1","addr":"172.21.15.32:6831","nonce":1566874440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":1566874440},{"type":"v1","addr":"172.21.15.32:6829","nonce":1566874440}]},"public_addr":"172.21.15.32:6825/1566874440","cluster_addr":"172.21.15.32:6827/1566874440","heartbeat_back_addr":"172.21.15.32:6831/1566874440","heartbeat_front_addr":"172.21.15.32:6829/1566874440","state":["exists","up"]},{"osd":3,"uuid":"ad655af2-1f6f-4689-b21d-b07bbaeb68b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":3672614802},{"type":"v1","addr":"172.21.15.32:6806","nonce":3672614802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6809","nonce":3672614802},{"type":"v1","addr":"172.21.15.32:6811","nonce":3672614802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":3672614802},{"type":"v1","addr":"172.21.15.32:6815","nonce":3672614802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":3672614802},{"type":"v1","addr":"172.21.15.32:6813","nonce":3672614802}]},"public_addr":"172.21.15.32:6806/3672614802","cluster_addr":"172.21.15.32:6811/3672614802","heartbeat_back_addr":"172.21.15.32:6815/3672614802","heartbeat_front_addr":"172.21.15.32:6813/3672614802","state":["exists","up"]},{"osd":4,"uuid":"64a543a1-8c4f-458e-9aba-b35c1cd7dd03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":3369928244},{"type":"v1","addr":"172.21.15.40:6801","nonce":3369928244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":3369928244},{"type":"v1","addr":"172.21.15.40:6803","nonce":3369928244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":3369928244},{"type":"v1","addr":"172.21.15.40:6807","nonce":3369928244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":3369928244},{"type":"v1","addr":"172.21.15.40:6805","nonce":3369928244}]},"public_addr":"172.21.15.40:6801/3369928244","cluster_addr":"172.21.15.40:6803/3369928244","heartbeat_back_addr":"172.21.15.40:6807/3369928244","heartbeat_front_addr":"172.21.15.40:6805/3369928244","state":["exists","up"]},{"osd":5,"uuid":"0fef3e54-edb4-4678-878e-944663c51638","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":2395850297},{"type":"v1","addr":"172.21.15.40:6825","nonce":2395850297}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":2395850297},{"type":"v1","addr":"172.21.15.40:6827","nonce":2395850297}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":2395850297},{"type":"v1","addr":"172.21.15.40:6831","nonce":2395850297}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":2395850297},{"type":"v1","addr":"172.21.15.40:6829","nonce":2395850297}]},"public_addr":"172.21.15.40:6825/2395850297","cluster_addr":"172.21.15.40:6827/2395850297","heartbeat_back_addr":"172.21.15.40:6831/2395850297","heartbeat_front_addr":"172.21.15.40:6829/2395850297","state":["exists","up"]},{"osd":6,"uuid":"2eeb0472-6096-469d-9b2c-cab4bf41c31a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":4145283410},{"type":"v1","addr":"172.21.15.40:6809","nonce":4145283410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":4145283410},{"type":"v1","addr":"172.21.15.40:6811","nonce":4145283410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":4145283410},{"type":"v1","addr":"172.21.15.40:6815","nonce":4145283410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":4145283410},{"type":"v1","addr":"172.21.15.40:6813","nonce":4145283410}]},"public_addr":"172.21.15.40:6809/4145283410","cluster_addr":"172.21.15.40:6811/4145283410","heartbeat_back_addr":"172.21.15.40:6815/4145283410","heartbeat_front_addr":"172.21.15.40:6813/4145283410","state":["exists","up"]},{"osd":7,"uuid":"cf76e4c7-96a6-401f-a280-91aad4641940","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":2943297416},{"type":"v1","addr":"172.21.15.40:6817","nonce":2943297416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":2943297416},{"type":"v1","addr":"172.21.15.40:6819","nonce":2943297416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":2943297416},{"type":"v1","addr":"172.21.15.40:6823","nonce":2943297416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":2943297416},{"type":"v1","addr":"172.21.15.40:6821","nonce":2943297416}]},"public_addr":"172.21.15.40:6817/2943297416","cluster_addr":"172.21.15.40:6819/2943297416","heartbeat_back_addr":"172.21.15.40:6823/2943297416","heartbeat_front_addr":"172.21.15.40:6821/2943297416","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.411475+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.628841+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.599055+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.166100+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.384135+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.488403+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.307648+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.363541+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T06:09:39.890 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:39.884+0000 7f01c13b1700 1 -- 172.21.15.32:0/1209699805 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f01a8066540 msgr2=0x7f01a8068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:39.890 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:39.884+0000 7f01c13b1700 1 --2- 172.21.15.32:0/1209699805 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f01a8066540 0x7f01a8068a00 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f01bc0c54a0 tx=0x7f01ac009040 comp rx=0 tx=0).stop 2023-10-08T06:09:39.890 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:39.884+0000 7f01c13b1700 1 -- 172.21.15.32:0/1209699805 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f01bc0c98c0 msgr2=0x7f01bc0b4260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:39.890 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:39.884+0000 7f01c13b1700 1 --2- 172.21.15.32:0/1209699805 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f01bc0c98c0 0x7f01bc0b4260 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f01bc06b7d0 tx=0x7f01b0004770 comp rx=0 tx=0).stop 2023-10-08T06:09:39.890 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:39.884+0000 7f01c13b1700 1 -- 172.21.15.32:0/1209699805 shutdown_connections 2023-10-08T06:09:39.891 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:39.884+0000 7f01c13b1700 1 --2- 172.21.15.32:0/1209699805 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f01a8066540 0x7f01a8068a00 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:39.891 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:39.884+0000 7f01c13b1700 1 --2- 172.21.15.32:0/1209699805 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f01bc15a2b0 0x7f01bc0b2010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:39.891 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:39.884+0000 7f01c13b1700 1 --2- 172.21.15.32:0/1209699805 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f01bc159ed0 0x7f01bc1493a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:39.891 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:39.884+0000 7f01c13b1700 1 --2- 172.21.15.32:0/1209699805 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f01bc0c98c0 0x7f01bc0b4260 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:39.891 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:39.884+0000 7f01c13b1700 1 -- 172.21.15.32:0/1209699805 >> 172.21.15.32:0/1209699805 conn(0x7f01bc0b0900 msgr2=0x7f01bc0ae870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:09:39.891 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:39.884+0000 7f01c13b1700 1 -- 172.21.15.32:0/1209699805 shutdown_connections 2023-10-08T06:09:39.891 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:39.884+0000 7f01c13b1700 1 -- 172.21.15.32:0/1209699805 wait complete. 2023-10-08T06:09:39.904 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-08T06:09:39.904 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T06:09:40.013 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.008+0000 7fb554a0d700 1 Processor -- start 2023-10-08T06:09:40.013 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.008+0000 7fb554a0d700 1 -- start start 2023-10-08T06:09:40.014 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.008+0000 7fb554a0d700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fb5500c21a0 0x7fb55006c690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:40.014 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.008+0000 7fb554a0d700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb5500cbef0 0x7fb5500cc9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:40.015 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.008+0000 7fb554a0d700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb55006c200 con 0x7fb5501652b0 2023-10-08T06:09:40.015 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.008+0000 7fb554a0d700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5501662c0 con 0x7fb5500c21a0 2023-10-08T06:09:40.015 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.008+0000 7fb554a0d700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb550165d00 con 0x7fb5500cbef0 2023-10-08T06:09:40.015 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.008+0000 7fb54e59c700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fb5501652b0 0x7fb5500cb7e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:58516/0 (socket says 172.21.15.32:58516) 2023-10-08T06:09:40.015 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.008+0000 7fb54e59c700 1 -- 172.21.15.32:0/231016921 learned_addr learned my addr 172.21.15.32:0/231016921 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-08T06:09:40.015 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.008+0000 7fb54ed9d700 1 --2- 172.21.15.32:0/231016921 >> v2:172.21.15.32:3300/0 conn(0x7fb5500c21a0 0x7fb55006c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:40.015 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.008+0000 7fb54f59e700 1 --2- 172.21.15.32:0/231016921 >> v2:172.21.15.40:3300/0 conn(0x7fb5500cbef0 0x7fb5500cc9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:40.015 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.008+0000 7fb54dd9b700 1 -- 172.21.15.32:0/231016921 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 98841765 0 0) 0x7fb55006c200 con 0x7fb5501652b0 2023-10-08T06:09:40.015 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.008+0000 7fb54dd9b700 1 -- 172.21.15.32:0/231016921 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb5380035d0 con 0x7fb5501652b0 2023-10-08T06:09:40.016 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.008+0000 7fb54dd9b700 1 -- 172.21.15.32:0/231016921 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2927890055 0 0) 0x7fb5380035d0 con 0x7fb5501652b0 2023-10-08T06:09:40.016 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.008+0000 7fb54ed9d700 1 -- 172.21.15.32:0/231016921 >> v2:172.21.15.40:3300/0 conn(0x7fb5500cbef0 msgr2=0x7fb5500cc9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:09:40.016 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.008+0000 7fb54ed9d700 1 --2- 172.21.15.32:0/231016921 >> v2:172.21.15.40:3300/0 conn(0x7fb5500cbef0 0x7fb5500cc9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:40.016 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.008+0000 7fb54ed9d700 1 -- 172.21.15.32:0/231016921 >> v1:172.21.15.32:6789/0 conn(0x7fb5501652b0 legacy=0x7fb5500cb7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:40.017 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.008+0000 7fb54ed9d700 1 -- 172.21.15.32:0/231016921 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb550165fe0 con 0x7fb5500c21a0 2023-10-08T06:09:40.017 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.012+0000 7fb54ed9d700 1 --2- 172.21.15.32:0/231016921 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb5500c21a0 0x7fb55006c690 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fb544009850 tx=0x7fb544009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=872faa6b77fe9bc9 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:40.017 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.012+0000 7fb54dd9b700 1 -- 172.21.15.32:0/231016921 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb540001670 con 0x7fb5500c21a0 2023-10-08T06:09:40.017 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.012+0000 7fb54dd9b700 1 -- 172.21.15.32:0/231016921 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb544004030 con 0x7fb5500c21a0 2023-10-08T06:09:40.017 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.012+0000 7fb54dd9b700 1 -- 172.21.15.32:0/231016921 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5440043c0 con 0x7fb5500c21a0 2023-10-08T06:09:40.018 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.012+0000 7fb554a0d700 1 -- 172.21.15.32:0/231016921 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb5500c21a0 msgr2=0x7fb55006c690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:40.018 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.012+0000 7fb554a0d700 1 --2- 172.21.15.32:0/231016921 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb5500c21a0 0x7fb55006c690 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fb544009850 tx=0x7fb544009b60 comp rx=0 tx=0).stop 2023-10-08T06:09:40.018 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.012+0000 7fb554a0d700 1 -- 172.21.15.32:0/231016921 shutdown_connections 2023-10-08T06:09:40.018 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.012+0000 7fb554a0d700 1 --2- 172.21.15.32:0/231016921 >> v2:172.21.15.40:3300/0 conn(0x7fb5500cbef0 0x7fb5500cc9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:40.018 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.012+0000 7fb554a0d700 1 --2- 172.21.15.32:0/231016921 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb5500c21a0 0x7fb55006c690 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:40.018 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.012+0000 7fb554a0d700 1 -- 172.21.15.32:0/231016921 >> 172.21.15.32:0/231016921 conn(0x7fb5500b0900 msgr2=0x7fb5500b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:09:40.018 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.012+0000 7fb554a0d700 1 -- 172.21.15.32:0/231016921 shutdown_connections 2023-10-08T06:09:40.018 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.012+0000 7fb554a0d700 1 -- 172.21.15.32:0/231016921 wait complete. 2023-10-08T06:09:40.020 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.016+0000 7fb554a0d700 1 Processor -- start 2023-10-08T06:09:40.020 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.016+0000 7fb554a0d700 1 -- start start 2023-10-08T06:09:40.021 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.016+0000 7fb554a0d700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb5500c21a0 0x7fb5500afb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:40.021 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.016+0000 7fb554a0d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb5500cbef0 0x7fb55014edd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:40.021 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.016+0000 7fb554a0d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb5501652b0 0x7fb55014f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:40.021 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.016+0000 7fb554a0d700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5500c6700 con 0x7fb5500c21a0 2023-10-08T06:09:40.021 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.016+0000 7fb554a0d700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb55014f850 con 0x7fb5500cbef0 2023-10-08T06:09:40.021 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.016+0000 7fb554a0d700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb550163b30 con 0x7fb5501652b0 2023-10-08T06:09:40.021 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.016+0000 7fb54ed9d700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb5500c21a0 0x7fb5500afb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:40.021 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.016+0000 7fb54ed9d700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb5500c21a0 0x7fb5500afb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:37374/0 (socket says 172.21.15.32:37374) 2023-10-08T06:09:40.021 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.016+0000 7fb54ed9d700 1 -- 172.21.15.32:0/1570027160 learned_addr learned my addr 172.21.15.32:0/1570027160 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:09:40.023 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.016+0000 7fb54f59e700 1 --2- 172.21.15.32:0/1570027160 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb5501652b0 0x7fb55014f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:40.023 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.016+0000 7fb54e59c700 1 --2- 172.21.15.32:0/1570027160 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb5500cbef0 0x7fb55014edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:40.023 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.016+0000 7fb54ed9d700 1 -- 172.21.15.32:0/1570027160 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb5501652b0 msgr2=0x7fb55014f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:40.023 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.016+0000 7fb54ed9d700 1 --2- 172.21.15.32:0/1570027160 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb5501652b0 0x7fb55014f310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:40.023 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.016+0000 7fb54ed9d700 1 -- 172.21.15.32:0/1570027160 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb5500cbef0 msgr2=0x7fb55014edd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:40.023 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.016+0000 7fb54ed9d700 1 --2- 172.21.15.32:0/1570027160 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb5500cbef0 0x7fb55014edd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:40.023 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.016+0000 7fb54ed9d700 1 -- 172.21.15.32:0/1570027160 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5440094b0 con 0x7fb5500c21a0 2023-10-08T06:09:40.023 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.016+0000 7fb54e59c700 1 --2- 172.21.15.32:0/1570027160 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb5500cbef0 0x7fb55014edd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T06:09:40.023 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.016+0000 7fb54ed9d700 1 --2- 172.21.15.32:0/1570027160 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb5500c21a0 0x7fb5500afb90 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fb544009eb0 tx=0x7fb544004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:40.023 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.016+0000 7fb5377fe700 1 -- 172.21.15.32:0/1570027160 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb544006ea0 con 0x7fb5500c21a0 2023-10-08T06:09:40.024 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.016+0000 7fb5377fe700 1 -- 172.21.15.32:0/1570027160 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb54401f070 con 0x7fb5500c21a0 2023-10-08T06:09:40.024 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.016+0000 7fb554a0d700 1 -- 172.21.15.32:0/1570027160 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5500c6040 con 0x7fb5500c21a0 2023-10-08T06:09:40.024 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.016+0000 7fb5377fe700 1 -- 172.21.15.32:0/1570027160 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb544011870 con 0x7fb5500c21a0 2023-10-08T06:09:40.024 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.016+0000 7fb554a0d700 1 -- 172.21.15.32:0/1570027160 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5500b00d0 con 0x7fb5500c21a0 2023-10-08T06:09:40.024 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.016+0000 7fb554a0d700 1 -- 172.21.15.32:0/1570027160 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5500c5e80 con 0x7fb5500c21a0 2023-10-08T06:09:40.025 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.020+0000 7fb5377fe700 1 -- 172.21.15.32:0/1570027160 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fb544021030 con 0x7fb5500c21a0 2023-10-08T06:09:40.025 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.020+0000 7fb5377fe700 1 --2- 172.21.15.32:0/1570027160 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fb53c066510 0x7fb53c0689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:40.025 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.020+0000 7fb5377fe700 1 -- 172.21.15.32:0/1570027160 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb5440857d0 con 0x7fb5500c21a0 2023-10-08T06:09:40.025 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.020+0000 7fb54e59c700 1 --2- 172.21.15.32:0/1570027160 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fb53c066510 0x7fb53c0689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:40.025 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.020+0000 7fb54e59c700 1 --2- 172.21.15.32:0/1570027160 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fb53c066510 0x7fb53c0689d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fb5500c5350 tx=0x7fb540009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:40.030 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.024+0000 7fb5377fe700 1 -- 172.21.15.32:0/1570027160 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fb544052e00 con 0x7fb5500c21a0 2023-10-08T06:09:40.189 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.184+0000 7fb554a0d700 1 -- 172.21.15.32:0/1570027160 --> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb55006cbd0 con 0x7fb53c066510 2023-10-08T06:09:40.205 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.200+0000 7fb5377fe700 1 -- 172.21.15.32:0/1570027160 <== mgr.4107 v2:172.21.15.32:6832/2601628338 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264591 (secure 0 0 0) 0x7fb540007e40 con 0x7fb53c066510 2023-10-08T06:09:40.208 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:09:40.210 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.204+0000 7fb554a0d700 1 -- 172.21.15.32:0/1570027160 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fb53c066510 msgr2=0x7fb53c0689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:40.210 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.204+0000 7fb554a0d700 1 --2- 172.21.15.32:0/1570027160 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fb53c066510 0x7fb53c0689d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fb5500c5350 tx=0x7fb540009040 comp rx=0 tx=0).stop 2023-10-08T06:09:40.210 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.204+0000 7fb554a0d700 1 -- 172.21.15.32:0/1570027160 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb5500c21a0 msgr2=0x7fb5500afb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:40.210 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.204+0000 7fb554a0d700 1 --2- 172.21.15.32:0/1570027160 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb5500c21a0 0x7fb5500afb90 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fb544009eb0 tx=0x7fb544004770 comp rx=0 tx=0).stop 2023-10-08T06:09:40.211 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.204+0000 7fb554a0d700 1 -- 172.21.15.32:0/1570027160 shutdown_connections 2023-10-08T06:09:40.211 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.204+0000 7fb554a0d700 1 --2- 172.21.15.32:0/1570027160 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fb53c066510 0x7fb53c0689d0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:40.211 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.204+0000 7fb554a0d700 1 --2- 172.21.15.32:0/1570027160 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb5501652b0 0x7fb55014f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:40.211 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.204+0000 7fb554a0d700 1 --2- 172.21.15.32:0/1570027160 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb5500cbef0 0x7fb55014edd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:40.211 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.204+0000 7fb554a0d700 1 --2- 172.21.15.32:0/1570027160 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb5500c21a0 0x7fb5500afb90 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:40.211 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.204+0000 7fb554a0d700 1 -- 172.21.15.32:0/1570027160 >> 172.21.15.32:0/1570027160 conn(0x7fb5500b0900 msgr2=0x7fb5500ae770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:09:40.211 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.204+0000 7fb554a0d700 1 -- 172.21.15.32:0/1570027160 shutdown_connections 2023-10-08T06:09:40.211 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.204+0000 7fb554a0d700 1 -- 172.21.15.32:0/1570027160 wait complete. 2023-10-08T06:09:40.212 INFO:teuthology.orchestra.run.smithi032.stderr:dumped all 2023-10-08T06:09:40.223 INFO:teuthology.orchestra.run.smithi032.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-10-08T06:09:39.248909+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":47,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235684,"kb_used_data":2868,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754739036,"statfs":{"total":773094113280,"available":772852772864,"internally_reserved":0,"allocated":2936832,"data_stored":1751376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":238276153},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":40,"apply_latency_ms":40,"commit_latency_ns":40000000,"apply_latency_ns":40000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.109530"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.166128+0000","last_change":"2023-10-08T06:09:37.189119+0000","last_active":"2023-10-08T06:09:38.166128+0000","last_peered":"2023-10-08T06:09:38.166128+0000","last_clean":"2023-10-08T06:09:38.166128+0000","last_became_active":"2023-10-08T06:09:37.188327+0000","last_became_peered":"2023-10-08T06:09:37.188327+0000","last_unstale":"2023-10-08T06:09:38.166128+0000","last_undegraded":"2023-10-08T06:09:38.166128+0000","last_fullsized":"2023-10-08T06:09:38.166128+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:24:28.854916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.162226+0000","last_change":"2023-10-08T06:09:37.187273+0000","last_active":"2023-10-08T06:09:38.162226+0000","last_peered":"2023-10-08T06:09:38.162226+0000","last_clean":"2023-10-08T06:09:38.162226+0000","last_became_active":"2023-10-08T06:09:37.187002+0000","last_became_peered":"2023-10-08T06:09:37.187002+0000","last_unstale":"2023-10-08T06:09:38.162226+0000","last_undegraded":"2023-10-08T06:09:38.162226+0000","last_fullsized":"2023-10-08T06:09:38.162226+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:49:17.057808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-08T06:09:37.195337+0000","last_change":"2023-10-08T06:09:37.189008+0000","last_active":"2023-10-08T06:09:37.195337+0000","last_peered":"2023-10-08T06:09:37.195337+0000","last_clean":"2023-10-08T06:09:37.195337+0000","last_became_active":"2023-10-08T06:09:37.188668+0000","last_became_peered":"2023-10-08T06:09:37.188668+0000","last_unstale":"2023-10-08T06:09:37.195337+0000","last_undegraded":"2023-10-08T06:09:37.195337+0000","last_fullsized":"2023-10-08T06:09:37.195337+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:38:59.919098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.166462+0000","last_change":"2023-10-08T06:09:37.187681+0000","last_active":"2023-10-08T06:09:38.166462+0000","last_peered":"2023-10-08T06:09:38.166462+0000","last_clean":"2023-10-08T06:09:38.166462+0000","last_became_active":"2023-10-08T06:09:37.186052+0000","last_became_peered":"2023-10-08T06:09:37.186052+0000","last_unstale":"2023-10-08T06:09:38.166462+0000","last_undegraded":"2023-10-08T06:09:38.166462+0000","last_fullsized":"2023-10-08T06:09:38.166462+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:04:32.307233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.164796+0000","last_change":"2023-10-08T06:09:37.184596+0000","last_active":"2023-10-08T06:09:38.164796+0000","last_peered":"2023-10-08T06:09:38.164796+0000","last_clean":"2023-10-08T06:09:38.164796+0000","last_became_active":"2023-10-08T06:09:37.184317+0000","last_became_peered":"2023-10-08T06:09:37.184317+0000","last_unstale":"2023-10-08T06:09:38.164796+0000","last_undegraded":"2023-10-08T06:09:38.164796+0000","last_fullsized":"2023-10-08T06:09:38.164796+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:06:27.727341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.164499+0000","last_change":"2023-10-08T06:09:37.189924+0000","last_active":"2023-10-08T06:09:38.164499+0000","last_peered":"2023-10-08T06:09:38.164499+0000","last_clean":"2023-10-08T06:09:38.164499+0000","last_became_active":"2023-10-08T06:09:37.188282+0000","last_became_peered":"2023-10-08T06:09:37.188282+0000","last_unstale":"2023-10-08T06:09:38.164499+0000","last_undegraded":"2023-10-08T06:09:38.164499+0000","last_fullsized":"2023-10-08T06:09:38.164499+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:37:42.540248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.164130+0000","last_change":"2023-10-08T06:09:37.187514+0000","last_active":"2023-10-08T06:09:38.164130+0000","last_peered":"2023-10-08T06:09:38.164130+0000","last_clean":"2023-10-08T06:09:38.164130+0000","last_became_active":"2023-10-08T06:09:37.187122+0000","last_became_peered":"2023-10-08T06:09:37.187122+0000","last_unstale":"2023-10-08T06:09:38.164130+0000","last_undegraded":"2023-10-08T06:09:38.164130+0000","last_fullsized":"2023-10-08T06:09:38.164130+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:49:58.972598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-08T06:09:37.195931+0000","last_change":"2023-10-08T06:09:37.186725+0000","last_active":"2023-10-08T06:09:37.195931+0000","last_peered":"2023-10-08T06:09:37.195931+0000","last_clean":"2023-10-08T06:09:37.195931+0000","last_became_active":"2023-10-08T06:09:37.186416+0000","last_became_peered":"2023-10-08T06:09:37.186416+0000","last_unstale":"2023-10-08T06:09:37.195931+0000","last_undegraded":"2023-10-08T06:09:37.195931+0000","last_fullsized":"2023-10-08T06:09:37.195931+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:37:33.898985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.166298+0000","last_change":"2023-10-08T06:09:37.196289+0000","last_active":"2023-10-08T06:09:38.166298+0000","last_peered":"2023-10-08T06:09:38.166298+0000","last_clean":"2023-10-08T06:09:38.166298+0000","last_became_active":"2023-10-08T06:09:37.196029+0000","last_became_peered":"2023-10-08T06:09:37.196029+0000","last_unstale":"2023-10-08T06:09:38.166298+0000","last_undegraded":"2023-10-08T06:09:38.166298+0000","last_fullsized":"2023-10-08T06:09:38.166298+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:58:21.359302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.259158+0000","last_change":"2023-10-08T06:09:37.192494+0000","last_active":"2023-10-08T06:09:38.259158+0000","last_peered":"2023-10-08T06:09:38.259158+0000","last_clean":"2023-10-08T06:09:38.259158+0000","last_became_active":"2023-10-08T06:09:37.192219+0000","last_became_peered":"2023-10-08T06:09:37.192219+0000","last_unstale":"2023-10-08T06:09:38.259158+0000","last_undegraded":"2023-10-08T06:09:38.259158+0000","last_fullsized":"2023-10-08T06:09:38.259158+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:21:38.351456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.258945+0000","last_change":"2023-10-08T06:09:37.191422+0000","last_active":"2023-10-08T06:09:38.258945+0000","last_peered":"2023-10-08T06:09:38.258945+0000","last_clean":"2023-10-08T06:09:38.258945+0000","last_became_active":"2023-10-08T06:09:37.191135+0000","last_became_peered":"2023-10-08T06:09:37.191135+0000","last_unstale":"2023-10-08T06:09:38.258945+0000","last_undegraded":"2023-10-08T06:09:38.258945+0000","last_fullsized":"2023-10-08T06:09:38.258945+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:49:17.057808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-08T06:09:37.190865+0000","last_change":"2023-10-08T06:09:37.180493+0000","last_active":"2023-10-08T06:09:37.190865+0000","last_peered":"2023-10-08T06:09:37.190865+0000","last_clean":"2023-10-08T06:09:37.190865+0000","last_became_active":"2023-10-08T06:09:37.180194+0000","last_became_peered":"2023-10-08T06:09:37.180194+0000","last_unstale":"2023-10-08T06:09:37.190865+0000","last_undegraded":"2023-10-08T06:09:37.190865+0000","last_fullsized":"2023-10-08T06:09:37.190865+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:11:11.824362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-08T06:09:37.190285+0000","last_change":"2023-10-08T06:09:37.182805+0000","last_active":"2023-10-08T06:09:37.190285+0000","last_peered":"2023-10-08T06:09:37.190285+0000","last_clean":"2023-10-08T06:09:37.190285+0000","last_became_active":"2023-10-08T06:09:37.182511+0000","last_became_peered":"2023-10-08T06:09:37.182511+0000","last_unstale":"2023-10-08T06:09:37.190285+0000","last_undegraded":"2023-10-08T06:09:37.190285+0000","last_fullsized":"2023-10-08T06:09:37.190285+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:23:18.544057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-08T06:09:37.189200+0000","last_change":"2023-10-08T06:09:37.184291+0000","last_active":"2023-10-08T06:09:37.189200+0000","last_peered":"2023-10-08T06:09:37.189200+0000","last_clean":"2023-10-08T06:09:37.189200+0000","last_became_active":"2023-10-08T06:09:37.183944+0000","last_became_peered":"2023-10-08T06:09:37.183944+0000","last_unstale":"2023-10-08T06:09:37.189200+0000","last_undegraded":"2023-10-08T06:09:37.189200+0000","last_fullsized":"2023-10-08T06:09:37.189200+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:03:25.190681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.161692+0000","last_change":"2023-10-08T06:09:37.173135+0000","last_active":"2023-10-08T06:09:38.161692+0000","last_peered":"2023-10-08T06:09:38.161692+0000","last_clean":"2023-10-08T06:09:38.161692+0000","last_became_active":"2023-10-08T06:09:37.172786+0000","last_became_peered":"2023-10-08T06:09:37.172786+0000","last_unstale":"2023-10-08T06:09:38.161692+0000","last_undegraded":"2023-10-08T06:09:38.161692+0000","last_fullsized":"2023-10-08T06:09:38.161692+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:34:24.217470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.163600+0000","last_change":"2023-10-08T06:09:37.190091+0000","last_active":"2023-10-08T06:09:38.163600+0000","last_peered":"2023-10-08T06:09:38.163600+0000","last_clean":"2023-10-08T06:09:38.163600+0000","last_became_active":"2023-10-08T06:09:37.188278+0000","last_became_peered":"2023-10-08T06:09:37.188278+0000","last_unstale":"2023-10-08T06:09:38.163600+0000","last_undegraded":"2023-10-08T06:09:38.163600+0000","last_fullsized":"2023-10-08T06:09:38.163600+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:21:38.351456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.166514+0000","last_change":"2023-10-08T06:09:37.188196+0000","last_active":"2023-10-08T06:09:38.166514+0000","last_peered":"2023-10-08T06:09:38.166514+0000","last_clean":"2023-10-08T06:09:38.166514+0000","last_became_active":"2023-10-08T06:09:37.187906+0000","last_became_peered":"2023-10-08T06:09:37.187906+0000","last_unstale":"2023-10-08T06:09:38.166514+0000","last_undegraded":"2023-10-08T06:09:38.166514+0000","last_fullsized":"2023-10-08T06:09:38.166514+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:24:28.854916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-08T06:09:37.191536+0000","last_change":"2023-10-08T06:09:37.185222+0000","last_active":"2023-10-08T06:09:37.191536+0000","last_peered":"2023-10-08T06:09:37.191536+0000","last_clean":"2023-10-08T06:09:37.191536+0000","last_became_active":"2023-10-08T06:09:37.184040+0000","last_became_peered":"2023-10-08T06:09:37.184040+0000","last_unstale":"2023-10-08T06:09:37.191536+0000","last_undegraded":"2023-10-08T06:09:37.191536+0000","last_fullsized":"2023-10-08T06:09:37.191536+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:03:25.190681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.165574+0000","last_change":"2023-10-08T06:09:37.189503+0000","last_active":"2023-10-08T06:09:38.165574+0000","last_peered":"2023-10-08T06:09:38.165574+0000","last_clean":"2023-10-08T06:09:38.165574+0000","last_became_active":"2023-10-08T06:09:37.189210+0000","last_became_peered":"2023-10-08T06:09:37.189210+0000","last_unstale":"2023-10-08T06:09:38.165574+0000","last_undegraded":"2023-10-08T06:09:38.165574+0000","last_fullsized":"2023-10-08T06:09:38.165574+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:04:33.773359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.259261+0000","last_change":"2023-10-08T06:09:37.190736+0000","last_active":"2023-10-08T06:09:38.259261+0000","last_peered":"2023-10-08T06:09:38.259261+0000","last_clean":"2023-10-08T06:09:38.259261+0000","last_became_active":"2023-10-08T06:09:37.190034+0000","last_became_peered":"2023-10-08T06:09:37.190034+0000","last_unstale":"2023-10-08T06:09:38.259261+0000","last_undegraded":"2023-10-08T06:09:38.259261+0000","last_fullsized":"2023-10-08T06:09:38.259261+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:34:25.213819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-08T06:09:37.195503+0000","last_change":"2023-10-08T06:09:37.189807+0000","last_active":"2023-10-08T06:09:37.195503+0000","last_peered":"2023-10-08T06:09:37.195503+0000","last_clean":"2023-10-08T06:09:37.195503+0000","last_became_active":"2023-10-08T06:09:37.189522+0000","last_became_peered":"2023-10-08T06:09:37.189522+0000","last_unstale":"2023-10-08T06:09:37.195503+0000","last_undegraded":"2023-10-08T06:09:37.195503+0000","last_fullsized":"2023-10-08T06:09:37.195503+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:05:09.836876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.164808+0000","last_change":"2023-10-08T06:09:37.187974+0000","last_active":"2023-10-08T06:09:38.164808+0000","last_peered":"2023-10-08T06:09:38.164808+0000","last_clean":"2023-10-08T06:09:38.164808+0000","last_became_active":"2023-10-08T06:09:37.187664+0000","last_became_peered":"2023-10-08T06:09:37.187664+0000","last_unstale":"2023-10-08T06:09:38.164808+0000","last_undegraded":"2023-10-08T06:09:38.164808+0000","last_fullsized":"2023-10-08T06:09:38.164808+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:18:15.487038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-08T06:09:37.197811+0000","last_change":"2023-10-08T06:09:37.190236+0000","last_active":"2023-10-08T06:09:37.197811+0000","last_peered":"2023-10-08T06:09:37.197811+0000","last_clean":"2023-10-08T06:09:37.197811+0000","last_became_active":"2023-10-08T06:09:37.187376+0000","last_became_peered":"2023-10-08T06:09:37.187376+0000","last_unstale":"2023-10-08T06:09:37.197811+0000","last_undegraded":"2023-10-08T06:09:37.197811+0000","last_fullsized":"2023-10-08T06:09:37.197811+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:35:59.443164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.164217+0000","last_change":"2023-10-08T06:09:37.187245+0000","last_active":"2023-10-08T06:09:38.164217+0000","last_peered":"2023-10-08T06:09:38.164217+0000","last_clean":"2023-10-08T06:09:38.164217+0000","last_became_active":"2023-10-08T06:09:37.182394+0000","last_became_peered":"2023-10-08T06:09:37.182394+0000","last_unstale":"2023-10-08T06:09:38.164217+0000","last_undegraded":"2023-10-08T06:09:38.164217+0000","last_fullsized":"2023-10-08T06:09:38.164217+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:34:25.213819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-08T06:09:37.197837+0000","last_change":"2023-10-08T06:09:37.190400+0000","last_active":"2023-10-08T06:09:37.197837+0000","last_peered":"2023-10-08T06:09:37.197837+0000","last_clean":"2023-10-08T06:09:37.197837+0000","last_became_active":"2023-10-08T06:09:37.187332+0000","last_became_peered":"2023-10-08T06:09:37.187332+0000","last_unstale":"2023-10-08T06:09:37.197837+0000","last_undegraded":"2023-10-08T06:09:37.197837+0000","last_fullsized":"2023-10-08T06:09:37.197837+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:17:31.653860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.259322+0000","last_change":"2023-10-08T06:09:37.189247+0000","last_active":"2023-10-08T06:09:38.259322+0000","last_peered":"2023-10-08T06:09:38.259322+0000","last_clean":"2023-10-08T06:09:38.259322+0000","last_became_active":"2023-10-08T06:09:37.188933+0000","last_became_peered":"2023-10-08T06:09:37.188933+0000","last_unstale":"2023-10-08T06:09:38.259322+0000","last_undegraded":"2023-10-08T06:09:38.259322+0000","last_fullsized":"2023-10-08T06:09:38.259322+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:37:42.540248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.162400+0000","last_change":"2023-10-08T06:09:37.182750+0000","last_active":"2023-10-08T06:09:38.162400+0000","last_peered":"2023-10-08T06:09:38.162400+0000","last_clean":"2023-10-08T06:09:38.162400+0000","last_became_active":"2023-10-08T06:09:37.182459+0000","last_became_peered":"2023-10-08T06:09:37.182459+0000","last_unstale":"2023-10-08T06:09:38.162400+0000","last_undegraded":"2023-10-08T06:09:38.162400+0000","last_fullsized":"2023-10-08T06:09:38.162400+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:34:25.213819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-08T06:09:37.197857+0000","last_change":"2023-10-08T06:09:37.190585+0000","last_active":"2023-10-08T06:09:37.197857+0000","last_peered":"2023-10-08T06:09:37.197857+0000","last_clean":"2023-10-08T06:09:37.197857+0000","last_became_active":"2023-10-08T06:09:37.190040+0000","last_became_peered":"2023-10-08T06:09:37.190040+0000","last_unstale":"2023-10-08T06:09:37.197857+0000","last_undegraded":"2023-10-08T06:09:37.197857+0000","last_fullsized":"2023-10-08T06:09:37.197857+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:32:07.663697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-08T06:09:37.197077+0000","last_change":"2023-10-08T06:09:37.195008+0000","last_active":"2023-10-08T06:09:37.197077+0000","last_peered":"2023-10-08T06:09:37.197077+0000","last_clean":"2023-10-08T06:09:37.197077+0000","last_became_active":"2023-10-08T06:09:37.191672+0000","last_became_peered":"2023-10-08T06:09:37.191672+0000","last_unstale":"2023-10-08T06:09:37.197077+0000","last_undegraded":"2023-10-08T06:09:37.197077+0000","last_fullsized":"2023-10-08T06:09:37.197077+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:17:12.495543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.165134+0000","last_change":"2023-10-08T06:09:37.182779+0000","last_active":"2023-10-08T06:09:38.165134+0000","last_peered":"2023-10-08T06:09:38.165134+0000","last_clean":"2023-10-08T06:09:38.165134+0000","last_became_active":"2023-10-08T06:09:37.182402+0000","last_became_peered":"2023-10-08T06:09:37.182402+0000","last_unstale":"2023-10-08T06:09:38.165134+0000","last_undegraded":"2023-10-08T06:09:38.165134+0000","last_fullsized":"2023-10-08T06:09:38.165134+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:49:58.972598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-08T06:09:37.192301+0000","last_change":"2023-10-08T06:09:37.186117+0000","last_active":"2023-10-08T06:09:37.192301+0000","last_peered":"2023-10-08T06:09:37.192301+0000","last_clean":"2023-10-08T06:09:37.192301+0000","last_became_active":"2023-10-08T06:09:37.185159+0000","last_became_peered":"2023-10-08T06:09:37.185159+0000","last_unstale":"2023-10-08T06:09:37.192301+0000","last_undegraded":"2023-10-08T06:09:37.192301+0000","last_fullsized":"2023-10-08T06:09:37.192301+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:38:59.919098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.258513+0000","last_change":"2023-10-08T06:09:37.187121+0000","last_active":"2023-10-08T06:09:38.258513+0000","last_peered":"2023-10-08T06:09:38.258513+0000","last_clean":"2023-10-08T06:09:38.258513+0000","last_became_active":"2023-10-08T06:09:37.186834+0000","last_became_peered":"2023-10-08T06:09:37.186834+0000","last_unstale":"2023-10-08T06:09:38.258513+0000","last_undegraded":"2023-10-08T06:09:38.258513+0000","last_fullsized":"2023-10-08T06:09:38.258513+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:22:50.644480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-08T06:09:37.170397+0000","last_change":"2023-10-08T06:09:37.166163+0000","last_active":"2023-10-08T06:09:37.170397+0000","last_peered":"2023-10-08T06:09:37.170397+0000","last_clean":"2023-10-08T06:09:37.170397+0000","last_became_active":"2023-10-08T06:09:37.165819+0000","last_became_peered":"2023-10-08T06:09:37.165819+0000","last_unstale":"2023-10-08T06:09:37.170397+0000","last_undegraded":"2023-10-08T06:09:37.170397+0000","last_fullsized":"2023-10-08T06:09:37.170397+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:07:10.060832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-08T06:09:37.191195+0000","last_change":"2023-10-08T06:09:36.171417+0000","last_active":"2023-10-08T06:09:37.191195+0000","last_peered":"2023-10-08T06:09:37.191195+0000","last_clean":"2023-10-08T06:09:37.191195+0000","last_became_active":"2023-10-08T06:09:36.171084+0000","last_became_peered":"2023-10-08T06:09:36.171084+0000","last_unstale":"2023-10-08T06:09:37.191195+0000","last_undegraded":"2023-10-08T06:09:37.191195+0000","last_fullsized":"2023-10-08T06:09:37.191195+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_clean_scrub_stamp":"2023-10-08T06:09:35.125722+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:27:31.423500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-08T06:09:37.197308+0000","last_change":"2023-10-08T06:09:37.195690+0000","last_active":"2023-10-08T06:09:37.197308+0000","last_peered":"2023-10-08T06:09:37.197308+0000","last_clean":"2023-10-08T06:09:37.197308+0000","last_became_active":"2023-10-08T06:09:37.195446+0000","last_became_peered":"2023-10-08T06:09:37.195446+0000","last_unstale":"2023-10-08T06:09:37.197308+0000","last_undegraded":"2023-10-08T06:09:37.197308+0000","last_fullsized":"2023-10-08T06:09:37.197308+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:20:00.822966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.258516+0000","last_change":"2023-10-08T06:09:36.177551+0000","last_active":"2023-10-08T06:09:38.258516+0000","last_peered":"2023-10-08T06:09:38.258516+0000","last_clean":"2023-10-08T06:09:38.258516+0000","last_became_active":"2023-10-08T06:09:36.176999+0000","last_became_peered":"2023-10-08T06:09:36.176999+0000","last_unstale":"2023-10-08T06:09:38.258516+0000","last_undegraded":"2023-10-08T06:09:38.258516+0000","last_fullsized":"2023-10-08T06:09:38.258516+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_clean_scrub_stamp":"2023-10-08T06:09:35.125722+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:05:49.733090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-08T06:09:37.172190+0000","last_change":"2023-10-08T06:09:36.185251+0000","last_active":"2023-10-08T06:09:37.172190+0000","last_peered":"2023-10-08T06:09:37.172190+0000","last_clean":"2023-10-08T06:09:37.172190+0000","last_became_active":"2023-10-08T06:09:36.185009+0000","last_became_peered":"2023-10-08T06:09:36.185009+0000","last_unstale":"2023-10-08T06:09:37.172190+0000","last_undegraded":"2023-10-08T06:09:37.172190+0000","last_fullsized":"2023-10-08T06:09:37.172190+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_clean_scrub_stamp":"2023-10-08T06:09:35.125722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:23:55.526790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-08T06:09:37.195713+0000","last_change":"2023-10-08T06:09:37.185750+0000","last_active":"2023-10-08T06:09:37.195713+0000","last_peered":"2023-10-08T06:09:37.195713+0000","last_clean":"2023-10-08T06:09:37.195713+0000","last_became_active":"2023-10-08T06:09:37.185376+0000","last_became_peered":"2023-10-08T06:09:37.185376+0000","last_unstale":"2023-10-08T06:09:37.195713+0000","last_undegraded":"2023-10-08T06:09:37.195713+0000","last_fullsized":"2023-10-08T06:09:37.195713+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:55:27.159548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.164429+0000","last_change":"2023-10-08T06:09:36.176796+0000","last_active":"2023-10-08T06:09:38.164429+0000","last_peered":"2023-10-08T06:09:38.164429+0000","last_clean":"2023-10-08T06:09:38.164429+0000","last_became_active":"2023-10-08T06:09:36.176522+0000","last_became_peered":"2023-10-08T06:09:36.176522+0000","last_unstale":"2023-10-08T06:09:38.164429+0000","last_undegraded":"2023-10-08T06:09:38.164429+0000","last_fullsized":"2023-10-08T06:09:38.164429+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_clean_scrub_stamp":"2023-10-08T06:09:35.125722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:05:08.823966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.161590+0000","last_change":"2023-10-08T06:09:37.179556+0000","last_active":"2023-10-08T06:09:38.161590+0000","last_peered":"2023-10-08T06:09:38.161590+0000","last_clean":"2023-10-08T06:09:38.161590+0000","last_became_active":"2023-10-08T06:09:37.179272+0000","last_became_peered":"2023-10-08T06:09:37.179272+0000","last_unstale":"2023-10-08T06:09:38.161590+0000","last_undegraded":"2023-10-08T06:09:38.161590+0000","last_fullsized":"2023-10-08T06:09:38.161590+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:56:29.982869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.258906+0000","last_change":"2023-10-08T06:09:36.177352+0000","last_active":"2023-10-08T06:09:38.258906+0000","last_peered":"2023-10-08T06:09:38.258906+0000","last_clean":"2023-10-08T06:09:38.258906+0000","last_became_active":"2023-10-08T06:09:36.176974+0000","last_became_peered":"2023-10-08T06:09:36.176974+0000","last_unstale":"2023-10-08T06:09:38.258906+0000","last_undegraded":"2023-10-08T06:09:38.258906+0000","last_fullsized":"2023-10-08T06:09:38.258906+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_clean_scrub_stamp":"2023-10-08T06:09:35.125722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:23:11.727351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.166180+0000","last_change":"2023-10-08T06:09:37.186798+0000","last_active":"2023-10-08T06:09:38.166180+0000","last_peered":"2023-10-08T06:09:38.166180+0000","last_clean":"2023-10-08T06:09:38.166180+0000","last_became_active":"2023-10-08T06:09:37.186528+0000","last_became_peered":"2023-10-08T06:09:37.186528+0000","last_unstale":"2023-10-08T06:09:38.166180+0000","last_undegraded":"2023-10-08T06:09:38.166180+0000","last_fullsized":"2023-10-08T06:09:38.166180+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:04:33.773359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.166293+0000","last_change":"2023-10-08T06:09:36.177563+0000","last_active":"2023-10-08T06:09:38.166293+0000","last_peered":"2023-10-08T06:09:38.166293+0000","last_clean":"2023-10-08T06:09:38.166293+0000","last_became_active":"2023-10-08T06:09:36.177299+0000","last_became_peered":"2023-10-08T06:09:36.177299+0000","last_unstale":"2023-10-08T06:09:38.166293+0000","last_undegraded":"2023-10-08T06:09:38.166293+0000","last_fullsized":"2023-10-08T06:09:38.166293+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_clean_scrub_stamp":"2023-10-08T06:09:35.125722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:23:11.727351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-08T06:09:37.196705+0000","last_change":"2023-10-08T06:09:37.194668+0000","last_active":"2023-10-08T06:09:37.196705+0000","last_peered":"2023-10-08T06:09:37.196705+0000","last_clean":"2023-10-08T06:09:37.196705+0000","last_became_active":"2023-10-08T06:09:37.194275+0000","last_became_peered":"2023-10-08T06:09:37.194275+0000","last_unstale":"2023-10-08T06:09:37.196705+0000","last_undegraded":"2023-10-08T06:09:37.196705+0000","last_fullsized":"2023-10-08T06:09:37.196705+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:15:44.339765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.162597+0000","last_change":"2023-10-08T06:09:36.168806+0000","last_active":"2023-10-08T06:09:38.162597+0000","last_peered":"2023-10-08T06:09:38.162597+0000","last_clean":"2023-10-08T06:09:38.162597+0000","last_became_active":"2023-10-08T06:09:36.168379+0000","last_became_peered":"2023-10-08T06:09:36.168379+0000","last_unstale":"2023-10-08T06:09:38.162597+0000","last_undegraded":"2023-10-08T06:09:38.162597+0000","last_fullsized":"2023-10-08T06:09:38.162597+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_clean_scrub_stamp":"2023-10-08T06:09:35.125722+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:15:43.326854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-08T06:09:37.193555+0000","last_change":"2023-10-08T06:09:37.183629+0000","last_active":"2023-10-08T06:09:37.193555+0000","last_peered":"2023-10-08T06:09:37.193555+0000","last_clean":"2023-10-08T06:09:37.193555+0000","last_became_active":"2023-10-08T06:09:37.183318+0000","last_became_peered":"2023-10-08T06:09:37.183318+0000","last_unstale":"2023-10-08T06:09:37.193555+0000","last_undegraded":"2023-10-08T06:09:37.193555+0000","last_fullsized":"2023-10-08T06:09:37.193555+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:57:15.415485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"21'6","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.258922+0000","last_change":"2023-10-08T06:09:36.177043+0000","last_active":"2023-10-08T06:09:38.258922+0000","last_peered":"2023-10-08T06:09:38.258922+0000","last_clean":"2023-10-08T06:09:38.258922+0000","last_became_active":"2023-10-08T06:09:36.176455+0000","last_became_peered":"2023-10-08T06:09:36.176455+0000","last_unstale":"2023-10-08T06:09:38.258922+0000","last_undegraded":"2023-10-08T06:09:38.258922+0000","last_fullsized":"2023-10-08T06:09:38.258922+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_clean_scrub_stamp":"2023-10-08T06:09:35.125722+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:03:55.740286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.165422+0000","last_change":"2023-10-08T06:09:37.187989+0000","last_active":"2023-10-08T06:09:38.165422+0000","last_peered":"2023-10-08T06:09:38.165422+0000","last_clean":"2023-10-08T06:09:38.165422+0000","last_became_active":"2023-10-08T06:09:37.187694+0000","last_became_peered":"2023-10-08T06:09:37.187694+0000","last_unstale":"2023-10-08T06:09:38.165422+0000","last_undegraded":"2023-10-08T06:09:38.165422+0000","last_fullsized":"2023-10-08T06:09:38.165422+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:06:58.385054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-08T06:09:37.195185+0000","last_change":"2023-10-08T06:09:36.180486+0000","last_active":"2023-10-08T06:09:37.195185+0000","last_peered":"2023-10-08T06:09:37.195185+0000","last_clean":"2023-10-08T06:09:37.195185+0000","last_became_active":"2023-10-08T06:09:36.180170+0000","last_became_peered":"2023-10-08T06:09:36.180170+0000","last_unstale":"2023-10-08T06:09:37.195185+0000","last_undegraded":"2023-10-08T06:09:37.195185+0000","last_fullsized":"2023-10-08T06:09:37.195185+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_clean_scrub_stamp":"2023-10-08T06:09:35.125722+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:05:49.733090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-08T06:09:37.197084+0000","last_change":"2023-10-08T06:09:37.195019+0000","last_active":"2023-10-08T06:09:37.197084+0000","last_peered":"2023-10-08T06:09:37.197084+0000","last_clean":"2023-10-08T06:09:37.197084+0000","last_became_active":"2023-10-08T06:09:37.192104+0000","last_became_peered":"2023-10-08T06:09:37.192104+0000","last_unstale":"2023-10-08T06:09:37.197084+0000","last_undegraded":"2023-10-08T06:09:37.197084+0000","last_fullsized":"2023-10-08T06:09:37.197084+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:11:11.824362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.165326+0000","last_change":"2023-10-08T06:09:36.174464+0000","last_active":"2023-10-08T06:09:38.165326+0000","last_peered":"2023-10-08T06:09:38.165326+0000","last_clean":"2023-10-08T06:09:38.165326+0000","last_became_active":"2023-10-08T06:09:36.174144+0000","last_became_peered":"2023-10-08T06:09:36.174144+0000","last_unstale":"2023-10-08T06:09:38.165326+0000","last_undegraded":"2023-10-08T06:09:38.165326+0000","last_fullsized":"2023-10-08T06:09:38.165326+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_clean_scrub_stamp":"2023-10-08T06:09:35.125722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:34:23.204560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.165097+0000","last_change":"2023-10-08T06:09:37.193371+0000","last_active":"2023-10-08T06:09:38.165097+0000","last_peered":"2023-10-08T06:09:38.165097+0000","last_clean":"2023-10-08T06:09:38.165097+0000","last_became_active":"2023-10-08T06:09:37.192842+0000","last_became_peered":"2023-10-08T06:09:37.192842+0000","last_unstale":"2023-10-08T06:09:38.165097+0000","last_undegraded":"2023-10-08T06:09:38.165097+0000","last_fullsized":"2023-10-08T06:09:38.165097+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:16:03.874960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.258443+0000","last_change":"2023-10-08T06:09:36.178850+0000","last_active":"2023-10-08T06:09:38.258443+0000","last_peered":"2023-10-08T06:09:38.258443+0000","last_clean":"2023-10-08T06:09:38.258443+0000","last_became_active":"2023-10-08T06:09:36.178580+0000","last_became_peered":"2023-10-08T06:09:36.178580+0000","last_unstale":"2023-10-08T06:09:38.258443+0000","last_undegraded":"2023-10-08T06:09:38.258443+0000","last_fullsized":"2023-10-08T06:09:38.258443+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_clean_scrub_stamp":"2023-10-08T06:09:35.125722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:52:59.381910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.258458+0000","last_change":"2023-10-08T06:09:37.187049+0000","last_active":"2023-10-08T06:09:38.258458+0000","last_peered":"2023-10-08T06:09:38.258458+0000","last_clean":"2023-10-08T06:09:38.258458+0000","last_became_active":"2023-10-08T06:09:37.186754+0000","last_became_peered":"2023-10-08T06:09:37.186754+0000","last_unstale":"2023-10-08T06:09:38.258458+0000","last_undegraded":"2023-10-08T06:09:38.258458+0000","last_fullsized":"2023-10-08T06:09:38.258458+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:56:29.982869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-08T06:09:37.197500+0000","last_change":"2023-10-08T06:09:36.169901+0000","last_active":"2023-10-08T06:09:37.197500+0000","last_peered":"2023-10-08T06:09:37.197500+0000","last_clean":"2023-10-08T06:09:37.197500+0000","last_became_active":"2023-10-08T06:09:36.169437+0000","last_became_peered":"2023-10-08T06:09:36.169437+0000","last_unstale":"2023-10-08T06:09:37.197500+0000","last_undegraded":"2023-10-08T06:09:37.197500+0000","last_fullsized":"2023-10-08T06:09:37.197500+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_clean_scrub_stamp":"2023-10-08T06:09:35.125722+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:18:04.415654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.163886+0000","last_change":"2023-10-08T06:09:37.192889+0000","last_active":"2023-10-08T06:09:38.163886+0000","last_peered":"2023-10-08T06:09:38.163886+0000","last_clean":"2023-10-08T06:09:38.163886+0000","last_became_active":"2023-10-08T06:09:37.192566+0000","last_became_peered":"2023-10-08T06:09:37.192566+0000","last_unstale":"2023-10-08T06:09:38.163886+0000","last_undegraded":"2023-10-08T06:09:38.163886+0000","last_fullsized":"2023-10-08T06:09:38.163886+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:18:15.487038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-08T06:09:37.188480+0000","last_change":"2023-10-08T06:09:36.174556+0000","last_active":"2023-10-08T06:09:37.188480+0000","last_peered":"2023-10-08T06:09:37.188480+0000","last_clean":"2023-10-08T06:09:37.188480+0000","last_became_active":"2023-10-08T06:09:36.174232+0000","last_became_peered":"2023-10-08T06:09:36.174232+0000","last_unstale":"2023-10-08T06:09:37.188480+0000","last_undegraded":"2023-10-08T06:09:37.188480+0000","last_fullsized":"2023-10-08T06:09:37.188480+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_clean_scrub_stamp":"2023-10-08T06:09:35.125722+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:38:58.906188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.165929+0000","last_change":"2023-10-08T06:09:37.192804+0000","last_active":"2023-10-08T06:09:38.165929+0000","last_peered":"2023-10-08T06:09:38.165929+0000","last_clean":"2023-10-08T06:09:38.165929+0000","last_became_active":"2023-10-08T06:09:37.192500+0000","last_became_peered":"2023-10-08T06:09:37.192500+0000","last_unstale":"2023-10-08T06:09:38.165929+0000","last_undegraded":"2023-10-08T06:09:38.165929+0000","last_fullsized":"2023-10-08T06:09:38.165929+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:04:32.307233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-08T06:09:37.198023+0000","last_change":"2023-10-08T06:09:36.177373+0000","last_active":"2023-10-08T06:09:37.198023+0000","last_peered":"2023-10-08T06:09:37.198023+0000","last_clean":"2023-10-08T06:09:37.198023+0000","last_became_active":"2023-10-08T06:09:36.176919+0000","last_became_peered":"2023-10-08T06:09:36.176919+0000","last_unstale":"2023-10-08T06:09:37.198023+0000","last_undegraded":"2023-10-08T06:09:37.198023+0000","last_fullsized":"2023-10-08T06:09:37.198023+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_clean_scrub_stamp":"2023-10-08T06:09:35.125722+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:19:59.810056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.166276+0000","last_change":"2023-10-08T06:09:37.194526+0000","last_active":"2023-10-08T06:09:38.166276+0000","last_peered":"2023-10-08T06:09:38.166276+0000","last_clean":"2023-10-08T06:09:38.166276+0000","last_became_active":"2023-10-08T06:09:37.193884+0000","last_became_peered":"2023-10-08T06:09:37.193884+0000","last_unstale":"2023-10-08T06:09:38.166276+0000","last_undegraded":"2023-10-08T06:09:38.166276+0000","last_fullsized":"2023-10-08T06:09:38.166276+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:06:09.459089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.162713+0000","last_change":"2023-10-08T06:09:36.175751+0000","last_active":"2023-10-08T06:09:38.162713+0000","last_peered":"2023-10-08T06:09:38.162713+0000","last_clean":"2023-10-08T06:09:38.162713+0000","last_became_active":"2023-10-08T06:09:36.175401+0000","last_became_peered":"2023-10-08T06:09:36.175401+0000","last_unstale":"2023-10-08T06:09:38.162713+0000","last_undegraded":"2023-10-08T06:09:38.162713+0000","last_fullsized":"2023-10-08T06:09:38.162713+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_clean_scrub_stamp":"2023-10-08T06:09:35.125722+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:05:49.733090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.166140+0000","last_change":"2023-10-08T06:09:37.186035+0000","last_active":"2023-10-08T06:09:38.166140+0000","last_peered":"2023-10-08T06:09:38.166140+0000","last_clean":"2023-10-08T06:09:38.166140+0000","last_became_active":"2023-10-08T06:09:37.182569+0000","last_became_peered":"2023-10-08T06:09:37.182569+0000","last_unstale":"2023-10-08T06:09:38.166140+0000","last_undegraded":"2023-10-08T06:09:38.166140+0000","last_fullsized":"2023-10-08T06:09:38.166140+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:36:49.578063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-08T06:09:37.171668+0000","last_change":"2023-10-08T06:09:36.168728+0000","last_active":"2023-10-08T06:09:37.171668+0000","last_peered":"2023-10-08T06:09:37.171668+0000","last_clean":"2023-10-08T06:09:37.171668+0000","last_became_active":"2023-10-08T06:09:36.168339+0000","last_became_peered":"2023-10-08T06:09:36.168339+0000","last_unstale":"2023-10-08T06:09:37.171668+0000","last_undegraded":"2023-10-08T06:09:37.171668+0000","last_fullsized":"2023-10-08T06:09:37.171668+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_clean_scrub_stamp":"2023-10-08T06:09:35.125722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:17:11.482633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.165436+0000","last_change":"2023-10-08T06:09:37.194313+0000","last_active":"2023-10-08T06:09:38.165436+0000","last_peered":"2023-10-08T06:09:38.165436+0000","last_clean":"2023-10-08T06:09:38.165436+0000","last_became_active":"2023-10-08T06:09:37.193990+0000","last_became_peered":"2023-10-08T06:09:37.193990+0000","last_unstale":"2023-10-08T06:09:38.165436+0000","last_undegraded":"2023-10-08T06:09:38.165436+0000","last_fullsized":"2023-10-08T06:09:38.165436+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:36:49.578063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":165,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-08T06:09:37.175106+0000","last_change":"2023-10-08T06:09:24.811692+0000","last_active":"2023-10-08T06:09:37.175106+0000","last_peered":"2023-10-08T06:09:37.175106+0000","last_clean":"2023-10-08T06:09:37.175106+0000","last_became_active":"2023-10-08T06:09:24.809788+0000","last_became_peered":"2023-10-08T06:09:24.809788+0000","last_unstale":"2023-10-08T06:09:37.175106+0000","last_undegraded":"2023-10-08T06:09:37.175106+0000","last_fullsized":"2023-10-08T06:09:37.175106+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:23.748736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:23.748736+0000","last_clean_scrub_stamp":"2023-10-08T06:09:23.748736+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:39:45.599458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.164066+0000","last_change":"2023-10-08T06:09:36.168138+0000","last_active":"2023-10-08T06:09:38.164066+0000","last_peered":"2023-10-08T06:09:38.164066+0000","last_clean":"2023-10-08T06:09:38.164066+0000","last_became_active":"2023-10-08T06:09:36.167559+0000","last_became_peered":"2023-10-08T06:09:36.167559+0000","last_unstale":"2023-10-08T06:09:38.164066+0000","last_undegraded":"2023-10-08T06:09:38.164066+0000","last_fullsized":"2023-10-08T06:09:38.164066+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_clean_scrub_stamp":"2023-10-08T06:09:35.125722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:38:58.906188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-08T06:09:37.181195+0000","last_change":"2023-10-08T06:09:37.174591+0000","last_active":"2023-10-08T06:09:37.181195+0000","last_peered":"2023-10-08T06:09:37.181195+0000","last_clean":"2023-10-08T06:09:37.181195+0000","last_became_active":"2023-10-08T06:09:37.174291+0000","last_became_peered":"2023-10-08T06:09:37.174291+0000","last_unstale":"2023-10-08T06:09:37.181195+0000","last_undegraded":"2023-10-08T06:09:37.181195+0000","last_fullsized":"2023-10-08T06:09:37.181195+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:43:26.242139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.163652+0000","last_change":"2023-10-08T06:09:36.177856+0000","last_active":"2023-10-08T06:09:38.163652+0000","last_peered":"2023-10-08T06:09:38.163652+0000","last_clean":"2023-10-08T06:09:38.163652+0000","last_became_active":"2023-10-08T06:09:36.177525+0000","last_became_peered":"2023-10-08T06:09:36.177525+0000","last_unstale":"2023-10-08T06:09:38.163652+0000","last_undegraded":"2023-10-08T06:09:38.163652+0000","last_fullsized":"2023-10-08T06:09:38.163652+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_clean_scrub_stamp":"2023-10-08T06:09:35.125722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:18:38.124206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-08T06:09:37.191280+0000","last_change":"2023-10-08T06:09:37.188650+0000","last_active":"2023-10-08T06:09:37.191280+0000","last_peered":"2023-10-08T06:09:37.191280+0000","last_clean":"2023-10-08T06:09:37.191280+0000","last_became_active":"2023-10-08T06:09:37.187914+0000","last_became_peered":"2023-10-08T06:09:37.187914+0000","last_unstale":"2023-10-08T06:09:37.191280+0000","last_undegraded":"2023-10-08T06:09:37.191280+0000","last_fullsized":"2023-10-08T06:09:37.191280+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:57:15.415485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-08T06:09:37.172181+0000","last_change":"2023-10-08T06:09:36.174692+0000","last_active":"2023-10-08T06:09:37.172181+0000","last_peered":"2023-10-08T06:09:37.172181+0000","last_clean":"2023-10-08T06:09:37.172181+0000","last_became_active":"2023-10-08T06:09:36.174385+0000","last_became_peered":"2023-10-08T06:09:36.174385+0000","last_unstale":"2023-10-08T06:09:37.172181+0000","last_undegraded":"2023-10-08T06:09:37.172181+0000","last_fullsized":"2023-10-08T06:09:37.172181+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_clean_scrub_stamp":"2023-10-08T06:09:35.125722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:15:43.326854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.161620+0000","last_change":"2023-10-08T06:09:37.180115+0000","last_active":"2023-10-08T06:09:38.161620+0000","last_peered":"2023-10-08T06:09:38.161620+0000","last_clean":"2023-10-08T06:09:38.161620+0000","last_became_active":"2023-10-08T06:09:37.179866+0000","last_became_peered":"2023-10-08T06:09:37.179866+0000","last_unstale":"2023-10-08T06:09:38.161620+0000","last_undegraded":"2023-10-08T06:09:38.161620+0000","last_fullsized":"2023-10-08T06:09:38.161620+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:22:50.644480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.165478+0000","last_change":"2023-10-08T06:09:36.179535+0000","last_active":"2023-10-08T06:09:38.165478+0000","last_peered":"2023-10-08T06:09:38.165478+0000","last_clean":"2023-10-08T06:09:38.165478+0000","last_became_active":"2023-10-08T06:09:36.179229+0000","last_became_peered":"2023-10-08T06:09:36.179229+0000","last_unstale":"2023-10-08T06:09:38.165478+0000","last_undegraded":"2023-10-08T06:09:38.165478+0000","last_fullsized":"2023-10-08T06:09:38.165478+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_clean_scrub_stamp":"2023-10-08T06:09:35.125722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:49:16.044898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-08T06:09:37.194026+0000","last_change":"2023-10-08T06:09:37.187671+0000","last_active":"2023-10-08T06:09:37.194026+0000","last_peered":"2023-10-08T06:09:37.194026+0000","last_clean":"2023-10-08T06:09:37.194026+0000","last_became_active":"2023-10-08T06:09:37.187278+0000","last_became_peered":"2023-10-08T06:09:37.187278+0000","last_unstale":"2023-10-08T06:09:37.194026+0000","last_undegraded":"2023-10-08T06:09:37.194026+0000","last_fullsized":"2023-10-08T06:09:37.194026+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:03:25.190681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.162458+0000","last_change":"2023-10-08T06:09:36.170421+0000","last_active":"2023-10-08T06:09:38.162458+0000","last_peered":"2023-10-08T06:09:38.162458+0000","last_clean":"2023-10-08T06:09:38.162458+0000","last_became_active":"2023-10-08T06:09:36.169186+0000","last_became_peered":"2023-10-08T06:09:36.169186+0000","last_unstale":"2023-10-08T06:09:38.162458+0000","last_undegraded":"2023-10-08T06:09:38.162458+0000","last_fullsized":"2023-10-08T06:09:38.162458+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_clean_scrub_stamp":"2023-10-08T06:09:35.125722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:52:59.381910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.166119+0000","last_change":"2023-10-08T06:09:37.187824+0000","last_active":"2023-10-08T06:09:38.166119+0000","last_peered":"2023-10-08T06:09:38.166119+0000","last_clean":"2023-10-08T06:09:38.166119+0000","last_became_active":"2023-10-08T06:09:37.186117+0000","last_became_peered":"2023-10-08T06:09:37.186117+0000","last_unstale":"2023-10-08T06:09:38.166119+0000","last_undegraded":"2023-10-08T06:09:38.166119+0000","last_fullsized":"2023-10-08T06:09:38.166119+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:06:58.385054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.165731+0000","last_change":"2023-10-08T06:09:36.174520+0000","last_active":"2023-10-08T06:09:38.165731+0000","last_peered":"2023-10-08T06:09:38.165731+0000","last_clean":"2023-10-08T06:09:38.165731+0000","last_became_active":"2023-10-08T06:09:36.174174+0000","last_became_peered":"2023-10-08T06:09:36.174174+0000","last_unstale":"2023-10-08T06:09:38.165731+0000","last_undegraded":"2023-10-08T06:09:38.165731+0000","last_fullsized":"2023-10-08T06:09:38.165731+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_clean_scrub_stamp":"2023-10-08T06:09:35.125722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:21:37.338545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.162247+0000","last_change":"2023-10-08T06:09:37.185459+0000","last_active":"2023-10-08T06:09:38.162247+0000","last_peered":"2023-10-08T06:09:38.162247+0000","last_clean":"2023-10-08T06:09:38.162247+0000","last_became_active":"2023-10-08T06:09:37.185174+0000","last_became_peered":"2023-10-08T06:09:37.185174+0000","last_unstale":"2023-10-08T06:09:38.162247+0000","last_undegraded":"2023-10-08T06:09:38.162247+0000","last_fullsized":"2023-10-08T06:09:38.162247+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:21:38.351456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.162651+0000","last_change":"2023-10-08T06:09:36.180184+0000","last_active":"2023-10-08T06:09:38.162651+0000","last_peered":"2023-10-08T06:09:38.162651+0000","last_clean":"2023-10-08T06:09:38.162651+0000","last_became_active":"2023-10-08T06:09:36.179847+0000","last_became_peered":"2023-10-08T06:09:36.179847+0000","last_unstale":"2023-10-08T06:09:38.162651+0000","last_undegraded":"2023-10-08T06:09:38.162651+0000","last_fullsized":"2023-10-08T06:09:38.162651+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_clean_scrub_stamp":"2023-10-08T06:09:35.125722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:41:18.133708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-08T06:09:37.195849+0000","last_change":"2023-10-08T06:09:37.186300+0000","last_active":"2023-10-08T06:09:37.195849+0000","last_peered":"2023-10-08T06:09:37.195849+0000","last_clean":"2023-10-08T06:09:37.195849+0000","last_became_active":"2023-10-08T06:09:37.185836+0000","last_became_peered":"2023-10-08T06:09:37.185836+0000","last_unstale":"2023-10-08T06:09:37.195849+0000","last_undegraded":"2023-10-08T06:09:37.195849+0000","last_fullsized":"2023-10-08T06:09:37.195849+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:16:24.958518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.259033+0000","last_change":"2023-10-08T06:09:36.177038+0000","last_active":"2023-10-08T06:09:38.259033+0000","last_peered":"2023-10-08T06:09:38.259033+0000","last_clean":"2023-10-08T06:09:38.259033+0000","last_became_active":"2023-10-08T06:09:36.176498+0000","last_became_peered":"2023-10-08T06:09:36.176498+0000","last_unstale":"2023-10-08T06:09:38.259033+0000","last_undegraded":"2023-10-08T06:09:38.259033+0000","last_fullsized":"2023-10-08T06:09:38.259033+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_clean_scrub_stamp":"2023-10-08T06:09:35.125722+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:09:42.887654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-08T06:09:37.189185+0000","last_change":"2023-10-08T06:09:37.183347+0000","last_active":"2023-10-08T06:09:37.189185+0000","last_peered":"2023-10-08T06:09:37.189185+0000","last_clean":"2023-10-08T06:09:37.189185+0000","last_became_active":"2023-10-08T06:09:37.183069+0000","last_became_peered":"2023-10-08T06:09:37.183069+0000","last_unstale":"2023-10-08T06:09:37.189185+0000","last_undegraded":"2023-10-08T06:09:37.189185+0000","last_fullsized":"2023-10-08T06:09:37.189185+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:18:05.428564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.163642+0000","last_change":"2023-10-08T06:09:36.173735+0000","last_active":"2023-10-08T06:09:38.163642+0000","last_peered":"2023-10-08T06:09:38.163642+0000","last_clean":"2023-10-08T06:09:38.163642+0000","last_became_active":"2023-10-08T06:09:36.173306+0000","last_became_peered":"2023-10-08T06:09:36.173306+0000","last_unstale":"2023-10-08T06:09:38.163642+0000","last_undegraded":"2023-10-08T06:09:38.163642+0000","last_fullsized":"2023-10-08T06:09:38.163642+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_clean_scrub_stamp":"2023-10-08T06:09:35.125722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:19:59.810056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-08T06:09:37.191276+0000","last_change":"2023-10-08T06:09:37.183706+0000","last_active":"2023-10-08T06:09:37.191276+0000","last_peered":"2023-10-08T06:09:37.191276+0000","last_clean":"2023-10-08T06:09:37.191276+0000","last_became_active":"2023-10-08T06:09:37.183394+0000","last_became_peered":"2023-10-08T06:09:37.183394+0000","last_unstale":"2023-10-08T06:09:37.191276+0000","last_undegraded":"2023-10-08T06:09:37.191276+0000","last_fullsized":"2023-10-08T06:09:37.191276+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:18:05.428564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.161813+0000","last_change":"2023-10-08T06:09:36.171679+0000","last_active":"2023-10-08T06:09:38.161813+0000","last_peered":"2023-10-08T06:09:38.161813+0000","last_clean":"2023-10-08T06:09:38.161813+0000","last_became_active":"2023-10-08T06:09:36.171169+0000","last_became_peered":"2023-10-08T06:09:36.171169+0000","last_unstale":"2023-10-08T06:09:38.161813+0000","last_undegraded":"2023-10-08T06:09:38.161813+0000","last_fullsized":"2023-10-08T06:09:38.161813+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_clean_scrub_stamp":"2023-10-08T06:09:35.125722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:23:11.727351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-08T06:09:37.182546+0000","last_change":"2023-10-08T06:09:37.176151+0000","last_active":"2023-10-08T06:09:37.182546+0000","last_peered":"2023-10-08T06:09:37.182546+0000","last_clean":"2023-10-08T06:09:37.182546+0000","last_became_active":"2023-10-08T06:09:37.175845+0000","last_became_peered":"2023-10-08T06:09:37.175845+0000","last_unstale":"2023-10-08T06:09:37.182546+0000","last_undegraded":"2023-10-08T06:09:37.182546+0000","last_fullsized":"2023-10-08T06:09:37.182546+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:29:31.010000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.161868+0000","last_change":"2023-10-08T06:09:36.174531+0000","last_active":"2023-10-08T06:09:38.161868+0000","last_peered":"2023-10-08T06:09:38.161868+0000","last_clean":"2023-10-08T06:09:38.161868+0000","last_became_active":"2023-10-08T06:09:36.174216+0000","last_became_peered":"2023-10-08T06:09:36.174216+0000","last_unstale":"2023-10-08T06:09:38.161868+0000","last_undegraded":"2023-10-08T06:09:38.161868+0000","last_fullsized":"2023-10-08T06:09:38.161868+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_clean_scrub_stamp":"2023-10-08T06:09:35.125722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:17:11.482633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-08T06:09:37.198296+0000","last_change":"2023-10-08T06:09:37.191746+0000","last_active":"2023-10-08T06:09:37.198296+0000","last_peered":"2023-10-08T06:09:37.198296+0000","last_clean":"2023-10-08T06:09:37.198296+0000","last_became_active":"2023-10-08T06:09:37.191481+0000","last_became_peered":"2023-10-08T06:09:37.191481+0000","last_unstale":"2023-10-08T06:09:37.198296+0000","last_undegraded":"2023-10-08T06:09:37.198296+0000","last_fullsized":"2023-10-08T06:09:37.198296+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:45:36.408987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.165140+0000","last_change":"2023-10-08T06:09:36.179497+0000","last_active":"2023-10-08T06:09:38.165140+0000","last_peered":"2023-10-08T06:09:38.165140+0000","last_clean":"2023-10-08T06:09:38.165140+0000","last_became_active":"2023-10-08T06:09:36.179129+0000","last_became_peered":"2023-10-08T06:09:36.179129+0000","last_unstale":"2023-10-08T06:09:38.165140+0000","last_undegraded":"2023-10-08T06:09:38.165140+0000","last_fullsized":"2023-10-08T06:09:38.165140+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_clean_scrub_stamp":"2023-10-08T06:09:35.125722+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:34:23.204560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.258598+0000","last_change":"2023-10-08T06:09:37.185754+0000","last_active":"2023-10-08T06:09:38.258598+0000","last_peered":"2023-10-08T06:09:38.258598+0000","last_clean":"2023-10-08T06:09:38.258598+0000","last_became_active":"2023-10-08T06:09:37.185472+0000","last_became_peered":"2023-10-08T06:09:37.185472+0000","last_unstale":"2023-10-08T06:09:38.258598+0000","last_undegraded":"2023-10-08T06:09:38.258598+0000","last_fullsized":"2023-10-08T06:09:38.258598+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:34:24.217470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.166112+0000","last_change":"2023-10-08T06:09:37.181546+0000","last_active":"2023-10-08T06:09:38.166112+0000","last_peered":"2023-10-08T06:09:38.166112+0000","last_clean":"2023-10-08T06:09:38.166112+0000","last_became_active":"2023-10-08T06:09:37.181244+0000","last_became_peered":"2023-10-08T06:09:37.181244+0000","last_unstale":"2023-10-08T06:09:38.166112+0000","last_undegraded":"2023-10-08T06:09:38.166112+0000","last_fullsized":"2023-10-08T06:09:38.166112+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:16:03.874960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.165289+0000","last_change":"2023-10-08T06:09:36.173329+0000","last_active":"2023-10-08T06:09:38.165289+0000","last_peered":"2023-10-08T06:09:38.165289+0000","last_clean":"2023-10-08T06:09:38.165289+0000","last_became_active":"2023-10-08T06:09:36.172872+0000","last_became_peered":"2023-10-08T06:09:36.172872+0000","last_unstale":"2023-10-08T06:09:38.165289+0000","last_undegraded":"2023-10-08T06:09:38.165289+0000","last_fullsized":"2023-10-08T06:09:38.165289+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_clean_scrub_stamp":"2023-10-08T06:09:35.125722+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:56:28.969959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.165938+0000","last_change":"2023-10-08T06:09:37.168180+0000","last_active":"2023-10-08T06:09:38.165938+0000","last_peered":"2023-10-08T06:09:38.165938+0000","last_clean":"2023-10-08T06:09:38.165938+0000","last_became_active":"2023-10-08T06:09:37.167874+0000","last_became_peered":"2023-10-08T06:09:37.167874+0000","last_unstale":"2023-10-08T06:09:38.165938+0000","last_undegraded":"2023-10-08T06:09:38.165938+0000","last_fullsized":"2023-10-08T06:09:38.165938+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:06:27.727341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.165564+0000","last_change":"2023-10-08T06:09:36.181123+0000","last_active":"2023-10-08T06:09:38.165564+0000","last_peered":"2023-10-08T06:09:38.165564+0000","last_clean":"2023-10-08T06:09:38.165564+0000","last_became_active":"2023-10-08T06:09:36.180774+0000","last_became_peered":"2023-10-08T06:09:36.180774+0000","last_unstale":"2023-10-08T06:09:38.165564+0000","last_undegraded":"2023-10-08T06:09:38.165564+0000","last_fullsized":"2023-10-08T06:09:38.165564+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_clean_scrub_stamp":"2023-10-08T06:09:35.125722+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:23:11.727351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-08T06:09:37.196732+0000","last_change":"2023-10-08T06:09:37.194698+0000","last_active":"2023-10-08T06:09:37.196732+0000","last_peered":"2023-10-08T06:09:37.196732+0000","last_clean":"2023-10-08T06:09:37.196732+0000","last_became_active":"2023-10-08T06:09:37.194354+0000","last_became_peered":"2023-10-08T06:09:37.194354+0000","last_unstale":"2023-10-08T06:09:37.196732+0000","last_undegraded":"2023-10-08T06:09:37.196732+0000","last_fullsized":"2023-10-08T06:09:37.196732+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:18:39.137117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-08T06:09:37.191126+0000","last_change":"2023-10-08T06:09:36.175818+0000","last_active":"2023-10-08T06:09:37.191126+0000","last_peered":"2023-10-08T06:09:37.191126+0000","last_clean":"2023-10-08T06:09:37.191126+0000","last_became_active":"2023-10-08T06:09:36.175493+0000","last_became_peered":"2023-10-08T06:09:36.175493+0000","last_unstale":"2023-10-08T06:09:37.191126+0000","last_undegraded":"2023-10-08T06:09:37.191126+0000","last_fullsized":"2023-10-08T06:09:37.191126+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_clean_scrub_stamp":"2023-10-08T06:09:35.125722+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:29:33.964626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-08T06:09:37.195720+0000","last_change":"2023-10-08T06:09:37.183447+0000","last_active":"2023-10-08T06:09:37.195720+0000","last_peered":"2023-10-08T06:09:37.195720+0000","last_clean":"2023-10-08T06:09:37.195720+0000","last_became_active":"2023-10-08T06:09:37.183169+0000","last_became_peered":"2023-10-08T06:09:37.183169+0000","last_unstale":"2023-10-08T06:09:37.195720+0000","last_undegraded":"2023-10-08T06:09:37.195720+0000","last_fullsized":"2023-10-08T06:09:37.195720+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:13:01.305723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"21'4","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-08T06:09:37.192507+0000","last_change":"2023-10-08T06:09:36.173093+0000","last_active":"2023-10-08T06:09:37.192507+0000","last_peered":"2023-10-08T06:09:37.192507+0000","last_clean":"2023-10-08T06:09:37.192507+0000","last_became_active":"2023-10-08T06:09:36.172702+0000","last_became_peered":"2023-10-08T06:09:36.172702+0000","last_unstale":"2023-10-08T06:09:37.192507+0000","last_undegraded":"2023-10-08T06:09:37.192507+0000","last_fullsized":"2023-10-08T06:09:37.192507+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_clean_scrub_stamp":"2023-10-08T06:09:35.125722+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:52:59.381910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509445,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27808,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344032,"statfs":{"total":96636764160,"available":96608288768,"internally_reserved":0,"allocated":806912,"data_stored":660890,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95299999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2210000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0760000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64300000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.121}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85399999999999998}]}]},{"osd":6,"up_from":15,"seq":64424509446,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":233472,"data_stored":77852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0960000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69699999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76000000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2490000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.127}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.484}]}]},{"osd":5,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":212992,"data_stored":70030,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95999999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70099999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81100000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1879999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0580000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0129999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.395}]}]},{"osd":4,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":221184,"data_stored":70066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0429999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84499999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94599999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98299999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.502}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2410000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5549999999999999}]}]},{"osd":2,"up_from":15,"seq":64424509445,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31388,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340452,"statfs":{"total":96636764160,"available":96604622848,"internally_reserved":0,"allocated":208896,"data_stored":69940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75800000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99099999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0609999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82099999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97599999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3740000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2490000000000001}]}]},{"osd":1,"up_from":15,"seq":64424509444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31396,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340444,"statfs":{"total":96636764160,"available":96604614656,"internally_reserved":0,"allocated":217088,"data_stored":70100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52400000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69299999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70799999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78900000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92000000000000004}]}]},{"osd":0,"up_from":15,"seq":64424509445,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31976,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339864,"statfs":{"total":96636764160,"available":96604020736,"internally_reserved":0,"allocated":815104,"data_stored":660946,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79300000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68899999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72199999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88600000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1120000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1519999999999999}]}]},{"osd":3,"up_from":14,"seq":60129542148,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31400,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340440,"statfs":{"total":96636764160,"available":96604610560,"internally_reserved":0,"allocated":221184,"data_stored":71552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60499999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68999999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89400000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.133}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.103}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78100000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93500000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T06:09:40.230 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T06:09:40.344 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.340+0000 7f34f23d9700 1 Processor -- start 2023-10-08T06:09:40.345 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.340+0000 7f34f23d9700 1 -- start start 2023-10-08T06:09:40.345 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.340+0000 7f34f23d9700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f34ec15b980 0x7f34ec15f780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:40.346 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.340+0000 7f34f23d9700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f34ec0719e0 0x7f34ec0c9420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:40.346 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.340+0000 7f34f23d9700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34ec06fc20 con 0x7f34ec0c9960 2023-10-08T06:09:40.346 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.340+0000 7f34f23d9700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34ec070430 con 0x7f34ec15b980 2023-10-08T06:09:40.346 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.340+0000 7f34f23d9700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34ec15ed70 con 0x7f34ec0719e0 2023-10-08T06:09:40.346 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.340+0000 7f34f0bd6700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f34ec0719e0 0x7f34ec0c9420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:40.346 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.340+0000 7f34f0bd6700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f34ec0719e0 0x7f34ec0c9420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.32:54436/0 (socket says 172.21.15.32:54436) 2023-10-08T06:09:40.346 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.340+0000 7f34f0bd6700 1 -- 172.21.15.32:0/3055815534 learned_addr learned my addr 172.21.15.32:0/3055815534 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:09:40.346 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.340+0000 7f34f13d7700 1 --2- 172.21.15.32:0/3055815534 >> v2:172.21.15.40:3300/0 conn(0x7f34ec15b980 0x7f34ec15f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:40.348 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.340+0000 7f34f0bd6700 1 -- 172.21.15.32:0/3055815534 >> v2:172.21.15.40:3300/0 conn(0x7f34ec15b980 msgr2=0x7f34ec15f780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:09:40.348 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.340+0000 7f34f0bd6700 1 --2- 172.21.15.32:0/3055815534 >> v2:172.21.15.40:3300/0 conn(0x7f34ec15b980 0x7f34ec15f780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:40.348 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.340+0000 7f34f0bd6700 1 -- 172.21.15.32:0/3055815534 >> v1:172.21.15.40:6789/0 conn(0x7f34ec0c9960 legacy=0x7f34ec15bd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:40.348 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.340+0000 7f34f0bd6700 1 -- 172.21.15.32:0/3055815534 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34ec15fcc0 con 0x7f34ec0719e0 2023-10-08T06:09:40.348 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.340+0000 7f34f13d7700 1 --2- 172.21.15.32:0/3055815534 >> v2:172.21.15.40:3300/0 conn(0x7f34ec15b980 0x7f34ec15f780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T06:09:40.348 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.340+0000 7f34f0bd6700 1 --2- 172.21.15.32:0/3055815534 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f34ec0719e0 0x7f34ec0c9420 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f34e4009e50 tx=0x7f34e400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=113a8d68f149eead server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:40.348 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.340+0000 7f34e3fff700 1 -- 172.21.15.32:0/3055815534 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34e400e070 con 0x7f34ec0719e0 2023-10-08T06:09:40.348 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.340+0000 7f34e3fff700 1 -- 172.21.15.32:0/3055815534 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34e400b910 con 0x7f34ec0719e0 2023-10-08T06:09:40.348 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.340+0000 7f34e3fff700 1 -- 172.21.15.32:0/3055815534 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34e400bcc0 con 0x7f34ec0719e0 2023-10-08T06:09:40.349 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.344+0000 7f34f23d9700 1 -- 172.21.15.32:0/3055815534 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f34ec0719e0 msgr2=0x7f34ec0c9420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:40.349 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.344+0000 7f34f23d9700 1 --2- 172.21.15.32:0/3055815534 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f34ec0719e0 0x7f34ec0c9420 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f34e4009e50 tx=0x7f34e400b330 comp rx=0 tx=0).stop 2023-10-08T06:09:40.349 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.344+0000 7f34f23d9700 1 -- 172.21.15.32:0/3055815534 shutdown_connections 2023-10-08T06:09:40.349 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.344+0000 7f34f23d9700 1 --2- 172.21.15.32:0/3055815534 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f34ec0719e0 0x7f34ec0c9420 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:40.349 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.344+0000 7f34f23d9700 1 --2- 172.21.15.32:0/3055815534 >> v2:172.21.15.40:3300/0 conn(0x7f34ec15b980 0x7f34ec15f780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:40.349 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.344+0000 7f34f23d9700 1 -- 172.21.15.32:0/3055815534 >> 172.21.15.32:0/3055815534 conn(0x7f34ec0b0900 msgr2=0x7f34ec0b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:09:40.349 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.344+0000 7f34f23d9700 1 -- 172.21.15.32:0/3055815534 shutdown_connections 2023-10-08T06:09:40.349 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.344+0000 7f34f23d9700 1 -- 172.21.15.32:0/3055815534 wait complete. 2023-10-08T06:09:40.351 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.344+0000 7f34f23d9700 1 Processor -- start 2023-10-08T06:09:40.351 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.344+0000 7f34f23d9700 1 -- start start 2023-10-08T06:09:40.351 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.344+0000 7f34f23d9700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f34ec0719e0 0x7f34ec0b3410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:40.351 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.344+0000 7f34f23d9700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f34ec0c9960 0x7f34ec155e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:40.351 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.344+0000 7f34f23d9700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f34ec15b980 0x7f34ec0ad650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:40.351 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.344+0000 7f34f23d9700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34ec15d530 con 0x7f34ec15b980 2023-10-08T06:09:40.351 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.344+0000 7f34f23d9700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34ec0b3cd0 con 0x7f34ec0719e0 2023-10-08T06:09:40.351 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.344+0000 7f34f23d9700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34ec0b39f0 con 0x7f34ec0c9960 2023-10-08T06:09:40.351 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.344+0000 7f34f1bd8700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f34ec15b980 0x7f34ec0ad650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:40.351 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.344+0000 7f34f1bd8700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f34ec15b980 0x7f34ec0ad650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:59128/0 (socket says 172.21.15.32:59128) 2023-10-08T06:09:40.352 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.344+0000 7f34f1bd8700 1 -- 172.21.15.32:0/3919155454 learned_addr learned my addr 172.21.15.32:0/3919155454 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:09:40.352 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.344+0000 7f34f0bd6700 1 --2- 172.21.15.32:0/3919155454 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f34ec0c9960 0x7f34ec155e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:40.352 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.344+0000 7f34f13d7700 1 --2- 172.21.15.32:0/3919155454 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f34ec0719e0 0x7f34ec0b3410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:40.352 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.344+0000 7f34f1bd8700 1 -- 172.21.15.32:0/3919155454 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f34ec0c9960 msgr2=0x7f34ec155e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:40.352 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.344+0000 7f34f1bd8700 1 --2- 172.21.15.32:0/3919155454 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f34ec0c9960 0x7f34ec155e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:40.352 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.344+0000 7f34f1bd8700 1 -- 172.21.15.32:0/3919155454 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f34ec0719e0 msgr2=0x7f34ec0b3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:40.352 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.344+0000 7f34f1bd8700 1 --2- 172.21.15.32:0/3919155454 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f34ec0719e0 0x7f34ec0b3410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:40.352 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.344+0000 7f34f1bd8700 1 -- 172.21.15.32:0/3919155454 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34e80094b0 con 0x7f34ec15b980 2023-10-08T06:09:40.352 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.344+0000 7f34f1bd8700 1 --2- 172.21.15.32:0/3919155454 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f34ec15b980 0x7f34ec0ad650 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f34dc00c480 tx=0x7f34dc00c790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:40.353 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.344+0000 7f34e1ffb700 1 -- 172.21.15.32:0/3919155454 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34dc0052d0 con 0x7f34ec15b980 2023-10-08T06:09:40.353 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.344+0000 7f34e1ffb700 1 -- 172.21.15.32:0/3919155454 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34dc00ce90 con 0x7f34ec15b980 2023-10-08T06:09:40.353 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.344+0000 7f34f23d9700 1 -- 172.21.15.32:0/3919155454 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34e4009b30 con 0x7f34ec15b980 2023-10-08T06:09:40.353 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.344+0000 7f34e1ffb700 1 -- 172.21.15.32:0/3919155454 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34dc0036a0 con 0x7f34ec15b980 2023-10-08T06:09:40.353 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.344+0000 7f34f23d9700 1 -- 172.21.15.32:0/3919155454 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34ec15d1c0 con 0x7f34ec15b980 2023-10-08T06:09:40.354 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.348+0000 7f34f23d9700 1 -- 172.21.15.32:0/3919155454 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34ec15d6e0 con 0x7f34ec15b980 2023-10-08T06:09:40.354 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.348+0000 7f34e1ffb700 1 -- 172.21.15.32:0/3919155454 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f34dc003800 con 0x7f34ec15b980 2023-10-08T06:09:40.355 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.348+0000 7f34e1ffb700 1 --2- 172.21.15.32:0/3919155454 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f34d0066510 0x7f34d00689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:40.355 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.348+0000 7f34e1ffb700 1 -- 172.21.15.32:0/3919155454 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f34dc083160 con 0x7f34ec15b980 2023-10-08T06:09:40.355 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.348+0000 7f34f13d7700 1 --2- 172.21.15.32:0/3919155454 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f34d0066510 0x7f34d00689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:40.356 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.352+0000 7f34f13d7700 1 --2- 172.21.15.32:0/3919155454 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f34d0066510 0x7f34d00689d0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f34e8009ce0 tx=0x7f34e8009240 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:40.364 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.360+0000 7f34e1ffb700 1 -- 172.21.15.32:0/3919155454 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f34ec15d6e0 con 0x7f34ec15b980 2023-10-08T06:09:40.520 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.516+0000 7f34f23d9700 1 -- 172.21.15.32:0/3919155454 --> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f34ec06fe70 con 0x7f34d0066510 2023-10-08T06:09:40.534 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.528+0000 7f34e1ffb700 1 -- 172.21.15.32:0/3919155454 <== mgr.4107 v2:172.21.15.32:6832/2601628338 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264591 (secure 0 0 0) 0x7f34e8009e20 con 0x7f34d0066510 2023-10-08T06:09:40.537 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:09:40.539 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.532+0000 7f34f23d9700 1 -- 172.21.15.32:0/3919155454 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f34d0066510 msgr2=0x7f34d00689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:40.539 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.532+0000 7f34f23d9700 1 --2- 172.21.15.32:0/3919155454 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f34d0066510 0x7f34d00689d0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f34e8009ce0 tx=0x7f34e8009240 comp rx=0 tx=0).stop 2023-10-08T06:09:40.539 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.532+0000 7f34f23d9700 1 -- 172.21.15.32:0/3919155454 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f34ec15b980 msgr2=0x7f34ec0ad650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:40.539 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.532+0000 7f34f23d9700 1 --2- 172.21.15.32:0/3919155454 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f34ec15b980 0x7f34ec0ad650 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f34dc00c480 tx=0x7f34dc00c790 comp rx=0 tx=0).stop 2023-10-08T06:09:40.540 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.532+0000 7f34f23d9700 1 -- 172.21.15.32:0/3919155454 shutdown_connections 2023-10-08T06:09:40.540 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.532+0000 7f34f23d9700 1 --2- 172.21.15.32:0/3919155454 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f34d0066510 0x7f34d00689d0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:40.540 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.532+0000 7f34f23d9700 1 --2- 172.21.15.32:0/3919155454 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f34ec15b980 0x7f34ec0ad650 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:40.540 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.532+0000 7f34f23d9700 1 --2- 172.21.15.32:0/3919155454 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f34ec0c9960 0x7f34ec155e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:40.540 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.532+0000 7f34f23d9700 1 --2- 172.21.15.32:0/3919155454 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f34ec0719e0 0x7f34ec0b3410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:40.540 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.532+0000 7f34f23d9700 1 -- 172.21.15.32:0/3919155454 >> 172.21.15.32:0/3919155454 conn(0x7f34ec0b0900 msgr2=0x7f34ec154f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:09:40.540 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.532+0000 7f34f23d9700 1 -- 172.21.15.32:0/3919155454 shutdown_connections 2023-10-08T06:09:40.540 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.532+0000 7f34f23d9700 1 -- 172.21.15.32:0/3919155454 wait complete. 2023-10-08T06:09:40.540 INFO:teuthology.orchestra.run.smithi032.stderr:dumped all 2023-10-08T06:09:40.555 INFO:teuthology.orchestra.run.smithi032.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-10-08T06:09:39.248909+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":47,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235684,"kb_used_data":2868,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754739036,"statfs":{"total":773094113280,"available":772852772864,"internally_reserved":0,"allocated":2936832,"data_stored":1751376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":238276153},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":40,"apply_latency_ms":40,"commit_latency_ns":40000000,"apply_latency_ns":40000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.109530"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.166128+0000","last_change":"2023-10-08T06:09:37.189119+0000","last_active":"2023-10-08T06:09:38.166128+0000","last_peered":"2023-10-08T06:09:38.166128+0000","last_clean":"2023-10-08T06:09:38.166128+0000","last_became_active":"2023-10-08T06:09:37.188327+0000","last_became_peered":"2023-10-08T06:09:37.188327+0000","last_unstale":"2023-10-08T06:09:38.166128+0000","last_undegraded":"2023-10-08T06:09:38.166128+0000","last_fullsized":"2023-10-08T06:09:38.166128+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:24:28.854916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.162226+0000","last_change":"2023-10-08T06:09:37.187273+0000","last_active":"2023-10-08T06:09:38.162226+0000","last_peered":"2023-10-08T06:09:38.162226+0000","last_clean":"2023-10-08T06:09:38.162226+0000","last_became_active":"2023-10-08T06:09:37.187002+0000","last_became_peered":"2023-10-08T06:09:37.187002+0000","last_unstale":"2023-10-08T06:09:38.162226+0000","last_undegraded":"2023-10-08T06:09:38.162226+0000","last_fullsized":"2023-10-08T06:09:38.162226+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:49:17.057808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-08T06:09:37.195337+0000","last_change":"2023-10-08T06:09:37.189008+0000","last_active":"2023-10-08T06:09:37.195337+0000","last_peered":"2023-10-08T06:09:37.195337+0000","last_clean":"2023-10-08T06:09:37.195337+0000","last_became_active":"2023-10-08T06:09:37.188668+0000","last_became_peered":"2023-10-08T06:09:37.188668+0000","last_unstale":"2023-10-08T06:09:37.195337+0000","last_undegraded":"2023-10-08T06:09:37.195337+0000","last_fullsized":"2023-10-08T06:09:37.195337+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:38:59.919098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.166462+0000","last_change":"2023-10-08T06:09:37.187681+0000","last_active":"2023-10-08T06:09:38.166462+0000","last_peered":"2023-10-08T06:09:38.166462+0000","last_clean":"2023-10-08T06:09:38.166462+0000","last_became_active":"2023-10-08T06:09:37.186052+0000","last_became_peered":"2023-10-08T06:09:37.186052+0000","last_unstale":"2023-10-08T06:09:38.166462+0000","last_undegraded":"2023-10-08T06:09:38.166462+0000","last_fullsized":"2023-10-08T06:09:38.166462+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:04:32.307233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.164796+0000","last_change":"2023-10-08T06:09:37.184596+0000","last_active":"2023-10-08T06:09:38.164796+0000","last_peered":"2023-10-08T06:09:38.164796+0000","last_clean":"2023-10-08T06:09:38.164796+0000","last_became_active":"2023-10-08T06:09:37.184317+0000","last_became_peered":"2023-10-08T06:09:37.184317+0000","last_unstale":"2023-10-08T06:09:38.164796+0000","last_undegraded":"2023-10-08T06:09:38.164796+0000","last_fullsized":"2023-10-08T06:09:38.164796+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:06:27.727341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.164499+0000","last_change":"2023-10-08T06:09:37.189924+0000","last_active":"2023-10-08T06:09:38.164499+0000","last_peered":"2023-10-08T06:09:38.164499+0000","last_clean":"2023-10-08T06:09:38.164499+0000","last_became_active":"2023-10-08T06:09:37.188282+0000","last_became_peered":"2023-10-08T06:09:37.188282+0000","last_unstale":"2023-10-08T06:09:38.164499+0000","last_undegraded":"2023-10-08T06:09:38.164499+0000","last_fullsized":"2023-10-08T06:09:38.164499+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:37:42.540248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.164130+0000","last_change":"2023-10-08T06:09:37.187514+0000","last_active":"2023-10-08T06:09:38.164130+0000","last_peered":"2023-10-08T06:09:38.164130+0000","last_clean":"2023-10-08T06:09:38.164130+0000","last_became_active":"2023-10-08T06:09:37.187122+0000","last_became_peered":"2023-10-08T06:09:37.187122+0000","last_unstale":"2023-10-08T06:09:38.164130+0000","last_undegraded":"2023-10-08T06:09:38.164130+0000","last_fullsized":"2023-10-08T06:09:38.164130+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:49:58.972598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-08T06:09:37.195931+0000","last_change":"2023-10-08T06:09:37.186725+0000","last_active":"2023-10-08T06:09:37.195931+0000","last_peered":"2023-10-08T06:09:37.195931+0000","last_clean":"2023-10-08T06:09:37.195931+0000","last_became_active":"2023-10-08T06:09:37.186416+0000","last_became_peered":"2023-10-08T06:09:37.186416+0000","last_unstale":"2023-10-08T06:09:37.195931+0000","last_undegraded":"2023-10-08T06:09:37.195931+0000","last_fullsized":"2023-10-08T06:09:37.195931+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:37:33.898985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.166298+0000","last_change":"2023-10-08T06:09:37.196289+0000","last_active":"2023-10-08T06:09:38.166298+0000","last_peered":"2023-10-08T06:09:38.166298+0000","last_clean":"2023-10-08T06:09:38.166298+0000","last_became_active":"2023-10-08T06:09:37.196029+0000","last_became_peered":"2023-10-08T06:09:37.196029+0000","last_unstale":"2023-10-08T06:09:38.166298+0000","last_undegraded":"2023-10-08T06:09:38.166298+0000","last_fullsized":"2023-10-08T06:09:38.166298+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:58:21.359302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.259158+0000","last_change":"2023-10-08T06:09:37.192494+0000","last_active":"2023-10-08T06:09:38.259158+0000","last_peered":"2023-10-08T06:09:38.259158+0000","last_clean":"2023-10-08T06:09:38.259158+0000","last_became_active":"2023-10-08T06:09:37.192219+0000","last_became_peered":"2023-10-08T06:09:37.192219+0000","last_unstale":"2023-10-08T06:09:38.259158+0000","last_undegraded":"2023-10-08T06:09:38.259158+0000","last_fullsized":"2023-10-08T06:09:38.259158+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:21:38.351456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.258945+0000","last_change":"2023-10-08T06:09:37.191422+0000","last_active":"2023-10-08T06:09:38.258945+0000","last_peered":"2023-10-08T06:09:38.258945+0000","last_clean":"2023-10-08T06:09:38.258945+0000","last_became_active":"2023-10-08T06:09:37.191135+0000","last_became_peered":"2023-10-08T06:09:37.191135+0000","last_unstale":"2023-10-08T06:09:38.258945+0000","last_undegraded":"2023-10-08T06:09:38.258945+0000","last_fullsized":"2023-10-08T06:09:38.258945+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:49:17.057808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-08T06:09:37.190865+0000","last_change":"2023-10-08T06:09:37.180493+0000","last_active":"2023-10-08T06:09:37.190865+0000","last_peered":"2023-10-08T06:09:37.190865+0000","last_clean":"2023-10-08T06:09:37.190865+0000","last_became_active":"2023-10-08T06:09:37.180194+0000","last_became_peered":"2023-10-08T06:09:37.180194+0000","last_unstale":"2023-10-08T06:09:37.190865+0000","last_undegraded":"2023-10-08T06:09:37.190865+0000","last_fullsized":"2023-10-08T06:09:37.190865+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:11:11.824362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-08T06:09:37.190285+0000","last_change":"2023-10-08T06:09:37.182805+0000","last_active":"2023-10-08T06:09:37.190285+0000","last_peered":"2023-10-08T06:09:37.190285+0000","last_clean":"2023-10-08T06:09:37.190285+0000","last_became_active":"2023-10-08T06:09:37.182511+0000","last_became_peered":"2023-10-08T06:09:37.182511+0000","last_unstale":"2023-10-08T06:09:37.190285+0000","last_undegraded":"2023-10-08T06:09:37.190285+0000","last_fullsized":"2023-10-08T06:09:37.190285+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:23:18.544057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-08T06:09:37.189200+0000","last_change":"2023-10-08T06:09:37.184291+0000","last_active":"2023-10-08T06:09:37.189200+0000","last_peered":"2023-10-08T06:09:37.189200+0000","last_clean":"2023-10-08T06:09:37.189200+0000","last_became_active":"2023-10-08T06:09:37.183944+0000","last_became_peered":"2023-10-08T06:09:37.183944+0000","last_unstale":"2023-10-08T06:09:37.189200+0000","last_undegraded":"2023-10-08T06:09:37.189200+0000","last_fullsized":"2023-10-08T06:09:37.189200+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:03:25.190681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.161692+0000","last_change":"2023-10-08T06:09:37.173135+0000","last_active":"2023-10-08T06:09:38.161692+0000","last_peered":"2023-10-08T06:09:38.161692+0000","last_clean":"2023-10-08T06:09:38.161692+0000","last_became_active":"2023-10-08T06:09:37.172786+0000","last_became_peered":"2023-10-08T06:09:37.172786+0000","last_unstale":"2023-10-08T06:09:38.161692+0000","last_undegraded":"2023-10-08T06:09:38.161692+0000","last_fullsized":"2023-10-08T06:09:38.161692+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:34:24.217470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.163600+0000","last_change":"2023-10-08T06:09:37.190091+0000","last_active":"2023-10-08T06:09:38.163600+0000","last_peered":"2023-10-08T06:09:38.163600+0000","last_clean":"2023-10-08T06:09:38.163600+0000","last_became_active":"2023-10-08T06:09:37.188278+0000","last_became_peered":"2023-10-08T06:09:37.188278+0000","last_unstale":"2023-10-08T06:09:38.163600+0000","last_undegraded":"2023-10-08T06:09:38.163600+0000","last_fullsized":"2023-10-08T06:09:38.163600+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:21:38.351456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.166514+0000","last_change":"2023-10-08T06:09:37.188196+0000","last_active":"2023-10-08T06:09:38.166514+0000","last_peered":"2023-10-08T06:09:38.166514+0000","last_clean":"2023-10-08T06:09:38.166514+0000","last_became_active":"2023-10-08T06:09:37.187906+0000","last_became_peered":"2023-10-08T06:09:37.187906+0000","last_unstale":"2023-10-08T06:09:38.166514+0000","last_undegraded":"2023-10-08T06:09:38.166514+0000","last_fullsized":"2023-10-08T06:09:38.166514+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:24:28.854916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-08T06:09:37.191536+0000","last_change":"2023-10-08T06:09:37.185222+0000","last_active":"2023-10-08T06:09:37.191536+0000","last_peered":"2023-10-08T06:09:37.191536+0000","last_clean":"2023-10-08T06:09:37.191536+0000","last_became_active":"2023-10-08T06:09:37.184040+0000","last_became_peered":"2023-10-08T06:09:37.184040+0000","last_unstale":"2023-10-08T06:09:37.191536+0000","last_undegraded":"2023-10-08T06:09:37.191536+0000","last_fullsized":"2023-10-08T06:09:37.191536+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:03:25.190681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.165574+0000","last_change":"2023-10-08T06:09:37.189503+0000","last_active":"2023-10-08T06:09:38.165574+0000","last_peered":"2023-10-08T06:09:38.165574+0000","last_clean":"2023-10-08T06:09:38.165574+0000","last_became_active":"2023-10-08T06:09:37.189210+0000","last_became_peered":"2023-10-08T06:09:37.189210+0000","last_unstale":"2023-10-08T06:09:38.165574+0000","last_undegraded":"2023-10-08T06:09:38.165574+0000","last_fullsized":"2023-10-08T06:09:38.165574+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:04:33.773359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.259261+0000","last_change":"2023-10-08T06:09:37.190736+0000","last_active":"2023-10-08T06:09:38.259261+0000","last_peered":"2023-10-08T06:09:38.259261+0000","last_clean":"2023-10-08T06:09:38.259261+0000","last_became_active":"2023-10-08T06:09:37.190034+0000","last_became_peered":"2023-10-08T06:09:37.190034+0000","last_unstale":"2023-10-08T06:09:38.259261+0000","last_undegraded":"2023-10-08T06:09:38.259261+0000","last_fullsized":"2023-10-08T06:09:38.259261+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:34:25.213819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-08T06:09:37.195503+0000","last_change":"2023-10-08T06:09:37.189807+0000","last_active":"2023-10-08T06:09:37.195503+0000","last_peered":"2023-10-08T06:09:37.195503+0000","last_clean":"2023-10-08T06:09:37.195503+0000","last_became_active":"2023-10-08T06:09:37.189522+0000","last_became_peered":"2023-10-08T06:09:37.189522+0000","last_unstale":"2023-10-08T06:09:37.195503+0000","last_undegraded":"2023-10-08T06:09:37.195503+0000","last_fullsized":"2023-10-08T06:09:37.195503+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:05:09.836876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.164808+0000","last_change":"2023-10-08T06:09:37.187974+0000","last_active":"2023-10-08T06:09:38.164808+0000","last_peered":"2023-10-08T06:09:38.164808+0000","last_clean":"2023-10-08T06:09:38.164808+0000","last_became_active":"2023-10-08T06:09:37.187664+0000","last_became_peered":"2023-10-08T06:09:37.187664+0000","last_unstale":"2023-10-08T06:09:38.164808+0000","last_undegraded":"2023-10-08T06:09:38.164808+0000","last_fullsized":"2023-10-08T06:09:38.164808+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:18:15.487038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-08T06:09:37.197811+0000","last_change":"2023-10-08T06:09:37.190236+0000","last_active":"2023-10-08T06:09:37.197811+0000","last_peered":"2023-10-08T06:09:37.197811+0000","last_clean":"2023-10-08T06:09:37.197811+0000","last_became_active":"2023-10-08T06:09:37.187376+0000","last_became_peered":"2023-10-08T06:09:37.187376+0000","last_unstale":"2023-10-08T06:09:37.197811+0000","last_undegraded":"2023-10-08T06:09:37.197811+0000","last_fullsized":"2023-10-08T06:09:37.197811+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:35:59.443164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.164217+0000","last_change":"2023-10-08T06:09:37.187245+0000","last_active":"2023-10-08T06:09:38.164217+0000","last_peered":"2023-10-08T06:09:38.164217+0000","last_clean":"2023-10-08T06:09:38.164217+0000","last_became_active":"2023-10-08T06:09:37.182394+0000","last_became_peered":"2023-10-08T06:09:37.182394+0000","last_unstale":"2023-10-08T06:09:38.164217+0000","last_undegraded":"2023-10-08T06:09:38.164217+0000","last_fullsized":"2023-10-08T06:09:38.164217+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:34:25.213819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-08T06:09:37.197837+0000","last_change":"2023-10-08T06:09:37.190400+0000","last_active":"2023-10-08T06:09:37.197837+0000","last_peered":"2023-10-08T06:09:37.197837+0000","last_clean":"2023-10-08T06:09:37.197837+0000","last_became_active":"2023-10-08T06:09:37.187332+0000","last_became_peered":"2023-10-08T06:09:37.187332+0000","last_unstale":"2023-10-08T06:09:37.197837+0000","last_undegraded":"2023-10-08T06:09:37.197837+0000","last_fullsized":"2023-10-08T06:09:37.197837+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:17:31.653860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.259322+0000","last_change":"2023-10-08T06:09:37.189247+0000","last_active":"2023-10-08T06:09:38.259322+0000","last_peered":"2023-10-08T06:09:38.259322+0000","last_clean":"2023-10-08T06:09:38.259322+0000","last_became_active":"2023-10-08T06:09:37.188933+0000","last_became_peered":"2023-10-08T06:09:37.188933+0000","last_unstale":"2023-10-08T06:09:38.259322+0000","last_undegraded":"2023-10-08T06:09:38.259322+0000","last_fullsized":"2023-10-08T06:09:38.259322+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:37:42.540248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.162400+0000","last_change":"2023-10-08T06:09:37.182750+0000","last_active":"2023-10-08T06:09:38.162400+0000","last_peered":"2023-10-08T06:09:38.162400+0000","last_clean":"2023-10-08T06:09:38.162400+0000","last_became_active":"2023-10-08T06:09:37.182459+0000","last_became_peered":"2023-10-08T06:09:37.182459+0000","last_unstale":"2023-10-08T06:09:38.162400+0000","last_undegraded":"2023-10-08T06:09:38.162400+0000","last_fullsized":"2023-10-08T06:09:38.162400+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:34:25.213819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-08T06:09:37.197857+0000","last_change":"2023-10-08T06:09:37.190585+0000","last_active":"2023-10-08T06:09:37.197857+0000","last_peered":"2023-10-08T06:09:37.197857+0000","last_clean":"2023-10-08T06:09:37.197857+0000","last_became_active":"2023-10-08T06:09:37.190040+0000","last_became_peered":"2023-10-08T06:09:37.190040+0000","last_unstale":"2023-10-08T06:09:37.197857+0000","last_undegraded":"2023-10-08T06:09:37.197857+0000","last_fullsized":"2023-10-08T06:09:37.197857+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:32:07.663697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-08T06:09:37.197077+0000","last_change":"2023-10-08T06:09:37.195008+0000","last_active":"2023-10-08T06:09:37.197077+0000","last_peered":"2023-10-08T06:09:37.197077+0000","last_clean":"2023-10-08T06:09:37.197077+0000","last_became_active":"2023-10-08T06:09:37.191672+0000","last_became_peered":"2023-10-08T06:09:37.191672+0000","last_unstale":"2023-10-08T06:09:37.197077+0000","last_undegraded":"2023-10-08T06:09:37.197077+0000","last_fullsized":"2023-10-08T06:09:37.197077+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:17:12.495543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.165134+0000","last_change":"2023-10-08T06:09:37.182779+0000","last_active":"2023-10-08T06:09:38.165134+0000","last_peered":"2023-10-08T06:09:38.165134+0000","last_clean":"2023-10-08T06:09:38.165134+0000","last_became_active":"2023-10-08T06:09:37.182402+0000","last_became_peered":"2023-10-08T06:09:37.182402+0000","last_unstale":"2023-10-08T06:09:38.165134+0000","last_undegraded":"2023-10-08T06:09:38.165134+0000","last_fullsized":"2023-10-08T06:09:38.165134+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:49:58.972598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-08T06:09:37.192301+0000","last_change":"2023-10-08T06:09:37.186117+0000","last_active":"2023-10-08T06:09:37.192301+0000","last_peered":"2023-10-08T06:09:37.192301+0000","last_clean":"2023-10-08T06:09:37.192301+0000","last_became_active":"2023-10-08T06:09:37.185159+0000","last_became_peered":"2023-10-08T06:09:37.185159+0000","last_unstale":"2023-10-08T06:09:37.192301+0000","last_undegraded":"2023-10-08T06:09:37.192301+0000","last_fullsized":"2023-10-08T06:09:37.192301+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:38:59.919098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.258513+0000","last_change":"2023-10-08T06:09:37.187121+0000","last_active":"2023-10-08T06:09:38.258513+0000","last_peered":"2023-10-08T06:09:38.258513+0000","last_clean":"2023-10-08T06:09:38.258513+0000","last_became_active":"2023-10-08T06:09:37.186834+0000","last_became_peered":"2023-10-08T06:09:37.186834+0000","last_unstale":"2023-10-08T06:09:38.258513+0000","last_undegraded":"2023-10-08T06:09:38.258513+0000","last_fullsized":"2023-10-08T06:09:38.258513+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:22:50.644480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-08T06:09:37.170397+0000","last_change":"2023-10-08T06:09:37.166163+0000","last_active":"2023-10-08T06:09:37.170397+0000","last_peered":"2023-10-08T06:09:37.170397+0000","last_clean":"2023-10-08T06:09:37.170397+0000","last_became_active":"2023-10-08T06:09:37.165819+0000","last_became_peered":"2023-10-08T06:09:37.165819+0000","last_unstale":"2023-10-08T06:09:37.170397+0000","last_undegraded":"2023-10-08T06:09:37.170397+0000","last_fullsized":"2023-10-08T06:09:37.170397+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:07:10.060832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-08T06:09:37.191195+0000","last_change":"2023-10-08T06:09:36.171417+0000","last_active":"2023-10-08T06:09:37.191195+0000","last_peered":"2023-10-08T06:09:37.191195+0000","last_clean":"2023-10-08T06:09:37.191195+0000","last_became_active":"2023-10-08T06:09:36.171084+0000","last_became_peered":"2023-10-08T06:09:36.171084+0000","last_unstale":"2023-10-08T06:09:37.191195+0000","last_undegraded":"2023-10-08T06:09:37.191195+0000","last_fullsized":"2023-10-08T06:09:37.191195+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_clean_scrub_stamp":"2023-10-08T06:09:35.125722+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:27:31.423500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-08T06:09:37.197308+0000","last_change":"2023-10-08T06:09:37.195690+0000","last_active":"2023-10-08T06:09:37.197308+0000","last_peered":"2023-10-08T06:09:37.197308+0000","last_clean":"2023-10-08T06:09:37.197308+0000","last_became_active":"2023-10-08T06:09:37.195446+0000","last_became_peered":"2023-10-08T06:09:37.195446+0000","last_unstale":"2023-10-08T06:09:37.197308+0000","last_undegraded":"2023-10-08T06:09:37.197308+0000","last_fullsized":"2023-10-08T06:09:37.197308+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:20:00.822966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.258516+0000","last_change":"2023-10-08T06:09:36.177551+0000","last_active":"2023-10-08T06:09:38.258516+0000","last_peered":"2023-10-08T06:09:38.258516+0000","last_clean":"2023-10-08T06:09:38.258516+0000","last_became_active":"2023-10-08T06:09:36.176999+0000","last_became_peered":"2023-10-08T06:09:36.176999+0000","last_unstale":"2023-10-08T06:09:38.258516+0000","last_undegraded":"2023-10-08T06:09:38.258516+0000","last_fullsized":"2023-10-08T06:09:38.258516+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_clean_scrub_stamp":"2023-10-08T06:09:35.125722+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:05:49.733090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-08T06:09:37.172190+0000","last_change":"2023-10-08T06:09:36.185251+0000","last_active":"2023-10-08T06:09:37.172190+0000","last_peered":"2023-10-08T06:09:37.172190+0000","last_clean":"2023-10-08T06:09:37.172190+0000","last_became_active":"2023-10-08T06:09:36.185009+0000","last_became_peered":"2023-10-08T06:09:36.185009+0000","last_unstale":"2023-10-08T06:09:37.172190+0000","last_undegraded":"2023-10-08T06:09:37.172190+0000","last_fullsized":"2023-10-08T06:09:37.172190+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_clean_scrub_stamp":"2023-10-08T06:09:35.125722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:23:55.526790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-08T06:09:37.195713+0000","last_change":"2023-10-08T06:09:37.185750+0000","last_active":"2023-10-08T06:09:37.195713+0000","last_peered":"2023-10-08T06:09:37.195713+0000","last_clean":"2023-10-08T06:09:37.195713+0000","last_became_active":"2023-10-08T06:09:37.185376+0000","last_became_peered":"2023-10-08T06:09:37.185376+0000","last_unstale":"2023-10-08T06:09:37.195713+0000","last_undegraded":"2023-10-08T06:09:37.195713+0000","last_fullsized":"2023-10-08T06:09:37.195713+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:55:27.159548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.164429+0000","last_change":"2023-10-08T06:09:36.176796+0000","last_active":"2023-10-08T06:09:38.164429+0000","last_peered":"2023-10-08T06:09:38.164429+0000","last_clean":"2023-10-08T06:09:38.164429+0000","last_became_active":"2023-10-08T06:09:36.176522+0000","last_became_peered":"2023-10-08T06:09:36.176522+0000","last_unstale":"2023-10-08T06:09:38.164429+0000","last_undegraded":"2023-10-08T06:09:38.164429+0000","last_fullsized":"2023-10-08T06:09:38.164429+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_clean_scrub_stamp":"2023-10-08T06:09:35.125722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:05:08.823966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.161590+0000","last_change":"2023-10-08T06:09:37.179556+0000","last_active":"2023-10-08T06:09:38.161590+0000","last_peered":"2023-10-08T06:09:38.161590+0000","last_clean":"2023-10-08T06:09:38.161590+0000","last_became_active":"2023-10-08T06:09:37.179272+0000","last_became_peered":"2023-10-08T06:09:37.179272+0000","last_unstale":"2023-10-08T06:09:38.161590+0000","last_undegraded":"2023-10-08T06:09:38.161590+0000","last_fullsized":"2023-10-08T06:09:38.161590+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:56:29.982869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.258906+0000","last_change":"2023-10-08T06:09:36.177352+0000","last_active":"2023-10-08T06:09:38.258906+0000","last_peered":"2023-10-08T06:09:38.258906+0000","last_clean":"2023-10-08T06:09:38.258906+0000","last_became_active":"2023-10-08T06:09:36.176974+0000","last_became_peered":"2023-10-08T06:09:36.176974+0000","last_unstale":"2023-10-08T06:09:38.258906+0000","last_undegraded":"2023-10-08T06:09:38.258906+0000","last_fullsized":"2023-10-08T06:09:38.258906+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_clean_scrub_stamp":"2023-10-08T06:09:35.125722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:23:11.727351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.166180+0000","last_change":"2023-10-08T06:09:37.186798+0000","last_active":"2023-10-08T06:09:38.166180+0000","last_peered":"2023-10-08T06:09:38.166180+0000","last_clean":"2023-10-08T06:09:38.166180+0000","last_became_active":"2023-10-08T06:09:37.186528+0000","last_became_peered":"2023-10-08T06:09:37.186528+0000","last_unstale":"2023-10-08T06:09:38.166180+0000","last_undegraded":"2023-10-08T06:09:38.166180+0000","last_fullsized":"2023-10-08T06:09:38.166180+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:04:33.773359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.166293+0000","last_change":"2023-10-08T06:09:36.177563+0000","last_active":"2023-10-08T06:09:38.166293+0000","last_peered":"2023-10-08T06:09:38.166293+0000","last_clean":"2023-10-08T06:09:38.166293+0000","last_became_active":"2023-10-08T06:09:36.177299+0000","last_became_peered":"2023-10-08T06:09:36.177299+0000","last_unstale":"2023-10-08T06:09:38.166293+0000","last_undegraded":"2023-10-08T06:09:38.166293+0000","last_fullsized":"2023-10-08T06:09:38.166293+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_clean_scrub_stamp":"2023-10-08T06:09:35.125722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:23:11.727351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-08T06:09:37.196705+0000","last_change":"2023-10-08T06:09:37.194668+0000","last_active":"2023-10-08T06:09:37.196705+0000","last_peered":"2023-10-08T06:09:37.196705+0000","last_clean":"2023-10-08T06:09:37.196705+0000","last_became_active":"2023-10-08T06:09:37.194275+0000","last_became_peered":"2023-10-08T06:09:37.194275+0000","last_unstale":"2023-10-08T06:09:37.196705+0000","last_undegraded":"2023-10-08T06:09:37.196705+0000","last_fullsized":"2023-10-08T06:09:37.196705+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:15:44.339765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.162597+0000","last_change":"2023-10-08T06:09:36.168806+0000","last_active":"2023-10-08T06:09:38.162597+0000","last_peered":"2023-10-08T06:09:38.162597+0000","last_clean":"2023-10-08T06:09:38.162597+0000","last_became_active":"2023-10-08T06:09:36.168379+0000","last_became_peered":"2023-10-08T06:09:36.168379+0000","last_unstale":"2023-10-08T06:09:38.162597+0000","last_undegraded":"2023-10-08T06:09:38.162597+0000","last_fullsized":"2023-10-08T06:09:38.162597+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_clean_scrub_stamp":"2023-10-08T06:09:35.125722+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:15:43.326854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-08T06:09:37.193555+0000","last_change":"2023-10-08T06:09:37.183629+0000","last_active":"2023-10-08T06:09:37.193555+0000","last_peered":"2023-10-08T06:09:37.193555+0000","last_clean":"2023-10-08T06:09:37.193555+0000","last_became_active":"2023-10-08T06:09:37.183318+0000","last_became_peered":"2023-10-08T06:09:37.183318+0000","last_unstale":"2023-10-08T06:09:37.193555+0000","last_undegraded":"2023-10-08T06:09:37.193555+0000","last_fullsized":"2023-10-08T06:09:37.193555+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:57:15.415485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"21'6","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.258922+0000","last_change":"2023-10-08T06:09:36.177043+0000","last_active":"2023-10-08T06:09:38.258922+0000","last_peered":"2023-10-08T06:09:38.258922+0000","last_clean":"2023-10-08T06:09:38.258922+0000","last_became_active":"2023-10-08T06:09:36.176455+0000","last_became_peered":"2023-10-08T06:09:36.176455+0000","last_unstale":"2023-10-08T06:09:38.258922+0000","last_undegraded":"2023-10-08T06:09:38.258922+0000","last_fullsized":"2023-10-08T06:09:38.258922+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_clean_scrub_stamp":"2023-10-08T06:09:35.125722+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:03:55.740286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.165422+0000","last_change":"2023-10-08T06:09:37.187989+0000","last_active":"2023-10-08T06:09:38.165422+0000","last_peered":"2023-10-08T06:09:38.165422+0000","last_clean":"2023-10-08T06:09:38.165422+0000","last_became_active":"2023-10-08T06:09:37.187694+0000","last_became_peered":"2023-10-08T06:09:37.187694+0000","last_unstale":"2023-10-08T06:09:38.165422+0000","last_undegraded":"2023-10-08T06:09:38.165422+0000","last_fullsized":"2023-10-08T06:09:38.165422+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:06:58.385054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-08T06:09:37.195185+0000","last_change":"2023-10-08T06:09:36.180486+0000","last_active":"2023-10-08T06:09:37.195185+0000","last_peered":"2023-10-08T06:09:37.195185+0000","last_clean":"2023-10-08T06:09:37.195185+0000","last_became_active":"2023-10-08T06:09:36.180170+0000","last_became_peered":"2023-10-08T06:09:36.180170+0000","last_unstale":"2023-10-08T06:09:37.195185+0000","last_undegraded":"2023-10-08T06:09:37.195185+0000","last_fullsized":"2023-10-08T06:09:37.195185+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_clean_scrub_stamp":"2023-10-08T06:09:35.125722+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:05:49.733090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-08T06:09:37.197084+0000","last_change":"2023-10-08T06:09:37.195019+0000","last_active":"2023-10-08T06:09:37.197084+0000","last_peered":"2023-10-08T06:09:37.197084+0000","last_clean":"2023-10-08T06:09:37.197084+0000","last_became_active":"2023-10-08T06:09:37.192104+0000","last_became_peered":"2023-10-08T06:09:37.192104+0000","last_unstale":"2023-10-08T06:09:37.197084+0000","last_undegraded":"2023-10-08T06:09:37.197084+0000","last_fullsized":"2023-10-08T06:09:37.197084+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:11:11.824362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.165326+0000","last_change":"2023-10-08T06:09:36.174464+0000","last_active":"2023-10-08T06:09:38.165326+0000","last_peered":"2023-10-08T06:09:38.165326+0000","last_clean":"2023-10-08T06:09:38.165326+0000","last_became_active":"2023-10-08T06:09:36.174144+0000","last_became_peered":"2023-10-08T06:09:36.174144+0000","last_unstale":"2023-10-08T06:09:38.165326+0000","last_undegraded":"2023-10-08T06:09:38.165326+0000","last_fullsized":"2023-10-08T06:09:38.165326+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_clean_scrub_stamp":"2023-10-08T06:09:35.125722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:34:23.204560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.165097+0000","last_change":"2023-10-08T06:09:37.193371+0000","last_active":"2023-10-08T06:09:38.165097+0000","last_peered":"2023-10-08T06:09:38.165097+0000","last_clean":"2023-10-08T06:09:38.165097+0000","last_became_active":"2023-10-08T06:09:37.192842+0000","last_became_peered":"2023-10-08T06:09:37.192842+0000","last_unstale":"2023-10-08T06:09:38.165097+0000","last_undegraded":"2023-10-08T06:09:38.165097+0000","last_fullsized":"2023-10-08T06:09:38.165097+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:16:03.874960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.258443+0000","last_change":"2023-10-08T06:09:36.178850+0000","last_active":"2023-10-08T06:09:38.258443+0000","last_peered":"2023-10-08T06:09:38.258443+0000","last_clean":"2023-10-08T06:09:38.258443+0000","last_became_active":"2023-10-08T06:09:36.178580+0000","last_became_peered":"2023-10-08T06:09:36.178580+0000","last_unstale":"2023-10-08T06:09:38.258443+0000","last_undegraded":"2023-10-08T06:09:38.258443+0000","last_fullsized":"2023-10-08T06:09:38.258443+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_clean_scrub_stamp":"2023-10-08T06:09:35.125722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:52:59.381910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.258458+0000","last_change":"2023-10-08T06:09:37.187049+0000","last_active":"2023-10-08T06:09:38.258458+0000","last_peered":"2023-10-08T06:09:38.258458+0000","last_clean":"2023-10-08T06:09:38.258458+0000","last_became_active":"2023-10-08T06:09:37.186754+0000","last_became_peered":"2023-10-08T06:09:37.186754+0000","last_unstale":"2023-10-08T06:09:38.258458+0000","last_undegraded":"2023-10-08T06:09:38.258458+0000","last_fullsized":"2023-10-08T06:09:38.258458+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:56:29.982869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-08T06:09:37.197500+0000","last_change":"2023-10-08T06:09:36.169901+0000","last_active":"2023-10-08T06:09:37.197500+0000","last_peered":"2023-10-08T06:09:37.197500+0000","last_clean":"2023-10-08T06:09:37.197500+0000","last_became_active":"2023-10-08T06:09:36.169437+0000","last_became_peered":"2023-10-08T06:09:36.169437+0000","last_unstale":"2023-10-08T06:09:37.197500+0000","last_undegraded":"2023-10-08T06:09:37.197500+0000","last_fullsized":"2023-10-08T06:09:37.197500+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_clean_scrub_stamp":"2023-10-08T06:09:35.125722+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:18:04.415654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.163886+0000","last_change":"2023-10-08T06:09:37.192889+0000","last_active":"2023-10-08T06:09:38.163886+0000","last_peered":"2023-10-08T06:09:38.163886+0000","last_clean":"2023-10-08T06:09:38.163886+0000","last_became_active":"2023-10-08T06:09:37.192566+0000","last_became_peered":"2023-10-08T06:09:37.192566+0000","last_unstale":"2023-10-08T06:09:38.163886+0000","last_undegraded":"2023-10-08T06:09:38.163886+0000","last_fullsized":"2023-10-08T06:09:38.163886+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:18:15.487038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-08T06:09:37.188480+0000","last_change":"2023-10-08T06:09:36.174556+0000","last_active":"2023-10-08T06:09:37.188480+0000","last_peered":"2023-10-08T06:09:37.188480+0000","last_clean":"2023-10-08T06:09:37.188480+0000","last_became_active":"2023-10-08T06:09:36.174232+0000","last_became_peered":"2023-10-08T06:09:36.174232+0000","last_unstale":"2023-10-08T06:09:37.188480+0000","last_undegraded":"2023-10-08T06:09:37.188480+0000","last_fullsized":"2023-10-08T06:09:37.188480+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_clean_scrub_stamp":"2023-10-08T06:09:35.125722+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:38:58.906188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.165929+0000","last_change":"2023-10-08T06:09:37.192804+0000","last_active":"2023-10-08T06:09:38.165929+0000","last_peered":"2023-10-08T06:09:38.165929+0000","last_clean":"2023-10-08T06:09:38.165929+0000","last_became_active":"2023-10-08T06:09:37.192500+0000","last_became_peered":"2023-10-08T06:09:37.192500+0000","last_unstale":"2023-10-08T06:09:38.165929+0000","last_undegraded":"2023-10-08T06:09:38.165929+0000","last_fullsized":"2023-10-08T06:09:38.165929+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:04:32.307233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-08T06:09:37.198023+0000","last_change":"2023-10-08T06:09:36.177373+0000","last_active":"2023-10-08T06:09:37.198023+0000","last_peered":"2023-10-08T06:09:37.198023+0000","last_clean":"2023-10-08T06:09:37.198023+0000","last_became_active":"2023-10-08T06:09:36.176919+0000","last_became_peered":"2023-10-08T06:09:36.176919+0000","last_unstale":"2023-10-08T06:09:37.198023+0000","last_undegraded":"2023-10-08T06:09:37.198023+0000","last_fullsized":"2023-10-08T06:09:37.198023+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_clean_scrub_stamp":"2023-10-08T06:09:35.125722+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:19:59.810056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.166276+0000","last_change":"2023-10-08T06:09:37.194526+0000","last_active":"2023-10-08T06:09:38.166276+0000","last_peered":"2023-10-08T06:09:38.166276+0000","last_clean":"2023-10-08T06:09:38.166276+0000","last_became_active":"2023-10-08T06:09:37.193884+0000","last_became_peered":"2023-10-08T06:09:37.193884+0000","last_unstale":"2023-10-08T06:09:38.166276+0000","last_undegraded":"2023-10-08T06:09:38.166276+0000","last_fullsized":"2023-10-08T06:09:38.166276+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:06:09.459089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.162713+0000","last_change":"2023-10-08T06:09:36.175751+0000","last_active":"2023-10-08T06:09:38.162713+0000","last_peered":"2023-10-08T06:09:38.162713+0000","last_clean":"2023-10-08T06:09:38.162713+0000","last_became_active":"2023-10-08T06:09:36.175401+0000","last_became_peered":"2023-10-08T06:09:36.175401+0000","last_unstale":"2023-10-08T06:09:38.162713+0000","last_undegraded":"2023-10-08T06:09:38.162713+0000","last_fullsized":"2023-10-08T06:09:38.162713+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_clean_scrub_stamp":"2023-10-08T06:09:35.125722+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:05:49.733090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.166140+0000","last_change":"2023-10-08T06:09:37.186035+0000","last_active":"2023-10-08T06:09:38.166140+0000","last_peered":"2023-10-08T06:09:38.166140+0000","last_clean":"2023-10-08T06:09:38.166140+0000","last_became_active":"2023-10-08T06:09:37.182569+0000","last_became_peered":"2023-10-08T06:09:37.182569+0000","last_unstale":"2023-10-08T06:09:38.166140+0000","last_undegraded":"2023-10-08T06:09:38.166140+0000","last_fullsized":"2023-10-08T06:09:38.166140+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:36:49.578063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-08T06:09:37.171668+0000","last_change":"2023-10-08T06:09:36.168728+0000","last_active":"2023-10-08T06:09:37.171668+0000","last_peered":"2023-10-08T06:09:37.171668+0000","last_clean":"2023-10-08T06:09:37.171668+0000","last_became_active":"2023-10-08T06:09:36.168339+0000","last_became_peered":"2023-10-08T06:09:36.168339+0000","last_unstale":"2023-10-08T06:09:37.171668+0000","last_undegraded":"2023-10-08T06:09:37.171668+0000","last_fullsized":"2023-10-08T06:09:37.171668+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_clean_scrub_stamp":"2023-10-08T06:09:35.125722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:17:11.482633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.165436+0000","last_change":"2023-10-08T06:09:37.194313+0000","last_active":"2023-10-08T06:09:38.165436+0000","last_peered":"2023-10-08T06:09:38.165436+0000","last_clean":"2023-10-08T06:09:38.165436+0000","last_became_active":"2023-10-08T06:09:37.193990+0000","last_became_peered":"2023-10-08T06:09:37.193990+0000","last_unstale":"2023-10-08T06:09:38.165436+0000","last_undegraded":"2023-10-08T06:09:38.165436+0000","last_fullsized":"2023-10-08T06:09:38.165436+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:36:49.578063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":165,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-08T06:09:37.175106+0000","last_change":"2023-10-08T06:09:24.811692+0000","last_active":"2023-10-08T06:09:37.175106+0000","last_peered":"2023-10-08T06:09:37.175106+0000","last_clean":"2023-10-08T06:09:37.175106+0000","last_became_active":"2023-10-08T06:09:24.809788+0000","last_became_peered":"2023-10-08T06:09:24.809788+0000","last_unstale":"2023-10-08T06:09:37.175106+0000","last_undegraded":"2023-10-08T06:09:37.175106+0000","last_fullsized":"2023-10-08T06:09:37.175106+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:23.748736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:23.748736+0000","last_clean_scrub_stamp":"2023-10-08T06:09:23.748736+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:39:45.599458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.164066+0000","last_change":"2023-10-08T06:09:36.168138+0000","last_active":"2023-10-08T06:09:38.164066+0000","last_peered":"2023-10-08T06:09:38.164066+0000","last_clean":"2023-10-08T06:09:38.164066+0000","last_became_active":"2023-10-08T06:09:36.167559+0000","last_became_peered":"2023-10-08T06:09:36.167559+0000","last_unstale":"2023-10-08T06:09:38.164066+0000","last_undegraded":"2023-10-08T06:09:38.164066+0000","last_fullsized":"2023-10-08T06:09:38.164066+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_clean_scrub_stamp":"2023-10-08T06:09:35.125722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:38:58.906188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-08T06:09:37.181195+0000","last_change":"2023-10-08T06:09:37.174591+0000","last_active":"2023-10-08T06:09:37.181195+0000","last_peered":"2023-10-08T06:09:37.181195+0000","last_clean":"2023-10-08T06:09:37.181195+0000","last_became_active":"2023-10-08T06:09:37.174291+0000","last_became_peered":"2023-10-08T06:09:37.174291+0000","last_unstale":"2023-10-08T06:09:37.181195+0000","last_undegraded":"2023-10-08T06:09:37.181195+0000","last_fullsized":"2023-10-08T06:09:37.181195+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:43:26.242139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.163652+0000","last_change":"2023-10-08T06:09:36.177856+0000","last_active":"2023-10-08T06:09:38.163652+0000","last_peered":"2023-10-08T06:09:38.163652+0000","last_clean":"2023-10-08T06:09:38.163652+0000","last_became_active":"2023-10-08T06:09:36.177525+0000","last_became_peered":"2023-10-08T06:09:36.177525+0000","last_unstale":"2023-10-08T06:09:38.163652+0000","last_undegraded":"2023-10-08T06:09:38.163652+0000","last_fullsized":"2023-10-08T06:09:38.163652+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_clean_scrub_stamp":"2023-10-08T06:09:35.125722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:18:38.124206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-08T06:09:37.191280+0000","last_change":"2023-10-08T06:09:37.188650+0000","last_active":"2023-10-08T06:09:37.191280+0000","last_peered":"2023-10-08T06:09:37.191280+0000","last_clean":"2023-10-08T06:09:37.191280+0000","last_became_active":"2023-10-08T06:09:37.187914+0000","last_became_peered":"2023-10-08T06:09:37.187914+0000","last_unstale":"2023-10-08T06:09:37.191280+0000","last_undegraded":"2023-10-08T06:09:37.191280+0000","last_fullsized":"2023-10-08T06:09:37.191280+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:57:15.415485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-08T06:09:37.172181+0000","last_change":"2023-10-08T06:09:36.174692+0000","last_active":"2023-10-08T06:09:37.172181+0000","last_peered":"2023-10-08T06:09:37.172181+0000","last_clean":"2023-10-08T06:09:37.172181+0000","last_became_active":"2023-10-08T06:09:36.174385+0000","last_became_peered":"2023-10-08T06:09:36.174385+0000","last_unstale":"2023-10-08T06:09:37.172181+0000","last_undegraded":"2023-10-08T06:09:37.172181+0000","last_fullsized":"2023-10-08T06:09:37.172181+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_clean_scrub_stamp":"2023-10-08T06:09:35.125722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:15:43.326854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.161620+0000","last_change":"2023-10-08T06:09:37.180115+0000","last_active":"2023-10-08T06:09:38.161620+0000","last_peered":"2023-10-08T06:09:38.161620+0000","last_clean":"2023-10-08T06:09:38.161620+0000","last_became_active":"2023-10-08T06:09:37.179866+0000","last_became_peered":"2023-10-08T06:09:37.179866+0000","last_unstale":"2023-10-08T06:09:38.161620+0000","last_undegraded":"2023-10-08T06:09:38.161620+0000","last_fullsized":"2023-10-08T06:09:38.161620+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:22:50.644480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.165478+0000","last_change":"2023-10-08T06:09:36.179535+0000","last_active":"2023-10-08T06:09:38.165478+0000","last_peered":"2023-10-08T06:09:38.165478+0000","last_clean":"2023-10-08T06:09:38.165478+0000","last_became_active":"2023-10-08T06:09:36.179229+0000","last_became_peered":"2023-10-08T06:09:36.179229+0000","last_unstale":"2023-10-08T06:09:38.165478+0000","last_undegraded":"2023-10-08T06:09:38.165478+0000","last_fullsized":"2023-10-08T06:09:38.165478+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_clean_scrub_stamp":"2023-10-08T06:09:35.125722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:49:16.044898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-08T06:09:37.194026+0000","last_change":"2023-10-08T06:09:37.187671+0000","last_active":"2023-10-08T06:09:37.194026+0000","last_peered":"2023-10-08T06:09:37.194026+0000","last_clean":"2023-10-08T06:09:37.194026+0000","last_became_active":"2023-10-08T06:09:37.187278+0000","last_became_peered":"2023-10-08T06:09:37.187278+0000","last_unstale":"2023-10-08T06:09:37.194026+0000","last_undegraded":"2023-10-08T06:09:37.194026+0000","last_fullsized":"2023-10-08T06:09:37.194026+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:03:25.190681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.162458+0000","last_change":"2023-10-08T06:09:36.170421+0000","last_active":"2023-10-08T06:09:38.162458+0000","last_peered":"2023-10-08T06:09:38.162458+0000","last_clean":"2023-10-08T06:09:38.162458+0000","last_became_active":"2023-10-08T06:09:36.169186+0000","last_became_peered":"2023-10-08T06:09:36.169186+0000","last_unstale":"2023-10-08T06:09:38.162458+0000","last_undegraded":"2023-10-08T06:09:38.162458+0000","last_fullsized":"2023-10-08T06:09:38.162458+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_clean_scrub_stamp":"2023-10-08T06:09:35.125722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:52:59.381910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.166119+0000","last_change":"2023-10-08T06:09:37.187824+0000","last_active":"2023-10-08T06:09:38.166119+0000","last_peered":"2023-10-08T06:09:38.166119+0000","last_clean":"2023-10-08T06:09:38.166119+0000","last_became_active":"2023-10-08T06:09:37.186117+0000","last_became_peered":"2023-10-08T06:09:37.186117+0000","last_unstale":"2023-10-08T06:09:38.166119+0000","last_undegraded":"2023-10-08T06:09:38.166119+0000","last_fullsized":"2023-10-08T06:09:38.166119+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:06:58.385054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.165731+0000","last_change":"2023-10-08T06:09:36.174520+0000","last_active":"2023-10-08T06:09:38.165731+0000","last_peered":"2023-10-08T06:09:38.165731+0000","last_clean":"2023-10-08T06:09:38.165731+0000","last_became_active":"2023-10-08T06:09:36.174174+0000","last_became_peered":"2023-10-08T06:09:36.174174+0000","last_unstale":"2023-10-08T06:09:38.165731+0000","last_undegraded":"2023-10-08T06:09:38.165731+0000","last_fullsized":"2023-10-08T06:09:38.165731+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_clean_scrub_stamp":"2023-10-08T06:09:35.125722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:21:37.338545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.162247+0000","last_change":"2023-10-08T06:09:37.185459+0000","last_active":"2023-10-08T06:09:38.162247+0000","last_peered":"2023-10-08T06:09:38.162247+0000","last_clean":"2023-10-08T06:09:38.162247+0000","last_became_active":"2023-10-08T06:09:37.185174+0000","last_became_peered":"2023-10-08T06:09:37.185174+0000","last_unstale":"2023-10-08T06:09:38.162247+0000","last_undegraded":"2023-10-08T06:09:38.162247+0000","last_fullsized":"2023-10-08T06:09:38.162247+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:21:38.351456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.162651+0000","last_change":"2023-10-08T06:09:36.180184+0000","last_active":"2023-10-08T06:09:38.162651+0000","last_peered":"2023-10-08T06:09:38.162651+0000","last_clean":"2023-10-08T06:09:38.162651+0000","last_became_active":"2023-10-08T06:09:36.179847+0000","last_became_peered":"2023-10-08T06:09:36.179847+0000","last_unstale":"2023-10-08T06:09:38.162651+0000","last_undegraded":"2023-10-08T06:09:38.162651+0000","last_fullsized":"2023-10-08T06:09:38.162651+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_clean_scrub_stamp":"2023-10-08T06:09:35.125722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:41:18.133708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-08T06:09:37.195849+0000","last_change":"2023-10-08T06:09:37.186300+0000","last_active":"2023-10-08T06:09:37.195849+0000","last_peered":"2023-10-08T06:09:37.195849+0000","last_clean":"2023-10-08T06:09:37.195849+0000","last_became_active":"2023-10-08T06:09:37.185836+0000","last_became_peered":"2023-10-08T06:09:37.185836+0000","last_unstale":"2023-10-08T06:09:37.195849+0000","last_undegraded":"2023-10-08T06:09:37.195849+0000","last_fullsized":"2023-10-08T06:09:37.195849+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:16:24.958518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.259033+0000","last_change":"2023-10-08T06:09:36.177038+0000","last_active":"2023-10-08T06:09:38.259033+0000","last_peered":"2023-10-08T06:09:38.259033+0000","last_clean":"2023-10-08T06:09:38.259033+0000","last_became_active":"2023-10-08T06:09:36.176498+0000","last_became_peered":"2023-10-08T06:09:36.176498+0000","last_unstale":"2023-10-08T06:09:38.259033+0000","last_undegraded":"2023-10-08T06:09:38.259033+0000","last_fullsized":"2023-10-08T06:09:38.259033+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_clean_scrub_stamp":"2023-10-08T06:09:35.125722+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:09:42.887654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-08T06:09:37.189185+0000","last_change":"2023-10-08T06:09:37.183347+0000","last_active":"2023-10-08T06:09:37.189185+0000","last_peered":"2023-10-08T06:09:37.189185+0000","last_clean":"2023-10-08T06:09:37.189185+0000","last_became_active":"2023-10-08T06:09:37.183069+0000","last_became_peered":"2023-10-08T06:09:37.183069+0000","last_unstale":"2023-10-08T06:09:37.189185+0000","last_undegraded":"2023-10-08T06:09:37.189185+0000","last_fullsized":"2023-10-08T06:09:37.189185+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:18:05.428564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.163642+0000","last_change":"2023-10-08T06:09:36.173735+0000","last_active":"2023-10-08T06:09:38.163642+0000","last_peered":"2023-10-08T06:09:38.163642+0000","last_clean":"2023-10-08T06:09:38.163642+0000","last_became_active":"2023-10-08T06:09:36.173306+0000","last_became_peered":"2023-10-08T06:09:36.173306+0000","last_unstale":"2023-10-08T06:09:38.163642+0000","last_undegraded":"2023-10-08T06:09:38.163642+0000","last_fullsized":"2023-10-08T06:09:38.163642+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_clean_scrub_stamp":"2023-10-08T06:09:35.125722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:19:59.810056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-08T06:09:37.191276+0000","last_change":"2023-10-08T06:09:37.183706+0000","last_active":"2023-10-08T06:09:37.191276+0000","last_peered":"2023-10-08T06:09:37.191276+0000","last_clean":"2023-10-08T06:09:37.191276+0000","last_became_active":"2023-10-08T06:09:37.183394+0000","last_became_peered":"2023-10-08T06:09:37.183394+0000","last_unstale":"2023-10-08T06:09:37.191276+0000","last_undegraded":"2023-10-08T06:09:37.191276+0000","last_fullsized":"2023-10-08T06:09:37.191276+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:18:05.428564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.161813+0000","last_change":"2023-10-08T06:09:36.171679+0000","last_active":"2023-10-08T06:09:38.161813+0000","last_peered":"2023-10-08T06:09:38.161813+0000","last_clean":"2023-10-08T06:09:38.161813+0000","last_became_active":"2023-10-08T06:09:36.171169+0000","last_became_peered":"2023-10-08T06:09:36.171169+0000","last_unstale":"2023-10-08T06:09:38.161813+0000","last_undegraded":"2023-10-08T06:09:38.161813+0000","last_fullsized":"2023-10-08T06:09:38.161813+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_clean_scrub_stamp":"2023-10-08T06:09:35.125722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:23:11.727351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-08T06:09:37.182546+0000","last_change":"2023-10-08T06:09:37.176151+0000","last_active":"2023-10-08T06:09:37.182546+0000","last_peered":"2023-10-08T06:09:37.182546+0000","last_clean":"2023-10-08T06:09:37.182546+0000","last_became_active":"2023-10-08T06:09:37.175845+0000","last_became_peered":"2023-10-08T06:09:37.175845+0000","last_unstale":"2023-10-08T06:09:37.182546+0000","last_undegraded":"2023-10-08T06:09:37.182546+0000","last_fullsized":"2023-10-08T06:09:37.182546+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:29:31.010000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.161868+0000","last_change":"2023-10-08T06:09:36.174531+0000","last_active":"2023-10-08T06:09:38.161868+0000","last_peered":"2023-10-08T06:09:38.161868+0000","last_clean":"2023-10-08T06:09:38.161868+0000","last_became_active":"2023-10-08T06:09:36.174216+0000","last_became_peered":"2023-10-08T06:09:36.174216+0000","last_unstale":"2023-10-08T06:09:38.161868+0000","last_undegraded":"2023-10-08T06:09:38.161868+0000","last_fullsized":"2023-10-08T06:09:38.161868+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_clean_scrub_stamp":"2023-10-08T06:09:35.125722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:17:11.482633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-08T06:09:37.198296+0000","last_change":"2023-10-08T06:09:37.191746+0000","last_active":"2023-10-08T06:09:37.198296+0000","last_peered":"2023-10-08T06:09:37.198296+0000","last_clean":"2023-10-08T06:09:37.198296+0000","last_became_active":"2023-10-08T06:09:37.191481+0000","last_became_peered":"2023-10-08T06:09:37.191481+0000","last_unstale":"2023-10-08T06:09:37.198296+0000","last_undegraded":"2023-10-08T06:09:37.198296+0000","last_fullsized":"2023-10-08T06:09:37.198296+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:45:36.408987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.165140+0000","last_change":"2023-10-08T06:09:36.179497+0000","last_active":"2023-10-08T06:09:38.165140+0000","last_peered":"2023-10-08T06:09:38.165140+0000","last_clean":"2023-10-08T06:09:38.165140+0000","last_became_active":"2023-10-08T06:09:36.179129+0000","last_became_peered":"2023-10-08T06:09:36.179129+0000","last_unstale":"2023-10-08T06:09:38.165140+0000","last_undegraded":"2023-10-08T06:09:38.165140+0000","last_fullsized":"2023-10-08T06:09:38.165140+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_clean_scrub_stamp":"2023-10-08T06:09:35.125722+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:34:23.204560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.258598+0000","last_change":"2023-10-08T06:09:37.185754+0000","last_active":"2023-10-08T06:09:38.258598+0000","last_peered":"2023-10-08T06:09:38.258598+0000","last_clean":"2023-10-08T06:09:38.258598+0000","last_became_active":"2023-10-08T06:09:37.185472+0000","last_became_peered":"2023-10-08T06:09:37.185472+0000","last_unstale":"2023-10-08T06:09:38.258598+0000","last_undegraded":"2023-10-08T06:09:38.258598+0000","last_fullsized":"2023-10-08T06:09:38.258598+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:34:24.217470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.166112+0000","last_change":"2023-10-08T06:09:37.181546+0000","last_active":"2023-10-08T06:09:38.166112+0000","last_peered":"2023-10-08T06:09:38.166112+0000","last_clean":"2023-10-08T06:09:38.166112+0000","last_became_active":"2023-10-08T06:09:37.181244+0000","last_became_peered":"2023-10-08T06:09:37.181244+0000","last_unstale":"2023-10-08T06:09:38.166112+0000","last_undegraded":"2023-10-08T06:09:38.166112+0000","last_fullsized":"2023-10-08T06:09:38.166112+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:16:03.874960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.165289+0000","last_change":"2023-10-08T06:09:36.173329+0000","last_active":"2023-10-08T06:09:38.165289+0000","last_peered":"2023-10-08T06:09:38.165289+0000","last_clean":"2023-10-08T06:09:38.165289+0000","last_became_active":"2023-10-08T06:09:36.172872+0000","last_became_peered":"2023-10-08T06:09:36.172872+0000","last_unstale":"2023-10-08T06:09:38.165289+0000","last_undegraded":"2023-10-08T06:09:38.165289+0000","last_fullsized":"2023-10-08T06:09:38.165289+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_clean_scrub_stamp":"2023-10-08T06:09:35.125722+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:56:28.969959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.165938+0000","last_change":"2023-10-08T06:09:37.168180+0000","last_active":"2023-10-08T06:09:38.165938+0000","last_peered":"2023-10-08T06:09:38.165938+0000","last_clean":"2023-10-08T06:09:38.165938+0000","last_became_active":"2023-10-08T06:09:37.167874+0000","last_became_peered":"2023-10-08T06:09:37.167874+0000","last_unstale":"2023-10-08T06:09:38.165938+0000","last_undegraded":"2023-10-08T06:09:38.165938+0000","last_fullsized":"2023-10-08T06:09:38.165938+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:06:27.727341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.165564+0000","last_change":"2023-10-08T06:09:36.181123+0000","last_active":"2023-10-08T06:09:38.165564+0000","last_peered":"2023-10-08T06:09:38.165564+0000","last_clean":"2023-10-08T06:09:38.165564+0000","last_became_active":"2023-10-08T06:09:36.180774+0000","last_became_peered":"2023-10-08T06:09:36.180774+0000","last_unstale":"2023-10-08T06:09:38.165564+0000","last_undegraded":"2023-10-08T06:09:38.165564+0000","last_fullsized":"2023-10-08T06:09:38.165564+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_clean_scrub_stamp":"2023-10-08T06:09:35.125722+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:23:11.727351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-08T06:09:37.196732+0000","last_change":"2023-10-08T06:09:37.194698+0000","last_active":"2023-10-08T06:09:37.196732+0000","last_peered":"2023-10-08T06:09:37.196732+0000","last_clean":"2023-10-08T06:09:37.196732+0000","last_became_active":"2023-10-08T06:09:37.194354+0000","last_became_peered":"2023-10-08T06:09:37.194354+0000","last_unstale":"2023-10-08T06:09:37.196732+0000","last_undegraded":"2023-10-08T06:09:37.196732+0000","last_fullsized":"2023-10-08T06:09:37.196732+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:18:39.137117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-08T06:09:37.191126+0000","last_change":"2023-10-08T06:09:36.175818+0000","last_active":"2023-10-08T06:09:37.191126+0000","last_peered":"2023-10-08T06:09:37.191126+0000","last_clean":"2023-10-08T06:09:37.191126+0000","last_became_active":"2023-10-08T06:09:36.175493+0000","last_became_peered":"2023-10-08T06:09:36.175493+0000","last_unstale":"2023-10-08T06:09:37.191126+0000","last_undegraded":"2023-10-08T06:09:37.191126+0000","last_fullsized":"2023-10-08T06:09:37.191126+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_clean_scrub_stamp":"2023-10-08T06:09:35.125722+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:29:33.964626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-08T06:09:37.195720+0000","last_change":"2023-10-08T06:09:37.183447+0000","last_active":"2023-10-08T06:09:37.195720+0000","last_peered":"2023-10-08T06:09:37.195720+0000","last_clean":"2023-10-08T06:09:37.195720+0000","last_became_active":"2023-10-08T06:09:37.183169+0000","last_became_peered":"2023-10-08T06:09:37.183169+0000","last_unstale":"2023-10-08T06:09:37.195720+0000","last_undegraded":"2023-10-08T06:09:37.195720+0000","last_fullsized":"2023-10-08T06:09:37.195720+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:13:01.305723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"21'4","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-08T06:09:37.192507+0000","last_change":"2023-10-08T06:09:36.173093+0000","last_active":"2023-10-08T06:09:37.192507+0000","last_peered":"2023-10-08T06:09:37.192507+0000","last_clean":"2023-10-08T06:09:37.192507+0000","last_became_active":"2023-10-08T06:09:36.172702+0000","last_became_peered":"2023-10-08T06:09:36.172702+0000","last_unstale":"2023-10-08T06:09:37.192507+0000","last_undegraded":"2023-10-08T06:09:37.192507+0000","last_fullsized":"2023-10-08T06:09:37.192507+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_clean_scrub_stamp":"2023-10-08T06:09:35.125722+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:52:59.381910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509445,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27808,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344032,"statfs":{"total":96636764160,"available":96608288768,"internally_reserved":0,"allocated":806912,"data_stored":660890,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95299999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2210000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0760000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64300000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.121}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85399999999999998}]}]},{"osd":6,"up_from":15,"seq":64424509446,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":233472,"data_stored":77852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0960000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69699999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76000000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2490000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.127}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.484}]}]},{"osd":5,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":212992,"data_stored":70030,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95999999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70099999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81100000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1879999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0580000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0129999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.395}]}]},{"osd":4,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":221184,"data_stored":70066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0429999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84499999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94599999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98299999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.502}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2410000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5549999999999999}]}]},{"osd":2,"up_from":15,"seq":64424509445,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31388,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340452,"statfs":{"total":96636764160,"available":96604622848,"internally_reserved":0,"allocated":208896,"data_stored":69940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75800000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99099999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0609999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82099999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97599999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3740000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2490000000000001}]}]},{"osd":1,"up_from":15,"seq":64424509444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31396,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340444,"statfs":{"total":96636764160,"available":96604614656,"internally_reserved":0,"allocated":217088,"data_stored":70100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52400000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69299999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70799999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78900000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92000000000000004}]}]},{"osd":0,"up_from":15,"seq":64424509445,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31976,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339864,"statfs":{"total":96636764160,"available":96604020736,"internally_reserved":0,"allocated":815104,"data_stored":660946,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79300000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68899999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72199999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88600000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1120000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1519999999999999}]}]},{"osd":3,"up_from":14,"seq":60129542148,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31400,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340440,"statfs":{"total":96636764160,"available":96604610560,"internally_reserved":0,"allocated":221184,"data_stored":71552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60499999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68999999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89400000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.133}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.103}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78100000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93500000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T06:09:40.560 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-08T06:09:40.560 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-10-08T06:09:40.560 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-10-08T06:09:40.560 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-10-08T06:09:40.561 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-10-08T06:09:40.676 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.672+0000 7f6aacd29700 1 Processor -- start 2023-10-08T06:09:40.677 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.672+0000 7f6aacd29700 1 -- start start 2023-10-08T06:09:40.677 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.672+0000 7f6aacd29700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6aa815d980 0x7f6aa80b4d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:40.677 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.672+0000 7f6aacd29700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6aa80d1e70 0x7f6aa80b7140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:40.677 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.672+0000 7f6aacd29700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6aa80b6750 con 0x7f6aa80b5270 2023-10-08T06:09:40.677 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.672+0000 7f6aacd29700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6aa80d2a30 con 0x7f6aa80d1e70 2023-10-08T06:09:40.678 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.672+0000 7f6aacd29700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6aa80b6980 con 0x7f6aa815d980 2023-10-08T06:09:40.678 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.672+0000 7f6aa6d9d700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6aa80d1e70 0x7f6aa80b7140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:40.678 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.672+0000 7f6aa659c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6aa815d980 0x7f6aa80b4d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:40.679 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.672+0000 7f6aa6d9d700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6aa80d1e70 0x7f6aa80b7140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.32:37984/0 (socket says 172.21.15.32:37984) 2023-10-08T06:09:40.679 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.672+0000 7f6aa6d9d700 1 -- 172.21.15.32:0/1156687055 learned_addr learned my addr 172.21.15.32:0/1156687055 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:09:40.679 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.672+0000 7f6aa6d9d700 1 -- 172.21.15.32:0/1156687055 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6aa815d980 msgr2=0x7f6aa80b4d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:09:40.679 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.672+0000 7f6aa6d9d700 1 --2- 172.21.15.32:0/1156687055 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6aa815d980 0x7f6aa80b4d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:40.679 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.672+0000 7f6aa6d9d700 1 -- 172.21.15.32:0/1156687055 >> v1:172.21.15.40:6789/0 conn(0x7f6aa80b5270 legacy=0x7f6aa80d1760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:40.679 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.672+0000 7f6aa559a700 1 -- 172.21.15.32:0/1156687055 <== mon.1 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3462458007 0 0) 0x7f6aa80b6750 con 0x7f6aa80b5270 2023-10-08T06:09:40.679 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.672+0000 7f6aa6d9d700 1 -- 172.21.15.32:0/1156687055 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6aa80b56d0 con 0x7f6aa80d1e70 2023-10-08T06:09:40.680 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.672+0000 7f6aa6d9d700 1 --2- 172.21.15.32:0/1156687055 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6aa80d1e70 0x7f6aa80b7140 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f6a98009910 tx=0x7f6a98009c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3c649c2ff102771f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:40.680 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.672+0000 7f6aa559a700 1 -- 172.21.15.32:0/1156687055 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a98011830 con 0x7f6aa80d1e70 2023-10-08T06:09:40.680 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.672+0000 7f6aa559a700 1 -- 172.21.15.32:0/1156687055 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a98011990 con 0x7f6aa80d1e70 2023-10-08T06:09:40.680 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.672+0000 7f6aa559a700 1 -- 172.21.15.32:0/1156687055 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a98011d40 con 0x7f6aa80d1e70 2023-10-08T06:09:40.681 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.676+0000 7f6aacd29700 1 -- 172.21.15.32:0/1156687055 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6aa80d1e70 msgr2=0x7f6aa80b7140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:40.681 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.676+0000 7f6aacd29700 1 --2- 172.21.15.32:0/1156687055 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6aa80d1e70 0x7f6aa80b7140 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f6a98009910 tx=0x7f6a98009c20 comp rx=0 tx=0).stop 2023-10-08T06:09:40.681 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.676+0000 7f6aacd29700 1 -- 172.21.15.32:0/1156687055 shutdown_connections 2023-10-08T06:09:40.681 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.676+0000 7f6aacd29700 1 --2- 172.21.15.32:0/1156687055 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6aa80d1e70 0x7f6aa80b7140 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:40.681 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.676+0000 7f6aacd29700 1 --2- 172.21.15.32:0/1156687055 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6aa815d980 0x7f6aa80b4d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:40.681 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.676+0000 7f6aacd29700 1 -- 172.21.15.32:0/1156687055 >> 172.21.15.32:0/1156687055 conn(0x7f6aa80cfd30 msgr2=0x7f6aa80d0110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:09:40.681 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.676+0000 7f6aacd29700 1 -- 172.21.15.32:0/1156687055 shutdown_connections 2023-10-08T06:09:40.681 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.676+0000 7f6aacd29700 1 -- 172.21.15.32:0/1156687055 wait complete. 2023-10-08T06:09:40.682 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.676+0000 7f6aacd29700 1 Processor -- start 2023-10-08T06:09:40.682 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.676+0000 7f6aacd29700 1 -- start start 2023-10-08T06:09:40.683 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.676+0000 7f6aacd29700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6aa80b5270 0x7f6aa81f5740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:40.683 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.676+0000 7f6aacd29700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6aa80d1e70 0x7f6aa815f800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:40.684 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.676+0000 7f6aacd29700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6aa80aaab0 0x7f6aa80b4130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:40.684 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.676+0000 7f6aacd29700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6aa8160d80 con 0x7f6aa80aaab0 2023-10-08T06:09:40.684 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.676+0000 7f6aacd29700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6aa8160100 con 0x7f6aa80d1e70 2023-10-08T06:09:40.684 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.676+0000 7f6aacd29700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6aa81603e0 con 0x7f6aa80b5270 2023-10-08T06:09:40.684 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.676+0000 7f6aa6d9d700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6aa80aaab0 0x7f6aa80b4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:40.684 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.676+0000 7f6aa6d9d700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6aa80aaab0 0x7f6aa80b4130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:59138/0 (socket says 172.21.15.32:59138) 2023-10-08T06:09:40.685 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.676+0000 7f6aa6d9d700 1 -- 172.21.15.32:0/1251686324 learned_addr learned my addr 172.21.15.32:0/1251686324 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:09:40.685 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.676+0000 7f6aa659c700 1 --2- 172.21.15.32:0/1251686324 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6aa80b5270 0x7f6aa81f5740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:40.685 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.676+0000 7f6aa5d9b700 1 --2- 172.21.15.32:0/1251686324 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6aa80d1e70 0x7f6aa815f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:40.687 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.680+0000 7f6aa6d9d700 1 -- 172.21.15.32:0/1251686324 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6aa80b5270 msgr2=0x7f6aa81f5740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:40.687 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.680+0000 7f6aa6d9d700 1 --2- 172.21.15.32:0/1251686324 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6aa80b5270 0x7f6aa81f5740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:40.687 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.680+0000 7f6aa6d9d700 1 -- 172.21.15.32:0/1251686324 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6aa80d1e70 msgr2=0x7f6aa815f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:40.687 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.680+0000 7f6aa6d9d700 1 --2- 172.21.15.32:0/1251686324 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6aa80d1e70 0x7f6aa815f800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:40.687 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.680+0000 7f6aa6d9d700 1 -- 172.21.15.32:0/1251686324 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a98009570 con 0x7f6aa80aaab0 2023-10-08T06:09:40.687 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.680+0000 7f6aa6d9d700 1 --2- 172.21.15.32:0/1251686324 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6aa80aaab0 0x7f6aa80b4130 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f6aa80b59c0 tx=0x7f6a98004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:40.688 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.680+0000 7f6a9effd700 1 -- 172.21.15.32:0/1251686324 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a9801a8f0 con 0x7f6aa80aaab0 2023-10-08T06:09:40.688 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.680+0000 7f6a9effd700 1 -- 172.21.15.32:0/1251686324 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a9801e070 con 0x7f6aa80aaab0 2023-10-08T06:09:40.688 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.680+0000 7f6aacd29700 1 -- 172.21.15.32:0/1251686324 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6aa81606c0 con 0x7f6aa80aaab0 2023-10-08T06:09:40.688 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.680+0000 7f6a9effd700 1 -- 172.21.15.32:0/1251686324 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a9801ac90 con 0x7f6aa80aaab0 2023-10-08T06:09:40.688 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.680+0000 7f6aacd29700 1 -- 172.21.15.32:0/1251686324 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6aa81f5c80 con 0x7f6aa80aaab0 2023-10-08T06:09:40.689 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.680+0000 7f6aacd29700 1 -- 172.21.15.32:0/1251686324 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6aa8160ec0 con 0x7f6aa80aaab0 2023-10-08T06:09:40.689 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.680+0000 7f6a9effd700 1 -- 172.21.15.32:0/1251686324 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f6a98024400 con 0x7f6aa80aaab0 2023-10-08T06:09:40.690 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.684+0000 7f6a9effd700 1 --2- 172.21.15.32:0/1251686324 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f6a88066510 0x7f6a880689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:40.690 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.684+0000 7f6a9effd700 1 -- 172.21.15.32:0/1251686324 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6a98084d90 con 0x7f6aa80aaab0 2023-10-08T06:09:40.690 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.684+0000 7f6aa659c700 1 --2- 172.21.15.32:0/1251686324 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f6a88066510 0x7f6a880689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:40.690 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.684+0000 7f6aa659c700 1 --2- 172.21.15.32:0/1251686324 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f6a88066510 0x7f6a880689d0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f6aa80c9c10 tx=0x7f6aa000b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:40.697 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.692+0000 7f6a9effd700 1 -- 172.21.15.32:0/1251686324 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f6aa8160ec0 con 0x7f6aa80aaab0 2023-10-08T06:09:40.715 INFO:tasks.ceph.mds.b.smithi040.stderr:2023-10-08T06:09:40.711+0000 7f8059b9e700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-08T06:09:40.897 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.888+0000 7f6aacd29700 1 -- 172.21.15.32:0/1251686324 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f6aa8160ec0 con 0x7f6aa80aaab0 2023-10-08T06:09:40.898 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.892+0000 7f6a9effd700 1 -- 172.21.15.32:0/1251686324 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+164429 (secure 0 0 0) 0x7f6aa8160ec0 con 0x7f6aa80aaab0 2023-10-08T06:09:40.900 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:09:40.902 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.896+0000 7f6aacd29700 1 -- 172.21.15.32:0/1251686324 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f6a88066510 msgr2=0x7f6a880689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:40.902 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.896+0000 7f6aacd29700 1 --2- 172.21.15.32:0/1251686324 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f6a88066510 0x7f6a880689d0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f6aa80c9c10 tx=0x7f6aa000b040 comp rx=0 tx=0).stop 2023-10-08T06:09:40.902 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.896+0000 7f6aacd29700 1 -- 172.21.15.32:0/1251686324 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6aa80aaab0 msgr2=0x7f6aa80b4130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:40.902 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.896+0000 7f6aacd29700 1 --2- 172.21.15.32:0/1251686324 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6aa80aaab0 0x7f6aa80b4130 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f6aa80b59c0 tx=0x7f6a98004770 comp rx=0 tx=0).stop 2023-10-08T06:09:40.902 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.896+0000 7f6aacd29700 1 -- 172.21.15.32:0/1251686324 shutdown_connections 2023-10-08T06:09:40.902 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.896+0000 7f6aacd29700 1 --2- 172.21.15.32:0/1251686324 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f6a88066510 0x7f6a880689d0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:40.902 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.896+0000 7f6aacd29700 1 --2- 172.21.15.32:0/1251686324 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6aa80aaab0 0x7f6aa80b4130 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:40.902 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.896+0000 7f6aacd29700 1 --2- 172.21.15.32:0/1251686324 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6aa80d1e70 0x7f6aa815f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:40.902 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.896+0000 7f6aacd29700 1 --2- 172.21.15.32:0/1251686324 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6aa80b5270 0x7f6aa81f5740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:40.903 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.896+0000 7f6aacd29700 1 -- 172.21.15.32:0/1251686324 >> 172.21.15.32:0/1251686324 conn(0x7f6aa80cfd30 msgr2=0x7f6aa815bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:09:40.903 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.896+0000 7f6aacd29700 1 -- 172.21.15.32:0/1251686324 shutdown_connections 2023-10-08T06:09:40.903 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:40.896+0000 7f6aacd29700 1 -- 172.21.15.32:0/1251686324 wait complete. 2023-10-08T06:09:40.914 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":5,"active_gid":4107,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6832","nonce":2601628338},{"type":"v1","addr":"172.21.15.32:6833","nonce":2601628338}]},"active_addr":"172.21.15.32:6833/2601628338","active_change":"2023-10-08T06:09:17.233637+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4102,"name":"x","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.3","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.3","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.32:0","nonce":3319913602}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.32:0","nonce":610568327}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.32:0","nonce":2851505517}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.32:0","nonce":1144747073}]}]} 2023-10-08T06:09:40.918 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-10-08T06:09:40.918 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-10-08T06:09:40.918 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T06:09:41.032 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.028+0000 7f8e8dc50700 1 Processor -- start 2023-10-08T06:09:41.032 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.028+0000 7f8e8dc50700 1 -- start start 2023-10-08T06:09:41.033 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.028+0000 7f8e8dc50700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f8e880b8bc0 0x7f8e880cddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:41.034 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.028+0000 7f8e8dc50700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f8e880ce310 0x7f8e880b6130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:41.034 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.028+0000 7f8e8dc50700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e880b9000 con 0x7f8e8815d490 2023-10-08T06:09:41.034 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.028+0000 7f8e8dc50700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e880ce7c0 con 0x7f8e880ce310 2023-10-08T06:09:41.034 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.028+0000 7f8e8dc50700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e880d1bb0 con 0x7f8e880b8bc0 2023-10-08T06:09:41.034 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.028+0000 7f8e8cc4e700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f8e8815d490 0x7f8e880d13d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:46110/0 (socket says 172.21.15.32:46110) 2023-10-08T06:09:41.034 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.028+0000 7f8e8cc4e700 1 -- 172.21.15.32:0/277678764 learned_addr learned my addr 172.21.15.32:0/277678764 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-08T06:09:41.034 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.028+0000 7f8e8d44f700 1 --2- 172.21.15.32:0/277678764 >> v2:172.21.15.32:3300/0 conn(0x7f8e880ce310 0x7f8e880b6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:41.034 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.028+0000 7f8e87fff700 1 --2- 172.21.15.32:0/277678764 >> v2:172.21.15.40:3300/0 conn(0x7f8e880b8bc0 0x7f8e880cddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:41.035 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.028+0000 7f8e877fe700 1 -- 172.21.15.32:0/277678764 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4140451863 0 0) 0x7f8e78001490 con 0x7f8e8815d490 2023-10-08T06:09:41.035 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.028+0000 7f8e877fe700 1 -- 172.21.15.32:0/277678764 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8e740035d0 con 0x7f8e8815d490 2023-10-08T06:09:41.036 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.028+0000 7f8e87fff700 1 -- 172.21.15.32:0/277678764 >> v2:172.21.15.32:3300/0 conn(0x7f8e880ce310 msgr2=0x7f8e880b6130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:09:41.036 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.028+0000 7f8e87fff700 1 --2- 172.21.15.32:0/277678764 >> v2:172.21.15.32:3300/0 conn(0x7f8e880ce310 0x7f8e880b6130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:41.036 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.028+0000 7f8e87fff700 1 -- 172.21.15.32:0/277678764 >> v1:172.21.15.32:6789/0 conn(0x7f8e8815d490 legacy=0x7f8e880d13d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:41.036 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.028+0000 7f8e87fff700 1 -- 172.21.15.32:0/277678764 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e880d1e90 con 0x7f8e880b8bc0 2023-10-08T06:09:41.036 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.028+0000 7f8e8d44f700 1 --2- 172.21.15.32:0/277678764 >> v2:172.21.15.32:3300/0 conn(0x7f8e880ce310 0x7f8e880b6130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T06:09:41.036 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.028+0000 7f8e87fff700 1 --2- 172.21.15.32:0/277678764 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8e880b8bc0 0x7f8e880cddd0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f8e8806bbc0 tx=0x7f8e70009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=794e9f2acc2ec81b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:41.036 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.028+0000 7f8e877fe700 1 -- 172.21.15.32:0/277678764 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e70011830 con 0x7f8e880b8bc0 2023-10-08T06:09:41.036 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.028+0000 7f8e877fe700 1 -- 172.21.15.32:0/277678764 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e70011990 con 0x7f8e880b8bc0 2023-10-08T06:09:41.036 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.028+0000 7f8e877fe700 1 -- 172.21.15.32:0/277678764 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e70011d20 con 0x7f8e880b8bc0 2023-10-08T06:09:41.037 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.032+0000 7f8e8dc50700 1 -- 172.21.15.32:0/277678764 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8e880b8bc0 msgr2=0x7f8e880cddd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:41.037 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.032+0000 7f8e8dc50700 1 --2- 172.21.15.32:0/277678764 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8e880b8bc0 0x7f8e880cddd0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f8e8806bbc0 tx=0x7f8e70009b30 comp rx=0 tx=0).stop 2023-10-08T06:09:41.037 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.032+0000 7f8e8dc50700 1 -- 172.21.15.32:0/277678764 shutdown_connections 2023-10-08T06:09:41.038 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.032+0000 7f8e8dc50700 1 --2- 172.21.15.32:0/277678764 >> v2:172.21.15.32:3300/0 conn(0x7f8e880ce310 0x7f8e880b6130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:41.038 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.032+0000 7f8e8dc50700 1 --2- 172.21.15.32:0/277678764 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8e880b8bc0 0x7f8e880cddd0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:41.038 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.032+0000 7f8e8dc50700 1 -- 172.21.15.32:0/277678764 >> 172.21.15.32:0/277678764 conn(0x7f8e8806ab40 msgr2=0x7f8e8806af20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:09:41.038 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.032+0000 7f8e8dc50700 1 -- 172.21.15.32:0/277678764 shutdown_connections 2023-10-08T06:09:41.038 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.032+0000 7f8e8dc50700 1 -- 172.21.15.32:0/277678764 wait complete. 2023-10-08T06:09:41.040 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.036+0000 7f8e8dc50700 1 Processor -- start 2023-10-08T06:09:41.040 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.036+0000 7f8e8dc50700 1 -- start start 2023-10-08T06:09:41.042 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.036+0000 7f8e8dc50700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8e880b8bc0 0x7f8e881f2200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:41.042 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.036+0000 7f8e8dc50700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8e880ce310 0x7f8e88141550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:41.042 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.036+0000 7f8e8dc50700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8e8815d490 0x7f8e88151130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:41.042 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.036+0000 7f8e8dc50700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e8814ed70 con 0x7f8e880ce310 2023-10-08T06:09:41.042 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.036+0000 7f8e8dc50700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e8815fd50 con 0x7f8e8815d490 2023-10-08T06:09:41.043 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.036+0000 7f8e8dc50700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e88160030 con 0x7f8e880b8bc0 2023-10-08T06:09:41.043 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.036+0000 7f8e87fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8e880ce310 0x7f8e88141550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:41.043 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.036+0000 7f8e87fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8e880ce310 0x7f8e88141550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:59154/0 (socket says 172.21.15.32:59154) 2023-10-08T06:09:41.043 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.036+0000 7f8e87fff700 1 -- 172.21.15.32:0/345555866 learned_addr learned my addr 172.21.15.32:0/345555866 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:09:41.043 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.036+0000 7f8e8cc4e700 1 --2- 172.21.15.32:0/345555866 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8e880b8bc0 0x7f8e881f2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:41.043 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.036+0000 7f8e8d44f700 1 --2- 172.21.15.32:0/345555866 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8e8815d490 0x7f8e88151130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:41.044 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.036+0000 7f8e87fff700 1 -- 172.21.15.32:0/345555866 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8e880b8bc0 msgr2=0x7f8e881f2200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:41.044 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.036+0000 7f8e87fff700 1 --2- 172.21.15.32:0/345555866 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8e880b8bc0 0x7f8e881f2200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:41.044 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.036+0000 7f8e87fff700 1 -- 172.21.15.32:0/345555866 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8e8815d490 msgr2=0x7f8e88151130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:41.044 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.036+0000 7f8e87fff700 1 --2- 172.21.15.32:0/345555866 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8e8815d490 0x7f8e88151130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:41.044 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.036+0000 7f8e87fff700 1 -- 172.21.15.32:0/345555866 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e800094b0 con 0x7f8e880ce310 2023-10-08T06:09:41.044 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.036+0000 7f8e87fff700 1 --2- 172.21.15.32:0/345555866 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8e880ce310 0x7f8e88141550 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f8e700090b0 tx=0x7f8e70004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:41.045 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.036+0000 7f8e857fa700 1 -- 172.21.15.32:0/345555866 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e70004340 con 0x7f8e880ce310 2023-10-08T06:09:41.045 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.036+0000 7f8e857fa700 1 -- 172.21.15.32:0/345555866 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e7001f070 con 0x7f8e880ce310 2023-10-08T06:09:41.045 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.040+0000 7f8e8dc50700 1 -- 172.21.15.32:0/345555866 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e700094b0 con 0x7f8e880ce310 2023-10-08T06:09:41.045 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.040+0000 7f8e857fa700 1 -- 172.21.15.32:0/345555866 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e700036c0 con 0x7f8e880ce310 2023-10-08T06:09:41.045 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.040+0000 7f8e8dc50700 1 -- 172.21.15.32:0/345555866 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e881605f0 con 0x7f8e880ce310 2023-10-08T06:09:41.045 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.040+0000 7f8e8dc50700 1 -- 172.21.15.32:0/345555866 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e8814eeb0 con 0x7f8e880ce310 2023-10-08T06:09:41.047 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.040+0000 7f8e857fa700 1 -- 172.21.15.32:0/345555866 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f8e70021030 con 0x7f8e880ce310 2023-10-08T06:09:41.048 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.044+0000 7f8e857fa700 1 --2- 172.21.15.32:0/345555866 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f8e68066510 0x7f8e680689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:41.048 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.044+0000 7f8e857fa700 1 -- 172.21.15.32:0/345555866 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8e70085680 con 0x7f8e880ce310 2023-10-08T06:09:41.048 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.044+0000 7f8e8cc4e700 1 --2- 172.21.15.32:0/345555866 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f8e68066510 0x7f8e680689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:41.048 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.044+0000 7f8e8cc4e700 1 --2- 172.21.15.32:0/345555866 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f8e68066510 0x7f8e680689d0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f8e780015f0 tx=0x7f8e78001a00 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:41.052 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.048+0000 7f8e857fa700 1 -- 172.21.15.32:0/345555866 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f8e8814eeb0 con 0x7f8e880ce310 2023-10-08T06:09:41.217 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.212+0000 7f8e8dc50700 1 -- 172.21.15.32:0/345555866 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8e8814eeb0 con 0x7f8e880ce310 2023-10-08T06:09:41.219 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.212+0000 7f8e857fa700 1 -- 172.21.15.32:0/345555866 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16445 (secure 0 0 0) 0x7f8e8814eeb0 con 0x7f8e880ce310 2023-10-08T06:09:41.220 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:09:41.220 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":22,"fsid":"ac672d87-96ae-41e0-9314-623ba2cdbbba","created":"2023-10-08T06:09:11.175626+0000","modified":"2023-10-08T06:09:38.153256+0000","last_up_change":"2023-10-08T06:09:22.744643+0000","last_in_change":"2023-10-08T06:09:14.131580+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T06:09:23.307843+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T06:09:34.295012+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T06:09:35.515590+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"43433f0c-9592-4874-92d7-10f8f4acf07f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":587888964},{"type":"v1","addr":"172.21.15.32:6801","nonce":587888964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":587888964},{"type":"v1","addr":"172.21.15.32:6803","nonce":587888964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":587888964},{"type":"v1","addr":"172.21.15.32:6810","nonce":587888964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6805","nonce":587888964},{"type":"v1","addr":"172.21.15.32:6807","nonce":587888964}]},"public_addr":"172.21.15.32:6801/587888964","cluster_addr":"172.21.15.32:6803/587888964","heartbeat_back_addr":"172.21.15.32:6810/587888964","heartbeat_front_addr":"172.21.15.32:6807/587888964","state":["exists","up"]},{"osd":1,"uuid":"2ecb1008-b987-4ce7-b646-6cded55fc8d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":990576767},{"type":"v1","addr":"172.21.15.32:6817","nonce":990576767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":990576767},{"type":"v1","addr":"172.21.15.32:6819","nonce":990576767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":990576767},{"type":"v1","addr":"172.21.15.32:6823","nonce":990576767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":990576767},{"type":"v1","addr":"172.21.15.32:6821","nonce":990576767}]},"public_addr":"172.21.15.32:6817/990576767","cluster_addr":"172.21.15.32:6819/990576767","heartbeat_back_addr":"172.21.15.32:6823/990576767","heartbeat_front_addr":"172.21.15.32:6821/990576767","state":["exists","up"]},{"osd":2,"uuid":"1b131c94-c09b-4e80-8746-bf1b7bac362d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6824","nonce":1566874440},{"type":"v1","addr":"172.21.15.32:6825","nonce":1566874440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":1566874440},{"type":"v1","addr":"172.21.15.32:6827","nonce":1566874440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":1566874440},{"type":"v1","addr":"172.21.15.32:6831","nonce":1566874440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":1566874440},{"type":"v1","addr":"172.21.15.32:6829","nonce":1566874440}]},"public_addr":"172.21.15.32:6825/1566874440","cluster_addr":"172.21.15.32:6827/1566874440","heartbeat_back_addr":"172.21.15.32:6831/1566874440","heartbeat_front_addr":"172.21.15.32:6829/1566874440","state":["exists","up"]},{"osd":3,"uuid":"ad655af2-1f6f-4689-b21d-b07bbaeb68b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":3672614802},{"type":"v1","addr":"172.21.15.32:6806","nonce":3672614802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6809","nonce":3672614802},{"type":"v1","addr":"172.21.15.32:6811","nonce":3672614802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":3672614802},{"type":"v1","addr":"172.21.15.32:6815","nonce":3672614802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":3672614802},{"type":"v1","addr":"172.21.15.32:6813","nonce":3672614802}]},"public_addr":"172.21.15.32:6806/3672614802","cluster_addr":"172.21.15.32:6811/3672614802","heartbeat_back_addr":"172.21.15.32:6815/3672614802","heartbeat_front_addr":"172.21.15.32:6813/3672614802","state":["exists","up"]},{"osd":4,"uuid":"64a543a1-8c4f-458e-9aba-b35c1cd7dd03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":3369928244},{"type":"v1","addr":"172.21.15.40:6801","nonce":3369928244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":3369928244},{"type":"v1","addr":"172.21.15.40:6803","nonce":3369928244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":3369928244},{"type":"v1","addr":"172.21.15.40:6807","nonce":3369928244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":3369928244},{"type":"v1","addr":"172.21.15.40:6805","nonce":3369928244}]},"public_addr":"172.21.15.40:6801/3369928244","cluster_addr":"172.21.15.40:6803/3369928244","heartbeat_back_addr":"172.21.15.40:6807/3369928244","heartbeat_front_addr":"172.21.15.40:6805/3369928244","state":["exists","up"]},{"osd":5,"uuid":"0fef3e54-edb4-4678-878e-944663c51638","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":2395850297},{"type":"v1","addr":"172.21.15.40:6825","nonce":2395850297}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":2395850297},{"type":"v1","addr":"172.21.15.40:6827","nonce":2395850297}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":2395850297},{"type":"v1","addr":"172.21.15.40:6831","nonce":2395850297}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":2395850297},{"type":"v1","addr":"172.21.15.40:6829","nonce":2395850297}]},"public_addr":"172.21.15.40:6825/2395850297","cluster_addr":"172.21.15.40:6827/2395850297","heartbeat_back_addr":"172.21.15.40:6831/2395850297","heartbeat_front_addr":"172.21.15.40:6829/2395850297","state":["exists","up"]},{"osd":6,"uuid":"2eeb0472-6096-469d-9b2c-cab4bf41c31a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":4145283410},{"type":"v1","addr":"172.21.15.40:6809","nonce":4145283410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":4145283410},{"type":"v1","addr":"172.21.15.40:6811","nonce":4145283410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":4145283410},{"type":"v1","addr":"172.21.15.40:6815","nonce":4145283410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":4145283410},{"type":"v1","addr":"172.21.15.40:6813","nonce":4145283410}]},"public_addr":"172.21.15.40:6809/4145283410","cluster_addr":"172.21.15.40:6811/4145283410","heartbeat_back_addr":"172.21.15.40:6815/4145283410","heartbeat_front_addr":"172.21.15.40:6813/4145283410","state":["exists","up"]},{"osd":7,"uuid":"cf76e4c7-96a6-401f-a280-91aad4641940","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":2943297416},{"type":"v1","addr":"172.21.15.40:6817","nonce":2943297416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":2943297416},{"type":"v1","addr":"172.21.15.40:6819","nonce":2943297416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":2943297416},{"type":"v1","addr":"172.21.15.40:6823","nonce":2943297416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":2943297416},{"type":"v1","addr":"172.21.15.40:6821","nonce":2943297416}]},"public_addr":"172.21.15.40:6817/2943297416","cluster_addr":"172.21.15.40:6819/2943297416","heartbeat_back_addr":"172.21.15.40:6823/2943297416","heartbeat_front_addr":"172.21.15.40:6821/2943297416","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.411475+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.628841+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.599055+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.166100+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.384135+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.488403+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.307648+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.363541+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T06:09:41.222 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.216+0000 7f8e8dc50700 1 -- 172.21.15.32:0/345555866 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f8e68066510 msgr2=0x7f8e680689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:41.223 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.216+0000 7f8e8dc50700 1 --2- 172.21.15.32:0/345555866 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f8e68066510 0x7f8e680689d0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f8e780015f0 tx=0x7f8e78001a00 comp rx=0 tx=0).stop 2023-10-08T06:09:41.223 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.216+0000 7f8e8dc50700 1 -- 172.21.15.32:0/345555866 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8e880ce310 msgr2=0x7f8e88141550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:41.223 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.216+0000 7f8e8dc50700 1 --2- 172.21.15.32:0/345555866 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8e880ce310 0x7f8e88141550 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f8e700090b0 tx=0x7f8e70004770 comp rx=0 tx=0).stop 2023-10-08T06:09:41.223 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.216+0000 7f8e8dc50700 1 -- 172.21.15.32:0/345555866 shutdown_connections 2023-10-08T06:09:41.223 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.216+0000 7f8e8dc50700 1 --2- 172.21.15.32:0/345555866 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f8e68066510 0x7f8e680689d0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:41.223 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.216+0000 7f8e8dc50700 1 --2- 172.21.15.32:0/345555866 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8e880ce310 0x7f8e88141550 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:41.223 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.216+0000 7f8e8dc50700 1 --2- 172.21.15.32:0/345555866 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8e8815d490 0x7f8e88151130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:41.223 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.216+0000 7f8e8dc50700 1 --2- 172.21.15.32:0/345555866 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8e880b8bc0 0x7f8e881f2200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:41.223 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.216+0000 7f8e8dc50700 1 -- 172.21.15.32:0/345555866 >> 172.21.15.32:0/345555866 conn(0x7f8e8806ab40 msgr2=0x7f8e8815c570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:09:41.224 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.216+0000 7f8e8dc50700 1 -- 172.21.15.32:0/345555866 shutdown_connections 2023-10-08T06:09:41.224 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.216+0000 7f8e8dc50700 1 -- 172.21.15.32:0/345555866 wait complete. 2023-10-08T06:09:41.239 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-10-08T06:09:41.239 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T06:09:41.351 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.344+0000 7fe2620a6700 1 Processor -- start 2023-10-08T06:09:41.351 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.344+0000 7fe2620a6700 1 -- start start 2023-10-08T06:09:41.351 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.348+0000 7fe2620a6700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe25c15d4b0 0x7fe25c161110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:41.352 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.348+0000 7fe2620a6700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe25c0b8b20 0x7fe25c0cdef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:41.352 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.348+0000 7fe2620a6700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fe25c0ce430 0x7fe25c0b4ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:41.352 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.348+0000 7fe2620a6700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe25c0ce8e0 con 0x7fe25c0ce430 2023-10-08T06:09:41.352 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.348+0000 7fe2620a6700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe25c0d1620 con 0x7fe25c0b8b20 2023-10-08T06:09:41.352 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.348+0000 7fe2620a6700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe25c0d1320 con 0x7fe25c15d4b0 2023-10-08T06:09:41.353 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.348+0000 7fe2618a5700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fe25c0ce430 0x7fe25c0b4ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:41.353 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.348+0000 7fe2608a3700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe25c0b8b20 0x7fe25c0cdef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:41.353 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.348+0000 7fe2610a4700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe25c15d4b0 0x7fe25c161110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:41.353 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.348+0000 7fe2608a3700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe25c0b8b20 0x7fe25c0cdef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.32:38028/0 (socket says 172.21.15.32:38028) 2023-10-08T06:09:41.353 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.348+0000 7fe2618a5700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fe25c0ce430 0x7fe25c0b4ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:59162/0 (socket says 172.21.15.32:59162) 2023-10-08T06:09:41.354 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.348+0000 7fe2608a3700 1 -- 172.21.15.32:0/3286054983 learned_addr learned my addr 172.21.15.32:0/3286054983 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:09:41.354 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.348+0000 7fe2618a5700 1 -- 172.21.15.32:0/3286054983 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe25c15d4b0 msgr2=0x7fe25c161110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:09:41.354 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.348+0000 7fe2618a5700 1 --2- 172.21.15.32:0/3286054983 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe25c15d4b0 0x7fe25c161110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:41.354 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.348+0000 7fe2618a5700 1 -- 172.21.15.32:0/3286054983 >> v2:172.21.15.40:3300/0 conn(0x7fe25c0b8b20 msgr2=0x7fe25c0cdef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:09:41.354 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.348+0000 7fe2618a5700 1 --2- 172.21.15.32:0/3286054983 >> v2:172.21.15.40:3300/0 conn(0x7fe25c0b8b20 0x7fe25c0cdef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:41.354 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.348+0000 7fe2618a5700 1 -- 172.21.15.32:0/3286054983 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe25c1619f0 con 0x7fe25c0ce430 2023-10-08T06:09:41.354 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.348+0000 7fe2608a3700 1 --2- 172.21.15.32:0/3286054983 >> v2:172.21.15.40:3300/0 conn(0x7fe25c0b8b20 0x7fe25c0cdef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T06:09:41.354 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.348+0000 7fe2618a5700 1 --2- 172.21.15.32:0/3286054983 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe25c0ce430 0x7fe25c0b4ba0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fe25c072770 tx=0x7fe25400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d560c598b319d497 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:41.355 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.348+0000 7fe253fff700 1 -- 172.21.15.32:0/3286054983 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe25400e070 con 0x7fe25c0ce430 2023-10-08T06:09:41.355 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.348+0000 7fe253fff700 1 -- 172.21.15.32:0/3286054983 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe25400bb20 con 0x7fe25c0ce430 2023-10-08T06:09:41.355 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.348+0000 7fe253fff700 1 -- 172.21.15.32:0/3286054983 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe254012430 con 0x7fe25c0ce430 2023-10-08T06:09:41.355 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.348+0000 7fe2620a6700 1 -- 172.21.15.32:0/3286054983 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe25c0ce430 msgr2=0x7fe25c0b4ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:41.356 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.348+0000 7fe2620a6700 1 --2- 172.21.15.32:0/3286054983 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe25c0ce430 0x7fe25c0b4ba0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fe25c072770 tx=0x7fe25400b330 comp rx=0 tx=0).stop 2023-10-08T06:09:41.356 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.348+0000 7fe2620a6700 1 -- 172.21.15.32:0/3286054983 shutdown_connections 2023-10-08T06:09:41.356 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.348+0000 7fe2620a6700 1 --2- 172.21.15.32:0/3286054983 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe25c0ce430 0x7fe25c0b4ba0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:41.356 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.348+0000 7fe2620a6700 1 --2- 172.21.15.32:0/3286054983 >> v2:172.21.15.40:3300/0 conn(0x7fe25c0b8b20 0x7fe25c0cdef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:41.356 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.348+0000 7fe2620a6700 1 --2- 172.21.15.32:0/3286054983 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe25c15d4b0 0x7fe25c161110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:41.356 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.348+0000 7fe2620a6700 1 -- 172.21.15.32:0/3286054983 >> 172.21.15.32:0/3286054983 conn(0x7fe25c06ac60 msgr2=0x7fe25c06b070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:09:41.356 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.348+0000 7fe2620a6700 1 -- 172.21.15.32:0/3286054983 shutdown_connections 2023-10-08T06:09:41.356 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.348+0000 7fe2620a6700 1 -- 172.21.15.32:0/3286054983 wait complete. 2023-10-08T06:09:41.358 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.352+0000 7fe2620a6700 1 Processor -- start 2023-10-08T06:09:41.358 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.352+0000 7fe2620a6700 1 -- start start 2023-10-08T06:09:41.358 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.352+0000 7fe2620a6700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe25c0b8b20 0x7fe25c1f25b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:41.358 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.352+0000 7fe2620a6700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe25c0ce430 0x7fe25c0b4390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:41.358 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.352+0000 7fe2620a6700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe25c15d4b0 0x7fe25c0b48d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:41.358 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.352+0000 7fe2620a6700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe25c0b5a80 con 0x7fe25c15d4b0 2023-10-08T06:09:41.358 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.352+0000 7fe2620a6700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe25c15e540 con 0x7fe25c0ce430 2023-10-08T06:09:41.358 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.352+0000 7fe2620a6700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe25c0b4f00 con 0x7fe25c0b8b20 2023-10-08T06:09:41.358 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.352+0000 7fe2618a5700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe25c15d4b0 0x7fe25c0b48d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:41.359 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.352+0000 7fe2618a5700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe25c15d4b0 0x7fe25c0b48d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:59170/0 (socket says 172.21.15.32:59170) 2023-10-08T06:09:41.359 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.352+0000 7fe2618a5700 1 -- 172.21.15.32:0/2390247161 learned_addr learned my addr 172.21.15.32:0/2390247161 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:09:41.359 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.352+0000 7fe2608a3700 1 --2- 172.21.15.32:0/2390247161 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe25c0ce430 0x7fe25c0b4390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:41.359 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.352+0000 7fe2610a4700 1 --2- 172.21.15.32:0/2390247161 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe25c0b8b20 0x7fe25c1f25b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:41.359 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.352+0000 7fe2618a5700 1 -- 172.21.15.32:0/2390247161 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe25c0b8b20 msgr2=0x7fe25c1f25b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:41.359 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.352+0000 7fe2618a5700 1 --2- 172.21.15.32:0/2390247161 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe25c0b8b20 0x7fe25c1f25b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:41.359 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.352+0000 7fe2618a5700 1 -- 172.21.15.32:0/2390247161 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe25c0ce430 msgr2=0x7fe25c0b4390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:41.359 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.352+0000 7fe2618a5700 1 --2- 172.21.15.32:0/2390247161 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe25c0ce430 0x7fe25c0b4390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:41.359 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.352+0000 7fe2618a5700 1 -- 172.21.15.32:0/2390247161 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe258009570 con 0x7fe25c15d4b0 2023-10-08T06:09:41.359 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.352+0000 7fe2618a5700 1 --2- 172.21.15.32:0/2390247161 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe25c15d4b0 0x7fe25c0b48d0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fe254014040 tx=0x7fe254004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:41.360 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.352+0000 7fe251ffb700 1 -- 172.21.15.32:0/2390247161 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe254004960 con 0x7fe25c15d4b0 2023-10-08T06:09:41.360 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.352+0000 7fe251ffb700 1 -- 172.21.15.32:0/2390247161 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe254020070 con 0x7fe25c15d4b0 2023-10-08T06:09:41.361 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.352+0000 7fe2620a6700 1 -- 172.21.15.32:0/2390247161 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe254009a70 con 0x7fe25c15d4b0 2023-10-08T06:09:41.361 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.352+0000 7fe251ffb700 1 -- 172.21.15.32:0/2390247161 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2540276e0 con 0x7fe25c15d4b0 2023-10-08T06:09:41.361 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.352+0000 7fe2620a6700 1 -- 172.21.15.32:0/2390247161 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe25c0b54c0 con 0x7fe25c15d4b0 2023-10-08T06:09:41.361 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.356+0000 7fe2620a6700 1 -- 172.21.15.32:0/2390247161 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe25c0686a0 con 0x7fe25c15d4b0 2023-10-08T06:09:41.361 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.356+0000 7fe251ffb700 1 -- 172.21.15.32:0/2390247161 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fe254012430 con 0x7fe25c15d4b0 2023-10-08T06:09:41.361 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.356+0000 7fe251ffb700 1 --2- 172.21.15.32:0/2390247161 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fe240066510 0x7fe2400689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:41.362 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.356+0000 7fe251ffb700 1 -- 172.21.15.32:0/2390247161 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe254022070 con 0x7fe25c15d4b0 2023-10-08T06:09:41.362 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.356+0000 7fe2610a4700 1 --2- 172.21.15.32:0/2390247161 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fe240066510 0x7fe2400689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:41.362 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.356+0000 7fe2610a4700 1 --2- 172.21.15.32:0/2390247161 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fe240066510 0x7fe2400689d0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fe24c009b80 tx=0x7fe24c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:41.369 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.364+0000 7fe251ffb700 1 -- 172.21.15.32:0/2390247161 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fe254052f80 con 0x7fe25c15d4b0 2023-10-08T06:09:41.535 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.528+0000 7fe2620a6700 1 -- 172.21.15.32:0/2390247161 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe25c0d0e30 con 0x7fe25c15d4b0 2023-10-08T06:09:41.536 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.532+0000 7fe251ffb700 1 -- 172.21.15.32:0/2390247161 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16445 (secure 0 0 0) 0x7fe25402c090 con 0x7fe25c15d4b0 2023-10-08T06:09:41.537 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:09:41.537 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":22,"fsid":"ac672d87-96ae-41e0-9314-623ba2cdbbba","created":"2023-10-08T06:09:11.175626+0000","modified":"2023-10-08T06:09:38.153256+0000","last_up_change":"2023-10-08T06:09:22.744643+0000","last_in_change":"2023-10-08T06:09:14.131580+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T06:09:23.307843+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T06:09:34.295012+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T06:09:35.515590+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"43433f0c-9592-4874-92d7-10f8f4acf07f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":587888964},{"type":"v1","addr":"172.21.15.32:6801","nonce":587888964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":587888964},{"type":"v1","addr":"172.21.15.32:6803","nonce":587888964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":587888964},{"type":"v1","addr":"172.21.15.32:6810","nonce":587888964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6805","nonce":587888964},{"type":"v1","addr":"172.21.15.32:6807","nonce":587888964}]},"public_addr":"172.21.15.32:6801/587888964","cluster_addr":"172.21.15.32:6803/587888964","heartbeat_back_addr":"172.21.15.32:6810/587888964","heartbeat_front_addr":"172.21.15.32:6807/587888964","state":["exists","up"]},{"osd":1,"uuid":"2ecb1008-b987-4ce7-b646-6cded55fc8d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":990576767},{"type":"v1","addr":"172.21.15.32:6817","nonce":990576767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":990576767},{"type":"v1","addr":"172.21.15.32:6819","nonce":990576767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":990576767},{"type":"v1","addr":"172.21.15.32:6823","nonce":990576767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":990576767},{"type":"v1","addr":"172.21.15.32:6821","nonce":990576767}]},"public_addr":"172.21.15.32:6817/990576767","cluster_addr":"172.21.15.32:6819/990576767","heartbeat_back_addr":"172.21.15.32:6823/990576767","heartbeat_front_addr":"172.21.15.32:6821/990576767","state":["exists","up"]},{"osd":2,"uuid":"1b131c94-c09b-4e80-8746-bf1b7bac362d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6824","nonce":1566874440},{"type":"v1","addr":"172.21.15.32:6825","nonce":1566874440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":1566874440},{"type":"v1","addr":"172.21.15.32:6827","nonce":1566874440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":1566874440},{"type":"v1","addr":"172.21.15.32:6831","nonce":1566874440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":1566874440},{"type":"v1","addr":"172.21.15.32:6829","nonce":1566874440}]},"public_addr":"172.21.15.32:6825/1566874440","cluster_addr":"172.21.15.32:6827/1566874440","heartbeat_back_addr":"172.21.15.32:6831/1566874440","heartbeat_front_addr":"172.21.15.32:6829/1566874440","state":["exists","up"]},{"osd":3,"uuid":"ad655af2-1f6f-4689-b21d-b07bbaeb68b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":3672614802},{"type":"v1","addr":"172.21.15.32:6806","nonce":3672614802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6809","nonce":3672614802},{"type":"v1","addr":"172.21.15.32:6811","nonce":3672614802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":3672614802},{"type":"v1","addr":"172.21.15.32:6815","nonce":3672614802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":3672614802},{"type":"v1","addr":"172.21.15.32:6813","nonce":3672614802}]},"public_addr":"172.21.15.32:6806/3672614802","cluster_addr":"172.21.15.32:6811/3672614802","heartbeat_back_addr":"172.21.15.32:6815/3672614802","heartbeat_front_addr":"172.21.15.32:6813/3672614802","state":["exists","up"]},{"osd":4,"uuid":"64a543a1-8c4f-458e-9aba-b35c1cd7dd03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":3369928244},{"type":"v1","addr":"172.21.15.40:6801","nonce":3369928244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":3369928244},{"type":"v1","addr":"172.21.15.40:6803","nonce":3369928244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":3369928244},{"type":"v1","addr":"172.21.15.40:6807","nonce":3369928244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":3369928244},{"type":"v1","addr":"172.21.15.40:6805","nonce":3369928244}]},"public_addr":"172.21.15.40:6801/3369928244","cluster_addr":"172.21.15.40:6803/3369928244","heartbeat_back_addr":"172.21.15.40:6807/3369928244","heartbeat_front_addr":"172.21.15.40:6805/3369928244","state":["exists","up"]},{"osd":5,"uuid":"0fef3e54-edb4-4678-878e-944663c51638","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":2395850297},{"type":"v1","addr":"172.21.15.40:6825","nonce":2395850297}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":2395850297},{"type":"v1","addr":"172.21.15.40:6827","nonce":2395850297}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":2395850297},{"type":"v1","addr":"172.21.15.40:6831","nonce":2395850297}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":2395850297},{"type":"v1","addr":"172.21.15.40:6829","nonce":2395850297}]},"public_addr":"172.21.15.40:6825/2395850297","cluster_addr":"172.21.15.40:6827/2395850297","heartbeat_back_addr":"172.21.15.40:6831/2395850297","heartbeat_front_addr":"172.21.15.40:6829/2395850297","state":["exists","up"]},{"osd":6,"uuid":"2eeb0472-6096-469d-9b2c-cab4bf41c31a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":4145283410},{"type":"v1","addr":"172.21.15.40:6809","nonce":4145283410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":4145283410},{"type":"v1","addr":"172.21.15.40:6811","nonce":4145283410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":4145283410},{"type":"v1","addr":"172.21.15.40:6815","nonce":4145283410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":4145283410},{"type":"v1","addr":"172.21.15.40:6813","nonce":4145283410}]},"public_addr":"172.21.15.40:6809/4145283410","cluster_addr":"172.21.15.40:6811/4145283410","heartbeat_back_addr":"172.21.15.40:6815/4145283410","heartbeat_front_addr":"172.21.15.40:6813/4145283410","state":["exists","up"]},{"osd":7,"uuid":"cf76e4c7-96a6-401f-a280-91aad4641940","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":2943297416},{"type":"v1","addr":"172.21.15.40:6817","nonce":2943297416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":2943297416},{"type":"v1","addr":"172.21.15.40:6819","nonce":2943297416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":2943297416},{"type":"v1","addr":"172.21.15.40:6823","nonce":2943297416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":2943297416},{"type":"v1","addr":"172.21.15.40:6821","nonce":2943297416}]},"public_addr":"172.21.15.40:6817/2943297416","cluster_addr":"172.21.15.40:6819/2943297416","heartbeat_back_addr":"172.21.15.40:6823/2943297416","heartbeat_front_addr":"172.21.15.40:6821/2943297416","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.411475+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.628841+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.599055+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.166100+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.384135+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.488403+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.307648+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.363541+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T06:09:41.539 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.532+0000 7fe2620a6700 1 -- 172.21.15.32:0/2390247161 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fe240066510 msgr2=0x7fe2400689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:41.540 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.532+0000 7fe2620a6700 1 --2- 172.21.15.32:0/2390247161 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fe240066510 0x7fe2400689d0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fe24c009b80 tx=0x7fe24c008040 comp rx=0 tx=0).stop 2023-10-08T06:09:41.540 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.532+0000 7fe2620a6700 1 -- 172.21.15.32:0/2390247161 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe25c15d4b0 msgr2=0x7fe25c0b48d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:41.540 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.532+0000 7fe2620a6700 1 --2- 172.21.15.32:0/2390247161 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe25c15d4b0 0x7fe25c0b48d0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fe254014040 tx=0x7fe254004af0 comp rx=0 tx=0).stop 2023-10-08T06:09:41.540 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.532+0000 7fe2620a6700 1 -- 172.21.15.32:0/2390247161 shutdown_connections 2023-10-08T06:09:41.540 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.532+0000 7fe2620a6700 1 --2- 172.21.15.32:0/2390247161 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fe240066510 0x7fe2400689d0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:41.540 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.532+0000 7fe2620a6700 1 --2- 172.21.15.32:0/2390247161 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe25c15d4b0 0x7fe25c0b48d0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:41.540 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.532+0000 7fe2620a6700 1 --2- 172.21.15.32:0/2390247161 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe25c0ce430 0x7fe25c0b4390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:41.540 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.532+0000 7fe2620a6700 1 --2- 172.21.15.32:0/2390247161 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe25c0b8b20 0x7fe25c1f25b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:41.540 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.532+0000 7fe2620a6700 1 -- 172.21.15.32:0/2390247161 >> 172.21.15.32:0/2390247161 conn(0x7fe25c06ac60 msgr2=0x7fe25c0b76f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:09:41.540 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.532+0000 7fe2620a6700 1 -- 172.21.15.32:0/2390247161 shutdown_connections 2023-10-08T06:09:41.541 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.536+0000 7fe2620a6700 1 -- 172.21.15.32:0/2390247161 wait complete. 2023-10-08T06:09:41.553 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-10-08T06:09:41.553 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-10-08T06:09:41.554 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-10-08T06:09:41.554 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-10-08T06:09:41.554 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-10-08T06:09:41.555 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-10-08T06:09:41.555 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-10-08T06:09:41.556 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-10-08T06:09:41.707 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.700+0000 7f247e611700 1 Processor -- start 2023-10-08T06:09:41.707 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.700+0000 7f247e611700 1 -- start start 2023-10-08T06:09:41.707 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.700+0000 7f6b5180a700 1 Processor -- start 2023-10-08T06:09:41.708 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.700+0000 7f6b5180a700 1 -- start start 2023-10-08T06:09:41.708 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.704+0000 7f6b5180a700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f6b4c15d600 0x7f6b4c0cd9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:41.708 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.704+0000 7f6b5180a700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b4c06dfc0 con 0x7f6b4c0703c0 2023-10-08T06:09:41.709 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.704+0000 7f6b5180a700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b4c15e800 con 0x7f6b4c0adfc0 2023-10-08T06:09:41.709 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.704+0000 7f6b5180a700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b4c0ade50 con 0x7f6b4c15d600 2023-10-08T06:09:41.709 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.704+0000 7f247e611700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2470050050 0x7f2470006830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:41.709 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.704+0000 7f247e611700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2470006d70 0x7f2470005fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:41.709 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.704+0000 7f247e611700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2470007180 con 0x7f24700508f0 2023-10-08T06:09:41.709 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.704+0000 7f247e611700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24700d6c90 con 0x7f2470006d70 2023-10-08T06:09:41.709 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.704+0000 7f247e611700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24700e0ce0 con 0x7f2470050050 2023-10-08T06:09:41.710 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.700+0000 7f3a7f59e700 1 Processor -- start 2023-10-08T06:09:41.710 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.704+0000 7f3a7f59e700 1 -- start start 2023-10-08T06:09:41.710 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.704+0000 7f6b4bfff700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f6b4c0703c0 0x7f6b4c0cdef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:46114/0 (socket says 172.21.15.32:46114) 2023-10-08T06:09:41.710 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.704+0000 7f6b4bfff700 1 -- 172.21.15.32:0/2026496667 learned_addr learned my addr 172.21.15.32:0/2026496667 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-08T06:09:41.710 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.704+0000 7f6b51009700 1 --1- 172.21.15.32:0/2026496667 >> v1:172.21.15.40:6789/0 conn(0x7f6b4c0adfc0 0x7f6b4c0ac8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.32:45898/0 (socket says 172.21.15.32:45898) 2023-10-08T06:09:41.713 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.704+0000 7f247ce0e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2470050050 0x7f2470006830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:41.713 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.704+0000 7f247ce0e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2470050050 0x7f2470006830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.32:54508/0 (socket says 172.21.15.32:54508) 2023-10-08T06:09:41.713 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.704+0000 7f247ce0e700 1 -- 172.21.15.32:0/916456077 learned_addr learned my addr 172.21.15.32:0/916456077 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:09:41.713 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.704+0000 7f247de10700 1 --2- 172.21.15.32:0/916456077 >> v2:172.21.15.40:3300/0 conn(0x7f2470006d70 0x7f2470005fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:41.714 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.704+0000 7f3a7f59e700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f3a80159ed0 0x7f3a800ca9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:41.714 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.704+0000 7f3a7f59e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3a8015a2b0 0x7f3a800c98c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:41.714 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.704+0000 7f3a7f59e700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a800cca40 con 0x7f3a800706f0 2023-10-08T06:09:41.714 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.704+0000 7f3a7f59e700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a800ccdb0 con 0x7f3a80159ed0 2023-10-08T06:09:41.714 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.704+0000 7f3a7f59e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a800caef0 con 0x7f3a8015a2b0 2023-10-08T06:09:41.715 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.704+0000 7f6b50808700 1 --2- 172.21.15.32:0/2026496667 >> v2:172.21.15.32:3300/0 conn(0x7f6b4c15d600 0x7f6b4c0cd9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:41.715 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.704+0000 7f3a7dd9b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3a8015a2b0 0x7f3a800c98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:41.715 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.704+0000 7f3a7dd9b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3a8015a2b0 0x7f3a800c98c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.32:54512/0 (socket says 172.21.15.32:54512) 2023-10-08T06:09:41.715 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.704+0000 7f3a7dd9b700 1 -- 172.21.15.32:0/3843028686 learned_addr learned my addr 172.21.15.32:0/3843028686 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:09:41.715 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.704+0000 7f3a7e59c700 1 --2- 172.21.15.32:0/3843028686 >> v2:172.21.15.32:3300/0 conn(0x7f3a80159ed0 0x7f3a800ca9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:41.715 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.704+0000 7f247ce0e700 1 -- 172.21.15.32:0/916456077 >> v2:172.21.15.40:3300/0 conn(0x7f2470006d70 msgr2=0x7f2470005fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:09:41.716 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.704+0000 7f247ce0e700 1 --2- 172.21.15.32:0/916456077 >> v2:172.21.15.40:3300/0 conn(0x7f2470006d70 0x7f2470005fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:41.716 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.704+0000 7f247ce0e700 1 -- 172.21.15.32:0/916456077 >> v1:172.21.15.40:6789/0 conn(0x7f24700508f0 legacy=0x7f24700dfd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:41.716 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.704+0000 7f247ce0e700 1 -- 172.21.15.32:0/916456077 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24700e0450 con 0x7f2470050050 2023-10-08T06:09:41.716 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.704+0000 7f3a7e59c700 1 -- 172.21.15.32:0/3843028686 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3a8015a2b0 msgr2=0x7f3a800c98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:09:41.716 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.704+0000 7f3a7e59c700 1 --2- 172.21.15.32:0/3843028686 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3a8015a2b0 0x7f3a800c98c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:41.716 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.704+0000 7f3a7e59c700 1 -- 172.21.15.32:0/3843028686 >> v1:172.21.15.32:6789/0 conn(0x7f3a800706f0 legacy=0x7f3a800cb510 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-08T06:09:41.716 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.704+0000 7f3a7e59c700 1 -- 172.21.15.32:0/3843028686 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a800cdf60 con 0x7f3a80159ed0 2023-10-08T06:09:41.717 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.704+0000 7f6b4b7fe700 1 -- 172.21.15.32:0/2026496667 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4238478629 0 0) 0x7f6b4c06dfc0 con 0x7f6b4c0703c0 2023-10-08T06:09:41.717 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.704+0000 7f6b50808700 1 -- 172.21.15.32:0/2026496667 >> v1:172.21.15.40:6789/0 conn(0x7f6b4c0adfc0 legacy=0x7f6b4c0ac8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:41.717 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.704+0000 7f6b50808700 1 -- 172.21.15.32:0/2026496667 >> v1:172.21.15.32:6789/0 conn(0x7f6b4c0703c0 legacy=0x7f6b4c0cdef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:41.717 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.704+0000 7f6b50808700 1 -- 172.21.15.32:0/2026496667 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b4c06e260 con 0x7f6b4c15d600 2023-10-08T06:09:41.717 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.704+0000 7f247ce0e700 1 --2- 172.21.15.32:0/916456077 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2470050050 0x7f2470006830 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f2474009910 tx=0x7f2474009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d3e6ccc7db84f3a9 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:41.718 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.704+0000 7f3a7e59c700 1 --2- 172.21.15.32:0/3843028686 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3a80159ed0 0x7f3a800ca9b0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f3a70009850 tx=0x7f3a70009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4430d97eb597c08 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:41.718 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.704+0000 7f246ffff700 1 -- 172.21.15.32:0/916456077 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2474011830 con 0x7f2470050050 2023-10-08T06:09:41.718 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.704+0000 7f6b50808700 1 --2- 172.21.15.32:0/2026496667 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6b4c15d600 0x7f6b4c0cd9b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f6b340097d0 tx=0x7f6b34009ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f86e8d5d624f867e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:41.719 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.704+0000 7f3a7d59a700 1 -- 172.21.15.32:0/3843028686 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a70004230 con 0x7f3a80159ed0 2023-10-08T06:09:41.719 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.704+0000 7f3a7d59a700 1 -- 172.21.15.32:0/3843028686 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a70004390 con 0x7f3a80159ed0 2023-10-08T06:09:41.719 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.704+0000 7f3a7d59a700 1 -- 172.21.15.32:0/3843028686 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a700036c0 con 0x7f3a80159ed0 2023-10-08T06:09:41.719 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.704+0000 7f6b4b7fe700 1 -- 172.21.15.32:0/2026496667 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b34004230 con 0x7f6b4c15d600 2023-10-08T06:09:41.719 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.704+0000 7f246ffff700 1 -- 172.21.15.32:0/916456077 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2474011990 con 0x7f2470050050 2023-10-08T06:09:41.720 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.704+0000 7f246ffff700 1 -- 172.21.15.32:0/916456077 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2474011d40 con 0x7f2470050050 2023-10-08T06:09:41.720 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.704+0000 7f6b4b7fe700 1 -- 172.21.15.32:0/2026496667 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b34004390 con 0x7f6b4c15d600 2023-10-08T06:09:41.720 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.704+0000 7f6b4b7fe700 1 -- 172.21.15.32:0/2026496667 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b340036c0 con 0x7f6b4c15d600 2023-10-08T06:09:41.720 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.704+0000 7f3a7f59e700 1 -- 172.21.15.32:0/3843028686 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3a80159ed0 msgr2=0x7f3a800ca9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:41.721 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.704+0000 7f3a7f59e700 1 --2- 172.21.15.32:0/3843028686 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3a80159ed0 0x7f3a800ca9b0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f3a70009850 tx=0x7f3a70009b60 comp rx=0 tx=0).stop 2023-10-08T06:09:41.721 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.708+0000 7f3a7f59e700 1 -- 172.21.15.32:0/3843028686 shutdown_connections 2023-10-08T06:09:41.721 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.708+0000 7f3a7f59e700 1 --2- 172.21.15.32:0/3843028686 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3a8015a2b0 0x7f3a800c98c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:41.721 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.708+0000 7f3a7f59e700 1 --2- 172.21.15.32:0/3843028686 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3a80159ed0 0x7f3a800ca9b0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:41.721 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.708+0000 7f3a7f59e700 1 -- 172.21.15.32:0/3843028686 >> 172.21.15.32:0/3843028686 conn(0x7f3a800b0900 msgr2=0x7f3a800b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:09:41.721 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.708+0000 7f247e611700 1 -- 172.21.15.32:0/916456077 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2470050050 msgr2=0x7f2470006830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:41.721 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.708+0000 7f247e611700 1 --2- 172.21.15.32:0/916456077 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2470050050 0x7f2470006830 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f2474009910 tx=0x7f2474009c20 comp rx=0 tx=0).stop 2023-10-08T06:09:41.722 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.708+0000 7fd8b24b5700 1 Processor -- start 2023-10-08T06:09:41.722 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.708+0000 7fd7b1b18700 1 Processor -- start 2023-10-08T06:09:41.722 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.708+0000 7f247e611700 1 -- 172.21.15.32:0/916456077 shutdown_connections 2023-10-08T06:09:41.723 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.708+0000 7f247e611700 1 --2- 172.21.15.32:0/916456077 >> v2:172.21.15.40:3300/0 conn(0x7f2470006d70 0x7f2470005fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:41.723 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.708+0000 7f247e611700 1 --2- 172.21.15.32:0/916456077 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2470050050 0x7f2470006830 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:41.723 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.708+0000 7f247e611700 1 -- 172.21.15.32:0/916456077 >> 172.21.15.32:0/916456077 conn(0x7f2470054c90 msgr2=0x7f24700550a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:09:41.723 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.708+0000 7f3a7f59e700 1 -- 172.21.15.32:0/3843028686 shutdown_connections 2023-10-08T06:09:41.723 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.708+0000 7f3a7f59e700 1 -- 172.21.15.32:0/3843028686 wait complete. 2023-10-08T06:09:41.724 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.708+0000 7fd7b1b18700 1 -- start start 2023-10-08T06:09:41.724 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.708+0000 7f6b5180a700 1 -- 172.21.15.32:0/2026496667 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6b4c15d600 msgr2=0x7f6b4c0cd9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:41.724 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.708+0000 7f6b5180a700 1 --2- 172.21.15.32:0/2026496667 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6b4c15d600 0x7f6b4c0cd9b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f6b340097d0 tx=0x7f6b34009ae0 comp rx=0 tx=0).stop 2023-10-08T06:09:41.724 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.708+0000 7f6b5180a700 1 -- 172.21.15.32:0/2026496667 shutdown_connections 2023-10-08T06:09:41.724 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.708+0000 7f6b5180a700 1 --2- 172.21.15.32:0/2026496667 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6b4c15d600 0x7f6b4c0cd9b0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:41.725 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.708+0000 7f6b5180a700 1 -- 172.21.15.32:0/2026496667 >> 172.21.15.32:0/2026496667 conn(0x7f6b4c0cb850 msgr2=0x7f6b4c0cbc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:09:41.725 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.708+0000 7f247e611700 1 -- 172.21.15.32:0/916456077 shutdown_connections 2023-10-08T06:09:41.725 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.708+0000 7fd8b24b5700 1 -- start start 2023-10-08T06:09:41.725 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.708+0000 7f9f7f91a700 1 Processor -- start 2023-10-08T06:09:41.726 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.708+0000 7f3a7f59e700 1 Processor -- start 2023-10-08T06:09:41.726 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.708+0000 7f3a7f59e700 1 -- start start 2023-10-08T06:09:41.726 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.708+0000 7fd8b24b5700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd8ac1597f0 0x7fd8ac0ce190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:41.727 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.708+0000 7f6b5180a700 1 -- 172.21.15.32:0/2026496667 shutdown_connections 2023-10-08T06:09:41.727 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.708+0000 7f247e611700 1 -- 172.21.15.32:0/916456077 wait complete. 2023-10-08T06:09:41.727 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.708+0000 7fd8b24b5700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8ac0cd290 con 0x7fd8ac159bd0 2023-10-08T06:09:41.727 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.708+0000 7fd8b24b5700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8ac0cec10 con 0x7fd8ac06c6d0 2023-10-08T06:09:41.727 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.708+0000 7fd8b24b5700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8ac0cc9a0 con 0x7fd8ac1597f0 2023-10-08T06:09:41.728 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.708+0000 7f6b5180a700 1 -- 172.21.15.32:0/2026496667 wait complete. 2023-10-08T06:09:41.728 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.708+0000 7fd8b14b3700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd8ac1597f0 0x7fd8ac0ce190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:41.728 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.708+0000 7fd8b14b3700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd8ac1597f0 0x7fd8ac0ce190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.32:54524/0 (socket says 172.21.15.32:54524) 2023-10-08T06:09:41.729 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.708+0000 7fd8b14b3700 1 -- 172.21.15.32:0/2022253300 learned_addr learned my addr 172.21.15.32:0/2022253300 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:09:41.729 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.708+0000 7f247e611700 1 Processor -- start 2023-10-08T06:09:41.729 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.708+0000 7fd7b1b18700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd7a4033770 0x7fd7a4038800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:41.729 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.708+0000 7fd7b1b18700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7a4033fa0 con 0x7fd7a40e10c0 2023-10-08T06:09:41.730 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.708+0000 7fd7b1b18700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7a404f980 con 0x7fd7a403a810 2023-10-08T06:09:41.730 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.708+0000 7fd7b1b18700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7a4033cc0 con 0x7fd7a4033770 2023-10-08T06:09:41.730 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.708+0000 7fd7abfff700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fd7a403a810 0x7fd7a4050160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.32:45912/0 (socket says 172.21.15.32:45912) 2023-10-08T06:09:41.730 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.708+0000 7fd7abfff700 1 -- 172.21.15.32:0/3184106534 learned_addr learned my addr 172.21.15.32:0/3184106534 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-08T06:09:41.730 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.708+0000 7fd7b1317700 1 --2- 172.21.15.32:0/3184106534 >> v2:172.21.15.40:3300/0 conn(0x7fd7a4033770 0x7fd7a4038800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:41.730 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.708+0000 7fd7b1317700 1 -- 172.21.15.32:0/3184106534 >> v1:172.21.15.40:6789/0 conn(0x7fd7a403a810 legacy=0x7fd7a4050160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:09:41.730 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.708+0000 7fd7b1317700 1 -- 172.21.15.32:0/3184106534 >> v1:172.21.15.32:6789/0 conn(0x7fd7a40e10c0 legacy=0x7fd7a403a100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:09:41.730 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.708+0000 7fd7b1317700 1 -- 172.21.15.32:0/3184106534 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7a404ece0 con 0x7fd7a4033770 2023-10-08T06:09:41.730 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.708+0000 7f3a7f59e700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3a800706f0 0x7f3a80155d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:41.731 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.708+0000 7f9f7f91a700 1 -- start start 2023-10-08T06:09:41.731 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.708+0000 7f9f7f91a700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f9f7815a440 0x7f9f780cd9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:41.731 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.708+0000 7f9f7f91a700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f780ce100 con 0x7f9f781599e0 2023-10-08T06:09:41.731 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.708+0000 7f9f7f91a700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f780ce3e0 con 0x7f9f78070a90 2023-10-08T06:09:41.731 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.708+0000 7f9f7f91a700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f78071160 con 0x7f9f7815a440 2023-10-08T06:09:41.731 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.708+0000 7f9f7deb7700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f9f78070a90 0x7f9f780c9800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.32:45918/0 (socket says 172.21.15.32:45918) 2023-10-08T06:09:41.731 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.708+0000 7f9f7deb7700 1 -- 172.21.15.32:0/2793783372 learned_addr learned my addr 172.21.15.32:0/2793783372 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-08T06:09:41.732 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.708+0000 7fd7b1317700 1 --2- 172.21.15.32:0/3184106534 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd7a4033770 0x7fd7a4038800 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fd7980144c0 tx=0x7fd7980147d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8511b6df07b54d80 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:41.732 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.708+0000 7f3a7f59e700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3a80159ed0 0x7f3a800c8860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:41.732 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.708+0000 7f3a7f59e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3a8015a2b0 0x7f3a800b18d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:41.732 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.708+0000 7f3a7f59e700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a800c4660 con 0x7f3a800706f0 2023-10-08T06:09:41.732 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.708+0000 7f3a7f59e700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a801562b0 con 0x7f3a80159ed0 2023-10-08T06:09:41.733 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.708+0000 7f3a7f59e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a800c3700 con 0x7f3a8015a2b0 2023-10-08T06:09:41.733 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.708+0000 7fd8b14b3700 1 -- 172.21.15.32:0/2022253300 >> v1:172.21.15.40:6789/0 conn(0x7fd8ac06c6d0 legacy=0x7fd8ac0c9b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:09:41.733 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.708+0000 7fd8b14b3700 1 -- 172.21.15.32:0/2022253300 >> v1:172.21.15.32:6789/0 conn(0x7fd8ac159bd0 legacy=0x7fd8ac0cd720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:09:41.733 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.708+0000 7fd8b14b3700 1 -- 172.21.15.32:0/2022253300 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8ac06ce00 con 0x7fd8ac1597f0 2023-10-08T06:09:41.733 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.708+0000 7f9f7d6b6700 1 --2- 172.21.15.32:0/2793783372 >> v2:172.21.15.32:3300/0 conn(0x7f9f7815a440 0x7f9f780cd9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:41.734 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.708+0000 7f247e611700 1 -- start start 2023-10-08T06:09:41.734 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.708+0000 7f3a7e59c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3a800706f0 0x7f3a80155d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:41.734 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.708+0000 7f3a7e59c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3a800706f0 0x7f3a80155d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:59196/0 (socket says 172.21.15.32:59196) 2023-10-08T06:09:41.734 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.708+0000 7f3a7e59c700 1 -- 172.21.15.32:0/3151139969 learned_addr learned my addr 172.21.15.32:0/3151139969 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:09:41.734 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.708+0000 7f3a7ed9d700 1 --2- 172.21.15.32:0/3151139969 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3a8015a2b0 0x7f3a800b18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:41.734 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.708+0000 7f3a7dd9b700 1 --2- 172.21.15.32:0/3151139969 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3a80159ed0 0x7f3a800c8860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:41.735 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.712+0000 7fd7ab7fe700 1 -- 172.21.15.32:0/3184106534 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd798004030 con 0x7fd7a4033770 2023-10-08T06:09:41.735 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.712+0000 7fd7ab7fe700 1 -- 172.21.15.32:0/3184106534 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd798004190 con 0x7fd7a4033770 2023-10-08T06:09:41.735 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.712+0000 7fd7ab7fe700 1 -- 172.21.15.32:0/3184106534 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd798004520 con 0x7fd7a4033770 2023-10-08T06:09:41.735 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.712+0000 7fd8b14b3700 1 --2- 172.21.15.32:0/2022253300 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd8ac1597f0 0x7fd8ac0ce190 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fd89c00bbc0 tx=0x7fd89c00bed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=76662ae9817fa5b0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:41.736 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.712+0000 7f9f6ffff700 1 -- 172.21.15.32:0/2793783372 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2658604900 0 0) 0x7f9f780ce100 con 0x7f9f781599e0 2023-10-08T06:09:41.736 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.712+0000 7f9f6ffff700 1 -- 172.21.15.32:0/2793783372 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9f640046e0 con 0x7f9f781599e0 2023-10-08T06:09:41.736 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.712+0000 7f6b5180a700 1 Processor -- start 2023-10-08T06:09:41.737 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.712+0000 7f9f6ffff700 1 -- 172.21.15.32:0/2793783372 <== mon.1 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 773245701 0 0) 0x7f9f780ce3e0 con 0x7f9f78070a90 2023-10-08T06:09:41.737 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.712+0000 7f9f6ffff700 1 -- 172.21.15.32:0/2793783372 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9f780ce100 con 0x7f9f78070a90 2023-10-08T06:09:41.737 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.712+0000 7f9f7d6b6700 1 -- 172.21.15.32:0/2793783372 >> v1:172.21.15.40:6789/0 conn(0x7f9f78070a90 legacy=0x7f9f780c9800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:41.737 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.712+0000 7f9f7d6b6700 1 -- 172.21.15.32:0/2793783372 >> v1:172.21.15.32:6789/0 conn(0x7f9f781599e0 legacy=0x7f9f78070380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:41.737 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.712+0000 7f3a7e59c700 1 -- 172.21.15.32:0/3151139969 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3a8015a2b0 msgr2=0x7f3a800b18d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:41.737 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.712+0000 7f3a7e59c700 1 --2- 172.21.15.32:0/3151139969 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3a8015a2b0 0x7f3a800b18d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:41.737 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.712+0000 7f3a7e59c700 1 -- 172.21.15.32:0/3151139969 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3a80159ed0 msgr2=0x7f3a800c8860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:41.738 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.712+0000 7f3a7e59c700 1 --2- 172.21.15.32:0/3151139969 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3a80159ed0 0x7f3a800c8860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:41.738 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.712+0000 7f3a7e59c700 1 -- 172.21.15.32:0/3151139969 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a700094b0 con 0x7f3a800706f0 2023-10-08T06:09:41.738 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.712+0000 7f9f7d6b6700 1 -- 172.21.15.32:0/2793783372 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f780ce6c0 con 0x7f9f7815a440 2023-10-08T06:09:41.738 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.712+0000 7f247e611700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2470006d70 0x7f247004d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:41.738 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.712+0000 7f247e611700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2470050050 0x7f247004a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:41.739 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.712+0000 7f247e611700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f24700508f0 0x7f24700ef7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:41.739 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.712+0000 7fd7b1b18700 1 -- 172.21.15.32:0/3184106534 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd7a4033770 msgr2=0x7fd7a4038800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:41.739 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.712+0000 7fd7b1b18700 1 --2- 172.21.15.32:0/3184106534 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd7a4033770 0x7fd7a4038800 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fd7980144c0 tx=0x7fd7980147d0 comp rx=0 tx=0).stop 2023-10-08T06:09:41.739 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.712+0000 7f247e611700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f247004d720 con 0x7f2470050050 2023-10-08T06:09:41.739 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.712+0000 7f247e611700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f247004cd50 con 0x7f24700508f0 2023-10-08T06:09:41.739 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.712+0000 7f247e611700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f247004adc0 con 0x7f2470006d70 2023-10-08T06:09:41.740 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.712+0000 7f3a7e59c700 1 --2- 172.21.15.32:0/3151139969 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3a800706f0 0x7f3a80155d70 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f3a70004000 tx=0x7f3a70004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:41.740 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.712+0000 7f247ce0e700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2470050050 0x7f247004a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:41.740 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.712+0000 7f247ce0e700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2470050050 0x7f247004a880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:59198/0 (socket says 172.21.15.32:59198) 2023-10-08T06:09:41.740 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.712+0000 7f247ce0e700 1 -- 172.21.15.32:0/1761187852 learned_addr learned my addr 172.21.15.32:0/1761187852 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:09:41.741 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.712+0000 7f247d60f700 1 --2- 172.21.15.32:0/1761187852 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2470006d70 0x7f247004d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:41.741 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.712+0000 7f247de10700 1 --2- 172.21.15.32:0/1761187852 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f24700508f0 0x7f24700ef7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:41.741 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.712+0000 7fd8a3fff700 1 -- 172.21.15.32:0/2022253300 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd89c00dc00 con 0x7fd8ac1597f0 2023-10-08T06:09:41.741 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.712+0000 7fd8a3fff700 1 -- 172.21.15.32:0/2022253300 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd89c00dd60 con 0x7fd8ac1597f0 2023-10-08T06:09:41.741 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.712+0000 7fd8a3fff700 1 -- 172.21.15.32:0/2022253300 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd89c00dc00 con 0x7fd8ac1597f0 2023-10-08T06:09:41.742 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.712+0000 7f6b5180a700 1 -- start start 2023-10-08T06:09:41.742 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.712+0000 7f6b5180a700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6b4c0703c0 0x7f6b4c1fad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:41.742 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.712+0000 7f6b5180a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6b4c0adfc0 0x7f6b4c14a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:41.742 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.712+0000 7f6b5180a700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6b4c15d600 0x7f6b4c14d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:41.742 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.712+0000 7f6b5180a700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b4c1fa570 con 0x7f6b4c15d600 2023-10-08T06:09:41.742 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.712+0000 7f6b5180a700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b4c14de50 con 0x7f6b4c0adfc0 2023-10-08T06:09:41.742 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.712+0000 7f6b5180a700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b4c14e130 con 0x7f6b4c0703c0 2023-10-08T06:09:41.743 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.712+0000 7f3a6effd700 1 -- 172.21.15.32:0/3151139969 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a70006ea0 con 0x7f3a800706f0 2023-10-08T06:09:41.743 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.712+0000 7fd7b1b18700 1 -- 172.21.15.32:0/3184106534 shutdown_connections 2023-10-08T06:09:41.743 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.712+0000 7fd7b1b18700 1 --2- 172.21.15.32:0/3184106534 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd7a4033770 0x7fd7a4038800 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:41.743 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.712+0000 7fd7b1b18700 1 -- 172.21.15.32:0/3184106534 >> 172.21.15.32:0/3184106534 conn(0x7fd7a4054c90 msgr2=0x7fd7a40550a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:09:41.744 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.712+0000 7f247ce0e700 1 -- 172.21.15.32:0/1761187852 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2470006d70 msgr2=0x7f247004d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:41.744 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.712+0000 7f247ce0e700 1 --2- 172.21.15.32:0/1761187852 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2470006d70 0x7f247004d1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:41.744 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.712+0000 7f247ce0e700 1 -- 172.21.15.32:0/1761187852 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f24700508f0 msgr2=0x7f24700ef7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:41.744 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.712+0000 7f247ce0e700 1 --2- 172.21.15.32:0/1761187852 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f24700508f0 0x7f24700ef7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:41.744 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.712+0000 7f247ce0e700 1 -- 172.21.15.32:0/1761187852 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2474009570 con 0x7f2470050050 2023-10-08T06:09:41.744 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.712+0000 7f6b50808700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6b4c0703c0 0x7f6b4c1fad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:41.744 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.712+0000 7f6b4bfff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6b4c0adfc0 0x7f6b4c14a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:41.744 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.712+0000 7f6b50808700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6b4c0703c0 0x7f6b4c1fad50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.32:54544/0 (socket says 172.21.15.32:54544) 2023-10-08T06:09:41.745 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.712+0000 7f6b50808700 1 -- 172.21.15.32:0/944125589 learned_addr learned my addr 172.21.15.32:0/944125589 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:09:41.745 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.712+0000 7f3a6effd700 1 -- 172.21.15.32:0/3151139969 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a7000f8a0 con 0x7f3a800706f0 2023-10-08T06:09:41.745 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.712+0000 7f3a6effd700 1 -- 172.21.15.32:0/3151139969 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a7000fc30 con 0x7f3a800706f0 2023-10-08T06:09:41.745 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.712+0000 7f3a7f59e700 1 -- 172.21.15.32:0/3151139969 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a800c39e0 con 0x7f3a800706f0 2023-10-08T06:09:41.745 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.712+0000 7f3a7f59e700 1 -- 172.21.15.32:0/3151139969 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a800c3fa0 con 0x7f3a800706f0 2023-10-08T06:09:41.746 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.712+0000 7f247ce0e700 1 --2- 172.21.15.32:0/1761187852 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2470050050 0x7f247004a880 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f2474009c60 tx=0x7f2474004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:41.746 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.712+0000 7fd8b24b5700 1 -- 172.21.15.32:0/2022253300 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd8ac1597f0 msgr2=0x7fd8ac0ce190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:41.746 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.712+0000 7fd8b24b5700 1 --2- 172.21.15.32:0/2022253300 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd8ac1597f0 0x7fd8ac0ce190 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fd89c00bbc0 tx=0x7fd89c00bed0 comp rx=0 tx=0).stop 2023-10-08T06:09:41.746 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.712+0000 7fd8b24b5700 1 -- 172.21.15.32:0/2022253300 shutdown_connections 2023-10-08T06:09:41.747 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.712+0000 7f6b4bfff700 1 -- 172.21.15.32:0/944125589 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6b4c0703c0 msgr2=0x7f6b4c1fad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:41.747 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.712+0000 7f6b4bfff700 1 --2- 172.21.15.32:0/944125589 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6b4c0703c0 0x7f6b4c1fad50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:41.747 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.712+0000 7f6b4bfff700 1 -- 172.21.15.32:0/944125589 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6b4c15d600 msgr2=0x7f6b4c14d400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:41.747 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.712+0000 7f6b4bfff700 1 --2- 172.21.15.32:0/944125589 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6b4c15d600 0x7f6b4c14d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:41.747 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.712+0000 7f6b4bfff700 1 -- 172.21.15.32:0/944125589 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b340094b0 con 0x7f6b4c0adfc0 2023-10-08T06:09:41.747 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.712+0000 7fd8b24b5700 1 --2- 172.21.15.32:0/2022253300 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd8ac1597f0 0x7fd8ac0ce190 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:41.748 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.712+0000 7fd8b24b5700 1 -- 172.21.15.32:0/2022253300 >> 172.21.15.32:0/2022253300 conn(0x7fd8ac0b0900 msgr2=0x7fd8ac0b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:09:41.748 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.712+0000 7fd8b24b5700 1 -- 172.21.15.32:0/2022253300 shutdown_connections 2023-10-08T06:09:41.748 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.712+0000 7f6b4bfff700 1 --2- 172.21.15.32:0/944125589 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6b4c0adfc0 0x7f6b4c14a940 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f6b3c000c00 tx=0x7f6b3c00c800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:41.748 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.712+0000 7f6b497fa700 1 -- 172.21.15.32:0/944125589 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b3c004ca0 con 0x7f6b4c0adfc0 2023-10-08T06:09:41.748 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.712+0000 7f246dffb700 1 -- 172.21.15.32:0/1761187852 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2474004610 con 0x7f2470050050 2023-10-08T06:09:41.749 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.712+0000 7f246dffb700 1 -- 172.21.15.32:0/1761187852 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24740036c0 con 0x7f2470050050 2023-10-08T06:09:41.749 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.712+0000 7f246dffb700 1 -- 172.21.15.32:0/1761187852 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2474003a30 con 0x7f2470050050 2023-10-08T06:09:41.749 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.712+0000 7f6b497fa700 1 -- 172.21.15.32:0/944125589 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b3c004e20 con 0x7f6b4c0adfc0 2023-10-08T06:09:41.749 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.712+0000 7f6b497fa700 1 -- 172.21.15.32:0/944125589 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b3c007310 con 0x7f6b4c0adfc0 2023-10-08T06:09:41.749 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.712+0000 7f6b5180a700 1 -- 172.21.15.32:0/944125589 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b4c1fa830 con 0x7f6b4c0adfc0 2023-10-08T06:09:41.749 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.712+0000 7f6b5180a700 1 -- 172.21.15.32:0/944125589 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b4c151760 con 0x7f6b4c0adfc0 2023-10-08T06:09:41.750 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.712+0000 7f3a7f59e700 1 -- 172.21.15.32:0/3151139969 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3a64000fc0 con 0x7f3a800706f0 2023-10-08T06:09:41.750 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.712+0000 7fd8b24b5700 1 -- 172.21.15.32:0/2022253300 wait complete. 2023-10-08T06:09:41.751 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.712+0000 7f9f7d6b6700 1 --2- 172.21.15.32:0/2793783372 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9f7815a440 0x7f9f780cd9b0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f9f70009990 tx=0x7f9f70009ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2483dfda89ac2d6a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:41.751 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.716+0000 7f9f6ffff700 1 -- 172.21.15.32:0/2793783372 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f70003c40 con 0x7f9f7815a440 2023-10-08T06:09:41.751 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.716+0000 7f9f6ffff700 1 -- 172.21.15.32:0/2793783372 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f70003da0 con 0x7f9f7815a440 2023-10-08T06:09:41.751 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.716+0000 7f9f6ffff700 1 -- 172.21.15.32:0/2793783372 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f70003c40 con 0x7f9f7815a440 2023-10-08T06:09:41.751 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.712+0000 7f247e611700 1 -- 172.21.15.32:0/1761187852 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f247004c140 con 0x7f2470050050 2023-10-08T06:09:41.751 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.716+0000 7f247e611700 1 -- 172.21.15.32:0/1761187852 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f247004c700 con 0x7f2470050050 2023-10-08T06:09:41.752 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.712+0000 7fd7b1b18700 1 -- 172.21.15.32:0/3184106534 shutdown_connections 2023-10-08T06:09:41.752 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.712+0000 7fd7b1b18700 1 -- 172.21.15.32:0/3184106534 wait complete. 2023-10-08T06:09:41.752 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.716+0000 7fd8b24b5700 1 Processor -- start 2023-10-08T06:09:41.752 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.716+0000 7f6b5180a700 1 -- 172.21.15.32:0/944125589 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6b4c1fa3f0 con 0x7f6b4c0adfc0 2023-10-08T06:09:41.753 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.716+0000 7fd8b24b5700 1 -- start start 2023-10-08T06:09:41.753 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.716+0000 7fd7b1b18700 1 Processor -- start 2023-10-08T06:09:41.753 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.716+0000 7f245b7fe700 1 -- 172.21.15.32:0/1761187852 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f24700e0a00 con 0x7f2470050050 2023-10-08T06:09:41.754 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.716+0000 7f9f7f91a700 1 -- 172.21.15.32:0/2793783372 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9f7815a440 msgr2=0x7f9f780cd9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:41.754 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.716+0000 7f9f7f91a700 1 --2- 172.21.15.32:0/2793783372 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9f7815a440 0x7f9f780cd9b0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f9f70009990 tx=0x7f9f70009ca0 comp rx=0 tx=0).stop 2023-10-08T06:09:41.754 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.716+0000 7f9f7f91a700 1 -- 172.21.15.32:0/2793783372 shutdown_connections 2023-10-08T06:09:41.754 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.716+0000 7f9f7f91a700 1 --2- 172.21.15.32:0/2793783372 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9f7815a440 0x7f9f780cd9b0 secure :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f9f70009990 tx=0x7f9f70009ca0 comp rx=0 tx=0).stop 2023-10-08T06:09:41.754 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.716+0000 7f9f7f91a700 1 -- 172.21.15.32:0/2793783372 >> 172.21.15.32:0/2793783372 conn(0x7f9f780cb850 msgr2=0x7f9f780cbc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:09:41.754 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.716+0000 7f9f7f91a700 1 -- 172.21.15.32:0/2793783372 shutdown_connections 2023-10-08T06:09:41.754 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.716+0000 7f9f7f91a700 1 -- 172.21.15.32:0/2793783372 wait complete. 2023-10-08T06:09:41.755 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.716+0000 7fd7b1b18700 1 -- start start 2023-10-08T06:09:41.826 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.716+0000 7fd8b24b5700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd8ac06c6d0 0x7fd8ac0c2a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:41.826 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.716+0000 7fd8b24b5700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd8ac1597f0 0x7fd8ac0c2f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:41.827 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.716+0000 7fd8b24b5700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd8ac159bd0 0x7fd8ac0c3480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:41.827 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.716+0000 7fd8b24b5700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8ac150530 con 0x7fd8ac159bd0 2023-10-08T06:09:41.827 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.716+0000 7fd8b24b5700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8ac150a60 con 0x7fd8ac06c6d0 2023-10-08T06:09:41.827 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.716+0000 7fd8b24b5700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8ac0b2900 con 0x7fd8ac1597f0 2023-10-08T06:09:41.828 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.716+0000 7f3a6effd700 1 -- 172.21.15.32:0/3151139969 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f3a700193f0 con 0x7f3a800706f0 2023-10-08T06:09:41.828 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.716+0000 7f3a6effd700 1 --2- 172.21.15.32:0/3151139969 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f3a600665e0 0x7f3a60068aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:41.828 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.716+0000 7f3a6effd700 1 -- 172.21.15.32:0/3151139969 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3a70085300 con 0x7f3a800706f0 2023-10-08T06:09:41.828 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.716+0000 7f3a7dd9b700 1 --2- 172.21.15.32:0/3151139969 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f3a600665e0 0x7f3a60068aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:41.829 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.716+0000 7f3a6effd700 1 --2- 172.21.15.32:0/3151139969 >> [v2:172.21.15.40:6800/3369928244,v1:172.21.15.40:6801/3369928244] conn(0x7f3a6006e800 0x7f3a60070c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:41.829 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.716+0000 7f3a6effd700 1 -- 172.21.15.32:0/3151139969 --> [v2:172.21.15.40:6800/3369928244,v1:172.21.15.40:6801/3369928244] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3a600712d0 con 0x7f3a6006e800 2023-10-08T06:09:41.829 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.716+0000 7fd7b1b18700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd7a4033770 0x7fd7a4189620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:41.830 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.716+0000 7f3a6effd700 1 -- 172.21.15.32:0/3151139969 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3a70087920 con 0x7f3a800706f0 2023-10-08T06:09:41.830 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.716+0000 7fd7b1b18700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd7a403a810 0x7fd7a4054400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:41.830 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.716+0000 7fd7b1b18700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd7a40e10c0 0x7fd7a4053b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:41.830 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.716+0000 7fd7b1b18700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7a4189200 con 0x7fd7a4033770 2023-10-08T06:09:41.831 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.716+0000 7fd7b1b18700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7a4188b60 con 0x7fd7a40e10c0 2023-10-08T06:09:41.831 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.716+0000 7fd7b1b18700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7a404d840 con 0x7fd7a403a810 2023-10-08T06:09:41.831 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.716+0000 7fd8b0cb2700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd8ac1597f0 0x7fd8ac0c2f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:41.832 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.716+0000 7fd8b0cb2700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd8ac1597f0 0x7fd8ac0c2f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.32:54546/0 (socket says 172.21.15.32:54546) 2023-10-08T06:09:41.832 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.716+0000 7fd8b0cb2700 1 -- 172.21.15.32:0/37005294 learned_addr learned my addr 172.21.15.32:0/37005294 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:09:41.832 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.716+0000 7fd7abfff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd7a403a810 0x7fd7a4054400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:41.833 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.716+0000 7fd7abfff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd7a403a810 0x7fd7a4054400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.32:54548/0 (socket says 172.21.15.32:54548) 2023-10-08T06:09:41.833 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.716+0000 7fd7abfff700 1 -- 172.21.15.32:0/2035612663 learned_addr learned my addr 172.21.15.32:0/2035612663 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:09:41.833 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.716+0000 7fd7b1317700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd7a40e10c0 0x7fd7a4053b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:41.833 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.716+0000 7f246dffb700 1 -- 172.21.15.32:0/1761187852 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f2474021070 con 0x7f2470050050 2023-10-08T06:09:41.833 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.716+0000 7f246dffb700 1 --2- 172.21.15.32:0/1761187852 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f245c066560 0x7f245c068a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:41.834 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.716+0000 7fd8b14b3700 1 --2- 172.21.15.32:0/37005294 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd8ac06c6d0 0x7fd8ac0c2a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:41.834 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.716+0000 7fd8b1cb4700 1 --2- 172.21.15.32:0/37005294 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd8ac159bd0 0x7fd8ac0c3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:41.834 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.716+0000 7f3a7ed9d700 1 --2- 172.21.15.32:0/3151139969 >> [v2:172.21.15.40:6800/3369928244,v1:172.21.15.40:6801/3369928244] conn(0x7f3a6006e800 0x7f3a60070c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:41.835 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.716+0000 7f3a7dd9b700 1 --2- 172.21.15.32:0/3151139969 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f3a600665e0 0x7f3a60068aa0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f3a801f2140 tx=0x7f3a7800b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:41.835 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.716+0000 7f9f7f91a700 1 Processor -- start 2023-10-08T06:09:41.835 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.716+0000 7f9f7f91a700 1 -- start start 2023-10-08T06:09:41.835 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.716+0000 7fefcf467700 1 Processor -- start 2023-10-08T06:09:41.836 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.716+0000 7f6b497fa700 1 -- 172.21.15.32:0/944125589 <== mon.1 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f6b3c007470 con 0x7f6b4c0adfc0 2023-10-08T06:09:41.836 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.716+0000 7fd8b0cb2700 1 -- 172.21.15.32:0/37005294 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd8ac06c6d0 msgr2=0x7fd8ac0c2a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:41.836 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.716+0000 7fd8b0cb2700 1 --2- 172.21.15.32:0/37005294 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd8ac06c6d0 0x7fd8ac0c2a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:41.837 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.716+0000 7fd8b0cb2700 1 -- 172.21.15.32:0/37005294 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd8ac159bd0 msgr2=0x7fd8ac0c3480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:41.837 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.716+0000 7fd8b0cb2700 1 --2- 172.21.15.32:0/37005294 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd8ac159bd0 0x7fd8ac0c3480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:41.837 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.716+0000 7fd8b0cb2700 1 -- 172.21.15.32:0/37005294 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd89c00b820 con 0x7fd8ac1597f0 2023-10-08T06:09:41.837 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.716+0000 7f246dffb700 1 -- 172.21.15.32:0/1761187852 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2474085620 con 0x7f2470050050 2023-10-08T06:09:41.837 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.716+0000 7f246dffb700 1 --2- 172.21.15.32:0/1761187852 >> [v2:172.21.15.32:6824/1566874440,v1:172.21.15.32:6825/1566874440] conn(0x7f245c06e780 0x7f245c070ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:41.837 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.716+0000 7f246dffb700 1 -- 172.21.15.32:0/1761187852 --> [v2:172.21.15.32:6824/1566874440,v1:172.21.15.32:6825/1566874440] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f245c071250 con 0x7f245c06e780 2023-10-08T06:09:41.837 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.716+0000 7f246dffb700 1 -- 172.21.15.32:0/1761187852 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2474085ac0 con 0x7f2470050050 2023-10-08T06:09:41.838 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.716+0000 7fd8b1cb4700 1 --2- 172.21.15.32:0/37005294 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd8ac159bd0 0x7fd8ac0c3480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T06:09:41.838 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.720+0000 7f247d60f700 1 --2- 172.21.15.32:0/1761187852 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f245c066560 0x7f245c068a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:41.838 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.720+0000 7fefcf467700 1 -- start start 2023-10-08T06:09:41.838 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.720+0000 7f6afb4a1700 1 Processor -- start 2023-10-08T06:09:41.839 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.720+0000 7f6b497fa700 1 --2- 172.21.15.32:0/944125589 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f6b38066670 0x7f6b38068b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:41.839 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.720+0000 7f3a7ed9d700 1 --2- 172.21.15.32:0/3151139969 >> [v2:172.21.15.40:6800/3369928244,v1:172.21.15.40:6801/3369928244] conn(0x7f3a6006e800 0x7f3a60070c20 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:41.839 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.720+0000 7f6afb4a1700 1 -- start start 2023-10-08T06:09:41.840 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.720+0000 7f6b497fa700 1 -- 172.21.15.32:0/944125589 <== mon.1 v2:172.21.15.40:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6b3c084170 con 0x7f6b4c0adfc0 2023-10-08T06:09:41.840 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.720+0000 7f6b497fa700 1 --2- 172.21.15.32:0/944125589 >> [v2:172.21.15.32:6816/990576767,v1:172.21.15.32:6817/990576767] conn(0x7f6b3806e810 0x7f6b38070c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:41.840 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.720+0000 7f6b497fa700 1 -- 172.21.15.32:0/944125589 --> [v2:172.21.15.32:6816/990576767,v1:172.21.15.32:6817/990576767] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6b380712e0 con 0x7f6b3806e810 2023-10-08T06:09:41.840 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.720+0000 7f6b497fa700 1 -- 172.21.15.32:0/944125589 <== mon.1 v2:172.21.15.40:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6b3c084520 con 0x7f6b4c0adfc0 2023-10-08T06:09:41.841 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.720+0000 7f247d60f700 1 --2- 172.21.15.32:0/1761187852 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f245c066560 0x7f245c068a20 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f2478069b60 tx=0x7f2478079ce0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:41.841 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.720+0000 7f6b51009700 1 --2- 172.21.15.32:0/944125589 >> [v2:172.21.15.32:6816/990576767,v1:172.21.15.32:6817/990576767] conn(0x7f6b3806e810 0x7f6b38070c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:41.841 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.720+0000 7f9f7f91a700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9f78070a90 0x7f9f7814c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:41.841 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.716+0000 7fd7abfff700 1 -- 172.21.15.32:0/2035612663 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd7a40e10c0 msgr2=0x7fd7a4053b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:41.842 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.716+0000 7fd7abfff700 1 --2- 172.21.15.32:0/2035612663 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd7a40e10c0 0x7fd7a4053b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:41.842 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.720+0000 7fd7abfff700 1 -- 172.21.15.32:0/2035612663 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd7a4033770 msgr2=0x7fd7a4189620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:41.842 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.720+0000 7fd7abfff700 1 --2- 172.21.15.32:0/2035612663 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd7a4033770 0x7fd7a4189620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:41.842 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.720+0000 7fd7abfff700 1 -- 172.21.15.32:0/2035612663 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd79800fcf0 con 0x7fd7a403a810 2023-10-08T06:09:41.842 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.720+0000 7fd7abfff700 1 --2- 172.21.15.32:0/2035612663 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd7a403a810 0x7fd7a4054400 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fd7ac079670 tx=0x7fd7ac074710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:41.842 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.720+0000 7fd7a97fa700 1 -- 172.21.15.32:0/2035612663 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7ac067250 con 0x7fd7a403a810 2023-10-08T06:09:41.842 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.720+0000 7fd7b1b18700 1 -- 172.21.15.32:0/2035612663 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7a404db20 con 0x7fd7a403a810 2023-10-08T06:09:41.842 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.720+0000 7fd7b1b18700 1 -- 172.21.15.32:0/2035612663 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7a404d480 con 0x7fd7a403a810 2023-10-08T06:09:41.842 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.720+0000 7fd7a97fa700 1 -- 172.21.15.32:0/2035612663 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7ac08e070 con 0x7fd7a403a810 2023-10-08T06:09:41.842 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.720+0000 7fd7a97fa700 1 -- 172.21.15.32:0/2035612663 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7ac067630 con 0x7fd7a403a810 2023-10-08T06:09:41.843 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.720+0000 7f6b51009700 1 --2- 172.21.15.32:0/944125589 >> [v2:172.21.15.32:6816/990576767,v1:172.21.15.32:6817/990576767] conn(0x7f6b3806e810 0x7f6b38070c30 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:41.843 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.720+0000 7f6b50808700 1 --2- 172.21.15.32:0/944125589 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f6b38066670 0x7f6b38068b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:41.843 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.720+0000 7f247de10700 1 --2- 172.21.15.32:0/1761187852 >> [v2:172.21.15.32:6824/1566874440,v1:172.21.15.32:6825/1566874440] conn(0x7f245c06e780 0x7f245c070ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:41.843 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.720+0000 7f6afb4a1700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f6af415a2b0 0x7f6af40ca9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:41.844 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.720+0000 7f6afb4a1700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6af40c98c0 0x7f6af40cb510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:41.844 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.720+0000 7f6afb4a1700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6af40cca40 con 0x7f6af4159ed0 2023-10-08T06:09:41.844 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.720+0000 7f6afb4a1700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6af40ccdb0 con 0x7f6af415a2b0 2023-10-08T06:09:41.844 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.720+0000 7f6afb4a1700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6af40caef0 con 0x7f6af40c98c0 2023-10-08T06:09:41.844 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.720+0000 7f6afaca0700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6af40c98c0 0x7f6af40cb510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:41.844 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.720+0000 7f6afaca0700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6af40c98c0 0x7f6af40cb510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.32:38108/0 (socket says 172.21.15.32:38108) 2023-10-08T06:09:41.844 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.720+0000 7f6afaca0700 1 -- 172.21.15.32:0/2370644781 learned_addr learned my addr 172.21.15.32:0/2370644781 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:09:41.844 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.720+0000 7f9f7f91a700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9f781599e0 0x7f9f780ac8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:41.845 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.720+0000 7f9f7f91a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9f780ace30 0x7f9f780af040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:41.845 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.720+0000 7f9f7f91a700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f780ae070 con 0x7f9f78070a90 2023-10-08T06:09:41.845 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.720+0000 7f9f7f91a700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f780ad460 con 0x7f9f780ace30 2023-10-08T06:09:41.845 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.720+0000 7f9f7f91a700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f780ad740 con 0x7f9f781599e0 2023-10-08T06:09:41.845 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.720+0000 7f9f7d6b6700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9f78070a90 0x7f9f7814c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:41.845 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.720+0000 7f9f7d6b6700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9f78070a90 0x7f9f7814c0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:59234/0 (socket says 172.21.15.32:59234) 2023-10-08T06:09:41.845 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.720+0000 7f9f7d6b6700 1 -- 172.21.15.32:0/2930696406 learned_addr learned my addr 172.21.15.32:0/2930696406 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:09:41.845 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.720+0000 7f9f7ceb5700 1 --2- 172.21.15.32:0/2930696406 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9f781599e0 0x7f9f780ac8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:41.845 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.720+0000 7f9f7deb7700 1 --2- 172.21.15.32:0/2930696406 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9f780ace30 0x7f9f780af040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:41.845 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.720+0000 7f9f7ceb5700 1 -- 172.21.15.32:0/2930696406 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9f780ace30 msgr2=0x7f9f780af040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:41.845 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.720+0000 7f9f7ceb5700 1 --2- 172.21.15.32:0/2930696406 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9f780ace30 0x7f9f780af040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:41.845 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.720+0000 7f9f7ceb5700 1 -- 172.21.15.32:0/2930696406 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9f78070a90 msgr2=0x7f9f7814c0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:41.846 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.720+0000 7f9f7ceb5700 1 --2- 172.21.15.32:0/2930696406 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9f78070a90 0x7f9f7814c0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:41.846 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.720+0000 7f9f7ceb5700 1 -- 172.21.15.32:0/2930696406 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f700095f0 con 0x7f9f781599e0 2023-10-08T06:09:41.846 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.720+0000 7fefcf467700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fefc815b980 0x7fefc815f780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:41.846 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.720+0000 7fefcf467700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fefc80719e0 0x7fefc80c9420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:41.846 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.720+0000 7fefcf467700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefc806fc20 con 0x7fefc80c9960 2023-10-08T06:09:41.847 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.720+0000 7fefcf467700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fefc8070430 con 0x7fefc815b980 2023-10-08T06:09:41.847 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.720+0000 7fefcf467700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefc815ed70 con 0x7fefc80719e0 2023-10-08T06:09:41.847 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.720+0000 7fd8b0cb2700 1 --2- 172.21.15.32:0/37005294 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd8ac1597f0 0x7fd8ac0c2f40 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fd8a800b4a0 tx=0x7fd8a800b7b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:41.847 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.720+0000 7f247de10700 1 --2- 172.21.15.32:0/1761187852 >> [v2:172.21.15.32:6824/1566874440,v1:172.21.15.32:6825/1566874440] conn(0x7f245c06e780 0x7f245c070ba0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:41.848 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.720+0000 7fefcdc64700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fefc80719e0 0x7fefc80c9420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:41.848 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.720+0000 7fefcdc64700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fefc80719e0 0x7fefc80c9420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.32:54564/0 (socket says 172.21.15.32:54564) 2023-10-08T06:09:41.848 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.720+0000 7fefcdc64700 1 -- 172.21.15.32:0/566822261 learned_addr learned my addr 172.21.15.32:0/566822261 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:09:41.848 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.720+0000 7fefce465700 1 --2- 172.21.15.32:0/566822261 >> v2:172.21.15.40:3300/0 conn(0x7fefc815b980 0x7fefc815f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:41.849 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.720+0000 7f6afaca0700 1 -- 172.21.15.32:0/2370644781 >> v2:172.21.15.32:3300/0 conn(0x7f6af415a2b0 msgr2=0x7f6af40ca9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:09:41.849 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.720+0000 7f6afaca0700 1 --2- 172.21.15.32:0/2370644781 >> v2:172.21.15.32:3300/0 conn(0x7f6af415a2b0 0x7f6af40ca9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:41.849 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.720+0000 7f9f7ceb5700 1 --2- 172.21.15.32:0/2930696406 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9f781599e0 0x7f9f780ac8f0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f9f68001110 tx=0x7f9f6800c6e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:41.849 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.720+0000 7f6b497fa700 1 -- 172.21.15.32:0/944125589 <== osd.1 v2:172.21.15.32:6816/990576767 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f6b380712e0 con 0x7f6b3806e810 2023-10-08T06:09:41.850 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.720+0000 7fd8a1ffb700 1 -- 172.21.15.32:0/37005294 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8a8011830 con 0x7fd8ac1597f0 2023-10-08T06:09:41.850 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.720+0000 7f6afaca0700 1 -- 172.21.15.32:0/2370644781 >> v1:172.21.15.32:6789/0 conn(0x7f6af4159ed0 legacy=0x7f6af40706f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:09:41.850 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.720+0000 7fd8a1ffb700 1 -- 172.21.15.32:0/37005294 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8a8011990 con 0x7fd8ac1597f0 2023-10-08T06:09:41.850 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.720+0000 7fd8b24b5700 1 -- 172.21.15.32:0/37005294 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8ac0b2be0 con 0x7fd8ac1597f0 2023-10-08T06:09:41.850 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.720+0000 7fd8a1ffb700 1 -- 172.21.15.32:0/37005294 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8a8011d40 con 0x7fd8ac1597f0 2023-10-08T06:09:41.851 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.720+0000 7fd8b24b5700 1 -- 172.21.15.32:0/37005294 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8ac0b31a0 con 0x7fd8ac1597f0 2023-10-08T06:09:41.851 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.720+0000 7f6afaca0700 1 -- 172.21.15.32:0/2370644781 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6af40cdf60 con 0x7f6af40c98c0 2023-10-08T06:09:41.851 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.720+0000 7fefcdc64700 1 -- 172.21.15.32:0/566822261 >> v2:172.21.15.40:3300/0 conn(0x7fefc815b980 msgr2=0x7fefc815f780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:09:41.851 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.720+0000 7fefcdc64700 1 --2- 172.21.15.32:0/566822261 >> v2:172.21.15.40:3300/0 conn(0x7fefc815b980 0x7fefc815f780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:41.851 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.720+0000 7fefcdc64700 1 -- 172.21.15.32:0/566822261 >> v1:172.21.15.32:6789/0 conn(0x7fefc80c9960 legacy=0x7fefc815bd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:09:41.851 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.720+0000 7fefcdc64700 1 -- 172.21.15.32:0/566822261 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefc815fcc0 con 0x7fefc80719e0 2023-10-08T06:09:41.852 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.720+0000 7f9f6dffb700 1 -- 172.21.15.32:0/2930696406 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f680052d0 con 0x7f9f781599e0 2023-10-08T06:09:41.852 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.720+0000 7f9f6dffb700 1 -- 172.21.15.32:0/2930696406 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f6800ce90 con 0x7f9f781599e0 2023-10-08T06:09:41.852 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.720+0000 7f9f6dffb700 1 -- 172.21.15.32:0/2930696406 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f680036a0 con 0x7f9f781599e0 2023-10-08T06:09:41.852 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.720+0000 7f9f7f91a700 1 -- 172.21.15.32:0/2930696406 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f780ada20 con 0x7f9f781599e0 2023-10-08T06:09:41.852 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.720+0000 7f6afaca0700 1 --2- 172.21.15.32:0/2370644781 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6af40c98c0 0x7f6af40cb510 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f6af40ae820 tx=0x7f6aec00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=be6393227d15fff4 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:41.853 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.720+0000 7fefcdc64700 1 --2- 172.21.15.32:0/566822261 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fefc80719e0 0x7fefc80c9420 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fefc4009910 tx=0x7fefc4009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=768ee5dd64f08c62 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:41.853 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.720+0000 7f9f7f91a700 1 -- 172.21.15.32:0/2930696406 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f780b34c0 con 0x7f9f781599e0 2023-10-08T06:09:41.853 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.720+0000 7f3a6effd700 1 -- 172.21.15.32:0/3151139969 <== osd.4 v2:172.21.15.40:6800/3369928244 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f3a600712d0 con 0x7f3a6006e800 2023-10-08T06:09:41.854 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.720+0000 7f246dffb700 1 -- 172.21.15.32:0/1761187852 <== osd.2 v2:172.21.15.32:6824/1566874440 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f245c071250 con 0x7f245c06e780 2023-10-08T06:09:41.854 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.724+0000 7f6b50808700 1 --2- 172.21.15.32:0/944125589 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f6b38066670 0x7f6b38068b30 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f6b34009b20 tx=0x7f6b34010000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:41.854 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.724+0000 7fd7a97fa700 1 -- 172.21.15.32:0/2035612663 <== mon.2 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fd7ac06f470 con 0x7fd7a403a810 2023-10-08T06:09:41.854 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.724+0000 7fd7a97fa700 1 --2- 172.21.15.32:0/2035612663 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fd790066510 0x7fd7900689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:41.855 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.724+0000 7fd7a97fa700 1 -- 172.21.15.32:0/2035612663 <== mon.2 v2:172.21.15.40:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd7ac0fede0 con 0x7fd7a403a810 2023-10-08T06:09:41.855 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.724+0000 7f9f7f91a700 1 -- 172.21.15.32:0/2930696406 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9f780ce9a0 con 0x7f9f781599e0 2023-10-08T06:09:41.855 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.724+0000 7fd796ffd700 1 -- 172.21.15.32:0/2035612663 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd7a404fc40 con 0x7fd7a403a810 2023-10-08T06:09:41.855 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.724+0000 7fd7b0b16700 1 --2- 172.21.15.32:0/2035612663 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fd790066510 0x7fd7900689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:41.856 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.724+0000 7fd8b24b5700 1 -- 172.21.15.32:0/37005294 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd8ac0ccf20 con 0x7fd8ac1597f0 2023-10-08T06:09:41.856 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.724+0000 7fd7a97fa700 1 --2- 172.21.15.32:0/2035612663 >> [v2:172.21.15.32:6800/587888964,v1:172.21.15.32:6801/587888964] conn(0x7fd79006e6b0 0x7fd790070ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:41.856 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.724+0000 7fd7a97fa700 1 -- 172.21.15.32:0/2035612663 --> [v2:172.21.15.32:6800/587888964,v1:172.21.15.32:6801/587888964] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd790071180 con 0x7fd79006e6b0 2023-10-08T06:09:41.856 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.724+0000 7fd7b1317700 1 --2- 172.21.15.32:0/2035612663 >> [v2:172.21.15.32:6800/587888964,v1:172.21.15.32:6801/587888964] conn(0x7fd79006e6b0 0x7fd790070ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:41.856 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.724+0000 7fd7b0b16700 1 --2- 172.21.15.32:0/2035612663 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fd790066510 0x7fd7900689d0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd7a0001620 tx=0x7fd7a0007a40 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:41.857 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.724+0000 7fd7a97fa700 1 -- 172.21.15.32:0/2035612663 <== mon.2 v2:172.21.15.40:3301/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd7ac0cc270 con 0x7fd7a403a810 2023-10-08T06:09:41.857 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.724+0000 7fd7b1317700 1 --2- 172.21.15.32:0/2035612663 >> [v2:172.21.15.32:6800/587888964,v1:172.21.15.32:6801/587888964] conn(0x7fd79006e6b0 0x7fd790070ad0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:41.857 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.724+0000 7fd8a1ffb700 1 -- 172.21.15.32:0/37005294 <== mon.2 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fd8a8004020 con 0x7fd8ac1597f0 2023-10-08T06:09:41.857 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.724+0000 7fd8a1ffb700 1 --2- 172.21.15.32:0/37005294 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fd890066520 0x7fd8900689e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:41.858 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.724+0000 7fd8a1ffb700 1 -- 172.21.15.32:0/37005294 <== mon.2 v2:172.21.15.40:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd8a8084670 con 0x7fd8ac1597f0 2023-10-08T06:09:41.858 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.724+0000 7fd8a1ffb700 1 --2- 172.21.15.32:0/37005294 >> [v2:172.21.15.32:6804/3672614802,v1:172.21.15.32:6806/3672614802] conn(0x7fd89006e740 0x7fd890070b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:41.858 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.724+0000 7fd8a1ffb700 1 -- 172.21.15.32:0/37005294 --> [v2:172.21.15.32:6804/3672614802,v1:172.21.15.32:6806/3672614802] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd890071210 con 0x7fd89006e740 2023-10-08T06:09:41.858 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.724+0000 7fd8a1ffb700 1 -- 172.21.15.32:0/37005294 <== mon.2 v2:172.21.15.40:3301/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd8a8084a20 con 0x7fd8ac1597f0 2023-10-08T06:09:41.858 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.724+0000 7fd7a97fa700 1 -- 172.21.15.32:0/2035612663 <== osd.0 v2:172.21.15.32:6800/587888964 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7fd790071180 con 0x7fd79006e6b0 2023-10-08T06:09:41.859 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.724+0000 7fd8b1cb4700 1 --2- 172.21.15.32:0/37005294 >> [v2:172.21.15.32:6804/3672614802,v1:172.21.15.32:6806/3672614802] conn(0x7fd89006e740 0x7fd890070b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:41.859 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.724+0000 7fd8b1cb4700 1 --2- 172.21.15.32:0/37005294 >> [v2:172.21.15.32:6804/3672614802,v1:172.21.15.32:6806/3672614802] conn(0x7fd89006e740 0x7fd890070b60 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:41.859 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.728+0000 7fd8b14b3700 1 --2- 172.21.15.32:0/37005294 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fd890066520 0x7fd8900689e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:41.859 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.728+0000 7fd8b14b3700 1 --2- 172.21.15.32:0/37005294 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fd890066520 0x7fd8900689e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fd89c006fd0 tx=0x7fd89c014000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:41.860 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.728+0000 7fefcd463700 1 -- 172.21.15.32:0/566822261 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefc4004230 con 0x7fefc80719e0 2023-10-08T06:09:41.860 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.728+0000 7fefcd463700 1 -- 172.21.15.32:0/566822261 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefc4004390 con 0x7fefc80719e0 2023-10-08T06:09:41.860 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.728+0000 7fefcd463700 1 -- 172.21.15.32:0/566822261 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefc40036c0 con 0x7fefc80719e0 2023-10-08T06:09:41.860 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.728+0000 7fefcf467700 1 -- 172.21.15.32:0/566822261 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fefc80719e0 msgr2=0x7fefc80c9420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:41.860 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.728+0000 7fefcf467700 1 --2- 172.21.15.32:0/566822261 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fefc80719e0 0x7fefc80c9420 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fefc4009910 tx=0x7fefc4009c20 comp rx=0 tx=0).stop 2023-10-08T06:09:41.861 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.728+0000 7fefcf467700 1 -- 172.21.15.32:0/566822261 shutdown_connections 2023-10-08T06:09:41.861 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.728+0000 7fefcf467700 1 --2- 172.21.15.32:0/566822261 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fefc80719e0 0x7fefc80c9420 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:41.861 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.728+0000 7fefcf467700 1 --2- 172.21.15.32:0/566822261 >> v2:172.21.15.40:3300/0 conn(0x7fefc815b980 0x7fefc815f780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:41.861 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.728+0000 7fefcf467700 1 -- 172.21.15.32:0/566822261 >> 172.21.15.32:0/566822261 conn(0x7fefc80b0900 msgr2=0x7fefc80b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:09:41.861 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.728+0000 7fefcf467700 1 -- 172.21.15.32:0/566822261 shutdown_connections 2023-10-08T06:09:41.861 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.728+0000 7fefcf467700 1 -- 172.21.15.32:0/566822261 wait complete. 2023-10-08T06:09:41.861 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.728+0000 7fefcf467700 1 Processor -- start 2023-10-08T06:09:41.861 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.728+0000 7fefcf467700 1 -- start start 2023-10-08T06:09:41.862 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.724+0000 7f6af949d700 1 -- 172.21.15.32:0/2370644781 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6aec00e070 con 0x7f6af40c98c0 2023-10-08T06:09:41.862 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.724+0000 7f6af949d700 1 -- 172.21.15.32:0/2370644781 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6aec003a40 con 0x7f6af40c98c0 2023-10-08T06:09:41.862 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.724+0000 7f6af949d700 1 -- 172.21.15.32:0/2370644781 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6aec003df0 con 0x7f6af40c98c0 2023-10-08T06:09:41.862 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.724+0000 7f6afb4a1700 1 -- 172.21.15.32:0/2370644781 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6af40c98c0 msgr2=0x7f6af40cb510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:41.862 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.724+0000 7f6afb4a1700 1 --2- 172.21.15.32:0/2370644781 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6af40c98c0 0x7f6af40cb510 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f6af40ae820 tx=0x7f6aec00b330 comp rx=0 tx=0).stop 2023-10-08T06:09:41.863 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.724+0000 7f6afb4a1700 1 -- 172.21.15.32:0/2370644781 shutdown_connections 2023-10-08T06:09:41.863 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.724+0000 7f6afb4a1700 1 --2- 172.21.15.32:0/2370644781 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6af40c98c0 0x7f6af40cb510 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:41.863 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.724+0000 7f6afb4a1700 1 --2- 172.21.15.32:0/2370644781 >> v2:172.21.15.32:3300/0 conn(0x7f6af415a2b0 0x7f6af40ca9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:41.863 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.724+0000 7f6afb4a1700 1 -- 172.21.15.32:0/2370644781 >> 172.21.15.32:0/2370644781 conn(0x7f6af40b0900 msgr2=0x7f6af40b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:09:41.863 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.724+0000 7f6afb4a1700 1 -- 172.21.15.32:0/2370644781 shutdown_connections 2023-10-08T06:09:41.863 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.724+0000 7f6afb4a1700 1 -- 172.21.15.32:0/2370644781 wait complete. 2023-10-08T06:09:41.863 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.724+0000 7f6afb4a1700 1 Processor -- start 2023-10-08T06:09:41.863 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.724+0000 7f6afb4a1700 1 -- start start 2023-10-08T06:09:41.863 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.728+0000 7f6afb4a1700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6af40c98c0 0x7f6af4159120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:41.863 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.728+0000 7f6afb4a1700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6af4159ed0 0x7f6af4159660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:41.864 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.728+0000 7f6afb4a1700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6af415a2b0 0x7f6af40c8810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:41.864 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.728+0000 7f6afb4a1700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6af41567c0 con 0x7f6af4159ed0 2023-10-08T06:09:41.864 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.728+0000 7f6afb4a1700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6af4155bd0 con 0x7f6af40c98c0 2023-10-08T06:09:41.864 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.728+0000 7f6afb4a1700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6af4155e20 con 0x7f6af415a2b0 2023-10-08T06:09:41.864 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.728+0000 7f6afaca0700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6af415a2b0 0x7f6af40c8810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:41.864 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.728+0000 7f6afa49f700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6af40c98c0 0x7f6af4159120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:41.864 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.728+0000 7f6afaca0700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6af415a2b0 0x7f6af40c8810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.32:54566/0 (socket says 172.21.15.32:54566) 2023-10-08T06:09:41.864 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.728+0000 7f6afaca0700 1 -- 172.21.15.32:0/527895385 learned_addr learned my addr 172.21.15.32:0/527895385 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:09:41.864 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.728+0000 7f6afa49f700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6af40c98c0 0x7f6af4159120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.32:38118/0 (socket says 172.21.15.32:38118) 2023-10-08T06:09:41.864 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.728+0000 7f6afaca0700 1 -- 172.21.15.32:0/527895385 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6af40c98c0 msgr2=0x7f6af4159120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:41.864 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.728+0000 7f6afaca0700 1 --2- 172.21.15.32:0/527895385 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6af40c98c0 0x7f6af4159120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:41.865 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.728+0000 7f6afaca0700 1 -- 172.21.15.32:0/527895385 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6af4159ed0 msgr2=0x7f6af4159660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:41.865 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.728+0000 7f6afaca0700 1 --2- 172.21.15.32:0/527895385 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6af4159ed0 0x7f6af4159660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:41.865 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.728+0000 7f6afaca0700 1 -- 172.21.15.32:0/527895385 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6aec009b30 con 0x7f6af415a2b0 2023-10-08T06:09:41.865 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.728+0000 7f6afaca0700 1 --2- 172.21.15.32:0/527895385 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6af415a2b0 0x7f6af40c8810 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f6aec00b730 tx=0x7f6aec004af0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:41.865 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.728+0000 7f6aeaffd700 1 -- 172.21.15.32:0/527895385 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6aec004440 con 0x7f6af415a2b0 2023-10-08T06:09:41.865 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.728+0000 7f6aeaffd700 1 -- 172.21.15.32:0/527895385 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6aec0045a0 con 0x7f6af415a2b0 2023-10-08T06:09:41.865 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.728+0000 7f6afb4a1700 1 -- 172.21.15.32:0/527895385 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6af4156100 con 0x7f6af415a2b0 2023-10-08T06:09:41.865 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.728+0000 7f6aeaffd700 1 -- 172.21.15.32:0/527895385 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6aec004950 con 0x7f6af415a2b0 2023-10-08T06:09:41.865 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.728+0000 7f6afb4a1700 1 -- 172.21.15.32:0/527895385 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6af40c38d0 con 0x7f6af415a2b0 2023-10-08T06:09:41.866 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.732+0000 7fefcf467700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fefc80719e0 0x7fefc815aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:41.866 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.732+0000 7fefcf467700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fefc80c9960 0x7fefc80c6720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:41.866 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.732+0000 7fefcf467700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fefc815b980 0x7fefc80c6c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:41.866 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.732+0000 7fefcf467700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefc80c71a0 con 0x7fefc80719e0 2023-10-08T06:09:41.866 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.732+0000 7fefcf467700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefc814ced0 con 0x7fefc815b980 2023-10-08T06:09:41.866 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.732+0000 7fefcf467700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefc814d1b0 con 0x7fefc80c9960 2023-10-08T06:09:41.866 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.732+0000 7f6ae8ff9700 1 -- 172.21.15.32:0/527895385 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6af4070e00 con 0x7f6af415a2b0 2023-10-08T06:09:41.867 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.732+0000 7f6aeaffd700 1 -- 172.21.15.32:0/527895385 <== mon.2 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f6aec019030 con 0x7f6af415a2b0 2023-10-08T06:09:41.867 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.732+0000 7fefcdc64700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fefc80c9960 0x7fefc80c6720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:41.867 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.732+0000 7fefcdc64700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fefc80c9960 0x7fefc80c6720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.32:54572/0 (socket says 172.21.15.32:54572) 2023-10-08T06:09:41.867 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.732+0000 7fefcdc64700 1 -- 172.21.15.32:0/1932920234 learned_addr learned my addr 172.21.15.32:0/1932920234 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:09:41.867 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.732+0000 7f6aeaffd700 1 --2- 172.21.15.32:0/527895385 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f6ad8066510 0x7f6ad80689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:41.868 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.732+0000 7f6aeaffd700 1 -- 172.21.15.32:0/527895385 <== mon.2 v2:172.21.15.40:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6aec085260 con 0x7f6af415a2b0 2023-10-08T06:09:41.868 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.732+0000 7fefcdc64700 1 -- 172.21.15.32:0/1932920234 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fefc815b980 msgr2=0x7fefc80c6c60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T06:09:41.868 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.732+0000 7fefcdc64700 1 --2- 172.21.15.32:0/1932920234 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fefc815b980 0x7fefc80c6c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:41.868 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.732+0000 7fefcdc64700 1 -- 172.21.15.32:0/1932920234 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fefc80719e0 msgr2=0x7fefc815aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:41.868 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.732+0000 7fefcdc64700 1 --2- 172.21.15.32:0/1932920234 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fefc80719e0 0x7fefc815aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:41.868 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.732+0000 7f6aeaffd700 1 --2- 172.21.15.32:0/527895385 >> [v2:172.21.15.40:6824/2395850297,v1:172.21.15.40:6825/2395850297] conn(0x7f6ad806e6b0 0x7f6ad8070ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:41.869 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.732+0000 7f6aeaffd700 1 -- 172.21.15.32:0/527895385 --> [v2:172.21.15.40:6824/2395850297,v1:172.21.15.40:6825/2395850297] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6ad8071180 con 0x7f6ad806e6b0 2023-10-08T06:09:41.869 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.732+0000 7f6aeaffd700 1 -- 172.21.15.32:0/527895385 <== mon.2 v2:172.21.15.40:3301/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6aec087880 con 0x7f6af415a2b0 2023-10-08T06:09:41.869 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.732+0000 7f6afa49f700 1 --2- 172.21.15.32:0/527895385 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f6ad8066510 0x7f6ad80689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:41.869 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.732+0000 7fefcdc64700 1 -- 172.21.15.32:0/1932920234 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefc4009570 con 0x7fefc80c9960 2023-10-08T06:09:41.869 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.732+0000 7f6af9c9e700 1 --2- 172.21.15.32:0/527895385 >> [v2:172.21.15.40:6824/2395850297,v1:172.21.15.40:6825/2395850297] conn(0x7f6ad806e6b0 0x7f6ad8070ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:41.870 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.732+0000 7fefcdc64700 1 --2- 172.21.15.32:0/1932920234 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fefc80c9960 0x7fefc80c6720 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fefc815eeb0 tx=0x7fefc4004770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:41.870 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.732+0000 7f6afa49f700 1 --2- 172.21.15.32:0/527895385 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f6ad8066510 0x7f6ad80689d0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f6af40b0690 tx=0x7f6af0007ec0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:41.870 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.732+0000 7f6af9c9e700 1 --2- 172.21.15.32:0/527895385 >> [v2:172.21.15.40:6824/2395850297,v1:172.21.15.40:6825/2395850297] conn(0x7f6ad806e6b0 0x7f6ad8070ad0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:41.871 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.732+0000 7f9f6dffb700 1 -- 172.21.15.32:0/2930696406 <== mon.2 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f9f68003800 con 0x7f9f781599e0 2023-10-08T06:09:41.871 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.732+0000 7f9f6dffb700 1 --2- 172.21.15.32:0/2930696406 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f9f5c066510 0x7f9f5c0689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:41.871 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.732+0000 7f9f6dffb700 1 -- 172.21.15.32:0/2930696406 <== mon.2 v2:172.21.15.40:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9f680837d0 con 0x7f9f781599e0 2023-10-08T06:09:41.871 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.732+0000 7f9f6dffb700 1 --2- 172.21.15.32:0/2930696406 >> [v2:172.21.15.40:6808/4145283410,v1:172.21.15.40:6809/4145283410] conn(0x7f9f5c06e730 0x7f9f5c070b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:41.871 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.732+0000 7f9f6dffb700 1 -- 172.21.15.32:0/2930696406 --> [v2:172.21.15.40:6808/4145283410,v1:172.21.15.40:6809/4145283410] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9f5c071200 con 0x7f9f5c06e730 2023-10-08T06:09:41.871 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.732+0000 7f9f6dffb700 1 -- 172.21.15.32:0/2930696406 <== mon.2 v2:172.21.15.40:3301/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9f68083b80 con 0x7f9f781599e0 2023-10-08T06:09:41.871 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.732+0000 7f9f7d6b6700 1 --2- 172.21.15.32:0/2930696406 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f9f5c066510 0x7f9f5c0689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:41.871 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.732+0000 7f9f7deb7700 1 --2- 172.21.15.32:0/2930696406 >> [v2:172.21.15.40:6808/4145283410,v1:172.21.15.40:6809/4145283410] conn(0x7f9f5c06e730 0x7f9f5c070b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:41.871 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.732+0000 7f9f7deb7700 1 --2- 172.21.15.32:0/2930696406 >> [v2:172.21.15.40:6808/4145283410,v1:172.21.15.40:6809/4145283410] conn(0x7f9f5c06e730 0x7f9f5c070b50 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:41.872 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.732+0000 7f9f7d6b6700 1 --2- 172.21.15.32:0/2930696406 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f9f5c066510 0x7f9f5c0689d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f9f70009ce0 tx=0x7f9f7001b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:41.872 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.736+0000 7f9f6dffb700 1 -- 172.21.15.32:0/2930696406 <== osd.6 v2:172.21.15.40:6808/4145283410 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f9f5c071200 con 0x7f9f5c06e730 2023-10-08T06:09:41.872 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.728+0000 7fd8a1ffb700 1 -- 172.21.15.32:0/37005294 <== osd.3 v2:172.21.15.32:6804/3672614802 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7fd890071210 con 0x7fd89006e740 2023-10-08T06:09:41.872 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.736+0000 7f6aeaffd700 1 -- 172.21.15.32:0/527895385 <== osd.5 v2:172.21.15.40:6824/2395850297 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f6ad8071180 con 0x7f6ad806e6b0 2023-10-08T06:09:41.872 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.740+0000 7fefbeffd700 1 -- 172.21.15.32:0/1932920234 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefc4003ea0 con 0x7fefc80c9960 2023-10-08T06:09:41.873 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.744+0000 7f245b7fe700 1 -- 172.21.15.32:0/1761187852 --> [v2:172.21.15.32:6824/1566874440,v1:172.21.15.32:6825/1566874440] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f24700e0720 con 0x7f245c06e780 2023-10-08T06:09:41.873 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.740+0000 7fefbeffd700 1 -- 172.21.15.32:0/1932920234 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefc4011830 con 0x7fefc80c9960 2023-10-08T06:09:41.873 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.744+0000 7fefcf467700 1 -- 172.21.15.32:0/1932920234 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefc814d490 con 0x7fefc80c9960 2023-10-08T06:09:41.873 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.744+0000 7fefbeffd700 1 -- 172.21.15.32:0/1932920234 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefc4011be0 con 0x7fefc80c9960 2023-10-08T06:09:41.874 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.744+0000 7f246dffb700 1 -- 172.21.15.32:0/1761187852 <== osd.2 v2:172.21.15.32:6824/1566874440 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f2468009920 con 0x7f245c06e780 2023-10-08T06:09:41.874 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.744+0000 7fefcf467700 1 -- 172.21.15.32:0/1932920234 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefc814cb80 con 0x7fefc80c9960 2023-10-08T06:09:41.875 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.744+0000 7f245b7fe700 1 -- 172.21.15.32:0/1761187852 >> [v2:172.21.15.32:6824/1566874440,v1:172.21.15.32:6825/1566874440] conn(0x7f245c06e780 msgr2=0x7f245c070ba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:41.875 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.744+0000 7f245b7fe700 1 --2- 172.21.15.32:0/1761187852 >> [v2:172.21.15.32:6824/1566874440,v1:172.21.15.32:6825/1566874440] conn(0x7f245c06e780 0x7f245c070ba0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:41.875 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.744+0000 7f245b7fe700 1 -- 172.21.15.32:0/1761187852 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f245c066560 msgr2=0x7f245c068a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:41.875 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.744+0000 7f245b7fe700 1 --2- 172.21.15.32:0/1761187852 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f245c066560 0x7f245c068a20 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f2478069b60 tx=0x7f2478079ce0 comp rx=0 tx=0).stop 2023-10-08T06:09:41.876 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.744+0000 7f245b7fe700 1 -- 172.21.15.32:0/1761187852 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2470050050 msgr2=0x7f247004a880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:41.876 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.744+0000 7f245b7fe700 1 --2- 172.21.15.32:0/1761187852 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2470050050 0x7f247004a880 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f2474009c60 tx=0x7f2474004770 comp rx=0 tx=0).stop 2023-10-08T06:09:41.876 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.744+0000 7f247de10700 1 -- 172.21.15.32:0/1761187852 reap_dead start 2023-10-08T06:09:41.876 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.744+0000 7f245b7fe700 1 -- 172.21.15.32:0/1761187852 shutdown_connections 2023-10-08T06:09:41.876 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.744+0000 7f245b7fe700 1 -- 172.21.15.32:0/1761187852 >> 172.21.15.32:0/1761187852 conn(0x7f2470054c90 msgr2=0x7f24700d7660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:09:41.876 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.744+0000 7fefbeffd700 1 -- 172.21.15.32:0/1932920234 <== mon.2 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fefc4021070 con 0x7fefc80c9960 2023-10-08T06:09:41.877 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.744+0000 7f245b7fe700 1 -- 172.21.15.32:0/1761187852 shutdown_connections 2023-10-08T06:09:41.877 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.744+0000 7f245b7fe700 1 -- 172.21.15.32:0/1761187852 wait complete. 2023-10-08T06:09:41.877 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.744+0000 7fefbeffd700 1 --2- 172.21.15.32:0/1932920234 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fefac0665e0 0x7fefac068aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:41.877 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.744+0000 7fefbeffd700 1 -- 172.21.15.32:0/1932920234 <== mon.2 v2:172.21.15.40:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fefc4085780 con 0x7fefc80c9960 2023-10-08T06:09:41.877 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.744+0000 7fefce465700 1 --2- 172.21.15.32:0/1932920234 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fefac0665e0 0x7fefac068aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:41.877 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.748+0000 7fefce465700 1 --2- 172.21.15.32:0/1932920234 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fefac0665e0 0x7fefac068aa0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fefb8006b40 tx=0x7fefb8006ad0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:41.878 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.752+0000 7f6b5180a700 1 -- 172.21.15.32:0/944125589 --> [v2:172.21.15.32:6816/990576767,v1:172.21.15.32:6817/990576767] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f6b4c15d9e0 con 0x7f6b3806e810 2023-10-08T06:09:41.878 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.752+0000 7fefcf467700 1 --2- 172.21.15.32:0/1932920234 >> [v2:172.21.15.40:6816/2943297416,v1:172.21.15.40:6817/2943297416] conn(0x7fefc814dc70 0x7fefc80b19f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:41.878 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.752+0000 7fefcf467700 1 -- 172.21.15.32:0/1932920234 --> [v2:172.21.15.40:6816/2943297416,v1:172.21.15.40:6817/2943297416] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fefc80c9dd0 con 0x7fefc814dc70 2023-10-08T06:09:41.879 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.752+0000 7fefcec66700 1 --2- 172.21.15.32:0/1932920234 >> [v2:172.21.15.40:6816/2943297416,v1:172.21.15.40:6817/2943297416] conn(0x7fefc814dc70 0x7fefc80b19f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:41.879 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.752+0000 7f6b497fa700 1 -- 172.21.15.32:0/944125589 <== osd.1 v2:172.21.15.32:6816/990576767 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f6b44001d10 con 0x7f6b3806e810 2023-10-08T06:09:41.879 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.752+0000 7f6b5180a700 1 -- 172.21.15.32:0/944125589 >> [v2:172.21.15.32:6816/990576767,v1:172.21.15.32:6817/990576767] conn(0x7f6b3806e810 msgr2=0x7f6b38070c30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:41.879 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.752+0000 7f6b5180a700 1 --2- 172.21.15.32:0/944125589 >> [v2:172.21.15.32:6816/990576767,v1:172.21.15.32:6817/990576767] conn(0x7f6b3806e810 0x7f6b38070c30 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:41.880 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.752+0000 7fefcec66700 1 --2- 172.21.15.32:0/1932920234 >> [v2:172.21.15.40:6816/2943297416,v1:172.21.15.40:6817/2943297416] conn(0x7fefc814dc70 0x7fefc80b19f0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:41.880 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.752+0000 7f6b5180a700 1 -- 172.21.15.32:0/944125589 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f6b38066670 msgr2=0x7f6b38068b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:41.880 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.752+0000 7f6b5180a700 1 --2- 172.21.15.32:0/944125589 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f6b38066670 0x7f6b38068b30 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f6b34009b20 tx=0x7f6b34010000 comp rx=0 tx=0).stop 2023-10-08T06:09:41.881 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.752+0000 7f6b5180a700 1 -- 172.21.15.32:0/944125589 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6b4c0adfc0 msgr2=0x7f6b4c14a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:41.881 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.752+0000 7f6b5180a700 1 --2- 172.21.15.32:0/944125589 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6b4c0adfc0 0x7f6b4c14a940 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f6b3c000c00 tx=0x7f6b3c00c800 comp rx=0 tx=0).stop 2023-10-08T06:09:41.881 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.752+0000 7f6b51009700 1 -- 172.21.15.32:0/944125589 reap_dead start 2023-10-08T06:09:41.881 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.752+0000 7f6b5180a700 1 -- 172.21.15.32:0/944125589 shutdown_connections 2023-10-08T06:09:41.881 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.752+0000 7f6b5180a700 1 -- 172.21.15.32:0/944125589 >> 172.21.15.32:0/944125589 conn(0x7f6b4c0cb850 msgr2=0x7f6b4c0cd550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:09:41.881 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.752+0000 7f3a7f59e700 1 -- 172.21.15.32:0/3151139969 --> [v2:172.21.15.40:6800/3369928244,v1:172.21.15.40:6801/3369928244] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f3a64002d60 con 0x7f3a6006e800 2023-10-08T06:09:41.882 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.752+0000 7f6b5180a700 1 -- 172.21.15.32:0/944125589 shutdown_connections 2023-10-08T06:09:41.882 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.752+0000 7f6b5180a700 1 -- 172.21.15.32:0/944125589 wait complete. 2023-10-08T06:09:41.882 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.752+0000 7f3a6effd700 1 -- 172.21.15.32:0/3151139969 <== osd.4 v2:172.21.15.40:6800/3369928244 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f3a64002d60 con 0x7f3a6006e800 2023-10-08T06:09:41.883 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.752+0000 7f3a7f59e700 1 -- 172.21.15.32:0/3151139969 >> [v2:172.21.15.40:6800/3369928244,v1:172.21.15.40:6801/3369928244] conn(0x7f3a6006e800 msgr2=0x7f3a60070c20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:41.883 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.752+0000 7f3a7f59e700 1 --2- 172.21.15.32:0/3151139969 >> [v2:172.21.15.40:6800/3369928244,v1:172.21.15.40:6801/3369928244] conn(0x7f3a6006e800 0x7f3a60070c20 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:41.883 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.752+0000 7f3a7f59e700 1 -- 172.21.15.32:0/3151139969 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f3a600665e0 msgr2=0x7f3a60068aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:41.883 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.752+0000 7f3a7f59e700 1 --2- 172.21.15.32:0/3151139969 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f3a600665e0 0x7f3a60068aa0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f3a801f2140 tx=0x7f3a7800b040 comp rx=0 tx=0).stop 2023-10-08T06:09:41.883 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.752+0000 7fefbeffd700 1 -- 172.21.15.32:0/1932920234 <== osd.7 v2:172.21.15.40:6816/2943297416 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7fefc0004410 con 0x7fefc814dc70 2023-10-08T06:09:41.884 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.752+0000 7f3a7f59e700 1 -- 172.21.15.32:0/3151139969 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3a800706f0 msgr2=0x7f3a80155d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:41.884 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.752+0000 7f3a7f59e700 1 --2- 172.21.15.32:0/3151139969 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3a800706f0 0x7f3a80155d70 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f3a70004000 tx=0x7f3a70004770 comp rx=0 tx=0).stop 2023-10-08T06:09:41.884 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.752+0000 7f3a7ed9d700 1 -- 172.21.15.32:0/3151139969 reap_dead start 2023-10-08T06:09:41.884 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.752+0000 7f3a7f59e700 1 -- 172.21.15.32:0/3151139969 shutdown_connections 2023-10-08T06:09:41.884 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.752+0000 7f3a7f59e700 1 -- 172.21.15.32:0/3151139969 >> 172.21.15.32:0/3151139969 conn(0x7f3a800b0900 msgr2=0x7f3a8015c7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:09:41.884 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.752+0000 7f3a7f59e700 1 -- 172.21.15.32:0/3151139969 shutdown_connections 2023-10-08T06:09:41.884 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.752+0000 7f3a7f59e700 1 -- 172.21.15.32:0/3151139969 wait complete. 2023-10-08T06:09:41.885 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.756+0000 7fd796ffd700 1 -- 172.21.15.32:0/2035612663 --> [v2:172.21.15.32:6800/587888964,v1:172.21.15.32:6801/587888964] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fd7a404efc0 con 0x7fd79006e6b0 2023-10-08T06:09:41.885 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.756+0000 7fd7a97fa700 1 -- 172.21.15.32:0/2035612663 <== osd.0 v2:172.21.15.32:6800/587888964 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fd79800d040 con 0x7fd79006e6b0 2023-10-08T06:09:41.886 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.756+0000 7fd796ffd700 1 -- 172.21.15.32:0/2035612663 >> [v2:172.21.15.32:6800/587888964,v1:172.21.15.32:6801/587888964] conn(0x7fd79006e6b0 msgr2=0x7fd790070ad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:41.886 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.756+0000 7fd796ffd700 1 --2- 172.21.15.32:0/2035612663 >> [v2:172.21.15.32:6800/587888964,v1:172.21.15.32:6801/587888964] conn(0x7fd79006e6b0 0x7fd790070ad0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:41.886 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.756+0000 7fd796ffd700 1 -- 172.21.15.32:0/2035612663 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fd790066510 msgr2=0x7fd7900689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:41.886 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.756+0000 7fd796ffd700 1 --2- 172.21.15.32:0/2035612663 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fd790066510 0x7fd7900689d0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd7a0001620 tx=0x7fd7a0007a40 comp rx=0 tx=0).stop 2023-10-08T06:09:41.886 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.756+0000 7fd796ffd700 1 -- 172.21.15.32:0/2035612663 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd7a403a810 msgr2=0x7fd7a4054400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:41.886 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.756+0000 7fd796ffd700 1 --2- 172.21.15.32:0/2035612663 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd7a403a810 0x7fd7a4054400 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fd7ac079670 tx=0x7fd7ac074710 comp rx=0 tx=0).stop 2023-10-08T06:09:41.887 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.756+0000 7fd7b1317700 1 -- 172.21.15.32:0/2035612663 reap_dead start 2023-10-08T06:09:41.887 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.756+0000 7fd796ffd700 1 -- 172.21.15.32:0/2035612663 shutdown_connections 2023-10-08T06:09:41.887 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.756+0000 7fd796ffd700 1 -- 172.21.15.32:0/2035612663 >> 172.21.15.32:0/2035612663 conn(0x7fd7a4054c90 msgr2=0x7fd7a40df590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:09:41.887 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.756+0000 7fd796ffd700 1 -- 172.21.15.32:0/2035612663 shutdown_connections 2023-10-08T06:09:41.887 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.756+0000 7fd796ffd700 1 -- 172.21.15.32:0/2035612663 wait complete. 2023-10-08T06:09:41.888 INFO:teuthology.orchestra.run.smithi032.stdout:64424509446 2023-10-08T06:09:41.888 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-08T06:09:41.888 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.760+0000 7f9f7f91a700 1 -- 172.21.15.32:0/2930696406 --> [v2:172.21.15.40:6808/4145283410,v1:172.21.15.40:6809/4145283410] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f9f780cc370 con 0x7f9f5c06e730 2023-10-08T06:09:41.889 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.760+0000 7fd8b24b5700 1 -- 172.21.15.32:0/37005294 --> [v2:172.21.15.32:6804/3672614802,v1:172.21.15.32:6806/3672614802] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fd8ac0ccc40 con 0x7fd89006e740 2023-10-08T06:09:41.889 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.760+0000 7f6ae8ff9700 1 -- 172.21.15.32:0/527895385 --> [v2:172.21.15.40:6824/2395850297,v1:172.21.15.40:6825/2395850297] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f6af40ce240 con 0x7f6ad806e6b0 2023-10-08T06:09:41.889 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.760+0000 7f9f6dffb700 1 -- 172.21.15.32:0/2930696406 <== osd.6 v2:172.21.15.40:6808/4145283410 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f9f74004ac0 con 0x7f9f5c06e730 2023-10-08T06:09:41.890 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.764+0000 7fd8a1ffb700 1 -- 172.21.15.32:0/37005294 <== osd.3 v2:172.21.15.32:6804/3672614802 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fd8a4001a60 con 0x7fd89006e740 2023-10-08T06:09:41.890 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.764+0000 7f6aeaffd700 1 -- 172.21.15.32:0/527895385 <== osd.5 v2:172.21.15.40:6824/2395850297 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f6ae4009840 con 0x7f6ad806e6b0 2023-10-08T06:09:41.891 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.768+0000 7f9f7f91a700 1 -- 172.21.15.32:0/2930696406 >> [v2:172.21.15.40:6808/4145283410,v1:172.21.15.40:6809/4145283410] conn(0x7f9f5c06e730 msgr2=0x7f9f5c070b50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:41.891 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.768+0000 7f9f7f91a700 1 --2- 172.21.15.32:0/2930696406 >> [v2:172.21.15.40:6808/4145283410,v1:172.21.15.40:6809/4145283410] conn(0x7f9f5c06e730 0x7f9f5c070b50 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:41.891 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.768+0000 7f9f7f91a700 1 -- 172.21.15.32:0/2930696406 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f9f5c066510 msgr2=0x7f9f5c0689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:41.891 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.768+0000 7f9f7f91a700 1 --2- 172.21.15.32:0/2930696406 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f9f5c066510 0x7f9f5c0689d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f9f70009ce0 tx=0x7f9f7001b040 comp rx=0 tx=0).stop 2023-10-08T06:09:41.892 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.768+0000 7f9f7f91a700 1 -- 172.21.15.32:0/2930696406 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9f781599e0 msgr2=0x7f9f780ac8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:41.892 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.768+0000 7f9f7f91a700 1 --2- 172.21.15.32:0/2930696406 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9f781599e0 0x7f9f780ac8f0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f9f68001110 tx=0x7f9f6800c6e0 comp rx=0 tx=0).stop 2023-10-08T06:09:41.892 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.768+0000 7f9f7deb7700 1 -- 172.21.15.32:0/2930696406 reap_dead start 2023-10-08T06:09:41.892 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.768+0000 7f9f7f91a700 1 -- 172.21.15.32:0/2930696406 shutdown_connections 2023-10-08T06:09:41.892 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.768+0000 7f9f7f91a700 1 -- 172.21.15.32:0/2930696406 >> 172.21.15.32:0/2930696406 conn(0x7f9f780cb850 msgr2=0x7f9f78157f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:09:41.892 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.768+0000 7f9f7f91a700 1 -- 172.21.15.32:0/2930696406 shutdown_connections 2023-10-08T06:09:41.892 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.768+0000 7f9f7f91a700 1 -- 172.21.15.32:0/2930696406 wait complete. 2023-10-08T06:09:41.893 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.768+0000 7f6ae8ff9700 1 -- 172.21.15.32:0/527895385 >> [v2:172.21.15.40:6824/2395850297,v1:172.21.15.40:6825/2395850297] conn(0x7f6ad806e6b0 msgr2=0x7f6ad8070ad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:41.893 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.768+0000 7f6ae8ff9700 1 --2- 172.21.15.32:0/527895385 >> [v2:172.21.15.40:6824/2395850297,v1:172.21.15.40:6825/2395850297] conn(0x7f6ad806e6b0 0x7f6ad8070ad0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:41.893 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.768+0000 7f6ae8ff9700 1 -- 172.21.15.32:0/527895385 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f6ad8066510 msgr2=0x7f6ad80689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:41.893 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.768+0000 7f6ae8ff9700 1 --2- 172.21.15.32:0/527895385 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f6ad8066510 0x7f6ad80689d0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f6af40b0690 tx=0x7f6af0007ec0 comp rx=0 tx=0).stop 2023-10-08T06:09:41.893 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.768+0000 7f6ae8ff9700 1 -- 172.21.15.32:0/527895385 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6af415a2b0 msgr2=0x7f6af40c8810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:41.893 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.768+0000 7f6ae8ff9700 1 --2- 172.21.15.32:0/527895385 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6af415a2b0 0x7f6af40c8810 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f6aec00b730 tx=0x7f6aec004af0 comp rx=0 tx=0).stop 2023-10-08T06:09:41.893 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.768+0000 7f6afaca0700 1 -- 172.21.15.32:0/527895385 reap_dead start 2023-10-08T06:09:41.893 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.768+0000 7f6ae8ff9700 1 -- 172.21.15.32:0/527895385 shutdown_connections 2023-10-08T06:09:41.893 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.768+0000 7f6ae8ff9700 1 -- 172.21.15.32:0/527895385 >> 172.21.15.32:0/527895385 conn(0x7f6af40b0900 msgr2=0x7f6af40cf470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:09:41.894 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.768+0000 7f6ae8ff9700 1 -- 172.21.15.32:0/527895385 shutdown_connections 2023-10-08T06:09:41.894 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.768+0000 7f6ae8ff9700 1 -- 172.21.15.32:0/527895385 wait complete. 2023-10-08T06:09:41.894 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.772+0000 7fd8b24b5700 1 -- 172.21.15.32:0/37005294 >> [v2:172.21.15.32:6804/3672614802,v1:172.21.15.32:6806/3672614802] conn(0x7fd89006e740 msgr2=0x7fd890070b60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:41.894 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.772+0000 7fd8b24b5700 1 --2- 172.21.15.32:0/37005294 >> [v2:172.21.15.32:6804/3672614802,v1:172.21.15.32:6806/3672614802] conn(0x7fd89006e740 0x7fd890070b60 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:41.895 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.772+0000 7fd8b24b5700 1 -- 172.21.15.32:0/37005294 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fd890066520 msgr2=0x7fd8900689e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:41.895 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.772+0000 7fd8b24b5700 1 --2- 172.21.15.32:0/37005294 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fd890066520 0x7fd8900689e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fd89c006fd0 tx=0x7fd89c014000 comp rx=0 tx=0).stop 2023-10-08T06:09:41.895 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.772+0000 7fd8b24b5700 1 -- 172.21.15.32:0/37005294 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd8ac1597f0 msgr2=0x7fd8ac0c2f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:41.895 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.772+0000 7fd8b24b5700 1 --2- 172.21.15.32:0/37005294 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd8ac1597f0 0x7fd8ac0c2f40 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fd8a800b4a0 tx=0x7fd8a800b7b0 comp rx=0 tx=0).stop 2023-10-08T06:09:41.895 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.772+0000 7fd8b1cb4700 1 -- 172.21.15.32:0/37005294 reap_dead start 2023-10-08T06:09:41.895 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.772+0000 7fd8b24b5700 1 -- 172.21.15.32:0/37005294 shutdown_connections 2023-10-08T06:09:41.895 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.772+0000 7fd8b24b5700 1 -- 172.21.15.32:0/37005294 >> 172.21.15.32:0/37005294 conn(0x7fd8ac0b0900 msgr2=0x7fd8ac06bcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:09:41.896 INFO:teuthology.orchestra.run.smithi032.stdout:64424509446 2023-10-08T06:09:41.896 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-10-08T06:09:41.897 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.772+0000 7fd8b24b5700 1 -- 172.21.15.32:0/37005294 shutdown_connections 2023-10-08T06:09:41.897 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.772+0000 7fd8b24b5700 1 -- 172.21.15.32:0/37005294 wait complete. 2023-10-08T06:09:41.898 INFO:teuthology.orchestra.run.smithi032.stdout:64424509445 2023-10-08T06:09:41.898 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-08T06:09:41.899 INFO:teuthology.orchestra.run.smithi032.stdout:64424509446 2023-10-08T06:09:41.899 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-08T06:09:41.900 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.776+0000 7fefcf467700 1 -- 172.21.15.32:0/1932920234 --> [v2:172.21.15.40:6816/2943297416,v1:172.21.15.40:6817/2943297416] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fefc8070150 con 0x7fefc814dc70 2023-10-08T06:09:41.900 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.780+0000 7fefbeffd700 1 -- 172.21.15.32:0/1932920234 <== osd.7 v2:172.21.15.40:6816/2943297416 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fefc0004960 con 0x7fefc814dc70 2023-10-08T06:09:41.901 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.780+0000 7fefcf467700 1 -- 172.21.15.32:0/1932920234 >> [v2:172.21.15.40:6816/2943297416,v1:172.21.15.40:6817/2943297416] conn(0x7fefc814dc70 msgr2=0x7fefc80b19f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:41.901 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.780+0000 7fefcf467700 1 --2- 172.21.15.32:0/1932920234 >> [v2:172.21.15.40:6816/2943297416,v1:172.21.15.40:6817/2943297416] conn(0x7fefc814dc70 0x7fefc80b19f0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:41.901 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.780+0000 7fefcf467700 1 -- 172.21.15.32:0/1932920234 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fefac0665e0 msgr2=0x7fefac068aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:41.901 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.780+0000 7fefcf467700 1 --2- 172.21.15.32:0/1932920234 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fefac0665e0 0x7fefac068aa0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fefb8006b40 tx=0x7fefb8006ad0 comp rx=0 tx=0).stop 2023-10-08T06:09:41.901 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.780+0000 7fefcf467700 1 -- 172.21.15.32:0/1932920234 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fefc80c9960 msgr2=0x7fefc80c6720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:41.902 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.780+0000 7fefcf467700 1 --2- 172.21.15.32:0/1932920234 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fefc80c9960 0x7fefc80c6720 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fefc815eeb0 tx=0x7fefc4004770 comp rx=0 tx=0).stop 2023-10-08T06:09:41.902 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.780+0000 7fefcec66700 1 -- 172.21.15.32:0/1932920234 reap_dead start 2023-10-08T06:09:41.902 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.780+0000 7fefcf467700 1 -- 172.21.15.32:0/1932920234 shutdown_connections 2023-10-08T06:09:41.902 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.780+0000 7fefcf467700 1 -- 172.21.15.32:0/1932920234 >> 172.21.15.32:0/1932920234 conn(0x7fefc80b0900 msgr2=0x7fefc80ccd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:09:41.902 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.780+0000 7fefcf467700 1 -- 172.21.15.32:0/1932920234 shutdown_connections 2023-10-08T06:09:41.902 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:41.780+0000 7fefcf467700 1 -- 172.21.15.32:0/1932920234 wait complete. 2023-10-08T06:09:41.903 INFO:teuthology.orchestra.run.smithi032.stdout:64424509447 2023-10-08T06:09:41.903 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-10-08T06:09:41.904 INFO:teuthology.orchestra.run.smithi032.stdout:64424509446 2023-10-08T06:09:41.904 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-10-08T06:09:41.905 INFO:teuthology.orchestra.run.smithi032.stdout:60129542149 2023-10-08T06:09:41.905 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-08T06:09:41.906 INFO:teuthology.orchestra.run.smithi032.stdout:64424509446 2023-10-08T06:09:41.906 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-10-08T06:09:42.086 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.080+0000 7f3c9f155700 1 Processor -- start 2023-10-08T06:09:42.088 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.080+0000 7f3c9f155700 1 -- start start 2023-10-08T06:09:42.088 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.084+0000 7f3c9f155700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3c980cc370 0x7f3c980cd9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:42.088 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.084+0000 7f3c9f155700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3c98070380 0x7f3c98070810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:42.088 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.084+0000 7f3c9f155700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c980ce100 con 0x7f3c981599e0 2023-10-08T06:09:42.088 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.084+0000 7f3c9f155700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c98071160 con 0x7f3c980cc370 2023-10-08T06:09:42.088 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.084+0000 7f3c9f155700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c980cec80 con 0x7f3c98070380 2023-10-08T06:09:42.088 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.084+0000 7fb6e84b7700 1 Processor -- start 2023-10-08T06:09:42.089 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.084+0000 7f5b774dd700 1 Processor -- start 2023-10-08T06:09:42.089 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.084+0000 7faebccbe700 1 Processor -- start 2023-10-08T06:09:42.089 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.084+0000 7f3c9d6f2700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3c98070380 0x7f3c98070810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:42.089 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.084+0000 7f3c9d6f2700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3c98070380 0x7f3c98070810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.32:54588/0 (socket says 172.21.15.32:54588) 2023-10-08T06:09:42.089 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.084+0000 7f3c9d6f2700 1 -- 172.21.15.32:0/3734459363 learned_addr learned my addr 172.21.15.32:0/3734459363 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:09:42.090 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.084+0000 7faebccbe700 1 -- start start 2023-10-08T06:09:42.090 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.084+0000 7f5b774dd700 1 -- start start 2023-10-08T06:09:42.090 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.084+0000 7fa5430a9700 1 Processor -- start 2023-10-08T06:09:42.091 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.084+0000 7f3c9cef1700 1 --2- 172.21.15.32:0/3734459363 >> v2:172.21.15.40:3300/0 conn(0x7f3c980cc370 0x7f3c980cd9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:42.091 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.084+0000 7fa5430a9700 1 -- start start 2023-10-08T06:09:42.091 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.084+0000 7f3c9d6f2700 1 -- 172.21.15.32:0/3734459363 >> v2:172.21.15.40:3300/0 conn(0x7f3c980cc370 msgr2=0x7f3c980cd9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:09:42.091 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.084+0000 7f3c9d6f2700 1 --2- 172.21.15.32:0/3734459363 >> v2:172.21.15.40:3300/0 conn(0x7f3c980cc370 0x7f3c980cd9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:42.092 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.084+0000 7f3c9d6f2700 1 -- 172.21.15.32:0/3734459363 >> v1:172.21.15.40:6789/0 conn(0x7f3c981599e0 legacy=0x7f3c9815a3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:09:42.092 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.084+0000 7f3c9d6f2700 1 -- 172.21.15.32:0/3734459363 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c980ce3e0 con 0x7f3c98070380 2023-10-08T06:09:42.092 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.084+0000 7f3c9cef1700 1 --2- 172.21.15.32:0/3734459363 >> v2:172.21.15.40:3300/0 conn(0x7f3c980cc370 0x7f3c980cd9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T06:09:42.092 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.084+0000 7f3c9d6f2700 1 --2- 172.21.15.32:0/3734459363 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3c98070380 0x7f3c98070810 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f3c8c009940 tx=0x7f3c8c009c50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=82c1a06fe113c065 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:42.092 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.084+0000 7f5b774dd700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f5b700c21a0 0x7f5b7006c690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:42.092 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.084+0000 7f5b774dd700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f5b701652b0 0x7f5b700cb7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:42.092 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.084+0000 7f5b774dd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5b70165740 0x7f5b700cbd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:42.092 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.084+0000 7f5b774dd700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b701662c0 con 0x7f5b700c21a0 2023-10-08T06:09:42.093 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.084+0000 7f5b774dd700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b7006c200 con 0x7f5b701652b0 2023-10-08T06:09:42.093 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.084+0000 7f5b774dd700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b70165d00 con 0x7f5b70165740 2023-10-08T06:09:42.093 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.084+0000 7fb6e84b7700 1 -- start start 2023-10-08T06:09:42.093 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.084+0000 7fb6e84b7700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb6e01599e0 0x7fb6e00cd9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:42.093 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.084+0000 7fb6e84b7700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6e00ce100 con 0x7fb6e0070a90 2023-10-08T06:09:42.093 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.084+0000 7fb6e84b7700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6e00ce3e0 con 0x7fb6e015a440 2023-10-08T06:09:42.093 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.084+0000 7fb6e84b7700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6e0071160 con 0x7fb6e01599e0 2023-10-08T06:09:42.094 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.084+0000 7faebccbe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faeb80b8b20 0x7faeb80cdef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:42.094 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.084+0000 7faebccbe700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7faeb80ce430 0x7faeb80d1ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:42.094 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.084+0000 7faebccbe700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faeb80d1620 con 0x7faeb815d4b0 2023-10-08T06:09:42.094 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.084+0000 7faebccbe700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faeb80ce8e0 con 0x7faeb80ce430 2023-10-08T06:09:42.094 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.084+0000 7fb6e5a52700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fb6e0070a90 0x7fb6e00c9800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:46162/0 (socket says 172.21.15.32:46162) 2023-10-08T06:09:42.094 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.084+0000 7fb6e5a52700 1 -- 172.21.15.32:0/945950615 learned_addr learned my addr 172.21.15.32:0/945950615 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-08T06:09:42.094 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.084+0000 7faebccbe700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faeb80d1320 con 0x7faeb80b8b20 2023-10-08T06:09:42.095 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.084+0000 7f3c977fe700 1 -- 172.21.15.32:0/3734459363 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c8c004230 con 0x7f3c98070380 2023-10-08T06:09:42.095 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.084+0000 7f3c977fe700 1 -- 172.21.15.32:0/3734459363 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c8c009e90 con 0x7f3c98070380 2023-10-08T06:09:42.095 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.084+0000 7f3c977fe700 1 -- 172.21.15.32:0/3734459363 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c8c0045b0 con 0x7f3c98070380 2023-10-08T06:09:42.095 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.084+0000 7fb6e6a54700 1 --2- 172.21.15.32:0/945950615 >> v2:172.21.15.40:3300/0 conn(0x7fb6e01599e0 0x7fb6e00cd9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:42.095 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.084+0000 7f5b74a78700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f5b701652b0 0x7f5b700cb7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:42.096 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.084+0000 7faeb5d9b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faeb80b8b20 0x7faeb80cdef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:42.096 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.084+0000 7faeb5d9b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faeb80b8b20 0x7faeb80cdef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.32:54596/0 (socket says 172.21.15.32:54596) 2023-10-08T06:09:42.096 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.084+0000 7faeb5d9b700 1 -- 172.21.15.32:0/1702701564 learned_addr learned my addr 172.21.15.32:0/1702701564 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:09:42.096 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.084+0000 7fa5430a9700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fa53c0c21a0 0x7fa53c06c690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:42.096 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.084+0000 7fa5430a9700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa53c1652b0 0x7fa53c0cb7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:42.096 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.084+0000 7fa5430a9700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa53c06c200 con 0x7fa53c165740 2023-10-08T06:09:42.097 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.084+0000 7fa5430a9700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa53c1662c0 con 0x7fa53c0c21a0 2023-10-08T06:09:42.097 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.084+0000 7fa5430a9700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa53c165d00 con 0x7fa53c1652b0 2023-10-08T06:09:42.097 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.084+0000 7f5b74a78700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f5b701652b0 0x7f5b700cb7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.32:38132/0 (socket says 172.21.15.32:38132) 2023-10-08T06:09:42.097 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.084+0000 7f5b74a78700 1 -- 172.21.15.32:0/757836743 learned_addr learned my addr 172.21.15.32:0/757836743 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:09:42.097 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.084+0000 7f5b75279700 1 --2- 172.21.15.32:0/757836743 >> v2:172.21.15.32:3300/0 conn(0x7f5b700c21a0 0x7f5b7006c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:42.097 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.084+0000 7fa5428a8700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fa53c165740 0x7fa53c0cc9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:46178/0 (socket says 172.21.15.32:46178) 2023-10-08T06:09:42.098 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.084+0000 7fa5428a8700 1 -- 172.21.15.32:0/2403466009 learned_addr learned my addr 172.21.15.32:0/2403466009 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-08T06:09:42.098 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.084+0000 7fa5418a6700 1 --2- 172.21.15.32:0/2403466009 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa53c1652b0 0x7fa53c0cb7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:42.098 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.084+0000 7faeb6d9d700 1 --2- 172.21.15.32:0/1702701564 >> v2:172.21.15.40:3300/0 conn(0x7faeb80ce430 0x7faeb80d1ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:42.098 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.084+0000 7f5b75a7a700 1 --2- 172.21.15.32:0/757836743 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5b70165740 0x7f5b700cbd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:42.099 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.084+0000 7f3c9f155700 1 -- 172.21.15.32:0/3734459363 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3c98070380 msgr2=0x7f3c98070810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:42.099 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.084+0000 7f3c9f155700 1 --2- 172.21.15.32:0/3734459363 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3c98070380 0x7f3c98070810 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f3c8c009940 tx=0x7f3c8c009c50 comp rx=0 tx=0).stop 2023-10-08T06:09:42.099 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.084+0000 7fb6e5251700 1 -- 172.21.15.32:0/945950615 <== mon.1 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3581723136 0 0) 0x7fb6e00ce3e0 con 0x7fb6e015a440 2023-10-08T06:09:42.099 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.084+0000 7fb6e5251700 1 -- 172.21.15.32:0/945950615 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb6cc0034f0 con 0x7fb6e015a440 2023-10-08T06:09:42.099 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.084+0000 7faeb5d9b700 1 -- 172.21.15.32:0/1702701564 >> v2:172.21.15.40:3300/0 conn(0x7faeb80ce430 msgr2=0x7faeb80d1ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:09:42.100 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.084+0000 7fa5420a7700 1 --2- 172.21.15.32:0/2403466009 >> v2:172.21.15.32:3300/0 conn(0x7fa53c0c21a0 0x7fa53c06c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:42.100 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.084+0000 7f3c9f155700 1 -- 172.21.15.32:0/3734459363 shutdown_connections 2023-10-08T06:09:42.100 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.084+0000 7f3c9f155700 1 --2- 172.21.15.32:0/3734459363 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3c98070380 0x7f3c98070810 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:42.100 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.084+0000 7f3c9f155700 1 --2- 172.21.15.32:0/3734459363 >> v2:172.21.15.40:3300/0 conn(0x7f3c980cc370 0x7f3c980cd9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:42.100 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.084+0000 7f3c9f155700 1 -- 172.21.15.32:0/3734459363 >> 172.21.15.32:0/3734459363 conn(0x7f3c980cb850 msgr2=0x7f3c980cbc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:09:42.101 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.084+0000 7faeb559a700 1 -- 172.21.15.32:0/1702701564 <== mon.1 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3373848230 0 0) 0x7faeb80d1620 con 0x7faeb815d4b0 2023-10-08T06:09:42.101 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.084+0000 7f5b74a78700 1 -- 172.21.15.32:0/757836743 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5b70165740 msgr2=0x7f5b700cbd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:09:42.101 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.084+0000 7f3c9f155700 1 -- 172.21.15.32:0/3734459363 shutdown_connections 2023-10-08T06:09:42.101 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.084+0000 7fa5410a5700 1 -- 172.21.15.32:0/2403466009 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3523673887 0 0) 0x7fa53c06c200 con 0x7fa53c165740 2023-10-08T06:09:42.102 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.084+0000 7f3c9f155700 1 -- 172.21.15.32:0/3734459363 wait complete. 2023-10-08T06:09:42.102 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.084+0000 7fb6e5251700 1 -- 172.21.15.32:0/945950615 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3588622008 0 0) 0x7fb6e00ce100 con 0x7fb6e0070a90 2023-10-08T06:09:42.102 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.084+0000 7fb6e5251700 1 -- 172.21.15.32:0/945950615 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb6e00ce3e0 con 0x7fb6e0070a90 2023-10-08T06:09:42.102 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.084+0000 7fb6e5251700 1 -- 172.21.15.32:0/945950615 <== mon.1 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2241809136 0 0) 0x7fb6cc0034f0 con 0x7fb6e015a440 2023-10-08T06:09:42.103 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.084+0000 7faeb5d9b700 1 --2- 172.21.15.32:0/1702701564 >> v2:172.21.15.40:3300/0 conn(0x7faeb80ce430 0x7faeb80d1ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:42.103 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.084+0000 7faeb5d9b700 1 -- 172.21.15.32:0/1702701564 >> v1:172.21.15.40:6789/0 conn(0x7faeb815d4b0 legacy=0x7faeb8161110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:42.103 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.084+0000 7faeb5d9b700 1 -- 172.21.15.32:0/1702701564 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faeb81619f0 con 0x7faeb80b8b20 2023-10-08T06:09:42.103 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.084+0000 7faeb6d9d700 1 --2- 172.21.15.32:0/1702701564 >> v2:172.21.15.40:3300/0 conn(0x7faeb80ce430 0x7faeb80d1ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T06:09:42.103 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.084+0000 7fa5410a5700 1 -- 172.21.15.32:0/2403466009 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa5280035d0 con 0x7fa53c165740 2023-10-08T06:09:42.104 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.084+0000 7f5b74a78700 1 --2- 172.21.15.32:0/757836743 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5b70165740 0x7f5b700cbd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:42.104 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.084+0000 7f5b74a78700 1 -- 172.21.15.32:0/757836743 >> v2:172.21.15.32:3300/0 conn(0x7f5b700c21a0 msgr2=0x7f5b7006c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:09:42.104 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.084+0000 7f5b74a78700 1 --2- 172.21.15.32:0/757836743 >> v2:172.21.15.32:3300/0 conn(0x7f5b700c21a0 0x7f5b7006c690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:42.104 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.084+0000 7f5b74a78700 1 -- 172.21.15.32:0/757836743 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b70165fe0 con 0x7f5b701652b0 2023-10-08T06:09:42.104 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.084+0000 7f5b75279700 1 --2- 172.21.15.32:0/757836743 >> v2:172.21.15.32:3300/0 conn(0x7f5b700c21a0 0x7f5b7006c690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T06:09:42.104 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.084+0000 7f5b75a7a700 1 --2- 172.21.15.32:0/757836743 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5b70165740 0x7f5b700cbd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T06:09:42.104 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.088+0000 7fa5418a6700 1 -- 172.21.15.32:0/2403466009 >> v2:172.21.15.32:3300/0 conn(0x7fa53c0c21a0 msgr2=0x7fa53c06c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:09:42.105 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.088+0000 7fa5418a6700 1 --2- 172.21.15.32:0/2403466009 >> v2:172.21.15.32:3300/0 conn(0x7fa53c0c21a0 0x7fa53c06c690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:42.105 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.088+0000 7fa5418a6700 1 -- 172.21.15.32:0/2403466009 >> v1:172.21.15.32:6789/0 conn(0x7fa53c165740 legacy=0x7fa53c0cc9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:42.105 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.088+0000 7fa5418a6700 1 -- 172.21.15.32:0/2403466009 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa53c165fe0 con 0x7fa53c1652b0 2023-10-08T06:09:42.105 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.088+0000 7faeb5d9b700 1 --2- 172.21.15.32:0/1702701564 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faeb80b8b20 0x7faeb80cdef0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7faeb0009e50 tx=0x7faeb000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e9b3baa306791df9 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:42.105 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.088+0000 7f5b74a78700 1 --2- 172.21.15.32:0/757836743 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5b701652b0 0x7f5b700cb7e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f5b700ced80 tx=0x7f5b60009bf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b9ae0989bb34323 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:42.106 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.088+0000 7fa5420a7700 1 --2- 172.21.15.32:0/2403466009 >> v2:172.21.15.32:3300/0 conn(0x7fa53c0c21a0 0x7fa53c06c690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T06:09:42.106 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.084+0000 7fb6e5251700 1 -- 172.21.15.32:0/945950615 >> v2:172.21.15.40:3300/0 conn(0x7fb6e01599e0 msgr2=0x7fb6e00cd9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:09:42.106 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.088+0000 7fb6e5251700 1 --2- 172.21.15.32:0/945950615 >> v2:172.21.15.40:3300/0 conn(0x7fb6e01599e0 0x7fb6e00cd9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:42.106 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.088+0000 7fb6e5251700 1 -- 172.21.15.32:0/945950615 >> v1:172.21.15.32:6789/0 conn(0x7fb6e0070a90 legacy=0x7fb6e00c9800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:42.106 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.088+0000 7fb6e5251700 1 -- 172.21.15.32:0/945950615 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6e00ce6c0 con 0x7fb6e015a440 2023-10-08T06:09:42.106 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.088+0000 7fa5418a6700 1 --2- 172.21.15.32:0/2403466009 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa53c1652b0 0x7fa53c0cb7e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fa52c009850 tx=0x7fa52c009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b3ffb647e2365be server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:42.107 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.088+0000 7fb6e5251700 1 -- 172.21.15.32:0/945950615 <== mon.1 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2364763317 0 0) 0x7fb6d0001670 con 0x7fb6e015a440 2023-10-08T06:09:42.107 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.088+0000 7fb6e6a54700 1 --2- 172.21.15.32:0/945950615 >> v2:172.21.15.40:3300/0 conn(0x7fb6e01599e0 0x7fb6e00cd9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T06:09:42.107 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.088+0000 7fb6e5251700 1 -- 172.21.15.32:0/945950615 >> v1:172.21.15.40:6789/0 conn(0x7fb6e015a440 legacy=0x7fb6e0070380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:42.107 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.088+0000 7faeb559a700 1 -- 172.21.15.32:0/1702701564 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeb000e070 con 0x7faeb80b8b20 2023-10-08T06:09:42.107 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.088+0000 7faeb559a700 1 -- 172.21.15.32:0/1702701564 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faeb000b9c0 con 0x7faeb80b8b20 2023-10-08T06:09:42.108 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.088+0000 7fb6e5251700 1 --2- 172.21.15.32:0/945950615 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb6cc003ca0 0x7fb6cc004080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:42.108 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.088+0000 7fb6e5251700 1 --2- 172.21.15.32:0/945950615 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb6cc0089f0 0x7fb6cc00ae80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:42.108 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.088+0000 7fb6e5251700 1 --2- 172.21.15.32:0/945950615 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb6cc00b4f0 0x7fb6cc00d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:42.108 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.088+0000 7fb6e5251700 1 -- 172.21.15.32:0/945950615 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6dc004ad0 con 0x7fb6cc003ca0 2023-10-08T06:09:42.108 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.088+0000 7fb6e5251700 1 -- 172.21.15.32:0/945950615 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6cc00e290 con 0x7fb6cc00b4f0 2023-10-08T06:09:42.108 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.088+0000 7fb6e5251700 1 -- 172.21.15.32:0/945950615 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6cc00e450 con 0x7fb6cc0089f0 2023-10-08T06:09:42.109 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.088+0000 7faeb559a700 1 -- 172.21.15.32:0/1702701564 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeb000bd70 con 0x7faeb80b8b20 2023-10-08T06:09:42.109 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.088+0000 7f5b67fff700 1 -- 172.21.15.32:0/757836743 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b60011830 con 0x7f5b701652b0 2023-10-08T06:09:42.109 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.088+0000 7f5b67fff700 1 -- 172.21.15.32:0/757836743 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b60011990 con 0x7f5b701652b0 2023-10-08T06:09:42.109 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.088+0000 7f5b67fff700 1 -- 172.21.15.32:0/757836743 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b60011d20 con 0x7f5b701652b0 2023-10-08T06:09:42.110 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.088+0000 7fb6e6253700 1 --2- 172.21.15.32:0/945950615 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb6cc003ca0 0x7fb6cc004080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:42.110 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.088+0000 7fb6e6a54700 1 --2- 172.21.15.32:0/945950615 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb6cc00b4f0 0x7fb6cc00d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:42.110 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.088+0000 7fb6e6253700 1 -- 172.21.15.32:0/945950615 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb6cc0089f0 msgr2=0x7fb6cc00ae80 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-08T06:09:42.110 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.088+0000 7fb6e6253700 1 --2- 172.21.15.32:0/945950615 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb6cc0089f0 0x7fb6cc00ae80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:42.110 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.088+0000 7fb6e6253700 1 -- 172.21.15.32:0/945950615 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb6cc00b4f0 msgr2=0x7fb6cc00d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:09:42.110 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.088+0000 7fb6e6253700 1 --2- 172.21.15.32:0/945950615 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb6cc00b4f0 0x7fb6cc00d9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:42.110 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.088+0000 7fb6e6253700 1 -- 172.21.15.32:0/945950615 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6cc0034f0 con 0x7fb6cc003ca0 2023-10-08T06:09:42.110 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.088+0000 7fb6e6a54700 1 -- 172.21.15.32:0/945950615 reap_dead start 2023-10-08T06:09:42.111 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.088+0000 7fa5410a5700 1 -- 172.21.15.32:0/2403466009 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa52c011830 con 0x7fa53c1652b0 2023-10-08T06:09:42.111 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.088+0000 7fa5410a5700 1 -- 172.21.15.32:0/2403466009 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa52c011990 con 0x7fa53c1652b0 2023-10-08T06:09:42.111 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.088+0000 7fa5410a5700 1 -- 172.21.15.32:0/2403466009 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa52c011d40 con 0x7fa53c1652b0 2023-10-08T06:09:42.111 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.088+0000 7faebccbe700 1 -- 172.21.15.32:0/1702701564 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faeb80b8b20 msgr2=0x7faeb80cdef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:42.111 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.088+0000 7faebccbe700 1 --2- 172.21.15.32:0/1702701564 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faeb80b8b20 0x7faeb80cdef0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7faeb0009e50 tx=0x7faeb000b330 comp rx=0 tx=0).stop 2023-10-08T06:09:42.112 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.088+0000 7f1b10b0e700 1 Processor -- start 2023-10-08T06:09:42.112 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.088+0000 7f3c9f155700 1 Processor -- start 2023-10-08T06:09:42.112 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.088+0000 7fb6e6253700 1 --2- 172.21.15.32:0/945950615 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb6cc003ca0 0x7fb6cc004080 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fb6d0007f80 tx=0x7fb6cc0037a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3dbccd40759c18c5 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:42.113 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.088+0000 7f3c9f155700 1 -- start start 2023-10-08T06:09:42.113 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.088+0000 7f1b10b0e700 1 -- start start 2023-10-08T06:09:42.113 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.088+0000 7f5b774dd700 1 -- 172.21.15.32:0/757836743 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5b701652b0 msgr2=0x7f5b700cb7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:42.113 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.088+0000 7f5b774dd700 1 --2- 172.21.15.32:0/757836743 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5b701652b0 0x7f5b700cb7e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f5b700ced80 tx=0x7f5b60009bf0 comp rx=0 tx=0).stop 2023-10-08T06:09:42.113 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.088+0000 7f5b774dd700 1 -- 172.21.15.32:0/757836743 shutdown_connections 2023-10-08T06:09:42.114 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.088+0000 7f5b774dd700 1 --2- 172.21.15.32:0/757836743 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5b70165740 0x7f5b700cbd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:42.114 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.088+0000 7f5b774dd700 1 --2- 172.21.15.32:0/757836743 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5b701652b0 0x7f5b700cb7e0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:42.114 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.088+0000 7f5b774dd700 1 --2- 172.21.15.32:0/757836743 >> v2:172.21.15.32:3300/0 conn(0x7f5b700c21a0 0x7f5b7006c690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:42.114 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.088+0000 7f5b774dd700 1 -- 172.21.15.32:0/757836743 >> 172.21.15.32:0/757836743 conn(0x7f5b700b0900 msgr2=0x7f5b700b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:09:42.114 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.088+0000 7f8feedad700 1 Processor -- start 2023-10-08T06:09:42.114 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.088+0000 7f8feedad700 1 -- start start 2023-10-08T06:09:42.115 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.088+0000 7faebccbe700 1 -- 172.21.15.32:0/1702701564 shutdown_connections 2023-10-08T06:09:42.115 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.088+0000 7faebccbe700 1 --2- 172.21.15.32:0/1702701564 >> v2:172.21.15.40:3300/0 conn(0x7faeb80ce430 0x7faeb80d1ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:42.115 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.088+0000 7faebccbe700 1 --2- 172.21.15.32:0/1702701564 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faeb80b8b20 0x7faeb80cdef0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:42.115 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.088+0000 7faebccbe700 1 -- 172.21.15.32:0/1702701564 >> 172.21.15.32:0/1702701564 conn(0x7faeb806ac60 msgr2=0x7faeb806b070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:09:42.115 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.088+0000 7fb6e5251700 1 -- 172.21.15.32:0/945950615 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6d0007a40 con 0x7fb6cc003ca0 2023-10-08T06:09:42.115 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.088+0000 7fb6e5251700 1 -- 172.21.15.32:0/945950615 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6d000cc70 con 0x7fb6cc003ca0 2023-10-08T06:09:42.115 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.088+0000 7fb6e5251700 1 -- 172.21.15.32:0/945950615 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6d0012420 con 0x7fb6cc003ca0 2023-10-08T06:09:42.116 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.088+0000 7f5b774dd700 1 -- 172.21.15.32:0/757836743 shutdown_connections 2023-10-08T06:09:42.116 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.088+0000 7fa5430a9700 1 -- 172.21.15.32:0/2403466009 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa53c1652b0 msgr2=0x7fa53c0cb7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:42.116 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.088+0000 7fa5430a9700 1 --2- 172.21.15.32:0/2403466009 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa53c1652b0 0x7fa53c0cb7e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fa52c009850 tx=0x7fa52c009b60 comp rx=0 tx=0).stop 2023-10-08T06:09:42.116 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.088+0000 7fa5430a9700 1 -- 172.21.15.32:0/2403466009 shutdown_connections 2023-10-08T06:09:42.116 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.088+0000 7fa5430a9700 1 --2- 172.21.15.32:0/2403466009 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa53c1652b0 0x7fa53c0cb7e0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:42.116 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.088+0000 7fa5430a9700 1 --2- 172.21.15.32:0/2403466009 >> v2:172.21.15.32:3300/0 conn(0x7fa53c0c21a0 0x7fa53c06c690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:42.117 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.088+0000 7fa5430a9700 1 -- 172.21.15.32:0/2403466009 >> 172.21.15.32:0/2403466009 conn(0x7fa53c0b0900 msgr2=0x7fa53c0b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:09:42.117 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.088+0000 7f8feedad700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f8fe81652b0 0x7f8fe80cb7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:42.117 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.088+0000 7f8feedad700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f8fe8165740 0x7f8fe80cbd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:42.117 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.088+0000 7f1b10b0e700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f1b0c15d600 0x7f1b0c0cd9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:42.117 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.088+0000 7f1b10b0e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1b0c0703c0 0x7f1b0c0cdef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:42.118 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.088+0000 7fa5430a9700 1 -- 172.21.15.32:0/2403466009 shutdown_connections 2023-10-08T06:09:42.118 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.088+0000 7f1b10b0e700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f1b0c0ce430 0x7f1b0c161150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:42.118 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.088+0000 7f1b10b0e700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b0c0ade50 con 0x7f1b0c15d600 2023-10-08T06:09:42.118 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.088+0000 7f1b10b0e700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b0c06dfc0 con 0x7f1b0c0ce430 2023-10-08T06:09:42.118 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.088+0000 7f1b10b0e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b0c15e800 con 0x7f1b0c0703c0 2023-10-08T06:09:42.119 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.088+0000 7f8feedad700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fe806c200 con 0x7f8fe80c21a0 2023-10-08T06:09:42.119 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.088+0000 7f3c9f155700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3c98070380 0x7f3c980b1c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:42.119 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.088+0000 7f3c9f155700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3c980cc370 0x7f3c9814d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:42.119 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.088+0000 7f3c9f155700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3c981599e0 0x7f3c980c4720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:42.119 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.088+0000 7f3c9f155700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c980c4300 con 0x7f3c980cc370 2023-10-08T06:09:42.121 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.088+0000 7f3c9f155700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c980b3fe0 con 0x7f3c981599e0 2023-10-08T06:09:42.121 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.088+0000 7f3c9f155700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c980c3f60 con 0x7f3c98070380 2023-10-08T06:09:42.121 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.088+0000 7f3c9cef1700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3c98070380 0x7f3c980b1c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:42.122 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.088+0000 7faebccbe700 1 -- 172.21.15.32:0/1702701564 shutdown_connections 2023-10-08T06:09:42.122 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.088+0000 7faebccbe700 1 -- 172.21.15.32:0/1702701564 wait complete. 2023-10-08T06:09:42.122 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.088+0000 7f5b774dd700 1 -- 172.21.15.32:0/757836743 wait complete. 2023-10-08T06:09:42.122 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.088+0000 7f8feedad700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fe81662c0 con 0x7f8fe8165740 2023-10-08T06:09:42.122 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.088+0000 7f8feedad700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fe8165d00 con 0x7f8fe81652b0 2023-10-08T06:09:42.122 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.088+0000 7f8fe7fff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f8fe81652b0 0x7f8fe80cb7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:42.123 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.088+0000 7f8fecb49700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f8fe80c21a0 0x7f8fe806c690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.32:45958/0 (socket says 172.21.15.32:45958) 2023-10-08T06:09:42.123 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.088+0000 7f8fecb49700 1 -- 172.21.15.32:0/1372088893 learned_addr learned my addr 172.21.15.32:0/1372088893 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-08T06:09:42.123 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.088+0000 7f3c9cef1700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3c98070380 0x7f3c980b1c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.32:54636/0 (socket says 172.21.15.32:54636) 2023-10-08T06:09:42.123 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.088+0000 7f3c9cef1700 1 -- 172.21.15.32:0/2653903517 learned_addr learned my addr 172.21.15.32:0/2653903517 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:09:42.123 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.088+0000 7f3c9d6f2700 1 --2- 172.21.15.32:0/2653903517 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3c981599e0 0x7f3c980c4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:42.123 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.088+0000 7f1b0a59c700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f1b0c15d600 0x7f1b0c0cd9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:42.124 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.088+0000 7f1b0a59c700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f1b0c15d600 0x7f1b0c0cd9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:59286/0 (socket says 172.21.15.32:59286) 2023-10-08T06:09:42.124 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.088+0000 7f1b0a59c700 1 -- 172.21.15.32:0/1192728913 learned_addr learned my addr 172.21.15.32:0/1192728913 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:09:42.124 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.088+0000 7f1b09d9b700 1 --2- 172.21.15.32:0/1192728913 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1b0c0703c0 0x7f1b0c0cdef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:42.124 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.088+0000 7fb6e84b7700 1 -- 172.21.15.32:0/945950615 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb6cc003ca0 msgr2=0x7fb6cc004080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:42.124 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.088+0000 7fb6e84b7700 1 --2- 172.21.15.32:0/945950615 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb6cc003ca0 0x7fb6cc004080 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fb6d0007f80 tx=0x7fb6cc0037a0 comp rx=0 tx=0).stop 2023-10-08T06:09:42.124 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.088+0000 7fb6e84b7700 1 -- 172.21.15.32:0/945950615 shutdown_connections 2023-10-08T06:09:42.124 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.088+0000 7fb6e84b7700 1 --2- 172.21.15.32:0/945950615 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb6cc003ca0 0x7fb6cc004080 secure :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fb6d0007f80 tx=0x7fb6cc0037a0 comp rx=0 tx=0).stop 2023-10-08T06:09:42.124 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.088+0000 7fb6e84b7700 1 -- 172.21.15.32:0/945950615 >> 172.21.15.32:0/945950615 conn(0x7fb6e00cb850 msgr2=0x7fb6e00cbc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:09:42.125 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.088+0000 7f8fed34a700 1 --2- 172.21.15.32:0/1372088893 >> v2:172.21.15.32:3300/0 conn(0x7f8fe8165740 0x7f8fe80cbd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:42.125 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.088+0000 7f1b0ad9d700 1 --2- 172.21.15.32:0/1192728913 >> v2:172.21.15.40:3300/0 conn(0x7f1b0c0ce430 0x7f1b0c161150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:42.125 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.088+0000 7fa5430a9700 1 -- 172.21.15.32:0/2403466009 wait complete. 2023-10-08T06:09:42.125 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.088+0000 7f8fe7fff700 1 -- 172.21.15.32:0/1372088893 >> v2:172.21.15.32:3300/0 conn(0x7f8fe8165740 msgr2=0x7f8fe80cbd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:09:42.126 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.088+0000 7f191423b700 1 Processor -- start 2023-10-08T06:09:42.126 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.088+0000 7f8fe7fff700 1 --2- 172.21.15.32:0/1372088893 >> v2:172.21.15.32:3300/0 conn(0x7f8fe8165740 0x7f8fe80cbd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:42.126 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.088+0000 7f8fe7fff700 1 -- 172.21.15.32:0/1372088893 >> v1:172.21.15.40:6789/0 conn(0x7f8fe80c21a0 legacy=0x7f8fe806c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:42.126 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.092+0000 7f8fe7fff700 1 -- 172.21.15.32:0/1372088893 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fe8165fe0 con 0x7f8fe81652b0 2023-10-08T06:09:42.127 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.088+0000 7fb6e84b7700 1 -- 172.21.15.32:0/945950615 shutdown_connections 2023-10-08T06:09:42.127 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.092+0000 7f1b0a59c700 1 -- 172.21.15.32:0/1192728913 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1b0c0703c0 msgr2=0x7f1b0c0cdef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:09:42.127 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.092+0000 7f1b0a59c700 1 --2- 172.21.15.32:0/1192728913 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1b0c0703c0 0x7f1b0c0cdef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:42.127 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.092+0000 7f1b0a59c700 1 -- 172.21.15.32:0/1192728913 >> v2:172.21.15.40:3300/0 conn(0x7f1b0c0ce430 msgr2=0x7f1b0c161150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:09:42.127 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.092+0000 7f1b0a59c700 1 --2- 172.21.15.32:0/1192728913 >> v2:172.21.15.40:3300/0 conn(0x7f1b0c0ce430 0x7f1b0c161150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:42.127 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.092+0000 7f1b0a59c700 1 -- 172.21.15.32:0/1192728913 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b0c06e260 con 0x7f1b0c15d600 2023-10-08T06:09:42.128 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.092+0000 7f3c9cef1700 1 -- 172.21.15.32:0/2653903517 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3c981599e0 msgr2=0x7f3c980c4720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:42.128 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.092+0000 7f3c9cef1700 1 --2- 172.21.15.32:0/2653903517 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3c981599e0 0x7f3c980c4720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:42.128 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.092+0000 7f3c9cef1700 1 -- 172.21.15.32:0/2653903517 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3c980cc370 msgr2=0x7f3c9814d1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:42.128 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.092+0000 7f3c9cef1700 1 --2- 172.21.15.32:0/2653903517 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3c980cc370 0x7f3c9814d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:42.128 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.092+0000 7f3c9cef1700 1 -- 172.21.15.32:0/2653903517 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c8c009570 con 0x7f3c98070380 2023-10-08T06:09:42.128 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.092+0000 7f5b774dd700 1 Processor -- start 2023-10-08T06:09:42.129 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.092+0000 7fb6e84b7700 1 -- 172.21.15.32:0/945950615 wait complete. 2023-10-08T06:09:42.129 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.092+0000 7f1b0a59c700 1 --2- 172.21.15.32:0/1192728913 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1b0c15d600 0x7f1b0c0cd9b0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f1b0c1621f0 tx=0x7f1b0400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ced6a458a0282fbc server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:42.129 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.092+0000 7f5b774dd700 1 -- start start 2023-10-08T06:09:42.129 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.092+0000 7f1b0959a700 1 -- 172.21.15.32:0/1192728913 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b0400e070 con 0x7f1b0c15d600 2023-10-08T06:09:42.130 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.092+0000 7f1b0959a700 1 -- 172.21.15.32:0/1192728913 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b0400b910 con 0x7f1b0c15d600 2023-10-08T06:09:42.130 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.092+0000 7faebccbe700 1 Processor -- start 2023-10-08T06:09:42.130 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.092+0000 7f1b0959a700 1 -- 172.21.15.32:0/1192728913 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b0400bcc0 con 0x7f1b0c15d600 2023-10-08T06:09:42.130 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.092+0000 7faebccbe700 1 -- start start 2023-10-08T06:09:42.131 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.092+0000 7f1b10b0e700 1 -- 172.21.15.32:0/1192728913 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1b0c15d600 msgr2=0x7f1b0c0cd9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:42.131 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.092+0000 7f1b10b0e700 1 --2- 172.21.15.32:0/1192728913 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1b0c15d600 0x7f1b0c0cd9b0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f1b0c1621f0 tx=0x7f1b0400b330 comp rx=0 tx=0).stop 2023-10-08T06:09:42.131 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.092+0000 7fa5430a9700 1 Processor -- start 2023-10-08T06:09:42.131 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.092+0000 7fa5430a9700 1 -- start start 2023-10-08T06:09:42.132 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.092+0000 7f5b774dd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5b700c21a0 0x7f5b701561b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:42.132 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.092+0000 7fb6e84b7700 1 Processor -- start 2023-10-08T06:09:42.132 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.092+0000 7f5b774dd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5b701652b0 0x7f5b700b3920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:42.133 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.092+0000 7f5b774dd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5b70165740 0x7f5b70070cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:42.133 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.092+0000 7fb6e84b7700 1 -- start start 2023-10-08T06:09:42.133 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.092+0000 7faebccbe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faeb80b8b20 0x7faeb815fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:42.133 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.092+0000 7faebccbe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faeb80ce430 0x7faeb80c8c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:42.133 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.092+0000 7faebccbe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faeb815d4b0 0x7faeb80c91d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:42.133 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.092+0000 7faebccbe700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faeb80b4b40 con 0x7faeb80ce430 2023-10-08T06:09:42.133 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.092+0000 7faebccbe700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faeb80b4e20 con 0x7faeb80b8b20 2023-10-08T06:09:42.134 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.092+0000 7faebccbe700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faeb80c6d90 con 0x7faeb815d4b0 2023-10-08T06:09:42.134 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.092+0000 7f5b74a78700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5b701652b0 0x7f5b700b3920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:42.134 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.092+0000 7f5b74a78700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5b701652b0 0x7f5b700b3920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:59302/0 (socket says 172.21.15.32:59302) 2023-10-08T06:09:42.134 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.092+0000 7f5b74a78700 1 -- 172.21.15.32:0/1786959074 learned_addr learned my addr 172.21.15.32:0/1786959074 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:09:42.134 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.092+0000 7f5b774dd700 1 -- 172.21.15.32:0/1786959074 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b700c6180 con 0x7f5b701652b0 2023-10-08T06:09:42.134 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.092+0000 7f5b774dd700 1 -- 172.21.15.32:0/1786959074 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b700b4370 con 0x7f5b70165740 2023-10-08T06:09:42.134 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.092+0000 7f5b774dd700 1 -- 172.21.15.32:0/1786959074 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b700b4650 con 0x7f5b700c21a0 2023-10-08T06:09:42.135 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.092+0000 7f1b10b0e700 1 -- 172.21.15.32:0/1192728913 shutdown_connections 2023-10-08T06:09:42.135 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.092+0000 7f1b10b0e700 1 --2- 172.21.15.32:0/1192728913 >> v2:172.21.15.40:3300/0 conn(0x7f1b0c0ce430 0x7f1b0c161150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:42.135 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.092+0000 7f1b10b0e700 1 --2- 172.21.15.32:0/1192728913 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1b0c0703c0 0x7f1b0c0cdef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:42.135 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.092+0000 7f1b10b0e700 1 --2- 172.21.15.32:0/1192728913 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1b0c15d600 0x7f1b0c0cd9b0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:42.135 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.092+0000 7f1b10b0e700 1 -- 172.21.15.32:0/1192728913 >> 172.21.15.32:0/1192728913 conn(0x7f1b0c0cb850 msgr2=0x7f1b0c0cbc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:09:42.135 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.092+0000 7faeb6d9d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faeb815d4b0 0x7faeb80c91d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:42.135 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.092+0000 7faeb6d9d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faeb815d4b0 0x7faeb80c91d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.32:54656/0 (socket says 172.21.15.32:54656) 2023-10-08T06:09:42.135 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.092+0000 7faeb6d9d700 1 -- 172.21.15.32:0/2817828772 learned_addr learned my addr 172.21.15.32:0/2817828772 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:09:42.136 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.092+0000 7f5b75279700 1 --2- 172.21.15.32:0/1786959074 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5b700c21a0 0x7f5b701561b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:42.136 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.092+0000 7faeb5d9b700 1 --2- 172.21.15.32:0/2817828772 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faeb80ce430 0x7faeb80c8c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:42.136 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.092+0000 7f5b75a7a700 1 --2- 172.21.15.32:0/1786959074 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5b70165740 0x7f5b70070cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:42.137 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.092+0000 7f5b74a78700 1 -- 172.21.15.32:0/1786959074 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5b700c21a0 msgr2=0x7f5b701561b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:42.137 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.092+0000 7f5b74a78700 1 --2- 172.21.15.32:0/1786959074 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5b700c21a0 0x7f5b701561b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:42.137 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.092+0000 7f5b74a78700 1 -- 172.21.15.32:0/1786959074 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5b70165740 msgr2=0x7f5b70070cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:42.137 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.092+0000 7f5b74a78700 1 --2- 172.21.15.32:0/1786959074 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5b70165740 0x7f5b70070cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:42.137 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.092+0000 7f5b74a78700 1 -- 172.21.15.32:0/1786959074 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b68009a70 con 0x7f5b701652b0 2023-10-08T06:09:42.137 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.092+0000 7faeb659c700 1 --2- 172.21.15.32:0/2817828772 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faeb80b8b20 0x7faeb815fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:42.138 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.092+0000 7f1b10b0e700 1 -- 172.21.15.32:0/1192728913 shutdown_connections 2023-10-08T06:09:42.138 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.092+0000 7f1b10b0e700 1 -- 172.21.15.32:0/1192728913 wait complete. 2023-10-08T06:09:42.138 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.092+0000 7f5b74a78700 1 --2- 172.21.15.32:0/1786959074 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5b701652b0 0x7f5b700b3920 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f5b7006c340 tx=0x7f5b60004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:42.138 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.092+0000 7fa5430a9700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa53c0c21a0 0x7fa53c15d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:42.138 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.092+0000 7fa5430a9700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa53c1652b0 0x7fa53c06fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:42.138 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.092+0000 7fa5420a7700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa53c0c21a0 0x7fa53c15d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:42.139 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.092+0000 7fa5420a7700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa53c0c21a0 0x7fa53c15d570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:59326/0 (socket says 172.21.15.32:59326) 2023-10-08T06:09:42.139 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.092+0000 7fa5430a9700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa53c165740 0x7fa53c070060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:42.139 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.092+0000 7fa5430a9700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa53c0c44d0 con 0x7fa53c0c21a0 2023-10-08T06:09:42.139 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.092+0000 7fa5430a9700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa53c15dab0 con 0x7fa53c165740 2023-10-08T06:09:42.139 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.092+0000 7fa5430a9700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa53c0c3620 con 0x7fa53c1652b0 2023-10-08T06:09:42.139 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.092+0000 7fa5418a6700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa53c1652b0 0x7fa53c06fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:42.139 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.092+0000 7fa5418a6700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa53c1652b0 0x7fa53c06fb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.32:54678/0 (socket says 172.21.15.32:54678) 2023-10-08T06:09:42.139 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.092+0000 7fa5418a6700 1 -- 172.21.15.32:0/3969493961 learned_addr learned my addr 172.21.15.32:0/3969493961 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:09:42.139 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.092+0000 7fa5428a8700 1 --2- 172.21.15.32:0/3969493961 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa53c165740 0x7fa53c070060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:42.140 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.092+0000 7f5b65ffb700 1 -- 172.21.15.32:0/1786959074 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b600044d0 con 0x7f5b701652b0 2023-10-08T06:09:42.140 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.092+0000 7f5b65ffb700 1 -- 172.21.15.32:0/1786959074 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b6001f070 con 0x7f5b701652b0 2023-10-08T06:09:42.140 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.092+0000 7f5b774dd700 1 -- 172.21.15.32:0/1786959074 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b60009570 con 0x7f5b701652b0 2023-10-08T06:09:42.140 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.092+0000 7f5b65ffb700 1 -- 172.21.15.32:0/1786959074 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b60003900 con 0x7f5b701652b0 2023-10-08T06:09:42.140 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.092+0000 7f5b774dd700 1 -- 172.21.15.32:0/1786959074 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b701566f0 con 0x7f5b701652b0 2023-10-08T06:09:42.140 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.092+0000 7f8fe7fff700 1 --2- 172.21.15.32:0/1372088893 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8fe81652b0 0x7f8fe80cb7e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f8fe80ced80 tx=0x7f8fd0009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ff1bd17b7a409803 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:42.140 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.092+0000 7f8fe77fe700 1 -- 172.21.15.32:0/1372088893 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fd0011830 con 0x7f8fe81652b0 2023-10-08T06:09:42.140 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.092+0000 7f8fe77fe700 1 -- 172.21.15.32:0/1372088893 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fd0011990 con 0x7f8fe81652b0 2023-10-08T06:09:42.140 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.092+0000 7f8fe77fe700 1 -- 172.21.15.32:0/1372088893 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fd0011d20 con 0x7f8fe81652b0 2023-10-08T06:09:42.140 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.092+0000 7f8feedad700 1 -- 172.21.15.32:0/1372088893 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8fe81652b0 msgr2=0x7f8fe80cb7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:42.141 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.092+0000 7f8feedad700 1 --2- 172.21.15.32:0/1372088893 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8fe81652b0 0x7f8fe80cb7e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f8fe80ced80 tx=0x7f8fd0009b30 comp rx=0 tx=0).stop 2023-10-08T06:09:42.141 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.092+0000 7f8feedad700 1 -- 172.21.15.32:0/1372088893 shutdown_connections 2023-10-08T06:09:42.141 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.092+0000 7f8feedad700 1 --2- 172.21.15.32:0/1372088893 >> v2:172.21.15.32:3300/0 conn(0x7f8fe8165740 0x7f8fe80cbd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:42.141 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.092+0000 7f8feedad700 1 --2- 172.21.15.32:0/1372088893 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8fe81652b0 0x7f8fe80cb7e0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:42.141 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.092+0000 7f8feedad700 1 -- 172.21.15.32:0/1372088893 >> 172.21.15.32:0/1372088893 conn(0x7f8fe80b0900 msgr2=0x7f8fe80b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:09:42.141 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.092+0000 7f8feedad700 1 -- 172.21.15.32:0/1372088893 shutdown_connections 2023-10-08T06:09:42.141 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.092+0000 7f3c9cef1700 1 --2- 172.21.15.32:0/2653903517 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3c98070380 0x7f3c980b1c80 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f3c8800c7a0 tx=0x7f3c8800cab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:42.141 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.092+0000 7fb6e84b7700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb6e014e360 0x7fb6e015c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:42.142 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.092+0000 7fb6e84b7700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb6e0150070 0x7fb6e0150f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:42.142 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.092+0000 7fb6e84b7700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb6e015ac40 0x7fb6e0151450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:42.142 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.092+0000 7fb6e84b7700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6e015be10 con 0x7fb6e015ac40 2023-10-08T06:09:42.142 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.092+0000 7fb6e84b7700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6e015b200 con 0x7fb6e014e360 2023-10-08T06:09:42.142 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.092+0000 7fb6e84b7700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6e015b4e0 con 0x7fb6e0150070 2023-10-08T06:09:42.142 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.092+0000 7fb6e6a54700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb6e015ac40 0x7fb6e0151450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:42.142 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.092+0000 7fb6e6253700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb6e014e360 0x7fb6e015c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:42.142 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.092+0000 7fb6e5a52700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb6e0150070 0x7fb6e0150f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:42.142 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.092+0000 7fb6e6a54700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb6e015ac40 0x7fb6e0151450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:59332/0 (socket says 172.21.15.32:59332) 2023-10-08T06:09:42.142 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.092+0000 7fb6e6a54700 1 -- 172.21.15.32:0/3161223739 learned_addr learned my addr 172.21.15.32:0/3161223739 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:09:42.143 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.092+0000 7fb6e6a54700 1 -- 172.21.15.32:0/3161223739 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb6e0150070 msgr2=0x7fb6e0150f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:42.143 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.092+0000 7fb6e6a54700 1 --2- 172.21.15.32:0/3161223739 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb6e0150070 0x7fb6e0150f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:42.143 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.092+0000 7fb6e6a54700 1 -- 172.21.15.32:0/3161223739 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb6e014e360 msgr2=0x7fb6e015c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:42.143 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.092+0000 7fb6e6a54700 1 --2- 172.21.15.32:0/3161223739 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb6e014e360 0x7fb6e015c2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:42.143 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.092+0000 7fb6e6a54700 1 -- 172.21.15.32:0/3161223739 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6e015b7c0 con 0x7fb6e015ac40 2023-10-08T06:09:42.143 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.092+0000 7f191423b700 1 -- start start 2023-10-08T06:09:42.143 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.096+0000 7f191423b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f19040340d0 0x7f19040eb340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:42.143 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.096+0000 7f191423b700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f1904048330 0x7f19040eb880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:42.143 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.096+0000 7f191423b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1904047de0 0x7f1904005fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:42.143 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.096+0000 7f191423b700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f190404fca0 con 0x7f1904048330 2023-10-08T06:09:42.144 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.096+0000 7f191423b700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19040503d0 con 0x7f19040340d0 2023-10-08T06:09:42.144 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.096+0000 7f191423b700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f190404ff40 con 0x7f1904047de0 2023-10-08T06:09:42.144 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.096+0000 7f1b10b0e700 1 Processor -- start 2023-10-08T06:09:42.144 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.096+0000 7f19127d8700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1904047de0 0x7f1904005fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:42.145 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.096+0000 7f1911fd7700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f19040340d0 0x7f19040eb340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:42.145 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.096+0000 7f19127d8700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1904047de0 0x7f1904005fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.32:54688/0 (socket says 172.21.15.32:54688) 2023-10-08T06:09:42.145 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.096+0000 7f19127d8700 1 -- 172.21.15.32:0/463971715 learned_addr learned my addr 172.21.15.32:0/463971715 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:09:42.145 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.096+0000 7f19127d8700 1 -- 172.21.15.32:0/463971715 >> v2:172.21.15.40:3300/0 conn(0x7f19040340d0 msgr2=0x7f19040eb340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:09:42.145 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.096+0000 7f19127d8700 1 --2- 172.21.15.32:0/463971715 >> v2:172.21.15.40:3300/0 conn(0x7f19040340d0 0x7f19040eb340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:42.145 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.096+0000 7f19127d8700 1 -- 172.21.15.32:0/463971715 >> v2:172.21.15.32:3300/0 conn(0x7f1904048330 msgr2=0x7f19040eb880 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-08T06:09:42.145 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.096+0000 7f19127d8700 1 --2- 172.21.15.32:0/463971715 >> v2:172.21.15.32:3300/0 conn(0x7f1904048330 0x7f19040eb880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:42.145 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.096+0000 7f19127d8700 1 -- 172.21.15.32:0/463971715 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19040ec1e0 con 0x7f1904047de0 2023-10-08T06:09:42.145 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.096+0000 7f5b65ffb700 1 -- 172.21.15.32:0/1786959074 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f5b60003a60 con 0x7f5b701652b0 2023-10-08T06:09:42.146 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.096+0000 7f3c957fa700 1 -- 172.21.15.32:0/2653903517 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c88011800 con 0x7f3c98070380 2023-10-08T06:09:42.146 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.096+0000 7f3c957fa700 1 -- 172.21.15.32:0/2653903517 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c88011960 con 0x7f3c98070380 2023-10-08T06:09:42.146 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.096+0000 7f3c957fa700 1 -- 172.21.15.32:0/2653903517 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c88011d10 con 0x7f3c98070380 2023-10-08T06:09:42.146 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.096+0000 7fb6e5a52700 1 --2- 172.21.15.32:0/3161223739 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb6e0150070 0x7fb6e0150f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T06:09:42.146 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.096+0000 7fb6e6253700 1 --2- 172.21.15.32:0/3161223739 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb6e014e360 0x7fb6e015c2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T06:09:42.147 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.096+0000 7f8feedad700 1 -- 172.21.15.32:0/1372088893 wait complete. 2023-10-08T06:09:42.147 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.092+0000 7faeb5d9b700 1 -- 172.21.15.32:0/2817828772 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faeb815d4b0 msgr2=0x7faeb80c91d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:42.147 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.092+0000 7faeb5d9b700 1 --2- 172.21.15.32:0/2817828772 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faeb815d4b0 0x7faeb80c91d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:42.147 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.092+0000 7faeb5d9b700 1 -- 172.21.15.32:0/2817828772 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faeb80b8b20 msgr2=0x7faeb815fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:42.147 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.092+0000 7faeb5d9b700 1 --2- 172.21.15.32:0/2817828772 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faeb80b8b20 0x7faeb815fca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:42.147 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.092+0000 7faeb5d9b700 1 -- 172.21.15.32:0/2817828772 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faeb0009b30 con 0x7faeb80ce430 2023-10-08T06:09:42.147 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.092+0000 7faeb5d9b700 1 --2- 172.21.15.32:0/2817828772 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faeb80ce430 0x7faeb80c8c90 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7faeb0015000 tx=0x7faeb0004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:42.148 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.092+0000 7faea6ffd700 1 -- 172.21.15.32:0/2817828772 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeb00092e0 con 0x7faeb80ce430 2023-10-08T06:09:42.148 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.092+0000 7faea6ffd700 1 -- 172.21.15.32:0/2817828772 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faeb00094d0 con 0x7faeb80ce430 2023-10-08T06:09:42.148 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.092+0000 7faebccbe700 1 -- 172.21.15.32:0/2817828772 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faeb80c7070 con 0x7faeb80ce430 2023-10-08T06:09:42.148 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.092+0000 7faebccbe700 1 -- 172.21.15.32:0/2817828772 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faeb81601e0 con 0x7faeb80ce430 2023-10-08T06:09:42.148 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.096+0000 7faebccbe700 1 -- 172.21.15.32:0/2817828772 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faeb80c6bf0 con 0x7faeb80ce430 2023-10-08T06:09:42.148 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.096+0000 7f5b65ffb700 1 --2- 172.21.15.32:0/1786959074 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f5b54066510 0x7f5b540689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:42.148 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.096+0000 7f8feedad700 1 Processor -- start 2023-10-08T06:09:42.149 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.096+0000 7fa5420a7700 1 -- 172.21.15.32:0/3969493961 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa53c1652b0 msgr2=0x7fa53c06fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:42.149 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.096+0000 7fa5420a7700 1 --2- 172.21.15.32:0/3969493961 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa53c1652b0 0x7fa53c06fb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:42.149 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.096+0000 7fa5420a7700 1 -- 172.21.15.32:0/3969493961 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa53c165740 msgr2=0x7fa53c070060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:42.149 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.096+0000 7fa5420a7700 1 --2- 172.21.15.32:0/3969493961 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa53c165740 0x7fa53c070060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:42.149 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.096+0000 7fa5420a7700 1 -- 172.21.15.32:0/3969493961 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa52c0094b0 con 0x7fa53c0c21a0 2023-10-08T06:09:42.149 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.096+0000 7f19127d8700 1 --2- 172.21.15.32:0/463971715 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1904047de0 0x7f1904005fa0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f190c069b60 tx=0x7f190c074710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=af43337d8cc8dbbe server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:42.150 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.096+0000 7f1910fd5700 1 -- 172.21.15.32:0/463971715 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f190c04ef60 con 0x7f1904047de0 2023-10-08T06:09:42.150 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.096+0000 7f1910fd5700 1 -- 172.21.15.32:0/463971715 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f190c08e070 con 0x7f1904047de0 2023-10-08T06:09:42.150 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.096+0000 7f1910fd5700 1 -- 172.21.15.32:0/463971715 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f190c068490 con 0x7f1904047de0 2023-10-08T06:09:42.150 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.096+0000 7faea6ffd700 1 -- 172.21.15.32:0/2817828772 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeb001c6a0 con 0x7faeb80ce430 2023-10-08T06:09:42.150 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.096+0000 7f1b10b0e700 1 -- start start 2023-10-08T06:09:42.150 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.096+0000 7f1b10b0e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1b0c0703c0 0x7f1b0c1458f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:42.150 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.096+0000 7f1b10b0e700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1b0c0ce430 0x7f1b0c160ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:42.151 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.096+0000 7f1b10b0e700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1b0c15d600 0x7f1b0c0bc5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:42.151 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.096+0000 7f1b10b0e700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b0c160760 con 0x7f1b0c15d600 2023-10-08T06:09:42.151 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.096+0000 7f1b10b0e700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b0c146750 con 0x7f1b0c0ce430 2023-10-08T06:09:42.151 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.096+0000 7f1b10b0e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b0c146a30 con 0x7f1b0c0703c0 2023-10-08T06:09:42.151 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.096+0000 7fa5420a7700 1 --2- 172.21.15.32:0/3969493961 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa53c0c21a0 0x7fa53c15d570 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fa53800e810 tx=0x7fa53800eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:42.151 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.096+0000 7f5b65ffb700 1 -- 172.21.15.32:0/1786959074 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5b60021070 con 0x7f5b701652b0 2023-10-08T06:09:42.152 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.096+0000 7f5b774dd700 1 -- 172.21.15.32:0/1786959074 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b700b4b70 con 0x7f5b701652b0 2023-10-08T06:09:42.152 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.096+0000 7f8feedad700 1 -- start start 2023-10-08T06:09:42.152 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.096+0000 7f191423b700 1 -- 172.21.15.32:0/463971715 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1904047de0 msgr2=0x7f1904005fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:42.152 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.096+0000 7f191423b700 1 --2- 172.21.15.32:0/463971715 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1904047de0 0x7f1904005fa0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f190c069b60 tx=0x7f190c074710 comp rx=0 tx=0).stop 2023-10-08T06:09:42.152 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.096+0000 7f191423b700 1 -- 172.21.15.32:0/463971715 shutdown_connections 2023-10-08T06:09:42.153 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.096+0000 7f191423b700 1 --2- 172.21.15.32:0/463971715 >> v2:172.21.15.32:3300/0 conn(0x7f1904048330 0x7f19040eb880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:42.153 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.096+0000 7f191423b700 1 --2- 172.21.15.32:0/463971715 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1904047de0 0x7f1904005fa0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:42.153 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.096+0000 7f191423b700 1 --2- 172.21.15.32:0/463971715 >> v2:172.21.15.40:3300/0 conn(0x7f19040340d0 0x7f19040eb340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:42.153 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.096+0000 7f191423b700 1 -- 172.21.15.32:0/463971715 >> 172.21.15.32:0/463971715 conn(0x7f1904054c90 msgr2=0x7f19040550a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:09:42.153 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.096+0000 7f1b09d9b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1b0c0ce430 0x7f1b0c160ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:42.153 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.096+0000 7f1b09d9b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1b0c0ce430 0x7f1b0c160ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.32:38224/0 (socket says 172.21.15.32:38224) 2023-10-08T06:09:42.153 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.096+0000 7f1b09d9b700 1 -- 172.21.15.32:0/43426948 learned_addr learned my addr 172.21.15.32:0/43426948 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:09:42.154 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.096+0000 7f191423b700 1 -- 172.21.15.32:0/463971715 shutdown_connections 2023-10-08T06:09:42.154 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.096+0000 7f1b09d9b700 1 -- 172.21.15.32:0/43426948 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1b0c0703c0 msgr2=0x7f1b0c1458f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T06:09:42.154 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.096+0000 7f1b09d9b700 1 --2- 172.21.15.32:0/43426948 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1b0c0703c0 0x7f1b0c1458f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:42.154 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.096+0000 7f1b09d9b700 1 -- 172.21.15.32:0/43426948 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1b0c15d600 msgr2=0x7f1b0c0bc5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:42.154 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.096+0000 7f1b09d9b700 1 --2- 172.21.15.32:0/43426948 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1b0c15d600 0x7f1b0c0bc5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:42.154 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.096+0000 7f1b09d9b700 1 -- 172.21.15.32:0/43426948 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b04009b30 con 0x7f1b0c0ce430 2023-10-08T06:09:42.155 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.096+0000 7f8feedad700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8fe80c21a0 0x7f8fe80b2080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:42.155 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.096+0000 7f8feedad700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8fe81652b0 0x7f8fe80b25c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:42.155 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.096+0000 7f8feedad700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8fe8165740 0x7f8fe80c7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:42.155 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.096+0000 7f8feedad700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fe80c5610 con 0x7f8fe8165740 2023-10-08T06:09:42.155 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.096+0000 7f8feedad700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fe80b1630 con 0x7f8fe80c21a0 2023-10-08T06:09:42.155 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.096+0000 7f8feedad700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fe80b40b0 con 0x7f8fe81652b0 2023-10-08T06:09:42.156 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.096+0000 7f1b09d9b700 1 --2- 172.21.15.32:0/43426948 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1b0c0ce430 0x7f1b0c160ef0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f1b0000e790 tx=0x7f1b0000eb50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:42.156 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.096+0000 7f8fe7fff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8fe81652b0 0x7f8fe80b25c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:42.156 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.096+0000 7f8fe7fff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8fe81652b0 0x7f8fe80b25c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.32:54692/0 (socket says 172.21.15.32:54692) 2023-10-08T06:09:42.156 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.096+0000 7f8fe7fff700 1 -- 172.21.15.32:0/3739653030 learned_addr learned my addr 172.21.15.32:0/3739653030 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:09:42.157 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.100+0000 7f191423b700 1 -- 172.21.15.32:0/463971715 wait complete. 2023-10-08T06:09:42.157 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.100+0000 7f1afaffd700 1 -- 172.21.15.32:0/43426948 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b00013680 con 0x7f1b0c0ce430 2023-10-08T06:09:42.157 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.096+0000 7f3c9f155700 1 -- 172.21.15.32:0/2653903517 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c980b4310 con 0x7f3c98070380 2023-10-08T06:09:42.157 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.096+0000 7f3c9f155700 1 -- 172.21.15.32:0/2653903517 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c980c2460 con 0x7f3c98070380 2023-10-08T06:09:42.157 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.096+0000 7f3c9f155700 1 -- 172.21.15.32:0/2653903517 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c980c3dc0 con 0x7f3c98070380 2023-10-08T06:09:42.158 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.100+0000 7f1afaffd700 1 -- 172.21.15.32:0/43426948 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b000137e0 con 0x7f1b0c0ce430 2023-10-08T06:09:42.158 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.100+0000 7f1afaffd700 1 -- 172.21.15.32:0/43426948 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b00013b70 con 0x7f1b0c0ce430 2023-10-08T06:09:42.158 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.100+0000 7f1b10b0e700 1 -- 172.21.15.32:0/43426948 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b0c1609d0 con 0x7f1b0c0ce430 2023-10-08T06:09:42.158 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.100+0000 7f1b10b0e700 1 -- 172.21.15.32:0/43426948 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b0c146d10 con 0x7f1b0c0ce430 2023-10-08T06:09:42.158 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.100+0000 7f5b75279700 1 --2- 172.21.15.32:0/1786959074 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f5b54066510 0x7f5b540689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:42.159 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.100+0000 7fb6e6a54700 1 --2- 172.21.15.32:0/3161223739 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb6e015ac40 0x7fb6e0151450 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fb6e006b790 tx=0x7fb6d800f490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:42.159 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.100+0000 7f3c957fa700 1 -- 172.21.15.32:0/2653903517 <== mon.2 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f3c8801a450 con 0x7f3c98070380 2023-10-08T06:09:42.159 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.100+0000 7f8fecb49700 1 --2- 172.21.15.32:0/3739653030 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8fe80c21a0 0x7f8fe80b2080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:42.159 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.100+0000 7f8fed34a700 1 --2- 172.21.15.32:0/3739653030 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8fe8165740 0x7f8fe80c7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:42.160 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.100+0000 7f8fe7fff700 1 -- 172.21.15.32:0/3739653030 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8fe80c21a0 msgr2=0x7f8fe80b2080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:42.160 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.100+0000 7f8fe7fff700 1 --2- 172.21.15.32:0/3739653030 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8fe80c21a0 0x7f8fe80b2080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:42.160 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.100+0000 7f8fe7fff700 1 -- 172.21.15.32:0/3739653030 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8fe8165740 msgr2=0x7f8fe80c7230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:42.160 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.100+0000 7f8fe7fff700 1 --2- 172.21.15.32:0/3739653030 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8fe8165740 0x7f8fe80c7230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:42.160 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.100+0000 7f8fe7fff700 1 -- 172.21.15.32:0/3739653030 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fd00094b0 con 0x7f8fe81652b0 2023-10-08T06:09:42.160 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.100+0000 7f8fed34a700 1 --2- 172.21.15.32:0/3739653030 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8fe8165740 0x7f8fe80c7230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T06:09:42.160 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.100+0000 7f3c957fa700 1 --2- 172.21.15.32:0/2653903517 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f3c84066540 0x7f3c84068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:42.160 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.100+0000 7f3c957fa700 1 -- 172.21.15.32:0/2653903517 <== mon.2 v2:172.21.15.40:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3c88083ff0 con 0x7f3c98070380 2023-10-08T06:09:42.161 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.100+0000 7f8fe7fff700 1 --2- 172.21.15.32:0/3739653030 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8fe81652b0 0x7f8fe80b25c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f8fd0009b70 tx=0x7f8fd0004770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:42.161 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.100+0000 7f3c97fff700 1 --2- 172.21.15.32:0/2653903517 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f3c84066540 0x7f3c84068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:42.161 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.100+0000 7f5b75279700 1 --2- 172.21.15.32:0/1786959074 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f5b54066510 0x7f5b540689d0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f5b700c5380 tx=0x7f5b6800d040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:42.162 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.100+0000 7f3c97fff700 1 --2- 172.21.15.32:0/2653903517 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f3c84066540 0x7f3c84068a00 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f3c9814aa80 tx=0x7f3c90009230 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:42.162 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.100+0000 7f191423b700 1 Processor -- start 2023-10-08T06:09:42.162 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.100+0000 7faea6ffd700 1 -- 172.21.15.32:0/2817828772 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7faeb001c800 con 0x7faeb80ce430 2023-10-08T06:09:42.162 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.100+0000 7f191423b700 1 -- start start 2023-10-08T06:09:42.163 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.100+0000 7f1af8ff9700 1 -- 172.21.15.32:0/43426948 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b0c1464c0 con 0x7f1b0c0ce430 2023-10-08T06:09:42.163 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.100+0000 7faea6ffd700 1 --2- 172.21.15.32:0/2817828772 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fae980665e0 0x7fae98068aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:42.163 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.100+0000 7faeb659c700 1 --2- 172.21.15.32:0/2817828772 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fae980665e0 0x7fae98068aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:42.163 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.100+0000 7faea6ffd700 1 -- 172.21.15.32:0/2817828772 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7faeb0085a50 con 0x7faeb80ce430 2023-10-08T06:09:42.164 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.100+0000 7f1afaffd700 1 -- 172.21.15.32:0/43426948 <== mon.1 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f1b00013cd0 con 0x7f1b0c0ce430 2023-10-08T06:09:42.164 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.100+0000 7faeb659c700 1 --2- 172.21.15.32:0/2817828772 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fae980665e0 0x7fae98068aa0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7faea8000f60 tx=0x7faea8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:42.164 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.100+0000 7f191423b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f19040340d0 0x7f190404d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:42.164 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.100+0000 7f191423b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1904047de0 0x7f1904049c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:42.165 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.100+0000 7f191423b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1904048330 0x7f19040dc230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:42.165 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.100+0000 7f191423b700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f190404e500 con 0x7f1904048330 2023-10-08T06:09:42.165 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.100+0000 7f191423b700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19040dc770 con 0x7f19040340d0 2023-10-08T06:09:42.165 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.100+0000 7f191423b700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f190404d8f0 con 0x7f1904047de0 2023-10-08T06:09:42.165 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.100+0000 7f1afaffd700 1 --2- 172.21.15.32:0/43426948 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f1aec066560 0x7f1aec068a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:42.165 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.100+0000 7f19117d6700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1904047de0 0x7f1904049c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:42.165 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.100+0000 7f19127d8700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1904048330 0x7f19040dc230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:42.166 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.100+0000 7f1afaffd700 1 -- 172.21.15.32:0/43426948 <== mon.1 v2:172.21.15.40:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1b00083bc0 con 0x7f1b0c0ce430 2023-10-08T06:09:42.166 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.100+0000 7f1b0a59c700 1 --2- 172.21.15.32:0/43426948 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f1aec066560 0x7f1aec068a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:42.166 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.100+0000 7f19117d6700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1904047de0 0x7f1904049c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.32:54696/0 (socket says 172.21.15.32:54696) 2023-10-08T06:09:42.166 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.100+0000 7f19117d6700 1 -- 172.21.15.32:0/3486402389 learned_addr learned my addr 172.21.15.32:0/3486402389 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:09:42.166 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.100+0000 7f1911fd7700 1 --2- 172.21.15.32:0/3486402389 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f19040340d0 0x7f190404d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:42.167 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.100+0000 7f1b0a59c700 1 --2- 172.21.15.32:0/43426948 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f1aec066560 0x7f1aec068a20 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f1b04009fd0 tx=0x7f1b04009000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:42.167 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.100+0000 7f19117d6700 1 -- 172.21.15.32:0/3486402389 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f19040340d0 msgr2=0x7f190404d1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:42.167 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.100+0000 7f19117d6700 1 --2- 172.21.15.32:0/3486402389 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f19040340d0 0x7f190404d1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:42.167 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.100+0000 7f19117d6700 1 -- 172.21.15.32:0/3486402389 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1904048330 msgr2=0x7f19040dc230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:42.167 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.100+0000 7f19117d6700 1 --2- 172.21.15.32:0/3486402389 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1904048330 0x7f19040dc230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:42.168 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.100+0000 7f19117d6700 1 -- 172.21.15.32:0/3486402389 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f190c066ea0 con 0x7f1904047de0 2023-10-08T06:09:42.168 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.100+0000 7f19127d8700 1 --2- 172.21.15.32:0/3486402389 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1904048330 0x7f19040dc230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T06:09:42.168 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.100+0000 7f19117d6700 1 --2- 172.21.15.32:0/3486402389 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1904047de0 0x7f1904049c30 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f190800b550 tx=0x7f190800b860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:42.168 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.104+0000 7fa532ffd700 1 -- 172.21.15.32:0/3969493961 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa53800c070 con 0x7fa53c0c21a0 2023-10-08T06:09:42.168 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.104+0000 7fa5430a9700 1 -- 172.21.15.32:0/3969493961 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa53c0c38c0 con 0x7fa53c0c21a0 2023-10-08T06:09:42.168 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.104+0000 7fb6d6ffd700 1 -- 172.21.15.32:0/3161223739 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6d800e040 con 0x7fb6e015ac40 2023-10-08T06:09:42.169 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.104+0000 7fa5430a9700 1 -- 172.21.15.32:0/3969493961 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa53c0c3e80 con 0x7fa53c0c21a0 2023-10-08T06:09:42.169 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.104+0000 7faea6ffd700 1 -- 172.21.15.32:0/2817828772 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7faeb0052f40 con 0x7faeb80ce430 2023-10-08T06:09:42.169 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.104+0000 7fb6e84b7700 1 -- 172.21.15.32:0/3161223739 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6e015baa0 con 0x7fb6e015ac40 2023-10-08T06:09:42.169 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.104+0000 7fb6e84b7700 1 -- 172.21.15.32:0/3161223739 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6e014e740 con 0x7fb6e015ac40 2023-10-08T06:09:42.170 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.104+0000 7fa5430a9700 1 -- 172.21.15.32:0/3969493961 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa53c073f00 con 0x7fa53c0c21a0 2023-10-08T06:09:42.170 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.104+0000 7f8fe57fa700 1 -- 172.21.15.32:0/3739653030 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fd00036c0 con 0x7f8fe81652b0 2023-10-08T06:09:42.170 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.104+0000 7f8fe57fa700 1 -- 172.21.15.32:0/3739653030 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fd001f070 con 0x7f8fe81652b0 2023-10-08T06:09:42.170 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.104+0000 7f8feedad700 1 -- 172.21.15.32:0/3739653030 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fe80b4390 con 0x7f8fe81652b0 2023-10-08T06:09:42.170 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.104+0000 7f8fe57fa700 1 -- 172.21.15.32:0/3739653030 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fd0003a20 con 0x7f8fe81652b0 2023-10-08T06:09:42.171 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.104+0000 7f8feedad700 1 -- 172.21.15.32:0/3739653030 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fe80b1b60 con 0x7f8fe81652b0 2023-10-08T06:09:42.171 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.104+0000 7f19027fc700 1 -- 172.21.15.32:0/3486402389 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1908011830 con 0x7f1904047de0 2023-10-08T06:09:42.171 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.104+0000 7f3c957fa700 1 -- 172.21.15.32:0/2653903517 <== mon.2 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f3c880514e0 con 0x7f3c98070380 2023-10-08T06:09:42.171 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.104+0000 7f191423b700 1 -- 172.21.15.32:0/3486402389 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f190404dbd0 con 0x7f1904047de0 2023-10-08T06:09:42.171 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.104+0000 7f19027fc700 1 -- 172.21.15.32:0/3486402389 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1908011990 con 0x7f1904047de0 2023-10-08T06:09:42.171 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.104+0000 7f19027fc700 1 -- 172.21.15.32:0/3486402389 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1908011d40 con 0x7f1904047de0 2023-10-08T06:09:42.172 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.104+0000 7f191423b700 1 -- 172.21.15.32:0/3486402389 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f190404e190 con 0x7f1904047de0 2023-10-08T06:09:42.172 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.104+0000 7f8feedad700 1 -- 172.21.15.32:0/3739653030 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fcc005310 con 0x7f8fe81652b0 2023-10-08T06:09:42.172 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.104+0000 7f191423b700 1 -- 172.21.15.32:0/3486402389 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f190404e350 con 0x7f1904047de0 2023-10-08T06:09:42.173 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.104+0000 7f8fe57fa700 1 -- 172.21.15.32:0/3739653030 <== mon.2 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f8fd0003b80 con 0x7f8fe81652b0 2023-10-08T06:09:42.173 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.104+0000 7f8fe57fa700 1 --2- 172.21.15.32:0/3739653030 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f8fc8066510 0x7f8fc80689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:42.173 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.104+0000 7f8fe57fa700 1 -- 172.21.15.32:0/3739653030 <== mon.2 v2:172.21.15.40:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8fd0021070 con 0x7f8fe81652b0 2023-10-08T06:09:42.173 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.104+0000 7f8fecb49700 1 --2- 172.21.15.32:0/3739653030 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f8fc8066510 0x7f8fc80689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:42.173 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.108+0000 7f8fecb49700 1 --2- 172.21.15.32:0/3739653030 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f8fc8066510 0x7f8fc80689d0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f8fe0005930 tx=0x7f8fe0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:42.173 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.108+0000 7f1afaffd700 1 -- 172.21.15.32:0/43426948 <== mon.1 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f1b000511b0 con 0x7f1b0c0ce430 2023-10-08T06:09:42.173 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.108+0000 7fa532ffd700 1 -- 172.21.15.32:0/3969493961 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa538004230 con 0x7fa53c0c21a0 2023-10-08T06:09:42.174 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.108+0000 7fa532ffd700 1 -- 172.21.15.32:0/3969493961 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5380045a0 con 0x7fa53c0c21a0 2023-10-08T06:09:42.174 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.108+0000 7fb6d6ffd700 1 -- 172.21.15.32:0/3161223739 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6d800f040 con 0x7fb6e015ac40 2023-10-08T06:09:42.174 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.108+0000 7fb6d6ffd700 1 -- 172.21.15.32:0/3161223739 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6d8003a40 con 0x7fb6e015ac40 2023-10-08T06:09:42.174 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.108+0000 7f5b65ffb700 1 -- 172.21.15.32:0/1786959074 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f5b700b4b70 con 0x7f5b701652b0 2023-10-08T06:09:42.175 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.112+0000 7fb6d6ffd700 1 -- 172.21.15.32:0/3161223739 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fb6d8003ba0 con 0x7fb6e015ac40 2023-10-08T06:09:42.175 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.112+0000 7fb6d6ffd700 1 --2- 172.21.15.32:0/3161223739 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fb6c4066540 0x7fb6c4068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:42.175 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.112+0000 7fb6d6ffd700 1 -- 172.21.15.32:0/3161223739 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb6d8084430 con 0x7fb6e015ac40 2023-10-08T06:09:42.175 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.112+0000 7fb6e6253700 1 --2- 172.21.15.32:0/3161223739 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fb6c4066540 0x7fb6c4068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:42.175 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.112+0000 7fb6e6253700 1 --2- 172.21.15.32:0/3161223739 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fb6c4066540 0x7fb6c4068a00 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fb6e0157500 tx=0x7fb6d000a000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:42.175 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.112+0000 7f8fe57fa700 1 -- 172.21.15.32:0/3739653030 <== mon.2 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f8fd0052c40 con 0x7f8fe81652b0 2023-10-08T06:09:42.176 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.116+0000 7f19027fc700 1 -- 172.21.15.32:0/3486402389 <== mon.2 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f1908004020 con 0x7f1904047de0 2023-10-08T06:09:42.176 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.116+0000 7f19027fc700 1 --2- 172.21.15.32:0/3486402389 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f18f0066540 0x7f18f0068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:42.176 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.116+0000 7f19027fc700 1 -- 172.21.15.32:0/3486402389 <== mon.2 v2:172.21.15.40:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1908084270 con 0x7f1904047de0 2023-10-08T06:09:42.176 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.116+0000 7fa532ffd700 1 -- 172.21.15.32:0/3969493961 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fa5380036c0 con 0x7fa53c0c21a0 2023-10-08T06:09:42.176 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.116+0000 7fa532ffd700 1 --2- 172.21.15.32:0/3969493961 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fa520066510 0x7fa5200689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:42.176 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.116+0000 7fa532ffd700 1 -- 172.21.15.32:0/3969493961 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa538083ea0 con 0x7fa53c0c21a0 2023-10-08T06:09:42.177 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.116+0000 7f19027fc700 1 -- 172.21.15.32:0/3486402389 <== mon.2 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f19080516d0 con 0x7f1904047de0 2023-10-08T06:09:42.177 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.116+0000 7f1911fd7700 1 --2- 172.21.15.32:0/3486402389 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f18f0066540 0x7f18f0068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:42.177 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.116+0000 7fa5418a6700 1 --2- 172.21.15.32:0/3969493961 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fa520066510 0x7fa5200689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:42.177 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.116+0000 7f1911fd7700 1 --2- 172.21.15.32:0/3486402389 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f18f0066540 0x7f18f0068a00 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f18fc009b50 tx=0x7f18fc009240 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:42.178 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.116+0000 7fa5418a6700 1 --2- 172.21.15.32:0/3969493961 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fa520066510 0x7fa5200689d0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fa53c070dd0 tx=0x7fa52c008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:42.178 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.120+0000 7fb6e84b7700 1 -- 172.21.15.32:0/3161223739 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6c8005310 con 0x7fb6e015ac40 2023-10-08T06:09:42.178 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.120+0000 7fa532ffd700 1 -- 172.21.15.32:0/3969493961 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fa538051310 con 0x7fa53c0c21a0 2023-10-08T06:09:42.178 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.128+0000 7fb6d6ffd700 1 -- 172.21.15.32:0/3161223739 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fb6d8051810 con 0x7fb6e015ac40 2023-10-08T06:09:42.427 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.420+0000 7faebccbe700 1 -- 172.21.15.32:0/2817828772 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7faeb80c6bf0 con 0x7faeb80ce430 2023-10-08T06:09:42.427 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.420+0000 7faea6ffd700 1 -- 172.21.15.32:0/2817828772 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7faeb80c6bf0 con 0x7faeb80ce430 2023-10-08T06:09:42.430 INFO:teuthology.orchestra.run.smithi032.stdout:64424509444 2023-10-08T06:09:42.432 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.428+0000 7faea4ff9700 1 -- 172.21.15.32:0/2817828772 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fae980665e0 msgr2=0x7fae98068aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:42.432 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.428+0000 7faea4ff9700 1 --2- 172.21.15.32:0/2817828772 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fae980665e0 0x7fae98068aa0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7faea8000f60 tx=0x7faea8009040 comp rx=0 tx=0).stop 2023-10-08T06:09:42.432 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.428+0000 7faea4ff9700 1 -- 172.21.15.32:0/2817828772 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faeb80ce430 msgr2=0x7faeb80c8c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:42.432 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.428+0000 7faea4ff9700 1 --2- 172.21.15.32:0/2817828772 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faeb80ce430 0x7faeb80c8c90 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7faeb0015000 tx=0x7faeb0004af0 comp rx=0 tx=0).stop 2023-10-08T06:09:42.433 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.428+0000 7faea4ff9700 1 -- 172.21.15.32:0/2817828772 shutdown_connections 2023-10-08T06:09:42.433 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.428+0000 7faea4ff9700 1 --2- 172.21.15.32:0/2817828772 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fae980665e0 0x7fae98068aa0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:42.433 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.428+0000 7faea4ff9700 1 --2- 172.21.15.32:0/2817828772 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faeb80ce430 0x7faeb80c8c90 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:42.433 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.428+0000 7faea4ff9700 1 --2- 172.21.15.32:0/2817828772 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faeb815d4b0 0x7faeb80c91d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:42.433 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.428+0000 7faea4ff9700 1 --2- 172.21.15.32:0/2817828772 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faeb80b8b20 0x7faeb815fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:42.433 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.428+0000 7faea4ff9700 1 -- 172.21.15.32:0/2817828772 >> 172.21.15.32:0/2817828772 conn(0x7faeb806ac60 msgr2=0x7faeb8153610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:09:42.434 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.428+0000 7faea4ff9700 1 -- 172.21.15.32:0/2817828772 shutdown_connections 2023-10-08T06:09:42.434 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.428+0000 7faea4ff9700 1 -- 172.21.15.32:0/2817828772 wait complete. 2023-10-08T06:09:42.437 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.432+0000 7f8feedad700 1 -- 172.21.15.32:0/3739653030 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f8fcc005890 con 0x7f8fe81652b0 2023-10-08T06:09:42.438 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.432+0000 7f8fe57fa700 1 -- 172.21.15.32:0/3739653030 <== mon.2 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8fd0015090 con 0x7f8fe81652b0 2023-10-08T06:09:42.438 INFO:teuthology.orchestra.run.smithi032.stdout:64424509446 2023-10-08T06:09:42.439 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.436+0000 7f3c9f155700 1 -- 172.21.15.32:0/2653903517 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f3c980c3dc0 con 0x7f3c98070380 2023-10-08T06:09:42.440 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.436+0000 7f3c957fa700 1 -- 172.21.15.32:0/2653903517 <== mon.2 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3c8801f020 con 0x7f3c98070380 2023-10-08T06:09:42.441 INFO:teuthology.orchestra.run.smithi032.stdout:64424509445 2023-10-08T06:09:42.441 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.436+0000 7f1af8ff9700 1 -- 172.21.15.32:0/43426948 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f1b0c073f00 con 0x7f1b0c0ce430 2023-10-08T06:09:42.442 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.436+0000 7f5b774dd700 1 -- 172.21.15.32:0/1786959074 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f5b700c62c0 con 0x7f5b701652b0 2023-10-08T06:09:42.442 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.436+0000 7f5b65ffb700 1 -- 172.21.15.32:0/1786959074 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5b700c62c0 con 0x7f5b701652b0 2023-10-08T06:09:42.442 INFO:teuthology.orchestra.run.smithi032.stdout:64424509445 2023-10-08T06:09:42.443 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.436+0000 7f8feedad700 1 -- 172.21.15.32:0/3739653030 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f8fc8066510 msgr2=0x7f8fc80689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:42.443 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.436+0000 7f8feedad700 1 --2- 172.21.15.32:0/3739653030 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f8fc8066510 0x7f8fc80689d0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f8fe0005930 tx=0x7f8fe0009040 comp rx=0 tx=0).stop 2023-10-08T06:09:42.443 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.436+0000 7f8feedad700 1 -- 172.21.15.32:0/3739653030 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8fe81652b0 msgr2=0x7f8fe80b25c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:42.443 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.436+0000 7f8feedad700 1 --2- 172.21.15.32:0/3739653030 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8fe81652b0 0x7f8fe80b25c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f8fd0009b70 tx=0x7f8fd0004770 comp rx=0 tx=0).stop 2023-10-08T06:09:42.443 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.436+0000 7f1afaffd700 1 -- 172.21.15.32:0/43426948 <== mon.1 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1b00017090 con 0x7f1b0c0ce430 2023-10-08T06:09:42.444 INFO:teuthology.orchestra.run.smithi032.stdout:64424509445 2023-10-08T06:09:42.444 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.436+0000 7f8feedad700 1 -- 172.21.15.32:0/3739653030 shutdown_connections 2023-10-08T06:09:42.444 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.436+0000 7f8feedad700 1 --2- 172.21.15.32:0/3739653030 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f8fc8066510 0x7f8fc80689d0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:42.444 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.436+0000 7f8feedad700 1 --2- 172.21.15.32:0/3739653030 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8fe8165740 0x7f8fe80c7230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:42.444 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.436+0000 7f8feedad700 1 --2- 172.21.15.32:0/3739653030 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8fe81652b0 0x7f8fe80b25c0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:42.444 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.436+0000 7f8feedad700 1 --2- 172.21.15.32:0/3739653030 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8fe80c21a0 0x7f8fe80b2080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:42.444 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.436+0000 7f8feedad700 1 -- 172.21.15.32:0/3739653030 >> 172.21.15.32:0/3739653030 conn(0x7f8fe80b0900 msgr2=0x7f8fe8163c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:09:42.444 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.440+0000 7f8feedad700 1 -- 172.21.15.32:0/3739653030 shutdown_connections 2023-10-08T06:09:42.445 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.440+0000 7f8feedad700 1 -- 172.21.15.32:0/3739653030 wait complete. 2023-10-08T06:09:42.446 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.440+0000 7f3c9f155700 1 -- 172.21.15.32:0/2653903517 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f3c84066540 msgr2=0x7f3c84068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:42.446 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.440+0000 7f3c9f155700 1 --2- 172.21.15.32:0/2653903517 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f3c84066540 0x7f3c84068a00 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f3c9814aa80 tx=0x7f3c90009230 comp rx=0 tx=0).stop 2023-10-08T06:09:42.446 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.440+0000 7f3c9f155700 1 -- 172.21.15.32:0/2653903517 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3c98070380 msgr2=0x7f3c980b1c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:42.446 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.440+0000 7f3c9f155700 1 --2- 172.21.15.32:0/2653903517 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3c98070380 0x7f3c980b1c80 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f3c8800c7a0 tx=0x7f3c8800cab0 comp rx=0 tx=0).stop 2023-10-08T06:09:42.446 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.440+0000 7f3c9f155700 1 -- 172.21.15.32:0/2653903517 shutdown_connections 2023-10-08T06:09:42.446 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.440+0000 7f3c9f155700 1 --2- 172.21.15.32:0/2653903517 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f3c84066540 0x7f3c84068a00 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:42.446 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.440+0000 7f3c9f155700 1 --2- 172.21.15.32:0/2653903517 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3c980cc370 0x7f3c9814d1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:42.447 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.440+0000 7f3c9f155700 1 --2- 172.21.15.32:0/2653903517 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3c981599e0 0x7f3c980c4720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:42.447 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.440+0000 7f3c9f155700 1 --2- 172.21.15.32:0/2653903517 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3c98070380 0x7f3c980b1c80 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:42.447 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.440+0000 7f3c9f155700 1 -- 172.21.15.32:0/2653903517 >> 172.21.15.32:0/2653903517 conn(0x7f3c980cb850 msgr2=0x7f3c9815a3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:09:42.447 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.440+0000 7f3c9f155700 1 -- 172.21.15.32:0/2653903517 shutdown_connections 2023-10-08T06:09:42.447 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.440+0000 7f3c9f155700 1 -- 172.21.15.32:0/2653903517 wait complete. 2023-10-08T06:09:42.447 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.440+0000 7f1af8ff9700 1 -- 172.21.15.32:0/43426948 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f1aec066560 msgr2=0x7f1aec068a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:42.448 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.440+0000 7f1af8ff9700 1 --2- 172.21.15.32:0/43426948 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f1aec066560 0x7f1aec068a20 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f1b04009fd0 tx=0x7f1b04009000 comp rx=0 tx=0).stop 2023-10-08T06:09:42.448 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.440+0000 7f1af8ff9700 1 -- 172.21.15.32:0/43426948 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1b0c0ce430 msgr2=0x7f1b0c160ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:42.448 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.440+0000 7f1af8ff9700 1 --2- 172.21.15.32:0/43426948 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1b0c0ce430 0x7f1b0c160ef0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f1b0000e790 tx=0x7f1b0000eb50 comp rx=0 tx=0).stop 2023-10-08T06:09:42.448 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.440+0000 7f1af8ff9700 1 -- 172.21.15.32:0/43426948 shutdown_connections 2023-10-08T06:09:42.448 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.440+0000 7f1af8ff9700 1 --2- 172.21.15.32:0/43426948 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f1aec066560 0x7f1aec068a20 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:42.448 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.440+0000 7f1af8ff9700 1 --2- 172.21.15.32:0/43426948 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1b0c15d600 0x7f1b0c0bc5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:42.448 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.440+0000 7f1af8ff9700 1 --2- 172.21.15.32:0/43426948 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1b0c0ce430 0x7f1b0c160ef0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:42.448 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.440+0000 7f1af8ff9700 1 --2- 172.21.15.32:0/43426948 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1b0c0703c0 0x7f1b0c1458f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:42.448 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.440+0000 7f1af8ff9700 1 -- 172.21.15.32:0/43426948 >> 172.21.15.32:0/43426948 conn(0x7f1b0c0cb850 msgr2=0x7f1b0c0b3e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:09:42.448 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.440+0000 7f1af8ff9700 1 -- 172.21.15.32:0/43426948 shutdown_connections 2023-10-08T06:09:42.449 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.440+0000 7f1af8ff9700 1 -- 172.21.15.32:0/43426948 wait complete. 2023-10-08T06:09:42.449 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509444 for osd.1 2023-10-08T06:09:42.450 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.440+0000 7fa5430a9700 1 -- 172.21.15.32:0/3969493961 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fa53c0b4d50 con 0x7fa53c0c21a0 2023-10-08T06:09:42.450 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.440+0000 7f5b774dd700 1 -- 172.21.15.32:0/1786959074 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f5b54066510 msgr2=0x7f5b540689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:42.450 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.440+0000 7f5b774dd700 1 --2- 172.21.15.32:0/1786959074 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f5b54066510 0x7f5b540689d0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f5b700c5380 tx=0x7f5b6800d040 comp rx=0 tx=0).stop 2023-10-08T06:09:42.450 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.440+0000 7f5b774dd700 1 -- 172.21.15.32:0/1786959074 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5b701652b0 msgr2=0x7f5b700b3920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:42.450 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.440+0000 7f5b774dd700 1 --2- 172.21.15.32:0/1786959074 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5b701652b0 0x7f5b700b3920 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f5b7006c340 tx=0x7f5b60004770 comp rx=0 tx=0).stop 2023-10-08T06:09:42.451 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.440+0000 7f5b774dd700 1 -- 172.21.15.32:0/1786959074 shutdown_connections 2023-10-08T06:09:42.451 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.440+0000 7f5b774dd700 1 --2- 172.21.15.32:0/1786959074 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f5b54066510 0x7f5b540689d0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:42.451 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.440+0000 7f5b774dd700 1 --2- 172.21.15.32:0/1786959074 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5b701652b0 0x7f5b700b3920 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:42.451 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.440+0000 7f5b774dd700 1 --2- 172.21.15.32:0/1786959074 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5b70165740 0x7f5b70070cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:42.451 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.440+0000 7f5b774dd700 1 --2- 172.21.15.32:0/1786959074 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5b700c21a0 0x7f5b701561b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:42.451 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.440+0000 7f5b774dd700 1 -- 172.21.15.32:0/1786959074 >> 172.21.15.32:0/1786959074 conn(0x7f5b700b0900 msgr2=0x7f5b70163c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:09:42.451 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.440+0000 7f5b774dd700 1 -- 172.21.15.32:0/1786959074 shutdown_connections 2023-10-08T06:09:42.451 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.440+0000 7f5b774dd700 1 -- 172.21.15.32:0/1786959074 wait complete. 2023-10-08T06:09:42.452 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.440+0000 7fa532ffd700 1 -- 172.21.15.32:0/3969493961 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa538059e60 con 0x7fa53c0c21a0 2023-10-08T06:09:42.452 INFO:teuthology.orchestra.run.smithi032.stdout:64424509445 2023-10-08T06:09:42.453 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.444+0000 7fa5430a9700 1 -- 172.21.15.32:0/3969493961 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fa520066510 msgr2=0x7fa5200689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:42.453 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.444+0000 7fa5430a9700 1 --2- 172.21.15.32:0/3969493961 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fa520066510 0x7fa5200689d0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fa53c070dd0 tx=0x7fa52c008030 comp rx=0 tx=0).stop 2023-10-08T06:09:42.453 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.444+0000 7fa5430a9700 1 -- 172.21.15.32:0/3969493961 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa53c0c21a0 msgr2=0x7fa53c15d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:42.453 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.444+0000 7fa5430a9700 1 --2- 172.21.15.32:0/3969493961 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa53c0c21a0 0x7fa53c15d570 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fa53800e810 tx=0x7fa53800eb20 comp rx=0 tx=0).stop 2023-10-08T06:09:42.453 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.444+0000 7fa5430a9700 1 -- 172.21.15.32:0/3969493961 shutdown_connections 2023-10-08T06:09:42.453 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.444+0000 7fa5430a9700 1 --2- 172.21.15.32:0/3969493961 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fa520066510 0x7fa5200689d0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:42.453 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.444+0000 7fa5430a9700 1 --2- 172.21.15.32:0/3969493961 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa53c165740 0x7fa53c070060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:42.453 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.444+0000 7fa5430a9700 1 --2- 172.21.15.32:0/3969493961 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa53c1652b0 0x7fa53c06fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:42.453 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.444+0000 7fa5430a9700 1 --2- 172.21.15.32:0/3969493961 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa53c0c21a0 0x7fa53c15d570 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:42.454 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.444+0000 7fa5430a9700 1 -- 172.21.15.32:0/3969493961 >> 172.21.15.32:0/3969493961 conn(0x7fa53c0b0900 msgr2=0x7fa53c0ae770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:09:42.454 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.444+0000 7fa5430a9700 1 -- 172.21.15.32:0/3969493961 shutdown_connections 2023-10-08T06:09:42.454 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.444+0000 7fa5430a9700 1 -- 172.21.15.32:0/3969493961 wait complete. 2023-10-08T06:09:42.454 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.448+0000 7f191423b700 1 -- 172.21.15.32:0/3486402389 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f190404e670 con 0x7f1904047de0 2023-10-08T06:09:42.454 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.448+0000 7f19027fc700 1 -- 172.21.15.32:0/3486402389 <== mon.2 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1908009320 con 0x7f1904047de0 2023-10-08T06:09:42.456 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.452+0000 7fb6e84b7700 1 -- 172.21.15.32:0/3161223739 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fb6c80055c0 con 0x7fb6e015ac40 2023-10-08T06:09:42.456 INFO:teuthology.orchestra.run.smithi032.stdout:64424509445 2023-10-08T06:09:42.456 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.452+0000 7f191423b700 1 -- 172.21.15.32:0/3486402389 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f18f0066540 msgr2=0x7f18f0068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:42.457 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.452+0000 7f191423b700 1 --2- 172.21.15.32:0/3486402389 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f18f0066540 0x7f18f0068a00 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f18fc009b50 tx=0x7f18fc009240 comp rx=0 tx=0).stop 2023-10-08T06:09:42.457 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.452+0000 7f191423b700 1 -- 172.21.15.32:0/3486402389 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1904047de0 msgr2=0x7f1904049c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:42.457 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.452+0000 7f191423b700 1 --2- 172.21.15.32:0/3486402389 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1904047de0 0x7f1904049c30 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f190800b550 tx=0x7f190800b860 comp rx=0 tx=0).stop 2023-10-08T06:09:42.457 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.452+0000 7f191423b700 1 -- 172.21.15.32:0/3486402389 shutdown_connections 2023-10-08T06:09:42.457 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.452+0000 7f191423b700 1 --2- 172.21.15.32:0/3486402389 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f18f0066540 0x7f18f0068a00 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:42.457 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.452+0000 7f191423b700 1 --2- 172.21.15.32:0/3486402389 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1904048330 0x7f19040dc230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:42.457 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.452+0000 7f191423b700 1 --2- 172.21.15.32:0/3486402389 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1904047de0 0x7f1904049c30 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:42.457 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.452+0000 7f191423b700 1 --2- 172.21.15.32:0/3486402389 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f19040340d0 0x7f190404d1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:42.457 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.452+0000 7f191423b700 1 -- 172.21.15.32:0/3486402389 >> 172.21.15.32:0/3486402389 conn(0x7f1904054c90 msgr2=0x7f1904035530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:09:42.458 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.452+0000 7fb6d6ffd700 1 -- 172.21.15.32:0/3161223739 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb6d8054e30 con 0x7fb6e015ac40 2023-10-08T06:09:42.458 INFO:teuthology.orchestra.run.smithi032.stdout:60129542148 2023-10-08T06:09:42.458 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.452+0000 7f191423b700 1 -- 172.21.15.32:0/3486402389 shutdown_connections 2023-10-08T06:09:42.458 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.452+0000 7f191423b700 1 -- 172.21.15.32:0/3486402389 wait complete. 2023-10-08T06:09:42.460 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509446 for osd.6 2023-10-08T06:09:42.461 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.456+0000 7fb6e84b7700 1 -- 172.21.15.32:0/3161223739 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fb6c4066540 msgr2=0x7fb6c4068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:42.461 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.456+0000 7fb6e84b7700 1 --2- 172.21.15.32:0/3161223739 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fb6c4066540 0x7fb6c4068a00 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fb6e0157500 tx=0x7fb6d000a000 comp rx=0 tx=0).stop 2023-10-08T06:09:42.461 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.456+0000 7fb6e84b7700 1 -- 172.21.15.32:0/3161223739 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb6e015ac40 msgr2=0x7fb6e0151450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:42.461 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.456+0000 7fb6e84b7700 1 --2- 172.21.15.32:0/3161223739 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb6e015ac40 0x7fb6e0151450 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fb6e006b790 tx=0x7fb6d800f490 comp rx=0 tx=0).stop 2023-10-08T06:09:42.461 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.456+0000 7fb6e84b7700 1 -- 172.21.15.32:0/3161223739 shutdown_connections 2023-10-08T06:09:42.461 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.456+0000 7fb6e84b7700 1 --2- 172.21.15.32:0/3161223739 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fb6c4066540 0x7fb6c4068a00 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:42.461 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.456+0000 7fb6e84b7700 1 --2- 172.21.15.32:0/3161223739 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb6e015ac40 0x7fb6e0151450 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:42.461 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.456+0000 7fb6e84b7700 1 --2- 172.21.15.32:0/3161223739 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb6e0150070 0x7fb6e0150f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:42.461 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.456+0000 7fb6e84b7700 1 --2- 172.21.15.32:0/3161223739 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb6e014e360 0x7fb6e015c2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:42.462 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.456+0000 7fb6e84b7700 1 -- 172.21.15.32:0/3161223739 >> 172.21.15.32:0/3161223739 conn(0x7fb6e00cb850 msgr2=0x7fb6e0158c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:09:42.462 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.456+0000 7fb6e84b7700 1 -- 172.21.15.32:0/3161223739 shutdown_connections 2023-10-08T06:09:42.462 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:42.456+0000 7fb6e84b7700 1 -- 172.21.15.32:0/3161223739 wait complete. 2023-10-08T06:09:42.463 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509445 for osd.5 2023-10-08T06:09:42.464 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509445 for osd.0 2023-10-08T06:09:42.465 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509445 for osd.2 2023-10-08T06:09:42.469 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509445 for osd.4 2023-10-08T06:09:42.471 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509445 for osd.7 2023-10-08T06:09:42.472 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542148 for osd.3 2023-10-08T06:09:43.450 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-08T06:09:43.461 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-10-08T06:09:43.464 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-10-08T06:09:43.465 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-08T06:09:43.465 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-08T06:09:43.470 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-10-08T06:09:43.472 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-10-08T06:09:43.473 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-08T06:09:43.615 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.608+0000 7f76461a0700 1 Processor -- start 2023-10-08T06:09:43.616 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.612+0000 7f76461a0700 1 -- start start 2023-10-08T06:09:43.618 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.612+0000 7f76461a0700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f764015d600 0x7f76400cd9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:43.618 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.612+0000 7f76461a0700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f76400703c0 0x7f76400cdef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:43.618 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.612+0000 7f76461a0700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f76400ce430 0x7f7640161150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:43.618 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.612+0000 7f76461a0700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76400ade50 con 0x7f764015d600 2023-10-08T06:09:43.618 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.612+0000 7f76461a0700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f764006dfc0 con 0x7f76400ce430 2023-10-08T06:09:43.619 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.612+0000 7f76461a0700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f764015e800 con 0x7f76400703c0 2023-10-08T06:09:43.619 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.612+0000 7f764519e700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f764015d600 0x7f76400cd9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:43.619 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.612+0000 7f764519e700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f764015d600 0x7f76400cd9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:59374/0 (socket says 172.21.15.32:59374) 2023-10-08T06:09:43.619 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.612+0000 7f764519e700 1 -- 172.21.15.32:0/1100820551 learned_addr learned my addr 172.21.15.32:0/1100820551 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:09:43.619 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.612+0000 7f764499d700 1 --2- 172.21.15.32:0/1100820551 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f76400703c0 0x7f76400cdef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:43.619 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.612+0000 7f764599f700 1 --2- 172.21.15.32:0/1100820551 >> v2:172.21.15.40:3300/0 conn(0x7f76400ce430 0x7f7640161150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:43.619 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.612+0000 7f764519e700 1 -- 172.21.15.32:0/1100820551 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f76400703c0 msgr2=0x7f76400cdef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:09:43.619 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.612+0000 7f764519e700 1 --2- 172.21.15.32:0/1100820551 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f76400703c0 0x7f76400cdef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:43.619 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.612+0000 7f764519e700 1 -- 172.21.15.32:0/1100820551 >> v2:172.21.15.40:3300/0 conn(0x7f76400ce430 msgr2=0x7f7640161150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:09:43.619 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.612+0000 7f764519e700 1 --2- 172.21.15.32:0/1100820551 >> v2:172.21.15.40:3300/0 conn(0x7f76400ce430 0x7f7640161150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:43.619 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.612+0000 7f764519e700 1 -- 172.21.15.32:0/1100820551 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f764006e260 con 0x7f764015d600 2023-10-08T06:09:43.620 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.612+0000 7fe9d88da700 1 Processor -- start 2023-10-08T06:09:43.620 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.612+0000 7f764519e700 1 --2- 172.21.15.32:0/1100820551 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f764015d600 0x7f76400cd9b0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f76401621f0 tx=0x7f763c009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42daba7ec0a9ef3d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:43.620 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.612+0000 7fe9d88da700 1 -- start start 2023-10-08T06:09:43.621 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.612+0000 7f7637fff700 1 -- 172.21.15.32:0/1100820551 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f763c00b8a0 con 0x7f764015d600 2023-10-08T06:09:43.621 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.616+0000 7fe9d88da700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe9d415d4b0 0x7fe9d4161110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:43.621 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.616+0000 7fe9d88da700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fe9d40b8b20 0x7fe9d40cdef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:43.621 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.616+0000 7fe9d88da700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9d40d1620 con 0x7fe9d40ce430 2023-10-08T06:09:43.622 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.616+0000 7fe9d88da700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9d40ce8e0 con 0x7fe9d40b8b20 2023-10-08T06:09:43.622 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.616+0000 7fe9d88da700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9d40d1320 con 0x7fe9d415d4b0 2023-10-08T06:09:43.622 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.612+0000 7f7637fff700 1 -- 172.21.15.32:0/1100820551 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f763c00ba00 con 0x7f764015d600 2023-10-08T06:09:43.622 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.612+0000 7f7637fff700 1 -- 172.21.15.32:0/1100820551 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f763c00bd90 con 0x7f764015d600 2023-10-08T06:09:43.622 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.616+0000 7f76461a0700 1 -- 172.21.15.32:0/1100820551 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f764015d600 msgr2=0x7f76400cd9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:43.622 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.616+0000 7f76461a0700 1 --2- 172.21.15.32:0/1100820551 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f764015d600 0x7f76400cd9b0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f76401621f0 tx=0x7f763c009bf0 comp rx=0 tx=0).stop 2023-10-08T06:09:43.623 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.616+0000 7fe9d2ffd700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fe9d40b8b20 0x7fe9d40cdef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:43.623 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.616+0000 7fe9d2ffd700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fe9d40b8b20 0x7fe9d40cdef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:59390/0 (socket says 172.21.15.32:59390) 2023-10-08T06:09:43.623 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.616+0000 7fe9d2ffd700 1 -- 172.21.15.32:0/478992549 learned_addr learned my addr 172.21.15.32:0/478992549 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:09:43.623 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.616+0000 7fe9d37fe700 1 --2- 172.21.15.32:0/478992549 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe9d415d4b0 0x7fe9d4161110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:43.623 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.616+0000 7fe9d2ffd700 1 -- 172.21.15.32:0/478992549 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe9d415d4b0 msgr2=0x7fe9d4161110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:09:43.623 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.616+0000 7fe9d2ffd700 1 --2- 172.21.15.32:0/478992549 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe9d415d4b0 0x7fe9d4161110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:43.624 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.616+0000 7fe9d2ffd700 1 -- 172.21.15.32:0/478992549 >> v1:172.21.15.40:6789/0 conn(0x7fe9d40ce430 legacy=0x7fe9d40b4ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:09:43.624 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.616+0000 7fe9d2ffd700 1 -- 172.21.15.32:0/478992549 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9d41619f0 con 0x7fe9d40b8b20 2023-10-08T06:09:43.624 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.616+0000 7f76461a0700 1 -- 172.21.15.32:0/1100820551 shutdown_connections 2023-10-08T06:09:43.624 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.616+0000 7f76461a0700 1 --2- 172.21.15.32:0/1100820551 >> v2:172.21.15.40:3300/0 conn(0x7f76400ce430 0x7f7640161150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:43.624 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.616+0000 7f76461a0700 1 --2- 172.21.15.32:0/1100820551 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f76400703c0 0x7f76400cdef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:43.624 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.616+0000 7f76461a0700 1 --2- 172.21.15.32:0/1100820551 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f764015d600 0x7f76400cd9b0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:43.624 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.616+0000 7f76461a0700 1 -- 172.21.15.32:0/1100820551 >> 172.21.15.32:0/1100820551 conn(0x7f76400cb850 msgr2=0x7f76400cbc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:09:43.625 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.616+0000 7f76461a0700 1 -- 172.21.15.32:0/1100820551 shutdown_connections 2023-10-08T06:09:43.625 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.616+0000 7fe9d2ffd700 1 --2- 172.21.15.32:0/478992549 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe9d40b8b20 0x7fe9d40cdef0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fe9c4009910 tx=0x7fe9c4009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e240752862990fc6 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:43.625 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.616+0000 7f76461a0700 1 -- 172.21.15.32:0/1100820551 wait complete. 2023-10-08T06:09:43.625 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.616+0000 7f104fc22700 1 Processor -- start 2023-10-08T06:09:43.626 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.616+0000 7fab4ea02700 1 Processor -- start 2023-10-08T06:09:43.626 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.616+0000 7f104fc22700 1 -- start start 2023-10-08T06:09:43.626 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.616+0000 7fab4ea02700 1 -- start start 2023-10-08T06:09:43.627 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.616+0000 7f76461a0700 1 Processor -- start 2023-10-08T06:09:43.627 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.616+0000 7f76461a0700 1 -- start start 2023-10-08T06:09:43.627 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.616+0000 7fe9d27fc700 1 -- 172.21.15.32:0/478992549 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9c4004230 con 0x7fe9d40b8b20 2023-10-08T06:09:43.627 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.616+0000 7fe9d27fc700 1 -- 172.21.15.32:0/478992549 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9c4004390 con 0x7fe9d40b8b20 2023-10-08T06:09:43.627 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.616+0000 7fe9d27fc700 1 -- 172.21.15.32:0/478992549 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9c40036c0 con 0x7fe9d40b8b20 2023-10-08T06:09:43.628 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.616+0000 7fab4ea02700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fab48159ed0 0x7fab480ca9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:43.628 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.616+0000 7fab4ea02700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fab4815a2b0 0x7fab480c98c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:43.628 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.616+0000 7fab4ea02700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab480cca40 con 0x7fab480706f0 2023-10-08T06:09:43.628 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.616+0000 7fab4ea02700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab480ccdb0 con 0x7fab4815a2b0 2023-10-08T06:09:43.628 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.616+0000 7fab4ea02700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab480caef0 con 0x7fab48159ed0 2023-10-08T06:09:43.629 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.616+0000 7fab477fe700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fab4815a2b0 0x7fab480c98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:43.629 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.616+0000 7fab477fe700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fab4815a2b0 0x7fab480c98c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:59398/0 (socket says 172.21.15.32:59398) 2023-10-08T06:09:43.629 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.616+0000 7fab477fe700 1 -- 172.21.15.32:0/21276881 learned_addr learned my addr 172.21.15.32:0/21276881 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:09:43.629 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.616+0000 7fab47fff700 1 --2- 172.21.15.32:0/21276881 >> v2:172.21.15.40:3300/0 conn(0x7fab48159ed0 0x7fab480ca9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:43.629 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.620+0000 7f76461a0700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f76400703c0 0x7f76401581e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:43.629 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.620+0000 7f76461a0700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f76400ce430 0x7f764015ed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:43.629 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.620+0000 7f76461a0700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f764015d600 0x7f764015b840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:43.629 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.620+0000 7f76461a0700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f764015b420 con 0x7f76400703c0 2023-10-08T06:09:43.630 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.620+0000 7f76461a0700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76401f73f0 con 0x7f764015d600 2023-10-08T06:09:43.630 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.620+0000 7f76461a0700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f764015a810 con 0x7f76400ce430 2023-10-08T06:09:43.630 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.620+0000 7f104fc22700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f104815a2b0 0x7f10480ca9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:43.630 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.620+0000 7f104fc22700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f10480c98c0 0x7f10480cb510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:43.630 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.620+0000 7f104fc22700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10480cca40 con 0x7f1048159ed0 2023-10-08T06:09:43.630 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.620+0000 7f104fc22700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10480ccdb0 con 0x7f104815a2b0 2023-10-08T06:09:43.630 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.620+0000 7f104fc22700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10480caef0 con 0x7f10480c98c0 2023-10-08T06:09:43.631 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.620+0000 7f764519e700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f76400703c0 0x7f76401581e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:43.631 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.620+0000 7f764519e700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f76400703c0 0x7f76401581e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:59410/0 (socket says 172.21.15.32:59410) 2023-10-08T06:09:43.631 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.620+0000 7f764519e700 1 -- 172.21.15.32:0/1828160077 learned_addr learned my addr 172.21.15.32:0/1828160077 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:09:43.631 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.620+0000 7f764599f700 1 --2- 172.21.15.32:0/1828160077 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f764015d600 0x7f764015b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:43.631 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.620+0000 7f104d1bd700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f104815a2b0 0x7f10480ca9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:43.631 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.620+0000 7f104d1bd700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f104815a2b0 0x7f10480ca9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:59426/0 (socket says 172.21.15.32:59426) 2023-10-08T06:09:43.631 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.620+0000 7f104d1bd700 1 -- 172.21.15.32:0/2251986762 learned_addr learned my addr 172.21.15.32:0/2251986762 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:09:43.631 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.620+0000 7f104e1bf700 1 --2- 172.21.15.32:0/2251986762 >> v2:172.21.15.40:3300/0 conn(0x7f10480c98c0 0x7f10480cb510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:43.632 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.620+0000 7f458195d700 1 Processor -- start 2023-10-08T06:09:43.632 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.620+0000 7fab46ffd700 1 -- 172.21.15.32:0/21276881 <== mon.1 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 297199941 0 0) 0x7fab480cca40 con 0x7fab480706f0 2023-10-08T06:09:43.632 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.620+0000 7fab46ffd700 1 -- 172.21.15.32:0/21276881 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fab300035d0 con 0x7fab480706f0 2023-10-08T06:09:43.632 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.620+0000 7fab477fe700 1 -- 172.21.15.32:0/21276881 >> v2:172.21.15.40:3300/0 conn(0x7fab48159ed0 msgr2=0x7fab480ca9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:09:43.632 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.620+0000 7fab477fe700 1 --2- 172.21.15.32:0/21276881 >> v2:172.21.15.40:3300/0 conn(0x7fab48159ed0 0x7fab480ca9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:43.632 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.620+0000 7fab477fe700 1 -- 172.21.15.32:0/21276881 >> v1:172.21.15.40:6789/0 conn(0x7fab480706f0 legacy=0x7fab480cb510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:43.633 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.620+0000 7fab477fe700 1 -- 172.21.15.32:0/21276881 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab480cdf60 con 0x7fab4815a2b0 2023-10-08T06:09:43.633 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.620+0000 7f3f41aae700 1 Processor -- start 2023-10-08T06:09:43.633 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.620+0000 7f3f41aae700 1 -- start start 2023-10-08T06:09:43.633 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.620+0000 7f764499d700 1 --2- 172.21.15.32:0/1828160077 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f76400ce430 0x7f764015ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:43.634 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.620+0000 7f104d1bd700 1 -- 172.21.15.32:0/2251986762 >> v2:172.21.15.40:3300/0 conn(0x7f10480c98c0 msgr2=0x7f10480cb510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:09:43.634 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.620+0000 7f104d1bd700 1 --2- 172.21.15.32:0/2251986762 >> v2:172.21.15.40:3300/0 conn(0x7f10480c98c0 0x7f10480cb510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:43.634 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.620+0000 7f104d1bd700 1 -- 172.21.15.32:0/2251986762 >> v1:172.21.15.32:6789/0 conn(0x7f1048159ed0 legacy=0x7f10480706f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:43.634 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.620+0000 7f104d1bd700 1 -- 172.21.15.32:0/2251986762 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10480cdf60 con 0x7f104815a2b0 2023-10-08T06:09:43.634 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.620+0000 7fab47fff700 1 --2- 172.21.15.32:0/21276881 >> v2:172.21.15.40:3300/0 conn(0x7fab48159ed0 0x7fab480ca9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T06:09:43.634 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.620+0000 7fab477fe700 1 --2- 172.21.15.32:0/21276881 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fab4815a2b0 0x7fab480c98c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fab480685d0 tx=0x7fab3c009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e386522d00e48387 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:43.634 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.620+0000 7f458195d700 1 -- start start 2023-10-08T06:09:43.635 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.620+0000 7f764519e700 1 -- 172.21.15.32:0/1828160077 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f76400ce430 msgr2=0x7f764015ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:43.635 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.620+0000 7f764519e700 1 --2- 172.21.15.32:0/1828160077 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f76400ce430 0x7f764015ed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:43.635 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.620+0000 7f764519e700 1 -- 172.21.15.32:0/1828160077 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f764015d600 msgr2=0x7f764015b840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:43.635 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.620+0000 7f764519e700 1 --2- 172.21.15.32:0/1828160077 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f764015d600 0x7f764015b840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:43.635 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.620+0000 7f764519e700 1 -- 172.21.15.32:0/1828160077 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f763c009570 con 0x7f76400703c0 2023-10-08T06:09:43.635 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.620+0000 7fab46ffd700 1 -- 172.21.15.32:0/21276881 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab3c011830 con 0x7fab4815a2b0 2023-10-08T06:09:43.636 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.620+0000 7fe9d88da700 1 -- 172.21.15.32:0/478992549 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe9d40b8b20 msgr2=0x7fe9d40cdef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:43.636 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.620+0000 7fab46ffd700 1 -- 172.21.15.32:0/21276881 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab3c011990 con 0x7fab4815a2b0 2023-10-08T06:09:43.636 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.620+0000 7fab46ffd700 1 -- 172.21.15.32:0/21276881 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab3c011d20 con 0x7fab4815a2b0 2023-10-08T06:09:43.637 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.620+0000 7fe9d88da700 1 --2- 172.21.15.32:0/478992549 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe9d40b8b20 0x7fe9d40cdef0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fe9c4009910 tx=0x7fe9c4009c20 comp rx=0 tx=0).stop 2023-10-08T06:09:43.637 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.620+0000 7fe9d88da700 1 -- 172.21.15.32:0/478992549 shutdown_connections 2023-10-08T06:09:43.637 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.620+0000 7fe9d88da700 1 --2- 172.21.15.32:0/478992549 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe9d40b8b20 0x7fe9d40cdef0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:43.637 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.620+0000 7fe9d88da700 1 --2- 172.21.15.32:0/478992549 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe9d415d4b0 0x7fe9d4161110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:43.637 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.620+0000 7fe9d88da700 1 -- 172.21.15.32:0/478992549 >> 172.21.15.32:0/478992549 conn(0x7fe9d406ac60 msgr2=0x7fe9d406b070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:09:43.637 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.620+0000 7f764519e700 1 --2- 172.21.15.32:0/1828160077 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f76400703c0 0x7f76401581e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f76400b1800 tx=0x7f763c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:43.638 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.620+0000 7f3f41aae700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3f3c153490 0x7f3f3c153870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:43.638 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.620+0000 7f3f41aae700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f3f3c15a180 0x7f3f3c0c9420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:43.638 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.620+0000 7f3f41aae700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3f3c15a5e0 0x7f3f3c0c9960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:43.638 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.620+0000 7f3f41aae700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f3c06cd10 con 0x7f3f3c15a180 2023-10-08T06:09:43.638 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.620+0000 7f3f41aae700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f3c153db0 con 0x7f3f3c15a5e0 2023-10-08T06:09:43.638 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.620+0000 7f3f41aae700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f3c06c090 con 0x7f3f3c153490 2023-10-08T06:09:43.639 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.620+0000 7f104d1bd700 1 --2- 172.21.15.32:0/2251986762 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f104815a2b0 0x7f10480ca9b0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f10480ae820 tx=0x7f103800be90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c20b610de9fb26b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:43.639 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.620+0000 7f7635ffb700 1 -- 172.21.15.32:0/1828160077 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f763c00be60 con 0x7f76400703c0 2023-10-08T06:09:43.639 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.620+0000 7f458195d700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f457c0c21a0 0x7f457c06c690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:43.639 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.620+0000 7f458195d700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f457c06c200 con 0x7f457c1652b0 2023-10-08T06:09:43.639 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.620+0000 7f458195d700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f457c165d00 con 0x7f457c0cbef0 2023-10-08T06:09:43.639 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.620+0000 7f458195d700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f457c1662c0 con 0x7f457c0c21a0 2023-10-08T06:09:43.640 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.620+0000 7f7635ffb700 1 -- 172.21.15.32:0/1828160077 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f763c01e070 con 0x7f76400703c0 2023-10-08T06:09:43.640 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.620+0000 7f7635ffb700 1 -- 172.21.15.32:0/1828160077 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f763c003900 con 0x7f76400703c0 2023-10-08T06:09:43.640 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.620+0000 7f457bfff700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f457c1652b0 0x7f457c0cb7e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:46188/0 (socket says 172.21.15.32:46188) 2023-10-08T06:09:43.641 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.620+0000 7fab4ea02700 1 -- 172.21.15.32:0/21276881 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fab4815a2b0 msgr2=0x7fab480c98c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:43.641 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.620+0000 7fab4ea02700 1 --2- 172.21.15.32:0/21276881 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fab4815a2b0 0x7fab480c98c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fab480685d0 tx=0x7fab3c009bf0 comp rx=0 tx=0).stop 2023-10-08T06:09:43.641 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.620+0000 7f457bfff700 1 -- 172.21.15.32:0/4269725644 learned_addr learned my addr 172.21.15.32:0/4269725644 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-08T06:09:43.641 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.620+0000 7f104c9bc700 1 -- 172.21.15.32:0/2251986762 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f103800dd30 con 0x7f104815a2b0 2023-10-08T06:09:43.642 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.620+0000 7f3f3bfff700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f3f3c15a180 0x7f3f3c0c9420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:43.642 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.620+0000 7f458095b700 1 --2- 172.21.15.32:0/4269725644 >> v2:172.21.15.32:3300/0 conn(0x7f457c0c21a0 0x7f457c06c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:43.642 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.620+0000 7f104c9bc700 1 -- 172.21.15.32:0/2251986762 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f103800de90 con 0x7f104815a2b0 2023-10-08T06:09:43.642 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.620+0000 7f104c9bc700 1 -- 172.21.15.32:0/2251986762 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1038010690 con 0x7f104815a2b0 2023-10-08T06:09:43.643 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.620+0000 7f3f3bfff700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f3f3c15a180 0x7f3f3c0c9420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:59442/0 (socket says 172.21.15.32:59442) 2023-10-08T06:09:43.643 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.620+0000 7f3f3bfff700 1 -- 172.21.15.32:0/1485149848 learned_addr learned my addr 172.21.15.32:0/1485149848 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:09:43.643 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.620+0000 7f3f412ad700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3f3c15a5e0 0x7f3f3c0c9960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:43.643 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.620+0000 7fe9d88da700 1 -- 172.21.15.32:0/478992549 shutdown_connections 2023-10-08T06:09:43.644 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.620+0000 7f3f40aac700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3f3c153490 0x7f3f3c153870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:43.644 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.620+0000 7f3f3bfff700 1 -- 172.21.15.32:0/1485149848 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3f3c153490 msgr2=0x7f3f3c153870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:09:43.644 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.620+0000 7f3f3bfff700 1 --2- 172.21.15.32:0/1485149848 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3f3c153490 0x7f3f3c153870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:43.644 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.620+0000 7f458095b700 1 -- 172.21.15.32:0/4269725644 >> v1:172.21.15.40:6789/0 conn(0x7f457c0cbef0 legacy=0x7f457c0cc9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:43.644 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.620+0000 7f458095b700 1 -- 172.21.15.32:0/4269725644 >> v1:172.21.15.32:6789/0 conn(0x7f457c1652b0 legacy=0x7f457c0cb7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:43.644 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.620+0000 7f458095b700 1 -- 172.21.15.32:0/4269725644 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f457c165fe0 con 0x7f457c0c21a0 2023-10-08T06:09:43.645 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.620+0000 7f3f3bfff700 1 -- 172.21.15.32:0/1485149848 >> v2:172.21.15.40:3300/0 conn(0x7f3f3c15a5e0 msgr2=0x7f3f3c0c9960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:09:43.645 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.620+0000 7f3f3bfff700 1 --2- 172.21.15.32:0/1485149848 >> v2:172.21.15.40:3300/0 conn(0x7f3f3c15a5e0 0x7f3f3c0c9960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:43.645 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.620+0000 7f3f3bfff700 1 -- 172.21.15.32:0/1485149848 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f3c06c370 con 0x7f3f3c15a180 2023-10-08T06:09:43.645 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.620+0000 7f3f40aac700 1 --2- 172.21.15.32:0/1485149848 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3f3c153490 0x7f3f3c153870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T06:09:43.645 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.620+0000 7f458095b700 1 --2- 172.21.15.32:0/4269725644 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f457c0c21a0 0x7f457c06c690 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f456c009880 tx=0x7f456c009b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3eb038324bdc232 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:43.646 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.620+0000 7f76461a0700 1 -- 172.21.15.32:0/1828160077 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f764015aa80 con 0x7f76400703c0 2023-10-08T06:09:43.646 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.620+0000 7f76461a0700 1 -- 172.21.15.32:0/1828160077 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f764015b040 con 0x7f76400703c0 2023-10-08T06:09:43.646 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.620+0000 7fe9d88da700 1 -- 172.21.15.32:0/478992549 wait complete. 2023-10-08T06:09:43.646 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.620+0000 7f3f3bfff700 1 --2- 172.21.15.32:0/1485149848 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3f3c15a180 0x7f3f3c0c9420 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f3f3c0cec90 tx=0x7f3f3000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d06277e89fd857d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:43.647 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.620+0000 7f104fc22700 1 -- 172.21.15.32:0/2251986762 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f104815a2b0 msgr2=0x7f10480ca9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:43.647 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.620+0000 7f104fc22700 1 --2- 172.21.15.32:0/2251986762 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f104815a2b0 0x7f10480ca9b0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f10480ae820 tx=0x7f103800be90 comp rx=0 tx=0).stop 2023-10-08T06:09:43.647 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.624+0000 7f1b7a406700 1 Processor -- start 2023-10-08T06:09:43.647 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.624+0000 7f1b7a406700 1 -- start start 2023-10-08T06:09:43.648 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.624+0000 7f104fc22700 1 -- 172.21.15.32:0/2251986762 shutdown_connections 2023-10-08T06:09:43.648 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.624+0000 7f104fc22700 1 --2- 172.21.15.32:0/2251986762 >> v2:172.21.15.40:3300/0 conn(0x7f10480c98c0 0x7f10480cb510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:43.648 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.624+0000 7f104fc22700 1 --2- 172.21.15.32:0/2251986762 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f104815a2b0 0x7f10480ca9b0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:43.648 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.624+0000 7f104fc22700 1 -- 172.21.15.32:0/2251986762 >> 172.21.15.32:0/2251986762 conn(0x7f10480b0900 msgr2=0x7f10480b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:09:43.648 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.624+0000 7fe9d88da700 1 Processor -- start 2023-10-08T06:09:43.649 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.624+0000 7f457b7fe700 1 -- 172.21.15.32:0/4269725644 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f456c011830 con 0x7f457c0c21a0 2023-10-08T06:09:43.649 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.624+0000 7f457b7fe700 1 -- 172.21.15.32:0/4269725644 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f456c011990 con 0x7f457c0c21a0 2023-10-08T06:09:43.649 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.624+0000 7f457b7fe700 1 -- 172.21.15.32:0/4269725644 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f456c011d00 con 0x7f457c0c21a0 2023-10-08T06:09:43.649 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.624+0000 7f76461a0700 1 -- 172.21.15.32:0/1828160077 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f764015b560 con 0x7f76400703c0 2023-10-08T06:09:43.650 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.624+0000 7f3f3b7fe700 1 -- 172.21.15.32:0/1485149848 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f3000e070 con 0x7f3f3c15a180 2023-10-08T06:09:43.650 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.624+0000 7f3f3b7fe700 1 -- 172.21.15.32:0/1485149848 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f3000b910 con 0x7f3f3c15a180 2023-10-08T06:09:43.650 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.624+0000 7fe9d88da700 1 -- start start 2023-10-08T06:09:43.650 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.624+0000 7f3f3b7fe700 1 -- 172.21.15.32:0/1485149848 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f3000bcc0 con 0x7f3f3c15a180 2023-10-08T06:09:43.651 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.624+0000 7f104fc22700 1 -- 172.21.15.32:0/2251986762 shutdown_connections 2023-10-08T06:09:43.651 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.624+0000 7f104fc22700 1 -- 172.21.15.32:0/2251986762 wait complete. 2023-10-08T06:09:43.651 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.624+0000 7f3f41aae700 1 -- 172.21.15.32:0/1485149848 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3f3c15a180 msgr2=0x7f3f3c0c9420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:43.651 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.624+0000 7f3f41aae700 1 --2- 172.21.15.32:0/1485149848 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3f3c15a180 0x7f3f3c0c9420 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f3f3c0cec90 tx=0x7f3f3000b330 comp rx=0 tx=0).stop 2023-10-08T06:09:43.651 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.624+0000 7f1b7a406700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f1b740ce910 0x7f1b74070390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:43.651 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.624+0000 7f1b7a406700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b74070c20 con 0x7f1b740c9e00 2023-10-08T06:09:43.652 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.624+0000 7f1b7a406700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b74071390 con 0x7f1b7415d4e0 2023-10-08T06:09:43.652 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.624+0000 7f1b7a406700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b7415e340 con 0x7f1b740ce910 2023-10-08T06:09:43.652 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.624+0000 7f1b737fe700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f1b740ce910 0x7f1b74070390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:43.652 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.624+0000 7f1b789a3700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f1b740c9e00 0x7f1b740ca290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:46194/0 (socket says 172.21.15.32:46194) 2023-10-08T06:09:43.652 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.624+0000 7fab4ea02700 1 -- 172.21.15.32:0/21276881 shutdown_connections 2023-10-08T06:09:43.652 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.624+0000 7fab4ea02700 1 --2- 172.21.15.32:0/21276881 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fab4815a2b0 0x7fab480c98c0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:43.652 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.624+0000 7fab4ea02700 1 --2- 172.21.15.32:0/21276881 >> v2:172.21.15.40:3300/0 conn(0x7fab48159ed0 0x7fab480ca9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:43.652 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.624+0000 7fab4ea02700 1 -- 172.21.15.32:0/21276881 >> 172.21.15.32:0/21276881 conn(0x7fab480b0900 msgr2=0x7fab480b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:09:43.653 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.624+0000 7f458195d700 1 -- 172.21.15.32:0/4269725644 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f457c0c21a0 msgr2=0x7f457c06c690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:43.653 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.624+0000 7f458195d700 1 --2- 172.21.15.32:0/4269725644 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f457c0c21a0 0x7f457c06c690 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f456c009880 tx=0x7f456c009b90 comp rx=0 tx=0).stop 2023-10-08T06:09:43.653 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.624+0000 7f1b789a3700 1 -- 172.21.15.32:0/3746447408 learned_addr learned my addr 172.21.15.32:0/3746447408 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-08T06:09:43.653 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.624+0000 7f1b72ffd700 1 -- 172.21.15.32:0/3746447408 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1864166603 0 0) 0x7f1b74070c20 con 0x7f1b740c9e00 2023-10-08T06:09:43.653 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.624+0000 7f1b72ffd700 1 -- 172.21.15.32:0/3746447408 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1b5c0035d0 con 0x7f1b740c9e00 2023-10-08T06:09:43.653 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.624+0000 7f1b737fe700 1 -- 172.21.15.32:0/3746447408 >> v1:172.21.15.40:6789/0 conn(0x7f1b7415d4e0 legacy=0x7f1b7415d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:43.653 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.624+0000 7f1b737fe700 1 -- 172.21.15.32:0/3746447408 >> v1:172.21.15.32:6789/0 conn(0x7f1b740c9e00 legacy=0x7f1b740ca290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:43.654 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.624+0000 7f1b737fe700 1 -- 172.21.15.32:0/3746447408 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b7406fcc0 con 0x7f1b740ce910 2023-10-08T06:09:43.654 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.624+0000 7f7635ffb700 1 -- 172.21.15.32:0/1828160077 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f763c020030 con 0x7f76400703c0 2023-10-08T06:09:43.654 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.624+0000 7fab4ea02700 1 -- 172.21.15.32:0/21276881 shutdown_connections 2023-10-08T06:09:43.654 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.624+0000 7fab4ea02700 1 -- 172.21.15.32:0/21276881 wait complete. 2023-10-08T06:09:43.655 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.624+0000 7f7635ffb700 1 --2- 172.21.15.32:0/1828160077 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f7624066510 0x7f76240689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:43.655 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.624+0000 7f7635ffb700 1 -- 172.21.15.32:0/1828160077 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f763c085000 con 0x7f76400703c0 2023-10-08T06:09:43.655 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.624+0000 7f764499d700 1 --2- 172.21.15.32:0/1828160077 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f7624066510 0x7f76240689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:43.655 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.624+0000 7fe9d88da700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe9d40b8b20 0x7fe9d40c86c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:43.655 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.624+0000 7fe9d88da700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe9d40ce430 0x7fe9d4151410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:43.655 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.624+0000 7fe9d88da700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe9d415d4b0 0x7fe9d4151950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:43.656 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.624+0000 7fe9d88da700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9d41f8100 con 0x7fe9d40b8b20 2023-10-08T06:09:43.656 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.624+0000 7fe9d88da700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9d41f77d0 con 0x7fe9d40ce430 2023-10-08T06:09:43.656 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.624+0000 7fe9d88da700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9d41f7ab0 con 0x7fe9d415d4b0 2023-10-08T06:09:43.656 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.624+0000 7fe9d37fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe9d40b8b20 0x7fe9d40c86c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:43.656 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.624+0000 7fe9d37fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe9d40b8b20 0x7fe9d40c86c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:59472/0 (socket says 172.21.15.32:59472) 2023-10-08T06:09:43.656 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.624+0000 7fe9d37fe700 1 -- 172.21.15.32:0/1728626842 learned_addr learned my addr 172.21.15.32:0/1728626842 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:09:43.656 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.624+0000 7fe9d2ffd700 1 --2- 172.21.15.32:0/1728626842 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe9d40ce430 0x7fe9d4151410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:43.656 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.624+0000 7fe9d3fff700 1 --2- 172.21.15.32:0/1728626842 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe9d415d4b0 0x7fe9d4151950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:43.656 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.624+0000 7fe9d37fe700 1 -- 172.21.15.32:0/1728626842 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe9d415d4b0 msgr2=0x7fe9d4151950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:43.656 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.624+0000 7fe9d37fe700 1 --2- 172.21.15.32:0/1728626842 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe9d415d4b0 0x7fe9d4151950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:43.656 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.624+0000 7fe9d37fe700 1 -- 172.21.15.32:0/1728626842 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe9d40ce430 msgr2=0x7fe9d4151410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:43.656 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.624+0000 7fe9d37fe700 1 --2- 172.21.15.32:0/1728626842 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe9d40ce430 0x7fe9d4151410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:43.657 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.624+0000 7fe9d37fe700 1 -- 172.21.15.32:0/1728626842 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9c4009570 con 0x7fe9d40b8b20 2023-10-08T06:09:43.657 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.624+0000 7fe9d2ffd700 1 --2- 172.21.15.32:0/1728626842 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe9d40ce430 0x7fe9d4151410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T06:09:43.657 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.624+0000 7f458195d700 1 -- 172.21.15.32:0/4269725644 shutdown_connections 2023-10-08T06:09:43.657 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.624+0000 7f458195d700 1 --2- 172.21.15.32:0/4269725644 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f457c0c21a0 0x7f457c06c690 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:43.657 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.624+0000 7f458195d700 1 -- 172.21.15.32:0/4269725644 >> 172.21.15.32:0/4269725644 conn(0x7f457c0b0900 msgr2=0x7f457c0b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:09:43.657 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.624+0000 7fe9d37fe700 1 --2- 172.21.15.32:0/1728626842 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe9d40b8b20 0x7fe9d40c86c0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fe9cc00efc0 tx=0x7fe9cc00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:43.658 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.624+0000 7f458195d700 1 -- 172.21.15.32:0/4269725644 shutdown_connections 2023-10-08T06:09:43.658 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.624+0000 7f458195d700 1 -- 172.21.15.32:0/4269725644 wait complete. 2023-10-08T06:09:43.658 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.624+0000 7f764499d700 1 --2- 172.21.15.32:0/1828160077 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f7624066510 0x7f76240689d0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f76400707c0 tx=0x7f7630008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:43.658 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.624+0000 7f1b737fe700 1 --2- 172.21.15.32:0/3746447408 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1b740ce910 0x7f1b74070390 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f1b68009850 tx=0x7f1b68009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a281e0056f4b331 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:43.659 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.628+0000 7f3f41aae700 1 -- 172.21.15.32:0/1485149848 shutdown_connections 2023-10-08T06:09:43.659 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.628+0000 7f3f41aae700 1 --2- 172.21.15.32:0/1485149848 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3f3c15a180 0x7f3f3c0c9420 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:43.659 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.628+0000 7f3f41aae700 1 --2- 172.21.15.32:0/1485149848 >> v2:172.21.15.40:3300/0 conn(0x7f3f3c15a5e0 0x7f3f3c0c9960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:43.659 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.628+0000 7f3f41aae700 1 --2- 172.21.15.32:0/1485149848 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3f3c153490 0x7f3f3c153870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:43.659 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.628+0000 7f3f41aae700 1 -- 172.21.15.32:0/1485149848 >> 172.21.15.32:0/1485149848 conn(0x7f3f3c0b0900 msgr2=0x7f3f3c0b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:09:43.659 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.628+0000 7fab4ea02700 1 Processor -- start 2023-10-08T06:09:43.660 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.628+0000 7fab4ea02700 1 -- start start 2023-10-08T06:09:43.660 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.628+0000 7f104fc22700 1 Processor -- start 2023-10-08T06:09:43.660 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.628+0000 7f3f41aae700 1 -- 172.21.15.32:0/1485149848 shutdown_connections 2023-10-08T06:09:43.660 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.628+0000 7f3f41aae700 1 -- 172.21.15.32:0/1485149848 wait complete. 2023-10-08T06:09:43.661 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.628+0000 7f104fc22700 1 -- start start 2023-10-08T06:09:43.661 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.628+0000 7f458195d700 1 Processor -- start 2023-10-08T06:09:43.661 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.628+0000 7f458195d700 1 -- start start 2023-10-08T06:09:43.662 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.628+0000 7f104fc22700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f10480c98c0 0x7f1048151290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:43.662 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.628+0000 7f104fc22700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1048159ed0 0x7f10480b3110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:43.662 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.628+0000 7f104fc22700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f104815a2b0 0x7f10480b3650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:43.662 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.628+0000 7f104fc22700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10480c3e00 con 0x7f10480c98c0 2023-10-08T06:09:43.663 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.628+0000 7f104fc22700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10480c4690 con 0x7f1048159ed0 2023-10-08T06:09:43.663 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.628+0000 7f104fc22700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10481517d0 con 0x7f104815a2b0 2023-10-08T06:09:43.663 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.628+0000 7f104d9be700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f10480c98c0 0x7f1048151290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:43.663 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.628+0000 7f104d9be700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f10480c98c0 0x7f1048151290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:59490/0 (socket says 172.21.15.32:59490) 2023-10-08T06:09:43.663 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.628+0000 7f104d9be700 1 -- 172.21.15.32:0/3464199602 learned_addr learned my addr 172.21.15.32:0/3464199602 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:09:43.663 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.628+0000 7f104d1bd700 1 --2- 172.21.15.32:0/3464199602 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1048159ed0 0x7f10480b3110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:43.663 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.628+0000 7fab4ea02700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fab480706f0 0x7fab481f6600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:43.663 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.628+0000 7fab4ea02700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fab48159ed0 0x7fab480c77d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:43.663 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.628+0000 7fab4ea02700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fab4815a2b0 0x7fab480b3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:43.664 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.628+0000 7fab4ea02700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab480c8dd0 con 0x7fab480706f0 2023-10-08T06:09:43.664 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.628+0000 7fab4ea02700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab480c8250 con 0x7fab4815a2b0 2023-10-08T06:09:43.664 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.628+0000 7fab4ea02700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab480c8530 con 0x7fab48159ed0 2023-10-08T06:09:43.664 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.628+0000 7fab47fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fab480706f0 0x7fab481f6600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:43.664 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.628+0000 7fab47fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fab480706f0 0x7fab481f6600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:59480/0 (socket says 172.21.15.32:59480) 2023-10-08T06:09:43.664 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.628+0000 7f3f41aae700 1 Processor -- start 2023-10-08T06:09:43.665 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.628+0000 7fab47fff700 1 -- 172.21.15.32:0/3699819011 learned_addr learned my addr 172.21.15.32:0/3699819011 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:09:43.665 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.628+0000 7fab477fe700 1 --2- 172.21.15.32:0/3699819011 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fab48159ed0 0x7fab480c77d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:43.665 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.628+0000 7fab47fff700 1 -- 172.21.15.32:0/3699819011 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fab48159ed0 msgr2=0x7fab480c77d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:43.665 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.628+0000 7fab47fff700 1 --2- 172.21.15.32:0/3699819011 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fab48159ed0 0x7fab480c77d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:43.665 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.628+0000 7fab47fff700 1 -- 172.21.15.32:0/3699819011 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fab4815a2b0 msgr2=0x7fab480b3aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:43.665 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.628+0000 7fab4cf9f700 1 --2- 172.21.15.32:0/3699819011 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fab4815a2b0 0x7fab480b3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:43.665 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.628+0000 7fab47fff700 1 --2- 172.21.15.32:0/3699819011 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fab4815a2b0 0x7fab480b3aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:43.665 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.628+0000 7fab47fff700 1 -- 172.21.15.32:0/3699819011 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab40009a70 con 0x7fab480706f0 2023-10-08T06:09:43.665 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.628+0000 7fab477fe700 1 --2- 172.21.15.32:0/3699819011 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fab48159ed0 0x7fab480c77d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T06:09:43.665 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.628+0000 7fab4cf9f700 1 --2- 172.21.15.32:0/3699819011 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fab4815a2b0 0x7fab480b3aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T06:09:43.665 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.628+0000 7fab47fff700 1 --2- 172.21.15.32:0/3699819011 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fab480706f0 0x7fab481f6600 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fab4000efc0 tx=0x7fab4000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:43.666 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.628+0000 7f104d9be700 1 -- 172.21.15.32:0/3464199602 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f104815a2b0 msgr2=0x7f10480b3650 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T06:09:43.666 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.628+0000 7f104d9be700 1 --2- 172.21.15.32:0/3464199602 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f104815a2b0 0x7f10480b3650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:43.666 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.628+0000 7f104d9be700 1 -- 172.21.15.32:0/3464199602 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1048159ed0 msgr2=0x7f10480b3110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:43.666 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.628+0000 7f104d9be700 1 --2- 172.21.15.32:0/3464199602 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1048159ed0 0x7f10480b3110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:43.666 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.628+0000 7f104d9be700 1 -- 172.21.15.32:0/3464199602 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f103800b810 con 0x7f10480c98c0 2023-10-08T06:09:43.666 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.628+0000 7f104d1bd700 1 --2- 172.21.15.32:0/3464199602 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1048159ed0 0x7f10480b3110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T06:09:43.667 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.628+0000 7f3f41aae700 1 -- start start 2023-10-08T06:09:43.667 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.628+0000 7f458195d700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f457c0c21a0 0x7f457c0c57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:43.667 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.628+0000 7f458195d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f457c0cbef0 0x7f457c1520e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:43.667 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.628+0000 7f458195d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f457c1652b0 0x7f457c0c3d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:43.667 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.628+0000 7f458195d700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f457c0c4720 con 0x7f457c0c21a0 2023-10-08T06:09:43.667 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.628+0000 7f458195d700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f457c0c4a00 con 0x7f457c1652b0 2023-10-08T06:09:43.667 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.628+0000 7f458195d700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f457c0c4ce0 con 0x7f457c0cbef0 2023-10-08T06:09:43.667 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.628+0000 7f458095b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f457c0c21a0 0x7f457c0c57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:43.667 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.628+0000 7f458095b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f457c0c21a0 0x7f457c0c57c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:59498/0 (socket says 172.21.15.32:59498) 2023-10-08T06:09:43.668 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.628+0000 7f458095b700 1 -- 172.21.15.32:0/3499922646 learned_addr learned my addr 172.21.15.32:0/3499922646 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:09:43.668 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.628+0000 7f104d9be700 1 --2- 172.21.15.32:0/3464199602 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f10480c98c0 0x7f1048151290 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f1040001f00 tx=0x7f104000a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:43.668 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.628+0000 7f457bfff700 1 --2- 172.21.15.32:0/3499922646 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f457c0cbef0 0x7f457c1520e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:43.668 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.628+0000 7f458115c700 1 --2- 172.21.15.32:0/3499922646 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f457c1652b0 0x7f457c0c3d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:43.669 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.628+0000 7f458095b700 1 -- 172.21.15.32:0/3499922646 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f457c0cbef0 msgr2=0x7f457c1520e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:43.669 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.628+0000 7f458095b700 1 --2- 172.21.15.32:0/3499922646 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f457c0cbef0 0x7f457c1520e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:43.669 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.628+0000 7f458095b700 1 -- 172.21.15.32:0/3499922646 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f457c1652b0 msgr2=0x7f457c0c3d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:43.669 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.628+0000 7f458095b700 1 --2- 172.21.15.32:0/3499922646 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f457c1652b0 0x7f457c0c3d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:43.669 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.628+0000 7f458095b700 1 -- 172.21.15.32:0/3499922646 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f456c0094b0 con 0x7f457c0c21a0 2023-10-08T06:09:43.669 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.628+0000 7f458095b700 1 --2- 172.21.15.32:0/3499922646 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f457c0c21a0 0x7f457c0c57c0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f456c0090b0 tx=0x7f456c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:43.670 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.628+0000 7f3f41aae700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3f3c153490 0x7f3f3c1508f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:43.670 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.628+0000 7f3f41aae700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3f3c15a180 0x7f3f3c150e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:43.671 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.628+0000 7f3f41aae700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3f3c15a5e0 0x7f3f3c0c7560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:43.671 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.628+0000 7f3f41aae700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f3c14ced0 con 0x7f3f3c15a5e0 2023-10-08T06:09:43.671 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.628+0000 7f3f41aae700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f3c0c1a60 con 0x7f3f3c15a180 2023-10-08T06:09:43.671 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.628+0000 7f3f41aae700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f3c0c1cb0 con 0x7f3f3c153490 2023-10-08T06:09:43.671 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.628+0000 7f3f412ad700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3f3c15a5e0 0x7f3f3c0c7560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:43.671 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.628+0000 7f3f412ad700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3f3c15a5e0 0x7f3f3c0c7560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:59502/0 (socket says 172.21.15.32:59502) 2023-10-08T06:09:43.671 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.628+0000 7f3f412ad700 1 -- 172.21.15.32:0/4068910248 learned_addr learned my addr 172.21.15.32:0/4068910248 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:09:43.671 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.628+0000 7f3f40aac700 1 --2- 172.21.15.32:0/4068910248 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3f3c153490 0x7f3f3c1508f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:43.671 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.628+0000 7f3f3bfff700 1 --2- 172.21.15.32:0/4068910248 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3f3c15a180 0x7f3f3c150e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:43.671 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.632+0000 7f3f412ad700 1 -- 172.21.15.32:0/4068910248 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3f3c153490 msgr2=0x7f3f3c1508f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:43.671 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.632+0000 7f3f412ad700 1 --2- 172.21.15.32:0/4068910248 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3f3c153490 0x7f3f3c1508f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:43.672 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.632+0000 7f3f412ad700 1 -- 172.21.15.32:0/4068910248 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3f3c15a180 msgr2=0x7f3f3c150e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:43.672 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.632+0000 7f3f412ad700 1 --2- 172.21.15.32:0/4068910248 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3f3c15a180 0x7f3f3c150e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:43.672 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.632+0000 7f3f412ad700 1 -- 172.21.15.32:0/4068910248 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f30009b30 con 0x7f3f3c15a5e0 2023-10-08T06:09:43.672 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.632+0000 7f3f412ad700 1 --2- 172.21.15.32:0/4068910248 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3f3c15a5e0 0x7f3f3c0c7560 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f3f3400e7f0 tx=0x7f3f3400ebb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:43.672 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.632+0000 7fe280efd700 1 Processor -- start 2023-10-08T06:09:43.672 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.632+0000 7fe280efd700 1 -- start start 2023-10-08T06:09:43.673 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.632+0000 7f1b72ffd700 1 -- 172.21.15.32:0/3746447408 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b68011830 con 0x7f1b740ce910 2023-10-08T06:09:43.673 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.632+0000 7fab44ff9700 1 -- 172.21.15.32:0/3699819011 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab4000cee0 con 0x7fab480706f0 2023-10-08T06:09:43.673 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.632+0000 7f10467fc700 1 -- 172.21.15.32:0/3464199602 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1040002100 con 0x7f10480c98c0 2023-10-08T06:09:43.673 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.632+0000 7fe9bbfff700 1 -- 172.21.15.32:0/1728626842 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9cc009b80 con 0x7fe9d40b8b20 2023-10-08T06:09:43.674 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.632+0000 7f1b72ffd700 1 -- 172.21.15.32:0/3746447408 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b68011990 con 0x7f1b740ce910 2023-10-08T06:09:43.674 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.632+0000 7f1b72ffd700 1 -- 172.21.15.32:0/3746447408 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b68011d00 con 0x7f1b740ce910 2023-10-08T06:09:43.674 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.632+0000 7fe9bbfff700 1 -- 172.21.15.32:0/1728626842 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9cc00f040 con 0x7fe9d40b8b20 2023-10-08T06:09:43.674 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.632+0000 7fab4ea02700 1 -- 172.21.15.32:0/3699819011 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab3c009570 con 0x7fab480706f0 2023-10-08T06:09:43.674 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.632+0000 7fab4ea02700 1 -- 172.21.15.32:0/3699819011 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab480c8af0 con 0x7fab480706f0 2023-10-08T06:09:43.675 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.632+0000 7f7635ffb700 1 -- 172.21.15.32:0/1828160077 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f763c0b6090 con 0x7f76400703c0 2023-10-08T06:09:43.675 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.632+0000 7fe9d88da700 1 -- 172.21.15.32:0/1728626842 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9d41f7d90 con 0x7fe9d40b8b20 2023-10-08T06:09:43.675 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.632+0000 7fe9d88da700 1 -- 172.21.15.32:0/1728626842 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9d40cb7e0 con 0x7fe9d40b8b20 2023-10-08T06:09:43.676 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.632+0000 7f3f397fa700 1 -- 172.21.15.32:0/4068910248 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f340095c0 con 0x7f3f3c15a5e0 2023-10-08T06:09:43.676 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.632+0000 7f3f41aae700 1 -- 172.21.15.32:0/4068910248 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f3c0c8710 con 0x7f3f3c15a5e0 2023-10-08T06:09:43.676 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.632+0000 7f3f41aae700 1 -- 172.21.15.32:0/4068910248 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f3c0c8cd0 con 0x7f3f3c15a5e0 2023-10-08T06:09:43.676 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.632+0000 7fe9bbfff700 1 -- 172.21.15.32:0/1728626842 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9cc014480 con 0x7fe9d40b8b20 2023-10-08T06:09:43.677 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.632+0000 7f10467fc700 1 -- 172.21.15.32:0/3464199602 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f104000ada0 con 0x7f10480c98c0 2023-10-08T06:09:43.677 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.632+0000 7f10467fc700 1 -- 172.21.15.32:0/3464199602 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1040003c60 con 0x7f10480c98c0 2023-10-08T06:09:43.677 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.632+0000 7fab44ff9700 1 -- 172.21.15.32:0/3699819011 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab4000f040 con 0x7fab480706f0 2023-10-08T06:09:43.677 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.632+0000 7fab44ff9700 1 -- 172.21.15.32:0/3699819011 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab40014680 con 0x7fab480706f0 2023-10-08T06:09:43.677 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.632+0000 7f3f397fa700 1 -- 172.21.15.32:0/4068910248 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f34005a40 con 0x7f3f3c15a5e0 2023-10-08T06:09:43.678 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.632+0000 7fe280efd700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fe27c0cc370 0x7fe27c15dc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:43.678 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.632+0000 7fe280efd700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe27c0cc750 con 0x7fe27c15a0f0 2023-10-08T06:09:43.678 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.632+0000 7fe280efd700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe27c15a830 con 0x7fe27c15ad10 2023-10-08T06:09:43.678 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.632+0000 7fe280efd700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe27c15ebc0 con 0x7fe27c0cc370 2023-10-08T06:09:43.678 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.632+0000 7f45797fa700 1 -- 172.21.15.32:0/3499922646 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f456c004230 con 0x7f457c0c21a0 2023-10-08T06:09:43.678 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.632+0000 7f458195d700 1 -- 172.21.15.32:0/3499922646 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f457c0c4fc0 con 0x7f457c0c21a0 2023-10-08T06:09:43.679 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.632+0000 7f458195d700 1 -- 172.21.15.32:0/3499922646 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f457c152800 con 0x7f457c0c21a0 2023-10-08T06:09:43.679 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.632+0000 7f45797fa700 1 -- 172.21.15.32:0/3499922646 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f456c0043b0 con 0x7f457c0c21a0 2023-10-08T06:09:43.679 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.632+0000 7f1b7a406700 1 -- 172.21.15.32:0/3746447408 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1b740ce910 msgr2=0x7f1b74070390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:43.679 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.632+0000 7f1b7a406700 1 --2- 172.21.15.32:0/3746447408 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1b740ce910 0x7f1b74070390 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f1b68009850 tx=0x7f1b68009b60 comp rx=0 tx=0).stop 2023-10-08T06:09:43.679 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.632+0000 7f1b7a406700 1 -- 172.21.15.32:0/3746447408 shutdown_connections 2023-10-08T06:09:43.679 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.632+0000 7f1b7a406700 1 --2- 172.21.15.32:0/3746447408 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1b740ce910 0x7f1b74070390 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:43.679 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.632+0000 7f1b7a406700 1 -- 172.21.15.32:0/3746447408 >> 172.21.15.32:0/3746447408 conn(0x7f1b740cb850 msgr2=0x7f1b740cbc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:09:43.679 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.632+0000 7f1b7a406700 1 -- 172.21.15.32:0/3746447408 shutdown_connections 2023-10-08T06:09:43.680 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.632+0000 7f3f397fa700 1 -- 172.21.15.32:0/4068910248 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f34005db0 con 0x7f3f3c15a5e0 2023-10-08T06:09:43.680 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.632+0000 7f3f397fa700 1 -- 172.21.15.32:0/4068910248 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f3f34013680 con 0x7f3f3c15a5e0 2023-10-08T06:09:43.680 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.632+0000 7fe27b7fe700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fe27c0cc370 0x7fe27c15dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:43.680 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.632+0000 7fe27b7fe700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fe27c0cc370 0x7fe27c15dc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:59508/0 (socket says 172.21.15.32:59508) 2023-10-08T06:09:43.681 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.632+0000 7fe27b7fe700 1 -- 172.21.15.32:0/4018909043 learned_addr learned my addr 172.21.15.32:0/4018909043 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:09:43.681 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.632+0000 7f3f397fa700 1 --2- 172.21.15.32:0/4068910248 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f3f20066510 0x7f3f200689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:43.681 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.636+0000 7f3f40aac700 1 --2- 172.21.15.32:0/4068910248 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f3f20066510 0x7f3f200689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:43.681 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.632+0000 7fe27b7fe700 1 -- 172.21.15.32:0/4018909043 >> v1:172.21.15.40:6789/0 conn(0x7fe27c15ad10 legacy=0x7fe27c0c9420 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-08T06:09:43.681 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.632+0000 7fe27b7fe700 1 -- 172.21.15.32:0/4018909043 >> v1:172.21.15.32:6789/0 conn(0x7fe27c15a0f0 legacy=0x7fe27c0cd9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:09:43.682 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.632+0000 7fe27b7fe700 1 -- 172.21.15.32:0/4018909043 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe27c15e320 con 0x7fe27c0cc370 2023-10-08T06:09:43.682 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.632+0000 7f104fc22700 1 -- 172.21.15.32:0/3464199602 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10480c3180 con 0x7f10480c98c0 2023-10-08T06:09:43.682 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.632+0000 7f104fc22700 1 -- 172.21.15.32:0/3464199602 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10480c3740 con 0x7f10480c98c0 2023-10-08T06:09:43.682 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.636+0000 7f3f397fa700 1 -- 172.21.15.32:0/4068910248 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3f34083fb0 con 0x7f3f3c15a5e0 2023-10-08T06:09:43.683 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.636+0000 7f1b7a406700 1 -- 172.21.15.32:0/3746447408 wait complete. 2023-10-08T06:09:43.683 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.636+0000 7fab44ff9700 1 -- 172.21.15.32:0/3699819011 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fab400147e0 con 0x7fab480706f0 2023-10-08T06:09:43.683 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.636+0000 7fab44ff9700 1 --2- 172.21.15.32:0/3699819011 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fab2c066510 0x7fab2c0689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:43.683 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.636+0000 7fab44ff9700 1 -- 172.21.15.32:0/3699819011 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fab40084b60 con 0x7fab480706f0 2023-10-08T06:09:43.683 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.636+0000 7fab477fe700 1 --2- 172.21.15.32:0/3699819011 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fab2c066510 0x7fab2c0689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:43.684 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.636+0000 7f104fc22700 1 -- 172.21.15.32:0/3464199602 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1048073f00 con 0x7f10480c98c0 2023-10-08T06:09:43.684 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.636+0000 7f1b7a406700 1 Processor -- start 2023-10-08T06:09:43.684 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.636+0000 7fe9bbfff700 1 -- 172.21.15.32:0/1728626842 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fe9cc0145e0 con 0x7fe9d40b8b20 2023-10-08T06:09:43.685 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.636+0000 7f3f40aac700 1 --2- 172.21.15.32:0/4068910248 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f3f20066510 0x7f3f200689d0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f3f2800aa30 tx=0x7f3f28008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:43.685 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.636+0000 7f3f41aae700 1 -- 172.21.15.32:0/4068910248 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f1c005310 con 0x7f3f3c15a5e0 2023-10-08T06:09:43.685 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.636+0000 7fe27b7fe700 1 --2- 172.21.15.32:0/4018909043 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe27c0cc370 0x7fe27c15dc10 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fe26c00f9b0 tx=0x7fe26c00fcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dec4ac5f0912271a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:43.685 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.636+0000 7f45797fa700 1 -- 172.21.15.32:0/3499922646 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f456c0036c0 con 0x7f457c0c21a0 2023-10-08T06:09:43.685 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.636+0000 7f458195d700 1 -- 172.21.15.32:0/3499922646 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f455c005310 con 0x7f457c0c21a0 2023-10-08T06:09:43.686 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.636+0000 7fe9bbfff700 1 --2- 172.21.15.32:0/1728626842 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fe9c0066510 0x7fe9c00689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:43.686 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.636+0000 7fab477fe700 1 --2- 172.21.15.32:0/3699819011 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fab2c066510 0x7fab2c0689d0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fab3c000c00 tx=0x7fab3c008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:43.686 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.636+0000 7f45797fa700 1 -- 172.21.15.32:0/3499922646 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f456c022070 con 0x7f457c0c21a0 2023-10-08T06:09:43.687 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.636+0000 7fe9bbfff700 1 -- 172.21.15.32:0/1728626842 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe9cc084830 con 0x7fe9d40b8b20 2023-10-08T06:09:43.687 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.636+0000 7fe9d2ffd700 1 --2- 172.21.15.32:0/1728626842 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fe9c0066510 0x7fe9c00689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:43.687 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.636+0000 7f10467fc700 1 -- 172.21.15.32:0/3464199602 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f10400050d0 con 0x7f10480c98c0 2023-10-08T06:09:43.687 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.636+0000 7f10467fc700 1 --2- 172.21.15.32:0/3464199602 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f1034066510 0x7f10340689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:43.687 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.636+0000 7f10467fc700 1 -- 172.21.15.32:0/3464199602 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1040084a80 con 0x7f10480c98c0 2023-10-08T06:09:43.687 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.636+0000 7f104d1bd700 1 --2- 172.21.15.32:0/3464199602 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f1034066510 0x7f10340689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:43.688 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.636+0000 7f1b7a406700 1 -- start start 2023-10-08T06:09:43.688 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.636+0000 7f45797fa700 1 --2- 172.21.15.32:0/3499922646 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f4568066590 0x7f4568068a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:43.688 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.636+0000 7f45797fa700 1 -- 172.21.15.32:0/3499922646 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f456c084ef0 con 0x7f457c0c21a0 2023-10-08T06:09:43.688 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.636+0000 7f457bfff700 1 --2- 172.21.15.32:0/3499922646 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f4568066590 0x7f4568068a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:43.689 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.640+0000 7f457bfff700 1 --2- 172.21.15.32:0/3499922646 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f4568066590 0x7f4568068a50 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f457c0c8a30 tx=0x7f4570009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:43.689 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.640+0000 7f1b7a406700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1b740c9e00 0x7f1b74144090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:43.689 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.640+0000 7f1b7a406700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1b740ce910 0x7f1b740cdbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:43.689 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.636+0000 7f104d1bd700 1 --2- 172.21.15.32:0/3464199602 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f1034066510 0x7f10340689d0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f1038000c00 tx=0x7f1038013000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:43.690 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.640+0000 7f1b7a406700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1b7415d4e0 0x7f1b740ce0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:43.690 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.640+0000 7f1b7a406700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b740b46c0 con 0x7f1b7415d4e0 2023-10-08T06:09:43.690 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.640+0000 7f1b7a406700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b741f08d0 con 0x7f1b740c9e00 2023-10-08T06:09:43.690 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.640+0000 7f1b7a406700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b741f0bb0 con 0x7f1b740ce910 2023-10-08T06:09:43.690 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.640+0000 7fe9d88da700 1 -- 172.21.15.32:0/1728626842 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9b4005310 con 0x7fe9d40b8b20 2023-10-08T06:09:43.691 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.640+0000 7fab4ea02700 1 -- 172.21.15.32:0/3699819011 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab24005310 con 0x7fab480706f0 2023-10-08T06:09:43.691 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.640+0000 7f1b789a3700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1b7415d4e0 0x7f1b740ce0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:43.691 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.640+0000 7f1b789a3700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1b7415d4e0 0x7f1b740ce0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:59520/0 (socket says 172.21.15.32:59520) 2023-10-08T06:09:43.692 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.640+0000 7f1b789a3700 1 -- 172.21.15.32:0/876182145 learned_addr learned my addr 172.21.15.32:0/876182145 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:09:43.692 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.640+0000 7f1b73fff700 1 --2- 172.21.15.32:0/876182145 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1b740c9e00 0x7f1b74144090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:43.692 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.640+0000 7f1b737fe700 1 --2- 172.21.15.32:0/876182145 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1b740ce910 0x7f1b740cdbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:43.692 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.640+0000 7f1b789a3700 1 -- 172.21.15.32:0/876182145 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1b740ce910 msgr2=0x7f1b740cdbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:43.692 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.640+0000 7f1b789a3700 1 --2- 172.21.15.32:0/876182145 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1b740ce910 0x7f1b740cdbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:43.692 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.640+0000 7f1b789a3700 1 -- 172.21.15.32:0/876182145 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1b740c9e00 msgr2=0x7f1b74144090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:43.692 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.640+0000 7f1b789a3700 1 --2- 172.21.15.32:0/876182145 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1b740c9e00 0x7f1b74144090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:43.692 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.640+0000 7f1b789a3700 1 -- 172.21.15.32:0/876182145 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b680094b0 con 0x7f1b7415d4e0 2023-10-08T06:09:43.692 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.640+0000 7fe9d2ffd700 1 --2- 172.21.15.32:0/1728626842 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fe9c0066510 0x7fe9c00689d0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fe9d40b8f60 tx=0x7fe9c4008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:43.693 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.640+0000 7f1b789a3700 1 --2- 172.21.15.32:0/876182145 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1b7415d4e0 0x7f1b740ce0f0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f1b6400c4f0 tx=0x7f1b6400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:43.693 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.640+0000 7fe27a7fc700 1 -- 172.21.15.32:0/4018909043 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe26c009940 con 0x7fe27c0cc370 2023-10-08T06:09:43.693 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.640+0000 7f10467fc700 1 -- 172.21.15.32:0/3464199602 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f1040051f50 con 0x7f10480c98c0 2023-10-08T06:09:43.694 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.644+0000 7f1b70ff9700 1 -- 172.21.15.32:0/876182145 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b64005d90 con 0x7f1b7415d4e0 2023-10-08T06:09:43.694 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.644+0000 7f1b7a406700 1 -- 172.21.15.32:0/876182145 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b74144820 con 0x7f1b7415d4e0 2023-10-08T06:09:43.694 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.644+0000 7f1b7a406700 1 -- 172.21.15.32:0/876182145 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b74144de0 con 0x7f1b7415d4e0 2023-10-08T06:09:43.694 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.644+0000 7fe9bbfff700 1 -- 172.21.15.32:0/1728626842 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fe9cc051b90 con 0x7fe9d40b8b20 2023-10-08T06:09:43.695 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.644+0000 7f1b7a406700 1 -- 172.21.15.32:0/876182145 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b74073f00 con 0x7f1b7415d4e0 2023-10-08T06:09:43.695 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.652+0000 7fab44ff9700 1 -- 172.21.15.32:0/3699819011 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fab40052070 con 0x7fab480706f0 2023-10-08T06:09:43.695 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.660+0000 7f45797fa700 1 -- 172.21.15.32:0/3499922646 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f456c0523e0 con 0x7f457c0c21a0 2023-10-08T06:09:43.696 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.668+0000 7fe27a7fc700 1 -- 172.21.15.32:0/4018909043 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe26c00c070 con 0x7fe27c0cc370 2023-10-08T06:09:43.696 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.668+0000 7fe27a7fc700 1 -- 172.21.15.32:0/4018909043 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe26c009ca0 con 0x7fe27c0cc370 2023-10-08T06:09:43.696 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.668+0000 7f3f397fa700 1 -- 172.21.15.32:0/4068910248 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f3f340af090 con 0x7f3f3c15a5e0 2023-10-08T06:09:43.698 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.668+0000 7fe280efd700 1 -- 172.21.15.32:0/4018909043 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe27c0cc370 msgr2=0x7fe27c15dc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:43.698 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.668+0000 7fe280efd700 1 --2- 172.21.15.32:0/4018909043 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe27c0cc370 0x7fe27c15dc10 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fe26c00f9b0 tx=0x7fe26c00fcc0 comp rx=0 tx=0).stop 2023-10-08T06:09:43.698 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.672+0000 7fe280efd700 1 -- 172.21.15.32:0/4018909043 shutdown_connections 2023-10-08T06:09:43.698 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.672+0000 7fe280efd700 1 --2- 172.21.15.32:0/4018909043 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe27c0cc370 0x7fe27c15dc10 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:43.698 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.672+0000 7fe280efd700 1 -- 172.21.15.32:0/4018909043 >> 172.21.15.32:0/4018909043 conn(0x7fe27c0cb850 msgr2=0x7fe27c0cbc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:09:43.698 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.672+0000 7fe280efd700 1 -- 172.21.15.32:0/4018909043 shutdown_connections 2023-10-08T06:09:43.698 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.672+0000 7fe280efd700 1 -- 172.21.15.32:0/4018909043 wait complete. 2023-10-08T06:09:43.699 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.672+0000 7fe280efd700 1 Processor -- start 2023-10-08T06:09:43.699 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.672+0000 7fe280efd700 1 -- start start 2023-10-08T06:09:43.699 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.672+0000 7fe280efd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe27c0cc370 0x7fe27c154670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:43.699 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.672+0000 7fe280efd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe27c15a0f0 0x7fe27c0c9400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:43.699 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.672+0000 7fe280efd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe27c15ad10 0x7fe27c0c9940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:43.699 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.672+0000 7fe27bfff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe27c15ad10 0x7fe27c0c9940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:43.699 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.672+0000 7fe27bfff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe27c15ad10 0x7fe27c0c9940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:59536/0 (socket says 172.21.15.32:59536) 2023-10-08T06:09:43.699 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.672+0000 7fe27bfff700 1 -- 172.21.15.32:0/518152985 learned_addr learned my addr 172.21.15.32:0/518152985 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:09:43.699 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.672+0000 7fe280efd700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe27c0c5680 con 0x7fe27c15ad10 2023-10-08T06:09:43.699 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.672+0000 7fe280efd700 1 -- 172.21.15.32:0/518152985 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe27c1ef700 con 0x7fe27c0cc370 2023-10-08T06:09:43.699 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.672+0000 7fe280efd700 1 -- 172.21.15.32:0/518152985 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe27c0c3510 con 0x7fe27c15a0f0 2023-10-08T06:09:43.700 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.676+0000 7fe27b7fe700 1 --2- 172.21.15.32:0/518152985 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe27c0cc370 0x7fe27c154670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:43.700 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.676+0000 7fe27affd700 1 --2- 172.21.15.32:0/518152985 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe27c15a0f0 0x7fe27c0c9400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:43.700 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.676+0000 7fe27bfff700 1 -- 172.21.15.32:0/518152985 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe27c15a0f0 msgr2=0x7fe27c0c9400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:43.700 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.676+0000 7fe27bfff700 1 --2- 172.21.15.32:0/518152985 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe27c15a0f0 0x7fe27c0c9400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:43.700 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.676+0000 7fe27bfff700 1 -- 172.21.15.32:0/518152985 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe27c0cc370 msgr2=0x7fe27c154670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:43.700 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.676+0000 7fe27bfff700 1 --2- 172.21.15.32:0/518152985 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe27c0cc370 0x7fe27c154670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:43.700 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.676+0000 7fe27bfff700 1 -- 172.21.15.32:0/518152985 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe26c00f610 con 0x7fe27c15ad10 2023-10-08T06:09:43.700 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.676+0000 7fe27bfff700 1 --2- 172.21.15.32:0/518152985 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe27c15ad10 0x7fe27c0c9940 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fe27000b440 tx=0x7fe27000b750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:43.700 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.684+0000 7fe263fff700 1 -- 172.21.15.32:0/518152985 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe270011830 con 0x7fe27c15ad10 2023-10-08T06:09:43.700 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.684+0000 7fe263fff700 1 -- 172.21.15.32:0/518152985 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2700119b0 con 0x7fe27c15ad10 2023-10-08T06:09:43.700 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.684+0000 7fe280efd700 1 -- 172.21.15.32:0/518152985 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe27c1ee940 con 0x7fe27c15ad10 2023-10-08T06:09:43.701 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.684+0000 7fe263fff700 1 -- 172.21.15.32:0/518152985 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe270011d60 con 0x7fe27c15ad10 2023-10-08T06:09:43.701 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.684+0000 7fe280efd700 1 -- 172.21.15.32:0/518152985 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe27c1eef00 con 0x7fe27c15ad10 2023-10-08T06:09:43.701 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.684+0000 7f1b70ff9700 1 -- 172.21.15.32:0/876182145 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b64007070 con 0x7f1b7415d4e0 2023-10-08T06:09:43.701 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.684+0000 7f1b70ff9700 1 -- 172.21.15.32:0/876182145 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b640073e0 con 0x7f1b7415d4e0 2023-10-08T06:09:43.701 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.684+0000 7f1b70ff9700 1 -- 172.21.15.32:0/876182145 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f1b640075c0 con 0x7f1b7415d4e0 2023-10-08T06:09:43.702 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.684+0000 7f1b70ff9700 1 --2- 172.21.15.32:0/876182145 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f1b600665c0 0x7f1b60068a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:43.702 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.684+0000 7fe263fff700 1 -- 172.21.15.32:0/518152985 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fe27001a400 con 0x7fe27c15ad10 2023-10-08T06:09:43.702 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.684+0000 7f1b73fff700 1 --2- 172.21.15.32:0/876182145 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f1b600665c0 0x7f1b60068a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:43.702 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.684+0000 7fe263fff700 1 --2- 172.21.15.32:0/518152985 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fe268066560 0x7fe268068a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:43.703 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.684+0000 7f1b73fff700 1 --2- 172.21.15.32:0/876182145 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f1b600665c0 0x7f1b60068a80 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f1b6c002130 tx=0x7f1b6c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:43.703 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.684+0000 7f1b70ff9700 1 -- 172.21.15.32:0/876182145 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1b64083c10 con 0x7f1b7415d4e0 2023-10-08T06:09:43.703 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.684+0000 7f1b70ff9700 1 -- 172.21.15.32:0/876182145 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f1b640ae130 con 0x7f1b7415d4e0 2023-10-08T06:09:43.704 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.684+0000 7fe27b7fe700 1 --2- 172.21.15.32:0/518152985 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fe268066560 0x7fe268068a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:43.704 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.688+0000 7fe263fff700 1 -- 172.21.15.32:0/518152985 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe270083be0 con 0x7fe27c15ad10 2023-10-08T06:09:43.704 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.688+0000 7fe27b7fe700 1 --2- 172.21.15.32:0/518152985 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fe268066560 0x7fe268068a20 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fe26c00fd00 tx=0x7fe26c008070 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:43.704 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.688+0000 7fe280efd700 1 -- 172.21.15.32:0/518152985 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe25c005310 con 0x7fe27c15ad10 2023-10-08T06:09:43.704 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.696+0000 7fe263fff700 1 -- 172.21.15.32:0/518152985 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fe270051140 con 0x7fe27c15ad10 2023-10-08T06:09:43.952 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.948+0000 7f76461a0700 1 -- 172.21.15.32:0/1828160077 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f76400ad880 con 0x7f76400703c0 2023-10-08T06:09:43.952 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.948+0000 7f7635ffb700 1 -- 172.21.15.32:0/1828160077 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f764015b560 con 0x7f76400703c0 2023-10-08T06:09:43.955 INFO:teuthology.orchestra.run.smithi032.stdout:64424509444 2023-10-08T06:09:43.956 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.952+0000 7f76237fe700 1 -- 172.21.15.32:0/1828160077 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f7624066510 msgr2=0x7f76240689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:43.956 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.952+0000 7f76237fe700 1 --2- 172.21.15.32:0/1828160077 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f7624066510 0x7f76240689d0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f76400707c0 tx=0x7f7630008040 comp rx=0 tx=0).stop 2023-10-08T06:09:43.956 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.952+0000 7f76237fe700 1 -- 172.21.15.32:0/1828160077 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f76400703c0 msgr2=0x7f76401581e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:43.956 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.952+0000 7f76237fe700 1 --2- 172.21.15.32:0/1828160077 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f76400703c0 0x7f76401581e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f76400b1800 tx=0x7f763c004770 comp rx=0 tx=0).stop 2023-10-08T06:09:43.957 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.952+0000 7f76237fe700 1 -- 172.21.15.32:0/1828160077 shutdown_connections 2023-10-08T06:09:43.957 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.952+0000 7f76237fe700 1 --2- 172.21.15.32:0/1828160077 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f7624066510 0x7f76240689d0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:43.957 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.952+0000 7f76237fe700 1 --2- 172.21.15.32:0/1828160077 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f764015d600 0x7f764015b840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:43.957 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.952+0000 7f76237fe700 1 --2- 172.21.15.32:0/1828160077 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f76400ce430 0x7f764015ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:43.957 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.952+0000 7f76237fe700 1 --2- 172.21.15.32:0/1828160077 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f76400703c0 0x7f76401581e0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:43.957 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.952+0000 7f76237fe700 1 -- 172.21.15.32:0/1828160077 >> 172.21.15.32:0/1828160077 conn(0x7f76400cb850 msgr2=0x7f76400b3a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:09:43.958 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.952+0000 7f76237fe700 1 -- 172.21.15.32:0/1828160077 shutdown_connections 2023-10-08T06:09:43.958 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.952+0000 7f76237fe700 1 -- 172.21.15.32:0/1828160077 wait complete. 2023-10-08T06:09:43.968 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.964+0000 7fe9d88da700 1 -- 172.21.15.32:0/1728626842 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fe9b40055c0 con 0x7fe9d40b8b20 2023-10-08T06:09:43.968 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.964+0000 7f104fc22700 1 -- 172.21.15.32:0/3464199602 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f10480cc6a0 con 0x7f10480c98c0 2023-10-08T06:09:43.969 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.964+0000 7f10467fc700 1 -- 172.21.15.32:0/3464199602 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1040055570 con 0x7f10480c98c0 2023-10-08T06:09:43.969 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.964+0000 7fe9bbfff700 1 -- 172.21.15.32:0/1728626842 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe9cc0551b0 con 0x7fe9d40b8b20 2023-10-08T06:09:43.969 INFO:teuthology.orchestra.run.smithi032.stdout:64424509445 2023-10-08T06:09:43.969 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.964+0000 7fab4ea02700 1 -- 172.21.15.32:0/3699819011 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fab24005890 con 0x7fab480706f0 2023-10-08T06:09:43.970 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.964+0000 7fab44ff9700 1 -- 172.21.15.32:0/3699819011 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fab40018070 con 0x7fab480706f0 2023-10-08T06:09:43.972 INFO:teuthology.orchestra.run.smithi032.stdout:64424509446 2023-10-08T06:09:43.972 INFO:teuthology.orchestra.run.smithi032.stdout:64424509445 2023-10-08T06:09:43.972 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509444 for osd.1 2023-10-08T06:09:43.973 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.968+0000 7f104fc22700 1 -- 172.21.15.32:0/3464199602 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f1034066510 msgr2=0x7f10340689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:43.973 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.968+0000 7f104fc22700 1 --2- 172.21.15.32:0/3464199602 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f1034066510 0x7f10340689d0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f1038000c00 tx=0x7f1038013000 comp rx=0 tx=0).stop 2023-10-08T06:09:43.973 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.968+0000 7f104fc22700 1 -- 172.21.15.32:0/3464199602 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f10480c98c0 msgr2=0x7f1048151290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:43.973 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.968+0000 7f104fc22700 1 --2- 172.21.15.32:0/3464199602 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f10480c98c0 0x7f1048151290 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f1040001f00 tx=0x7f104000a340 comp rx=0 tx=0).stop 2023-10-08T06:09:43.973 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.968+0000 7fe9d88da700 1 -- 172.21.15.32:0/1728626842 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fe9c0066510 msgr2=0x7fe9c00689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:43.974 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.968+0000 7fe9d88da700 1 --2- 172.21.15.32:0/1728626842 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fe9c0066510 0x7fe9c00689d0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fe9d40b8f60 tx=0x7fe9c4008030 comp rx=0 tx=0).stop 2023-10-08T06:09:43.974 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.968+0000 7f104fc22700 1 -- 172.21.15.32:0/3464199602 shutdown_connections 2023-10-08T06:09:43.974 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.968+0000 7fab4ea02700 1 -- 172.21.15.32:0/3699819011 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fab2c066510 msgr2=0x7fab2c0689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:43.974 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.968+0000 7f104fc22700 1 --2- 172.21.15.32:0/3464199602 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f1034066510 0x7f10340689d0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:43.975 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.968+0000 7fab4ea02700 1 --2- 172.21.15.32:0/3699819011 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fab2c066510 0x7fab2c0689d0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fab3c000c00 tx=0x7fab3c008030 comp rx=0 tx=0).stop 2023-10-08T06:09:43.975 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.968+0000 7fe9d88da700 1 -- 172.21.15.32:0/1728626842 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe9d40b8b20 msgr2=0x7fe9d40c86c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:43.975 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.968+0000 7fe9d88da700 1 --2- 172.21.15.32:0/1728626842 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe9d40b8b20 0x7fe9d40c86c0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fe9cc00efc0 tx=0x7fe9cc00c3a0 comp rx=0 tx=0).stop 2023-10-08T06:09:43.975 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.968+0000 7f104fc22700 1 --2- 172.21.15.32:0/3464199602 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f104815a2b0 0x7f10480b3650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:43.976 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.968+0000 7f104fc22700 1 --2- 172.21.15.32:0/3464199602 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1048159ed0 0x7f10480b3110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:43.976 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.968+0000 7fab4ea02700 1 -- 172.21.15.32:0/3699819011 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fab480706f0 msgr2=0x7fab481f6600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:43.976 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.968+0000 7f104fc22700 1 --2- 172.21.15.32:0/3464199602 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f10480c98c0 0x7f1048151290 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:43.976 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.968+0000 7fab4ea02700 1 --2- 172.21.15.32:0/3699819011 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fab480706f0 0x7fab481f6600 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fab4000efc0 tx=0x7fab4000c3a0 comp rx=0 tx=0).stop 2023-10-08T06:09:43.977 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.968+0000 7f104fc22700 1 -- 172.21.15.32:0/3464199602 >> 172.21.15.32:0/3464199602 conn(0x7f10480b0900 msgr2=0x7f1048071010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:09:43.977 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.968+0000 7f104fc22700 1 -- 172.21.15.32:0/3464199602 shutdown_connections 2023-10-08T06:09:43.977 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.968+0000 7f104fc22700 1 -- 172.21.15.32:0/3464199602 wait complete. 2023-10-08T06:09:43.978 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.968+0000 7fe9d88da700 1 -- 172.21.15.32:0/1728626842 shutdown_connections 2023-10-08T06:09:43.978 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.968+0000 7fe9d88da700 1 --2- 172.21.15.32:0/1728626842 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fe9c0066510 0x7fe9c00689d0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:43.978 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.968+0000 7fe9d88da700 1 --2- 172.21.15.32:0/1728626842 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe9d415d4b0 0x7fe9d4151950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:43.978 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.968+0000 7fe9d88da700 1 --2- 172.21.15.32:0/1728626842 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe9d40ce430 0x7fe9d4151410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:43.978 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.968+0000 7fe9d88da700 1 --2- 172.21.15.32:0/1728626842 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe9d40b8b20 0x7fe9d40c86c0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:43.978 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.968+0000 7fe9d88da700 1 -- 172.21.15.32:0/1728626842 >> 172.21.15.32:0/1728626842 conn(0x7fe9d406ac60 msgr2=0x7fe9d415c7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:09:43.978 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.968+0000 7fab4ea02700 1 -- 172.21.15.32:0/3699819011 shutdown_connections 2023-10-08T06:09:43.979 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.968+0000 7fab4ea02700 1 --2- 172.21.15.32:0/3699819011 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fab2c066510 0x7fab2c0689d0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:43.979 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.968+0000 7fab4ea02700 1 --2- 172.21.15.32:0/3699819011 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fab4815a2b0 0x7fab480b3aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:43.979 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.968+0000 7fab4ea02700 1 --2- 172.21.15.32:0/3699819011 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fab48159ed0 0x7fab480c77d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:43.979 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.968+0000 7fab4ea02700 1 --2- 172.21.15.32:0/3699819011 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fab480706f0 0x7fab481f6600 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:43.979 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.968+0000 7fab4ea02700 1 -- 172.21.15.32:0/3699819011 >> 172.21.15.32:0/3699819011 conn(0x7fab480b0900 msgr2=0x7fab480cb3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:09:43.979 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.968+0000 7fe9d88da700 1 -- 172.21.15.32:0/1728626842 shutdown_connections 2023-10-08T06:09:43.979 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.968+0000 7fe9d88da700 1 -- 172.21.15.32:0/1728626842 wait complete. 2023-10-08T06:09:43.980 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.968+0000 7fab4ea02700 1 -- 172.21.15.32:0/3699819011 shutdown_connections 2023-10-08T06:09:43.980 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.968+0000 7fab4ea02700 1 -- 172.21.15.32:0/3699819011 wait complete. 2023-10-08T06:09:43.984 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509445 for osd.0 2023-10-08T06:09:43.988 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509446 for osd.6 2023-10-08T06:09:43.989 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509445 for osd.5 2023-10-08T06:09:43.993 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.988+0000 7f458195d700 1 -- 172.21.15.32:0/3499922646 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f455c0055c0 con 0x7f457c0c21a0 2023-10-08T06:09:43.993 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.988+0000 7f45797fa700 1 -- 172.21.15.32:0/3499922646 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f456c015090 con 0x7f457c0c21a0 2023-10-08T06:09:43.993 INFO:teuthology.orchestra.run.smithi032.stdout:64424509445 2023-10-08T06:09:43.995 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.988+0000 7f3f41aae700 1 -- 172.21.15.32:0/4068910248 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f3f1c005890 con 0x7f3f3c15a5e0 2023-10-08T06:09:43.995 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.988+0000 7f3f397fa700 1 -- 172.21.15.32:0/4068910248 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3f34021020 con 0x7f3f3c15a5e0 2023-10-08T06:09:43.995 INFO:teuthology.orchestra.run.smithi032.stdout:64424509445 2023-10-08T06:09:43.996 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.992+0000 7f458195d700 1 -- 172.21.15.32:0/3499922646 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f4568066590 msgr2=0x7f4568068a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:43.996 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.992+0000 7f458195d700 1 --2- 172.21.15.32:0/3499922646 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f4568066590 0x7f4568068a50 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f457c0c8a30 tx=0x7f4570009040 comp rx=0 tx=0).stop 2023-10-08T06:09:43.997 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.992+0000 7f458195d700 1 -- 172.21.15.32:0/3499922646 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f457c0c21a0 msgr2=0x7f457c0c57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:43.997 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.992+0000 7f458195d700 1 --2- 172.21.15.32:0/3499922646 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f457c0c21a0 0x7f457c0c57c0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f456c0090b0 tx=0x7f456c004770 comp rx=0 tx=0).stop 2023-10-08T06:09:43.997 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.992+0000 7f458195d700 1 -- 172.21.15.32:0/3499922646 shutdown_connections 2023-10-08T06:09:43.997 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.992+0000 7f458195d700 1 --2- 172.21.15.32:0/3499922646 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f4568066590 0x7f4568068a50 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:43.997 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.992+0000 7f458195d700 1 --2- 172.21.15.32:0/3499922646 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f457c1652b0 0x7f457c0c3d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:43.997 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.992+0000 7f458195d700 1 --2- 172.21.15.32:0/3499922646 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f457c0cbef0 0x7f457c1520e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:43.997 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.992+0000 7f458195d700 1 --2- 172.21.15.32:0/3499922646 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f457c0c21a0 0x7f457c0c57c0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:43.997 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.992+0000 7f458195d700 1 -- 172.21.15.32:0/3499922646 >> 172.21.15.32:0/3499922646 conn(0x7f457c0b0900 msgr2=0x7f457c070e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:09:43.997 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.992+0000 7f458195d700 1 -- 172.21.15.32:0/3499922646 shutdown_connections 2023-10-08T06:09:43.997 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.992+0000 7f458195d700 1 -- 172.21.15.32:0/3499922646 wait complete. 2023-10-08T06:09:43.998 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.992+0000 7f3f41aae700 1 -- 172.21.15.32:0/4068910248 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f3f20066510 msgr2=0x7f3f200689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:43.998 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.992+0000 7f3f41aae700 1 --2- 172.21.15.32:0/4068910248 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f3f20066510 0x7f3f200689d0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f3f2800aa30 tx=0x7f3f28008040 comp rx=0 tx=0).stop 2023-10-08T06:09:43.998 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.992+0000 7f3f41aae700 1 -- 172.21.15.32:0/4068910248 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3f3c15a5e0 msgr2=0x7f3f3c0c7560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:43.999 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.992+0000 7f3f41aae700 1 --2- 172.21.15.32:0/4068910248 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3f3c15a5e0 0x7f3f3c0c7560 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f3f3400e7f0 tx=0x7f3f3400ebb0 comp rx=0 tx=0).stop 2023-10-08T06:09:43.999 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.992+0000 7f3f41aae700 1 -- 172.21.15.32:0/4068910248 shutdown_connections 2023-10-08T06:09:43.999 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.992+0000 7f3f41aae700 1 --2- 172.21.15.32:0/4068910248 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f3f20066510 0x7f3f200689d0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:43.999 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.992+0000 7f3f41aae700 1 --2- 172.21.15.32:0/4068910248 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3f3c15a5e0 0x7f3f3c0c7560 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:43.999 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.992+0000 7f3f41aae700 1 --2- 172.21.15.32:0/4068910248 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3f3c15a180 0x7f3f3c150e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:43.999 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.992+0000 7f3f41aae700 1 --2- 172.21.15.32:0/4068910248 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3f3c153490 0x7f3f3c1508f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:43.999 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.992+0000 7f3f41aae700 1 -- 172.21.15.32:0/4068910248 >> 172.21.15.32:0/4068910248 conn(0x7f3f3c0b0900 msgr2=0x7f3f3c152360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:09:43.999 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.992+0000 7f3f41aae700 1 -- 172.21.15.32:0/4068910248 shutdown_connections 2023-10-08T06:09:43.999 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.992+0000 7f3f41aae700 1 -- 172.21.15.32:0/4068910248 wait complete. 2023-10-08T06:09:44.000 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.992+0000 7f1b7a406700 1 -- 172.21.15.32:0/876182145 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f1b7415e080 con 0x7f1b7415d4e0 2023-10-08T06:09:44.000 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.992+0000 7f1b70ff9700 1 -- 172.21.15.32:0/876182145 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1b64051120 con 0x7f1b7415d4e0 2023-10-08T06:09:44.000 INFO:teuthology.orchestra.run.smithi032.stdout:60129542148 2023-10-08T06:09:44.001 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.996+0000 7f1b7a406700 1 -- 172.21.15.32:0/876182145 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f1b600665c0 msgr2=0x7f1b60068a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:44.001 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.996+0000 7f1b7a406700 1 --2- 172.21.15.32:0/876182145 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f1b600665c0 0x7f1b60068a80 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f1b6c002130 tx=0x7f1b6c009040 comp rx=0 tx=0).stop 2023-10-08T06:09:44.001 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.996+0000 7f1b7a406700 1 -- 172.21.15.32:0/876182145 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1b7415d4e0 msgr2=0x7f1b740ce0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:44.001 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.996+0000 7f1b7a406700 1 --2- 172.21.15.32:0/876182145 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1b7415d4e0 0x7f1b740ce0f0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f1b6400c4f0 tx=0x7f1b6400c8b0 comp rx=0 tx=0).stop 2023-10-08T06:09:44.001 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.996+0000 7f1b7a406700 1 -- 172.21.15.32:0/876182145 shutdown_connections 2023-10-08T06:09:44.002 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.996+0000 7f1b7a406700 1 --2- 172.21.15.32:0/876182145 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f1b600665c0 0x7f1b60068a80 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:44.002 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.996+0000 7f1b7a406700 1 --2- 172.21.15.32:0/876182145 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1b7415d4e0 0x7f1b740ce0f0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:44.002 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.996+0000 7f1b7a406700 1 --2- 172.21.15.32:0/876182145 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1b740ce910 0x7f1b740cdbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:44.002 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.996+0000 7f1b7a406700 1 --2- 172.21.15.32:0/876182145 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1b740c9e00 0x7f1b74144090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:44.002 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.996+0000 7f1b7a406700 1 -- 172.21.15.32:0/876182145 >> 172.21.15.32:0/876182145 conn(0x7f1b740cb850 msgr2=0x7f1b74155250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:09:44.002 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.996+0000 7f1b7a406700 1 -- 172.21.15.32:0/876182145 shutdown_connections 2023-10-08T06:09:44.002 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:43.996+0000 7f1b7a406700 1 -- 172.21.15.32:0/876182145 wait complete. 2023-10-08T06:09:44.004 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:44.000+0000 7fe280efd700 1 -- 172.21.15.32:0/518152985 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fe25c005890 con 0x7fe27c15ad10 2023-10-08T06:09:44.005 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:44.000+0000 7fe263fff700 1 -- 172.21.15.32:0/518152985 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe270015030 con 0x7fe27c15ad10 2023-10-08T06:09:44.005 INFO:teuthology.orchestra.run.smithi032.stdout:64424509445 2023-10-08T06:09:44.007 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:44.000+0000 7fe280efd700 1 -- 172.21.15.32:0/518152985 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fe268066560 msgr2=0x7fe268068a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:44.007 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:44.000+0000 7fe280efd700 1 --2- 172.21.15.32:0/518152985 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fe268066560 0x7fe268068a20 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fe26c00fd00 tx=0x7fe26c008070 comp rx=0 tx=0).stop 2023-10-08T06:09:44.007 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:44.000+0000 7fe280efd700 1 -- 172.21.15.32:0/518152985 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe27c15ad10 msgr2=0x7fe27c0c9940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:44.007 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:44.000+0000 7fe280efd700 1 --2- 172.21.15.32:0/518152985 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe27c15ad10 0x7fe27c0c9940 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fe27000b440 tx=0x7fe27000b750 comp rx=0 tx=0).stop 2023-10-08T06:09:44.007 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:44.000+0000 7fe280efd700 1 -- 172.21.15.32:0/518152985 shutdown_connections 2023-10-08T06:09:44.007 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:44.000+0000 7fe280efd700 1 --2- 172.21.15.32:0/518152985 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fe268066560 0x7fe268068a20 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:44.007 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:44.000+0000 7fe280efd700 1 --2- 172.21.15.32:0/518152985 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe27c15ad10 0x7fe27c0c9940 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:44.008 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:44.000+0000 7fe280efd700 1 --2- 172.21.15.32:0/518152985 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe27c15a0f0 0x7fe27c0c9400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:44.008 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:44.000+0000 7fe280efd700 1 --2- 172.21.15.32:0/518152985 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe27c0cc370 0x7fe27c154670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:44.008 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:44.000+0000 7fe280efd700 1 -- 172.21.15.32:0/518152985 >> 172.21.15.32:0/518152985 conn(0x7fe27c0cb850 msgr2=0x7fe27c0ce070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:09:44.008 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:44.000+0000 7fe280efd700 1 -- 172.21.15.32:0/518152985 shutdown_connections 2023-10-08T06:09:44.008 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:44.000+0000 7fe280efd700 1 -- 172.21.15.32:0/518152985 wait complete. 2023-10-08T06:09:44.009 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509445 for osd.7 2023-10-08T06:09:44.016 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509445 for osd.2 2023-10-08T06:09:44.018 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509445 for osd.4 2023-10-08T06:09:44.018 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542148 for osd.3 2023-10-08T06:09:44.974 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-08T06:09:44.985 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-08T06:09:44.990 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-10-08T06:09:44.990 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-10-08T06:09:45.010 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-10-08T06:09:45.017 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-08T06:09:45.018 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-10-08T06:09:45.019 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-08T06:09:45.120 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.116+0000 7f98a553a700 1 Processor -- start 2023-10-08T06:09:45.121 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.116+0000 7f98a553a700 1 -- start start 2023-10-08T06:09:45.121 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.116+0000 7f98a553a700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f98a015a440 0x7f98a00cd9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:45.121 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.116+0000 7f98a553a700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f98a0070a90 0x7f98a00c9800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:45.122 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.116+0000 7f98a553a700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98a00ce100 con 0x7f98a01599e0 2023-10-08T06:09:45.122 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.116+0000 7f98a553a700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98a0071160 con 0x7f98a0070a90 2023-10-08T06:09:45.122 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.116+0000 7f98a553a700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98a00cec80 con 0x7f98a015a440 2023-10-08T06:09:45.122 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.116+0000 7f989f7fe700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f98a0070a90 0x7f98a00c9800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:45.123 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.116+0000 7f989f7fe700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f98a0070a90 0x7f98a00c9800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.32:38368/0 (socket says 172.21.15.32:38368) 2023-10-08T06:09:45.123 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.116+0000 7f989f7fe700 1 -- 172.21.15.32:0/2968334237 learned_addr learned my addr 172.21.15.32:0/2968334237 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:09:45.123 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.116+0000 7f989effd700 1 --2- 172.21.15.32:0/2968334237 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f98a015a440 0x7f98a00cd9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:45.123 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.116+0000 7f989f7fe700 1 -- 172.21.15.32:0/2968334237 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f98a015a440 msgr2=0x7f98a00cd9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:09:45.123 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.116+0000 7f989f7fe700 1 --2- 172.21.15.32:0/2968334237 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f98a015a440 0x7f98a00cd9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:45.123 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.116+0000 7f989f7fe700 1 -- 172.21.15.32:0/2968334237 >> v1:172.21.15.32:6789/0 conn(0x7f98a01599e0 legacy=0x7f98a0070380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:09:45.124 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.116+0000 7f989f7fe700 1 -- 172.21.15.32:0/2968334237 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98a00ce3e0 con 0x7f98a0070a90 2023-10-08T06:09:45.124 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.116+0000 7f989f7fe700 1 --2- 172.21.15.32:0/2968334237 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f98a0070a90 0x7f98a00c9800 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f9898009e50 tx=0x7f989800bbc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7dfee878dca6e776 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:45.124 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.120+0000 7f989dffb700 1 -- 172.21.15.32:0/2968334237 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f989800e070 con 0x7f98a0070a90 2023-10-08T06:09:45.125 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.120+0000 7f989dffb700 1 -- 172.21.15.32:0/2968334237 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98980092e0 con 0x7f98a0070a90 2023-10-08T06:09:45.125 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.120+0000 7f989dffb700 1 -- 172.21.15.32:0/2968334237 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9898003c80 con 0x7f98a0070a90 2023-10-08T06:09:45.125 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.120+0000 7f98a553a700 1 -- 172.21.15.32:0/2968334237 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f98a0070a90 msgr2=0x7f98a00c9800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:45.125 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.120+0000 7f98a553a700 1 --2- 172.21.15.32:0/2968334237 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f98a0070a90 0x7f98a00c9800 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f9898009e50 tx=0x7f989800bbc0 comp rx=0 tx=0).stop 2023-10-08T06:09:45.125 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.120+0000 7f98a553a700 1 -- 172.21.15.32:0/2968334237 shutdown_connections 2023-10-08T06:09:45.125 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.120+0000 7f98a553a700 1 --2- 172.21.15.32:0/2968334237 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f98a0070a90 0x7f98a00c9800 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:45.125 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.120+0000 7f98a553a700 1 --2- 172.21.15.32:0/2968334237 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f98a015a440 0x7f98a00cd9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:45.125 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.120+0000 7f98a553a700 1 -- 172.21.15.32:0/2968334237 >> 172.21.15.32:0/2968334237 conn(0x7f98a00cb850 msgr2=0x7f98a00cbc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:09:45.126 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.120+0000 7f98a553a700 1 -- 172.21.15.32:0/2968334237 shutdown_connections 2023-10-08T06:09:45.127 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.120+0000 7f98a553a700 1 -- 172.21.15.32:0/2968334237 wait complete. 2023-10-08T06:09:45.127 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.120+0000 7f98a553a700 1 Processor -- start 2023-10-08T06:09:45.129 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.124+0000 7f98a553a700 1 -- start start 2023-10-08T06:09:45.129 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.124+0000 7f98a553a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f98a0070a90 0x7f98a0142a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:45.129 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.124+0000 7f98a553a700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f98a01599e0 0x7f98a00b43d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:45.129 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.124+0000 7f98a553a700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f98a015a440 0x7f98a01f9ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:45.129 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.124+0000 7f98a553a700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98a01470d0 con 0x7f98a015a440 2023-10-08T06:09:45.130 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.124+0000 7f98a553a700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98a014b3b0 con 0x7f98a0070a90 2023-10-08T06:09:45.130 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.124+0000 7f98a553a700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98a0146a80 con 0x7f98a01599e0 2023-10-08T06:09:45.130 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.124+0000 7f989f7fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f98a015a440 0x7f98a01f9ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:45.130 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.124+0000 7f989effd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f98a0070a90 0x7f98a0142a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:45.130 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.124+0000 7f989f7fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f98a015a440 0x7f98a01f9ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:59544/0 (socket says 172.21.15.32:59544) 2023-10-08T06:09:45.130 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.124+0000 7f989f7fe700 1 -- 172.21.15.32:0/3191355152 learned_addr learned my addr 172.21.15.32:0/3191355152 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:09:45.131 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.124+0000 7f989e7fc700 1 --2- 172.21.15.32:0/3191355152 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f98a01599e0 0x7f98a00b43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:45.131 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.124+0000 7f989f7fe700 1 -- 172.21.15.32:0/3191355152 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f98a01599e0 msgr2=0x7f98a00b43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:45.131 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.124+0000 7f989f7fe700 1 --2- 172.21.15.32:0/3191355152 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f98a01599e0 0x7f98a00b43d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:45.131 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.124+0000 7f989f7fe700 1 -- 172.21.15.32:0/3191355152 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f98a0070a90 msgr2=0x7f98a0142a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:45.131 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.124+0000 7f989f7fe700 1 --2- 172.21.15.32:0/3191355152 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f98a0070a90 0x7f98a0142a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:45.131 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.124+0000 7f989f7fe700 1 -- 172.21.15.32:0/3191355152 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9898009b30 con 0x7f98a015a440 2023-10-08T06:09:45.131 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.124+0000 7f989effd700 1 --2- 172.21.15.32:0/3191355152 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f98a0070a90 0x7f98a0142a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T06:09:45.131 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.124+0000 7f989f7fe700 1 --2- 172.21.15.32:0/3191355152 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f98a015a440 0x7f98a01f9ac0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f9898004000 tx=0x7f9898004b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:45.131 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.124+0000 7f98877fe700 1 -- 172.21.15.32:0/3191355152 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9898004440 con 0x7f98a015a440 2023-10-08T06:09:45.132 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.124+0000 7f98877fe700 1 -- 172.21.15.32:0/3191355152 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98980045a0 con 0x7f98a015a440 2023-10-08T06:09:45.132 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.124+0000 7f98a553a700 1 -- 172.21.15.32:0/3191355152 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98a0146d60 con 0x7f98a015a440 2023-10-08T06:09:45.132 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.124+0000 7f98a553a700 1 -- 172.21.15.32:0/3191355152 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98a01fa000 con 0x7f98a015a440 2023-10-08T06:09:45.132 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.128+0000 7f98877fe700 1 -- 172.21.15.32:0/3191355152 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9898004990 con 0x7f98a015a440 2023-10-08T06:09:45.134 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.128+0000 7f98a553a700 1 -- 172.21.15.32:0/3191355152 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9880005310 con 0x7f98a015a440 2023-10-08T06:09:45.134 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.128+0000 7f8c44870700 1 Processor -- start 2023-10-08T06:09:45.137 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.132+0000 7f98877fe700 1 -- 172.21.15.32:0/3191355152 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f9898019030 con 0x7f98a015a440 2023-10-08T06:09:45.137 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.132+0000 7f98877fe700 1 --2- 172.21.15.32:0/3191355152 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f988c066510 0x7f988c0689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:45.137 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.132+0000 7f98877fe700 1 -- 172.21.15.32:0/3191355152 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9898084e60 con 0x7f98a015a440 2023-10-08T06:09:45.137 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.132+0000 7f989effd700 1 --2- 172.21.15.32:0/3191355152 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f988c066510 0x7f988c0689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:45.138 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.128+0000 7f8c44870700 1 -- start start 2023-10-08T06:09:45.138 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.132+0000 7f8c44870700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f8c400c21a0 0x7f8c4006c690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:45.138 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.132+0000 7f8c44870700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8c400cbef0 0x7f8c400cc9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:45.138 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.132+0000 7f8c44870700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c4006c200 con 0x7f8c401652b0 2023-10-08T06:09:45.138 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.132+0000 7f8c44870700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c401662c0 con 0x7f8c400c21a0 2023-10-08T06:09:45.138 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.132+0000 7f8c44870700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c40165d00 con 0x7f8c400cbef0 2023-10-08T06:09:45.138 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.132+0000 7f8c3e59c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f8c400c21a0 0x7f8c4006c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:45.138 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.132+0000 7f8c3e59c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f8c400c21a0 0x7f8c4006c690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.32:38390/0 (socket says 172.21.15.32:38390) 2023-10-08T06:09:45.138 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.132+0000 7f8c3e59c700 1 -- 172.21.15.32:0/206681774 learned_addr learned my addr 172.21.15.32:0/206681774 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:09:45.138 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.132+0000 7f8c3dd9b700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f8c401652b0 0x7f8c400cb7e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.32:46018/0 (socket says 172.21.15.32:46018) 2023-10-08T06:09:45.139 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.132+0000 7f989effd700 1 --2- 172.21.15.32:0/3191355152 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f988c066510 0x7f988c0689d0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f9890009f40 tx=0x7f9890009240 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:45.140 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.132+0000 7f8c3e59c700 1 -- 172.21.15.32:0/206681774 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8c400cbef0 msgr2=0x7f8c400cc9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:09:45.140 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.132+0000 7f8c3ed9d700 1 --2- 172.21.15.32:0/206681774 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8c400cbef0 0x7f8c400cc9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:45.140 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.132+0000 7f8c3e59c700 1 --2- 172.21.15.32:0/206681774 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8c400cbef0 0x7f8c400cc9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:45.140 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.132+0000 7f8c3e59c700 1 -- 172.21.15.32:0/206681774 >> v1:172.21.15.40:6789/0 conn(0x7f8c401652b0 legacy=0x7f8c400cb7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:45.141 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.132+0000 7f8c3e59c700 1 -- 172.21.15.32:0/206681774 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c40165fe0 con 0x7f8c400c21a0 2023-10-08T06:09:45.141 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.132+0000 7f8c3ed9d700 1 --2- 172.21.15.32:0/206681774 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8c400cbef0 0x7f8c400cc9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T06:09:45.141 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.132+0000 7f8c3e59c700 1 --2- 172.21.15.32:0/206681774 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8c400c21a0 0x7f8c4006c690 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f8c38009e50 tx=0x7f8c3800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=85fa1651b3b87d07 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:45.141 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.132+0000 7f8c3d59a700 1 -- 172.21.15.32:0/206681774 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c3800e070 con 0x7f8c400c21a0 2023-10-08T06:09:45.141 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.132+0000 7f8c3d59a700 1 -- 172.21.15.32:0/206681774 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c38003a40 con 0x7f8c400c21a0 2023-10-08T06:09:45.141 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.132+0000 7f8c3d59a700 1 -- 172.21.15.32:0/206681774 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c38003dd0 con 0x7f8c400c21a0 2023-10-08T06:09:45.141 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.136+0000 7f8c44870700 1 -- 172.21.15.32:0/206681774 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8c400c21a0 msgr2=0x7f8c4006c690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:45.141 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.136+0000 7f8c44870700 1 --2- 172.21.15.32:0/206681774 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8c400c21a0 0x7f8c4006c690 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f8c38009e50 tx=0x7f8c3800b330 comp rx=0 tx=0).stop 2023-10-08T06:09:45.141 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.136+0000 7f8c44870700 1 -- 172.21.15.32:0/206681774 shutdown_connections 2023-10-08T06:09:45.141 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.136+0000 7f8c44870700 1 --2- 172.21.15.32:0/206681774 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8c400cbef0 0x7f8c400cc9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:45.141 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.136+0000 7f8c44870700 1 --2- 172.21.15.32:0/206681774 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8c400c21a0 0x7f8c4006c690 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:45.141 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.136+0000 7f8c44870700 1 -- 172.21.15.32:0/206681774 >> 172.21.15.32:0/206681774 conn(0x7f8c400b0900 msgr2=0x7f8c400b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:09:45.142 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.136+0000 7f8c44870700 1 -- 172.21.15.32:0/206681774 shutdown_connections 2023-10-08T06:09:45.142 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.136+0000 7f8c44870700 1 -- 172.21.15.32:0/206681774 wait complete. 2023-10-08T06:09:45.142 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.136+0000 7f8c44870700 1 Processor -- start 2023-10-08T06:09:45.142 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.136+0000 7f8c44870700 1 -- start start 2023-10-08T06:09:45.143 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.136+0000 7f8c44870700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8c400c21a0 0x7f8c40150f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:45.144 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.136+0000 7f98877fe700 1 -- 172.21.15.32:0/3191355152 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f9898055d60 con 0x7f98a015a440 2023-10-08T06:09:45.144 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.140+0000 7f8c44870700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8c400cbef0 0x7f8c400b3680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:45.144 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.140+0000 7f8c44870700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8c401652b0 0x7f8c400b3bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:45.144 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.140+0000 7f8c44870700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c40151f00 con 0x7f8c401652b0 2023-10-08T06:09:45.144 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.140+0000 7f8c44870700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c401525a0 con 0x7f8c400c21a0 2023-10-08T06:09:45.145 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.140+0000 7f8c44870700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c40151940 con 0x7f8c400cbef0 2023-10-08T06:09:45.145 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.140+0000 7f8c3e59c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8c400c21a0 0x7f8c40150f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:45.145 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.140+0000 7f8c3e59c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8c400c21a0 0x7f8c40150f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.32:38406/0 (socket says 172.21.15.32:38406) 2023-10-08T06:09:45.145 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.140+0000 7f8c3e59c700 1 -- 172.21.15.32:0/1362928725 learned_addr learned my addr 172.21.15.32:0/1362928725 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:09:45.145 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.140+0000 7f8c3dd9b700 1 --2- 172.21.15.32:0/1362928725 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8c400cbef0 0x7f8c400b3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:45.146 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.140+0000 7f8c3ed9d700 1 --2- 172.21.15.32:0/1362928725 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8c401652b0 0x7f8c400b3bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:45.146 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.140+0000 7f8c3e59c700 1 -- 172.21.15.32:0/1362928725 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8c400cbef0 msgr2=0x7f8c400b3680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:45.146 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.140+0000 7f8c3e59c700 1 --2- 172.21.15.32:0/1362928725 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8c400cbef0 0x7f8c400b3680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:45.146 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.140+0000 7f8c3e59c700 1 -- 172.21.15.32:0/1362928725 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8c401652b0 msgr2=0x7f8c400b3bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:45.146 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.140+0000 7f8c3e59c700 1 --2- 172.21.15.32:0/1362928725 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8c401652b0 0x7f8c400b3bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:45.146 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.140+0000 7f8c3e59c700 1 -- 172.21.15.32:0/1362928725 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c38009b30 con 0x7f8c400c21a0 2023-10-08T06:09:45.146 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.140+0000 7f8c3e59c700 1 --2- 172.21.15.32:0/1362928725 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8c400c21a0 0x7f8c40150f30 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f8c4006b7d0 tx=0x7f8c38004af0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:45.146 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.140+0000 7f8c2effd700 1 -- 172.21.15.32:0/1362928725 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c38004440 con 0x7f8c400c21a0 2023-10-08T06:09:45.147 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.140+0000 7f8c44870700 1 -- 172.21.15.32:0/1362928725 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c40151c20 con 0x7f8c400c21a0 2023-10-08T06:09:45.147 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.140+0000 7f8c44870700 1 -- 172.21.15.32:0/1362928725 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c40147d20 con 0x7f8c400c21a0 2023-10-08T06:09:45.147 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.140+0000 7f8c2effd700 1 -- 172.21.15.32:0/1362928725 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c380045c0 con 0x7f8c400c21a0 2023-10-08T06:09:45.147 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.140+0000 7f8c2effd700 1 -- 172.21.15.32:0/1362928725 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c38004970 con 0x7f8c400c21a0 2023-10-08T06:09:45.150 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.144+0000 7f8c44870700 1 -- 172.21.15.32:0/1362928725 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c24005310 con 0x7f8c400c21a0 2023-10-08T06:09:45.151 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.144+0000 7f8c2effd700 1 -- 172.21.15.32:0/1362928725 <== mon.1 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f8c38012430 con 0x7f8c400c21a0 2023-10-08T06:09:45.151 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.144+0000 7f8c2effd700 1 --2- 172.21.15.32:0/1362928725 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f8c20066540 0x7f8c20068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:45.151 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.144+0000 7f8c2effd700 1 -- 172.21.15.32:0/1362928725 <== mon.1 v2:172.21.15.40:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8c38085090 con 0x7f8c400c21a0 2023-10-08T06:09:45.151 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.144+0000 7f8c3dd9b700 1 --2- 172.21.15.32:0/1362928725 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f8c20066540 0x7f8c20068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:45.151 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.144+0000 7f8c3dd9b700 1 --2- 172.21.15.32:0/1362928725 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f8c20066540 0x7f8c20068a00 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f8c400c7520 tx=0x7f8c30007d70 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:45.159 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.152+0000 7f8c2effd700 1 -- 172.21.15.32:0/1362928725 <== mon.1 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f8c38052480 con 0x7f8c400c21a0 2023-10-08T06:09:45.175 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.168+0000 7f7b9f16e700 1 Processor -- start 2023-10-08T06:09:45.177 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.168+0000 7f7b9f16e700 1 -- start start 2023-10-08T06:09:45.177 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.172+0000 7f7b9f16e700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f7b98159590 0x7f7b980c9410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:45.177 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.172+0000 7f7b9f16e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7b980c9950 0x7f7b980b0840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:45.177 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.172+0000 7f7b9f16e700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b980c9e60 con 0x7f7b9806ca40 2023-10-08T06:09:45.177 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.172+0000 7f7b9f16e700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b980ca140 con 0x7f7b98159590 2023-10-08T06:09:45.178 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.172+0000 7f7b9f16e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b98159970 con 0x7f7b980c9950 2023-10-08T06:09:45.178 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.172+0000 7f7b9cf0a700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f7b98159590 0x7f7b980c9410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:45.178 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.172+0000 7f7b9cf0a700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f7b98159590 0x7f7b980c9410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:59568/0 (socket says 172.21.15.32:59568) 2023-10-08T06:09:45.178 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.172+0000 7f7b9cf0a700 1 -- 172.21.15.32:0/1361830694 learned_addr learned my addr 172.21.15.32:0/1361830694 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:09:45.178 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.172+0000 7f7b9d70b700 1 --1- 172.21.15.32:0/1361830694 >> v1:172.21.15.32:6789/0 conn(0x7f7b9806ca40 0x7f7b9815d050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:46214/0 (socket says 172.21.15.32:46214) 2023-10-08T06:09:45.178 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.172+0000 7f7b97fff700 1 --2- 172.21.15.32:0/1361830694 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7b980c9950 0x7f7b980b0840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:45.178 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.172+0000 7f7b977fe700 1 -- 172.21.15.32:0/1361830694 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4054182920 0 0) 0x7f7b980c9e60 con 0x7f7b9806ca40 2023-10-08T06:09:45.178 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.172+0000 7f7b9cf0a700 1 -- 172.21.15.32:0/1361830694 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7b980c9950 msgr2=0x7f7b980b0840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:09:45.178 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.172+0000 7f7b9cf0a700 1 --2- 172.21.15.32:0/1361830694 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7b980c9950 0x7f7b980b0840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:45.178 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.172+0000 7f7b9cf0a700 1 -- 172.21.15.32:0/1361830694 >> v1:172.21.15.32:6789/0 conn(0x7f7b9806ca40 legacy=0x7f7b9815d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:45.178 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.172+0000 7f7b9cf0a700 1 -- 172.21.15.32:0/1361830694 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b9806bf60 con 0x7f7b98159590 2023-10-08T06:09:45.179 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.172+0000 7f7b9cf0a700 1 --2- 172.21.15.32:0/1361830694 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7b98159590 0x7f7b980c9410 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f7b9000d1e0 tx=0x7f7b9000d4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d19960b912d807f6 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:45.180 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.172+0000 7f7b977fe700 1 -- 172.21.15.32:0/1361830694 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b90010070 con 0x7f7b98159590 2023-10-08T06:09:45.180 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.172+0000 7f7b977fe700 1 -- 172.21.15.32:0/1361830694 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b9000dbf0 con 0x7f7b98159590 2023-10-08T06:09:45.180 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.172+0000 7f7b9f16e700 1 -- 172.21.15.32:0/1361830694 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7b98159590 msgr2=0x7f7b980c9410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:45.180 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.172+0000 7f7b9f16e700 1 --2- 172.21.15.32:0/1361830694 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7b98159590 0x7f7b980c9410 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f7b9000d1e0 tx=0x7f7b9000d4f0 comp rx=0 tx=0).stop 2023-10-08T06:09:45.180 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.172+0000 7f7b9f16e700 1 -- 172.21.15.32:0/1361830694 shutdown_connections 2023-10-08T06:09:45.180 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.172+0000 7f7b9f16e700 1 --2- 172.21.15.32:0/1361830694 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7b980c9950 0x7f7b980b0840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:45.180 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.172+0000 7f7b9f16e700 1 --2- 172.21.15.32:0/1361830694 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7b98159590 0x7f7b980c9410 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:45.180 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.172+0000 7f7b9f16e700 1 -- 172.21.15.32:0/1361830694 >> 172.21.15.32:0/1361830694 conn(0x7f7b980cb840 msgr2=0x7f7b980cbc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:09:45.180 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.176+0000 7f7b9f16e700 1 -- 172.21.15.32:0/1361830694 shutdown_connections 2023-10-08T06:09:45.180 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.176+0000 7f7b9f16e700 1 -- 172.21.15.32:0/1361830694 wait complete. 2023-10-08T06:09:45.181 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.176+0000 7f7b9f16e700 1 Processor -- start 2023-10-08T06:09:45.181 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.176+0000 7f7b9f16e700 1 -- start start 2023-10-08T06:09:45.183 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.176+0000 7fdab2ab8700 1 Processor -- start 2023-10-08T06:09:45.183 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.176+0000 7fdab2ab8700 1 -- start start 2023-10-08T06:09:45.183 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.176+0000 7fdab2ab8700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdaac06dd10 0x7fdaac153490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:45.183 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.176+0000 7fdab2ab8700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fdaac1539d0 0x7fdaac0c9420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:45.183 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.176+0000 7fdab2ab8700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fdaac0c9960 0x7fdaac159f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:45.183 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.176+0000 7fdab2ab8700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdaac06cd10 con 0x7fdaac1539d0 2023-10-08T06:09:45.183 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.176+0000 7fdab2ab8700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdaac153e30 con 0x7fdaac0c9960 2023-10-08T06:09:45.183 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.176+0000 7fdab2ab8700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdaac0c9db0 con 0x7fdaac06dd10 2023-10-08T06:09:45.184 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.176+0000 7f7b9f16e700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7b9806ca40 0x7f7b9814d240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:45.184 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.176+0000 7f7b9f16e700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7b980c9950 0x7f7b9814ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:45.184 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.176+0000 7f7b9f16e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7b98159590 0x7f7b9815ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:45.184 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.176+0000 7f7b9f16e700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b9814dd40 con 0x7f7b980c9950 2023-10-08T06:09:45.184 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.176+0000 7f7b9f16e700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b9814e8c0 con 0x7f7b9806ca40 2023-10-08T06:09:45.184 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.176+0000 7f7b9f16e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b9814df90 con 0x7f7b98159590 2023-10-08T06:09:45.184 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.176+0000 7f7b9cf0a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7b9806ca40 0x7f7b9814d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:45.184 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.176+0000 7f7b9cf0a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7b9806ca40 0x7f7b9814d240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.32:38432/0 (socket says 172.21.15.32:38432) 2023-10-08T06:09:45.185 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.176+0000 7f7b9cf0a700 1 -- 172.21.15.32:0/1153046455 learned_addr learned my addr 172.21.15.32:0/1153046455 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:09:45.185 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.176+0000 7f7b9d70b700 1 --2- 172.21.15.32:0/1153046455 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7b98159590 0x7f7b9815ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:45.185 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.176+0000 7f7b97fff700 1 --2- 172.21.15.32:0/1153046455 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7b980c9950 0x7f7b9814ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:45.185 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.176+0000 7fdab22b7700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fdaac0c9960 0x7fdaac159f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:45.185 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.176+0000 7fdab22b7700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fdaac0c9960 0x7fdaac159f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.32:38418/0 (socket says 172.21.15.32:38418) 2023-10-08T06:09:45.185 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.176+0000 7fdab22b7700 1 -- 172.21.15.32:0/3772984747 learned_addr learned my addr 172.21.15.32:0/3772984747 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:09:45.185 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.176+0000 7fdab1ab6700 1 --2- 172.21.15.32:0/3772984747 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdaac06dd10 0x7fdaac153490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:45.186 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.180+0000 7fdab12b5700 1 --2- 172.21.15.32:0/3772984747 >> v2:172.21.15.32:3300/0 conn(0x7fdaac1539d0 0x7fdaac0c9420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:45.186 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.180+0000 7f7b97fff700 1 -- 172.21.15.32:0/1153046455 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7b98159590 msgr2=0x7f7b9815ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:45.186 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.180+0000 7f7b97fff700 1 --2- 172.21.15.32:0/1153046455 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7b98159590 0x7f7b9815ce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:45.186 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.180+0000 7f7b97fff700 1 -- 172.21.15.32:0/1153046455 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7b9806ca40 msgr2=0x7f7b9814d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:45.186 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.180+0000 7f7b97fff700 1 --2- 172.21.15.32:0/1153046455 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7b9806ca40 0x7f7b9814d240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:45.186 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.180+0000 7f7b97fff700 1 -- 172.21.15.32:0/1153046455 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b900079d0 con 0x7f7b980c9950 2023-10-08T06:09:45.187 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.180+0000 7fdab22b7700 1 -- 172.21.15.32:0/3772984747 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdaac06dd10 msgr2=0x7fdaac153490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:09:45.187 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.180+0000 7fdab22b7700 1 --2- 172.21.15.32:0/3772984747 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdaac06dd10 0x7fdaac153490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:45.187 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.180+0000 7fdab22b7700 1 -- 172.21.15.32:0/3772984747 >> v2:172.21.15.32:3300/0 conn(0x7fdaac1539d0 msgr2=0x7fdaac0c9420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:09:45.187 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.180+0000 7fdab22b7700 1 --2- 172.21.15.32:0/3772984747 >> v2:172.21.15.32:3300/0 conn(0x7fdaac1539d0 0x7fdaac0c9420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:45.187 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.180+0000 7fdab22b7700 1 -- 172.21.15.32:0/3772984747 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdaac1612c0 con 0x7fdaac0c9960 2023-10-08T06:09:45.187 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.180+0000 7f7b97fff700 1 --2- 172.21.15.32:0/1153046455 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7b980c9950 0x7f7b9814ed50 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f7b8c01f880 tx=0x7f7b8c01fb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:45.187 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.180+0000 7f7b957fa700 1 -- 172.21.15.32:0/1153046455 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b8c024890 con 0x7f7b980c9950 2023-10-08T06:09:45.188 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.180+0000 7fdab22b7700 1 --2- 172.21.15.32:0/3772984747 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdaac0c9960 0x7fdaac159f10 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fdaac0cec90 tx=0x7fda9c009bf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dbd3e2bbf8493052 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:45.188 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.180+0000 7f7b9f16e700 1 -- 172.21.15.32:0/1153046455 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b9814e270 con 0x7f7b980c9950 2023-10-08T06:09:45.188 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.180+0000 7f7b9f16e700 1 -- 172.21.15.32:0/1153046455 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b9814d780 con 0x7f7b980c9950 2023-10-08T06:09:45.189 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.180+0000 7fdab0ab4700 1 -- 172.21.15.32:0/3772984747 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda9c011830 con 0x7fdaac0c9960 2023-10-08T06:09:45.189 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.180+0000 7fdab0ab4700 1 -- 172.21.15.32:0/3772984747 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda9c011990 con 0x7fdaac0c9960 2023-10-08T06:09:45.189 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.180+0000 7fdab0ab4700 1 -- 172.21.15.32:0/3772984747 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda9c011d20 con 0x7fdaac0c9960 2023-10-08T06:09:45.189 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.180+0000 7f7b957fa700 1 -- 172.21.15.32:0/1153046455 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b8c0249f0 con 0x7f7b980c9950 2023-10-08T06:09:45.189 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.180+0000 7fdab2ab8700 1 -- 172.21.15.32:0/3772984747 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdaac0c9960 msgr2=0x7fdaac159f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:45.189 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.180+0000 7fdab2ab8700 1 --2- 172.21.15.32:0/3772984747 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdaac0c9960 0x7fdaac159f10 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fdaac0cec90 tx=0x7fda9c009bf0 comp rx=0 tx=0).stop 2023-10-08T06:09:45.190 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.180+0000 7f7b957fa700 1 -- 172.21.15.32:0/1153046455 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b8c024d60 con 0x7f7b980c9950 2023-10-08T06:09:45.190 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.180+0000 7f7b957fa700 1 -- 172.21.15.32:0/1153046455 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f7b8c0233e0 con 0x7f7b980c9950 2023-10-08T06:09:45.190 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.180+0000 7fdab2ab8700 1 -- 172.21.15.32:0/3772984747 shutdown_connections 2023-10-08T06:09:45.191 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.180+0000 7fdab2ab8700 1 --2- 172.21.15.32:0/3772984747 >> v2:172.21.15.32:3300/0 conn(0x7fdaac1539d0 0x7fdaac0c9420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:45.191 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.180+0000 7fdab2ab8700 1 --2- 172.21.15.32:0/3772984747 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdaac0c9960 0x7fdaac159f10 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:45.191 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.180+0000 7fdab2ab8700 1 --2- 172.21.15.32:0/3772984747 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdaac06dd10 0x7fdaac153490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:45.191 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.180+0000 7fdab2ab8700 1 -- 172.21.15.32:0/3772984747 >> 172.21.15.32:0/3772984747 conn(0x7fdaac0b0900 msgr2=0x7fdaac0b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:09:45.191 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.180+0000 7fdab2ab8700 1 -- 172.21.15.32:0/3772984747 shutdown_connections 2023-10-08T06:09:45.191 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.180+0000 7fdab2ab8700 1 -- 172.21.15.32:0/3772984747 wait complete. 2023-10-08T06:09:45.192 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.184+0000 7f7b957fa700 1 --2- 172.21.15.32:0/1153046455 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f7b84066660 0x7f7b84068b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:45.192 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.184+0000 7f7b9cf0a700 1 --2- 172.21.15.32:0/1153046455 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f7b84066660 0x7f7b84068b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:45.193 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.184+0000 7f7b9cf0a700 1 --2- 172.21.15.32:0/1153046455 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f7b84066660 0x7f7b84068b20 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f7b9000d530 tx=0x7f7b9000b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:45.193 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.184+0000 7f7b957fa700 1 -- 172.21.15.32:0/1153046455 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7b8c0945e0 con 0x7f7b980c9950 2023-10-08T06:09:45.193 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.184+0000 7fdab2ab8700 1 Processor -- start 2023-10-08T06:09:45.194 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.184+0000 7f7b9f16e700 1 -- 172.21.15.32:0/1153046455 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b78005310 con 0x7f7b980c9950 2023-10-08T06:09:45.194 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.184+0000 7fdab2ab8700 1 -- start start 2023-10-08T06:09:45.194 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.184+0000 7fdab2ab8700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdaac06dd10 0x7fdaac154fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:45.194 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.184+0000 7fdab2ab8700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdaac0c9960 0x7fdaac0aeff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:45.194 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.184+0000 7fdab2ab8700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdaac1539d0 0x7fdaac156630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:45.194 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.184+0000 7fdab1ab6700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdaac06dd10 0x7fdaac154fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:45.194 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.184+0000 7fdab1ab6700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdaac06dd10 0x7fdaac154fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.32:38434/0 (socket says 172.21.15.32:38434) 2023-10-08T06:09:45.194 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.184+0000 7fdab12b5700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdaac0c9960 0x7fdaac0aeff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:45.195 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.184+0000 7fdab12b5700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdaac0c9960 0x7fdaac0aeff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.32:54886/0 (socket says 172.21.15.32:54886) 2023-10-08T06:09:45.195 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.184+0000 7fdab1ab6700 1 -- 172.21.15.32:0/2420353570 learned_addr learned my addr 172.21.15.32:0/2420353570 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:09:45.195 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.184+0000 7fdab22b7700 1 --2- 172.21.15.32:0/2420353570 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdaac1539d0 0x7fdaac156630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:45.195 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.184+0000 7fdab2ab8700 1 -- 172.21.15.32:0/2420353570 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdaac1555b0 con 0x7fdaac1539d0 2023-10-08T06:09:45.195 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.184+0000 7fdab2ab8700 1 -- 172.21.15.32:0/2420353570 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdaac155890 con 0x7fdaac06dd10 2023-10-08T06:09:45.195 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.184+0000 7fdab2ab8700 1 -- 172.21.15.32:0/2420353570 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdaac155b70 con 0x7fdaac0c9960 2023-10-08T06:09:45.195 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.184+0000 7fdab12b5700 1 -- 172.21.15.32:0/2420353570 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdaac06dd10 msgr2=0x7fdaac154fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:45.195 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.184+0000 7fdab12b5700 1 --2- 172.21.15.32:0/2420353570 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdaac06dd10 0x7fdaac154fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:45.195 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.184+0000 7fdab12b5700 1 -- 172.21.15.32:0/2420353570 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdaac1539d0 msgr2=0x7fdaac156630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:45.195 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.184+0000 7fdab12b5700 1 --2- 172.21.15.32:0/2420353570 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdaac1539d0 0x7fdaac156630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:45.196 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.184+0000 7fdab12b5700 1 -- 172.21.15.32:0/2420353570 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda9c009570 con 0x7fdaac0c9960 2023-10-08T06:09:45.196 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.188+0000 7fdab12b5700 1 --2- 172.21.15.32:0/2420353570 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdaac0c9960 0x7fdaac0aeff0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fdaa400efc0 tx=0x7fdaa400c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:45.196 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.188+0000 7fdaa27fc700 1 -- 172.21.15.32:0/2420353570 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaa400cd10 con 0x7fdaac0c9960 2023-10-08T06:09:45.196 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.188+0000 7fdaa27fc700 1 -- 172.21.15.32:0/2420353570 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdaa400f040 con 0x7fdaac0c9960 2023-10-08T06:09:45.196 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.188+0000 7fdab2ab8700 1 -- 172.21.15.32:0/2420353570 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdaac155e50 con 0x7fdaac0c9960 2023-10-08T06:09:45.196 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.188+0000 7fdab2ab8700 1 -- 172.21.15.32:0/2420353570 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdaac0c20b0 con 0x7fdaac0c9960 2023-10-08T06:09:45.196 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.188+0000 7fdaa27fc700 1 -- 172.21.15.32:0/2420353570 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaa40146a0 con 0x7fdaac0c9960 2023-10-08T06:09:45.197 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.188+0000 7fde5250f700 1 Processor -- start 2023-10-08T06:09:45.197 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.188+0000 7fde5250f700 1 -- start start 2023-10-08T06:09:45.197 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.188+0000 7fdaa27fc700 1 -- 172.21.15.32:0/2420353570 <== mon.2 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fdaa4014800 con 0x7fdaac0c9960 2023-10-08T06:09:45.197 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.192+0000 7fdaa27fc700 1 --2- 172.21.15.32:0/2420353570 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fda980666e0 0x7fda98068ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:45.197 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.192+0000 7fdaa27fc700 1 -- 172.21.15.32:0/2420353570 <== mon.2 v2:172.21.15.40:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdaa4084840 con 0x7fdaac0c9960 2023-10-08T06:09:45.197 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.192+0000 7fdab1ab6700 1 --2- 172.21.15.32:0/2420353570 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fda980666e0 0x7fda98068ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:45.198 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.192+0000 7fde5250f700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fde4c0703c0 0x7fde4c0ce0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:45.198 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.192+0000 7fda8ffff700 1 -- 172.21.15.32:0/2420353570 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdaac073f00 con 0x7fdaac0c9960 2023-10-08T06:09:45.198 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.192+0000 7fdab1ab6700 1 --2- 172.21.15.32:0/2420353570 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fda980666e0 0x7fda98068ba0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fdaa8009b90 tx=0x7fdaa8009240 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:45.198 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.192+0000 7fde50d0c700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fde4c0703c0 0x7fde4c0ce0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:45.199 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.192+0000 7fde50d0c700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fde4c0703c0 0x7fde4c0ce0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:59600/0 (socket says 172.21.15.32:59600) 2023-10-08T06:09:45.199 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.192+0000 7fde50d0c700 1 -- 172.21.15.32:0/3449054666 learned_addr learned my addr 172.21.15.32:0/3449054666 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:09:45.199 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.192+0000 7fde5150d700 1 --1- 172.21.15.32:0/3449054666 >> v1:172.21.15.40:6789/0 conn(0x7fde4c15d600 0x7fde4c0cd9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.32:46026/0 (socket says 172.21.15.32:46026) 2023-10-08T06:09:45.199 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.192+0000 7fde5250f700 1 --2- 172.21.15.32:0/3449054666 >> v2:172.21.15.40:3300/0 conn(0x7fde4c0adfc0 0x7fde4c0ac8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:45.199 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.192+0000 7fde5250f700 1 -- 172.21.15.32:0/3449054666 --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde4c06dfc0 con 0x7fde4c15d600 2023-10-08T06:09:45.199 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.192+0000 7fde5250f700 1 -- 172.21.15.32:0/3449054666 --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde4c0ade50 con 0x7fde4c0703c0 2023-10-08T06:09:45.199 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.192+0000 7f7b957fa700 1 -- 172.21.15.32:0/1153046455 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f7b8c028080 con 0x7f7b980c9950 2023-10-08T06:09:45.200 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.192+0000 7fde5250f700 1 -- 172.21.15.32:0/3449054666 --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde4c15e800 con 0x7fde4c0adfc0 2023-10-08T06:09:45.200 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.192+0000 7fe4593c6700 1 Processor -- start 2023-10-08T06:09:45.200 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.192+0000 7fe4593c6700 1 -- start start 2023-10-08T06:09:45.201 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.192+0000 7fde51d0e700 1 --2- 172.21.15.32:0/3449054666 >> v2:172.21.15.40:3300/0 conn(0x7fde4c0adfc0 0x7fde4c0ac8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:45.201 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.192+0000 7fde43fff700 1 -- 172.21.15.32:0/3449054666 <== mon.1 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3632234202 0 0) 0x7fde4c06dfc0 con 0x7fde4c15d600 2023-10-08T06:09:45.201 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.192+0000 7fde43fff700 1 -- 172.21.15.32:0/3449054666 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fde380035d0 con 0x7fde4c15d600 2023-10-08T06:09:45.201 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.192+0000 7fde51d0e700 1 -- 172.21.15.32:0/3449054666 >> v2:172.21.15.32:3300/0 conn(0x7fde4c0703c0 msgr2=0x7fde4c0ce0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:09:45.201 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.192+0000 7fde51d0e700 1 --2- 172.21.15.32:0/3449054666 >> v2:172.21.15.32:3300/0 conn(0x7fde4c0703c0 0x7fde4c0ce0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:45.201 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.192+0000 7fde51d0e700 1 -- 172.21.15.32:0/3449054666 >> v1:172.21.15.40:6789/0 conn(0x7fde4c15d600 legacy=0x7fde4c0cd9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:45.202 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.192+0000 7fde51d0e700 1 -- 172.21.15.32:0/3449054666 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde4c06e260 con 0x7fde4c0adfc0 2023-10-08T06:09:45.202 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.192+0000 7fde51d0e700 1 --2- 172.21.15.32:0/3449054666 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fde4c0adfc0 0x7fde4c0ac8f0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fde4c0c5e30 tx=0x7fde3c009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e6a07b43497aa911 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:45.202 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.192+0000 7fde43fff700 1 -- 172.21.15.32:0/3449054666 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde3c011830 con 0x7fde4c0adfc0 2023-10-08T06:09:45.202 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.192+0000 7fde43fff700 1 -- 172.21.15.32:0/3449054666 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde3c011990 con 0x7fde4c0adfc0 2023-10-08T06:09:45.202 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.192+0000 7fde43fff700 1 -- 172.21.15.32:0/3449054666 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde3c011d00 con 0x7fde4c0adfc0 2023-10-08T06:09:45.203 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.192+0000 7fe4593c6700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fe45415b200 0x7fe45406c020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:45.203 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.192+0000 7fe4593c6700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe45415b5e0 0x7fe45406c560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:45.203 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.192+0000 7fe4593c6700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4540cda50 con 0x7fe4540cc370 2023-10-08T06:09:45.203 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.192+0000 7fe4593c6700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4540cc800 con 0x7fe45415b200 2023-10-08T06:09:45.203 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.192+0000 7fe4593c6700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe45406dfd0 con 0x7fe45415b5e0 2023-10-08T06:09:45.203 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.192+0000 7fe453fff700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fe45415b200 0x7fe45406c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:45.203 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.192+0000 7fe4537fe700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fe4540cc370 0x7fe4540b1c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:46228/0 (socket says 172.21.15.32:46228) 2023-10-08T06:09:45.203 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.192+0000 7fe4537fe700 1 -- 172.21.15.32:0/1639088501 learned_addr learned my addr 172.21.15.32:0/1639088501 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-08T06:09:45.203 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.192+0000 7fe458bc5700 1 --2- 172.21.15.32:0/1639088501 >> v2:172.21.15.40:3300/0 conn(0x7fe45415b5e0 0x7fe45406c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:45.204 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.192+0000 7fde5250f700 1 -- 172.21.15.32:0/3449054666 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fde4c0adfc0 msgr2=0x7fde4c0ac8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:45.204 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.192+0000 7fde5250f700 1 --2- 172.21.15.32:0/3449054666 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fde4c0adfc0 0x7fde4c0ac8f0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fde4c0c5e30 tx=0x7fde3c009b30 comp rx=0 tx=0).stop 2023-10-08T06:09:45.204 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.192+0000 7fe453fff700 1 -- 172.21.15.32:0/1639088501 >> v2:172.21.15.40:3300/0 conn(0x7fe45415b5e0 msgr2=0x7fe45406c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:09:45.204 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.192+0000 7fe453fff700 1 --2- 172.21.15.32:0/1639088501 >> v2:172.21.15.40:3300/0 conn(0x7fe45415b5e0 0x7fe45406c560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:45.204 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.192+0000 7fe453fff700 1 -- 172.21.15.32:0/1639088501 >> v1:172.21.15.32:6789/0 conn(0x7fe4540cc370 legacy=0x7fe4540b1c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:45.204 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.192+0000 7fe453fff700 1 -- 172.21.15.32:0/1639088501 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe45406e270 con 0x7fe45415b200 2023-10-08T06:09:45.204 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.192+0000 7fe453fff700 1 --2- 172.21.15.32:0/1639088501 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe45415b200 0x7fe45406c020 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fe4540c93b0 tx=0x7fe448009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=874ccdf46999fc81 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:45.205 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.192+0000 7fde5250f700 1 -- 172.21.15.32:0/3449054666 shutdown_connections 2023-10-08T06:09:45.205 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.192+0000 7fde5250f700 1 --2- 172.21.15.32:0/3449054666 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fde4c0adfc0 0x7fde4c0ac8f0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:45.205 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.192+0000 7fde5250f700 1 --2- 172.21.15.32:0/3449054666 >> v2:172.21.15.32:3300/0 conn(0x7fde4c0703c0 0x7fde4c0ce0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:45.205 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.192+0000 7fde5250f700 1 -- 172.21.15.32:0/3449054666 >> 172.21.15.32:0/3449054666 conn(0x7fde4c0cb850 msgr2=0x7fde4c0cbc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:09:45.205 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.192+0000 7fe452ffd700 1 -- 172.21.15.32:0/1639088501 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe448011830 con 0x7fe45415b200 2023-10-08T06:09:45.206 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.192+0000 7fe452ffd700 1 -- 172.21.15.32:0/1639088501 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe448011990 con 0x7fe45415b200 2023-10-08T06:09:45.206 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.192+0000 7fe452ffd700 1 -- 172.21.15.32:0/1639088501 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe448011d20 con 0x7fe45415b200 2023-10-08T06:09:45.206 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.192+0000 7fde5250f700 1 -- 172.21.15.32:0/3449054666 shutdown_connections 2023-10-08T06:09:45.206 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.192+0000 7fde5250f700 1 -- 172.21.15.32:0/3449054666 wait complete. 2023-10-08T06:09:45.207 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.196+0000 7fe4593c6700 1 -- 172.21.15.32:0/1639088501 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe45415b200 msgr2=0x7fe45406c020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:45.207 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.196+0000 7fe4593c6700 1 --2- 172.21.15.32:0/1639088501 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe45415b200 0x7fe45406c020 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fe4540c93b0 tx=0x7fe448009b30 comp rx=0 tx=0).stop 2023-10-08T06:09:45.207 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.196+0000 7fe4593c6700 1 -- 172.21.15.32:0/1639088501 shutdown_connections 2023-10-08T06:09:45.207 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.196+0000 7fe4593c6700 1 --2- 172.21.15.32:0/1639088501 >> v2:172.21.15.40:3300/0 conn(0x7fe45415b5e0 0x7fe45406c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:45.207 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.196+0000 7fe4593c6700 1 --2- 172.21.15.32:0/1639088501 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe45415b200 0x7fe45406c020 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:45.207 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.196+0000 7fe4593c6700 1 -- 172.21.15.32:0/1639088501 >> 172.21.15.32:0/1639088501 conn(0x7fe4540cb850 msgr2=0x7fe4540cbc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:09:45.207 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.196+0000 7fe4593c6700 1 -- 172.21.15.32:0/1639088501 shutdown_connections 2023-10-08T06:09:45.207 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.196+0000 7fe4593c6700 1 -- 172.21.15.32:0/1639088501 wait complete. 2023-10-08T06:09:45.208 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.196+0000 7f5e3eb02700 1 Processor -- start 2023-10-08T06:09:45.208 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.196+0000 7fde5250f700 1 Processor -- start 2023-10-08T06:09:45.208 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.196+0000 7fde5250f700 1 -- start start 2023-10-08T06:09:45.208 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.196+0000 7fde5250f700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fde4c0703c0 0x7fde4c1570d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:45.208 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.196+0000 7fde5250f700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fde4c0adfc0 0x7fde4c06d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:45.208 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.196+0000 7fde5250f700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fde4c15d600 0x7fde4c15b450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:45.209 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.196+0000 7fe4593c6700 1 Processor -- start 2023-10-08T06:09:45.209 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.196+0000 7fde5250f700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde4c15f600 con 0x7fde4c0703c0 2023-10-08T06:09:45.209 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.196+0000 7fde5250f700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde4c15f080 con 0x7fde4c15d600 2023-10-08T06:09:45.209 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.196+0000 7fde5250f700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde4c06c8a0 con 0x7fde4c0adfc0 2023-10-08T06:09:45.209 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.196+0000 7fde5150d700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fde4c0703c0 0x7fde4c1570d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:45.209 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.196+0000 7fde5150d700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fde4c0703c0 0x7fde4c1570d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:59616/0 (socket says 172.21.15.32:59616) 2023-10-08T06:09:45.210 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.196+0000 7fde5150d700 1 -- 172.21.15.32:0/1369194311 learned_addr learned my addr 172.21.15.32:0/1369194311 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:09:45.210 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.196+0000 7fde50d0c700 1 --2- 172.21.15.32:0/1369194311 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fde4c0adfc0 0x7fde4c06d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:45.210 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.196+0000 7fde51d0e700 1 --2- 172.21.15.32:0/1369194311 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fde4c15d600 0x7fde4c15b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:45.210 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.196+0000 7fde5150d700 1 -- 172.21.15.32:0/1369194311 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fde4c0adfc0 msgr2=0x7fde4c06d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:45.210 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.196+0000 7fde5150d700 1 --2- 172.21.15.32:0/1369194311 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fde4c0adfc0 0x7fde4c06d060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:45.210 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.196+0000 7fde5150d700 1 -- 172.21.15.32:0/1369194311 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fde4c15d600 msgr2=0x7fde4c15b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:45.210 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.196+0000 7fde5150d700 1 --2- 172.21.15.32:0/1369194311 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fde4c15d600 0x7fde4c15b450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:45.210 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.196+0000 7fde5150d700 1 -- 172.21.15.32:0/1369194311 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde3c0094b0 con 0x7fde4c0703c0 2023-10-08T06:09:45.211 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.196+0000 7fe4593c6700 1 -- start start 2023-10-08T06:09:45.211 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.196+0000 7fe4593c6700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe45415b200 0x7fe4541f03a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:45.211 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.196+0000 7fe4593c6700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe45415b5e0 0x7fe4541e0730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:45.211 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.196+0000 7fe4593c6700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe4541e0c70 0x7fe4540b2c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:45.211 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.196+0000 7fe4593c6700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4541e1100 con 0x7fe45415b200 2023-10-08T06:09:45.211 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.196+0000 7fe4593c6700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe45414cf00 con 0x7fe45415b5e0 2023-10-08T06:09:45.211 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.196+0000 7fe4593c6700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4540c5f40 con 0x7fe4541e0c70 2023-10-08T06:09:45.212 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.196+0000 7fde5150d700 1 --2- 172.21.15.32:0/1369194311 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fde4c0703c0 0x7fde4c1570d0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fde4400cc50 tx=0x7fde4400cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:45.212 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.196+0000 7fe453fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe45415b200 0x7fe4541f03a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:45.212 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.196+0000 7fe453fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe45415b200 0x7fe4541f03a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:59622/0 (socket says 172.21.15.32:59622) 2023-10-08T06:09:45.212 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.196+0000 7fe453fff700 1 -- 172.21.15.32:0/1320792193 learned_addr learned my addr 172.21.15.32:0/1320792193 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:09:45.212 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.196+0000 7fe4537fe700 1 --2- 172.21.15.32:0/1320792193 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe45415b5e0 0x7fe4541e0730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:45.213 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.196+0000 7fe458bc5700 1 --2- 172.21.15.32:0/1320792193 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe4541e0c70 0x7fe4540b2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:45.213 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.200+0000 7fe453fff700 1 -- 172.21.15.32:0/1320792193 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe4541e0c70 msgr2=0x7fe4540b2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:45.213 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.200+0000 7fe453fff700 1 --2- 172.21.15.32:0/1320792193 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe4541e0c70 0x7fe4540b2c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:45.213 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.200+0000 7fe453fff700 1 -- 172.21.15.32:0/1320792193 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe45415b5e0 msgr2=0x7fe4541e0730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:45.213 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.200+0000 7fe453fff700 1 --2- 172.21.15.32:0/1320792193 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe45415b5e0 0x7fe4541e0730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:45.213 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.200+0000 7fe453fff700 1 -- 172.21.15.32:0/1320792193 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4480094b0 con 0x7fe45415b200 2023-10-08T06:09:45.213 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.200+0000 7fdaa27fc700 1 -- 172.21.15.32:0/2420353570 <== mon.2 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fdaa4051da0 con 0x7fdaac0c9960 2023-10-08T06:09:45.214 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.200+0000 7fe453fff700 1 --2- 172.21.15.32:0/1320792193 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe45415b200 0x7fe4541f03a0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fe448009b70 tx=0x7fe448004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:45.214 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.200+0000 7fde41ffb700 1 -- 172.21.15.32:0/1369194311 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde4400aa70 con 0x7fde4c0703c0 2023-10-08T06:09:45.215 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.200+0000 7fde41ffb700 1 -- 172.21.15.32:0/1369194311 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde4400abd0 con 0x7fde4c0703c0 2023-10-08T06:09:45.215 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.200+0000 7fde41ffb700 1 -- 172.21.15.32:0/1369194311 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde44007070 con 0x7fde4c0703c0 2023-10-08T06:09:45.215 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.200+0000 7fde5250f700 1 -- 172.21.15.32:0/1369194311 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde4c15f320 con 0x7fde4c0703c0 2023-10-08T06:09:45.215 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.200+0000 7fde5250f700 1 -- 172.21.15.32:0/1369194311 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde4c06d5a0 con 0x7fde4c0703c0 2023-10-08T06:09:45.215 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.204+0000 7fde41ffb700 1 -- 172.21.15.32:0/1369194311 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fde440071d0 con 0x7fde4c0703c0 2023-10-08T06:09:45.215 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.204+0000 7fde41ffb700 1 --2- 172.21.15.32:0/1369194311 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fde30066560 0x7fde30068a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:45.215 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.204+0000 7fde41ffb700 1 -- 172.21.15.32:0/1369194311 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fde44083af0 con 0x7fde4c0703c0 2023-10-08T06:09:45.215 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.204+0000 7fde50d0c700 1 --2- 172.21.15.32:0/1369194311 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fde30066560 0x7fde30068a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:45.216 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.200+0000 7fe450ff9700 1 -- 172.21.15.32:0/1320792193 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe448004480 con 0x7fe45415b200 2023-10-08T06:09:45.216 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.200+0000 7fe450ff9700 1 -- 172.21.15.32:0/1320792193 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe448023070 con 0x7fe45415b200 2023-10-08T06:09:45.216 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.200+0000 7fe450ff9700 1 -- 172.21.15.32:0/1320792193 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe44801fa60 con 0x7fe45415b200 2023-10-08T06:09:45.216 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.200+0000 7fe4593c6700 1 -- 172.21.15.32:0/1320792193 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4540c61b0 con 0x7fe45415b200 2023-10-08T06:09:45.216 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.200+0000 7fe4593c6700 1 -- 172.21.15.32:0/1320792193 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4540c6770 con 0x7fe45415b200 2023-10-08T06:09:45.216 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.200+0000 7fe450ff9700 1 -- 172.21.15.32:0/1320792193 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fe448025030 con 0x7fe45415b200 2023-10-08T06:09:45.216 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.200+0000 7fe450ff9700 1 --2- 172.21.15.32:0/1320792193 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fe43c066650 0x7fe43c068b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:45.216 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.200+0000 7fe4593c6700 1 -- 172.21.15.32:0/1320792193 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe440005310 con 0x7fe45415b200 2023-10-08T06:09:45.216 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.200+0000 7fe450ff9700 1 -- 172.21.15.32:0/1320792193 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe448084c60 con 0x7fe45415b200 2023-10-08T06:09:45.216 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.200+0000 7fe4537fe700 1 --2- 172.21.15.32:0/1320792193 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fe43c066650 0x7fe43c068b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:45.217 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.204+0000 7fe4537fe700 1 --2- 172.21.15.32:0/1320792193 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fe43c066650 0x7fe43c068b10 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fe454158b60 tx=0x7fe44c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:45.217 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.204+0000 7fde50d0c700 1 --2- 172.21.15.32:0/1369194311 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fde30066560 0x7fde30068a20 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fde4c0c8ea0 tx=0x7fde48008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:45.217 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.204+0000 7fde5250f700 1 -- 172.21.15.32:0/1369194311 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde4c06c700 con 0x7fde4c0703c0 2023-10-08T06:09:45.218 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.204+0000 7f5e3eb02700 1 -- start start 2023-10-08T06:09:45.218 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.204+0000 7f5e3eb02700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5e381597f0 0x7f5e380ce190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:45.218 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.204+0000 7f5e3eb02700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e380cd290 con 0x7f5e3806c6d0 2023-10-08T06:09:45.218 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.204+0000 7f5e3eb02700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e380cec10 con 0x7f5e38159bd0 2023-10-08T06:09:45.218 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.204+0000 7f5e3eb02700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e380cc9a0 con 0x7f5e381597f0 2023-10-08T06:09:45.218 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.204+0000 7f5e3e301700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f5e3806c6d0 0x7f5e380c9b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:46230/0 (socket says 172.21.15.32:46230) 2023-10-08T06:09:45.218 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.204+0000 7f5e3e301700 1 -- 172.21.15.32:0/3175010912 learned_addr learned my addr 172.21.15.32:0/3175010912 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-08T06:09:45.218 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.204+0000 7f5e3cafe700 1 -- 172.21.15.32:0/3175010912 <== mon.1 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3999461257 0 0) 0x7f5e380cec10 con 0x7f5e38159bd0 2023-10-08T06:09:45.219 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.204+0000 7f0f6ae38700 1 Processor -- start 2023-10-08T06:09:45.219 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.204+0000 7f5e3cafe700 1 -- 172.21.15.32:0/3175010912 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5e240035d0 con 0x7f5e38159bd0 2023-10-08T06:09:45.219 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.204+0000 7f0f6ae38700 1 -- start start 2023-10-08T06:09:45.220 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.204+0000 7f5e3db00700 1 --2- 172.21.15.32:0/3175010912 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5e381597f0 0x7f5e380ce190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:45.220 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.204+0000 7f5e3cafe700 1 -- 172.21.15.32:0/3175010912 <== mon.1 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1763703249 0 0) 0x7f5e240035d0 con 0x7f5e38159bd0 2023-10-08T06:09:45.221 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.204+0000 7f5e3cafe700 1 -- 172.21.15.32:0/3175010912 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5e381597f0 msgr2=0x7f5e380ce190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:09:45.221 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.204+0000 7f5e3cafe700 1 --2- 172.21.15.32:0/3175010912 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5e381597f0 0x7f5e380ce190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:45.221 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.204+0000 7f5e3cafe700 1 -- 172.21.15.32:0/3175010912 >> v1:172.21.15.32:6789/0 conn(0x7f5e3806c6d0 legacy=0x7f5e380c9b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:45.221 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.204+0000 7f5e3cafe700 1 -- 172.21.15.32:0/3175010912 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e3806ce00 con 0x7f5e38159bd0 2023-10-08T06:09:45.221 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.204+0000 7f5e3cafe700 1 -- 172.21.15.32:0/3175010912 <== mon.1 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2364763317 0 0) 0x7f5e28001670 con 0x7f5e38159bd0 2023-10-08T06:09:45.221 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.204+0000 7f5e3cafe700 1 -- 172.21.15.32:0/3175010912 >> v1:172.21.15.40:6789/0 conn(0x7f5e38159bd0 legacy=0x7f5e380cd720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:45.221 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.204+0000 7f5e3cafe700 1 --2- 172.21.15.32:0/3175010912 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5e24003a20 0x7f5e24003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:45.221 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.204+0000 7f5e3db00700 1 --2- 172.21.15.32:0/3175010912 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5e24003a20 0x7f5e24003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:45.221 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.204+0000 7f5e3cafe700 1 --2- 172.21.15.32:0/3175010912 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5e381597f0 0x7f5e24004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:45.221 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.208+0000 7f5e3cafe700 1 --2- 172.21.15.32:0/3175010912 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5e24004db0 0x7f5e24005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:45.221 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.208+0000 7f5e3cafe700 1 -- 172.21.15.32:0/3175010912 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e380cc9a0 con 0x7f5e24003a20 2023-10-08T06:09:45.222 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.208+0000 7f5e3cafe700 1 -- 172.21.15.32:0/3175010912 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e2400bbf0 con 0x7f5e24004db0 2023-10-08T06:09:45.222 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.208+0000 7f5e3cafe700 1 -- 172.21.15.32:0/3175010912 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e2400bdb0 con 0x7f5e381597f0 2023-10-08T06:09:45.222 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.208+0000 7f5e3d2ff700 1 --2- 172.21.15.32:0/3175010912 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5e381597f0 0x7f5e24004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:45.222 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.208+0000 7f5e3e301700 1 --2- 172.21.15.32:0/3175010912 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5e24004db0 0x7f5e24005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:45.222 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.208+0000 7f5e3db00700 1 -- 172.21.15.32:0/3175010912 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5e381597f0 msgr2=0x7f5e24004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:09:45.222 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.208+0000 7f5e3db00700 1 --2- 172.21.15.32:0/3175010912 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5e381597f0 0x7f5e24004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:45.222 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.208+0000 7f5e3db00700 1 -- 172.21.15.32:0/3175010912 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5e24004db0 msgr2=0x7f5e24005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:09:45.222 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.208+0000 7f5e3db00700 1 --2- 172.21.15.32:0/3175010912 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5e24004db0 0x7f5e24005230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:45.222 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.208+0000 7f5e3db00700 1 -- 172.21.15.32:0/3175010912 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e240035d0 con 0x7f5e24003a20 2023-10-08T06:09:45.223 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.208+0000 7f0f6ae38700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f0f6415a0f0 0x7f0f640cc370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:45.223 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.208+0000 7f0f6ae38700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f0f6415ad10 0x7f0f6415b180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:45.223 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.208+0000 7f0f6ae38700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f6415a830 con 0x7f0f6415dc10 2023-10-08T06:09:45.223 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.208+0000 7f0f6ae38700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f6415ebc0 con 0x7f0f6415ad10 2023-10-08T06:09:45.223 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.208+0000 7f0f6ae38700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f6415e070 con 0x7f0f6415a0f0 2023-10-08T06:09:45.223 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.208+0000 7f0f6a637700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f0f6415ad10 0x7f0f6415b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:45.223 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.208+0000 7f5e3db00700 1 --2- 172.21.15.32:0/3175010912 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5e24003a20 0x7f5e24003e40 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f5e340098b0 tx=0x7f5e240058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecf91a42f875a594 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:45.224 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.208+0000 7f0f6a637700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f0f6415ad10 0x7f0f6415b180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:59648/0 (socket says 172.21.15.32:59648) 2023-10-08T06:09:45.224 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.208+0000 7f0f6a637700 1 -- 172.21.15.32:0/3670462432 learned_addr learned my addr 172.21.15.32:0/3670462432 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:09:45.224 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.208+0000 7f0f69e36700 1 --2- 172.21.15.32:0/3670462432 >> v2:172.21.15.40:3300/0 conn(0x7f0f6415a0f0 0x7f0f640cc370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:45.224 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.208+0000 7f0f6a637700 1 -- 172.21.15.32:0/3670462432 >> v2:172.21.15.40:3300/0 conn(0x7f0f6415a0f0 msgr2=0x7f0f640cc370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:09:45.224 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.208+0000 7f0f6a637700 1 --2- 172.21.15.32:0/3670462432 >> v2:172.21.15.40:3300/0 conn(0x7f0f6415a0f0 0x7f0f640cc370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:45.225 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.208+0000 7f0f6a637700 1 -- 172.21.15.32:0/3670462432 >> v1:172.21.15.40:6789/0 conn(0x7f0f6415dc10 legacy=0x7f0f640cd9b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-08T06:09:45.225 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.208+0000 7f0f6a637700 1 -- 172.21.15.32:0/3670462432 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f6415e320 con 0x7f0f6415ad10 2023-10-08T06:09:45.225 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.208+0000 7f0f6a637700 1 --2- 172.21.15.32:0/3670462432 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0f6415ad10 0x7f0f6415b180 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f0f64069ac0 tx=0x7f0f60009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9559cd43a00144c0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:45.225 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.208+0000 7fe450ff9700 1 -- 172.21.15.32:0/1320792193 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fe448052290 con 0x7fe45415b200 2023-10-08T06:09:45.225 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.216+0000 7f5e3cafe700 1 -- 172.21.15.32:0/3175010912 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e3400c070 con 0x7f5e24003a20 2023-10-08T06:09:45.226 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.216+0000 7f5e3cafe700 1 -- 172.21.15.32:0/3175010912 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e34013610 con 0x7f5e24003a20 2023-10-08T06:09:45.226 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.216+0000 7f5e3cafe700 1 -- 172.21.15.32:0/3175010912 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e340139c0 con 0x7f5e24003a20 2023-10-08T06:09:45.226 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.216+0000 7f0f68e34700 1 -- 172.21.15.32:0/3670462432 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f60004230 con 0x7f0f6415ad10 2023-10-08T06:09:45.226 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.216+0000 7f0f68e34700 1 -- 172.21.15.32:0/3670462432 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f60004390 con 0x7f0f6415ad10 2023-10-08T06:09:45.226 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.216+0000 7fde41ffb700 1 -- 172.21.15.32:0/1369194311 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fde4c06c700 con 0x7fde4c0703c0 2023-10-08T06:09:45.227 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.216+0000 7f5e3eb02700 1 -- 172.21.15.32:0/3175010912 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5e24003a20 msgr2=0x7f5e24003e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:45.227 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.216+0000 7f5e3eb02700 1 --2- 172.21.15.32:0/3175010912 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5e24003a20 0x7f5e24003e40 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f5e340098b0 tx=0x7f5e240058a0 comp rx=0 tx=0).stop 2023-10-08T06:09:45.227 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.216+0000 7f5e3e301700 1 -- 172.21.15.32:0/3175010912 reap_dead start 2023-10-08T06:09:45.227 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.216+0000 7f0f6ae38700 1 -- 172.21.15.32:0/3670462432 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0f6415ad10 msgr2=0x7f0f6415b180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:45.227 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.216+0000 7f0f6ae38700 1 --2- 172.21.15.32:0/3670462432 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0f6415ad10 0x7f0f6415b180 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f0f64069ac0 tx=0x7f0f60009bf0 comp rx=0 tx=0).stop 2023-10-08T06:09:45.227 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.216+0000 7f0f6ae38700 1 -- 172.21.15.32:0/3670462432 shutdown_connections 2023-10-08T06:09:45.228 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.216+0000 7f0f6ae38700 1 --2- 172.21.15.32:0/3670462432 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0f6415ad10 0x7f0f6415b180 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:45.228 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.216+0000 7f0f6ae38700 1 --2- 172.21.15.32:0/3670462432 >> v2:172.21.15.40:3300/0 conn(0x7f0f6415a0f0 0x7f0f640cc370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:45.228 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.216+0000 7f0f6ae38700 1 -- 172.21.15.32:0/3670462432 >> 172.21.15.32:0/3670462432 conn(0x7f0f640cb850 msgr2=0x7f0f640cbc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:09:45.228 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.216+0000 7f5e3eb02700 1 -- 172.21.15.32:0/3175010912 shutdown_connections 2023-10-08T06:09:45.228 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.216+0000 7f5e3eb02700 1 -- 172.21.15.32:0/3175010912 >> 172.21.15.32:0/3175010912 conn(0x7f5e380b0900 msgr2=0x7f5e380b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:09:45.228 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.216+0000 7f0f6ae38700 1 -- 172.21.15.32:0/3670462432 shutdown_connections 2023-10-08T06:09:45.229 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.216+0000 7f5e3eb02700 1 -- 172.21.15.32:0/3175010912 shutdown_connections 2023-10-08T06:09:45.229 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.216+0000 7f5e3eb02700 1 -- 172.21.15.32:0/3175010912 wait complete. 2023-10-08T06:09:45.229 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.216+0000 7f5e3eb02700 1 Processor -- start 2023-10-08T06:09:45.229 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.216+0000 7f0f6ae38700 1 -- 172.21.15.32:0/3670462432 wait complete. 2023-10-08T06:09:45.230 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.216+0000 7f5e3eb02700 1 -- start start 2023-10-08T06:09:45.230 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.220+0000 7f5e3eb02700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5e24003a20 0x7f5e380b38e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:45.230 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.220+0000 7f0f6ae38700 1 Processor -- start 2023-10-08T06:09:45.230 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.220+0000 7f0f6ae38700 1 -- start start 2023-10-08T06:09:45.231 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.220+0000 7f5e3db00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5e24003a20 0x7f5e380b38e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:45.231 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.220+0000 7f5e3db00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5e24003a20 0x7f5e380b38e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:59654/0 (socket says 172.21.15.32:59654) 2023-10-08T06:09:45.231 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.220+0000 7f5e3db00700 1 -- 172.21.15.32:0/3437851501 learned_addr learned my addr 172.21.15.32:0/3437851501 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:09:45.232 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.220+0000 7f5e3eb02700 1 --2- 172.21.15.32:0/3437851501 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5e38144330 0x7f5e38147310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:45.232 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.220+0000 7f5e3eb02700 1 --2- 172.21.15.32:0/3437851501 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5e38145a30 0x7f5e38145ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:45.232 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.220+0000 7f5e3eb02700 1 -- 172.21.15.32:0/3437851501 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e3815a1e0 con 0x7f5e24003a20 2023-10-08T06:09:45.232 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.220+0000 7f5e3eb02700 1 -- 172.21.15.32:0/3437851501 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e38143b70 con 0x7f5e38144330 2023-10-08T06:09:45.232 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.220+0000 7f5e3eb02700 1 -- 172.21.15.32:0/3437851501 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e38143f50 con 0x7f5e38145a30 2023-10-08T06:09:45.232 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.220+0000 7f5e3d2ff700 1 --2- 172.21.15.32:0/3437851501 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5e38144330 0x7f5e38147310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:45.232 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.220+0000 7f0f6ae38700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0f6415a0f0 0x7f0f641448a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:45.233 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.220+0000 7f5e3db00700 1 -- 172.21.15.32:0/3437851501 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5e38145a30 msgr2=0x7f5e38145ee0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T06:09:45.233 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.220+0000 7f5e3db00700 1 --2- 172.21.15.32:0/3437851501 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5e38145a30 0x7f5e38145ee0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:45.233 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.220+0000 7f5e3db00700 1 -- 172.21.15.32:0/3437851501 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5e38144330 msgr2=0x7f5e38147310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:45.233 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.220+0000 7f5e3db00700 1 --2- 172.21.15.32:0/3437851501 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5e38144330 0x7f5e38147310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:45.233 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.220+0000 7f5e3db00700 1 -- 172.21.15.32:0/3437851501 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e380b3fb0 con 0x7f5e24003a20 2023-10-08T06:09:45.234 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.220+0000 7f0f6ae38700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0f6415ad10 0x7f0f640ccd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:45.234 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.220+0000 7f0f69e36700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0f6415a0f0 0x7f0f641448a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:45.234 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.220+0000 7f0f69e36700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0f6415a0f0 0x7f0f641448a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:59664/0 (socket says 172.21.15.32:59664) 2023-10-08T06:09:45.234 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.220+0000 7f0f69e36700 1 -- 172.21.15.32:0/1055021483 learned_addr learned my addr 172.21.15.32:0/1055021483 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:09:45.234 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.220+0000 7f0f6ae38700 1 --2- 172.21.15.32:0/1055021483 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0f6415dc10 0x7f0f640cd2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:45.234 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.220+0000 7f0f6ae38700 1 -- 172.21.15.32:0/1055021483 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f640c7480 con 0x7f0f6415a0f0 2023-10-08T06:09:45.234 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.220+0000 7f0f6ae38700 1 -- 172.21.15.32:0/1055021483 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f640c8000 con 0x7f0f6415ad10 2023-10-08T06:09:45.234 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.220+0000 7f0f6ae38700 1 -- 172.21.15.32:0/1055021483 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f640c8490 con 0x7f0f6415dc10 2023-10-08T06:09:45.235 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.220+0000 7f5e3db00700 1 --2- 172.21.15.32:0/3437851501 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5e24003a20 0x7f5e380b38e0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f5e3400a010 tx=0x7f5e340047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:45.235 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.220+0000 7f0f69e36700 1 -- 172.21.15.32:0/1055021483 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0f6415dc10 msgr2=0x7f0f640cd2d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T06:09:45.235 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.220+0000 7f0f69e36700 1 --2- 172.21.15.32:0/1055021483 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0f6415dc10 0x7f0f640cd2d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:45.235 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.220+0000 7f0f69e36700 1 -- 172.21.15.32:0/1055021483 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0f6415ad10 msgr2=0x7f0f640ccd90 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-08T06:09:45.235 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.220+0000 7f0f69e36700 1 --2- 172.21.15.32:0/1055021483 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0f6415ad10 0x7f0f640ccd90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:45.235 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.220+0000 7f0f69e36700 1 -- 172.21.15.32:0/1055021483 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f60009570 con 0x7f0f6415a0f0 2023-10-08T06:09:45.236 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.220+0000 7f5e2e7fc700 1 -- 172.21.15.32:0/3437851501 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e34013b90 con 0x7f5e24003a20 2023-10-08T06:09:45.236 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.220+0000 7f5e3eb02700 1 -- 172.21.15.32:0/3437851501 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e380b4290 con 0x7f5e24003a20 2023-10-08T06:09:45.236 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.220+0000 7f5e3eb02700 1 -- 172.21.15.32:0/3437851501 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e380b4850 con 0x7f5e24003a20 2023-10-08T06:09:45.236 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.220+0000 7f0f69e36700 1 --2- 172.21.15.32:0/1055021483 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0f6415a0f0 0x7f0f641448a0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f0f5c00ef00 tx=0x7f0f5c00b0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:45.237 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.220+0000 7f5e2e7fc700 1 -- 172.21.15.32:0/3437851501 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e34013d10 con 0x7f5e24003a20 2023-10-08T06:09:45.237 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.220+0000 7f5e2e7fc700 1 -- 172.21.15.32:0/3437851501 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e34003900 con 0x7f5e24003a20 2023-10-08T06:09:45.237 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.220+0000 7f0f5a7fc700 1 -- 172.21.15.32:0/1055021483 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f5c010040 con 0x7f0f6415a0f0 2023-10-08T06:09:45.237 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.220+0000 7f0f6ae38700 1 -- 172.21.15.32:0/1055021483 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f640c76d0 con 0x7f0f6415a0f0 2023-10-08T06:09:45.237 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.224+0000 7f0f6ae38700 1 -- 172.21.15.32:0/1055021483 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f640c7c90 con 0x7f0f6415a0f0 2023-10-08T06:09:45.238 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.224+0000 7f0f5a7fc700 1 -- 172.21.15.32:0/1055021483 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f5c00bb90 con 0x7f0f6415a0f0 2023-10-08T06:09:45.238 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.224+0000 7f0f5a7fc700 1 -- 172.21.15.32:0/1055021483 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f5c014400 con 0x7f0f6415a0f0 2023-10-08T06:09:45.238 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.224+0000 7f5e2e7fc700 1 -- 172.21.15.32:0/3437851501 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f5e34003a60 con 0x7f5e24003a20 2023-10-08T06:09:45.238 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.224+0000 7f5e2e7fc700 1 --2- 172.21.15.32:0/3437851501 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f5e1c0665e0 0x7f5e1c068aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:45.238 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.224+0000 7f5e2e7fc700 1 -- 172.21.15.32:0/3437851501 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5e34085200 con 0x7f5e24003a20 2023-10-08T06:09:45.238 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.224+0000 7f0f5a7fc700 1 -- 172.21.15.32:0/1055021483 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f0f5c014560 con 0x7f0f6415a0f0 2023-10-08T06:09:45.239 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.224+0000 7f5e3d2ff700 1 --2- 172.21.15.32:0/3437851501 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f5e1c0665e0 0x7f5e1c068aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:45.239 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.224+0000 7f0f5a7fc700 1 --2- 172.21.15.32:0/1055021483 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f0f480665e0 0x7f0f48068aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:45.239 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.224+0000 7f0f5a7fc700 1 -- 172.21.15.32:0/1055021483 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0f5c084230 con 0x7f0f6415a0f0 2023-10-08T06:09:45.239 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.232+0000 7f0f69635700 1 --2- 172.21.15.32:0/1055021483 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f0f480665e0 0x7f0f48068aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:45.240 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.232+0000 7f5e3eb02700 1 -- 172.21.15.32:0/3437851501 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e20005310 con 0x7f5e24003a20 2023-10-08T06:09:45.240 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.232+0000 7f5e3d2ff700 1 --2- 172.21.15.32:0/3437851501 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f5e1c0665e0 0x7f5e1c068aa0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f5e38071850 tx=0x7f5e28009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:45.240 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.232+0000 7f0f69635700 1 --2- 172.21.15.32:0/1055021483 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f0f480665e0 0x7f0f48068aa0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f0f64151910 tx=0x7f0f54006c80 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:45.240 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.232+0000 7f0f6ae38700 1 -- 172.21.15.32:0/1055021483 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f4c005310 con 0x7f0f6415a0f0 2023-10-08T06:09:45.241 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.240+0000 7f5e2e7fc700 1 -- 172.21.15.32:0/3437851501 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f5e340526f0 con 0x7f5e24003a20 2023-10-08T06:09:45.251 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.252+0000 7f0f5a7fc700 1 -- 172.21.15.32:0/1055021483 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f0f5c0517a0 con 0x7f0f6415a0f0 2023-10-08T06:09:45.467 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.468+0000 7f98a553a700 1 -- 172.21.15.32:0/3191355152 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f9880005180 con 0x7f98a015a440 2023-10-08T06:09:45.468 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.468+0000 7f98877fe700 1 -- 172.21.15.32:0/3191355152 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f98980558f0 con 0x7f98a015a440 2023-10-08T06:09:45.470 INFO:teuthology.orchestra.run.smithi032.stdout:64424509446 2023-10-08T06:09:45.472 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.472+0000 7f98857fa700 1 -- 172.21.15.32:0/3191355152 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f988c066510 msgr2=0x7f988c0689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:45.472 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.472+0000 7f98857fa700 1 --2- 172.21.15.32:0/3191355152 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f988c066510 0x7f988c0689d0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f9890009f40 tx=0x7f9890009240 comp rx=0 tx=0).stop 2023-10-08T06:09:45.472 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.472+0000 7f98857fa700 1 -- 172.21.15.32:0/3191355152 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f98a015a440 msgr2=0x7f98a01f9ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:45.472 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.472+0000 7f98857fa700 1 --2- 172.21.15.32:0/3191355152 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f98a015a440 0x7f98a01f9ac0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f9898004000 tx=0x7f9898004b60 comp rx=0 tx=0).stop 2023-10-08T06:09:45.473 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.472+0000 7f98857fa700 1 -- 172.21.15.32:0/3191355152 shutdown_connections 2023-10-08T06:09:45.473 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.472+0000 7f98857fa700 1 --2- 172.21.15.32:0/3191355152 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f988c066510 0x7f988c0689d0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:45.473 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.472+0000 7f98857fa700 1 --2- 172.21.15.32:0/3191355152 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f98a015a440 0x7f98a01f9ac0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:45.473 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.472+0000 7f98857fa700 1 --2- 172.21.15.32:0/3191355152 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f98a01599e0 0x7f98a00b43d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:45.473 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.472+0000 7f98857fa700 1 --2- 172.21.15.32:0/3191355152 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f98a0070a90 0x7f98a0142a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:45.474 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.472+0000 7f98857fa700 1 -- 172.21.15.32:0/3191355152 >> 172.21.15.32:0/3191355152 conn(0x7f98a00cb850 msgr2=0x7f98a00c9700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:09:45.474 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.472+0000 7f98857fa700 1 -- 172.21.15.32:0/3191355152 shutdown_connections 2023-10-08T06:09:45.474 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.472+0000 7f98857fa700 1 -- 172.21.15.32:0/3191355152 wait complete. 2023-10-08T06:09:45.483 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.480+0000 7f8c44870700 1 -- 172.21.15.32:0/1362928725 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f8c240055c0 con 0x7f8c400c21a0 2023-10-08T06:09:45.484 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.484+0000 7f8c2effd700 1 -- 172.21.15.32:0/1362928725 <== mon.1 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8c38055aa0 con 0x7f8c400c21a0 2023-10-08T06:09:45.487 INFO:teuthology.orchestra.run.smithi032.stdout:64424509447 2023-10-08T06:09:45.487 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509446 for osd.1 2023-10-08T06:09:45.487 DEBUG:teuthology.parallel:result is None 2023-10-08T06:09:45.493 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.492+0000 7f8c2cff9700 1 -- 172.21.15.32:0/1362928725 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f8c20066540 msgr2=0x7f8c20068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:45.493 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.492+0000 7f8c2cff9700 1 --2- 172.21.15.32:0/1362928725 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f8c20066540 0x7f8c20068a00 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f8c400c7520 tx=0x7f8c30007d70 comp rx=0 tx=0).stop 2023-10-08T06:09:45.493 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.492+0000 7f8c2cff9700 1 -- 172.21.15.32:0/1362928725 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8c400c21a0 msgr2=0x7f8c40150f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:45.493 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.492+0000 7f8c2cff9700 1 --2- 172.21.15.32:0/1362928725 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8c400c21a0 0x7f8c40150f30 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f8c4006b7d0 tx=0x7f8c38004af0 comp rx=0 tx=0).stop 2023-10-08T06:09:45.493 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.492+0000 7f8c2cff9700 1 -- 172.21.15.32:0/1362928725 shutdown_connections 2023-10-08T06:09:45.493 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.492+0000 7f8c2cff9700 1 --2- 172.21.15.32:0/1362928725 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f8c20066540 0x7f8c20068a00 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:45.493 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.492+0000 7f8c2cff9700 1 --2- 172.21.15.32:0/1362928725 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8c401652b0 0x7f8c400b3bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:45.493 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.492+0000 7f8c2cff9700 1 --2- 172.21.15.32:0/1362928725 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8c400cbef0 0x7f8c400b3680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:45.493 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.492+0000 7f8c2cff9700 1 --2- 172.21.15.32:0/1362928725 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8c400c21a0 0x7f8c40150f30 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:45.493 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.492+0000 7f8c2cff9700 1 -- 172.21.15.32:0/1362928725 >> 172.21.15.32:0/1362928725 conn(0x7f8c400b0900 msgr2=0x7f8c4006fb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:09:45.494 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.492+0000 7f8c2cff9700 1 -- 172.21.15.32:0/1362928725 shutdown_connections 2023-10-08T06:09:45.494 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.492+0000 7f8c2cff9700 1 -- 172.21.15.32:0/1362928725 wait complete. 2023-10-08T06:09:45.504 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509447 for osd.0 2023-10-08T06:09:45.504 DEBUG:teuthology.parallel:result is None 2023-10-08T06:09:45.512 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.512+0000 7f7b9f16e700 1 -- 172.21.15.32:0/1153046455 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f7b78005890 con 0x7f7b980c9950 2023-10-08T06:09:45.513 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.512+0000 7f7b957fa700 1 -- 172.21.15.32:0/1153046455 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7b8c061aa0 con 0x7f7b980c9950 2023-10-08T06:09:45.513 INFO:teuthology.orchestra.run.smithi032.stdout:60129542150 2023-10-08T06:09:45.516 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.516+0000 7f7b9f16e700 1 -- 172.21.15.32:0/1153046455 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f7b84066660 msgr2=0x7f7b84068b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:45.516 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.516+0000 7f7b9f16e700 1 --2- 172.21.15.32:0/1153046455 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f7b84066660 0x7f7b84068b20 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f7b9000d530 tx=0x7f7b9000b040 comp rx=0 tx=0).stop 2023-10-08T06:09:45.516 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.516+0000 7f7b9f16e700 1 -- 172.21.15.32:0/1153046455 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7b980c9950 msgr2=0x7f7b9814ed50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:45.516 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.516+0000 7f7b9f16e700 1 --2- 172.21.15.32:0/1153046455 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7b980c9950 0x7f7b9814ed50 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f7b8c01f880 tx=0x7f7b8c01fb90 comp rx=0 tx=0).stop 2023-10-08T06:09:45.516 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.516+0000 7f7b9f16e700 1 -- 172.21.15.32:0/1153046455 shutdown_connections 2023-10-08T06:09:45.516 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.516+0000 7f7b9f16e700 1 --2- 172.21.15.32:0/1153046455 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f7b84066660 0x7f7b84068b20 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:45.516 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.516+0000 7f7b9f16e700 1 --2- 172.21.15.32:0/1153046455 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7b980c9950 0x7f7b9814ed50 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:45.516 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.516+0000 7f7b9f16e700 1 --2- 172.21.15.32:0/1153046455 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7b98159590 0x7f7b9815ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:45.517 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.516+0000 7f7b9f16e700 1 --2- 172.21.15.32:0/1153046455 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7b9806ca40 0x7f7b9814d240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:45.517 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.516+0000 7f7b9f16e700 1 -- 172.21.15.32:0/1153046455 >> 172.21.15.32:0/1153046455 conn(0x7f7b980cb840 msgr2=0x7f7b980cbf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:09:45.517 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.516+0000 7f7b9f16e700 1 -- 172.21.15.32:0/1153046455 shutdown_connections 2023-10-08T06:09:45.517 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.516+0000 7f7b9f16e700 1 -- 172.21.15.32:0/1153046455 wait complete. 2023-10-08T06:09:45.521 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.520+0000 7fda8ffff700 1 -- 172.21.15.32:0/2420353570 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fdaac0b1700 con 0x7fdaac0c9960 2023-10-08T06:09:45.522 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.520+0000 7fdaa27fc700 1 -- 172.21.15.32:0/2420353570 <== mon.2 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fdaa40553c0 con 0x7fdaac0c9960 2023-10-08T06:09:45.522 INFO:teuthology.orchestra.run.smithi032.stdout:64424509447 2023-10-08T06:09:45.525 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.524+0000 7fda8ffff700 1 -- 172.21.15.32:0/2420353570 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fda980666e0 msgr2=0x7fda98068ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:45.525 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.524+0000 7fda8ffff700 1 --2- 172.21.15.32:0/2420353570 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fda980666e0 0x7fda98068ba0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fdaa8009b90 tx=0x7fdaa8009240 comp rx=0 tx=0).stop 2023-10-08T06:09:45.526 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.524+0000 7fda8ffff700 1 -- 172.21.15.32:0/2420353570 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdaac0c9960 msgr2=0x7fdaac0aeff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:45.526 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.524+0000 7fda8ffff700 1 --2- 172.21.15.32:0/2420353570 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdaac0c9960 0x7fdaac0aeff0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fdaa400efc0 tx=0x7fdaa400c3a0 comp rx=0 tx=0).stop 2023-10-08T06:09:45.526 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.524+0000 7fda8ffff700 1 -- 172.21.15.32:0/2420353570 shutdown_connections 2023-10-08T06:09:45.526 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.524+0000 7fda8ffff700 1 --2- 172.21.15.32:0/2420353570 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fda980666e0 0x7fda98068ba0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:45.526 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.524+0000 7fda8ffff700 1 --2- 172.21.15.32:0/2420353570 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdaac1539d0 0x7fdaac156630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:45.526 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.524+0000 7fda8ffff700 1 --2- 172.21.15.32:0/2420353570 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdaac0c9960 0x7fdaac0aeff0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:45.526 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.524+0000 7fda8ffff700 1 --2- 172.21.15.32:0/2420353570 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdaac06dd10 0x7fdaac154fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:45.526 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.524+0000 7fda8ffff700 1 -- 172.21.15.32:0/2420353570 >> 172.21.15.32:0/2420353570 conn(0x7fdaac0b0900 msgr2=0x7fdaac14a4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:09:45.526 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.524+0000 7fda8ffff700 1 -- 172.21.15.32:0/2420353570 shutdown_connections 2023-10-08T06:09:45.526 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.524+0000 7fda8ffff700 1 -- 172.21.15.32:0/2420353570 wait complete. 2023-10-08T06:09:45.527 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.524+0000 7fde5250f700 1 -- 172.21.15.32:0/1369194311 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fde4c06c700 con 0x7fde4c0703c0 2023-10-08T06:09:45.528 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.528+0000 7fde41ffb700 1 -- 172.21.15.32:0/1369194311 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fde4c06c700 con 0x7fde4c0703c0 2023-10-08T06:09:45.528 INFO:teuthology.orchestra.run.smithi032.stdout:64424509447 2023-10-08T06:09:45.529 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542150 for osd.3 2023-10-08T06:09:45.529 DEBUG:teuthology.parallel:result is None 2023-10-08T06:09:45.531 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.528+0000 7fde5250f700 1 -- 172.21.15.32:0/1369194311 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fde30066560 msgr2=0x7fde30068a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:45.531 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.528+0000 7fde5250f700 1 --2- 172.21.15.32:0/1369194311 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fde30066560 0x7fde30068a20 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fde4c0c8ea0 tx=0x7fde48008040 comp rx=0 tx=0).stop 2023-10-08T06:09:45.531 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.528+0000 7fde5250f700 1 -- 172.21.15.32:0/1369194311 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fde4c0703c0 msgr2=0x7fde4c1570d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:45.531 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.528+0000 7fde5250f700 1 --2- 172.21.15.32:0/1369194311 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fde4c0703c0 0x7fde4c1570d0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fde4400cc50 tx=0x7fde4400cf60 comp rx=0 tx=0).stop 2023-10-08T06:09:45.531 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.528+0000 7fde5250f700 1 -- 172.21.15.32:0/1369194311 shutdown_connections 2023-10-08T06:09:45.531 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.528+0000 7fde5250f700 1 --2- 172.21.15.32:0/1369194311 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fde30066560 0x7fde30068a20 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:45.532 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.528+0000 7fde5250f700 1 --2- 172.21.15.32:0/1369194311 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fde4c15d600 0x7fde4c15b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:45.532 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.528+0000 7fde5250f700 1 --2- 172.21.15.32:0/1369194311 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fde4c0adfc0 0x7fde4c06d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:45.532 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.528+0000 7fde5250f700 1 --2- 172.21.15.32:0/1369194311 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fde4c0703c0 0x7fde4c1570d0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:45.532 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.528+0000 7fde5250f700 1 -- 172.21.15.32:0/1369194311 >> 172.21.15.32:0/1369194311 conn(0x7fde4c0cb850 msgr2=0x7fde4c0af480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:09:45.532 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.528+0000 7fde5250f700 1 -- 172.21.15.32:0/1369194311 shutdown_connections 2023-10-08T06:09:45.532 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.528+0000 7fde5250f700 1 -- 172.21.15.32:0/1369194311 wait complete. 2023-10-08T06:09:45.540 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.540+0000 7fe4593c6700 1 -- 172.21.15.32:0/1320792193 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fe440005890 con 0x7fe45415b200 2023-10-08T06:09:45.541 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.540+0000 7fe450ff9700 1 -- 172.21.15.32:0/1320792193 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe448015070 con 0x7fe45415b200 2023-10-08T06:09:45.542 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509447 for osd.7 2023-10-08T06:09:45.542 INFO:teuthology.orchestra.run.smithi032.stdout:64424509447 2023-10-08T06:09:45.542 DEBUG:teuthology.parallel:result is None 2023-10-08T06:09:45.544 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.544+0000 7fe4593c6700 1 -- 172.21.15.32:0/1320792193 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fe43c066650 msgr2=0x7fe43c068b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:45.545 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.544+0000 7fe4593c6700 1 --2- 172.21.15.32:0/1320792193 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fe43c066650 0x7fe43c068b10 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fe454158b60 tx=0x7fe44c009040 comp rx=0 tx=0).stop 2023-10-08T06:09:45.545 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.544+0000 7fe4593c6700 1 -- 172.21.15.32:0/1320792193 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe45415b200 msgr2=0x7fe4541f03a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:45.545 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.544+0000 7fe4593c6700 1 --2- 172.21.15.32:0/1320792193 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe45415b200 0x7fe4541f03a0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fe448009b70 tx=0x7fe448004770 comp rx=0 tx=0).stop 2023-10-08T06:09:45.545 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.544+0000 7fe4593c6700 1 -- 172.21.15.32:0/1320792193 shutdown_connections 2023-10-08T06:09:45.545 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.544+0000 7fe4593c6700 1 --2- 172.21.15.32:0/1320792193 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fe43c066650 0x7fe43c068b10 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:45.545 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.544+0000 7fe4593c6700 1 --2- 172.21.15.32:0/1320792193 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe4541e0c70 0x7fe4540b2c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:45.545 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.544+0000 7fe4593c6700 1 --2- 172.21.15.32:0/1320792193 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe45415b5e0 0x7fe4541e0730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:45.545 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.544+0000 7fe4593c6700 1 --2- 172.21.15.32:0/1320792193 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe45415b200 0x7fe4541f03a0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:45.545 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.544+0000 7fe4593c6700 1 -- 172.21.15.32:0/1320792193 >> 172.21.15.32:0/1320792193 conn(0x7fe4540cb850 msgr2=0x7fe45415a2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:09:45.546 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.544+0000 7fe4593c6700 1 -- 172.21.15.32:0/1320792193 shutdown_connections 2023-10-08T06:09:45.546 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.544+0000 7fe4593c6700 1 -- 172.21.15.32:0/1320792193 wait complete. 2023-10-08T06:09:45.546 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509447 for osd.5 2023-10-08T06:09:45.547 DEBUG:teuthology.parallel:result is None 2023-10-08T06:09:45.558 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509447 for osd.2 2023-10-08T06:09:45.558 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.556+0000 7f0f6ae38700 1 -- 172.21.15.32:0/1055021483 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f0f4c005180 con 0x7f0f6415a0f0 2023-10-08T06:09:45.559 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.556+0000 7f0f5a7fc700 1 -- 172.21.15.32:0/1055021483 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0f5c054dc0 con 0x7f0f6415a0f0 2023-10-08T06:09:45.559 DEBUG:teuthology.parallel:result is None 2023-10-08T06:09:45.559 INFO:teuthology.orchestra.run.smithi032.stdout:64424509448 2023-10-08T06:09:45.560 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.556+0000 7f5e3eb02700 1 -- 172.21.15.32:0/3437851501 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f5e200055c0 con 0x7f5e24003a20 2023-10-08T06:09:45.560 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.560+0000 7f5e2e7fc700 1 -- 172.21.15.32:0/3437851501 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5e34017090 con 0x7f5e24003a20 2023-10-08T06:09:45.560 INFO:teuthology.orchestra.run.smithi032.stdout:64424509447 2023-10-08T06:09:45.561 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.560+0000 7f0f6ae38700 1 -- 172.21.15.32:0/1055021483 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f0f480665e0 msgr2=0x7f0f48068aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:45.561 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.560+0000 7f0f6ae38700 1 --2- 172.21.15.32:0/1055021483 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f0f480665e0 0x7f0f48068aa0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f0f64151910 tx=0x7f0f54006c80 comp rx=0 tx=0).stop 2023-10-08T06:09:45.561 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.560+0000 7f0f6ae38700 1 -- 172.21.15.32:0/1055021483 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0f6415a0f0 msgr2=0x7f0f641448a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:45.561 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.560+0000 7f0f6ae38700 1 --2- 172.21.15.32:0/1055021483 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0f6415a0f0 0x7f0f641448a0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f0f5c00ef00 tx=0x7f0f5c00b0b0 comp rx=0 tx=0).stop 2023-10-08T06:09:45.561 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.560+0000 7f0f6ae38700 1 -- 172.21.15.32:0/1055021483 shutdown_connections 2023-10-08T06:09:45.561 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.560+0000 7f0f6ae38700 1 --2- 172.21.15.32:0/1055021483 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f0f480665e0 0x7f0f48068aa0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:45.561 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.560+0000 7f0f6ae38700 1 --2- 172.21.15.32:0/1055021483 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0f6415dc10 0x7f0f640cd2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:45.561 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.560+0000 7f0f6ae38700 1 --2- 172.21.15.32:0/1055021483 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0f6415ad10 0x7f0f640ccd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:45.561 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.560+0000 7f0f6ae38700 1 --2- 172.21.15.32:0/1055021483 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0f6415a0f0 0x7f0f641448a0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:45.562 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.560+0000 7f0f6ae38700 1 -- 172.21.15.32:0/1055021483 >> 172.21.15.32:0/1055021483 conn(0x7f0f640cb850 msgr2=0x7f0f6406fbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:09:45.562 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.560+0000 7f0f6ae38700 1 -- 172.21.15.32:0/1055021483 shutdown_connections 2023-10-08T06:09:45.562 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.560+0000 7f0f6ae38700 1 -- 172.21.15.32:0/1055021483 wait complete. 2023-10-08T06:09:45.563 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.560+0000 7f5e3eb02700 1 -- 172.21.15.32:0/3437851501 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f5e1c0665e0 msgr2=0x7f5e1c068aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:45.563 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.560+0000 7f5e3eb02700 1 --2- 172.21.15.32:0/3437851501 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f5e1c0665e0 0x7f5e1c068aa0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f5e38071850 tx=0x7f5e28009040 comp rx=0 tx=0).stop 2023-10-08T06:09:45.563 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.560+0000 7f5e3eb02700 1 -- 172.21.15.32:0/3437851501 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5e24003a20 msgr2=0x7f5e380b38e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:45.563 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.560+0000 7f5e3eb02700 1 --2- 172.21.15.32:0/3437851501 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5e24003a20 0x7f5e380b38e0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f5e3400a010 tx=0x7f5e340047e0 comp rx=0 tx=0).stop 2023-10-08T06:09:45.563 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.560+0000 7f5e3eb02700 1 -- 172.21.15.32:0/3437851501 shutdown_connections 2023-10-08T06:09:45.563 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.560+0000 7f5e3eb02700 1 --2- 172.21.15.32:0/3437851501 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f5e1c0665e0 0x7f5e1c068aa0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:45.563 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.560+0000 7f5e3eb02700 1 --2- 172.21.15.32:0/3437851501 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5e38145a30 0x7f5e38145ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:45.563 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.560+0000 7f5e3eb02700 1 --2- 172.21.15.32:0/3437851501 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5e38144330 0x7f5e38147310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:45.563 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.560+0000 7f5e3eb02700 1 --2- 172.21.15.32:0/3437851501 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5e24003a20 0x7f5e380b38e0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:45.564 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.560+0000 7f5e3eb02700 1 -- 172.21.15.32:0/3437851501 >> 172.21.15.32:0/3437851501 conn(0x7f5e380b0900 msgr2=0x7f5e380b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:09:45.564 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.560+0000 7f5e3eb02700 1 -- 172.21.15.32:0/3437851501 shutdown_connections 2023-10-08T06:09:45.564 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.560+0000 7f5e3eb02700 1 -- 172.21.15.32:0/3437851501 wait complete. 2023-10-08T06:09:45.571 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509448 for osd.6 2023-10-08T06:09:45.571 DEBUG:teuthology.parallel:result is None 2023-10-08T06:09:45.573 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509447 for osd.4 2023-10-08T06:09:45.573 DEBUG:teuthology.parallel:result is None 2023-10-08T06:09:45.573 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-10-08T06:09:45.573 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T06:09:45.728 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.728+0000 7f0e599c4700 1 Processor -- start 2023-10-08T06:09:45.728 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.728+0000 7f0e599c4700 1 -- start start 2023-10-08T06:09:45.730 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.728+0000 7f0e599c4700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f0e540cc190 0x7f0e540ce090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:45.730 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.728+0000 7f0e599c4700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f0e540ce5d0 0x7f0e540cc990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:45.731 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.728+0000 7f0e599c4700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e54166040 con 0x7f0e541617a0 2023-10-08T06:09:45.731 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.728+0000 7f0e599c4700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e54165430 con 0x7f0e540ce5d0 2023-10-08T06:09:45.731 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.728+0000 7f0e599c4700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e54165710 con 0x7f0e540cc190 2023-10-08T06:09:45.731 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.728+0000 7f0e52ffd700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f0e541617a0 0x7f0e540cba80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:46242/0 (socket says 172.21.15.32:46242) 2023-10-08T06:09:45.731 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.728+0000 7f0e52ffd700 1 -- 172.21.15.32:0/1995191468 learned_addr learned my addr 172.21.15.32:0/1995191468 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-08T06:09:45.731 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.728+0000 7f0e537fe700 1 --2- 172.21.15.32:0/1995191468 >> v2:172.21.15.32:3300/0 conn(0x7f0e540ce5d0 0x7f0e540cc990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:45.731 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.728+0000 7f0e527fc700 1 --2- 172.21.15.32:0/1995191468 >> v2:172.21.15.40:3300/0 conn(0x7f0e540cc190 0x7f0e540ce090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:45.731 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.728+0000 7f0e51ffb700 1 -- 172.21.15.32:0/1995191468 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1590468482 0 0) 0x7f0e54166040 con 0x7f0e541617a0 2023-10-08T06:09:45.731 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.728+0000 7f0e51ffb700 1 -- 172.21.15.32:0/1995191468 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0e400035d0 con 0x7f0e541617a0 2023-10-08T06:09:45.731 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.728+0000 7f0e51ffb700 1 -- 172.21.15.32:0/1995191468 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 335836180 0 0) 0x7f0e400035d0 con 0x7f0e541617a0 2023-10-08T06:09:45.732 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.728+0000 7f0e537fe700 1 -- 172.21.15.32:0/1995191468 >> v2:172.21.15.40:3300/0 conn(0x7f0e540cc190 msgr2=0x7f0e540ce090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:09:45.732 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.728+0000 7f0e537fe700 1 --2- 172.21.15.32:0/1995191468 >> v2:172.21.15.40:3300/0 conn(0x7f0e540cc190 0x7f0e540ce090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:45.732 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.728+0000 7f0e537fe700 1 -- 172.21.15.32:0/1995191468 >> v1:172.21.15.32:6789/0 conn(0x7f0e541617a0 legacy=0x7f0e540cba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:45.732 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.728+0000 7f0e537fe700 1 -- 172.21.15.32:0/1995191468 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e541659f0 con 0x7f0e540ce5d0 2023-10-08T06:09:45.732 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.728+0000 7f0e537fe700 1 --2- 172.21.15.32:0/1995191468 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0e540ce5d0 0x7f0e540cc990 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f0e3c009850 tx=0x7f0e3c009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b554d1f6d20bd7a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:45.732 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.728+0000 7f0e51ffb700 1 -- 172.21.15.32:0/1995191468 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e4c001670 con 0x7f0e540ce5d0 2023-10-08T06:09:45.732 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.728+0000 7f0e51ffb700 1 -- 172.21.15.32:0/1995191468 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e3c004030 con 0x7f0e540ce5d0 2023-10-08T06:09:45.732 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.728+0000 7f0e51ffb700 1 -- 172.21.15.32:0/1995191468 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e3c0043c0 con 0x7f0e540ce5d0 2023-10-08T06:09:45.733 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.732+0000 7f0e599c4700 1 -- 172.21.15.32:0/1995191468 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0e540ce5d0 msgr2=0x7f0e540cc990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:45.733 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.732+0000 7f0e599c4700 1 --2- 172.21.15.32:0/1995191468 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0e540ce5d0 0x7f0e540cc990 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f0e3c009850 tx=0x7f0e3c009b60 comp rx=0 tx=0).stop 2023-10-08T06:09:45.733 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.732+0000 7f0e599c4700 1 -- 172.21.15.32:0/1995191468 shutdown_connections 2023-10-08T06:09:45.733 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.732+0000 7f0e599c4700 1 --2- 172.21.15.32:0/1995191468 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0e540ce5d0 0x7f0e540cc990 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:45.733 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.732+0000 7f0e599c4700 1 --2- 172.21.15.32:0/1995191468 >> v2:172.21.15.40:3300/0 conn(0x7f0e540cc190 0x7f0e540ce090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:45.734 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.732+0000 7f0e599c4700 1 -- 172.21.15.32:0/1995191468 >> 172.21.15.32:0/1995191468 conn(0x7f0e5406a480 msgr2=0x7f0e5406a890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:09:45.734 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.732+0000 7f0e599c4700 1 -- 172.21.15.32:0/1995191468 shutdown_connections 2023-10-08T06:09:45.734 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.732+0000 7f0e599c4700 1 -- 172.21.15.32:0/1995191468 wait complete. 2023-10-08T06:09:45.734 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.732+0000 7f0e599c4700 1 Processor -- start 2023-10-08T06:09:45.734 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.732+0000 7f0e599c4700 1 -- start start 2023-10-08T06:09:45.737 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.736+0000 7f0e599c4700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0e540cc190 0x7f0e540b2330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:45.737 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.736+0000 7f0e599c4700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0e540ce5d0 0x7f0e540b36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:45.737 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.736+0000 7f0e599c4700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0e541617a0 0x7f0e541609b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:45.737 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.736+0000 7f0e599c4700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e540b3c00 con 0x7f0e540ce5d0 2023-10-08T06:09:45.737 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.736+0000 7f0e527fc700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0e540ce5d0 0x7f0e540b36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:45.737 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.736+0000 7f0e599c4700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e540b2910 con 0x7f0e541617a0 2023-10-08T06:09:45.737 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.736+0000 7f0e599c4700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e540b2bf0 con 0x7f0e540cc190 2023-10-08T06:09:45.738 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.736+0000 7f0e527fc700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0e540ce5d0 0x7f0e540b36c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:59684/0 (socket says 172.21.15.32:59684) 2023-10-08T06:09:45.738 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.736+0000 7f0e527fc700 1 -- 172.21.15.32:0/1470685919 learned_addr learned my addr 172.21.15.32:0/1470685919 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:09:45.738 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.736+0000 7f0e52ffd700 1 --2- 172.21.15.32:0/1470685919 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0e540cc190 0x7f0e540b2330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:45.738 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.736+0000 7f0e537fe700 1 --2- 172.21.15.32:0/1470685919 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0e541617a0 0x7f0e541609b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:45.739 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.736+0000 7f0e527fc700 1 -- 172.21.15.32:0/1470685919 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0e540cc190 msgr2=0x7f0e540b2330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:45.739 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.736+0000 7f0e527fc700 1 --2- 172.21.15.32:0/1470685919 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0e540cc190 0x7f0e540b2330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:45.740 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.736+0000 7f0e527fc700 1 -- 172.21.15.32:0/1470685919 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0e541617a0 msgr2=0x7f0e541609b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:45.740 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.736+0000 7f0e527fc700 1 --2- 172.21.15.32:0/1470685919 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0e541617a0 0x7f0e541609b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:45.740 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.736+0000 7f0e527fc700 1 -- 172.21.15.32:0/1470685919 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e3c0094b0 con 0x7f0e540ce5d0 2023-10-08T06:09:45.740 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.736+0000 7f0e527fc700 1 --2- 172.21.15.32:0/1470685919 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0e540ce5d0 0x7f0e540b36c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f0e4400efc0 tx=0x7f0e4400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:45.740 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.736+0000 7f0e4bfff700 1 -- 172.21.15.32:0/1470685919 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e4400cd10 con 0x7f0e540ce5d0 2023-10-08T06:09:45.740 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.736+0000 7f0e4bfff700 1 -- 172.21.15.32:0/1470685919 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e4400f040 con 0x7f0e540ce5d0 2023-10-08T06:09:45.740 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.736+0000 7f0e599c4700 1 -- 172.21.15.32:0/1470685919 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e540b2ed0 con 0x7f0e540ce5d0 2023-10-08T06:09:45.740 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.736+0000 7f0e4bfff700 1 -- 172.21.15.32:0/1470685919 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e440146a0 con 0x7f0e540ce5d0 2023-10-08T06:09:45.740 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.736+0000 7f0e599c4700 1 -- 172.21.15.32:0/1470685919 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e541f7030 con 0x7f0e540ce5d0 2023-10-08T06:09:45.740 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.736+0000 7f0e599c4700 1 -- 172.21.15.32:0/1470685919 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e541f71c0 con 0x7f0e540ce5d0 2023-10-08T06:09:45.740 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.740+0000 7f0e4bfff700 1 -- 172.21.15.32:0/1470685919 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f0e44014800 con 0x7f0e540ce5d0 2023-10-08T06:09:45.741 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.740+0000 7f0e4bfff700 1 --2- 172.21.15.32:0/1470685919 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f0e34066510 0x7f0e340689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:45.741 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.740+0000 7f0e4bfff700 1 -- 172.21.15.32:0/1470685919 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0e44084610 con 0x7f0e540ce5d0 2023-10-08T06:09:45.741 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.740+0000 7f0e52ffd700 1 --2- 172.21.15.32:0/1470685919 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f0e34066510 0x7f0e340689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:45.741 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.740+0000 7f0e52ffd700 1 --2- 172.21.15.32:0/1470685919 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f0e34066510 0x7f0e340689d0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f0e4c000f60 tx=0x7f0e4c001e00 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:45.747 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.744+0000 7f0e4bfff700 1 -- 172.21.15.32:0/1470685919 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f0e44051a90 con 0x7f0e540ce5d0 2023-10-08T06:09:45.902 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.900+0000 7f0e599c4700 1 -- 172.21.15.32:0/1470685919 --> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0e54165cd0 con 0x7f0e34066510 2023-10-08T06:09:45.918 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.916+0000 7f0e4bfff700 1 -- 172.21.15.32:0/1470685919 <== mgr.4107 v2:172.21.15.32:6832/2601628338 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264567 (secure 0 0 0) 0x7f0e4c001410 con 0x7f0e34066510 2023-10-08T06:09:45.921 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:09:45.924 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.920+0000 7f0e599c4700 1 -- 172.21.15.32:0/1470685919 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f0e34066510 msgr2=0x7f0e340689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:45.924 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.920+0000 7f0e599c4700 1 --2- 172.21.15.32:0/1470685919 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f0e34066510 0x7f0e340689d0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f0e4c000f60 tx=0x7f0e4c001e00 comp rx=0 tx=0).stop 2023-10-08T06:09:45.924 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.920+0000 7f0e599c4700 1 -- 172.21.15.32:0/1470685919 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0e540ce5d0 msgr2=0x7f0e540b36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:45.924 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.920+0000 7f0e599c4700 1 --2- 172.21.15.32:0/1470685919 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0e540ce5d0 0x7f0e540b36c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f0e4400efc0 tx=0x7f0e4400c3a0 comp rx=0 tx=0).stop 2023-10-08T06:09:45.924 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.920+0000 7f0e599c4700 1 -- 172.21.15.32:0/1470685919 shutdown_connections 2023-10-08T06:09:45.924 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.920+0000 7f0e599c4700 1 --2- 172.21.15.32:0/1470685919 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f0e34066510 0x7f0e340689d0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:45.924 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.920+0000 7f0e599c4700 1 --2- 172.21.15.32:0/1470685919 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0e540ce5d0 0x7f0e540b36c0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:45.924 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.920+0000 7f0e599c4700 1 --2- 172.21.15.32:0/1470685919 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0e541617a0 0x7f0e541609b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:45.925 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.920+0000 7f0e599c4700 1 --2- 172.21.15.32:0/1470685919 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0e540cc190 0x7f0e540b2330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:45.925 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.920+0000 7f0e599c4700 1 -- 172.21.15.32:0/1470685919 >> 172.21.15.32:0/1470685919 conn(0x7f0e5406a480 msgr2=0x7f0e540cba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:09:45.925 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.920+0000 7f0e599c4700 1 -- 172.21.15.32:0/1470685919 shutdown_connections 2023-10-08T06:09:45.925 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:45.920+0000 7f0e599c4700 1 -- 172.21.15.32:0/1470685919 wait complete. 2023-10-08T06:09:45.925 INFO:teuthology.orchestra.run.smithi032.stderr:dumped all 2023-10-08T06:09:45.935 INFO:teuthology.orchestra.run.smithi032.stdout:{"pg_ready":true,"pg_map":{"version":27,"stamp":"2023-10-08T06:09:45.251141+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235788,"kb_used_data":2952,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738932,"statfs":{"total":773094113280,"available":772852666368,"internally_reserved":0,"allocated":3022848,"data_stored":1795476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":238276153},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.095469"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.166128+0000","last_change":"2023-10-08T06:09:37.189119+0000","last_active":"2023-10-08T06:09:38.166128+0000","last_peered":"2023-10-08T06:09:38.166128+0000","last_clean":"2023-10-08T06:09:38.166128+0000","last_became_active":"2023-10-08T06:09:37.188327+0000","last_became_peered":"2023-10-08T06:09:37.188327+0000","last_unstale":"2023-10-08T06:09:38.166128+0000","last_undegraded":"2023-10-08T06:09:38.166128+0000","last_fullsized":"2023-10-08T06:09:38.166128+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:24:28.854916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.162226+0000","last_change":"2023-10-08T06:09:37.187273+0000","last_active":"2023-10-08T06:09:38.162226+0000","last_peered":"2023-10-08T06:09:38.162226+0000","last_clean":"2023-10-08T06:09:38.162226+0000","last_became_active":"2023-10-08T06:09:37.187002+0000","last_became_peered":"2023-10-08T06:09:37.187002+0000","last_unstale":"2023-10-08T06:09:38.162226+0000","last_undegraded":"2023-10-08T06:09:38.162226+0000","last_fullsized":"2023-10-08T06:09:38.162226+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:49:17.057808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.439703+0000","last_change":"2023-10-08T06:09:37.189008+0000","last_active":"2023-10-08T06:09:38.439703+0000","last_peered":"2023-10-08T06:09:38.439703+0000","last_clean":"2023-10-08T06:09:38.439703+0000","last_became_active":"2023-10-08T06:09:37.188668+0000","last_became_peered":"2023-10-08T06:09:37.188668+0000","last_unstale":"2023-10-08T06:09:38.439703+0000","last_undegraded":"2023-10-08T06:09:38.439703+0000","last_fullsized":"2023-10-08T06:09:38.439703+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:49:17.057808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.166462+0000","last_change":"2023-10-08T06:09:37.187681+0000","last_active":"2023-10-08T06:09:38.166462+0000","last_peered":"2023-10-08T06:09:38.166462+0000","last_clean":"2023-10-08T06:09:38.166462+0000","last_became_active":"2023-10-08T06:09:37.186052+0000","last_became_peered":"2023-10-08T06:09:37.186052+0000","last_unstale":"2023-10-08T06:09:38.166462+0000","last_undegraded":"2023-10-08T06:09:38.166462+0000","last_fullsized":"2023-10-08T06:09:38.166462+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:04:32.307233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.164796+0000","last_change":"2023-10-08T06:09:37.184596+0000","last_active":"2023-10-08T06:09:38.164796+0000","last_peered":"2023-10-08T06:09:38.164796+0000","last_clean":"2023-10-08T06:09:38.164796+0000","last_became_active":"2023-10-08T06:09:37.184317+0000","last_became_peered":"2023-10-08T06:09:37.184317+0000","last_unstale":"2023-10-08T06:09:38.164796+0000","last_undegraded":"2023-10-08T06:09:38.164796+0000","last_fullsized":"2023-10-08T06:09:38.164796+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:06:27.727341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.164499+0000","last_change":"2023-10-08T06:09:37.189924+0000","last_active":"2023-10-08T06:09:38.164499+0000","last_peered":"2023-10-08T06:09:38.164499+0000","last_clean":"2023-10-08T06:09:38.164499+0000","last_became_active":"2023-10-08T06:09:37.188282+0000","last_became_peered":"2023-10-08T06:09:37.188282+0000","last_unstale":"2023-10-08T06:09:38.164499+0000","last_undegraded":"2023-10-08T06:09:38.164499+0000","last_fullsized":"2023-10-08T06:09:38.164499+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:37:42.540248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.164130+0000","last_change":"2023-10-08T06:09:37.187514+0000","last_active":"2023-10-08T06:09:38.164130+0000","last_peered":"2023-10-08T06:09:38.164130+0000","last_clean":"2023-10-08T06:09:38.164130+0000","last_became_active":"2023-10-08T06:09:37.187122+0000","last_became_peered":"2023-10-08T06:09:37.187122+0000","last_unstale":"2023-10-08T06:09:38.164130+0000","last_undegraded":"2023-10-08T06:09:38.164130+0000","last_fullsized":"2023-10-08T06:09:38.164130+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:49:58.972598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.439267+0000","last_change":"2023-10-08T06:09:37.186725+0000","last_active":"2023-10-08T06:09:38.439267+0000","last_peered":"2023-10-08T06:09:38.439267+0000","last_clean":"2023-10-08T06:09:38.439267+0000","last_became_active":"2023-10-08T06:09:37.186416+0000","last_became_peered":"2023-10-08T06:09:37.186416+0000","last_unstale":"2023-10-08T06:09:38.439267+0000","last_undegraded":"2023-10-08T06:09:38.439267+0000","last_fullsized":"2023-10-08T06:09:38.439267+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:30:20.661501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.166298+0000","last_change":"2023-10-08T06:09:37.196289+0000","last_active":"2023-10-08T06:09:38.166298+0000","last_peered":"2023-10-08T06:09:38.166298+0000","last_clean":"2023-10-08T06:09:38.166298+0000","last_became_active":"2023-10-08T06:09:37.196029+0000","last_became_peered":"2023-10-08T06:09:37.196029+0000","last_unstale":"2023-10-08T06:09:38.166298+0000","last_undegraded":"2023-10-08T06:09:38.166298+0000","last_fullsized":"2023-10-08T06:09:38.166298+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:58:21.359302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.259158+0000","last_change":"2023-10-08T06:09:37.192494+0000","last_active":"2023-10-08T06:09:38.259158+0000","last_peered":"2023-10-08T06:09:38.259158+0000","last_clean":"2023-10-08T06:09:38.259158+0000","last_became_active":"2023-10-08T06:09:37.192219+0000","last_became_peered":"2023-10-08T06:09:37.192219+0000","last_unstale":"2023-10-08T06:09:38.259158+0000","last_undegraded":"2023-10-08T06:09:38.259158+0000","last_fullsized":"2023-10-08T06:09:38.259158+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:21:38.351456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.258945+0000","last_change":"2023-10-08T06:09:37.191422+0000","last_active":"2023-10-08T06:09:38.258945+0000","last_peered":"2023-10-08T06:09:38.258945+0000","last_clean":"2023-10-08T06:09:38.258945+0000","last_became_active":"2023-10-08T06:09:37.191135+0000","last_became_peered":"2023-10-08T06:09:37.191135+0000","last_unstale":"2023-10-08T06:09:38.258945+0000","last_undegraded":"2023-10-08T06:09:38.258945+0000","last_fullsized":"2023-10-08T06:09:38.258945+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:49:17.057808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.439036+0000","last_change":"2023-10-08T06:09:37.180493+0000","last_active":"2023-10-08T06:09:38.439036+0000","last_peered":"2023-10-08T06:09:38.439036+0000","last_clean":"2023-10-08T06:09:38.439036+0000","last_became_active":"2023-10-08T06:09:37.180194+0000","last_became_peered":"2023-10-08T06:09:37.180194+0000","last_unstale":"2023-10-08T06:09:38.439036+0000","last_undegraded":"2023-10-08T06:09:38.439036+0000","last_fullsized":"2023-10-08T06:09:38.439036+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:18:39.137117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.439400+0000","last_change":"2023-10-08T06:09:37.182805+0000","last_active":"2023-10-08T06:09:38.439400+0000","last_peered":"2023-10-08T06:09:38.439400+0000","last_clean":"2023-10-08T06:09:38.439400+0000","last_became_active":"2023-10-08T06:09:37.182511+0000","last_became_peered":"2023-10-08T06:09:37.182511+0000","last_unstale":"2023-10-08T06:09:38.439400+0000","last_undegraded":"2023-10-08T06:09:38.439400+0000","last_fullsized":"2023-10-08T06:09:38.439400+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:56:23.722542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.438683+0000","last_change":"2023-10-08T06:09:37.184291+0000","last_active":"2023-10-08T06:09:38.438683+0000","last_peered":"2023-10-08T06:09:38.438683+0000","last_clean":"2023-10-08T06:09:38.438683+0000","last_became_active":"2023-10-08T06:09:37.183944+0000","last_became_peered":"2023-10-08T06:09:37.183944+0000","last_unstale":"2023-10-08T06:09:38.438683+0000","last_undegraded":"2023-10-08T06:09:38.438683+0000","last_fullsized":"2023-10-08T06:09:38.438683+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:23:12.740262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.161692+0000","last_change":"2023-10-08T06:09:37.173135+0000","last_active":"2023-10-08T06:09:38.161692+0000","last_peered":"2023-10-08T06:09:38.161692+0000","last_clean":"2023-10-08T06:09:38.161692+0000","last_became_active":"2023-10-08T06:09:37.172786+0000","last_became_peered":"2023-10-08T06:09:37.172786+0000","last_unstale":"2023-10-08T06:09:38.161692+0000","last_undegraded":"2023-10-08T06:09:38.161692+0000","last_fullsized":"2023-10-08T06:09:38.161692+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:34:24.217470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.163600+0000","last_change":"2023-10-08T06:09:37.190091+0000","last_active":"2023-10-08T06:09:38.163600+0000","last_peered":"2023-10-08T06:09:38.163600+0000","last_clean":"2023-10-08T06:09:38.163600+0000","last_became_active":"2023-10-08T06:09:37.188278+0000","last_became_peered":"2023-10-08T06:09:37.188278+0000","last_unstale":"2023-10-08T06:09:38.163600+0000","last_undegraded":"2023-10-08T06:09:38.163600+0000","last_fullsized":"2023-10-08T06:09:38.163600+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:21:38.351456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.166514+0000","last_change":"2023-10-08T06:09:37.188196+0000","last_active":"2023-10-08T06:09:38.166514+0000","last_peered":"2023-10-08T06:09:38.166514+0000","last_clean":"2023-10-08T06:09:38.166514+0000","last_became_active":"2023-10-08T06:09:37.187906+0000","last_became_peered":"2023-10-08T06:09:37.187906+0000","last_unstale":"2023-10-08T06:09:38.166514+0000","last_undegraded":"2023-10-08T06:09:38.166514+0000","last_fullsized":"2023-10-08T06:09:38.166514+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:24:28.854916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.441427+0000","last_change":"2023-10-08T06:09:37.185222+0000","last_active":"2023-10-08T06:09:38.441427+0000","last_peered":"2023-10-08T06:09:38.441427+0000","last_clean":"2023-10-08T06:09:38.441427+0000","last_became_active":"2023-10-08T06:09:37.184040+0000","last_became_peered":"2023-10-08T06:09:37.184040+0000","last_unstale":"2023-10-08T06:09:38.441427+0000","last_undegraded":"2023-10-08T06:09:38.441427+0000","last_fullsized":"2023-10-08T06:09:38.441427+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:18:39.137117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.165574+0000","last_change":"2023-10-08T06:09:37.189503+0000","last_active":"2023-10-08T06:09:38.165574+0000","last_peered":"2023-10-08T06:09:38.165574+0000","last_clean":"2023-10-08T06:09:38.165574+0000","last_became_active":"2023-10-08T06:09:37.189210+0000","last_became_peered":"2023-10-08T06:09:37.189210+0000","last_unstale":"2023-10-08T06:09:38.165574+0000","last_undegraded":"2023-10-08T06:09:38.165574+0000","last_fullsized":"2023-10-08T06:09:38.165574+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:04:33.773359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.259261+0000","last_change":"2023-10-08T06:09:37.190736+0000","last_active":"2023-10-08T06:09:38.259261+0000","last_peered":"2023-10-08T06:09:38.259261+0000","last_clean":"2023-10-08T06:09:38.259261+0000","last_became_active":"2023-10-08T06:09:37.190034+0000","last_became_peered":"2023-10-08T06:09:37.190034+0000","last_unstale":"2023-10-08T06:09:38.259261+0000","last_undegraded":"2023-10-08T06:09:38.259261+0000","last_fullsized":"2023-10-08T06:09:38.259261+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:34:25.213819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.439417+0000","last_change":"2023-10-08T06:09:37.189807+0000","last_active":"2023-10-08T06:09:38.439417+0000","last_peered":"2023-10-08T06:09:38.439417+0000","last_clean":"2023-10-08T06:09:38.439417+0000","last_became_active":"2023-10-08T06:09:37.189522+0000","last_became_peered":"2023-10-08T06:09:37.189522+0000","last_unstale":"2023-10-08T06:09:38.439417+0000","last_undegraded":"2023-10-08T06:09:38.439417+0000","last_fullsized":"2023-10-08T06:09:38.439417+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:56:29.982869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.164808+0000","last_change":"2023-10-08T06:09:37.187974+0000","last_active":"2023-10-08T06:09:38.164808+0000","last_peered":"2023-10-08T06:09:38.164808+0000","last_clean":"2023-10-08T06:09:38.164808+0000","last_became_active":"2023-10-08T06:09:37.187664+0000","last_became_peered":"2023-10-08T06:09:37.187664+0000","last_unstale":"2023-10-08T06:09:38.164808+0000","last_undegraded":"2023-10-08T06:09:38.164808+0000","last_fullsized":"2023-10-08T06:09:38.164808+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:18:15.487038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.440362+0000","last_change":"2023-10-08T06:09:37.190236+0000","last_active":"2023-10-08T06:09:38.440362+0000","last_peered":"2023-10-08T06:09:38.440362+0000","last_clean":"2023-10-08T06:09:38.440362+0000","last_became_active":"2023-10-08T06:09:37.187376+0000","last_became_peered":"2023-10-08T06:09:37.187376+0000","last_unstale":"2023-10-08T06:09:38.440362+0000","last_undegraded":"2023-10-08T06:09:38.440362+0000","last_fullsized":"2023-10-08T06:09:38.440362+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:18:34.855901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.164217+0000","last_change":"2023-10-08T06:09:37.187245+0000","last_active":"2023-10-08T06:09:38.164217+0000","last_peered":"2023-10-08T06:09:38.164217+0000","last_clean":"2023-10-08T06:09:38.164217+0000","last_became_active":"2023-10-08T06:09:37.182394+0000","last_became_peered":"2023-10-08T06:09:37.182394+0000","last_unstale":"2023-10-08T06:09:38.164217+0000","last_undegraded":"2023-10-08T06:09:38.164217+0000","last_fullsized":"2023-10-08T06:09:38.164217+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:34:25.213819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.441511+0000","last_change":"2023-10-08T06:09:37.190400+0000","last_active":"2023-10-08T06:09:38.441511+0000","last_peered":"2023-10-08T06:09:38.441511+0000","last_clean":"2023-10-08T06:09:38.441511+0000","last_became_active":"2023-10-08T06:09:37.187332+0000","last_became_peered":"2023-10-08T06:09:37.187332+0000","last_unstale":"2023-10-08T06:09:38.441511+0000","last_undegraded":"2023-10-08T06:09:38.441511+0000","last_fullsized":"2023-10-08T06:09:38.441511+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:06:26.313725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.259322+0000","last_change":"2023-10-08T06:09:37.189247+0000","last_active":"2023-10-08T06:09:38.259322+0000","last_peered":"2023-10-08T06:09:38.259322+0000","last_clean":"2023-10-08T06:09:38.259322+0000","last_became_active":"2023-10-08T06:09:37.188933+0000","last_became_peered":"2023-10-08T06:09:37.188933+0000","last_unstale":"2023-10-08T06:09:38.259322+0000","last_undegraded":"2023-10-08T06:09:38.259322+0000","last_fullsized":"2023-10-08T06:09:38.259322+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:37:42.540248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.162400+0000","last_change":"2023-10-08T06:09:37.182750+0000","last_active":"2023-10-08T06:09:38.162400+0000","last_peered":"2023-10-08T06:09:38.162400+0000","last_clean":"2023-10-08T06:09:38.162400+0000","last_became_active":"2023-10-08T06:09:37.182459+0000","last_became_peered":"2023-10-08T06:09:37.182459+0000","last_unstale":"2023-10-08T06:09:38.162400+0000","last_undegraded":"2023-10-08T06:09:38.162400+0000","last_fullsized":"2023-10-08T06:09:38.162400+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:34:25.213819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.441274+0000","last_change":"2023-10-08T06:09:37.190585+0000","last_active":"2023-10-08T06:09:38.441274+0000","last_peered":"2023-10-08T06:09:38.441274+0000","last_clean":"2023-10-08T06:09:38.441274+0000","last_became_active":"2023-10-08T06:09:37.190040+0000","last_became_peered":"2023-10-08T06:09:37.190040+0000","last_unstale":"2023-10-08T06:09:38.441274+0000","last_undegraded":"2023-10-08T06:09:38.441274+0000","last_fullsized":"2023-10-08T06:09:38.441274+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:33:02.594601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.439692+0000","last_change":"2023-10-08T06:09:37.195008+0000","last_active":"2023-10-08T06:09:38.439692+0000","last_peered":"2023-10-08T06:09:38.439692+0000","last_clean":"2023-10-08T06:09:38.439692+0000","last_became_active":"2023-10-08T06:09:37.191672+0000","last_became_peered":"2023-10-08T06:09:37.191672+0000","last_unstale":"2023-10-08T06:09:38.439692+0000","last_undegraded":"2023-10-08T06:09:38.439692+0000","last_fullsized":"2023-10-08T06:09:38.439692+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:34:24.217470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.165134+0000","last_change":"2023-10-08T06:09:37.182779+0000","last_active":"2023-10-08T06:09:38.165134+0000","last_peered":"2023-10-08T06:09:38.165134+0000","last_clean":"2023-10-08T06:09:38.165134+0000","last_became_active":"2023-10-08T06:09:37.182402+0000","last_became_peered":"2023-10-08T06:09:37.182402+0000","last_unstale":"2023-10-08T06:09:38.165134+0000","last_undegraded":"2023-10-08T06:09:38.165134+0000","last_fullsized":"2023-10-08T06:09:38.165134+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:49:58.972598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.441666+0000","last_change":"2023-10-08T06:09:37.186117+0000","last_active":"2023-10-08T06:09:38.441666+0000","last_peered":"2023-10-08T06:09:38.441666+0000","last_clean":"2023-10-08T06:09:38.441666+0000","last_became_active":"2023-10-08T06:09:37.185159+0000","last_became_peered":"2023-10-08T06:09:37.185159+0000","last_unstale":"2023-10-08T06:09:38.441666+0000","last_undegraded":"2023-10-08T06:09:38.441666+0000","last_fullsized":"2023-10-08T06:09:38.441666+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:05:09.836876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.258513+0000","last_change":"2023-10-08T06:09:37.187121+0000","last_active":"2023-10-08T06:09:38.258513+0000","last_peered":"2023-10-08T06:09:38.258513+0000","last_clean":"2023-10-08T06:09:38.258513+0000","last_became_active":"2023-10-08T06:09:37.186834+0000","last_became_peered":"2023-10-08T06:09:37.186834+0000","last_unstale":"2023-10-08T06:09:38.258513+0000","last_undegraded":"2023-10-08T06:09:38.258513+0000","last_fullsized":"2023-10-08T06:09:38.258513+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:22:50.644480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.438323+0000","last_change":"2023-10-08T06:09:37.166163+0000","last_active":"2023-10-08T06:09:38.438323+0000","last_peered":"2023-10-08T06:09:38.438323+0000","last_clean":"2023-10-08T06:09:38.438323+0000","last_became_active":"2023-10-08T06:09:37.165819+0000","last_became_peered":"2023-10-08T06:09:37.165819+0000","last_unstale":"2023-10-08T06:09:38.438323+0000","last_undegraded":"2023-10-08T06:09:38.438323+0000","last_fullsized":"2023-10-08T06:09:38.438323+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:17:12.495543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-08T06:09:37.320927+0000","last_change":"2023-10-08T06:09:36.171417+0000","last_active":"2023-10-08T06:09:37.320927+0000","last_peered":"2023-10-08T06:09:37.320927+0000","last_clean":"2023-10-08T06:09:37.320927+0000","last_became_active":"2023-10-08T06:09:36.171084+0000","last_became_peered":"2023-10-08T06:09:36.171084+0000","last_unstale":"2023-10-08T06:09:37.320927+0000","last_undegraded":"2023-10-08T06:09:37.320927+0000","last_fullsized":"2023-10-08T06:09:37.320927+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_clean_scrub_stamp":"2023-10-08T06:09:35.125722+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:27:31.423500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.439901+0000","last_change":"2023-10-08T06:09:37.195690+0000","last_active":"2023-10-08T06:09:38.439901+0000","last_peered":"2023-10-08T06:09:38.439901+0000","last_clean":"2023-10-08T06:09:38.439901+0000","last_became_active":"2023-10-08T06:09:37.195446+0000","last_became_peered":"2023-10-08T06:09:37.195446+0000","last_unstale":"2023-10-08T06:09:38.439901+0000","last_undegraded":"2023-10-08T06:09:38.439901+0000","last_fullsized":"2023-10-08T06:09:38.439901+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:21:38.351456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.258516+0000","last_change":"2023-10-08T06:09:36.177551+0000","last_active":"2023-10-08T06:09:38.258516+0000","last_peered":"2023-10-08T06:09:38.258516+0000","last_clean":"2023-10-08T06:09:38.258516+0000","last_became_active":"2023-10-08T06:09:36.176999+0000","last_became_peered":"2023-10-08T06:09:36.176999+0000","last_unstale":"2023-10-08T06:09:38.258516+0000","last_undegraded":"2023-10-08T06:09:38.258516+0000","last_fullsized":"2023-10-08T06:09:38.258516+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_clean_scrub_stamp":"2023-10-08T06:09:35.125722+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:05:49.733090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-08T06:09:37.320858+0000","last_change":"2023-10-08T06:09:36.185251+0000","last_active":"2023-10-08T06:09:37.320858+0000","last_peered":"2023-10-08T06:09:37.320858+0000","last_clean":"2023-10-08T06:09:37.320858+0000","last_became_active":"2023-10-08T06:09:36.185009+0000","last_became_peered":"2023-10-08T06:09:36.185009+0000","last_unstale":"2023-10-08T06:09:37.320858+0000","last_undegraded":"2023-10-08T06:09:37.320858+0000","last_fullsized":"2023-10-08T06:09:37.320858+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_clean_scrub_stamp":"2023-10-08T06:09:35.125722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:23:55.526790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.439213+0000","last_change":"2023-10-08T06:09:37.185750+0000","last_active":"2023-10-08T06:09:38.439213+0000","last_peered":"2023-10-08T06:09:38.439213+0000","last_clean":"2023-10-08T06:09:38.439213+0000","last_became_active":"2023-10-08T06:09:37.185376+0000","last_became_peered":"2023-10-08T06:09:37.185376+0000","last_unstale":"2023-10-08T06:09:38.439213+0000","last_undegraded":"2023-10-08T06:09:38.439213+0000","last_fullsized":"2023-10-08T06:09:38.439213+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:50:54.351073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.164429+0000","last_change":"2023-10-08T06:09:36.176796+0000","last_active":"2023-10-08T06:09:38.164429+0000","last_peered":"2023-10-08T06:09:38.164429+0000","last_clean":"2023-10-08T06:09:38.164429+0000","last_became_active":"2023-10-08T06:09:36.176522+0000","last_became_peered":"2023-10-08T06:09:36.176522+0000","last_unstale":"2023-10-08T06:09:38.164429+0000","last_undegraded":"2023-10-08T06:09:38.164429+0000","last_fullsized":"2023-10-08T06:09:38.164429+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_clean_scrub_stamp":"2023-10-08T06:09:35.125722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:05:08.823966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.161590+0000","last_change":"2023-10-08T06:09:37.179556+0000","last_active":"2023-10-08T06:09:38.161590+0000","last_peered":"2023-10-08T06:09:38.161590+0000","last_clean":"2023-10-08T06:09:38.161590+0000","last_became_active":"2023-10-08T06:09:37.179272+0000","last_became_peered":"2023-10-08T06:09:37.179272+0000","last_unstale":"2023-10-08T06:09:38.161590+0000","last_undegraded":"2023-10-08T06:09:38.161590+0000","last_fullsized":"2023-10-08T06:09:38.161590+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:56:29.982869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.258906+0000","last_change":"2023-10-08T06:09:36.177352+0000","last_active":"2023-10-08T06:09:38.258906+0000","last_peered":"2023-10-08T06:09:38.258906+0000","last_clean":"2023-10-08T06:09:38.258906+0000","last_became_active":"2023-10-08T06:09:36.176974+0000","last_became_peered":"2023-10-08T06:09:36.176974+0000","last_unstale":"2023-10-08T06:09:38.258906+0000","last_undegraded":"2023-10-08T06:09:38.258906+0000","last_fullsized":"2023-10-08T06:09:38.258906+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_clean_scrub_stamp":"2023-10-08T06:09:35.125722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:23:11.727351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.166180+0000","last_change":"2023-10-08T06:09:37.186798+0000","last_active":"2023-10-08T06:09:38.166180+0000","last_peered":"2023-10-08T06:09:38.166180+0000","last_clean":"2023-10-08T06:09:38.166180+0000","last_became_active":"2023-10-08T06:09:37.186528+0000","last_became_peered":"2023-10-08T06:09:37.186528+0000","last_unstale":"2023-10-08T06:09:38.166180+0000","last_undegraded":"2023-10-08T06:09:38.166180+0000","last_fullsized":"2023-10-08T06:09:38.166180+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:04:33.773359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.166293+0000","last_change":"2023-10-08T06:09:36.177563+0000","last_active":"2023-10-08T06:09:38.166293+0000","last_peered":"2023-10-08T06:09:38.166293+0000","last_clean":"2023-10-08T06:09:38.166293+0000","last_became_active":"2023-10-08T06:09:36.177299+0000","last_became_peered":"2023-10-08T06:09:36.177299+0000","last_unstale":"2023-10-08T06:09:38.166293+0000","last_undegraded":"2023-10-08T06:09:38.166293+0000","last_fullsized":"2023-10-08T06:09:38.166293+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_clean_scrub_stamp":"2023-10-08T06:09:35.125722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:23:11.727351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.439612+0000","last_change":"2023-10-08T06:09:37.194668+0000","last_active":"2023-10-08T06:09:38.439612+0000","last_peered":"2023-10-08T06:09:38.439612+0000","last_clean":"2023-10-08T06:09:38.439612+0000","last_became_active":"2023-10-08T06:09:37.194275+0000","last_became_peered":"2023-10-08T06:09:37.194275+0000","last_unstale":"2023-10-08T06:09:38.439612+0000","last_undegraded":"2023-10-08T06:09:38.439612+0000","last_fullsized":"2023-10-08T06:09:38.439612+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:22:50.644480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.162597+0000","last_change":"2023-10-08T06:09:36.168806+0000","last_active":"2023-10-08T06:09:38.162597+0000","last_peered":"2023-10-08T06:09:38.162597+0000","last_clean":"2023-10-08T06:09:38.162597+0000","last_became_active":"2023-10-08T06:09:36.168379+0000","last_became_peered":"2023-10-08T06:09:36.168379+0000","last_unstale":"2023-10-08T06:09:38.162597+0000","last_undegraded":"2023-10-08T06:09:38.162597+0000","last_fullsized":"2023-10-08T06:09:38.162597+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_clean_scrub_stamp":"2023-10-08T06:09:35.125722+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:15:43.326854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.439035+0000","last_change":"2023-10-08T06:09:37.183629+0000","last_active":"2023-10-08T06:09:38.439035+0000","last_peered":"2023-10-08T06:09:38.439035+0000","last_clean":"2023-10-08T06:09:38.439035+0000","last_became_active":"2023-10-08T06:09:37.183318+0000","last_became_peered":"2023-10-08T06:09:37.183318+0000","last_unstale":"2023-10-08T06:09:38.439035+0000","last_undegraded":"2023-10-08T06:09:38.439035+0000","last_fullsized":"2023-10-08T06:09:38.439035+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:05:09.836876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"21'6","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.258922+0000","last_change":"2023-10-08T06:09:36.177043+0000","last_active":"2023-10-08T06:09:38.258922+0000","last_peered":"2023-10-08T06:09:38.258922+0000","last_clean":"2023-10-08T06:09:38.258922+0000","last_became_active":"2023-10-08T06:09:36.176455+0000","last_became_peered":"2023-10-08T06:09:36.176455+0000","last_unstale":"2023-10-08T06:09:38.258922+0000","last_undegraded":"2023-10-08T06:09:38.258922+0000","last_fullsized":"2023-10-08T06:09:38.258922+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_clean_scrub_stamp":"2023-10-08T06:09:35.125722+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:03:55.740286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.165422+0000","last_change":"2023-10-08T06:09:37.187989+0000","last_active":"2023-10-08T06:09:38.165422+0000","last_peered":"2023-10-08T06:09:38.165422+0000","last_clean":"2023-10-08T06:09:38.165422+0000","last_became_active":"2023-10-08T06:09:37.187694+0000","last_became_peered":"2023-10-08T06:09:37.187694+0000","last_unstale":"2023-10-08T06:09:38.165422+0000","last_undegraded":"2023-10-08T06:09:38.165422+0000","last_fullsized":"2023-10-08T06:09:38.165422+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:06:58.385054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.325426+0000","last_change":"2023-10-08T06:09:36.180486+0000","last_active":"2023-10-08T06:09:38.325426+0000","last_peered":"2023-10-08T06:09:38.325426+0000","last_clean":"2023-10-08T06:09:38.325426+0000","last_became_active":"2023-10-08T06:09:36.180170+0000","last_became_peered":"2023-10-08T06:09:36.180170+0000","last_unstale":"2023-10-08T06:09:38.325426+0000","last_undegraded":"2023-10-08T06:09:38.325426+0000","last_fullsized":"2023-10-08T06:09:38.325426+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_clean_scrub_stamp":"2023-10-08T06:09:35.125722+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:05:49.733090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.438863+0000","last_change":"2023-10-08T06:09:37.195019+0000","last_active":"2023-10-08T06:09:38.438863+0000","last_peered":"2023-10-08T06:09:38.438863+0000","last_clean":"2023-10-08T06:09:38.438863+0000","last_became_active":"2023-10-08T06:09:37.192104+0000","last_became_peered":"2023-10-08T06:09:37.192104+0000","last_unstale":"2023-10-08T06:09:38.438863+0000","last_undegraded":"2023-10-08T06:09:38.438863+0000","last_fullsized":"2023-10-08T06:09:38.438863+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:03:56.753197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.165326+0000","last_change":"2023-10-08T06:09:36.174464+0000","last_active":"2023-10-08T06:09:38.165326+0000","last_peered":"2023-10-08T06:09:38.165326+0000","last_clean":"2023-10-08T06:09:38.165326+0000","last_became_active":"2023-10-08T06:09:36.174144+0000","last_became_peered":"2023-10-08T06:09:36.174144+0000","last_unstale":"2023-10-08T06:09:38.165326+0000","last_undegraded":"2023-10-08T06:09:38.165326+0000","last_fullsized":"2023-10-08T06:09:38.165326+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_clean_scrub_stamp":"2023-10-08T06:09:35.125722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:34:23.204560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.165097+0000","last_change":"2023-10-08T06:09:37.193371+0000","last_active":"2023-10-08T06:09:38.165097+0000","last_peered":"2023-10-08T06:09:38.165097+0000","last_clean":"2023-10-08T06:09:38.165097+0000","last_became_active":"2023-10-08T06:09:37.192842+0000","last_became_peered":"2023-10-08T06:09:37.192842+0000","last_unstale":"2023-10-08T06:09:38.165097+0000","last_undegraded":"2023-10-08T06:09:38.165097+0000","last_fullsized":"2023-10-08T06:09:38.165097+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:16:03.874960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.258443+0000","last_change":"2023-10-08T06:09:36.178850+0000","last_active":"2023-10-08T06:09:38.258443+0000","last_peered":"2023-10-08T06:09:38.258443+0000","last_clean":"2023-10-08T06:09:38.258443+0000","last_became_active":"2023-10-08T06:09:36.178580+0000","last_became_peered":"2023-10-08T06:09:36.178580+0000","last_unstale":"2023-10-08T06:09:38.258443+0000","last_undegraded":"2023-10-08T06:09:38.258443+0000","last_fullsized":"2023-10-08T06:09:38.258443+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_clean_scrub_stamp":"2023-10-08T06:09:35.125722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:52:59.381910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.258458+0000","last_change":"2023-10-08T06:09:37.187049+0000","last_active":"2023-10-08T06:09:38.258458+0000","last_peered":"2023-10-08T06:09:38.258458+0000","last_clean":"2023-10-08T06:09:38.258458+0000","last_became_active":"2023-10-08T06:09:37.186754+0000","last_became_peered":"2023-10-08T06:09:37.186754+0000","last_unstale":"2023-10-08T06:09:38.258458+0000","last_undegraded":"2023-10-08T06:09:38.258458+0000","last_fullsized":"2023-10-08T06:09:38.258458+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:56:29.982869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.317672+0000","last_change":"2023-10-08T06:09:36.169901+0000","last_active":"2023-10-08T06:09:38.317672+0000","last_peered":"2023-10-08T06:09:38.317672+0000","last_clean":"2023-10-08T06:09:38.317672+0000","last_became_active":"2023-10-08T06:09:36.169437+0000","last_became_peered":"2023-10-08T06:09:36.169437+0000","last_unstale":"2023-10-08T06:09:38.317672+0000","last_undegraded":"2023-10-08T06:09:38.317672+0000","last_fullsized":"2023-10-08T06:09:38.317672+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_clean_scrub_stamp":"2023-10-08T06:09:35.125722+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:18:04.415654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.163886+0000","last_change":"2023-10-08T06:09:37.192889+0000","last_active":"2023-10-08T06:09:38.163886+0000","last_peered":"2023-10-08T06:09:38.163886+0000","last_clean":"2023-10-08T06:09:38.163886+0000","last_became_active":"2023-10-08T06:09:37.192566+0000","last_became_peered":"2023-10-08T06:09:37.192566+0000","last_unstale":"2023-10-08T06:09:38.163886+0000","last_undegraded":"2023-10-08T06:09:38.163886+0000","last_fullsized":"2023-10-08T06:09:38.163886+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:18:15.487038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.323580+0000","last_change":"2023-10-08T06:09:36.174556+0000","last_active":"2023-10-08T06:09:38.323580+0000","last_peered":"2023-10-08T06:09:38.323580+0000","last_clean":"2023-10-08T06:09:38.323580+0000","last_became_active":"2023-10-08T06:09:36.174232+0000","last_became_peered":"2023-10-08T06:09:36.174232+0000","last_unstale":"2023-10-08T06:09:38.323580+0000","last_undegraded":"2023-10-08T06:09:38.323580+0000","last_fullsized":"2023-10-08T06:09:38.323580+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_clean_scrub_stamp":"2023-10-08T06:09:35.125722+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:38:58.906188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.165929+0000","last_change":"2023-10-08T06:09:37.192804+0000","last_active":"2023-10-08T06:09:38.165929+0000","last_peered":"2023-10-08T06:09:38.165929+0000","last_clean":"2023-10-08T06:09:38.165929+0000","last_became_active":"2023-10-08T06:09:37.192500+0000","last_became_peered":"2023-10-08T06:09:37.192500+0000","last_unstale":"2023-10-08T06:09:38.165929+0000","last_undegraded":"2023-10-08T06:09:38.165929+0000","last_fullsized":"2023-10-08T06:09:38.165929+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:04:32.307233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.317884+0000","last_change":"2023-10-08T06:09:36.177373+0000","last_active":"2023-10-08T06:09:38.317884+0000","last_peered":"2023-10-08T06:09:38.317884+0000","last_clean":"2023-10-08T06:09:38.317884+0000","last_became_active":"2023-10-08T06:09:36.176919+0000","last_became_peered":"2023-10-08T06:09:36.176919+0000","last_unstale":"2023-10-08T06:09:38.317884+0000","last_undegraded":"2023-10-08T06:09:38.317884+0000","last_fullsized":"2023-10-08T06:09:38.317884+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_clean_scrub_stamp":"2023-10-08T06:09:35.125722+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:19:59.810056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.166276+0000","last_change":"2023-10-08T06:09:37.194526+0000","last_active":"2023-10-08T06:09:38.166276+0000","last_peered":"2023-10-08T06:09:38.166276+0000","last_clean":"2023-10-08T06:09:38.166276+0000","last_became_active":"2023-10-08T06:09:37.193884+0000","last_became_peered":"2023-10-08T06:09:37.193884+0000","last_unstale":"2023-10-08T06:09:38.166276+0000","last_undegraded":"2023-10-08T06:09:38.166276+0000","last_fullsized":"2023-10-08T06:09:38.166276+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:06:09.459089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.162713+0000","last_change":"2023-10-08T06:09:36.175751+0000","last_active":"2023-10-08T06:09:38.162713+0000","last_peered":"2023-10-08T06:09:38.162713+0000","last_clean":"2023-10-08T06:09:38.162713+0000","last_became_active":"2023-10-08T06:09:36.175401+0000","last_became_peered":"2023-10-08T06:09:36.175401+0000","last_unstale":"2023-10-08T06:09:38.162713+0000","last_undegraded":"2023-10-08T06:09:38.162713+0000","last_fullsized":"2023-10-08T06:09:38.162713+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_clean_scrub_stamp":"2023-10-08T06:09:35.125722+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:05:49.733090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.166140+0000","last_change":"2023-10-08T06:09:37.186035+0000","last_active":"2023-10-08T06:09:38.166140+0000","last_peered":"2023-10-08T06:09:38.166140+0000","last_clean":"2023-10-08T06:09:38.166140+0000","last_became_active":"2023-10-08T06:09:37.182569+0000","last_became_peered":"2023-10-08T06:09:37.182569+0000","last_unstale":"2023-10-08T06:09:38.166140+0000","last_undegraded":"2023-10-08T06:09:38.166140+0000","last_fullsized":"2023-10-08T06:09:38.166140+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:36:49.578063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.317778+0000","last_change":"2023-10-08T06:09:36.168728+0000","last_active":"2023-10-08T06:09:38.317778+0000","last_peered":"2023-10-08T06:09:38.317778+0000","last_clean":"2023-10-08T06:09:38.317778+0000","last_became_active":"2023-10-08T06:09:36.168339+0000","last_became_peered":"2023-10-08T06:09:36.168339+0000","last_unstale":"2023-10-08T06:09:38.317778+0000","last_undegraded":"2023-10-08T06:09:38.317778+0000","last_fullsized":"2023-10-08T06:09:38.317778+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_clean_scrub_stamp":"2023-10-08T06:09:35.125722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:17:11.482633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.165436+0000","last_change":"2023-10-08T06:09:37.194313+0000","last_active":"2023-10-08T06:09:38.165436+0000","last_peered":"2023-10-08T06:09:38.165436+0000","last_clean":"2023-10-08T06:09:38.165436+0000","last_became_active":"2023-10-08T06:09:37.193990+0000","last_became_peered":"2023-10-08T06:09:37.193990+0000","last_unstale":"2023-10-08T06:09:38.165436+0000","last_undegraded":"2023-10-08T06:09:38.165436+0000","last_fullsized":"2023-10-08T06:09:38.165436+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:36:49.578063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":165,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-08T06:09:37.175106+0000","last_change":"2023-10-08T06:09:24.811692+0000","last_active":"2023-10-08T06:09:37.175106+0000","last_peered":"2023-10-08T06:09:37.175106+0000","last_clean":"2023-10-08T06:09:37.175106+0000","last_became_active":"2023-10-08T06:09:24.809788+0000","last_became_peered":"2023-10-08T06:09:24.809788+0000","last_unstale":"2023-10-08T06:09:37.175106+0000","last_undegraded":"2023-10-08T06:09:37.175106+0000","last_fullsized":"2023-10-08T06:09:37.175106+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:23.748736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:23.748736+0000","last_clean_scrub_stamp":"2023-10-08T06:09:23.748736+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:39:45.599458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.164066+0000","last_change":"2023-10-08T06:09:36.168138+0000","last_active":"2023-10-08T06:09:38.164066+0000","last_peered":"2023-10-08T06:09:38.164066+0000","last_clean":"2023-10-08T06:09:38.164066+0000","last_became_active":"2023-10-08T06:09:36.167559+0000","last_became_peered":"2023-10-08T06:09:36.167559+0000","last_unstale":"2023-10-08T06:09:38.164066+0000","last_undegraded":"2023-10-08T06:09:38.164066+0000","last_fullsized":"2023-10-08T06:09:38.164066+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_clean_scrub_stamp":"2023-10-08T06:09:35.125722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:38:58.906188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.439834+0000","last_change":"2023-10-08T06:09:37.174591+0000","last_active":"2023-10-08T06:09:38.439834+0000","last_peered":"2023-10-08T06:09:38.439834+0000","last_clean":"2023-10-08T06:09:38.439834+0000","last_became_active":"2023-10-08T06:09:37.174291+0000","last_became_peered":"2023-10-08T06:09:37.174291+0000","last_unstale":"2023-10-08T06:09:38.439834+0000","last_undegraded":"2023-10-08T06:09:38.439834+0000","last_fullsized":"2023-10-08T06:09:38.439834+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:59:38.084934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.163652+0000","last_change":"2023-10-08T06:09:36.177856+0000","last_active":"2023-10-08T06:09:38.163652+0000","last_peered":"2023-10-08T06:09:38.163652+0000","last_clean":"2023-10-08T06:09:38.163652+0000","last_became_active":"2023-10-08T06:09:36.177525+0000","last_became_peered":"2023-10-08T06:09:36.177525+0000","last_unstale":"2023-10-08T06:09:38.163652+0000","last_undegraded":"2023-10-08T06:09:38.163652+0000","last_fullsized":"2023-10-08T06:09:38.163652+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_clean_scrub_stamp":"2023-10-08T06:09:35.125722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:18:38.124206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.438491+0000","last_change":"2023-10-08T06:09:37.188650+0000","last_active":"2023-10-08T06:09:38.438491+0000","last_peered":"2023-10-08T06:09:38.438491+0000","last_clean":"2023-10-08T06:09:38.438491+0000","last_became_active":"2023-10-08T06:09:37.187914+0000","last_became_peered":"2023-10-08T06:09:37.187914+0000","last_unstale":"2023-10-08T06:09:38.438491+0000","last_undegraded":"2023-10-08T06:09:38.438491+0000","last_fullsized":"2023-10-08T06:09:38.438491+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:09:43.900564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.317739+0000","last_change":"2023-10-08T06:09:36.174692+0000","last_active":"2023-10-08T06:09:38.317739+0000","last_peered":"2023-10-08T06:09:38.317739+0000","last_clean":"2023-10-08T06:09:38.317739+0000","last_became_active":"2023-10-08T06:09:36.174385+0000","last_became_peered":"2023-10-08T06:09:36.174385+0000","last_unstale":"2023-10-08T06:09:38.317739+0000","last_undegraded":"2023-10-08T06:09:38.317739+0000","last_fullsized":"2023-10-08T06:09:38.317739+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_clean_scrub_stamp":"2023-10-08T06:09:35.125722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:15:43.326854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.161620+0000","last_change":"2023-10-08T06:09:37.180115+0000","last_active":"2023-10-08T06:09:38.161620+0000","last_peered":"2023-10-08T06:09:38.161620+0000","last_clean":"2023-10-08T06:09:38.161620+0000","last_became_active":"2023-10-08T06:09:37.179866+0000","last_became_peered":"2023-10-08T06:09:37.179866+0000","last_unstale":"2023-10-08T06:09:38.161620+0000","last_undegraded":"2023-10-08T06:09:38.161620+0000","last_fullsized":"2023-10-08T06:09:38.161620+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:22:50.644480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.165478+0000","last_change":"2023-10-08T06:09:36.179535+0000","last_active":"2023-10-08T06:09:38.165478+0000","last_peered":"2023-10-08T06:09:38.165478+0000","last_clean":"2023-10-08T06:09:38.165478+0000","last_became_active":"2023-10-08T06:09:36.179229+0000","last_became_peered":"2023-10-08T06:09:36.179229+0000","last_unstale":"2023-10-08T06:09:38.165478+0000","last_undegraded":"2023-10-08T06:09:38.165478+0000","last_fullsized":"2023-10-08T06:09:38.165478+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_clean_scrub_stamp":"2023-10-08T06:09:35.125722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:49:16.044898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.438668+0000","last_change":"2023-10-08T06:09:37.187671+0000","last_active":"2023-10-08T06:09:38.438668+0000","last_peered":"2023-10-08T06:09:38.438668+0000","last_clean":"2023-10-08T06:09:38.438668+0000","last_became_active":"2023-10-08T06:09:37.187278+0000","last_became_peered":"2023-10-08T06:09:37.187278+0000","last_unstale":"2023-10-08T06:09:38.438668+0000","last_undegraded":"2023-10-08T06:09:38.438668+0000","last_fullsized":"2023-10-08T06:09:38.438668+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:15:44.339765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.162458+0000","last_change":"2023-10-08T06:09:36.170421+0000","last_active":"2023-10-08T06:09:38.162458+0000","last_peered":"2023-10-08T06:09:38.162458+0000","last_clean":"2023-10-08T06:09:38.162458+0000","last_became_active":"2023-10-08T06:09:36.169186+0000","last_became_peered":"2023-10-08T06:09:36.169186+0000","last_unstale":"2023-10-08T06:09:38.162458+0000","last_undegraded":"2023-10-08T06:09:38.162458+0000","last_fullsized":"2023-10-08T06:09:38.162458+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_clean_scrub_stamp":"2023-10-08T06:09:35.125722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:52:59.381910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.166119+0000","last_change":"2023-10-08T06:09:37.187824+0000","last_active":"2023-10-08T06:09:38.166119+0000","last_peered":"2023-10-08T06:09:38.166119+0000","last_clean":"2023-10-08T06:09:38.166119+0000","last_became_active":"2023-10-08T06:09:37.186117+0000","last_became_peered":"2023-10-08T06:09:37.186117+0000","last_unstale":"2023-10-08T06:09:38.166119+0000","last_undegraded":"2023-10-08T06:09:38.166119+0000","last_fullsized":"2023-10-08T06:09:38.166119+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:06:58.385054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.165731+0000","last_change":"2023-10-08T06:09:36.174520+0000","last_active":"2023-10-08T06:09:38.165731+0000","last_peered":"2023-10-08T06:09:38.165731+0000","last_clean":"2023-10-08T06:09:38.165731+0000","last_became_active":"2023-10-08T06:09:36.174174+0000","last_became_peered":"2023-10-08T06:09:36.174174+0000","last_unstale":"2023-10-08T06:09:38.165731+0000","last_undegraded":"2023-10-08T06:09:38.165731+0000","last_fullsized":"2023-10-08T06:09:38.165731+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_clean_scrub_stamp":"2023-10-08T06:09:35.125722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:21:37.338545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.162247+0000","last_change":"2023-10-08T06:09:37.185459+0000","last_active":"2023-10-08T06:09:38.162247+0000","last_peered":"2023-10-08T06:09:38.162247+0000","last_clean":"2023-10-08T06:09:38.162247+0000","last_became_active":"2023-10-08T06:09:37.185174+0000","last_became_peered":"2023-10-08T06:09:37.185174+0000","last_unstale":"2023-10-08T06:09:38.162247+0000","last_undegraded":"2023-10-08T06:09:38.162247+0000","last_fullsized":"2023-10-08T06:09:38.162247+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:21:38.351456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.319780+0000","last_change":"2023-10-08T06:09:36.180184+0000","last_active":"2023-10-08T06:09:38.319780+0000","last_peered":"2023-10-08T06:09:38.319780+0000","last_clean":"2023-10-08T06:09:38.319780+0000","last_became_active":"2023-10-08T06:09:36.179847+0000","last_became_peered":"2023-10-08T06:09:36.179847+0000","last_unstale":"2023-10-08T06:09:38.319780+0000","last_undegraded":"2023-10-08T06:09:38.319780+0000","last_fullsized":"2023-10-08T06:09:38.319780+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_clean_scrub_stamp":"2023-10-08T06:09:35.125722+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:41:18.133708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.441692+0000","last_change":"2023-10-08T06:09:37.186300+0000","last_active":"2023-10-08T06:09:38.441692+0000","last_peered":"2023-10-08T06:09:38.441692+0000","last_clean":"2023-10-08T06:09:38.441692+0000","last_became_active":"2023-10-08T06:09:37.185836+0000","last_became_peered":"2023-10-08T06:09:37.185836+0000","last_unstale":"2023-10-08T06:09:38.441692+0000","last_undegraded":"2023-10-08T06:09:38.441692+0000","last_fullsized":"2023-10-08T06:09:38.441692+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:40:15.474700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.259033+0000","last_change":"2023-10-08T06:09:36.177038+0000","last_active":"2023-10-08T06:09:38.259033+0000","last_peered":"2023-10-08T06:09:38.259033+0000","last_clean":"2023-10-08T06:09:38.259033+0000","last_became_active":"2023-10-08T06:09:36.176498+0000","last_became_peered":"2023-10-08T06:09:36.176498+0000","last_unstale":"2023-10-08T06:09:38.259033+0000","last_undegraded":"2023-10-08T06:09:38.259033+0000","last_fullsized":"2023-10-08T06:09:38.259033+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_clean_scrub_stamp":"2023-10-08T06:09:35.125722+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:09:42.887654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.440284+0000","last_change":"2023-10-08T06:09:37.183347+0000","last_active":"2023-10-08T06:09:38.440284+0000","last_peered":"2023-10-08T06:09:38.440284+0000","last_clean":"2023-10-08T06:09:38.440284+0000","last_became_active":"2023-10-08T06:09:37.183069+0000","last_became_peered":"2023-10-08T06:09:37.183069+0000","last_unstale":"2023-10-08T06:09:38.440284+0000","last_undegraded":"2023-10-08T06:09:38.440284+0000","last_fullsized":"2023-10-08T06:09:38.440284+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:34:25.213819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.163642+0000","last_change":"2023-10-08T06:09:36.173735+0000","last_active":"2023-10-08T06:09:38.163642+0000","last_peered":"2023-10-08T06:09:38.163642+0000","last_clean":"2023-10-08T06:09:38.163642+0000","last_became_active":"2023-10-08T06:09:36.173306+0000","last_became_peered":"2023-10-08T06:09:36.173306+0000","last_unstale":"2023-10-08T06:09:38.163642+0000","last_undegraded":"2023-10-08T06:09:38.163642+0000","last_fullsized":"2023-10-08T06:09:38.163642+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_clean_scrub_stamp":"2023-10-08T06:09:35.125722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:19:59.810056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.438530+0000","last_change":"2023-10-08T06:09:37.183706+0000","last_active":"2023-10-08T06:09:38.438530+0000","last_peered":"2023-10-08T06:09:38.438530+0000","last_clean":"2023-10-08T06:09:38.438530+0000","last_became_active":"2023-10-08T06:09:37.183394+0000","last_became_peered":"2023-10-08T06:09:37.183394+0000","last_unstale":"2023-10-08T06:09:38.438530+0000","last_undegraded":"2023-10-08T06:09:38.438530+0000","last_fullsized":"2023-10-08T06:09:38.438530+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:20:00.822966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.161813+0000","last_change":"2023-10-08T06:09:36.171679+0000","last_active":"2023-10-08T06:09:38.161813+0000","last_peered":"2023-10-08T06:09:38.161813+0000","last_clean":"2023-10-08T06:09:38.161813+0000","last_became_active":"2023-10-08T06:09:36.171169+0000","last_became_peered":"2023-10-08T06:09:36.171169+0000","last_unstale":"2023-10-08T06:09:38.161813+0000","last_undegraded":"2023-10-08T06:09:38.161813+0000","last_fullsized":"2023-10-08T06:09:38.161813+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_clean_scrub_stamp":"2023-10-08T06:09:35.125722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:23:11.727351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.439354+0000","last_change":"2023-10-08T06:09:37.176151+0000","last_active":"2023-10-08T06:09:38.439354+0000","last_peered":"2023-10-08T06:09:38.439354+0000","last_clean":"2023-10-08T06:09:38.439354+0000","last_became_active":"2023-10-08T06:09:37.175845+0000","last_became_peered":"2023-10-08T06:09:37.175845+0000","last_unstale":"2023-10-08T06:09:38.439354+0000","last_undegraded":"2023-10-08T06:09:38.439354+0000","last_fullsized":"2023-10-08T06:09:38.439354+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:07:29.091521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.161868+0000","last_change":"2023-10-08T06:09:36.174531+0000","last_active":"2023-10-08T06:09:38.161868+0000","last_peered":"2023-10-08T06:09:38.161868+0000","last_clean":"2023-10-08T06:09:38.161868+0000","last_became_active":"2023-10-08T06:09:36.174216+0000","last_became_peered":"2023-10-08T06:09:36.174216+0000","last_unstale":"2023-10-08T06:09:38.161868+0000","last_undegraded":"2023-10-08T06:09:38.161868+0000","last_fullsized":"2023-10-08T06:09:38.161868+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_clean_scrub_stamp":"2023-10-08T06:09:35.125722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:17:11.482633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.439685+0000","last_change":"2023-10-08T06:09:37.191746+0000","last_active":"2023-10-08T06:09:38.439685+0000","last_peered":"2023-10-08T06:09:38.439685+0000","last_clean":"2023-10-08T06:09:38.439685+0000","last_became_active":"2023-10-08T06:09:37.191481+0000","last_became_peered":"2023-10-08T06:09:37.191481+0000","last_unstale":"2023-10-08T06:09:38.439685+0000","last_undegraded":"2023-10-08T06:09:38.439685+0000","last_fullsized":"2023-10-08T06:09:38.439685+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:28:49.792955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.165140+0000","last_change":"2023-10-08T06:09:36.179497+0000","last_active":"2023-10-08T06:09:38.165140+0000","last_peered":"2023-10-08T06:09:38.165140+0000","last_clean":"2023-10-08T06:09:38.165140+0000","last_became_active":"2023-10-08T06:09:36.179129+0000","last_became_peered":"2023-10-08T06:09:36.179129+0000","last_unstale":"2023-10-08T06:09:38.165140+0000","last_undegraded":"2023-10-08T06:09:38.165140+0000","last_fullsized":"2023-10-08T06:09:38.165140+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_clean_scrub_stamp":"2023-10-08T06:09:35.125722+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:34:23.204560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.258598+0000","last_change":"2023-10-08T06:09:37.185754+0000","last_active":"2023-10-08T06:09:38.258598+0000","last_peered":"2023-10-08T06:09:38.258598+0000","last_clean":"2023-10-08T06:09:38.258598+0000","last_became_active":"2023-10-08T06:09:37.185472+0000","last_became_peered":"2023-10-08T06:09:37.185472+0000","last_unstale":"2023-10-08T06:09:38.258598+0000","last_undegraded":"2023-10-08T06:09:38.258598+0000","last_fullsized":"2023-10-08T06:09:38.258598+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:34:24.217470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.166112+0000","last_change":"2023-10-08T06:09:37.181546+0000","last_active":"2023-10-08T06:09:38.166112+0000","last_peered":"2023-10-08T06:09:38.166112+0000","last_clean":"2023-10-08T06:09:38.166112+0000","last_became_active":"2023-10-08T06:09:37.181244+0000","last_became_peered":"2023-10-08T06:09:37.181244+0000","last_unstale":"2023-10-08T06:09:38.166112+0000","last_undegraded":"2023-10-08T06:09:38.166112+0000","last_fullsized":"2023-10-08T06:09:38.166112+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:16:03.874960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.165289+0000","last_change":"2023-10-08T06:09:36.173329+0000","last_active":"2023-10-08T06:09:38.165289+0000","last_peered":"2023-10-08T06:09:38.165289+0000","last_clean":"2023-10-08T06:09:38.165289+0000","last_became_active":"2023-10-08T06:09:36.172872+0000","last_became_peered":"2023-10-08T06:09:36.172872+0000","last_unstale":"2023-10-08T06:09:38.165289+0000","last_undegraded":"2023-10-08T06:09:38.165289+0000","last_fullsized":"2023-10-08T06:09:38.165289+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_clean_scrub_stamp":"2023-10-08T06:09:35.125722+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:56:28.969959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.165938+0000","last_change":"2023-10-08T06:09:37.168180+0000","last_active":"2023-10-08T06:09:38.165938+0000","last_peered":"2023-10-08T06:09:38.165938+0000","last_clean":"2023-10-08T06:09:38.165938+0000","last_became_active":"2023-10-08T06:09:37.167874+0000","last_became_peered":"2023-10-08T06:09:37.167874+0000","last_unstale":"2023-10-08T06:09:38.165938+0000","last_undegraded":"2023-10-08T06:09:38.165938+0000","last_fullsized":"2023-10-08T06:09:38.165938+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:06:27.727341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.165564+0000","last_change":"2023-10-08T06:09:36.181123+0000","last_active":"2023-10-08T06:09:38.165564+0000","last_peered":"2023-10-08T06:09:38.165564+0000","last_clean":"2023-10-08T06:09:38.165564+0000","last_became_active":"2023-10-08T06:09:36.180774+0000","last_became_peered":"2023-10-08T06:09:36.180774+0000","last_unstale":"2023-10-08T06:09:38.165564+0000","last_undegraded":"2023-10-08T06:09:38.165564+0000","last_fullsized":"2023-10-08T06:09:38.165564+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_clean_scrub_stamp":"2023-10-08T06:09:35.125722+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:23:11.727351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.439287+0000","last_change":"2023-10-08T06:09:37.194698+0000","last_active":"2023-10-08T06:09:38.439287+0000","last_peered":"2023-10-08T06:09:38.439287+0000","last_clean":"2023-10-08T06:09:38.439287+0000","last_became_active":"2023-10-08T06:09:37.194354+0000","last_became_peered":"2023-10-08T06:09:37.194354+0000","last_unstale":"2023-10-08T06:09:38.439287+0000","last_undegraded":"2023-10-08T06:09:38.439287+0000","last_fullsized":"2023-10-08T06:09:38.439287+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:41:19.146619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-08T06:09:37.321003+0000","last_change":"2023-10-08T06:09:36.175818+0000","last_active":"2023-10-08T06:09:37.321003+0000","last_peered":"2023-10-08T06:09:37.321003+0000","last_clean":"2023-10-08T06:09:37.321003+0000","last_became_active":"2023-10-08T06:09:36.175493+0000","last_became_peered":"2023-10-08T06:09:36.175493+0000","last_unstale":"2023-10-08T06:09:37.321003+0000","last_undegraded":"2023-10-08T06:09:37.321003+0000","last_fullsized":"2023-10-08T06:09:37.321003+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_clean_scrub_stamp":"2023-10-08T06:09:35.125722+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:29:33.964626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.441328+0000","last_change":"2023-10-08T06:09:37.183447+0000","last_active":"2023-10-08T06:09:38.441328+0000","last_peered":"2023-10-08T06:09:38.441328+0000","last_clean":"2023-10-08T06:09:38.441328+0000","last_became_active":"2023-10-08T06:09:37.183169+0000","last_became_peered":"2023-10-08T06:09:37.183169+0000","last_unstale":"2023-10-08T06:09:38.441328+0000","last_undegraded":"2023-10-08T06:09:38.441328+0000","last_fullsized":"2023-10-08T06:09:38.441328+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:14:21.323882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"21'4","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.325531+0000","last_change":"2023-10-08T06:09:36.173093+0000","last_active":"2023-10-08T06:09:38.325531+0000","last_peered":"2023-10-08T06:09:38.325531+0000","last_clean":"2023-10-08T06:09:38.325531+0000","last_became_active":"2023-10-08T06:09:36.172702+0000","last_became_peered":"2023-10-08T06:09:36.172702+0000","last_unstale":"2023-10-08T06:09:38.325531+0000","last_undegraded":"2023-10-08T06:09:38.325531+0000","last_fullsized":"2023-10-08T06:09:38.325531+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_clean_scrub_stamp":"2023-10-08T06:09:35.125722+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:52:59.381910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509447,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":819200,"data_stored":667190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94299999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61199999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85999999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.125}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73199999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2030000000000001}]}]},{"osd":6,"up_from":15,"seq":64424509448,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":233472,"data_stored":77852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66000000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.627}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78400000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0409999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.01}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1379999999999999}]}]},{"osd":5,"up_from":15,"seq":64424509447,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":225280,"data_stored":76330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54600000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77900000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94799999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98699999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91900000000000004}]}]},{"osd":4,"up_from":15,"seq":64424509447,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":233472,"data_stored":76366,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1990000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69899999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90600000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86899999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81000000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2230000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96899999999999997}]}]},{"osd":2,"up_from":15,"seq":64424509447,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31404,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340436,"statfs":{"total":96636764160,"available":96604606464,"internally_reserved":0,"allocated":221184,"data_stored":76240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89500000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64300000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92800000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1160000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.163}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1870000000000001}]}]},{"osd":1,"up_from":15,"seq":64424509446,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31412,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340428,"statfs":{"total":96636764160,"available":96604598272,"internally_reserved":0,"allocated":229376,"data_stored":76400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70699999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50600000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80600000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.115}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0609999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1879999999999999}]}]},{"osd":0,"up_from":15,"seq":64424509447,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31992,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339848,"statfs":{"total":96636764160,"available":96604004352,"internally_reserved":0,"allocated":827392,"data_stored":667246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68500000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82699999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.046}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0289999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.179}]}]},{"osd":3,"up_from":14,"seq":60129542150,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31408,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340432,"statfs":{"total":96636764160,"available":96604602368,"internally_reserved":0,"allocated":233472,"data_stored":77852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41799999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36099999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29699999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82299999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59699999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98799999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70999999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T06:09:45.941 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T06:09:46.055 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.048+0000 7fc0bf59e700 1 Processor -- start 2023-10-08T06:09:46.055 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.048+0000 7fc0bf59e700 1 -- start start 2023-10-08T06:09:46.055 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.048+0000 7fc0bf59e700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fc0c015b980 0x7fc0c015f780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:46.055 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.048+0000 7fc0bf59e700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc0c00719e0 0x7fc0c00c9420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:46.055 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.048+0000 7fc0bf59e700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0c006fc20 con 0x7fc0c00c9960 2023-10-08T06:09:46.055 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.048+0000 7fc0bf59e700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0c00c9e10 con 0x7fc0c015b980 2023-10-08T06:09:46.056 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.048+0000 7fc0bf59e700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0c0070430 con 0x7fc0c00719e0 2023-10-08T06:09:46.056 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.048+0000 7fc0be59c700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fc0c015b980 0x7fc0c015f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:46.056 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.048+0000 7fc0b7fff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc0c00719e0 0x7fc0c00c9420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:46.056 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.048+0000 7fc0bed9d700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fc0c00c9960 0x7fc0c015bd60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.32:46046/0 (socket says 172.21.15.32:46046) 2023-10-08T06:09:46.056 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.048+0000 7fc0bed9d700 1 -- 172.21.15.32:0/2107468302 learned_addr learned my addr 172.21.15.32:0/2107468302 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-08T06:09:46.056 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.048+0000 7fc0be59c700 1 --2- 172.21.15.32:0/2107468302 >> v2:172.21.15.32:3300/0 conn(0x7fc0c015b980 0x7fc0c015f780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:59692/0 (socket says 172.21.15.32:59692) 2023-10-08T06:09:46.056 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.048+0000 7fc0be59c700 1 -- 172.21.15.32:0/2107468302 >> v2:172.21.15.40:3300/0 conn(0x7fc0c00719e0 msgr2=0x7fc0c00c9420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:09:46.056 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.048+0000 7fc0be59c700 1 --2- 172.21.15.32:0/2107468302 >> v2:172.21.15.40:3300/0 conn(0x7fc0c00719e0 0x7fc0c00c9420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:46.056 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.048+0000 7fc0bdd9b700 1 -- 172.21.15.32:0/2107468302 <== mon.1 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3982458973 0 0) 0x7fc0c006fc20 con 0x7fc0c00c9960 2023-10-08T06:09:46.056 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.048+0000 7fc0be59c700 1 -- 172.21.15.32:0/2107468302 >> v1:172.21.15.40:6789/0 conn(0x7fc0c00c9960 legacy=0x7fc0c015bd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:46.057 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.048+0000 7fc0be59c700 1 -- 172.21.15.32:0/2107468302 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0c015fcc0 con 0x7fc0c015b980 2023-10-08T06:09:46.057 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.052+0000 7fc0be59c700 1 --2- 172.21.15.32:0/2107468302 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc0c015b980 0x7fc0c015f780 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fc0c00685e0 tx=0x7fc0b0009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cf93618c6ba88ba server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:46.057 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.052+0000 7fc0bdd9b700 1 -- 172.21.15.32:0/2107468302 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0b0011830 con 0x7fc0c015b980 2023-10-08T06:09:46.057 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.052+0000 7fc0bdd9b700 1 -- 172.21.15.32:0/2107468302 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0b0011990 con 0x7fc0c015b980 2023-10-08T06:09:46.057 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.052+0000 7fc0bdd9b700 1 -- 172.21.15.32:0/2107468302 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0b0011d20 con 0x7fc0c015b980 2023-10-08T06:09:46.057 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.052+0000 7fc0bf59e700 1 -- 172.21.15.32:0/2107468302 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc0c015b980 msgr2=0x7fc0c015f780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:46.057 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.052+0000 7fc0bf59e700 1 --2- 172.21.15.32:0/2107468302 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc0c015b980 0x7fc0c015f780 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fc0c00685e0 tx=0x7fc0b0009b30 comp rx=0 tx=0).stop 2023-10-08T06:09:46.057 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.052+0000 7fc0bf59e700 1 -- 172.21.15.32:0/2107468302 shutdown_connections 2023-10-08T06:09:46.057 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.052+0000 7fc0bf59e700 1 --2- 172.21.15.32:0/2107468302 >> v2:172.21.15.40:3300/0 conn(0x7fc0c00719e0 0x7fc0c00c9420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:46.057 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.052+0000 7fc0bf59e700 1 --2- 172.21.15.32:0/2107468302 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc0c015b980 0x7fc0c015f780 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:46.057 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.052+0000 7fc0bf59e700 1 -- 172.21.15.32:0/2107468302 >> 172.21.15.32:0/2107468302 conn(0x7fc0c00b0900 msgr2=0x7fc0c00b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:09:46.058 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.052+0000 7fc0bf59e700 1 -- 172.21.15.32:0/2107468302 shutdown_connections 2023-10-08T06:09:46.058 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.052+0000 7fc0bf59e700 1 -- 172.21.15.32:0/2107468302 wait complete. 2023-10-08T06:09:46.058 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.052+0000 7fc0bf59e700 1 Processor -- start 2023-10-08T06:09:46.058 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.052+0000 7fc0bf59e700 1 -- start start 2023-10-08T06:09:46.060 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.056+0000 7fc0bf59e700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc0c00719e0 0x7fc0c00c4fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:46.060 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.056+0000 7fc0bf59e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc0c00c9960 0x7fc0c00ce450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:46.060 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.056+0000 7fc0bf59e700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc0c015b980 0x7fc0c00cb440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:46.060 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.056+0000 7fc0bf59e700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0c014b6b0 con 0x7fc0c00719e0 2023-10-08T06:09:46.060 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.056+0000 7fc0bf59e700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0c00c5510 con 0x7fc0c015b980 2023-10-08T06:09:46.060 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.056+0000 7fc0bf59e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0c00ce990 con 0x7fc0c00c9960 2023-10-08T06:09:46.060 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.056+0000 7fc0be59c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc0c00719e0 0x7fc0c00c4fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:46.060 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.056+0000 7fc0b7fff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc0c00c9960 0x7fc0c00ce450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:46.060 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.056+0000 7fc0be59c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc0c00719e0 0x7fc0c00c4fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:59706/0 (socket says 172.21.15.32:59706) 2023-10-08T06:09:46.061 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.056+0000 7fc0be59c700 1 -- 172.21.15.32:0/31030619 learned_addr learned my addr 172.21.15.32:0/31030619 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:09:46.061 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.056+0000 7fc0bed9d700 1 --2- 172.21.15.32:0/31030619 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc0c015b980 0x7fc0c00cb440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:46.061 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.056+0000 7fc0be59c700 1 -- 172.21.15.32:0/31030619 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc0c00c9960 msgr2=0x7fc0c00ce450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:46.061 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.056+0000 7fc0be59c700 1 --2- 172.21.15.32:0/31030619 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc0c00c9960 0x7fc0c00ce450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:46.061 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.056+0000 7fc0be59c700 1 -- 172.21.15.32:0/31030619 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc0c015b980 msgr2=0x7fc0c00cb440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:46.061 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.056+0000 7fc0be59c700 1 --2- 172.21.15.32:0/31030619 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc0c015b980 0x7fc0c00cb440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:46.061 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.056+0000 7fc0be59c700 1 -- 172.21.15.32:0/31030619 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0b00094b0 con 0x7fc0c00719e0 2023-10-08T06:09:46.061 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.056+0000 7fc0b7fff700 1 --2- 172.21.15.32:0/31030619 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc0c00c9960 0x7fc0c00ce450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T06:09:46.062 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.056+0000 7fc0be59c700 1 --2- 172.21.15.32:0/31030619 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc0c00719e0 0x7fc0c00c4fd0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fc0b0014040 tx=0x7fc0b0004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:46.062 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.056+0000 7fc0b6ffd700 1 -- 172.21.15.32:0/31030619 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0b0004610 con 0x7fc0c00719e0 2023-10-08T06:09:46.062 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.056+0000 7fc0b6ffd700 1 -- 172.21.15.32:0/31030619 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0b001e070 con 0x7fc0c00719e0 2023-10-08T06:09:46.062 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.056+0000 7fc0bf59e700 1 -- 172.21.15.32:0/31030619 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0c01562b0 con 0x7fc0c00719e0 2023-10-08T06:09:46.062 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.056+0000 7fc0b6ffd700 1 -- 172.21.15.32:0/31030619 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0b00038e0 con 0x7fc0c00719e0 2023-10-08T06:09:46.062 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.056+0000 7fc0bf59e700 1 -- 172.21.15.32:0/31030619 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0c0156870 con 0x7fc0c00719e0 2023-10-08T06:09:46.062 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.056+0000 7fc0bf59e700 1 -- 172.21.15.32:0/31030619 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0c0073f00 con 0x7fc0c00719e0 2023-10-08T06:09:46.063 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.060+0000 7fc0b6ffd700 1 -- 172.21.15.32:0/31030619 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fc0b0003a40 con 0x7fc0c00719e0 2023-10-08T06:09:46.063 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.060+0000 7fc0b6ffd700 1 --2- 172.21.15.32:0/31030619 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fc0a0066510 0x7fc0a00689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:46.063 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.060+0000 7fc0b6ffd700 1 -- 172.21.15.32:0/31030619 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc0b0084c30 con 0x7fc0c00719e0 2023-10-08T06:09:46.063 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.060+0000 7fc0b7fff700 1 --2- 172.21.15.32:0/31030619 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fc0a0066510 0x7fc0a00689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:46.063 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.060+0000 7fc0b7fff700 1 --2- 172.21.15.32:0/31030619 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fc0a0066510 0x7fc0a00689d0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fc0c014b860 tx=0x7fc0a8009240 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:46.067 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.064+0000 7fc0b6ffd700 1 -- 172.21.15.32:0/31030619 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fc0b00520c0 con 0x7fc0c00719e0 2023-10-08T06:09:46.224 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.224+0000 7fc0bf59e700 1 -- 172.21.15.32:0/31030619 --> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc0c0070150 con 0x7fc0a0066510 2023-10-08T06:09:46.241 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.240+0000 7fc0b6ffd700 1 -- 172.21.15.32:0/31030619 <== mgr.4107 v2:172.21.15.32:6832/2601628338 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264567 (secure 0 0 0) 0x7fc0a8011c20 con 0x7fc0a0066510 2023-10-08T06:09:46.244 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:09:46.246 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.244+0000 7fc0bf59e700 1 -- 172.21.15.32:0/31030619 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fc0a0066510 msgr2=0x7fc0a00689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:46.246 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.244+0000 7fc0bf59e700 1 --2- 172.21.15.32:0/31030619 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fc0a0066510 0x7fc0a00689d0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fc0c014b860 tx=0x7fc0a8009240 comp rx=0 tx=0).stop 2023-10-08T06:09:46.247 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.244+0000 7fc0bf59e700 1 -- 172.21.15.32:0/31030619 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc0c00719e0 msgr2=0x7fc0c00c4fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:46.247 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.244+0000 7fc0bf59e700 1 --2- 172.21.15.32:0/31030619 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc0c00719e0 0x7fc0c00c4fd0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fc0b0014040 tx=0x7fc0b0004770 comp rx=0 tx=0).stop 2023-10-08T06:09:46.247 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.244+0000 7fc0bf59e700 1 -- 172.21.15.32:0/31030619 shutdown_connections 2023-10-08T06:09:46.247 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.244+0000 7fc0bf59e700 1 --2- 172.21.15.32:0/31030619 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fc0a0066510 0x7fc0a00689d0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:46.247 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.244+0000 7fc0bf59e700 1 --2- 172.21.15.32:0/31030619 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc0c015b980 0x7fc0c00cb440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:46.247 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.244+0000 7fc0bf59e700 1 --2- 172.21.15.32:0/31030619 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc0c00c9960 0x7fc0c00ce450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:46.247 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.244+0000 7fc0bf59e700 1 --2- 172.21.15.32:0/31030619 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc0c00719e0 0x7fc0c00c4fd0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:46.247 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.244+0000 7fc0bf59e700 1 -- 172.21.15.32:0/31030619 >> 172.21.15.32:0/31030619 conn(0x7fc0c00b0900 msgr2=0x7fc0c01593a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:09:46.247 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.244+0000 7fc0bf59e700 1 -- 172.21.15.32:0/31030619 shutdown_connections 2023-10-08T06:09:46.247 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.244+0000 7fc0bf59e700 1 -- 172.21.15.32:0/31030619 wait complete. 2023-10-08T06:09:46.247 INFO:teuthology.orchestra.run.smithi032.stderr:dumped all 2023-10-08T06:09:46.258 INFO:teuthology.orchestra.run.smithi032.stdout:{"pg_ready":true,"pg_map":{"version":27,"stamp":"2023-10-08T06:09:45.251141+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235788,"kb_used_data":2952,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738932,"statfs":{"total":773094113280,"available":772852666368,"internally_reserved":0,"allocated":3022848,"data_stored":1795476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":238276153},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.095469"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.166128+0000","last_change":"2023-10-08T06:09:37.189119+0000","last_active":"2023-10-08T06:09:38.166128+0000","last_peered":"2023-10-08T06:09:38.166128+0000","last_clean":"2023-10-08T06:09:38.166128+0000","last_became_active":"2023-10-08T06:09:37.188327+0000","last_became_peered":"2023-10-08T06:09:37.188327+0000","last_unstale":"2023-10-08T06:09:38.166128+0000","last_undegraded":"2023-10-08T06:09:38.166128+0000","last_fullsized":"2023-10-08T06:09:38.166128+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:24:28.854916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.162226+0000","last_change":"2023-10-08T06:09:37.187273+0000","last_active":"2023-10-08T06:09:38.162226+0000","last_peered":"2023-10-08T06:09:38.162226+0000","last_clean":"2023-10-08T06:09:38.162226+0000","last_became_active":"2023-10-08T06:09:37.187002+0000","last_became_peered":"2023-10-08T06:09:37.187002+0000","last_unstale":"2023-10-08T06:09:38.162226+0000","last_undegraded":"2023-10-08T06:09:38.162226+0000","last_fullsized":"2023-10-08T06:09:38.162226+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:49:17.057808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.439703+0000","last_change":"2023-10-08T06:09:37.189008+0000","last_active":"2023-10-08T06:09:38.439703+0000","last_peered":"2023-10-08T06:09:38.439703+0000","last_clean":"2023-10-08T06:09:38.439703+0000","last_became_active":"2023-10-08T06:09:37.188668+0000","last_became_peered":"2023-10-08T06:09:37.188668+0000","last_unstale":"2023-10-08T06:09:38.439703+0000","last_undegraded":"2023-10-08T06:09:38.439703+0000","last_fullsized":"2023-10-08T06:09:38.439703+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:49:17.057808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.166462+0000","last_change":"2023-10-08T06:09:37.187681+0000","last_active":"2023-10-08T06:09:38.166462+0000","last_peered":"2023-10-08T06:09:38.166462+0000","last_clean":"2023-10-08T06:09:38.166462+0000","last_became_active":"2023-10-08T06:09:37.186052+0000","last_became_peered":"2023-10-08T06:09:37.186052+0000","last_unstale":"2023-10-08T06:09:38.166462+0000","last_undegraded":"2023-10-08T06:09:38.166462+0000","last_fullsized":"2023-10-08T06:09:38.166462+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:04:32.307233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.164796+0000","last_change":"2023-10-08T06:09:37.184596+0000","last_active":"2023-10-08T06:09:38.164796+0000","last_peered":"2023-10-08T06:09:38.164796+0000","last_clean":"2023-10-08T06:09:38.164796+0000","last_became_active":"2023-10-08T06:09:37.184317+0000","last_became_peered":"2023-10-08T06:09:37.184317+0000","last_unstale":"2023-10-08T06:09:38.164796+0000","last_undegraded":"2023-10-08T06:09:38.164796+0000","last_fullsized":"2023-10-08T06:09:38.164796+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:06:27.727341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.164499+0000","last_change":"2023-10-08T06:09:37.189924+0000","last_active":"2023-10-08T06:09:38.164499+0000","last_peered":"2023-10-08T06:09:38.164499+0000","last_clean":"2023-10-08T06:09:38.164499+0000","last_became_active":"2023-10-08T06:09:37.188282+0000","last_became_peered":"2023-10-08T06:09:37.188282+0000","last_unstale":"2023-10-08T06:09:38.164499+0000","last_undegraded":"2023-10-08T06:09:38.164499+0000","last_fullsized":"2023-10-08T06:09:38.164499+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:37:42.540248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.164130+0000","last_change":"2023-10-08T06:09:37.187514+0000","last_active":"2023-10-08T06:09:38.164130+0000","last_peered":"2023-10-08T06:09:38.164130+0000","last_clean":"2023-10-08T06:09:38.164130+0000","last_became_active":"2023-10-08T06:09:37.187122+0000","last_became_peered":"2023-10-08T06:09:37.187122+0000","last_unstale":"2023-10-08T06:09:38.164130+0000","last_undegraded":"2023-10-08T06:09:38.164130+0000","last_fullsized":"2023-10-08T06:09:38.164130+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:49:58.972598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.439267+0000","last_change":"2023-10-08T06:09:37.186725+0000","last_active":"2023-10-08T06:09:38.439267+0000","last_peered":"2023-10-08T06:09:38.439267+0000","last_clean":"2023-10-08T06:09:38.439267+0000","last_became_active":"2023-10-08T06:09:37.186416+0000","last_became_peered":"2023-10-08T06:09:37.186416+0000","last_unstale":"2023-10-08T06:09:38.439267+0000","last_undegraded":"2023-10-08T06:09:38.439267+0000","last_fullsized":"2023-10-08T06:09:38.439267+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:30:20.661501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.166298+0000","last_change":"2023-10-08T06:09:37.196289+0000","last_active":"2023-10-08T06:09:38.166298+0000","last_peered":"2023-10-08T06:09:38.166298+0000","last_clean":"2023-10-08T06:09:38.166298+0000","last_became_active":"2023-10-08T06:09:37.196029+0000","last_became_peered":"2023-10-08T06:09:37.196029+0000","last_unstale":"2023-10-08T06:09:38.166298+0000","last_undegraded":"2023-10-08T06:09:38.166298+0000","last_fullsized":"2023-10-08T06:09:38.166298+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:58:21.359302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.259158+0000","last_change":"2023-10-08T06:09:37.192494+0000","last_active":"2023-10-08T06:09:38.259158+0000","last_peered":"2023-10-08T06:09:38.259158+0000","last_clean":"2023-10-08T06:09:38.259158+0000","last_became_active":"2023-10-08T06:09:37.192219+0000","last_became_peered":"2023-10-08T06:09:37.192219+0000","last_unstale":"2023-10-08T06:09:38.259158+0000","last_undegraded":"2023-10-08T06:09:38.259158+0000","last_fullsized":"2023-10-08T06:09:38.259158+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:21:38.351456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.258945+0000","last_change":"2023-10-08T06:09:37.191422+0000","last_active":"2023-10-08T06:09:38.258945+0000","last_peered":"2023-10-08T06:09:38.258945+0000","last_clean":"2023-10-08T06:09:38.258945+0000","last_became_active":"2023-10-08T06:09:37.191135+0000","last_became_peered":"2023-10-08T06:09:37.191135+0000","last_unstale":"2023-10-08T06:09:38.258945+0000","last_undegraded":"2023-10-08T06:09:38.258945+0000","last_fullsized":"2023-10-08T06:09:38.258945+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:49:17.057808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.439036+0000","last_change":"2023-10-08T06:09:37.180493+0000","last_active":"2023-10-08T06:09:38.439036+0000","last_peered":"2023-10-08T06:09:38.439036+0000","last_clean":"2023-10-08T06:09:38.439036+0000","last_became_active":"2023-10-08T06:09:37.180194+0000","last_became_peered":"2023-10-08T06:09:37.180194+0000","last_unstale":"2023-10-08T06:09:38.439036+0000","last_undegraded":"2023-10-08T06:09:38.439036+0000","last_fullsized":"2023-10-08T06:09:38.439036+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:18:39.137117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.439400+0000","last_change":"2023-10-08T06:09:37.182805+0000","last_active":"2023-10-08T06:09:38.439400+0000","last_peered":"2023-10-08T06:09:38.439400+0000","last_clean":"2023-10-08T06:09:38.439400+0000","last_became_active":"2023-10-08T06:09:37.182511+0000","last_became_peered":"2023-10-08T06:09:37.182511+0000","last_unstale":"2023-10-08T06:09:38.439400+0000","last_undegraded":"2023-10-08T06:09:38.439400+0000","last_fullsized":"2023-10-08T06:09:38.439400+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:56:23.722542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.438683+0000","last_change":"2023-10-08T06:09:37.184291+0000","last_active":"2023-10-08T06:09:38.438683+0000","last_peered":"2023-10-08T06:09:38.438683+0000","last_clean":"2023-10-08T06:09:38.438683+0000","last_became_active":"2023-10-08T06:09:37.183944+0000","last_became_peered":"2023-10-08T06:09:37.183944+0000","last_unstale":"2023-10-08T06:09:38.438683+0000","last_undegraded":"2023-10-08T06:09:38.438683+0000","last_fullsized":"2023-10-08T06:09:38.438683+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:23:12.740262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.161692+0000","last_change":"2023-10-08T06:09:37.173135+0000","last_active":"2023-10-08T06:09:38.161692+0000","last_peered":"2023-10-08T06:09:38.161692+0000","last_clean":"2023-10-08T06:09:38.161692+0000","last_became_active":"2023-10-08T06:09:37.172786+0000","last_became_peered":"2023-10-08T06:09:37.172786+0000","last_unstale":"2023-10-08T06:09:38.161692+0000","last_undegraded":"2023-10-08T06:09:38.161692+0000","last_fullsized":"2023-10-08T06:09:38.161692+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:34:24.217470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.163600+0000","last_change":"2023-10-08T06:09:37.190091+0000","last_active":"2023-10-08T06:09:38.163600+0000","last_peered":"2023-10-08T06:09:38.163600+0000","last_clean":"2023-10-08T06:09:38.163600+0000","last_became_active":"2023-10-08T06:09:37.188278+0000","last_became_peered":"2023-10-08T06:09:37.188278+0000","last_unstale":"2023-10-08T06:09:38.163600+0000","last_undegraded":"2023-10-08T06:09:38.163600+0000","last_fullsized":"2023-10-08T06:09:38.163600+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:21:38.351456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.166514+0000","last_change":"2023-10-08T06:09:37.188196+0000","last_active":"2023-10-08T06:09:38.166514+0000","last_peered":"2023-10-08T06:09:38.166514+0000","last_clean":"2023-10-08T06:09:38.166514+0000","last_became_active":"2023-10-08T06:09:37.187906+0000","last_became_peered":"2023-10-08T06:09:37.187906+0000","last_unstale":"2023-10-08T06:09:38.166514+0000","last_undegraded":"2023-10-08T06:09:38.166514+0000","last_fullsized":"2023-10-08T06:09:38.166514+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:24:28.854916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.441427+0000","last_change":"2023-10-08T06:09:37.185222+0000","last_active":"2023-10-08T06:09:38.441427+0000","last_peered":"2023-10-08T06:09:38.441427+0000","last_clean":"2023-10-08T06:09:38.441427+0000","last_became_active":"2023-10-08T06:09:37.184040+0000","last_became_peered":"2023-10-08T06:09:37.184040+0000","last_unstale":"2023-10-08T06:09:38.441427+0000","last_undegraded":"2023-10-08T06:09:38.441427+0000","last_fullsized":"2023-10-08T06:09:38.441427+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:18:39.137117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.165574+0000","last_change":"2023-10-08T06:09:37.189503+0000","last_active":"2023-10-08T06:09:38.165574+0000","last_peered":"2023-10-08T06:09:38.165574+0000","last_clean":"2023-10-08T06:09:38.165574+0000","last_became_active":"2023-10-08T06:09:37.189210+0000","last_became_peered":"2023-10-08T06:09:37.189210+0000","last_unstale":"2023-10-08T06:09:38.165574+0000","last_undegraded":"2023-10-08T06:09:38.165574+0000","last_fullsized":"2023-10-08T06:09:38.165574+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:04:33.773359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.259261+0000","last_change":"2023-10-08T06:09:37.190736+0000","last_active":"2023-10-08T06:09:38.259261+0000","last_peered":"2023-10-08T06:09:38.259261+0000","last_clean":"2023-10-08T06:09:38.259261+0000","last_became_active":"2023-10-08T06:09:37.190034+0000","last_became_peered":"2023-10-08T06:09:37.190034+0000","last_unstale":"2023-10-08T06:09:38.259261+0000","last_undegraded":"2023-10-08T06:09:38.259261+0000","last_fullsized":"2023-10-08T06:09:38.259261+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:34:25.213819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.439417+0000","last_change":"2023-10-08T06:09:37.189807+0000","last_active":"2023-10-08T06:09:38.439417+0000","last_peered":"2023-10-08T06:09:38.439417+0000","last_clean":"2023-10-08T06:09:38.439417+0000","last_became_active":"2023-10-08T06:09:37.189522+0000","last_became_peered":"2023-10-08T06:09:37.189522+0000","last_unstale":"2023-10-08T06:09:38.439417+0000","last_undegraded":"2023-10-08T06:09:38.439417+0000","last_fullsized":"2023-10-08T06:09:38.439417+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:56:29.982869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.164808+0000","last_change":"2023-10-08T06:09:37.187974+0000","last_active":"2023-10-08T06:09:38.164808+0000","last_peered":"2023-10-08T06:09:38.164808+0000","last_clean":"2023-10-08T06:09:38.164808+0000","last_became_active":"2023-10-08T06:09:37.187664+0000","last_became_peered":"2023-10-08T06:09:37.187664+0000","last_unstale":"2023-10-08T06:09:38.164808+0000","last_undegraded":"2023-10-08T06:09:38.164808+0000","last_fullsized":"2023-10-08T06:09:38.164808+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:18:15.487038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.440362+0000","last_change":"2023-10-08T06:09:37.190236+0000","last_active":"2023-10-08T06:09:38.440362+0000","last_peered":"2023-10-08T06:09:38.440362+0000","last_clean":"2023-10-08T06:09:38.440362+0000","last_became_active":"2023-10-08T06:09:37.187376+0000","last_became_peered":"2023-10-08T06:09:37.187376+0000","last_unstale":"2023-10-08T06:09:38.440362+0000","last_undegraded":"2023-10-08T06:09:38.440362+0000","last_fullsized":"2023-10-08T06:09:38.440362+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:18:34.855901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.164217+0000","last_change":"2023-10-08T06:09:37.187245+0000","last_active":"2023-10-08T06:09:38.164217+0000","last_peered":"2023-10-08T06:09:38.164217+0000","last_clean":"2023-10-08T06:09:38.164217+0000","last_became_active":"2023-10-08T06:09:37.182394+0000","last_became_peered":"2023-10-08T06:09:37.182394+0000","last_unstale":"2023-10-08T06:09:38.164217+0000","last_undegraded":"2023-10-08T06:09:38.164217+0000","last_fullsized":"2023-10-08T06:09:38.164217+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:34:25.213819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.441511+0000","last_change":"2023-10-08T06:09:37.190400+0000","last_active":"2023-10-08T06:09:38.441511+0000","last_peered":"2023-10-08T06:09:38.441511+0000","last_clean":"2023-10-08T06:09:38.441511+0000","last_became_active":"2023-10-08T06:09:37.187332+0000","last_became_peered":"2023-10-08T06:09:37.187332+0000","last_unstale":"2023-10-08T06:09:38.441511+0000","last_undegraded":"2023-10-08T06:09:38.441511+0000","last_fullsized":"2023-10-08T06:09:38.441511+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:06:26.313725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.259322+0000","last_change":"2023-10-08T06:09:37.189247+0000","last_active":"2023-10-08T06:09:38.259322+0000","last_peered":"2023-10-08T06:09:38.259322+0000","last_clean":"2023-10-08T06:09:38.259322+0000","last_became_active":"2023-10-08T06:09:37.188933+0000","last_became_peered":"2023-10-08T06:09:37.188933+0000","last_unstale":"2023-10-08T06:09:38.259322+0000","last_undegraded":"2023-10-08T06:09:38.259322+0000","last_fullsized":"2023-10-08T06:09:38.259322+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:37:42.540248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.162400+0000","last_change":"2023-10-08T06:09:37.182750+0000","last_active":"2023-10-08T06:09:38.162400+0000","last_peered":"2023-10-08T06:09:38.162400+0000","last_clean":"2023-10-08T06:09:38.162400+0000","last_became_active":"2023-10-08T06:09:37.182459+0000","last_became_peered":"2023-10-08T06:09:37.182459+0000","last_unstale":"2023-10-08T06:09:38.162400+0000","last_undegraded":"2023-10-08T06:09:38.162400+0000","last_fullsized":"2023-10-08T06:09:38.162400+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:34:25.213819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.441274+0000","last_change":"2023-10-08T06:09:37.190585+0000","last_active":"2023-10-08T06:09:38.441274+0000","last_peered":"2023-10-08T06:09:38.441274+0000","last_clean":"2023-10-08T06:09:38.441274+0000","last_became_active":"2023-10-08T06:09:37.190040+0000","last_became_peered":"2023-10-08T06:09:37.190040+0000","last_unstale":"2023-10-08T06:09:38.441274+0000","last_undegraded":"2023-10-08T06:09:38.441274+0000","last_fullsized":"2023-10-08T06:09:38.441274+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:33:02.594601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.439692+0000","last_change":"2023-10-08T06:09:37.195008+0000","last_active":"2023-10-08T06:09:38.439692+0000","last_peered":"2023-10-08T06:09:38.439692+0000","last_clean":"2023-10-08T06:09:38.439692+0000","last_became_active":"2023-10-08T06:09:37.191672+0000","last_became_peered":"2023-10-08T06:09:37.191672+0000","last_unstale":"2023-10-08T06:09:38.439692+0000","last_undegraded":"2023-10-08T06:09:38.439692+0000","last_fullsized":"2023-10-08T06:09:38.439692+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:34:24.217470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.165134+0000","last_change":"2023-10-08T06:09:37.182779+0000","last_active":"2023-10-08T06:09:38.165134+0000","last_peered":"2023-10-08T06:09:38.165134+0000","last_clean":"2023-10-08T06:09:38.165134+0000","last_became_active":"2023-10-08T06:09:37.182402+0000","last_became_peered":"2023-10-08T06:09:37.182402+0000","last_unstale":"2023-10-08T06:09:38.165134+0000","last_undegraded":"2023-10-08T06:09:38.165134+0000","last_fullsized":"2023-10-08T06:09:38.165134+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:49:58.972598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.441666+0000","last_change":"2023-10-08T06:09:37.186117+0000","last_active":"2023-10-08T06:09:38.441666+0000","last_peered":"2023-10-08T06:09:38.441666+0000","last_clean":"2023-10-08T06:09:38.441666+0000","last_became_active":"2023-10-08T06:09:37.185159+0000","last_became_peered":"2023-10-08T06:09:37.185159+0000","last_unstale":"2023-10-08T06:09:38.441666+0000","last_undegraded":"2023-10-08T06:09:38.441666+0000","last_fullsized":"2023-10-08T06:09:38.441666+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:05:09.836876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.258513+0000","last_change":"2023-10-08T06:09:37.187121+0000","last_active":"2023-10-08T06:09:38.258513+0000","last_peered":"2023-10-08T06:09:38.258513+0000","last_clean":"2023-10-08T06:09:38.258513+0000","last_became_active":"2023-10-08T06:09:37.186834+0000","last_became_peered":"2023-10-08T06:09:37.186834+0000","last_unstale":"2023-10-08T06:09:38.258513+0000","last_undegraded":"2023-10-08T06:09:38.258513+0000","last_fullsized":"2023-10-08T06:09:38.258513+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:22:50.644480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.438323+0000","last_change":"2023-10-08T06:09:37.166163+0000","last_active":"2023-10-08T06:09:38.438323+0000","last_peered":"2023-10-08T06:09:38.438323+0000","last_clean":"2023-10-08T06:09:38.438323+0000","last_became_active":"2023-10-08T06:09:37.165819+0000","last_became_peered":"2023-10-08T06:09:37.165819+0000","last_unstale":"2023-10-08T06:09:38.438323+0000","last_undegraded":"2023-10-08T06:09:38.438323+0000","last_fullsized":"2023-10-08T06:09:38.438323+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:17:12.495543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-08T06:09:37.320927+0000","last_change":"2023-10-08T06:09:36.171417+0000","last_active":"2023-10-08T06:09:37.320927+0000","last_peered":"2023-10-08T06:09:37.320927+0000","last_clean":"2023-10-08T06:09:37.320927+0000","last_became_active":"2023-10-08T06:09:36.171084+0000","last_became_peered":"2023-10-08T06:09:36.171084+0000","last_unstale":"2023-10-08T06:09:37.320927+0000","last_undegraded":"2023-10-08T06:09:37.320927+0000","last_fullsized":"2023-10-08T06:09:37.320927+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_clean_scrub_stamp":"2023-10-08T06:09:35.125722+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:27:31.423500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.439901+0000","last_change":"2023-10-08T06:09:37.195690+0000","last_active":"2023-10-08T06:09:38.439901+0000","last_peered":"2023-10-08T06:09:38.439901+0000","last_clean":"2023-10-08T06:09:38.439901+0000","last_became_active":"2023-10-08T06:09:37.195446+0000","last_became_peered":"2023-10-08T06:09:37.195446+0000","last_unstale":"2023-10-08T06:09:38.439901+0000","last_undegraded":"2023-10-08T06:09:38.439901+0000","last_fullsized":"2023-10-08T06:09:38.439901+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:21:38.351456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.258516+0000","last_change":"2023-10-08T06:09:36.177551+0000","last_active":"2023-10-08T06:09:38.258516+0000","last_peered":"2023-10-08T06:09:38.258516+0000","last_clean":"2023-10-08T06:09:38.258516+0000","last_became_active":"2023-10-08T06:09:36.176999+0000","last_became_peered":"2023-10-08T06:09:36.176999+0000","last_unstale":"2023-10-08T06:09:38.258516+0000","last_undegraded":"2023-10-08T06:09:38.258516+0000","last_fullsized":"2023-10-08T06:09:38.258516+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_clean_scrub_stamp":"2023-10-08T06:09:35.125722+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:05:49.733090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-08T06:09:37.320858+0000","last_change":"2023-10-08T06:09:36.185251+0000","last_active":"2023-10-08T06:09:37.320858+0000","last_peered":"2023-10-08T06:09:37.320858+0000","last_clean":"2023-10-08T06:09:37.320858+0000","last_became_active":"2023-10-08T06:09:36.185009+0000","last_became_peered":"2023-10-08T06:09:36.185009+0000","last_unstale":"2023-10-08T06:09:37.320858+0000","last_undegraded":"2023-10-08T06:09:37.320858+0000","last_fullsized":"2023-10-08T06:09:37.320858+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_clean_scrub_stamp":"2023-10-08T06:09:35.125722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:23:55.526790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.439213+0000","last_change":"2023-10-08T06:09:37.185750+0000","last_active":"2023-10-08T06:09:38.439213+0000","last_peered":"2023-10-08T06:09:38.439213+0000","last_clean":"2023-10-08T06:09:38.439213+0000","last_became_active":"2023-10-08T06:09:37.185376+0000","last_became_peered":"2023-10-08T06:09:37.185376+0000","last_unstale":"2023-10-08T06:09:38.439213+0000","last_undegraded":"2023-10-08T06:09:38.439213+0000","last_fullsized":"2023-10-08T06:09:38.439213+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:50:54.351073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.164429+0000","last_change":"2023-10-08T06:09:36.176796+0000","last_active":"2023-10-08T06:09:38.164429+0000","last_peered":"2023-10-08T06:09:38.164429+0000","last_clean":"2023-10-08T06:09:38.164429+0000","last_became_active":"2023-10-08T06:09:36.176522+0000","last_became_peered":"2023-10-08T06:09:36.176522+0000","last_unstale":"2023-10-08T06:09:38.164429+0000","last_undegraded":"2023-10-08T06:09:38.164429+0000","last_fullsized":"2023-10-08T06:09:38.164429+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_clean_scrub_stamp":"2023-10-08T06:09:35.125722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:05:08.823966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.161590+0000","last_change":"2023-10-08T06:09:37.179556+0000","last_active":"2023-10-08T06:09:38.161590+0000","last_peered":"2023-10-08T06:09:38.161590+0000","last_clean":"2023-10-08T06:09:38.161590+0000","last_became_active":"2023-10-08T06:09:37.179272+0000","last_became_peered":"2023-10-08T06:09:37.179272+0000","last_unstale":"2023-10-08T06:09:38.161590+0000","last_undegraded":"2023-10-08T06:09:38.161590+0000","last_fullsized":"2023-10-08T06:09:38.161590+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:56:29.982869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.258906+0000","last_change":"2023-10-08T06:09:36.177352+0000","last_active":"2023-10-08T06:09:38.258906+0000","last_peered":"2023-10-08T06:09:38.258906+0000","last_clean":"2023-10-08T06:09:38.258906+0000","last_became_active":"2023-10-08T06:09:36.176974+0000","last_became_peered":"2023-10-08T06:09:36.176974+0000","last_unstale":"2023-10-08T06:09:38.258906+0000","last_undegraded":"2023-10-08T06:09:38.258906+0000","last_fullsized":"2023-10-08T06:09:38.258906+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_clean_scrub_stamp":"2023-10-08T06:09:35.125722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:23:11.727351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.166180+0000","last_change":"2023-10-08T06:09:37.186798+0000","last_active":"2023-10-08T06:09:38.166180+0000","last_peered":"2023-10-08T06:09:38.166180+0000","last_clean":"2023-10-08T06:09:38.166180+0000","last_became_active":"2023-10-08T06:09:37.186528+0000","last_became_peered":"2023-10-08T06:09:37.186528+0000","last_unstale":"2023-10-08T06:09:38.166180+0000","last_undegraded":"2023-10-08T06:09:38.166180+0000","last_fullsized":"2023-10-08T06:09:38.166180+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:04:33.773359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.166293+0000","last_change":"2023-10-08T06:09:36.177563+0000","last_active":"2023-10-08T06:09:38.166293+0000","last_peered":"2023-10-08T06:09:38.166293+0000","last_clean":"2023-10-08T06:09:38.166293+0000","last_became_active":"2023-10-08T06:09:36.177299+0000","last_became_peered":"2023-10-08T06:09:36.177299+0000","last_unstale":"2023-10-08T06:09:38.166293+0000","last_undegraded":"2023-10-08T06:09:38.166293+0000","last_fullsized":"2023-10-08T06:09:38.166293+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_clean_scrub_stamp":"2023-10-08T06:09:35.125722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:23:11.727351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.439612+0000","last_change":"2023-10-08T06:09:37.194668+0000","last_active":"2023-10-08T06:09:38.439612+0000","last_peered":"2023-10-08T06:09:38.439612+0000","last_clean":"2023-10-08T06:09:38.439612+0000","last_became_active":"2023-10-08T06:09:37.194275+0000","last_became_peered":"2023-10-08T06:09:37.194275+0000","last_unstale":"2023-10-08T06:09:38.439612+0000","last_undegraded":"2023-10-08T06:09:38.439612+0000","last_fullsized":"2023-10-08T06:09:38.439612+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:22:50.644480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.162597+0000","last_change":"2023-10-08T06:09:36.168806+0000","last_active":"2023-10-08T06:09:38.162597+0000","last_peered":"2023-10-08T06:09:38.162597+0000","last_clean":"2023-10-08T06:09:38.162597+0000","last_became_active":"2023-10-08T06:09:36.168379+0000","last_became_peered":"2023-10-08T06:09:36.168379+0000","last_unstale":"2023-10-08T06:09:38.162597+0000","last_undegraded":"2023-10-08T06:09:38.162597+0000","last_fullsized":"2023-10-08T06:09:38.162597+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_clean_scrub_stamp":"2023-10-08T06:09:35.125722+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:15:43.326854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.439035+0000","last_change":"2023-10-08T06:09:37.183629+0000","last_active":"2023-10-08T06:09:38.439035+0000","last_peered":"2023-10-08T06:09:38.439035+0000","last_clean":"2023-10-08T06:09:38.439035+0000","last_became_active":"2023-10-08T06:09:37.183318+0000","last_became_peered":"2023-10-08T06:09:37.183318+0000","last_unstale":"2023-10-08T06:09:38.439035+0000","last_undegraded":"2023-10-08T06:09:38.439035+0000","last_fullsized":"2023-10-08T06:09:38.439035+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:05:09.836876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"21'6","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.258922+0000","last_change":"2023-10-08T06:09:36.177043+0000","last_active":"2023-10-08T06:09:38.258922+0000","last_peered":"2023-10-08T06:09:38.258922+0000","last_clean":"2023-10-08T06:09:38.258922+0000","last_became_active":"2023-10-08T06:09:36.176455+0000","last_became_peered":"2023-10-08T06:09:36.176455+0000","last_unstale":"2023-10-08T06:09:38.258922+0000","last_undegraded":"2023-10-08T06:09:38.258922+0000","last_fullsized":"2023-10-08T06:09:38.258922+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_clean_scrub_stamp":"2023-10-08T06:09:35.125722+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:03:55.740286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.165422+0000","last_change":"2023-10-08T06:09:37.187989+0000","last_active":"2023-10-08T06:09:38.165422+0000","last_peered":"2023-10-08T06:09:38.165422+0000","last_clean":"2023-10-08T06:09:38.165422+0000","last_became_active":"2023-10-08T06:09:37.187694+0000","last_became_peered":"2023-10-08T06:09:37.187694+0000","last_unstale":"2023-10-08T06:09:38.165422+0000","last_undegraded":"2023-10-08T06:09:38.165422+0000","last_fullsized":"2023-10-08T06:09:38.165422+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:06:58.385054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.325426+0000","last_change":"2023-10-08T06:09:36.180486+0000","last_active":"2023-10-08T06:09:38.325426+0000","last_peered":"2023-10-08T06:09:38.325426+0000","last_clean":"2023-10-08T06:09:38.325426+0000","last_became_active":"2023-10-08T06:09:36.180170+0000","last_became_peered":"2023-10-08T06:09:36.180170+0000","last_unstale":"2023-10-08T06:09:38.325426+0000","last_undegraded":"2023-10-08T06:09:38.325426+0000","last_fullsized":"2023-10-08T06:09:38.325426+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_clean_scrub_stamp":"2023-10-08T06:09:35.125722+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:05:49.733090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.438863+0000","last_change":"2023-10-08T06:09:37.195019+0000","last_active":"2023-10-08T06:09:38.438863+0000","last_peered":"2023-10-08T06:09:38.438863+0000","last_clean":"2023-10-08T06:09:38.438863+0000","last_became_active":"2023-10-08T06:09:37.192104+0000","last_became_peered":"2023-10-08T06:09:37.192104+0000","last_unstale":"2023-10-08T06:09:38.438863+0000","last_undegraded":"2023-10-08T06:09:38.438863+0000","last_fullsized":"2023-10-08T06:09:38.438863+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:03:56.753197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.165326+0000","last_change":"2023-10-08T06:09:36.174464+0000","last_active":"2023-10-08T06:09:38.165326+0000","last_peered":"2023-10-08T06:09:38.165326+0000","last_clean":"2023-10-08T06:09:38.165326+0000","last_became_active":"2023-10-08T06:09:36.174144+0000","last_became_peered":"2023-10-08T06:09:36.174144+0000","last_unstale":"2023-10-08T06:09:38.165326+0000","last_undegraded":"2023-10-08T06:09:38.165326+0000","last_fullsized":"2023-10-08T06:09:38.165326+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_clean_scrub_stamp":"2023-10-08T06:09:35.125722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:34:23.204560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.165097+0000","last_change":"2023-10-08T06:09:37.193371+0000","last_active":"2023-10-08T06:09:38.165097+0000","last_peered":"2023-10-08T06:09:38.165097+0000","last_clean":"2023-10-08T06:09:38.165097+0000","last_became_active":"2023-10-08T06:09:37.192842+0000","last_became_peered":"2023-10-08T06:09:37.192842+0000","last_unstale":"2023-10-08T06:09:38.165097+0000","last_undegraded":"2023-10-08T06:09:38.165097+0000","last_fullsized":"2023-10-08T06:09:38.165097+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:16:03.874960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.258443+0000","last_change":"2023-10-08T06:09:36.178850+0000","last_active":"2023-10-08T06:09:38.258443+0000","last_peered":"2023-10-08T06:09:38.258443+0000","last_clean":"2023-10-08T06:09:38.258443+0000","last_became_active":"2023-10-08T06:09:36.178580+0000","last_became_peered":"2023-10-08T06:09:36.178580+0000","last_unstale":"2023-10-08T06:09:38.258443+0000","last_undegraded":"2023-10-08T06:09:38.258443+0000","last_fullsized":"2023-10-08T06:09:38.258443+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_clean_scrub_stamp":"2023-10-08T06:09:35.125722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:52:59.381910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.258458+0000","last_change":"2023-10-08T06:09:37.187049+0000","last_active":"2023-10-08T06:09:38.258458+0000","last_peered":"2023-10-08T06:09:38.258458+0000","last_clean":"2023-10-08T06:09:38.258458+0000","last_became_active":"2023-10-08T06:09:37.186754+0000","last_became_peered":"2023-10-08T06:09:37.186754+0000","last_unstale":"2023-10-08T06:09:38.258458+0000","last_undegraded":"2023-10-08T06:09:38.258458+0000","last_fullsized":"2023-10-08T06:09:38.258458+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:56:29.982869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.317672+0000","last_change":"2023-10-08T06:09:36.169901+0000","last_active":"2023-10-08T06:09:38.317672+0000","last_peered":"2023-10-08T06:09:38.317672+0000","last_clean":"2023-10-08T06:09:38.317672+0000","last_became_active":"2023-10-08T06:09:36.169437+0000","last_became_peered":"2023-10-08T06:09:36.169437+0000","last_unstale":"2023-10-08T06:09:38.317672+0000","last_undegraded":"2023-10-08T06:09:38.317672+0000","last_fullsized":"2023-10-08T06:09:38.317672+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_clean_scrub_stamp":"2023-10-08T06:09:35.125722+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:18:04.415654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.163886+0000","last_change":"2023-10-08T06:09:37.192889+0000","last_active":"2023-10-08T06:09:38.163886+0000","last_peered":"2023-10-08T06:09:38.163886+0000","last_clean":"2023-10-08T06:09:38.163886+0000","last_became_active":"2023-10-08T06:09:37.192566+0000","last_became_peered":"2023-10-08T06:09:37.192566+0000","last_unstale":"2023-10-08T06:09:38.163886+0000","last_undegraded":"2023-10-08T06:09:38.163886+0000","last_fullsized":"2023-10-08T06:09:38.163886+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:18:15.487038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.323580+0000","last_change":"2023-10-08T06:09:36.174556+0000","last_active":"2023-10-08T06:09:38.323580+0000","last_peered":"2023-10-08T06:09:38.323580+0000","last_clean":"2023-10-08T06:09:38.323580+0000","last_became_active":"2023-10-08T06:09:36.174232+0000","last_became_peered":"2023-10-08T06:09:36.174232+0000","last_unstale":"2023-10-08T06:09:38.323580+0000","last_undegraded":"2023-10-08T06:09:38.323580+0000","last_fullsized":"2023-10-08T06:09:38.323580+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_clean_scrub_stamp":"2023-10-08T06:09:35.125722+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:38:58.906188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.165929+0000","last_change":"2023-10-08T06:09:37.192804+0000","last_active":"2023-10-08T06:09:38.165929+0000","last_peered":"2023-10-08T06:09:38.165929+0000","last_clean":"2023-10-08T06:09:38.165929+0000","last_became_active":"2023-10-08T06:09:37.192500+0000","last_became_peered":"2023-10-08T06:09:37.192500+0000","last_unstale":"2023-10-08T06:09:38.165929+0000","last_undegraded":"2023-10-08T06:09:38.165929+0000","last_fullsized":"2023-10-08T06:09:38.165929+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:04:32.307233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.317884+0000","last_change":"2023-10-08T06:09:36.177373+0000","last_active":"2023-10-08T06:09:38.317884+0000","last_peered":"2023-10-08T06:09:38.317884+0000","last_clean":"2023-10-08T06:09:38.317884+0000","last_became_active":"2023-10-08T06:09:36.176919+0000","last_became_peered":"2023-10-08T06:09:36.176919+0000","last_unstale":"2023-10-08T06:09:38.317884+0000","last_undegraded":"2023-10-08T06:09:38.317884+0000","last_fullsized":"2023-10-08T06:09:38.317884+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_clean_scrub_stamp":"2023-10-08T06:09:35.125722+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:19:59.810056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.166276+0000","last_change":"2023-10-08T06:09:37.194526+0000","last_active":"2023-10-08T06:09:38.166276+0000","last_peered":"2023-10-08T06:09:38.166276+0000","last_clean":"2023-10-08T06:09:38.166276+0000","last_became_active":"2023-10-08T06:09:37.193884+0000","last_became_peered":"2023-10-08T06:09:37.193884+0000","last_unstale":"2023-10-08T06:09:38.166276+0000","last_undegraded":"2023-10-08T06:09:38.166276+0000","last_fullsized":"2023-10-08T06:09:38.166276+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:06:09.459089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.162713+0000","last_change":"2023-10-08T06:09:36.175751+0000","last_active":"2023-10-08T06:09:38.162713+0000","last_peered":"2023-10-08T06:09:38.162713+0000","last_clean":"2023-10-08T06:09:38.162713+0000","last_became_active":"2023-10-08T06:09:36.175401+0000","last_became_peered":"2023-10-08T06:09:36.175401+0000","last_unstale":"2023-10-08T06:09:38.162713+0000","last_undegraded":"2023-10-08T06:09:38.162713+0000","last_fullsized":"2023-10-08T06:09:38.162713+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_clean_scrub_stamp":"2023-10-08T06:09:35.125722+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:05:49.733090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.166140+0000","last_change":"2023-10-08T06:09:37.186035+0000","last_active":"2023-10-08T06:09:38.166140+0000","last_peered":"2023-10-08T06:09:38.166140+0000","last_clean":"2023-10-08T06:09:38.166140+0000","last_became_active":"2023-10-08T06:09:37.182569+0000","last_became_peered":"2023-10-08T06:09:37.182569+0000","last_unstale":"2023-10-08T06:09:38.166140+0000","last_undegraded":"2023-10-08T06:09:38.166140+0000","last_fullsized":"2023-10-08T06:09:38.166140+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:36:49.578063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.317778+0000","last_change":"2023-10-08T06:09:36.168728+0000","last_active":"2023-10-08T06:09:38.317778+0000","last_peered":"2023-10-08T06:09:38.317778+0000","last_clean":"2023-10-08T06:09:38.317778+0000","last_became_active":"2023-10-08T06:09:36.168339+0000","last_became_peered":"2023-10-08T06:09:36.168339+0000","last_unstale":"2023-10-08T06:09:38.317778+0000","last_undegraded":"2023-10-08T06:09:38.317778+0000","last_fullsized":"2023-10-08T06:09:38.317778+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_clean_scrub_stamp":"2023-10-08T06:09:35.125722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:17:11.482633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.165436+0000","last_change":"2023-10-08T06:09:37.194313+0000","last_active":"2023-10-08T06:09:38.165436+0000","last_peered":"2023-10-08T06:09:38.165436+0000","last_clean":"2023-10-08T06:09:38.165436+0000","last_became_active":"2023-10-08T06:09:37.193990+0000","last_became_peered":"2023-10-08T06:09:37.193990+0000","last_unstale":"2023-10-08T06:09:38.165436+0000","last_undegraded":"2023-10-08T06:09:38.165436+0000","last_fullsized":"2023-10-08T06:09:38.165436+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:36:49.578063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":165,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-08T06:09:37.175106+0000","last_change":"2023-10-08T06:09:24.811692+0000","last_active":"2023-10-08T06:09:37.175106+0000","last_peered":"2023-10-08T06:09:37.175106+0000","last_clean":"2023-10-08T06:09:37.175106+0000","last_became_active":"2023-10-08T06:09:24.809788+0000","last_became_peered":"2023-10-08T06:09:24.809788+0000","last_unstale":"2023-10-08T06:09:37.175106+0000","last_undegraded":"2023-10-08T06:09:37.175106+0000","last_fullsized":"2023-10-08T06:09:37.175106+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:23.748736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:23.748736+0000","last_clean_scrub_stamp":"2023-10-08T06:09:23.748736+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:39:45.599458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.164066+0000","last_change":"2023-10-08T06:09:36.168138+0000","last_active":"2023-10-08T06:09:38.164066+0000","last_peered":"2023-10-08T06:09:38.164066+0000","last_clean":"2023-10-08T06:09:38.164066+0000","last_became_active":"2023-10-08T06:09:36.167559+0000","last_became_peered":"2023-10-08T06:09:36.167559+0000","last_unstale":"2023-10-08T06:09:38.164066+0000","last_undegraded":"2023-10-08T06:09:38.164066+0000","last_fullsized":"2023-10-08T06:09:38.164066+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_clean_scrub_stamp":"2023-10-08T06:09:35.125722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:38:58.906188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.439834+0000","last_change":"2023-10-08T06:09:37.174591+0000","last_active":"2023-10-08T06:09:38.439834+0000","last_peered":"2023-10-08T06:09:38.439834+0000","last_clean":"2023-10-08T06:09:38.439834+0000","last_became_active":"2023-10-08T06:09:37.174291+0000","last_became_peered":"2023-10-08T06:09:37.174291+0000","last_unstale":"2023-10-08T06:09:38.439834+0000","last_undegraded":"2023-10-08T06:09:38.439834+0000","last_fullsized":"2023-10-08T06:09:38.439834+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:59:38.084934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.163652+0000","last_change":"2023-10-08T06:09:36.177856+0000","last_active":"2023-10-08T06:09:38.163652+0000","last_peered":"2023-10-08T06:09:38.163652+0000","last_clean":"2023-10-08T06:09:38.163652+0000","last_became_active":"2023-10-08T06:09:36.177525+0000","last_became_peered":"2023-10-08T06:09:36.177525+0000","last_unstale":"2023-10-08T06:09:38.163652+0000","last_undegraded":"2023-10-08T06:09:38.163652+0000","last_fullsized":"2023-10-08T06:09:38.163652+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_clean_scrub_stamp":"2023-10-08T06:09:35.125722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:18:38.124206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.438491+0000","last_change":"2023-10-08T06:09:37.188650+0000","last_active":"2023-10-08T06:09:38.438491+0000","last_peered":"2023-10-08T06:09:38.438491+0000","last_clean":"2023-10-08T06:09:38.438491+0000","last_became_active":"2023-10-08T06:09:37.187914+0000","last_became_peered":"2023-10-08T06:09:37.187914+0000","last_unstale":"2023-10-08T06:09:38.438491+0000","last_undegraded":"2023-10-08T06:09:38.438491+0000","last_fullsized":"2023-10-08T06:09:38.438491+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:09:43.900564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.317739+0000","last_change":"2023-10-08T06:09:36.174692+0000","last_active":"2023-10-08T06:09:38.317739+0000","last_peered":"2023-10-08T06:09:38.317739+0000","last_clean":"2023-10-08T06:09:38.317739+0000","last_became_active":"2023-10-08T06:09:36.174385+0000","last_became_peered":"2023-10-08T06:09:36.174385+0000","last_unstale":"2023-10-08T06:09:38.317739+0000","last_undegraded":"2023-10-08T06:09:38.317739+0000","last_fullsized":"2023-10-08T06:09:38.317739+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_clean_scrub_stamp":"2023-10-08T06:09:35.125722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:15:43.326854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.161620+0000","last_change":"2023-10-08T06:09:37.180115+0000","last_active":"2023-10-08T06:09:38.161620+0000","last_peered":"2023-10-08T06:09:38.161620+0000","last_clean":"2023-10-08T06:09:38.161620+0000","last_became_active":"2023-10-08T06:09:37.179866+0000","last_became_peered":"2023-10-08T06:09:37.179866+0000","last_unstale":"2023-10-08T06:09:38.161620+0000","last_undegraded":"2023-10-08T06:09:38.161620+0000","last_fullsized":"2023-10-08T06:09:38.161620+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:22:50.644480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.165478+0000","last_change":"2023-10-08T06:09:36.179535+0000","last_active":"2023-10-08T06:09:38.165478+0000","last_peered":"2023-10-08T06:09:38.165478+0000","last_clean":"2023-10-08T06:09:38.165478+0000","last_became_active":"2023-10-08T06:09:36.179229+0000","last_became_peered":"2023-10-08T06:09:36.179229+0000","last_unstale":"2023-10-08T06:09:38.165478+0000","last_undegraded":"2023-10-08T06:09:38.165478+0000","last_fullsized":"2023-10-08T06:09:38.165478+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_clean_scrub_stamp":"2023-10-08T06:09:35.125722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:49:16.044898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.438668+0000","last_change":"2023-10-08T06:09:37.187671+0000","last_active":"2023-10-08T06:09:38.438668+0000","last_peered":"2023-10-08T06:09:38.438668+0000","last_clean":"2023-10-08T06:09:38.438668+0000","last_became_active":"2023-10-08T06:09:37.187278+0000","last_became_peered":"2023-10-08T06:09:37.187278+0000","last_unstale":"2023-10-08T06:09:38.438668+0000","last_undegraded":"2023-10-08T06:09:38.438668+0000","last_fullsized":"2023-10-08T06:09:38.438668+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:15:44.339765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.162458+0000","last_change":"2023-10-08T06:09:36.170421+0000","last_active":"2023-10-08T06:09:38.162458+0000","last_peered":"2023-10-08T06:09:38.162458+0000","last_clean":"2023-10-08T06:09:38.162458+0000","last_became_active":"2023-10-08T06:09:36.169186+0000","last_became_peered":"2023-10-08T06:09:36.169186+0000","last_unstale":"2023-10-08T06:09:38.162458+0000","last_undegraded":"2023-10-08T06:09:38.162458+0000","last_fullsized":"2023-10-08T06:09:38.162458+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_clean_scrub_stamp":"2023-10-08T06:09:35.125722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:52:59.381910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.166119+0000","last_change":"2023-10-08T06:09:37.187824+0000","last_active":"2023-10-08T06:09:38.166119+0000","last_peered":"2023-10-08T06:09:38.166119+0000","last_clean":"2023-10-08T06:09:38.166119+0000","last_became_active":"2023-10-08T06:09:37.186117+0000","last_became_peered":"2023-10-08T06:09:37.186117+0000","last_unstale":"2023-10-08T06:09:38.166119+0000","last_undegraded":"2023-10-08T06:09:38.166119+0000","last_fullsized":"2023-10-08T06:09:38.166119+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:06:58.385054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.165731+0000","last_change":"2023-10-08T06:09:36.174520+0000","last_active":"2023-10-08T06:09:38.165731+0000","last_peered":"2023-10-08T06:09:38.165731+0000","last_clean":"2023-10-08T06:09:38.165731+0000","last_became_active":"2023-10-08T06:09:36.174174+0000","last_became_peered":"2023-10-08T06:09:36.174174+0000","last_unstale":"2023-10-08T06:09:38.165731+0000","last_undegraded":"2023-10-08T06:09:38.165731+0000","last_fullsized":"2023-10-08T06:09:38.165731+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_clean_scrub_stamp":"2023-10-08T06:09:35.125722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:21:37.338545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.162247+0000","last_change":"2023-10-08T06:09:37.185459+0000","last_active":"2023-10-08T06:09:38.162247+0000","last_peered":"2023-10-08T06:09:38.162247+0000","last_clean":"2023-10-08T06:09:38.162247+0000","last_became_active":"2023-10-08T06:09:37.185174+0000","last_became_peered":"2023-10-08T06:09:37.185174+0000","last_unstale":"2023-10-08T06:09:38.162247+0000","last_undegraded":"2023-10-08T06:09:38.162247+0000","last_fullsized":"2023-10-08T06:09:38.162247+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:21:38.351456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.319780+0000","last_change":"2023-10-08T06:09:36.180184+0000","last_active":"2023-10-08T06:09:38.319780+0000","last_peered":"2023-10-08T06:09:38.319780+0000","last_clean":"2023-10-08T06:09:38.319780+0000","last_became_active":"2023-10-08T06:09:36.179847+0000","last_became_peered":"2023-10-08T06:09:36.179847+0000","last_unstale":"2023-10-08T06:09:38.319780+0000","last_undegraded":"2023-10-08T06:09:38.319780+0000","last_fullsized":"2023-10-08T06:09:38.319780+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_clean_scrub_stamp":"2023-10-08T06:09:35.125722+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:41:18.133708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.441692+0000","last_change":"2023-10-08T06:09:37.186300+0000","last_active":"2023-10-08T06:09:38.441692+0000","last_peered":"2023-10-08T06:09:38.441692+0000","last_clean":"2023-10-08T06:09:38.441692+0000","last_became_active":"2023-10-08T06:09:37.185836+0000","last_became_peered":"2023-10-08T06:09:37.185836+0000","last_unstale":"2023-10-08T06:09:38.441692+0000","last_undegraded":"2023-10-08T06:09:38.441692+0000","last_fullsized":"2023-10-08T06:09:38.441692+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:40:15.474700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.259033+0000","last_change":"2023-10-08T06:09:36.177038+0000","last_active":"2023-10-08T06:09:38.259033+0000","last_peered":"2023-10-08T06:09:38.259033+0000","last_clean":"2023-10-08T06:09:38.259033+0000","last_became_active":"2023-10-08T06:09:36.176498+0000","last_became_peered":"2023-10-08T06:09:36.176498+0000","last_unstale":"2023-10-08T06:09:38.259033+0000","last_undegraded":"2023-10-08T06:09:38.259033+0000","last_fullsized":"2023-10-08T06:09:38.259033+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_clean_scrub_stamp":"2023-10-08T06:09:35.125722+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:09:42.887654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.440284+0000","last_change":"2023-10-08T06:09:37.183347+0000","last_active":"2023-10-08T06:09:38.440284+0000","last_peered":"2023-10-08T06:09:38.440284+0000","last_clean":"2023-10-08T06:09:38.440284+0000","last_became_active":"2023-10-08T06:09:37.183069+0000","last_became_peered":"2023-10-08T06:09:37.183069+0000","last_unstale":"2023-10-08T06:09:38.440284+0000","last_undegraded":"2023-10-08T06:09:38.440284+0000","last_fullsized":"2023-10-08T06:09:38.440284+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:34:25.213819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.163642+0000","last_change":"2023-10-08T06:09:36.173735+0000","last_active":"2023-10-08T06:09:38.163642+0000","last_peered":"2023-10-08T06:09:38.163642+0000","last_clean":"2023-10-08T06:09:38.163642+0000","last_became_active":"2023-10-08T06:09:36.173306+0000","last_became_peered":"2023-10-08T06:09:36.173306+0000","last_unstale":"2023-10-08T06:09:38.163642+0000","last_undegraded":"2023-10-08T06:09:38.163642+0000","last_fullsized":"2023-10-08T06:09:38.163642+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_clean_scrub_stamp":"2023-10-08T06:09:35.125722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:19:59.810056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.438530+0000","last_change":"2023-10-08T06:09:37.183706+0000","last_active":"2023-10-08T06:09:38.438530+0000","last_peered":"2023-10-08T06:09:38.438530+0000","last_clean":"2023-10-08T06:09:38.438530+0000","last_became_active":"2023-10-08T06:09:37.183394+0000","last_became_peered":"2023-10-08T06:09:37.183394+0000","last_unstale":"2023-10-08T06:09:38.438530+0000","last_undegraded":"2023-10-08T06:09:38.438530+0000","last_fullsized":"2023-10-08T06:09:38.438530+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:20:00.822966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.161813+0000","last_change":"2023-10-08T06:09:36.171679+0000","last_active":"2023-10-08T06:09:38.161813+0000","last_peered":"2023-10-08T06:09:38.161813+0000","last_clean":"2023-10-08T06:09:38.161813+0000","last_became_active":"2023-10-08T06:09:36.171169+0000","last_became_peered":"2023-10-08T06:09:36.171169+0000","last_unstale":"2023-10-08T06:09:38.161813+0000","last_undegraded":"2023-10-08T06:09:38.161813+0000","last_fullsized":"2023-10-08T06:09:38.161813+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_clean_scrub_stamp":"2023-10-08T06:09:35.125722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:23:11.727351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.439354+0000","last_change":"2023-10-08T06:09:37.176151+0000","last_active":"2023-10-08T06:09:38.439354+0000","last_peered":"2023-10-08T06:09:38.439354+0000","last_clean":"2023-10-08T06:09:38.439354+0000","last_became_active":"2023-10-08T06:09:37.175845+0000","last_became_peered":"2023-10-08T06:09:37.175845+0000","last_unstale":"2023-10-08T06:09:38.439354+0000","last_undegraded":"2023-10-08T06:09:38.439354+0000","last_fullsized":"2023-10-08T06:09:38.439354+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:07:29.091521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.161868+0000","last_change":"2023-10-08T06:09:36.174531+0000","last_active":"2023-10-08T06:09:38.161868+0000","last_peered":"2023-10-08T06:09:38.161868+0000","last_clean":"2023-10-08T06:09:38.161868+0000","last_became_active":"2023-10-08T06:09:36.174216+0000","last_became_peered":"2023-10-08T06:09:36.174216+0000","last_unstale":"2023-10-08T06:09:38.161868+0000","last_undegraded":"2023-10-08T06:09:38.161868+0000","last_fullsized":"2023-10-08T06:09:38.161868+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_clean_scrub_stamp":"2023-10-08T06:09:35.125722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:17:11.482633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.439685+0000","last_change":"2023-10-08T06:09:37.191746+0000","last_active":"2023-10-08T06:09:38.439685+0000","last_peered":"2023-10-08T06:09:38.439685+0000","last_clean":"2023-10-08T06:09:38.439685+0000","last_became_active":"2023-10-08T06:09:37.191481+0000","last_became_peered":"2023-10-08T06:09:37.191481+0000","last_unstale":"2023-10-08T06:09:38.439685+0000","last_undegraded":"2023-10-08T06:09:38.439685+0000","last_fullsized":"2023-10-08T06:09:38.439685+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:28:49.792955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.165140+0000","last_change":"2023-10-08T06:09:36.179497+0000","last_active":"2023-10-08T06:09:38.165140+0000","last_peered":"2023-10-08T06:09:38.165140+0000","last_clean":"2023-10-08T06:09:38.165140+0000","last_became_active":"2023-10-08T06:09:36.179129+0000","last_became_peered":"2023-10-08T06:09:36.179129+0000","last_unstale":"2023-10-08T06:09:38.165140+0000","last_undegraded":"2023-10-08T06:09:38.165140+0000","last_fullsized":"2023-10-08T06:09:38.165140+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_clean_scrub_stamp":"2023-10-08T06:09:35.125722+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:34:23.204560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.258598+0000","last_change":"2023-10-08T06:09:37.185754+0000","last_active":"2023-10-08T06:09:38.258598+0000","last_peered":"2023-10-08T06:09:38.258598+0000","last_clean":"2023-10-08T06:09:38.258598+0000","last_became_active":"2023-10-08T06:09:37.185472+0000","last_became_peered":"2023-10-08T06:09:37.185472+0000","last_unstale":"2023-10-08T06:09:38.258598+0000","last_undegraded":"2023-10-08T06:09:38.258598+0000","last_fullsized":"2023-10-08T06:09:38.258598+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:34:24.217470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.166112+0000","last_change":"2023-10-08T06:09:37.181546+0000","last_active":"2023-10-08T06:09:38.166112+0000","last_peered":"2023-10-08T06:09:38.166112+0000","last_clean":"2023-10-08T06:09:38.166112+0000","last_became_active":"2023-10-08T06:09:37.181244+0000","last_became_peered":"2023-10-08T06:09:37.181244+0000","last_unstale":"2023-10-08T06:09:38.166112+0000","last_undegraded":"2023-10-08T06:09:38.166112+0000","last_fullsized":"2023-10-08T06:09:38.166112+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:16:03.874960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.165289+0000","last_change":"2023-10-08T06:09:36.173329+0000","last_active":"2023-10-08T06:09:38.165289+0000","last_peered":"2023-10-08T06:09:38.165289+0000","last_clean":"2023-10-08T06:09:38.165289+0000","last_became_active":"2023-10-08T06:09:36.172872+0000","last_became_peered":"2023-10-08T06:09:36.172872+0000","last_unstale":"2023-10-08T06:09:38.165289+0000","last_undegraded":"2023-10-08T06:09:38.165289+0000","last_fullsized":"2023-10-08T06:09:38.165289+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_clean_scrub_stamp":"2023-10-08T06:09:35.125722+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:56:28.969959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.165938+0000","last_change":"2023-10-08T06:09:37.168180+0000","last_active":"2023-10-08T06:09:38.165938+0000","last_peered":"2023-10-08T06:09:38.165938+0000","last_clean":"2023-10-08T06:09:38.165938+0000","last_became_active":"2023-10-08T06:09:37.167874+0000","last_became_peered":"2023-10-08T06:09:37.167874+0000","last_unstale":"2023-10-08T06:09:38.165938+0000","last_undegraded":"2023-10-08T06:09:38.165938+0000","last_fullsized":"2023-10-08T06:09:38.165938+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:06:27.727341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.165564+0000","last_change":"2023-10-08T06:09:36.181123+0000","last_active":"2023-10-08T06:09:38.165564+0000","last_peered":"2023-10-08T06:09:38.165564+0000","last_clean":"2023-10-08T06:09:38.165564+0000","last_became_active":"2023-10-08T06:09:36.180774+0000","last_became_peered":"2023-10-08T06:09:36.180774+0000","last_unstale":"2023-10-08T06:09:38.165564+0000","last_undegraded":"2023-10-08T06:09:38.165564+0000","last_fullsized":"2023-10-08T06:09:38.165564+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_clean_scrub_stamp":"2023-10-08T06:09:35.125722+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:23:11.727351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.439287+0000","last_change":"2023-10-08T06:09:37.194698+0000","last_active":"2023-10-08T06:09:38.439287+0000","last_peered":"2023-10-08T06:09:38.439287+0000","last_clean":"2023-10-08T06:09:38.439287+0000","last_became_active":"2023-10-08T06:09:37.194354+0000","last_became_peered":"2023-10-08T06:09:37.194354+0000","last_unstale":"2023-10-08T06:09:38.439287+0000","last_undegraded":"2023-10-08T06:09:38.439287+0000","last_fullsized":"2023-10-08T06:09:38.439287+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:41:19.146619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-08T06:09:37.321003+0000","last_change":"2023-10-08T06:09:36.175818+0000","last_active":"2023-10-08T06:09:37.321003+0000","last_peered":"2023-10-08T06:09:37.321003+0000","last_clean":"2023-10-08T06:09:37.321003+0000","last_became_active":"2023-10-08T06:09:36.175493+0000","last_became_peered":"2023-10-08T06:09:36.175493+0000","last_unstale":"2023-10-08T06:09:37.321003+0000","last_undegraded":"2023-10-08T06:09:37.321003+0000","last_fullsized":"2023-10-08T06:09:37.321003+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_clean_scrub_stamp":"2023-10-08T06:09:35.125722+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:29:33.964626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.441328+0000","last_change":"2023-10-08T06:09:37.183447+0000","last_active":"2023-10-08T06:09:38.441328+0000","last_peered":"2023-10-08T06:09:38.441328+0000","last_clean":"2023-10-08T06:09:38.441328+0000","last_became_active":"2023-10-08T06:09:37.183169+0000","last_became_peered":"2023-10-08T06:09:37.183169+0000","last_unstale":"2023-10-08T06:09:38.441328+0000","last_undegraded":"2023-10-08T06:09:38.441328+0000","last_fullsized":"2023-10-08T06:09:38.441328+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:36.138632+0000","last_clean_scrub_stamp":"2023-10-08T06:09:36.138632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:14:21.323882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"21'4","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-08T06:09:38.325531+0000","last_change":"2023-10-08T06:09:36.173093+0000","last_active":"2023-10-08T06:09:38.325531+0000","last_peered":"2023-10-08T06:09:38.325531+0000","last_clean":"2023-10-08T06:09:38.325531+0000","last_became_active":"2023-10-08T06:09:36.172702+0000","last_became_peered":"2023-10-08T06:09:36.172702+0000","last_unstale":"2023-10-08T06:09:38.325531+0000","last_undegraded":"2023-10-08T06:09:38.325531+0000","last_fullsized":"2023-10-08T06:09:38.325531+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:35.125722+0000","last_clean_scrub_stamp":"2023-10-08T06:09:35.125722+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:52:59.381910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509447,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":819200,"data_stored":667190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94299999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61199999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85999999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.125}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73199999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2030000000000001}]}]},{"osd":6,"up_from":15,"seq":64424509448,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":233472,"data_stored":77852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66000000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.627}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78400000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0409999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.01}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1379999999999999}]}]},{"osd":5,"up_from":15,"seq":64424509447,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":225280,"data_stored":76330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54600000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77900000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94799999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98699999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91900000000000004}]}]},{"osd":4,"up_from":15,"seq":64424509447,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":233472,"data_stored":76366,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1990000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69899999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90600000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86899999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81000000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2230000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96899999999999997}]}]},{"osd":2,"up_from":15,"seq":64424509447,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31404,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340436,"statfs":{"total":96636764160,"available":96604606464,"internally_reserved":0,"allocated":221184,"data_stored":76240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89500000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64300000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92800000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1160000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.163}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1870000000000001}]}]},{"osd":1,"up_from":15,"seq":64424509446,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31412,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340428,"statfs":{"total":96636764160,"available":96604598272,"internally_reserved":0,"allocated":229376,"data_stored":76400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70699999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50600000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80600000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.115}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0609999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1879999999999999}]}]},{"osd":0,"up_from":15,"seq":64424509447,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31992,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339848,"statfs":{"total":96636764160,"available":96604004352,"internally_reserved":0,"allocated":827392,"data_stored":667246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68500000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82699999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.046}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0289999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.179}]}]},{"osd":3,"up_from":14,"seq":60129542150,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31408,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340432,"statfs":{"total":96636764160,"available":96604602368,"internally_reserved":0,"allocated":233472,"data_stored":77852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41799999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36099999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29699999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82299999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59699999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98799999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70999999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T06:09:46.263 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-10-08T06:09:46.263 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-10-08T06:09:46.263 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-10-08T06:09:46.264 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-08T06:09:46.368 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.368+0000 7f979536f700 1 Processor -- start 2023-10-08T06:09:46.368 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.368+0000 7f979536f700 1 -- start start 2023-10-08T06:09:46.369 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.368+0000 7f979536f700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f979015a2b0 0x7f97900ca9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:46.369 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.368+0000 7f979536f700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97900cca40 con 0x7f97900c98c0 2023-10-08T06:09:46.369 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.368+0000 7f979536f700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97900cdf60 con 0x7f9790159ed0 2023-10-08T06:09:46.369 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.368+0000 7f979536f700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97900ccdb0 con 0x7f979015a2b0 2023-10-08T06:09:46.369 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.368+0000 7f9794b6e700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f97900c98c0 0x7f97900cb510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:46254/0 (socket says 172.21.15.32:46254) 2023-10-08T06:09:46.370 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.368+0000 7f9794b6e700 1 -- 172.21.15.32:0/3956527821 learned_addr learned my addr 172.21.15.32:0/3956527821 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-08T06:09:46.370 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.368+0000 7f978f7fe700 1 --2- 172.21.15.32:0/3956527821 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f979015a2b0 0x7f97900ca9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:46.370 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.368+0000 7f978effd700 1 -- 172.21.15.32:0/3956527821 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 218755086 0 0) 0x7f97900cca40 con 0x7f97900c98c0 2023-10-08T06:09:46.370 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.368+0000 7f978effd700 1 -- 172.21.15.32:0/3956527821 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f97780035d0 con 0x7f97900c98c0 2023-10-08T06:09:46.373 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.368+0000 7f978effd700 1 -- 172.21.15.32:0/3956527821 <== mon.1 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3207970266 0 0) 0x7f97900cdf60 con 0x7f9790159ed0 2023-10-08T06:09:46.373 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.368+0000 7f978effd700 1 -- 172.21.15.32:0/3956527821 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f97900cca40 con 0x7f9790159ed0 2023-10-08T06:09:46.373 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.368+0000 7f978effd700 1 -- 172.21.15.32:0/3956527821 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2946198379 0 0) 0x7f97780035d0 con 0x7f97900c98c0 2023-10-08T06:09:46.373 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.368+0000 7f978effd700 1 -- 172.21.15.32:0/3956527821 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f979015a2b0 msgr2=0x7f97900ca9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:09:46.373 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.368+0000 7f978effd700 1 --2- 172.21.15.32:0/3956527821 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f979015a2b0 0x7f97900ca9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:46.373 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.368+0000 7f978effd700 1 -- 172.21.15.32:0/3956527821 >> v1:172.21.15.40:6789/0 conn(0x7f9790159ed0 legacy=0x7f97900706f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:46.373 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.368+0000 7f978effd700 1 -- 172.21.15.32:0/3956527821 --> v1:172.21.15.32:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97900ce240 con 0x7f97900c98c0 2023-10-08T06:09:46.374 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.368+0000 7f978effd700 1 -- 172.21.15.32:0/3956527821 <== mon.0 v1:172.21.15.32:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2364763317 0 0) 0x7f97880019f0 con 0x7f97900c98c0 2023-10-08T06:09:46.374 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.368+0000 7f978effd700 1 -- 172.21.15.32:0/3956527821 >> v1:172.21.15.32:6789/0 conn(0x7f97900c98c0 legacy=0x7f97900cb510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:46.374 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.368+0000 7f978effd700 1 --2- 172.21.15.32:0/3956527821 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9778003be0 0x7f9778003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:46.374 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.368+0000 7f978effd700 1 --2- 172.21.15.32:0/3956527821 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9778004870 0x7f9778004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:46.374 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.368+0000 7f978effd700 1 --2- 172.21.15.32:0/3956527821 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f979015a2b0 0x7f9778005250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:46.374 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.368+0000 7f978effd700 1 -- 172.21.15.32:0/3956527821 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97900ccdb0 con 0x7f9778004870 2023-10-08T06:09:46.374 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.368+0000 7f978effd700 1 -- 172.21.15.32:0/3956527821 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f977800bb70 con 0x7f9778003be0 2023-10-08T06:09:46.374 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.368+0000 7f978effd700 1 -- 172.21.15.32:0/3956527821 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f977800bd30 con 0x7f979015a2b0 2023-10-08T06:09:46.374 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.368+0000 7f978f7fe700 1 --2- 172.21.15.32:0/3956527821 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9778004870 0x7f9778004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:46.374 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.368+0000 7f978ffff700 1 --2- 172.21.15.32:0/3956527821 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9778003be0 0x7f9778003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:46.375 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.368+0000 7f9794b6e700 1 --2- 172.21.15.32:0/3956527821 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f979015a2b0 0x7f9778005250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:46.375 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.368+0000 7f978f7fe700 1 -- 172.21.15.32:0/3956527821 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f979015a2b0 msgr2=0x7f9778005250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:09:46.375 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.368+0000 7f978f7fe700 1 --2- 172.21.15.32:0/3956527821 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f979015a2b0 0x7f9778005250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:46.375 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.368+0000 7f978f7fe700 1 -- 172.21.15.32:0/3956527821 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9778003be0 msgr2=0x7f9778003fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:09:46.375 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.368+0000 7f978f7fe700 1 --2- 172.21.15.32:0/3956527821 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9778003be0 0x7f9778003fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:46.375 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.368+0000 7f978f7fe700 1 -- 172.21.15.32:0/3956527821 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97780035d0 con 0x7f9778004870 2023-10-08T06:09:46.375 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.368+0000 7f9794b6e700 1 --2- 172.21.15.32:0/3956527821 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f979015a2b0 0x7f9778005250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T06:09:46.375 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.372+0000 7f978f7fe700 1 --2- 172.21.15.32:0/3956527821 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9778004870 0x7f9778004cf0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f9784009b70 tx=0x7f97780058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db5a81ebb8a8c3b6 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:46.375 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.372+0000 7f978effd700 1 -- 172.21.15.32:0/3956527821 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f978400e6c0 con 0x7f9778004870 2023-10-08T06:09:46.375 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.372+0000 7f978effd700 1 -- 172.21.15.32:0/3956527821 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f978400e820 con 0x7f9778004870 2023-10-08T06:09:46.375 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.372+0000 7f978effd700 1 -- 172.21.15.32:0/3956527821 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f978400eb90 con 0x7f9778004870 2023-10-08T06:09:46.375 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.372+0000 7f979536f700 1 -- 172.21.15.32:0/3956527821 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9778004870 msgr2=0x7f9778004cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:46.376 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.372+0000 7f979536f700 1 --2- 172.21.15.32:0/3956527821 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9778004870 0x7f9778004cf0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f9784009b70 tx=0x7f97780058a0 comp rx=0 tx=0).stop 2023-10-08T06:09:46.376 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.372+0000 7f9794b6e700 1 -- 172.21.15.32:0/3956527821 reap_dead start 2023-10-08T06:09:46.376 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.372+0000 7f979536f700 1 -- 172.21.15.32:0/3956527821 shutdown_connections 2023-10-08T06:09:46.376 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.372+0000 7f979536f700 1 -- 172.21.15.32:0/3956527821 >> 172.21.15.32:0/3956527821 conn(0x7f97900b0900 msgr2=0x7f97900b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:09:46.376 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.372+0000 7f979536f700 1 -- 172.21.15.32:0/3956527821 shutdown_connections 2023-10-08T06:09:46.376 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.372+0000 7f979536f700 1 -- 172.21.15.32:0/3956527821 wait complete. 2023-10-08T06:09:46.378 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.372+0000 7f979536f700 1 Processor -- start 2023-10-08T06:09:46.378 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.372+0000 7f979536f700 1 -- start start 2023-10-08T06:09:46.378 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.372+0000 7f979536f700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f97900afcf0 0x7f97900c3c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:46.379 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.376+0000 7f979536f700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f97900b00d0 0x7f97900c3070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:46.379 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.376+0000 7f979536f700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f97900b3f50 0x7f97900b43d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:46.379 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.376+0000 7f979536f700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97900caef0 con 0x7f97900b00d0 2023-10-08T06:09:46.379 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.376+0000 7f979536f700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97900b3ac0 con 0x7f97900b3f50 2023-10-08T06:09:46.379 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.376+0000 7f979536f700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97900c4220 con 0x7f97900afcf0 2023-10-08T06:09:46.379 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.376+0000 7f978f7fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f97900b00d0 0x7f97900c3070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:46.379 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.376+0000 7f978f7fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f97900b00d0 0x7f97900c3070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:59716/0 (socket says 172.21.15.32:59716) 2023-10-08T06:09:46.379 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.376+0000 7f978f7fe700 1 -- 172.21.15.32:0/1344835704 learned_addr learned my addr 172.21.15.32:0/1344835704 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:09:46.379 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.376+0000 7f978ffff700 1 --2- 172.21.15.32:0/1344835704 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f97900afcf0 0x7f97900c3c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:46.379 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.376+0000 7f9794b6e700 1 --2- 172.21.15.32:0/1344835704 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f97900b3f50 0x7f97900b43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:46.379 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.376+0000 7f978f7fe700 1 -- 172.21.15.32:0/1344835704 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f97900afcf0 msgr2=0x7f97900c3c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:46.380 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.376+0000 7f978f7fe700 1 --2- 172.21.15.32:0/1344835704 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f97900afcf0 0x7f97900c3c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:46.380 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.376+0000 7f978f7fe700 1 -- 172.21.15.32:0/1344835704 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f97900b3f50 msgr2=0x7f97900b43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:46.380 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.376+0000 7f978f7fe700 1 --2- 172.21.15.32:0/1344835704 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f97900b3f50 0x7f97900b43d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:46.380 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.376+0000 7f978f7fe700 1 -- 172.21.15.32:0/1344835704 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97900c4500 con 0x7f97900b00d0 2023-10-08T06:09:46.380 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.376+0000 7f978f7fe700 1 --2- 172.21.15.32:0/1344835704 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f97900b00d0 0x7f97900c3070 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f9784016000 tx=0x7f97840047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:46.380 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.376+0000 7f978cff9700 1 -- 172.21.15.32:0/1344835704 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f978400e6c0 con 0x7f97900b00d0 2023-10-08T06:09:46.380 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.376+0000 7f978cff9700 1 -- 172.21.15.32:0/1344835704 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9784003af0 con 0x7f97900b00d0 2023-10-08T06:09:46.380 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.376+0000 7f979536f700 1 -- 172.21.15.32:0/1344835704 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97900b3750 con 0x7f97900b00d0 2023-10-08T06:09:46.380 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.376+0000 7f978cff9700 1 -- 172.21.15.32:0/1344835704 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9784003ea0 con 0x7f97900b00d0 2023-10-08T06:09:46.380 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.376+0000 7f979536f700 1 -- 172.21.15.32:0/1344835704 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f979015acb0 con 0x7f97900b00d0 2023-10-08T06:09:46.380 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.376+0000 7f979536f700 1 -- 172.21.15.32:0/1344835704 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97900b35b0 con 0x7f97900b00d0 2023-10-08T06:09:46.381 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.380+0000 7f978cff9700 1 -- 172.21.15.32:0/1344835704 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f9784013470 con 0x7f97900b00d0 2023-10-08T06:09:46.381 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.380+0000 7f978cff9700 1 --2- 172.21.15.32:0/1344835704 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f977c066540 0x7f977c068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:46.381 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.380+0000 7f978cff9700 1 -- 172.21.15.32:0/1344835704 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f97840851e0 con 0x7f97900b00d0 2023-10-08T06:09:46.382 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.380+0000 7f978ffff700 1 --2- 172.21.15.32:0/1344835704 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f977c066540 0x7f977c068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:46.382 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.380+0000 7f978ffff700 1 --2- 172.21.15.32:0/1344835704 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f977c066540 0x7f977c068a00 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f9780007fd0 tx=0x7f9780009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:46.388 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.388+0000 7f978cff9700 1 -- 172.21.15.32:0/1344835704 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f97900b35b0 con 0x7f97900b00d0 2023-10-08T06:09:46.580 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.580+0000 7f979536f700 1 -- 172.21.15.32:0/1344835704 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f97900b35b0 con 0x7f97900b00d0 2023-10-08T06:09:46.580 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.580+0000 7f978cff9700 1 -- 172.21.15.32:0/1344835704 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f97900b35b0 con 0x7f97900b00d0 2023-10-08T06:09:46.581 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:09:46.581 INFO:teuthology.orchestra.run.smithi032.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-10-08T06:09:46.583 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.580+0000 7f979536f700 1 -- 172.21.15.32:0/1344835704 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f977c066540 msgr2=0x7f977c068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:46.583 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.580+0000 7f979536f700 1 --2- 172.21.15.32:0/1344835704 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f977c066540 0x7f977c068a00 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f9780007fd0 tx=0x7f9780009040 comp rx=0 tx=0).stop 2023-10-08T06:09:46.584 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.580+0000 7f979536f700 1 -- 172.21.15.32:0/1344835704 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f97900b00d0 msgr2=0x7f97900c3070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:46.584 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.580+0000 7f979536f700 1 --2- 172.21.15.32:0/1344835704 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f97900b00d0 0x7f97900c3070 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f9784016000 tx=0x7f97840047e0 comp rx=0 tx=0).stop 2023-10-08T06:09:46.584 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.580+0000 7f979536f700 1 -- 172.21.15.32:0/1344835704 shutdown_connections 2023-10-08T06:09:46.584 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.580+0000 7f979536f700 1 --2- 172.21.15.32:0/1344835704 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f977c066540 0x7f977c068a00 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:46.584 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.580+0000 7f979536f700 1 --2- 172.21.15.32:0/1344835704 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f97900b00d0 0x7f97900c3070 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:46.584 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.580+0000 7f979536f700 1 --2- 172.21.15.32:0/1344835704 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f97900b3f50 0x7f97900b43d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:46.584 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.580+0000 7f979536f700 1 --2- 172.21.15.32:0/1344835704 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f97900afcf0 0x7f97900c3c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:46.584 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.580+0000 7f979536f700 1 -- 172.21.15.32:0/1344835704 >> 172.21.15.32:0/1344835704 conn(0x7f97900b0900 msgr2=0x7f97900cd0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:09:46.585 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.580+0000 7f979536f700 1 -- 172.21.15.32:0/1344835704 shutdown_connections 2023-10-08T06:09:46.585 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.580+0000 7f979536f700 1 -- 172.21.15.32:0/1344835704 wait complete. 2023-10-08T06:09:46.595 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-10-08T06:09:46.595 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T06:09:46.703 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.700+0000 7fa751d7c700 1 Processor -- start 2023-10-08T06:09:46.704 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.700+0000 7fa751d7c700 1 -- start start 2023-10-08T06:09:46.704 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.704+0000 7fa751d7c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa74c15d490 0x7fa74c0b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:46.704 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.704+0000 7fa751d7c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa74c0ce4e0 0x7fa74c0b6130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:46.705 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.704+0000 7fa751d7c700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa74c0d1bb0 con 0x7fa74c0d13d0 2023-10-08T06:09:46.705 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.704+0000 7fa751d7c700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa74c0d1e90 con 0x7fa74c0ce4e0 2023-10-08T06:09:46.705 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.704+0000 7fa751d7c700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa74c0d2170 con 0x7fa74c15d490 2023-10-08T06:09:46.706 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.704+0000 7fa750d7a700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa74c15d490 0x7fa74c0b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:46.706 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.704+0000 7fa75157b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa74c0ce4e0 0x7fa74c0b6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:46.706 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.704+0000 7fa750d7a700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa74c15d490 0x7fa74c0b8bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.32:54962/0 (socket says 172.21.15.32:54962) 2023-10-08T06:09:46.706 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.704+0000 7fa750d7a700 1 -- 172.21.15.32:0/2118280506 learned_addr learned my addr 172.21.15.32:0/2118280506 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:09:46.706 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.704+0000 7fa74bfff700 1 --1- 172.21.15.32:0/2118280506 >> v1:172.21.15.40:6789/0 conn(0x7fa74c0d13d0 0x7fa74c0cddd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.32:46056/0 (socket says 172.21.15.32:46056) 2023-10-08T06:09:46.706 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.704+0000 7fa750d7a700 1 -- 172.21.15.32:0/2118280506 >> v2:172.21.15.40:3300/0 conn(0x7fa74c0ce4e0 msgr2=0x7fa74c0b6130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:09:46.706 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.704+0000 7fa750d7a700 1 --2- 172.21.15.32:0/2118280506 >> v2:172.21.15.40:3300/0 conn(0x7fa74c0ce4e0 0x7fa74c0b6130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:46.706 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.704+0000 7fa750d7a700 1 -- 172.21.15.32:0/2118280506 >> v1:172.21.15.40:6789/0 conn(0x7fa74c0d13d0 legacy=0x7fa74c0cddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:46.707 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.704+0000 7fa750d7a700 1 -- 172.21.15.32:0/2118280506 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa74c0d2450 con 0x7fa74c15d490 2023-10-08T06:09:46.708 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.704+0000 7fa750d7a700 1 --2- 172.21.15.32:0/2118280506 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa74c15d490 0x7fa74c0b8bc0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fa73c009910 tx=0x7fa73c009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=578d2f328df7dc80 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:46.708 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.704+0000 7fa74b7fe700 1 -- 172.21.15.32:0/2118280506 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa73c011830 con 0x7fa74c15d490 2023-10-08T06:09:46.708 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.704+0000 7fa74b7fe700 1 -- 172.21.15.32:0/2118280506 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa73c011990 con 0x7fa74c15d490 2023-10-08T06:09:46.708 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.704+0000 7fa74b7fe700 1 -- 172.21.15.32:0/2118280506 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa73c011d40 con 0x7fa74c15d490 2023-10-08T06:09:46.708 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.704+0000 7fa751d7c700 1 -- 172.21.15.32:0/2118280506 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa74c15d490 msgr2=0x7fa74c0b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:46.708 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.704+0000 7fa751d7c700 1 --2- 172.21.15.32:0/2118280506 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa74c15d490 0x7fa74c0b8bc0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fa73c009910 tx=0x7fa73c009c20 comp rx=0 tx=0).stop 2023-10-08T06:09:46.709 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.704+0000 7fa751d7c700 1 -- 172.21.15.32:0/2118280506 shutdown_connections 2023-10-08T06:09:46.709 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.704+0000 7fa751d7c700 1 --2- 172.21.15.32:0/2118280506 >> v2:172.21.15.40:3300/0 conn(0x7fa74c0ce4e0 0x7fa74c0b6130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:46.709 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.704+0000 7fa751d7c700 1 --2- 172.21.15.32:0/2118280506 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa74c15d490 0x7fa74c0b8bc0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:46.709 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.704+0000 7fa751d7c700 1 -- 172.21.15.32:0/2118280506 >> 172.21.15.32:0/2118280506 conn(0x7fa74c06ab40 msgr2=0x7fa74c06af20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:09:46.709 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.704+0000 7fa751d7c700 1 -- 172.21.15.32:0/2118280506 shutdown_connections 2023-10-08T06:09:46.709 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.704+0000 7fa751d7c700 1 -- 172.21.15.32:0/2118280506 wait complete. 2023-10-08T06:09:46.711 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.708+0000 7fa751d7c700 1 Processor -- start 2023-10-08T06:09:46.711 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.708+0000 7fa751d7c700 1 -- start start 2023-10-08T06:09:46.711 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.708+0000 7fa751d7c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa74c0ce4e0 0x7fa74c15eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:46.711 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.708+0000 7fa751d7c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa74c0d13d0 0x7fa74c14a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:46.711 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.708+0000 7fa751d7c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa74c15d490 0x7fa74c160390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:46.711 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.708+0000 7fa751d7c700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa74c1608d0 con 0x7fa74c15d490 2023-10-08T06:09:46.711 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.708+0000 7fa751d7c700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa74c15de30 con 0x7fa74c0ce4e0 2023-10-08T06:09:46.711 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.708+0000 7fa751d7c700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa74c15e110 con 0x7fa74c0d13d0 2023-10-08T06:09:46.711 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.708+0000 7fa75157b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa74c15d490 0x7fa74c160390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:46.711 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.708+0000 7fa75157b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa74c15d490 0x7fa74c160390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:59732/0 (socket says 172.21.15.32:59732) 2023-10-08T06:09:46.712 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.708+0000 7fa74bfff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa74c0d13d0 0x7fa74c14a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:46.712 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.708+0000 7fa75157b700 1 -- 172.21.15.32:0/2534325937 learned_addr learned my addr 172.21.15.32:0/2534325937 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:09:46.712 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.708+0000 7fa750d7a700 1 --2- 172.21.15.32:0/2534325937 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa74c0ce4e0 0x7fa74c15eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:46.712 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.708+0000 7fa75157b700 1 -- 172.21.15.32:0/2534325937 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa74c0d13d0 msgr2=0x7fa74c14a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:46.712 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.708+0000 7fa75157b700 1 --2- 172.21.15.32:0/2534325937 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa74c0d13d0 0x7fa74c14a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:46.712 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.708+0000 7fa75157b700 1 -- 172.21.15.32:0/2534325937 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa74c0ce4e0 msgr2=0x7fa74c15eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:46.712 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.708+0000 7fa75157b700 1 --2- 172.21.15.32:0/2534325937 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa74c0ce4e0 0x7fa74c15eed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:46.712 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.708+0000 7fa75157b700 1 -- 172.21.15.32:0/2534325937 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa73c009570 con 0x7fa74c15d490 2023-10-08T06:09:46.712 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.708+0000 7fa75157b700 1 --2- 172.21.15.32:0/2534325937 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa74c15d490 0x7fa74c160390 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fa74400efc0 tx=0x7fa74400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:46.713 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.708+0000 7fa7497fa700 1 -- 172.21.15.32:0/2534325937 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa744009ea0 con 0x7fa74c15d490 2023-10-08T06:09:46.713 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.708+0000 7fa7497fa700 1 -- 172.21.15.32:0/2534325937 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa74400f040 con 0x7fa74c15d490 2023-10-08T06:09:46.713 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.708+0000 7fa751d7c700 1 -- 172.21.15.32:0/2534325937 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa74c15e3f0 con 0x7fa74c15d490 2023-10-08T06:09:46.713 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.708+0000 7fa7497fa700 1 -- 172.21.15.32:0/2534325937 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa74400ced0 con 0x7fa74c15d490 2023-10-08T06:09:46.713 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.708+0000 7fa751d7c700 1 -- 172.21.15.32:0/2534325937 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa74c15e9b0 con 0x7fa74c15d490 2023-10-08T06:09:46.714 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.712+0000 7fa751d7c700 1 -- 172.21.15.32:0/2534325937 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa74c0b8d30 con 0x7fa74c15d490 2023-10-08T06:09:46.714 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.712+0000 7fa7497fa700 1 -- 172.21.15.32:0/2534325937 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fa744014480 con 0x7fa74c15d490 2023-10-08T06:09:46.715 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.712+0000 7fa7497fa700 1 --2- 172.21.15.32:0/2534325937 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fa738066510 0x7fa7380689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:46.715 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.712+0000 7fa7497fa700 1 -- 172.21.15.32:0/2534325937 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa744084580 con 0x7fa74c15d490 2023-10-08T06:09:46.715 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.712+0000 7fa750d7a700 1 --2- 172.21.15.32:0/2534325937 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fa738066510 0x7fa7380689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:46.715 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.716+0000 7fa750d7a700 1 --2- 172.21.15.32:0/2534325937 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fa738066510 0x7fa7380689d0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fa73c009c60 tx=0x7fa73c008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:46.720 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.720+0000 7fa7497fa700 1 -- 172.21.15.32:0/2534325937 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fa744051b40 con 0x7fa74c15d490 2023-10-08T06:09:46.877 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.876+0000 7fa751d7c700 1 -- 172.21.15.32:0/2534325937 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa74c073f00 con 0x7fa74c15d490 2023-10-08T06:09:46.879 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.876+0000 7fa7497fa700 1 -- 172.21.15.32:0/2534325937 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16445 (secure 0 0 0) 0x7fa744055160 con 0x7fa74c15d490 2023-10-08T06:09:46.879 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:09:46.880 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":22,"fsid":"ac672d87-96ae-41e0-9314-623ba2cdbbba","created":"2023-10-08T06:09:11.175626+0000","modified":"2023-10-08T06:09:38.153256+0000","last_up_change":"2023-10-08T06:09:22.744643+0000","last_in_change":"2023-10-08T06:09:14.131580+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T06:09:23.307843+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T06:09:34.295012+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T06:09:35.515590+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"43433f0c-9592-4874-92d7-10f8f4acf07f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":587888964},{"type":"v1","addr":"172.21.15.32:6801","nonce":587888964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":587888964},{"type":"v1","addr":"172.21.15.32:6803","nonce":587888964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":587888964},{"type":"v1","addr":"172.21.15.32:6810","nonce":587888964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6805","nonce":587888964},{"type":"v1","addr":"172.21.15.32:6807","nonce":587888964}]},"public_addr":"172.21.15.32:6801/587888964","cluster_addr":"172.21.15.32:6803/587888964","heartbeat_back_addr":"172.21.15.32:6810/587888964","heartbeat_front_addr":"172.21.15.32:6807/587888964","state":["exists","up"]},{"osd":1,"uuid":"2ecb1008-b987-4ce7-b646-6cded55fc8d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":990576767},{"type":"v1","addr":"172.21.15.32:6817","nonce":990576767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":990576767},{"type":"v1","addr":"172.21.15.32:6819","nonce":990576767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":990576767},{"type":"v1","addr":"172.21.15.32:6823","nonce":990576767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":990576767},{"type":"v1","addr":"172.21.15.32:6821","nonce":990576767}]},"public_addr":"172.21.15.32:6817/990576767","cluster_addr":"172.21.15.32:6819/990576767","heartbeat_back_addr":"172.21.15.32:6823/990576767","heartbeat_front_addr":"172.21.15.32:6821/990576767","state":["exists","up"]},{"osd":2,"uuid":"1b131c94-c09b-4e80-8746-bf1b7bac362d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6824","nonce":1566874440},{"type":"v1","addr":"172.21.15.32:6825","nonce":1566874440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":1566874440},{"type":"v1","addr":"172.21.15.32:6827","nonce":1566874440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":1566874440},{"type":"v1","addr":"172.21.15.32:6831","nonce":1566874440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":1566874440},{"type":"v1","addr":"172.21.15.32:6829","nonce":1566874440}]},"public_addr":"172.21.15.32:6825/1566874440","cluster_addr":"172.21.15.32:6827/1566874440","heartbeat_back_addr":"172.21.15.32:6831/1566874440","heartbeat_front_addr":"172.21.15.32:6829/1566874440","state":["exists","up"]},{"osd":3,"uuid":"ad655af2-1f6f-4689-b21d-b07bbaeb68b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":3672614802},{"type":"v1","addr":"172.21.15.32:6806","nonce":3672614802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6809","nonce":3672614802},{"type":"v1","addr":"172.21.15.32:6811","nonce":3672614802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":3672614802},{"type":"v1","addr":"172.21.15.32:6815","nonce":3672614802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":3672614802},{"type":"v1","addr":"172.21.15.32:6813","nonce":3672614802}]},"public_addr":"172.21.15.32:6806/3672614802","cluster_addr":"172.21.15.32:6811/3672614802","heartbeat_back_addr":"172.21.15.32:6815/3672614802","heartbeat_front_addr":"172.21.15.32:6813/3672614802","state":["exists","up"]},{"osd":4,"uuid":"64a543a1-8c4f-458e-9aba-b35c1cd7dd03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":3369928244},{"type":"v1","addr":"172.21.15.40:6801","nonce":3369928244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":3369928244},{"type":"v1","addr":"172.21.15.40:6803","nonce":3369928244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":3369928244},{"type":"v1","addr":"172.21.15.40:6807","nonce":3369928244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":3369928244},{"type":"v1","addr":"172.21.15.40:6805","nonce":3369928244}]},"public_addr":"172.21.15.40:6801/3369928244","cluster_addr":"172.21.15.40:6803/3369928244","heartbeat_back_addr":"172.21.15.40:6807/3369928244","heartbeat_front_addr":"172.21.15.40:6805/3369928244","state":["exists","up"]},{"osd":5,"uuid":"0fef3e54-edb4-4678-878e-944663c51638","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":2395850297},{"type":"v1","addr":"172.21.15.40:6825","nonce":2395850297}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":2395850297},{"type":"v1","addr":"172.21.15.40:6827","nonce":2395850297}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":2395850297},{"type":"v1","addr":"172.21.15.40:6831","nonce":2395850297}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":2395850297},{"type":"v1","addr":"172.21.15.40:6829","nonce":2395850297}]},"public_addr":"172.21.15.40:6825/2395850297","cluster_addr":"172.21.15.40:6827/2395850297","heartbeat_back_addr":"172.21.15.40:6831/2395850297","heartbeat_front_addr":"172.21.15.40:6829/2395850297","state":["exists","up"]},{"osd":6,"uuid":"2eeb0472-6096-469d-9b2c-cab4bf41c31a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":4145283410},{"type":"v1","addr":"172.21.15.40:6809","nonce":4145283410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":4145283410},{"type":"v1","addr":"172.21.15.40:6811","nonce":4145283410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":4145283410},{"type":"v1","addr":"172.21.15.40:6815","nonce":4145283410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":4145283410},{"type":"v1","addr":"172.21.15.40:6813","nonce":4145283410}]},"public_addr":"172.21.15.40:6809/4145283410","cluster_addr":"172.21.15.40:6811/4145283410","heartbeat_back_addr":"172.21.15.40:6815/4145283410","heartbeat_front_addr":"172.21.15.40:6813/4145283410","state":["exists","up"]},{"osd":7,"uuid":"cf76e4c7-96a6-401f-a280-91aad4641940","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":2943297416},{"type":"v1","addr":"172.21.15.40:6817","nonce":2943297416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":2943297416},{"type":"v1","addr":"172.21.15.40:6819","nonce":2943297416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":2943297416},{"type":"v1","addr":"172.21.15.40:6823","nonce":2943297416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":2943297416},{"type":"v1","addr":"172.21.15.40:6821","nonce":2943297416}]},"public_addr":"172.21.15.40:6817/2943297416","cluster_addr":"172.21.15.40:6819/2943297416","heartbeat_back_addr":"172.21.15.40:6823/2943297416","heartbeat_front_addr":"172.21.15.40:6821/2943297416","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.411475+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.628841+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.599055+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.166100+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.384135+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.488403+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.307648+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.363541+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T06:09:46.881 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.880+0000 7fa751d7c700 1 -- 172.21.15.32:0/2534325937 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fa738066510 msgr2=0x7fa7380689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:46.882 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.880+0000 7fa751d7c700 1 --2- 172.21.15.32:0/2534325937 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fa738066510 0x7fa7380689d0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fa73c009c60 tx=0x7fa73c008030 comp rx=0 tx=0).stop 2023-10-08T06:09:46.882 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.880+0000 7fa751d7c700 1 -- 172.21.15.32:0/2534325937 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa74c15d490 msgr2=0x7fa74c160390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:46.882 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.880+0000 7fa751d7c700 1 --2- 172.21.15.32:0/2534325937 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa74c15d490 0x7fa74c160390 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fa74400efc0 tx=0x7fa74400c3a0 comp rx=0 tx=0).stop 2023-10-08T06:09:46.882 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.880+0000 7fa751d7c700 1 -- 172.21.15.32:0/2534325937 shutdown_connections 2023-10-08T06:09:46.882 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.880+0000 7fa751d7c700 1 --2- 172.21.15.32:0/2534325937 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fa738066510 0x7fa7380689d0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:46.882 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.880+0000 7fa751d7c700 1 --2- 172.21.15.32:0/2534325937 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa74c15d490 0x7fa74c160390 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:46.882 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.880+0000 7fa751d7c700 1 --2- 172.21.15.32:0/2534325937 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa74c0d13d0 0x7fa74c14a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:46.882 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.880+0000 7fa751d7c700 1 --2- 172.21.15.32:0/2534325937 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa74c0ce4e0 0x7fa74c15eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:46.882 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.880+0000 7fa751d7c700 1 -- 172.21.15.32:0/2534325937 >> 172.21.15.32:0/2534325937 conn(0x7fa74c06ab40 msgr2=0x7fa74c0c6b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:09:46.883 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.880+0000 7fa751d7c700 1 -- 172.21.15.32:0/2534325937 shutdown_connections 2023-10-08T06:09:46.883 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:46.880+0000 7fa751d7c700 1 -- 172.21.15.32:0/2534325937 wait complete. 2023-10-08T06:09:46.893 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T06:09:23.307843+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-08T06:09:34.295012+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-08T06:09:35.515590+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-08T06:09:46.894 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T06:09:47.009 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.008+0000 7fa89f59e700 1 Processor -- start 2023-10-08T06:09:47.009 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.008+0000 7fa89f59e700 1 -- start start 2023-10-08T06:09:47.010 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.008+0000 7fa89f59e700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa8a0159ed0 0x7fa8a00ca9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:47.011 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.008+0000 7fa89f59e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa8a00c98c0 0x7fa8a00cb510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:47.011 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.008+0000 7fa89f59e700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8a00cca40 con 0x7fa8a015a2b0 2023-10-08T06:09:47.011 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.008+0000 7fa89f59e700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8a00ccdb0 con 0x7fa8a0159ed0 2023-10-08T06:09:47.011 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.008+0000 7fa89f59e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8a00caef0 con 0x7fa8a00c98c0 2023-10-08T06:09:47.011 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.008+0000 7fa89e59c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa8a0159ed0 0x7fa8a00ca9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:47.011 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.008+0000 7fa89ed9d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa8a00c98c0 0x7fa8a00cb510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:47.011 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.008+0000 7fa89e59c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa8a0159ed0 0x7fa8a00ca9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.32:38596/0 (socket says 172.21.15.32:38596) 2023-10-08T06:09:47.011 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.008+0000 7fa89dd9b700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fa8a015a2b0 0x7fa8a00706f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.32:46062/0 (socket says 172.21.15.32:46062) 2023-10-08T06:09:47.011 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.008+0000 7fa89ed9d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa8a00c98c0 0x7fa8a00cb510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.32:54970/0 (socket says 172.21.15.32:54970) 2023-10-08T06:09:47.011 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.008+0000 7fa89dd9b700 1 -- 172.21.15.32:0/467254100 learned_addr learned my addr 172.21.15.32:0/467254100 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-08T06:09:47.013 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.008+0000 7fa89e59c700 1 -- 172.21.15.32:0/467254100 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa8a00c98c0 msgr2=0x7fa8a00cb510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:09:47.013 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.008+0000 7fa89e59c700 1 --2- 172.21.15.32:0/467254100 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa8a00c98c0 0x7fa8a00cb510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:47.013 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.008+0000 7fa89e59c700 1 -- 172.21.15.32:0/467254100 >> v1:172.21.15.40:6789/0 conn(0x7fa8a015a2b0 legacy=0x7fa8a00706f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:47.014 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.008+0000 7fa89d59a700 1 -- 172.21.15.32:0/467254100 <== mon.1 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 180588242 0 0) 0x7fa8a00cca40 con 0x7fa8a015a2b0 2023-10-08T06:09:47.014 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.008+0000 7fa89e59c700 1 -- 172.21.15.32:0/467254100 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8a00cdf60 con 0x7fa8a0159ed0 2023-10-08T06:09:47.014 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.012+0000 7fa89ed9d700 1 --2- 172.21.15.32:0/467254100 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa8a00c98c0 0x7fa8a00cb510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T06:09:47.014 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.012+0000 7fa89e59c700 1 --2- 172.21.15.32:0/467254100 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa8a0159ed0 0x7fa8a00ca9b0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fa890009850 tx=0x7fa890009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f7ac10d7a45f36a0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:47.014 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.012+0000 7fa89d59a700 1 -- 172.21.15.32:0/467254100 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa890011830 con 0x7fa8a0159ed0 2023-10-08T06:09:47.014 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.012+0000 7fa89d59a700 1 -- 172.21.15.32:0/467254100 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa890011990 con 0x7fa8a0159ed0 2023-10-08T06:09:47.014 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.012+0000 7fa89d59a700 1 -- 172.21.15.32:0/467254100 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa890011d40 con 0x7fa8a0159ed0 2023-10-08T06:09:47.014 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.012+0000 7fa89f59e700 1 -- 172.21.15.32:0/467254100 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa8a0159ed0 msgr2=0x7fa8a00ca9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:47.014 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.012+0000 7fa89f59e700 1 --2- 172.21.15.32:0/467254100 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa8a0159ed0 0x7fa8a00ca9b0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fa890009850 tx=0x7fa890009b60 comp rx=0 tx=0).stop 2023-10-08T06:09:47.014 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.012+0000 7fa89f59e700 1 -- 172.21.15.32:0/467254100 shutdown_connections 2023-10-08T06:09:47.014 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.012+0000 7fa89f59e700 1 --2- 172.21.15.32:0/467254100 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa8a00c98c0 0x7fa8a00cb510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:47.015 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.012+0000 7fa89f59e700 1 --2- 172.21.15.32:0/467254100 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa8a0159ed0 0x7fa8a00ca9b0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:47.015 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.012+0000 7fa89f59e700 1 -- 172.21.15.32:0/467254100 >> 172.21.15.32:0/467254100 conn(0x7fa8a00b0900 msgr2=0x7fa8a00b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:09:47.015 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.012+0000 7fa89f59e700 1 -- 172.21.15.32:0/467254100 shutdown_connections 2023-10-08T06:09:47.015 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.012+0000 7fa89f59e700 1 -- 172.21.15.32:0/467254100 wait complete. 2023-10-08T06:09:47.015 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.012+0000 7fa89f59e700 1 Processor -- start 2023-10-08T06:09:47.015 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.012+0000 7fa89f59e700 1 -- start start 2023-10-08T06:09:47.017 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.016+0000 7fa89f59e700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa8a00c98c0 0x7fa8a0146da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:47.017 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.016+0000 7fa89f59e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa8a015a2b0 0x7fa8a015d940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:47.017 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.016+0000 7fa89f59e700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa8a015de80 0x7fa8a01f3d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:47.017 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.016+0000 7fa89f59e700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8a015e310 con 0x7fa8a00c98c0 2023-10-08T06:09:47.017 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.016+0000 7fa89f59e700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8a014a130 con 0x7fa8a015de80 2023-10-08T06:09:47.017 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.016+0000 7fa89f59e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8a01f4a80 con 0x7fa8a015a2b0 2023-10-08T06:09:47.018 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.016+0000 7fa89e59c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa8a00c98c0 0x7fa8a0146da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:47.018 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.016+0000 7fa89e59c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa8a00c98c0 0x7fa8a0146da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:59740/0 (socket says 172.21.15.32:59740) 2023-10-08T06:09:47.018 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.016+0000 7fa89e59c700 1 -- 172.21.15.32:0/2049947288 learned_addr learned my addr 172.21.15.32:0/2049947288 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:09:47.018 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.016+0000 7fa89dd9b700 1 --2- 172.21.15.32:0/2049947288 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa8a015a2b0 0x7fa8a015d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:47.018 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.016+0000 7fa89ed9d700 1 --2- 172.21.15.32:0/2049947288 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa8a015de80 0x7fa8a01f3d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:47.018 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.016+0000 7fa89e59c700 1 -- 172.21.15.32:0/2049947288 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa8a015a2b0 msgr2=0x7fa8a015d940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:47.018 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.016+0000 7fa89e59c700 1 --2- 172.21.15.32:0/2049947288 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa8a015a2b0 0x7fa8a015d940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:47.018 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.016+0000 7fa89e59c700 1 -- 172.21.15.32:0/2049947288 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa8a015de80 msgr2=0x7fa8a01f3d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:47.018 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.016+0000 7fa89e59c700 1 --2- 172.21.15.32:0/2049947288 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa8a015de80 0x7fa8a01f3d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:47.018 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.016+0000 7fa89e59c700 1 -- 172.21.15.32:0/2049947288 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa898009a70 con 0x7fa8a00c98c0 2023-10-08T06:09:47.018 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.016+0000 7fa89e59c700 1 --2- 172.21.15.32:0/2049947288 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa8a00c98c0 0x7fa8a0146da0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fa8900090b0 tx=0x7fa890004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:47.019 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.016+0000 7fa88effd700 1 -- 172.21.15.32:0/2049947288 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa89001a950 con 0x7fa8a00c98c0 2023-10-08T06:09:47.019 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.016+0000 7fa88effd700 1 -- 172.21.15.32:0/2049947288 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa89001f070 con 0x7fa8a00c98c0 2023-10-08T06:09:47.019 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.016+0000 7fa89f59e700 1 -- 172.21.15.32:0/2049947288 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8900094b0 con 0x7fa8a00c98c0 2023-10-08T06:09:47.020 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.016+0000 7fa88effd700 1 -- 172.21.15.32:0/2049947288 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa89001acf0 con 0x7fa8a00c98c0 2023-10-08T06:09:47.020 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.016+0000 7fa89f59e700 1 -- 172.21.15.32:0/2049947288 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8a0149800 con 0x7fa8a00c98c0 2023-10-08T06:09:47.020 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.016+0000 7fa89f59e700 1 -- 172.21.15.32:0/2049947288 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8a0073f00 con 0x7fa8a00c98c0 2023-10-08T06:09:47.020 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.020+0000 7fa88effd700 1 -- 172.21.15.32:0/2049947288 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fa89001b430 con 0x7fa8a00c98c0 2023-10-08T06:09:47.021 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.020+0000 7fa88effd700 1 --2- 172.21.15.32:0/2049947288 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fa880066510 0x7fa8800689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:47.021 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.020+0000 7fa88effd700 1 -- 172.21.15.32:0/2049947288 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa890084e30 con 0x7fa8a00c98c0 2023-10-08T06:09:47.021 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.020+0000 7fa89dd9b700 1 --2- 172.21.15.32:0/2049947288 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fa880066510 0x7fa8800689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:47.021 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.020+0000 7fa89dd9b700 1 --2- 172.21.15.32:0/2049947288 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fa880066510 0x7fa8800689d0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fa8a00c5e50 tx=0x7fa894007e00 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:47.029 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.028+0000 7fa88effd700 1 -- 172.21.15.32:0/2049947288 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fa8900522e0 con 0x7fa8a00c98c0 2023-10-08T06:09:47.194 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.192+0000 7fa89f59e700 1 -- 172.21.15.32:0/2049947288 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa8a00b4d50 con 0x7fa8a00c98c0 2023-10-08T06:09:47.195 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.192+0000 7fa88effd700 1 -- 172.21.15.32:0/2049947288 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa890015020 con 0x7fa8a00c98c0 2023-10-08T06:09:47.195 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 1 2023-10-08T06:09:47.198 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.196+0000 7fa89f59e700 1 -- 172.21.15.32:0/2049947288 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fa880066510 msgr2=0x7fa8800689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:47.198 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.196+0000 7fa89f59e700 1 --2- 172.21.15.32:0/2049947288 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fa880066510 0x7fa8800689d0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fa8a00c5e50 tx=0x7fa894007e00 comp rx=0 tx=0).stop 2023-10-08T06:09:47.198 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.196+0000 7fa89f59e700 1 -- 172.21.15.32:0/2049947288 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa8a00c98c0 msgr2=0x7fa8a0146da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:47.199 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.196+0000 7fa89f59e700 1 --2- 172.21.15.32:0/2049947288 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa8a00c98c0 0x7fa8a0146da0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fa8900090b0 tx=0x7fa890004770 comp rx=0 tx=0).stop 2023-10-08T06:09:47.199 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.196+0000 7fa89f59e700 1 -- 172.21.15.32:0/2049947288 shutdown_connections 2023-10-08T06:09:47.199 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.196+0000 7fa89f59e700 1 --2- 172.21.15.32:0/2049947288 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fa880066510 0x7fa8800689d0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:47.199 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.196+0000 7fa89f59e700 1 --2- 172.21.15.32:0/2049947288 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa8a015de80 0x7fa8a01f3d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:47.199 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.196+0000 7fa89f59e700 1 --2- 172.21.15.32:0/2049947288 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa8a015a2b0 0x7fa8a015d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:47.199 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.196+0000 7fa89f59e700 1 --2- 172.21.15.32:0/2049947288 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa8a00c98c0 0x7fa8a0146da0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:47.199 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.196+0000 7fa89f59e700 1 -- 172.21.15.32:0/2049947288 >> 172.21.15.32:0/2049947288 conn(0x7fa8a00b0900 msgr2=0x7fa8a0158460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:09:47.199 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.196+0000 7fa89f59e700 1 -- 172.21.15.32:0/2049947288 shutdown_connections 2023-10-08T06:09:47.199 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.196+0000 7fa89f59e700 1 -- 172.21.15.32:0/2049947288 wait complete. 2023-10-08T06:09:47.210 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-08T06:09:47.325 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.324+0000 7f7ddbfd5700 1 Processor -- start 2023-10-08T06:09:47.325 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.324+0000 7f7ddbfd5700 1 -- start start 2023-10-08T06:09:47.326 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.324+0000 7f7ddbfd5700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f7dd406c120 0x7f7dd415e670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:47.326 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.324+0000 7f7ddbfd5700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f7dd4070d30 0x7f7dd40711c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:47.326 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.324+0000 7f7ddbfd5700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7dd40cca50 con 0x7f7dd40ca5f0 2023-10-08T06:09:47.326 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.324+0000 7f7ddbfd5700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7dd415a670 con 0x7f7dd4070d30 2023-10-08T06:09:47.326 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.324+0000 7f7ddbfd5700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7dd415ebb0 con 0x7f7dd406c120 2023-10-08T06:09:47.327 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.324+0000 7f7dda572700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f7dd4070d30 0x7f7dd40711c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:47.327 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.324+0000 7f7dd9570700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f7dd406c120 0x7f7dd415e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:47.327 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.324+0000 7f7dda572700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f7dd4070d30 0x7f7dd40711c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:59752/0 (socket says 172.21.15.32:59752) 2023-10-08T06:09:47.327 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.324+0000 7f7dda572700 1 -- 172.21.15.32:0/3468846520 learned_addr learned my addr 172.21.15.32:0/3468846520 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:09:47.328 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.324+0000 7f7dda572700 1 -- 172.21.15.32:0/3468846520 >> v2:172.21.15.40:3300/0 conn(0x7f7dd406c120 msgr2=0x7f7dd415e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:09:47.328 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.324+0000 7f7dda572700 1 --2- 172.21.15.32:0/3468846520 >> v2:172.21.15.40:3300/0 conn(0x7f7dd406c120 0x7f7dd415e670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:47.329 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.324+0000 7f7dda572700 1 -- 172.21.15.32:0/3468846520 >> v1:172.21.15.40:6789/0 conn(0x7f7dd40ca5f0 legacy=0x7f7dd40ca9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:47.329 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.324+0000 7f7dda572700 1 -- 172.21.15.32:0/3468846520 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dd415b470 con 0x7f7dd4070d30 2023-10-08T06:09:47.329 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.324+0000 7f7dda572700 1 --2- 172.21.15.32:0/3468846520 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7dd4070d30 0x7f7dd40711c0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f7dd406b250 tx=0x7f7dc8009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70dd4c49de05730 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:47.329 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.324+0000 7f7dd8d6f700 1 -- 172.21.15.32:0/3468846520 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dc8011830 con 0x7f7dd4070d30 2023-10-08T06:09:47.329 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.324+0000 7f7dd8d6f700 1 -- 172.21.15.32:0/3468846520 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dc8011990 con 0x7f7dd4070d30 2023-10-08T06:09:47.329 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.324+0000 7f7dd8d6f700 1 -- 172.21.15.32:0/3468846520 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dc8011d20 con 0x7f7dd4070d30 2023-10-08T06:09:47.329 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.328+0000 7f7ddbfd5700 1 -- 172.21.15.32:0/3468846520 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7dd4070d30 msgr2=0x7f7dd40711c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:47.329 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.328+0000 7f7ddbfd5700 1 --2- 172.21.15.32:0/3468846520 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7dd4070d30 0x7f7dd40711c0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f7dd406b250 tx=0x7f7dc8009bf0 comp rx=0 tx=0).stop 2023-10-08T06:09:47.329 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.328+0000 7f7ddbfd5700 1 -- 172.21.15.32:0/3468846520 shutdown_connections 2023-10-08T06:09:47.330 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.328+0000 7f7ddbfd5700 1 --2- 172.21.15.32:0/3468846520 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7dd4070d30 0x7f7dd40711c0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:47.330 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.328+0000 7f7ddbfd5700 1 --2- 172.21.15.32:0/3468846520 >> v2:172.21.15.40:3300/0 conn(0x7f7dd406c120 0x7f7dd415e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:47.330 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.328+0000 7f7ddbfd5700 1 -- 172.21.15.32:0/3468846520 >> 172.21.15.32:0/3468846520 conn(0x7f7dd40cee80 msgr2=0x7f7dd40cf290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:09:47.330 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.328+0000 7f7ddbfd5700 1 -- 172.21.15.32:0/3468846520 shutdown_connections 2023-10-08T06:09:47.330 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.328+0000 7f7ddbfd5700 1 -- 172.21.15.32:0/3468846520 wait complete. 2023-10-08T06:09:47.332 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.328+0000 7f7ddbfd5700 1 Processor -- start 2023-10-08T06:09:47.332 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.328+0000 7f7ddbfd5700 1 -- start start 2023-10-08T06:09:47.332 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.328+0000 7f7ddbfd5700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7dd406c120 0x7f7dd40ae780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:47.333 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.328+0000 7f7ddbfd5700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7dd4070d30 0x7f7dd40c53c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:47.333 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.328+0000 7f7ddbfd5700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7dd40ca5f0 0x7f7dd414d290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:47.333 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.328+0000 7f7ddbfd5700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dd40c5900 con 0x7f7dd4070d30 2023-10-08T06:09:47.333 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.328+0000 7f7ddbfd5700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dd40aedd0 con 0x7f7dd406c120 2023-10-08T06:09:47.333 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.328+0000 7f7ddbfd5700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7dd40af0b0 con 0x7f7dd40ca5f0 2023-10-08T06:09:47.333 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.328+0000 7f7dd9570700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7dd4070d30 0x7f7dd40c53c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:47.333 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.328+0000 7f7dd9570700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7dd4070d30 0x7f7dd40c53c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:59766/0 (socket says 172.21.15.32:59766) 2023-10-08T06:09:47.333 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.328+0000 7f7dd9570700 1 -- 172.21.15.32:0/788767487 learned_addr learned my addr 172.21.15.32:0/788767487 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:09:47.333 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.328+0000 7f7dd9d71700 1 --2- 172.21.15.32:0/788767487 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7dd406c120 0x7f7dd40ae780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:47.334 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.328+0000 7f7dda572700 1 --2- 172.21.15.32:0/788767487 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7dd40ca5f0 0x7f7dd414d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:47.334 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.328+0000 7f7dd9570700 1 -- 172.21.15.32:0/788767487 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7dd40ca5f0 msgr2=0x7f7dd414d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:47.334 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.328+0000 7f7dd9570700 1 --2- 172.21.15.32:0/788767487 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7dd40ca5f0 0x7f7dd414d290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:47.334 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.328+0000 7f7dd9570700 1 -- 172.21.15.32:0/788767487 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7dd406c120 msgr2=0x7f7dd40ae780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:47.334 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.328+0000 7f7dd9570700 1 --2- 172.21.15.32:0/788767487 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7dd406c120 0x7f7dd40ae780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:47.334 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.328+0000 7f7dd9570700 1 -- 172.21.15.32:0/788767487 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dc8009570 con 0x7f7dd4070d30 2023-10-08T06:09:47.334 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.328+0000 7f7dd9d71700 1 --2- 172.21.15.32:0/788767487 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7dd406c120 0x7f7dd40ae780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T06:09:47.334 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.332+0000 7f7dd9570700 1 --2- 172.21.15.32:0/788767487 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7dd4070d30 0x7f7dd40c53c0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f7dc400efc0 tx=0x7f7dc400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:47.334 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.332+0000 7f7dd27fc700 1 -- 172.21.15.32:0/788767487 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dc400cdc0 con 0x7f7dd4070d30 2023-10-08T06:09:47.335 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.332+0000 7f7dd27fc700 1 -- 172.21.15.32:0/788767487 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dc400f040 con 0x7f7dd4070d30 2023-10-08T06:09:47.335 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.332+0000 7f7ddbfd5700 1 -- 172.21.15.32:0/788767487 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7dd40af390 con 0x7f7dd4070d30 2023-10-08T06:09:47.335 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.332+0000 7f7dd27fc700 1 -- 172.21.15.32:0/788767487 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dc40146a0 con 0x7f7dd4070d30 2023-10-08T06:09:47.335 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.332+0000 7f7ddbfd5700 1 -- 172.21.15.32:0/788767487 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7dd40af950 con 0x7f7dd4070d30 2023-10-08T06:09:47.336 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.332+0000 7f7ddbfd5700 1 -- 172.21.15.32:0/788767487 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7dd4073f00 con 0x7f7dd4070d30 2023-10-08T06:09:47.336 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.332+0000 7f7dd27fc700 1 -- 172.21.15.32:0/788767487 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f7dc4014800 con 0x7f7dd4070d30 2023-10-08T06:09:47.336 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.336+0000 7f7dd27fc700 1 --2- 172.21.15.32:0/788767487 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f7dc0066510 0x7f7dc00689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:47.336 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.336+0000 7f7dd9d71700 1 --2- 172.21.15.32:0/788767487 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f7dc0066510 0x7f7dc00689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:47.336 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.336+0000 7f7dd27fc700 1 -- 172.21.15.32:0/788767487 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7dc40848d0 con 0x7f7dd4070d30 2023-10-08T06:09:47.337 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.336+0000 7f7dd9d71700 1 --2- 172.21.15.32:0/788767487 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f7dc0066510 0x7f7dc00689d0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f7dd415e450 tx=0x7f7dcc009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:47.342 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.340+0000 7f7dd27fc700 1 -- 172.21.15.32:0/788767487 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f7dc4051cb0 con 0x7f7dd4070d30 2023-10-08T06:09:47.508 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.508+0000 7f7ddbfd5700 1 -- 172.21.15.32:0/788767487 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7dd4072070 con 0x7f7dd4070d30 2023-10-08T06:09:47.508 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.508+0000 7f7dd27fc700 1 -- 172.21.15.32:0/788767487 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7dc40552d0 con 0x7f7dd4070d30 2023-10-08T06:09:47.509 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 32 2023-10-08T06:09:47.513 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.512+0000 7f7ddbfd5700 1 -- 172.21.15.32:0/788767487 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f7dc0066510 msgr2=0x7f7dc00689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:47.513 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.512+0000 7f7ddbfd5700 1 --2- 172.21.15.32:0/788767487 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f7dc0066510 0x7f7dc00689d0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f7dd415e450 tx=0x7f7dcc009040 comp rx=0 tx=0).stop 2023-10-08T06:09:47.513 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.512+0000 7f7ddbfd5700 1 -- 172.21.15.32:0/788767487 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7dd4070d30 msgr2=0x7f7dd40c53c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:47.513 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.512+0000 7f7ddbfd5700 1 --2- 172.21.15.32:0/788767487 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7dd4070d30 0x7f7dd40c53c0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f7dc400efc0 tx=0x7f7dc400c3a0 comp rx=0 tx=0).stop 2023-10-08T06:09:47.514 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.512+0000 7f7ddbfd5700 1 -- 172.21.15.32:0/788767487 shutdown_connections 2023-10-08T06:09:47.514 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.512+0000 7f7ddbfd5700 1 --2- 172.21.15.32:0/788767487 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f7dc0066510 0x7f7dc00689d0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:47.514 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.512+0000 7f7ddbfd5700 1 --2- 172.21.15.32:0/788767487 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7dd4070d30 0x7f7dd40c53c0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:47.514 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.512+0000 7f7ddbfd5700 1 --2- 172.21.15.32:0/788767487 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7dd40ca5f0 0x7f7dd414d290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:47.514 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.512+0000 7f7ddbfd5700 1 --2- 172.21.15.32:0/788767487 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7dd406c120 0x7f7dd40ae780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:47.514 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.512+0000 7f7ddbfd5700 1 -- 172.21.15.32:0/788767487 >> 172.21.15.32:0/788767487 conn(0x7f7dd40cee80 msgr2=0x7f7dd406d500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:09:47.514 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.512+0000 7f7ddbfd5700 1 -- 172.21.15.32:0/788767487 shutdown_connections 2023-10-08T06:09:47.514 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.512+0000 7f7ddbfd5700 1 -- 172.21.15.32:0/788767487 wait complete. 2023-10-08T06:09:47.530 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-08T06:09:47.646 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.644+0000 7f0515df3700 1 Processor -- start 2023-10-08T06:09:47.646 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.644+0000 7f0515df3700 1 -- start start 2023-10-08T06:09:47.648 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.644+0000 7f0515df3700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f051015d490 0x7f05100b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:47.648 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.644+0000 7f0515df3700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f05100d13d0 0x7f05100cddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:47.648 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.644+0000 7f0515df3700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f05100ce310 0x7f05100b4a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:47.648 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.644+0000 7f0515df3700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05100ce770 con 0x7f051015d490 2023-10-08T06:09:47.648 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.644+0000 7f0515df3700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05100d1bb0 con 0x7f05100ce310 2023-10-08T06:09:47.648 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.644+0000 7f0515df3700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05100d1e90 con 0x7f05100d13d0 2023-10-08T06:09:47.648 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.644+0000 7f0514df1700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f051015d490 0x7f05100b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:47.648 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.648+0000 7f050ffff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f05100d13d0 0x7f05100cddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:47.648 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.648+0000 7f05155f2700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f05100ce310 0x7f05100b4a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:47.648 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.648+0000 7f0514df1700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f051015d490 0x7f05100b8bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:59782/0 (socket says 172.21.15.32:59782) 2023-10-08T06:09:47.649 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.648+0000 7f0514df1700 1 -- 172.21.15.32:0/3614938734 learned_addr learned my addr 172.21.15.32:0/3614938734 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:09:47.650 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.648+0000 7f0514df1700 1 -- 172.21.15.32:0/3614938734 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f05100d13d0 msgr2=0x7f05100cddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:09:47.650 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.648+0000 7f0514df1700 1 --2- 172.21.15.32:0/3614938734 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f05100d13d0 0x7f05100cddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:47.650 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.648+0000 7f0514df1700 1 -- 172.21.15.32:0/3614938734 >> v2:172.21.15.40:3300/0 conn(0x7f05100ce310 msgr2=0x7f05100b4a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:09:47.651 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.648+0000 7f0514df1700 1 --2- 172.21.15.32:0/3614938734 >> v2:172.21.15.40:3300/0 conn(0x7f05100ce310 0x7f05100b4a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:47.651 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.648+0000 7f0514df1700 1 -- 172.21.15.32:0/3614938734 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05100d2170 con 0x7f051015d490 2023-10-08T06:09:47.651 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.648+0000 7f0514df1700 1 --2- 172.21.15.32:0/3614938734 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f051015d490 0x7f05100b8bc0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f051006d550 tx=0x7f0504009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c9607ec096c6d31 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:47.651 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.648+0000 7f050f7fe700 1 -- 172.21.15.32:0/3614938734 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0504011830 con 0x7f051015d490 2023-10-08T06:09:47.651 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.648+0000 7f050f7fe700 1 -- 172.21.15.32:0/3614938734 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0504011990 con 0x7f051015d490 2023-10-08T06:09:47.651 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.648+0000 7f050f7fe700 1 -- 172.21.15.32:0/3614938734 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0504011d20 con 0x7f051015d490 2023-10-08T06:09:47.651 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.648+0000 7f0515df3700 1 -- 172.21.15.32:0/3614938734 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f051015d490 msgr2=0x7f05100b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:47.651 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.648+0000 7f0515df3700 1 --2- 172.21.15.32:0/3614938734 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f051015d490 0x7f05100b8bc0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f051006d550 tx=0x7f0504009bf0 comp rx=0 tx=0).stop 2023-10-08T06:09:47.651 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.648+0000 7f0515df3700 1 -- 172.21.15.32:0/3614938734 shutdown_connections 2023-10-08T06:09:47.651 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.648+0000 7f0515df3700 1 --2- 172.21.15.32:0/3614938734 >> v2:172.21.15.40:3300/0 conn(0x7f05100ce310 0x7f05100b4a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:47.651 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.648+0000 7f0515df3700 1 --2- 172.21.15.32:0/3614938734 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f05100d13d0 0x7f05100cddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:47.652 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.648+0000 7f0515df3700 1 --2- 172.21.15.32:0/3614938734 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f051015d490 0x7f05100b8bc0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:47.652 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.648+0000 7f0515df3700 1 -- 172.21.15.32:0/3614938734 >> 172.21.15.32:0/3614938734 conn(0x7f051006ab40 msgr2=0x7f051006af20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:09:47.652 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.648+0000 7f0515df3700 1 -- 172.21.15.32:0/3614938734 shutdown_connections 2023-10-08T06:09:47.652 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.648+0000 7f0515df3700 1 -- 172.21.15.32:0/3614938734 wait complete. 2023-10-08T06:09:47.654 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.648+0000 7f0515df3700 1 Processor -- start 2023-10-08T06:09:47.654 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.648+0000 7f0515df3700 1 -- start start 2023-10-08T06:09:47.654 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.652+0000 7f0515df3700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f05100ce310 0x7f05100cdba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:47.654 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.652+0000 7f0515df3700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f05100d13d0 0x7f051015ed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:47.654 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.652+0000 7f0515df3700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f051015d490 0x7f051014fab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:47.654 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.652+0000 7f0515df3700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f051015f2c0 con 0x7f05100d13d0 2023-10-08T06:09:47.655 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.652+0000 7f0515df3700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f051015dd00 con 0x7f05100ce310 2023-10-08T06:09:47.655 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.652+0000 7f0515df3700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f051015dfe0 con 0x7f051015d490 2023-10-08T06:09:47.655 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.652+0000 7f050ffff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f05100d13d0 0x7f051015ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:47.655 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.652+0000 7f050ffff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f05100d13d0 0x7f051015ed80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:59788/0 (socket says 172.21.15.32:59788) 2023-10-08T06:09:47.655 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.652+0000 7f050ffff700 1 -- 172.21.15.32:0/3237797547 learned_addr learned my addr 172.21.15.32:0/3237797547 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:09:47.655 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.652+0000 7f05155f2700 1 --2- 172.21.15.32:0/3237797547 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f051015d490 0x7f051014fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:47.655 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.652+0000 7f0514df1700 1 --2- 172.21.15.32:0/3237797547 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f05100ce310 0x7f05100cdba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:47.655 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.652+0000 7f050ffff700 1 -- 172.21.15.32:0/3237797547 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f051015d490 msgr2=0x7f051014fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:47.655 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.652+0000 7f050ffff700 1 --2- 172.21.15.32:0/3237797547 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f051015d490 0x7f051014fab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:47.655 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.652+0000 7f050ffff700 1 -- 172.21.15.32:0/3237797547 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f05100ce310 msgr2=0x7f05100cdba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:47.655 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.652+0000 7f050ffff700 1 --2- 172.21.15.32:0/3237797547 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f05100ce310 0x7f05100cdba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:47.656 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.652+0000 7f050ffff700 1 -- 172.21.15.32:0/3237797547 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0504009570 con 0x7f05100d13d0 2023-10-08T06:09:47.656 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.652+0000 7f050ffff700 1 --2- 172.21.15.32:0/3237797547 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f05100d13d0 0x7f051015ed80 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f050000ebe0 tx=0x7f050000eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:47.656 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.652+0000 7f050d7fa700 1 -- 172.21.15.32:0/3237797547 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0500009740 con 0x7f05100d13d0 2023-10-08T06:09:47.656 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.652+0000 7f050d7fa700 1 -- 172.21.15.32:0/3237797547 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f050000c850 con 0x7f05100d13d0 2023-10-08T06:09:47.656 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.652+0000 7f0515df3700 1 -- 172.21.15.32:0/3237797547 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f051015e2c0 con 0x7f05100d13d0 2023-10-08T06:09:47.656 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.652+0000 7f050d7fa700 1 -- 172.21.15.32:0/3237797547 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f050000cbe0 con 0x7f05100d13d0 2023-10-08T06:09:47.657 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.652+0000 7f0515df3700 1 -- 172.21.15.32:0/3237797547 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f051014fff0 con 0x7f05100d13d0 2023-10-08T06:09:47.657 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.656+0000 7f0515df3700 1 -- 172.21.15.32:0/3237797547 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0510073f00 con 0x7f05100d13d0 2023-10-08T06:09:47.657 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.656+0000 7f050d7fa700 1 -- 172.21.15.32:0/3237797547 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f050000cd40 con 0x7f05100d13d0 2023-10-08T06:09:47.657 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.656+0000 7f050d7fa700 1 --2- 172.21.15.32:0/3237797547 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f04fc066510 0x7f04fc0689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:47.657 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.656+0000 7f050d7fa700 1 -- 172.21.15.32:0/3237797547 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0500083f40 con 0x7f05100d13d0 2023-10-08T06:09:47.657 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.656+0000 7f0514df1700 1 --2- 172.21.15.32:0/3237797547 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f04fc066510 0x7f04fc0689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:47.658 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.656+0000 7f0514df1700 1 --2- 172.21.15.32:0/3237797547 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f04fc066510 0x7f04fc0689d0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f0504000c00 tx=0x7f0504008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:47.664 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.664+0000 7f050d7fa700 1 -- 172.21.15.32:0/3237797547 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f05000512a0 con 0x7f05100d13d0 2023-10-08T06:09:47.825 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.824+0000 7f0515df3700 1 -- 172.21.15.32:0/3237797547 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f051015a280 con 0x7f05100d13d0 2023-10-08T06:09:47.826 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.824+0000 7f050d7fa700 1 -- 172.21.15.32:0/3237797547 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f05000548c0 con 0x7f05100d13d0 2023-10-08T06:09:47.826 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 64 2023-10-08T06:09:47.828 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.828+0000 7f0515df3700 1 -- 172.21.15.32:0/3237797547 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f04fc066510 msgr2=0x7f04fc0689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:47.828 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.828+0000 7f0515df3700 1 --2- 172.21.15.32:0/3237797547 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f04fc066510 0x7f04fc0689d0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f0504000c00 tx=0x7f0504008030 comp rx=0 tx=0).stop 2023-10-08T06:09:47.829 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.828+0000 7f0515df3700 1 -- 172.21.15.32:0/3237797547 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f05100d13d0 msgr2=0x7f051015ed80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:47.829 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.828+0000 7f0515df3700 1 --2- 172.21.15.32:0/3237797547 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f05100d13d0 0x7f051015ed80 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f050000ebe0 tx=0x7f050000eef0 comp rx=0 tx=0).stop 2023-10-08T06:09:47.829 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.828+0000 7f0515df3700 1 -- 172.21.15.32:0/3237797547 shutdown_connections 2023-10-08T06:09:47.829 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.828+0000 7f0515df3700 1 --2- 172.21.15.32:0/3237797547 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f04fc066510 0x7f04fc0689d0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:47.829 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.828+0000 7f0515df3700 1 --2- 172.21.15.32:0/3237797547 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f05100d13d0 0x7f051015ed80 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:47.829 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.828+0000 7f0515df3700 1 --2- 172.21.15.32:0/3237797547 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f051015d490 0x7f051014fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:47.829 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.828+0000 7f0515df3700 1 --2- 172.21.15.32:0/3237797547 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f05100ce310 0x7f05100cdba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:47.829 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.828+0000 7f0515df3700 1 -- 172.21.15.32:0/3237797547 >> 172.21.15.32:0/3237797547 conn(0x7f051006ab40 msgr2=0x7f05100cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:09:47.829 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.828+0000 7f0515df3700 1 -- 172.21.15.32:0/3237797547 shutdown_connections 2023-10-08T06:09:47.829 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.828+0000 7f0515df3700 1 -- 172.21.15.32:0/3237797547 wait complete. 2023-10-08T06:09:47.840 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T06:09:47.948 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.948+0000 7f0d12569700 1 Processor -- start 2023-10-08T06:09:47.949 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.948+0000 7f0d12569700 1 -- start start 2023-10-08T06:09:47.950 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.948+0000 7f0d12569700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f0d0c15d490 0x7f0d0c0b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:47.951 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.948+0000 7f0d12569700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0d0c0d13d0 0x7f0d0c0cddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:47.951 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.948+0000 7f0d12569700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d0c0ce770 con 0x7f0d0c0ce310 2023-10-08T06:09:47.951 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.948+0000 7f0d12569700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d0c0d1bb0 con 0x7f0d0c15d490 2023-10-08T06:09:47.951 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.948+0000 7f0d12569700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d0c0d1e90 con 0x7f0d0c0d13d0 2023-10-08T06:09:47.951 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.948+0000 7f0d11567700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f0d0c15d490 0x7f0d0c0b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:47.951 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.948+0000 7f0d11567700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f0d0c15d490 0x7f0d0c0b8bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:59790/0 (socket says 172.21.15.32:59790) 2023-10-08T06:09:47.951 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.948+0000 7f0d11567700 1 -- 172.21.15.32:0/220591653 learned_addr learned my addr 172.21.15.32:0/220591653 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:09:47.951 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.948+0000 7f0d10d66700 1 --2- 172.21.15.32:0/220591653 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0d0c0d13d0 0x7f0d0c0cddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:47.951 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.948+0000 7f0d11567700 1 -- 172.21.15.32:0/220591653 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0d0c0d13d0 msgr2=0x7f0d0c0cddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:09:47.951 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.948+0000 7f0d11567700 1 --2- 172.21.15.32:0/220591653 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0d0c0d13d0 0x7f0d0c0cddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:47.952 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.948+0000 7f0d11567700 1 -- 172.21.15.32:0/220591653 >> v1:172.21.15.40:6789/0 conn(0x7f0d0c0ce310 legacy=0x7f0d0c0b4a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:09:47.952 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.948+0000 7f0d11567700 1 -- 172.21.15.32:0/220591653 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d0c0d2170 con 0x7f0d0c15d490 2023-10-08T06:09:47.952 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.948+0000 7f0d11567700 1 --2- 172.21.15.32:0/220591653 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0d0c15d490 0x7f0d0c0b8bc0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f0d08009e50 tx=0x7f0d0800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7f421bcb9d89394 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:47.953 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.948+0000 7f0d03fff700 1 -- 172.21.15.32:0/220591653 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d0800e070 con 0x7f0d0c15d490 2023-10-08T06:09:47.953 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.948+0000 7f0d03fff700 1 -- 172.21.15.32:0/220591653 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d08003a40 con 0x7f0d0c15d490 2023-10-08T06:09:47.953 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.948+0000 7f0d03fff700 1 -- 172.21.15.32:0/220591653 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d08003df0 con 0x7f0d0c15d490 2023-10-08T06:09:47.953 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.952+0000 7f0d12569700 1 -- 172.21.15.32:0/220591653 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0d0c15d490 msgr2=0x7f0d0c0b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:47.953 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.952+0000 7f0d12569700 1 --2- 172.21.15.32:0/220591653 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0d0c15d490 0x7f0d0c0b8bc0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f0d08009e50 tx=0x7f0d0800b330 comp rx=0 tx=0).stop 2023-10-08T06:09:47.953 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.952+0000 7f0d12569700 1 -- 172.21.15.32:0/220591653 shutdown_connections 2023-10-08T06:09:47.953 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.952+0000 7f0d12569700 1 --2- 172.21.15.32:0/220591653 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0d0c0d13d0 0x7f0d0c0cddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:47.953 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.952+0000 7f0d12569700 1 --2- 172.21.15.32:0/220591653 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0d0c15d490 0x7f0d0c0b8bc0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:47.953 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.952+0000 7f0d12569700 1 -- 172.21.15.32:0/220591653 >> 172.21.15.32:0/220591653 conn(0x7f0d0c06ab40 msgr2=0x7f0d0c06af20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:09:47.953 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.952+0000 7f0d12569700 1 -- 172.21.15.32:0/220591653 shutdown_connections 2023-10-08T06:09:47.954 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.952+0000 7f0d12569700 1 -- 172.21.15.32:0/220591653 wait complete. 2023-10-08T06:09:47.954 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.952+0000 7f0d12569700 1 Processor -- start 2023-10-08T06:09:47.954 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.952+0000 7f0d12569700 1 -- start start 2023-10-08T06:09:47.957 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.956+0000 7f0d12569700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0d0c0ce310 0x7f0d0c0ca300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:47.957 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.956+0000 7f0d12569700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0d0c0d13d0 0x7f0d0c0ca840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:47.957 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.956+0000 7f0d12569700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0d0c15d490 0x7f0d0c150570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:47.957 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.956+0000 7f0d12569700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d0c142000 con 0x7f0d0c15d490 2023-10-08T06:09:47.957 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.956+0000 7f0d12569700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d0c1422e0 con 0x7f0d0c0d13d0 2023-10-08T06:09:47.957 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.956+0000 7f0d12569700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d0c1425c0 con 0x7f0d0c0ce310 2023-10-08T06:09:47.958 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.956+0000 7f0d11d68700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0d0c15d490 0x7f0d0c150570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:47.958 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.956+0000 7f0d11d68700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0d0c15d490 0x7f0d0c150570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:59792/0 (socket says 172.21.15.32:59792) 2023-10-08T06:09:47.958 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.956+0000 7f0d11d68700 1 -- 172.21.15.32:0/2755210033 learned_addr learned my addr 172.21.15.32:0/2755210033 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:09:47.958 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.956+0000 7f0d11567700 1 --2- 172.21.15.32:0/2755210033 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0d0c0ce310 0x7f0d0c0ca300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:47.958 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.956+0000 7f0d10d66700 1 --2- 172.21.15.32:0/2755210033 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0d0c0d13d0 0x7f0d0c0ca840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:47.958 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.956+0000 7f0d11d68700 1 -- 172.21.15.32:0/2755210033 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0d0c0ce310 msgr2=0x7f0d0c0ca300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:47.958 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.956+0000 7f0d11d68700 1 --2- 172.21.15.32:0/2755210033 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0d0c0ce310 0x7f0d0c0ca300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:47.958 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.956+0000 7f0d11d68700 1 -- 172.21.15.32:0/2755210033 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0d0c0d13d0 msgr2=0x7f0d0c0ca840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:47.958 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.956+0000 7f0d11d68700 1 --2- 172.21.15.32:0/2755210033 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0d0c0d13d0 0x7f0d0c0ca840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:47.958 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.956+0000 7f0d11d68700 1 -- 172.21.15.32:0/2755210033 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d08009b30 con 0x7f0d0c15d490 2023-10-08T06:09:47.958 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.956+0000 7f0d11d68700 1 --2- 172.21.15.32:0/2755210033 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0d0c15d490 0x7f0d0c150570 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f0d0400c470 tx=0x7f0d0400c780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:47.959 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.956+0000 7f0d01ffb700 1 -- 172.21.15.32:0/2755210033 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d04011790 con 0x7f0d0c15d490 2023-10-08T06:09:47.959 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.956+0000 7f0d01ffb700 1 -- 172.21.15.32:0/2755210033 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d040118f0 con 0x7f0d0c15d490 2023-10-08T06:09:47.959 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.956+0000 7f0d12569700 1 -- 172.21.15.32:0/2755210033 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d0c1428a0 con 0x7f0d0c15d490 2023-10-08T06:09:47.960 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.956+0000 7f0d01ffb700 1 -- 172.21.15.32:0/2755210033 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d04011ca0 con 0x7f0d0c15d490 2023-10-08T06:09:47.960 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.956+0000 7f0d12569700 1 -- 172.21.15.32:0/2755210033 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d0c0c5f70 con 0x7f0d0c15d490 2023-10-08T06:09:47.960 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.956+0000 7f0d12569700 1 -- 172.21.15.32:0/2755210033 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d0c142dc0 con 0x7f0d0c15d490 2023-10-08T06:09:47.960 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.960+0000 7f0d01ffb700 1 -- 172.21.15.32:0/2755210033 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f0d0401c460 con 0x7f0d0c15d490 2023-10-08T06:09:47.961 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.960+0000 7f0d01ffb700 1 --2- 172.21.15.32:0/2755210033 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f0cf0066510 0x7f0cf00689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:47.961 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.960+0000 7f0d01ffb700 1 -- 172.21.15.32:0/2755210033 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0d04083ac0 con 0x7f0d0c15d490 2023-10-08T06:09:47.961 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.960+0000 7f0d11567700 1 --2- 172.21.15.32:0/2755210033 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f0cf0066510 0x7f0cf00689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:47.962 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.960+0000 7f0d11567700 1 --2- 172.21.15.32:0/2755210033 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f0cf0066510 0x7f0cf00689d0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f0d08015040 tx=0x7f0d08009000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:47.969 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:47.968+0000 7f0d01ffb700 1 -- 172.21.15.32:0/2755210033 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f0d0c142dc0 con 0x7f0d0c15d490 2023-10-08T06:09:48.160 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.160+0000 7f0d12569700 1 -- 172.21.15.32:0/2755210033 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0d0c142dc0 con 0x7f0d0c15d490 2023-10-08T06:09:48.161 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.160+0000 7f0d01ffb700 1 -- 172.21.15.32:0/2755210033 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4907 (secure 0 0 0) 0x7f0d0c142dc0 con 0x7f0d0c15d490 2023-10-08T06:09:48.161 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:09:48.161 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6833/2405386193","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":2405386193},{"type":"v1","addr":"172.21.15.40:6833","nonce":2405386193}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4254,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6835/1810658720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6834","nonce":1810658720},{"type":"v1","addr":"172.21.15.32:6835","nonce":1810658720}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4257,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6837/2286934165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6836","nonce":2286934165},{"type":"v1","addr":"172.21.15.32:6837","nonce":2286934165}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T06:09:36.528026+0000","modified":"2023-10-08T06:09:38.533661+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4318},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4318":{"gid":4318,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.40:6835/3325966535","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":3325966535},{"type":"v1","addr":"172.21.15.40:6835","nonce":3325966535}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-08T06:09:48.163 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.160+0000 7f0d12569700 1 -- 172.21.15.32:0/2755210033 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f0cf0066510 msgr2=0x7f0cf00689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:48.163 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.160+0000 7f0d12569700 1 --2- 172.21.15.32:0/2755210033 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f0cf0066510 0x7f0cf00689d0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f0d08015040 tx=0x7f0d08009000 comp rx=0 tx=0).stop 2023-10-08T06:09:48.164 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.160+0000 7f0d12569700 1 -- 172.21.15.32:0/2755210033 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0d0c15d490 msgr2=0x7f0d0c150570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:48.164 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.160+0000 7f0d12569700 1 --2- 172.21.15.32:0/2755210033 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0d0c15d490 0x7f0d0c150570 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f0d0400c470 tx=0x7f0d0400c780 comp rx=0 tx=0).stop 2023-10-08T06:09:48.164 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.160+0000 7f0d12569700 1 -- 172.21.15.32:0/2755210033 shutdown_connections 2023-10-08T06:09:48.164 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.160+0000 7f0d12569700 1 --2- 172.21.15.32:0/2755210033 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f0cf0066510 0x7f0cf00689d0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:48.164 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.160+0000 7f0d12569700 1 --2- 172.21.15.32:0/2755210033 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0d0c15d490 0x7f0d0c150570 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:48.164 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.160+0000 7f0d12569700 1 --2- 172.21.15.32:0/2755210033 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0d0c0d13d0 0x7f0d0c0ca840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:48.164 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.160+0000 7f0d12569700 1 --2- 172.21.15.32:0/2755210033 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0d0c0ce310 0x7f0d0c0ca300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:48.164 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.160+0000 7f0d12569700 1 -- 172.21.15.32:0/2755210033 >> 172.21.15.32:0/2755210033 conn(0x7f0d0c06ab40 msgr2=0x7f0d0c15a880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:09:48.164 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.160+0000 7f0d12569700 1 -- 172.21.15.32:0/2755210033 shutdown_connections 2023-10-08T06:09:48.164 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.160+0000 7f0d12569700 1 -- 172.21.15.32:0/2755210033 wait complete. 2023-10-08T06:09:48.165 INFO:teuthology.orchestra.run.smithi032.stderr:dumped fsmap epoch 6 2023-10-08T06:09:48.175 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T06:09:48.286 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.284+0000 7f43cd437700 1 Processor -- start 2023-10-08T06:09:48.286 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.284+0000 7f43cd437700 1 -- start start 2023-10-08T06:09:48.287 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.284+0000 7f43cd437700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f43c815d490 0x7f43c80b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:48.287 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.284+0000 7f43cd437700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f43c80d13d0 0x7f43c80cddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:48.287 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.284+0000 7f43cd437700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43c80d1bb0 con 0x7f43c80ce310 2023-10-08T06:09:48.287 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.284+0000 7f43cd437700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43c80ce7a0 con 0x7f43c815d490 2023-10-08T06:09:48.288 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.284+0000 7f43cd437700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43c80d1e90 con 0x7f43c80d13d0 2023-10-08T06:09:48.288 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.284+0000 7f43c7fff700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f43c815d490 0x7f43c80b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:48.288 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.284+0000 7f43c7fff700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f43c815d490 0x7f43c80b8bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:59804/0 (socket says 172.21.15.32:59804) 2023-10-08T06:09:48.288 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.284+0000 7f43c7fff700 1 -- 172.21.15.32:0/2721892216 learned_addr learned my addr 172.21.15.32:0/2721892216 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:09:48.288 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.284+0000 7f43c77fe700 1 --2- 172.21.15.32:0/2721892216 >> v2:172.21.15.40:3300/0 conn(0x7f43c80d13d0 0x7f43c80cddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:48.290 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.288+0000 7f43c7fff700 1 -- 172.21.15.32:0/2721892216 >> v2:172.21.15.40:3300/0 conn(0x7f43c80d13d0 msgr2=0x7f43c80cddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:09:48.290 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.288+0000 7f43c7fff700 1 --2- 172.21.15.32:0/2721892216 >> v2:172.21.15.40:3300/0 conn(0x7f43c80d13d0 0x7f43c80cddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:48.290 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.288+0000 7f43c7fff700 1 -- 172.21.15.32:0/2721892216 >> v1:172.21.15.40:6789/0 conn(0x7f43c80ce310 legacy=0x7f43c80b4a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:48.290 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.288+0000 7f43c7fff700 1 -- 172.21.15.32:0/2721892216 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43c80d2170 con 0x7f43c815d490 2023-10-08T06:09:48.290 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.288+0000 7f43c77fe700 1 --2- 172.21.15.32:0/2721892216 >> v2:172.21.15.40:3300/0 conn(0x7f43c80d13d0 0x7f43c80cddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T06:09:48.290 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.288+0000 7f43c7fff700 1 --2- 172.21.15.32:0/2721892216 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f43c815d490 0x7f43c80b8bc0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f43c806bbc0 tx=0x7f43b8009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9875169ffca25d9 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:48.291 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.288+0000 7f43c6ffd700 1 -- 172.21.15.32:0/2721892216 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43b800b8a0 con 0x7f43c815d490 2023-10-08T06:09:48.291 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.288+0000 7f43c6ffd700 1 -- 172.21.15.32:0/2721892216 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43b800ba00 con 0x7f43c815d490 2023-10-08T06:09:48.291 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.288+0000 7f43c6ffd700 1 -- 172.21.15.32:0/2721892216 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43b800bd90 con 0x7f43c815d490 2023-10-08T06:09:48.291 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.288+0000 7f43cd437700 1 -- 172.21.15.32:0/2721892216 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f43c815d490 msgr2=0x7f43c80b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:48.291 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.288+0000 7f43cd437700 1 --2- 172.21.15.32:0/2721892216 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f43c815d490 0x7f43c80b8bc0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f43c806bbc0 tx=0x7f43b8009bf0 comp rx=0 tx=0).stop 2023-10-08T06:09:48.291 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.288+0000 7f43cd437700 1 -- 172.21.15.32:0/2721892216 shutdown_connections 2023-10-08T06:09:48.291 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.288+0000 7f43cd437700 1 --2- 172.21.15.32:0/2721892216 >> v2:172.21.15.40:3300/0 conn(0x7f43c80d13d0 0x7f43c80cddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:48.291 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.288+0000 7f43cd437700 1 --2- 172.21.15.32:0/2721892216 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f43c815d490 0x7f43c80b8bc0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:48.291 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.288+0000 7f43cd437700 1 -- 172.21.15.32:0/2721892216 >> 172.21.15.32:0/2721892216 conn(0x7f43c806ab40 msgr2=0x7f43c806af20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:09:48.291 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.288+0000 7f43cd437700 1 -- 172.21.15.32:0/2721892216 shutdown_connections 2023-10-08T06:09:48.292 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.288+0000 7f43cd437700 1 -- 172.21.15.32:0/2721892216 wait complete. 2023-10-08T06:09:48.293 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.288+0000 7f43cd437700 1 Processor -- start 2023-10-08T06:09:48.294 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.288+0000 7f43cd437700 1 -- start start 2023-10-08T06:09:48.294 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.292+0000 7f43cd437700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f43c80ce310 0x7f43c8147670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:48.294 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.292+0000 7f43cd437700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f43c80d13d0 0x7f43c815c270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:48.294 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.292+0000 7f43cd437700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f43c815d490 0x7f43c815c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:48.294 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.292+0000 7f43cd437700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43c8148000 con 0x7f43c80d13d0 2023-10-08T06:09:48.294 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.292+0000 7f43cd437700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43c8142290 con 0x7f43c80ce310 2023-10-08T06:09:48.294 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.292+0000 7f43cd437700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43c815f540 con 0x7f43c815d490 2023-10-08T06:09:48.294 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.292+0000 7f43c77fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f43c80d13d0 0x7f43c815c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:48.294 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.292+0000 7f43c77fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f43c80d13d0 0x7f43c815c270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:59806/0 (socket says 172.21.15.32:59806) 2023-10-08T06:09:48.295 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.292+0000 7f43c77fe700 1 -- 172.21.15.32:0/3257202583 learned_addr learned my addr 172.21.15.32:0/3257202583 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:09:48.295 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.292+0000 7f43ccc36700 1 --2- 172.21.15.32:0/3257202583 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f43c815d490 0x7f43c815c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:48.295 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.292+0000 7f43c7fff700 1 --2- 172.21.15.32:0/3257202583 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f43c80ce310 0x7f43c8147670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:48.295 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.292+0000 7f43c77fe700 1 -- 172.21.15.32:0/3257202583 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f43c815d490 msgr2=0x7f43c815c7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:48.295 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.292+0000 7f43c77fe700 1 --2- 172.21.15.32:0/3257202583 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f43c815d490 0x7f43c815c7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:48.295 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.292+0000 7f43c77fe700 1 -- 172.21.15.32:0/3257202583 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f43c80ce310 msgr2=0x7f43c8147670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:48.295 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.292+0000 7f43c77fe700 1 --2- 172.21.15.32:0/3257202583 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f43c80ce310 0x7f43c8147670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:48.295 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.292+0000 7f43c77fe700 1 -- 172.21.15.32:0/3257202583 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43b8009570 con 0x7f43c80d13d0 2023-10-08T06:09:48.295 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.292+0000 7f43c77fe700 1 --2- 172.21.15.32:0/3257202583 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f43c80d13d0 0x7f43c815c270 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f43b000e760 tx=0x7f43b000eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:48.295 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.292+0000 7f43c4ff9700 1 -- 172.21.15.32:0/3257202583 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43b0004230 con 0x7f43c80d13d0 2023-10-08T06:09:48.295 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.292+0000 7f43c4ff9700 1 -- 172.21.15.32:0/3257202583 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43b00043b0 con 0x7f43c80d13d0 2023-10-08T06:09:48.296 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.292+0000 7f43cd437700 1 -- 172.21.15.32:0/3257202583 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43c815f820 con 0x7f43c80d13d0 2023-10-08T06:09:48.296 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.292+0000 7f43c4ff9700 1 -- 172.21.15.32:0/3257202583 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43b00036c0 con 0x7f43c80d13d0 2023-10-08T06:09:48.296 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.292+0000 7f43cd437700 1 -- 172.21.15.32:0/3257202583 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43c8141f20 con 0x7f43c80d13d0 2023-10-08T06:09:48.297 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.292+0000 7f43c4ff9700 1 -- 172.21.15.32:0/3257202583 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f43b0003820 con 0x7f43c80d13d0 2023-10-08T06:09:48.297 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.296+0000 7f43cd437700 1 -- 172.21.15.32:0/3257202583 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43c8073f00 con 0x7f43c80d13d0 2023-10-08T06:09:48.297 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.296+0000 7f43c4ff9700 1 --2- 172.21.15.32:0/3257202583 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f43a8066510 0x7f43a80689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:48.297 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.296+0000 7f43c4ff9700 1 -- 172.21.15.32:0/3257202583 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f43b0083a90 con 0x7f43c80d13d0 2023-10-08T06:09:48.297 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.296+0000 7f43c7fff700 1 --2- 172.21.15.32:0/3257202583 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f43a8066510 0x7f43a80689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:48.297 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.296+0000 7f43c7fff700 1 --2- 172.21.15.32:0/3257202583 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f43a8066510 0x7f43a80689d0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f43b8000c00 tx=0x7f43b8008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:48.305 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.304+0000 7f43c4ff9700 1 -- 172.21.15.32:0/3257202583 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f43b0050e00 con 0x7f43c80d13d0 2023-10-08T06:09:48.466 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.464+0000 7f43cd437700 1 -- 172.21.15.32:0/3257202583 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f43c806b170 con 0x7f43c80d13d0 2023-10-08T06:09:48.469 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.468+0000 7f43c4ff9700 1 -- 172.21.15.32:0/3257202583 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16445 (secure 0 0 0) 0x7f43b0054420 con 0x7f43c80d13d0 2023-10-08T06:09:48.469 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:09:48.469 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":22,"fsid":"ac672d87-96ae-41e0-9314-623ba2cdbbba","created":"2023-10-08T06:09:11.175626+0000","modified":"2023-10-08T06:09:38.153256+0000","last_up_change":"2023-10-08T06:09:22.744643+0000","last_in_change":"2023-10-08T06:09:14.131580+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T06:09:23.307843+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T06:09:34.295012+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T06:09:35.515590+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"43433f0c-9592-4874-92d7-10f8f4acf07f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":587888964},{"type":"v1","addr":"172.21.15.32:6801","nonce":587888964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":587888964},{"type":"v1","addr":"172.21.15.32:6803","nonce":587888964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":587888964},{"type":"v1","addr":"172.21.15.32:6810","nonce":587888964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6805","nonce":587888964},{"type":"v1","addr":"172.21.15.32:6807","nonce":587888964}]},"public_addr":"172.21.15.32:6801/587888964","cluster_addr":"172.21.15.32:6803/587888964","heartbeat_back_addr":"172.21.15.32:6810/587888964","heartbeat_front_addr":"172.21.15.32:6807/587888964","state":["exists","up"]},{"osd":1,"uuid":"2ecb1008-b987-4ce7-b646-6cded55fc8d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":990576767},{"type":"v1","addr":"172.21.15.32:6817","nonce":990576767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":990576767},{"type":"v1","addr":"172.21.15.32:6819","nonce":990576767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":990576767},{"type":"v1","addr":"172.21.15.32:6823","nonce":990576767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":990576767},{"type":"v1","addr":"172.21.15.32:6821","nonce":990576767}]},"public_addr":"172.21.15.32:6817/990576767","cluster_addr":"172.21.15.32:6819/990576767","heartbeat_back_addr":"172.21.15.32:6823/990576767","heartbeat_front_addr":"172.21.15.32:6821/990576767","state":["exists","up"]},{"osd":2,"uuid":"1b131c94-c09b-4e80-8746-bf1b7bac362d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6824","nonce":1566874440},{"type":"v1","addr":"172.21.15.32:6825","nonce":1566874440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":1566874440},{"type":"v1","addr":"172.21.15.32:6827","nonce":1566874440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":1566874440},{"type":"v1","addr":"172.21.15.32:6831","nonce":1566874440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":1566874440},{"type":"v1","addr":"172.21.15.32:6829","nonce":1566874440}]},"public_addr":"172.21.15.32:6825/1566874440","cluster_addr":"172.21.15.32:6827/1566874440","heartbeat_back_addr":"172.21.15.32:6831/1566874440","heartbeat_front_addr":"172.21.15.32:6829/1566874440","state":["exists","up"]},{"osd":3,"uuid":"ad655af2-1f6f-4689-b21d-b07bbaeb68b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":3672614802},{"type":"v1","addr":"172.21.15.32:6806","nonce":3672614802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6809","nonce":3672614802},{"type":"v1","addr":"172.21.15.32:6811","nonce":3672614802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":3672614802},{"type":"v1","addr":"172.21.15.32:6815","nonce":3672614802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":3672614802},{"type":"v1","addr":"172.21.15.32:6813","nonce":3672614802}]},"public_addr":"172.21.15.32:6806/3672614802","cluster_addr":"172.21.15.32:6811/3672614802","heartbeat_back_addr":"172.21.15.32:6815/3672614802","heartbeat_front_addr":"172.21.15.32:6813/3672614802","state":["exists","up"]},{"osd":4,"uuid":"64a543a1-8c4f-458e-9aba-b35c1cd7dd03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":3369928244},{"type":"v1","addr":"172.21.15.40:6801","nonce":3369928244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":3369928244},{"type":"v1","addr":"172.21.15.40:6803","nonce":3369928244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":3369928244},{"type":"v1","addr":"172.21.15.40:6807","nonce":3369928244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":3369928244},{"type":"v1","addr":"172.21.15.40:6805","nonce":3369928244}]},"public_addr":"172.21.15.40:6801/3369928244","cluster_addr":"172.21.15.40:6803/3369928244","heartbeat_back_addr":"172.21.15.40:6807/3369928244","heartbeat_front_addr":"172.21.15.40:6805/3369928244","state":["exists","up"]},{"osd":5,"uuid":"0fef3e54-edb4-4678-878e-944663c51638","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":2395850297},{"type":"v1","addr":"172.21.15.40:6825","nonce":2395850297}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":2395850297},{"type":"v1","addr":"172.21.15.40:6827","nonce":2395850297}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":2395850297},{"type":"v1","addr":"172.21.15.40:6831","nonce":2395850297}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":2395850297},{"type":"v1","addr":"172.21.15.40:6829","nonce":2395850297}]},"public_addr":"172.21.15.40:6825/2395850297","cluster_addr":"172.21.15.40:6827/2395850297","heartbeat_back_addr":"172.21.15.40:6831/2395850297","heartbeat_front_addr":"172.21.15.40:6829/2395850297","state":["exists","up"]},{"osd":6,"uuid":"2eeb0472-6096-469d-9b2c-cab4bf41c31a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":4145283410},{"type":"v1","addr":"172.21.15.40:6809","nonce":4145283410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":4145283410},{"type":"v1","addr":"172.21.15.40:6811","nonce":4145283410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":4145283410},{"type":"v1","addr":"172.21.15.40:6815","nonce":4145283410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":4145283410},{"type":"v1","addr":"172.21.15.40:6813","nonce":4145283410}]},"public_addr":"172.21.15.40:6809/4145283410","cluster_addr":"172.21.15.40:6811/4145283410","heartbeat_back_addr":"172.21.15.40:6815/4145283410","heartbeat_front_addr":"172.21.15.40:6813/4145283410","state":["exists","up"]},{"osd":7,"uuid":"cf76e4c7-96a6-401f-a280-91aad4641940","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":2943297416},{"type":"v1","addr":"172.21.15.40:6817","nonce":2943297416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":2943297416},{"type":"v1","addr":"172.21.15.40:6819","nonce":2943297416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":2943297416},{"type":"v1","addr":"172.21.15.40:6823","nonce":2943297416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":2943297416},{"type":"v1","addr":"172.21.15.40:6821","nonce":2943297416}]},"public_addr":"172.21.15.40:6817/2943297416","cluster_addr":"172.21.15.40:6819/2943297416","heartbeat_back_addr":"172.21.15.40:6823/2943297416","heartbeat_front_addr":"172.21.15.40:6821/2943297416","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.411475+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.628841+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.599055+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.166100+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.384135+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.488403+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.307648+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.363541+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T06:09:48.474 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.468+0000 7f43cd437700 1 -- 172.21.15.32:0/3257202583 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f43a8066510 msgr2=0x7f43a80689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:48.474 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.468+0000 7f43cd437700 1 --2- 172.21.15.32:0/3257202583 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f43a8066510 0x7f43a80689d0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f43b8000c00 tx=0x7f43b8008030 comp rx=0 tx=0).stop 2023-10-08T06:09:48.475 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.468+0000 7f43cd437700 1 -- 172.21.15.32:0/3257202583 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f43c80d13d0 msgr2=0x7f43c815c270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:48.475 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.468+0000 7f43cd437700 1 --2- 172.21.15.32:0/3257202583 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f43c80d13d0 0x7f43c815c270 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f43b000e760 tx=0x7f43b000eb20 comp rx=0 tx=0).stop 2023-10-08T06:09:48.475 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.468+0000 7f43cd437700 1 -- 172.21.15.32:0/3257202583 shutdown_connections 2023-10-08T06:09:48.475 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.468+0000 7f43cd437700 1 --2- 172.21.15.32:0/3257202583 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f43a8066510 0x7f43a80689d0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:48.475 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.468+0000 7f43cd437700 1 --2- 172.21.15.32:0/3257202583 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f43c80d13d0 0x7f43c815c270 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:48.475 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.468+0000 7f43cd437700 1 --2- 172.21.15.32:0/3257202583 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f43c815d490 0x7f43c815c7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:48.475 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.472+0000 7f43cd437700 1 --2- 172.21.15.32:0/3257202583 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f43c80ce310 0x7f43c8147670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:48.475 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.472+0000 7f43cd437700 1 -- 172.21.15.32:0/3257202583 >> 172.21.15.32:0/3257202583 conn(0x7f43c806ab40 msgr2=0x7f43c815ab40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:09:48.475 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.472+0000 7f43cd437700 1 -- 172.21.15.32:0/3257202583 shutdown_connections 2023-10-08T06:09:48.475 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.472+0000 7f43cd437700 1 -- 172.21.15.32:0/3257202583 wait complete. 2023-10-08T06:09:48.484 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T06:09:23.307843+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-08T06:09:34.295012+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-08T06:09:35.515590+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-08T06:09:48.484 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T06:09:48.605 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.604+0000 7f969d323700 1 Processor -- start 2023-10-08T06:09:48.606 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.604+0000 7f969d323700 1 -- start start 2023-10-08T06:09:48.608 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.604+0000 7f969d323700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f96981597f0 0x7f96980ce190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:48.608 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.604+0000 7f969d323700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f969806c6d0 0x7f96980c9b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:48.608 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.604+0000 7f969d323700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96980cd290 con 0x7f9698159bd0 2023-10-08T06:09:48.608 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.604+0000 7f969d323700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96980cec10 con 0x7f96981597f0 2023-10-08T06:09:48.608 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.604+0000 7f969d323700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96980cc9a0 con 0x7f969806c6d0 2023-10-08T06:09:48.608 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.604+0000 7f9697fff700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f96981597f0 0x7f96980ce190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:48.608 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.604+0000 7f96977fe700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f9698159bd0 0x7f96980cd720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:46262/0 (socket says 172.21.15.32:46262) 2023-10-08T06:09:48.609 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.604+0000 7f96977fe700 1 -- 172.21.15.32:0/90989650 learned_addr learned my addr 172.21.15.32:0/90989650 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-08T06:09:48.609 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.608+0000 7f969cb22700 1 --2- 172.21.15.32:0/90989650 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f969806c6d0 0x7f96980c9b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:48.609 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.608+0000 7f9697fff700 1 -- 172.21.15.32:0/90989650 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f969806c6d0 msgr2=0x7f96980c9b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:09:48.609 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.608+0000 7f9697fff700 1 --2- 172.21.15.32:0/90989650 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f969806c6d0 0x7f96980c9b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:48.609 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.608+0000 7f9697fff700 1 -- 172.21.15.32:0/90989650 >> v1:172.21.15.32:6789/0 conn(0x7f9698159bd0 legacy=0x7f96980cd720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:48.609 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.608+0000 7f9697fff700 1 -- 172.21.15.32:0/90989650 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f969806ce00 con 0x7f96981597f0 2023-10-08T06:09:48.609 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.608+0000 7f969cb22700 1 --2- 172.21.15.32:0/90989650 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f969806c6d0 0x7f96980c9b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T06:09:48.609 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.608+0000 7f9697fff700 1 --2- 172.21.15.32:0/90989650 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f96981597f0 0x7f96980ce190 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f968800a9f0 tx=0x7f968800ad00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2890647d9d29f1af server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:48.611 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.608+0000 7f9696ffd700 1 -- 172.21.15.32:0/90989650 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f968800cb70 con 0x7f96981597f0 2023-10-08T06:09:48.611 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.608+0000 7f9696ffd700 1 -- 172.21.15.32:0/90989650 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f968800ccd0 con 0x7f96981597f0 2023-10-08T06:09:48.611 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.608+0000 7f9696ffd700 1 -- 172.21.15.32:0/90989650 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9688018620 con 0x7f96981597f0 2023-10-08T06:09:48.611 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.608+0000 7f969d323700 1 -- 172.21.15.32:0/90989650 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f96981597f0 msgr2=0x7f96980ce190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:48.611 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.608+0000 7f969d323700 1 --2- 172.21.15.32:0/90989650 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f96981597f0 0x7f96980ce190 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f968800a9f0 tx=0x7f968800ad00 comp rx=0 tx=0).stop 2023-10-08T06:09:48.611 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.608+0000 7f969d323700 1 -- 172.21.15.32:0/90989650 shutdown_connections 2023-10-08T06:09:48.611 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.608+0000 7f969d323700 1 --2- 172.21.15.32:0/90989650 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f969806c6d0 0x7f96980c9b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:48.611 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.608+0000 7f969d323700 1 --2- 172.21.15.32:0/90989650 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f96981597f0 0x7f96980ce190 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:48.611 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.608+0000 7f969d323700 1 -- 172.21.15.32:0/90989650 >> 172.21.15.32:0/90989650 conn(0x7f96980b0900 msgr2=0x7f96980b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:09:48.611 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.608+0000 7f969d323700 1 -- 172.21.15.32:0/90989650 shutdown_connections 2023-10-08T06:09:48.612 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.608+0000 7f969d323700 1 -- 172.21.15.32:0/90989650 wait complete. 2023-10-08T06:09:48.612 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.608+0000 7f969d323700 1 Processor -- start 2023-10-08T06:09:48.612 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.608+0000 7f969d323700 1 -- start start 2023-10-08T06:09:48.613 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.608+0000 7f969d323700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f969806c6d0 0x7f96980b3c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:48.613 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.608+0000 7f969d323700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f96981597f0 0x7f969815d550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:48.614 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.608+0000 7f969d323700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9698159bd0 0x7f969815da90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:48.614 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.608+0000 7f969d323700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96981557a0 con 0x7f9698159bd0 2023-10-08T06:09:48.614 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.608+0000 7f969d323700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96981559f0 con 0x7f969806c6d0 2023-10-08T06:09:48.614 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.608+0000 7f969d323700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9698155cd0 con 0x7f96981597f0 2023-10-08T06:09:48.614 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.608+0000 7f969cb22700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9698159bd0 0x7f969815da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:48.614 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.612+0000 7f969cb22700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9698159bd0 0x7f969815da90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:59830/0 (socket says 172.21.15.32:59830) 2023-10-08T06:09:48.614 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.612+0000 7f96977fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f96981597f0 0x7f969815d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:48.614 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.612+0000 7f969cb22700 1 -- 172.21.15.32:0/2777668444 learned_addr learned my addr 172.21.15.32:0/2777668444 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:09:48.614 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.612+0000 7f9697fff700 1 --2- 172.21.15.32:0/2777668444 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f969806c6d0 0x7f96980b3c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:48.614 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.612+0000 7f969cb22700 1 -- 172.21.15.32:0/2777668444 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f96981597f0 msgr2=0x7f969815d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:48.614 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.612+0000 7f969cb22700 1 --2- 172.21.15.32:0/2777668444 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f96981597f0 0x7f969815d550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:48.615 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.612+0000 7f969cb22700 1 -- 172.21.15.32:0/2777668444 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f969806c6d0 msgr2=0x7f96980b3c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:48.615 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.612+0000 7f969cb22700 1 --2- 172.21.15.32:0/2777668444 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f969806c6d0 0x7f96980b3c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:48.615 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.612+0000 7f969cb22700 1 -- 172.21.15.32:0/2777668444 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f968800a650 con 0x7f9698159bd0 2023-10-08T06:09:48.615 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.612+0000 7f969cb22700 1 --2- 172.21.15.32:0/2777668444 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9698159bd0 0x7f969815da90 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f9690007ef0 tx=0x7f969000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:48.615 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.612+0000 7f9694ff9700 1 -- 172.21.15.32:0/2777668444 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f969000dd80 con 0x7f9698159bd0 2023-10-08T06:09:48.615 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.612+0000 7f9694ff9700 1 -- 172.21.15.32:0/2777668444 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f969000f040 con 0x7f9698159bd0 2023-10-08T06:09:48.615 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.612+0000 7f9694ff9700 1 -- 172.21.15.32:0/2777668444 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9690003c80 con 0x7f9698159bd0 2023-10-08T06:09:48.615 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.612+0000 7f969d323700 1 -- 172.21.15.32:0/2777668444 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9698155fb0 con 0x7f9698159bd0 2023-10-08T06:09:48.615 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.612+0000 7f969d323700 1 -- 172.21.15.32:0/2777668444 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9698156570 con 0x7f9698159bd0 2023-10-08T06:09:48.616 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.612+0000 7f969d323700 1 -- 172.21.15.32:0/2777668444 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9698156790 con 0x7f9698159bd0 2023-10-08T06:09:48.616 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.612+0000 7f9694ff9700 1 -- 172.21.15.32:0/2777668444 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f9690004030 con 0x7f9698159bd0 2023-10-08T06:09:48.616 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.616+0000 7f9694ff9700 1 --2- 172.21.15.32:0/2777668444 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f9678066510 0x7f96780689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:48.616 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.616+0000 7f9694ff9700 1 -- 172.21.15.32:0/2777668444 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9690083e70 con 0x7f9698159bd0 2023-10-08T06:09:48.616 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.616+0000 7f9697fff700 1 --2- 172.21.15.32:0/2777668444 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f9678066510 0x7f96780689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:48.617 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.616+0000 7f9697fff700 1 --2- 172.21.15.32:0/2777668444 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f9678066510 0x7f96780689d0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f9688000c00 tx=0x7f968801b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:48.622 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.620+0000 7f9694ff9700 1 -- 172.21.15.32:0/2777668444 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f96900512f0 con 0x7f9698159bd0 2023-10-08T06:09:48.780 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.780+0000 7f969d323700 1 -- 172.21.15.32:0/2777668444 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9698073f00 con 0x7f9698159bd0 2023-10-08T06:09:48.780 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.780+0000 7f9694ff9700 1 -- 172.21.15.32:0/2777668444 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9690054910 con 0x7f9698159bd0 2023-10-08T06:09:48.781 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 1 2023-10-08T06:09:48.783 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.780+0000 7f969d323700 1 -- 172.21.15.32:0/2777668444 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f9678066510 msgr2=0x7f96780689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:48.783 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.780+0000 7f969d323700 1 --2- 172.21.15.32:0/2777668444 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f9678066510 0x7f96780689d0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f9688000c00 tx=0x7f968801b040 comp rx=0 tx=0).stop 2023-10-08T06:09:48.783 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.780+0000 7f969d323700 1 -- 172.21.15.32:0/2777668444 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9698159bd0 msgr2=0x7f969815da90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:48.783 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.780+0000 7f969d323700 1 --2- 172.21.15.32:0/2777668444 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9698159bd0 0x7f969815da90 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f9690007ef0 tx=0x7f969000d3b0 comp rx=0 tx=0).stop 2023-10-08T06:09:48.783 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.780+0000 7f969d323700 1 -- 172.21.15.32:0/2777668444 shutdown_connections 2023-10-08T06:09:48.783 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.780+0000 7f969d323700 1 --2- 172.21.15.32:0/2777668444 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f9678066510 0x7f96780689d0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:48.783 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.780+0000 7f969d323700 1 --2- 172.21.15.32:0/2777668444 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9698159bd0 0x7f969815da90 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:48.783 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.780+0000 7f969d323700 1 --2- 172.21.15.32:0/2777668444 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f96981597f0 0x7f969815d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:48.783 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.780+0000 7f969d323700 1 --2- 172.21.15.32:0/2777668444 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f969806c6d0 0x7f96980b3c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:48.783 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.780+0000 7f969d323700 1 -- 172.21.15.32:0/2777668444 >> 172.21.15.32:0/2777668444 conn(0x7f96980b0900 msgr2=0x7f96980713e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:09:48.784 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.780+0000 7f969d323700 1 -- 172.21.15.32:0/2777668444 shutdown_connections 2023-10-08T06:09:48.784 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.780+0000 7f969d323700 1 -- 172.21.15.32:0/2777668444 wait complete. 2023-10-08T06:09:48.794 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-08T06:09:48.918 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.916+0000 7fd667fff700 1 Processor -- start 2023-10-08T06:09:48.918 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.916+0000 7fd667fff700 1 -- start start 2023-10-08T06:09:48.919 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.916+0000 7fd667fff700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fd66815d5a0 0x7fd6680cfb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:48.919 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.916+0000 7fd667fff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd66815d980 0x7fd6680d0060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:48.919 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.916+0000 7fd667fff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6681621b0 con 0x7fd6680b2600 2023-10-08T06:09:48.919 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.916+0000 7fd667fff700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd668161630 con 0x7fd66815d5a0 2023-10-08T06:09:48.919 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.916+0000 7fd667fff700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd668161910 con 0x7fd66815d980 2023-10-08T06:09:48.919 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.916+0000 7fd666ffd700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fd66815d5a0 0x7fd6680cfb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:48.920 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.916+0000 7fd666ffd700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fd66815d5a0 0x7fd6680cfb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:59838/0 (socket says 172.21.15.32:59838) 2023-10-08T06:09:48.920 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.916+0000 7fd666ffd700 1 -- 172.21.15.32:0/3862810088 learned_addr learned my addr 172.21.15.32:0/3862810088 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:09:48.920 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.916+0000 7fd6667fc700 1 --2- 172.21.15.32:0/3862810088 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd66815d980 0x7fd6680d0060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:48.921 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.920+0000 7fd666ffd700 1 -- 172.21.15.32:0/3862810088 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd66815d980 msgr2=0x7fd6680d0060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:09:48.921 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.920+0000 7fd666ffd700 1 --2- 172.21.15.32:0/3862810088 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd66815d980 0x7fd6680d0060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:48.921 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.920+0000 7fd666ffd700 1 -- 172.21.15.32:0/3862810088 >> v1:172.21.15.40:6789/0 conn(0x7fd6680b2600 legacy=0x7fd6680b4b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:48.921 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.920+0000 7fd666ffd700 1 -- 172.21.15.32:0/3862810088 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd668161bf0 con 0x7fd66815d5a0 2023-10-08T06:09:48.921 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.920+0000 7fd666ffd700 1 --2- 172.21.15.32:0/3862810088 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd66815d5a0 0x7fd6680cfb20 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fd65c009910 tx=0x7fd65c009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51844b05c2a31bf3 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:48.921 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.920+0000 7fd665ffb700 1 -- 172.21.15.32:0/3862810088 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd65c011830 con 0x7fd66815d5a0 2023-10-08T06:09:48.921 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.920+0000 7fd665ffb700 1 -- 172.21.15.32:0/3862810088 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd65c011990 con 0x7fd66815d5a0 2023-10-08T06:09:48.921 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.920+0000 7fd665ffb700 1 -- 172.21.15.32:0/3862810088 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd65c011d40 con 0x7fd66815d5a0 2023-10-08T06:09:48.922 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.920+0000 7fd667fff700 1 -- 172.21.15.32:0/3862810088 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd66815d5a0 msgr2=0x7fd6680cfb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:48.922 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.920+0000 7fd667fff700 1 --2- 172.21.15.32:0/3862810088 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd66815d5a0 0x7fd6680cfb20 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fd65c009910 tx=0x7fd65c009c20 comp rx=0 tx=0).stop 2023-10-08T06:09:48.922 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.920+0000 7fd667fff700 1 -- 172.21.15.32:0/3862810088 shutdown_connections 2023-10-08T06:09:48.922 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.920+0000 7fd667fff700 1 --2- 172.21.15.32:0/3862810088 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd66815d980 0x7fd6680d0060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:48.923 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.920+0000 7fd667fff700 1 --2- 172.21.15.32:0/3862810088 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd66815d5a0 0x7fd6680cfb20 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:48.923 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.920+0000 7fd667fff700 1 -- 172.21.15.32:0/3862810088 >> 172.21.15.32:0/3862810088 conn(0x7fd66806aca0 msgr2=0x7fd66806b0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:09:48.923 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.920+0000 7fd667fff700 1 -- 172.21.15.32:0/3862810088 shutdown_connections 2023-10-08T06:09:48.923 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.920+0000 7fd667fff700 1 -- 172.21.15.32:0/3862810088 wait complete. 2023-10-08T06:09:48.923 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.924+0000 7fd667fff700 1 Processor -- start 2023-10-08T06:09:48.924 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.924+0000 7fd667fff700 1 -- start start 2023-10-08T06:09:48.925 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.924+0000 7fd667fff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd6680b2600 0x7fd6681593d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:48.925 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.924+0000 7fd667fff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd66815d5a0 0x7fd6680b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:48.925 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.924+0000 7fd667fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd6680b5350 0x7fd6680b2be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:48.926 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.924+0000 7fd667fff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6680b5800 con 0x7fd6680b5350 2023-10-08T06:09:48.926 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.924+0000 7fd667fff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6680c86a0 con 0x7fd66815d5a0 2023-10-08T06:09:48.926 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.924+0000 7fd667fff700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6680c94c0 con 0x7fd6680b2600 2023-10-08T06:09:48.926 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.924+0000 7fd6677fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd6680b5350 0x7fd6680b2be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:48.926 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.924+0000 7fd6677fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd6680b5350 0x7fd6680b2be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:59846/0 (socket says 172.21.15.32:59846) 2023-10-08T06:09:48.926 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.924+0000 7fd6677fe700 1 -- 172.21.15.32:0/1690896028 learned_addr learned my addr 172.21.15.32:0/1690896028 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:09:48.926 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.924+0000 7fd666ffd700 1 --2- 172.21.15.32:0/1690896028 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd6680b2600 0x7fd6681593d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:48.926 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.924+0000 7fd6667fc700 1 --2- 172.21.15.32:0/1690896028 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd66815d5a0 0x7fd6680b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:48.927 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.924+0000 7fd6677fe700 1 -- 172.21.15.32:0/1690896028 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd6680b2600 msgr2=0x7fd6681593d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:48.927 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.924+0000 7fd6677fe700 1 --2- 172.21.15.32:0/1690896028 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd6680b2600 0x7fd6681593d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:48.928 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.924+0000 7fd6677fe700 1 -- 172.21.15.32:0/1690896028 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd66815d5a0 msgr2=0x7fd6680b4e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:48.928 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.924+0000 7fd6677fe700 1 --2- 172.21.15.32:0/1690896028 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd66815d5a0 0x7fd6680b4e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:48.928 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.924+0000 7fd6677fe700 1 -- 172.21.15.32:0/1690896028 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd65c009570 con 0x7fd6680b5350 2023-10-08T06:09:48.928 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.924+0000 7fd6677fe700 1 --2- 172.21.15.32:0/1690896028 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd6680b5350 0x7fd6680b2be0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fd66000cbf0 tx=0x7fd66000cf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:48.928 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.924+0000 7fd64f7fe700 1 -- 172.21.15.32:0/1690896028 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd660003c20 con 0x7fd6680b5350 2023-10-08T06:09:48.928 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.924+0000 7fd64f7fe700 1 -- 172.21.15.32:0/1690896028 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd660003d80 con 0x7fd6680b5350 2023-10-08T06:09:48.928 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.924+0000 7fd667fff700 1 -- 172.21.15.32:0/1690896028 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6681f2c50 con 0x7fd6680b5350 2023-10-08T06:09:48.928 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.924+0000 7fd64f7fe700 1 -- 172.21.15.32:0/1690896028 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd66000aaa0 con 0x7fd6680b5350 2023-10-08T06:09:48.928 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.924+0000 7fd667fff700 1 -- 172.21.15.32:0/1690896028 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6680c8b90 con 0x7fd6680b5350 2023-10-08T06:09:48.929 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.928+0000 7fd667fff700 1 -- 172.21.15.32:0/1690896028 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6680c9600 con 0x7fd6680b5350 2023-10-08T06:09:48.930 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.928+0000 7fd64f7fe700 1 -- 172.21.15.32:0/1690896028 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fd66000ac00 con 0x7fd6680b5350 2023-10-08T06:09:48.931 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.928+0000 7fd64f7fe700 1 --2- 172.21.15.32:0/1690896028 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fd654066510 0x7fd6540689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:48.931 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.928+0000 7fd64f7fe700 1 -- 172.21.15.32:0/1690896028 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd660083de0 con 0x7fd6680b5350 2023-10-08T06:09:48.931 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.928+0000 7fd666ffd700 1 --2- 172.21.15.32:0/1690896028 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fd654066510 0x7fd6540689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:48.932 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.932+0000 7fd666ffd700 1 --2- 172.21.15.32:0/1690896028 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fd654066510 0x7fd6540689d0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fd65c000c00 tx=0x7fd65c008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:48.941 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:48.940+0000 7fd64f7fe700 1 -- 172.21.15.32:0/1690896028 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fd6680c9600 con 0x7fd6680b5350 2023-10-08T06:09:49.101 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.100+0000 7fd667fff700 1 -- 172.21.15.32:0/1690896028 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd6680c9600 con 0x7fd6680b5350 2023-10-08T06:09:49.101 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.100+0000 7fd64f7fe700 1 -- 172.21.15.32:0/1690896028 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd6680c9600 con 0x7fd6680b5350 2023-10-08T06:09:49.102 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 32 2023-10-08T06:09:49.104 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.104+0000 7fd667fff700 1 -- 172.21.15.32:0/1690896028 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fd654066510 msgr2=0x7fd6540689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:49.104 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.104+0000 7fd667fff700 1 --2- 172.21.15.32:0/1690896028 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fd654066510 0x7fd6540689d0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fd65c000c00 tx=0x7fd65c008030 comp rx=0 tx=0).stop 2023-10-08T06:09:49.105 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.104+0000 7fd667fff700 1 -- 172.21.15.32:0/1690896028 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd6680b5350 msgr2=0x7fd6680b2be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:49.105 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.104+0000 7fd667fff700 1 --2- 172.21.15.32:0/1690896028 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd6680b5350 0x7fd6680b2be0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fd66000cbf0 tx=0x7fd66000cf00 comp rx=0 tx=0).stop 2023-10-08T06:09:49.105 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.104+0000 7fd667fff700 1 -- 172.21.15.32:0/1690896028 shutdown_connections 2023-10-08T06:09:49.105 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.104+0000 7fd667fff700 1 --2- 172.21.15.32:0/1690896028 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fd654066510 0x7fd6540689d0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:49.105 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.104+0000 7fd667fff700 1 --2- 172.21.15.32:0/1690896028 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd6680b5350 0x7fd6680b2be0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:49.105 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.104+0000 7fd667fff700 1 --2- 172.21.15.32:0/1690896028 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd66815d5a0 0x7fd6680b4e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:49.105 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.104+0000 7fd667fff700 1 --2- 172.21.15.32:0/1690896028 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd6680b2600 0x7fd6681593d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:49.105 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.104+0000 7fd667fff700 1 -- 172.21.15.32:0/1690896028 >> 172.21.15.32:0/1690896028 conn(0x7fd66806aca0 msgr2=0x7fd668160210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:09:49.105 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.104+0000 7fd667fff700 1 -- 172.21.15.32:0/1690896028 shutdown_connections 2023-10-08T06:09:49.105 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.104+0000 7fd667fff700 1 -- 172.21.15.32:0/1690896028 wait complete. 2023-10-08T06:09:49.117 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-08T06:09:49.241 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.240+0000 7f1bbbfff700 1 Processor -- start 2023-10-08T06:09:49.242 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.240+0000 7f1bbbfff700 1 -- start start 2023-10-08T06:09:49.243 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.240+0000 7f1bbbfff700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f1bbc15d490 0x7f1bbc0b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:49.243 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.240+0000 7f1bbbfff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f1bbc0d13d0 0x7f1bbc0cddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:49.244 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.240+0000 7f1bbbfff700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1bbc0d1bb0 con 0x7f1bbc0ce310 2023-10-08T06:09:49.244 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.240+0000 7f1bbbfff700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1bbc0ce7a0 con 0x7f1bbc15d490 2023-10-08T06:09:49.244 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.240+0000 7f1bbbfff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1bbc0d1e90 con 0x7f1bbc0d13d0 2023-10-08T06:09:49.244 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.240+0000 7f1bbaffd700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f1bbc15d490 0x7f1bbc0b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:49.244 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.240+0000 7f1bbb7fe700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f1bbc0ce310 0x7f1bbc0b4a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:46274/0 (socket says 172.21.15.32:46274) 2023-10-08T06:09:49.244 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.240+0000 7f1bbb7fe700 1 -- 172.21.15.32:0/407475023 learned_addr learned my addr 172.21.15.32:0/407475023 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-08T06:09:49.244 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.240+0000 7f1bba7fc700 1 --2- 172.21.15.32:0/407475023 >> v2:172.21.15.40:3300/0 conn(0x7f1bbc0d13d0 0x7f1bbc0cddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:49.244 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.244+0000 7f1bb9ffb700 1 -- 172.21.15.32:0/407475023 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 487494438 0 0) 0x7f1bbc0d1bb0 con 0x7f1bbc0ce310 2023-10-08T06:09:49.244 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.244+0000 7f1bb9ffb700 1 -- 172.21.15.32:0/407475023 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1ba40035d0 con 0x7f1bbc0ce310 2023-10-08T06:09:49.246 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.244+0000 7f1bbaffd700 1 -- 172.21.15.32:0/407475023 >> v2:172.21.15.40:3300/0 conn(0x7f1bbc0d13d0 msgr2=0x7f1bbc0cddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:09:49.246 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.244+0000 7f1bbaffd700 1 --2- 172.21.15.32:0/407475023 >> v2:172.21.15.40:3300/0 conn(0x7f1bbc0d13d0 0x7f1bbc0cddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:49.246 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.244+0000 7f1bbaffd700 1 -- 172.21.15.32:0/407475023 >> v1:172.21.15.32:6789/0 conn(0x7f1bbc0ce310 legacy=0x7f1bbc0b4a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:49.246 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.244+0000 7f1bbaffd700 1 -- 172.21.15.32:0/407475023 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bbc0d2170 con 0x7f1bbc15d490 2023-10-08T06:09:49.246 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.244+0000 7f1bbaffd700 1 --2- 172.21.15.32:0/407475023 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1bbc15d490 0x7f1bbc0b8bc0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f1bbc06bbc0 tx=0x7f1bb0009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=946a3124bdda877a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:49.246 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.244+0000 7f1bb9ffb700 1 -- 172.21.15.32:0/407475023 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bb0011830 con 0x7f1bbc15d490 2023-10-08T06:09:49.246 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.244+0000 7f1bb9ffb700 1 -- 172.21.15.32:0/407475023 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bb0011990 con 0x7f1bbc15d490 2023-10-08T06:09:49.246 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.244+0000 7f1bb9ffb700 1 -- 172.21.15.32:0/407475023 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bb0011d20 con 0x7f1bbc15d490 2023-10-08T06:09:49.246 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.244+0000 7f1bbbfff700 1 -- 172.21.15.32:0/407475023 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1bbc15d490 msgr2=0x7f1bbc0b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:49.247 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.244+0000 7f1bbbfff700 1 --2- 172.21.15.32:0/407475023 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1bbc15d490 0x7f1bbc0b8bc0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f1bbc06bbc0 tx=0x7f1bb0009b30 comp rx=0 tx=0).stop 2023-10-08T06:09:49.247 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.244+0000 7f1bbbfff700 1 -- 172.21.15.32:0/407475023 shutdown_connections 2023-10-08T06:09:49.247 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.244+0000 7f1bbbfff700 1 --2- 172.21.15.32:0/407475023 >> v2:172.21.15.40:3300/0 conn(0x7f1bbc0d13d0 0x7f1bbc0cddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:49.247 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.244+0000 7f1bbbfff700 1 --2- 172.21.15.32:0/407475023 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1bbc15d490 0x7f1bbc0b8bc0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:49.247 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.244+0000 7f1bbbfff700 1 -- 172.21.15.32:0/407475023 >> 172.21.15.32:0/407475023 conn(0x7f1bbc06ab40 msgr2=0x7f1bbc06af20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:09:49.247 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.244+0000 7f1bbbfff700 1 -- 172.21.15.32:0/407475023 shutdown_connections 2023-10-08T06:09:49.247 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.244+0000 7f1bbbfff700 1 -- 172.21.15.32:0/407475023 wait complete. 2023-10-08T06:09:49.248 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.248+0000 7f1bbbfff700 1 Processor -- start 2023-10-08T06:09:49.248 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.248+0000 7f1bbbfff700 1 -- start start 2023-10-08T06:09:49.250 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.248+0000 7f1bbbfff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1bbc0ce310 0x7f1bbc14e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:49.251 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.248+0000 7f1bbbfff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1bbc0d13d0 0x7f1bbc15fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:49.251 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.248+0000 7f1bbbfff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1bbc15d490 0x7f1bbc14a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:49.251 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.248+0000 7f1bbbfff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bbc150e50 con 0x7f1bbc0d13d0 2023-10-08T06:09:49.251 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.248+0000 7f1bbbfff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bbc14b060 con 0x7f1bbc0ce310 2023-10-08T06:09:49.251 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.248+0000 7f1bbbfff700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bbc14aae0 con 0x7f1bbc15d490 2023-10-08T06:09:49.251 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.248+0000 7f1bba7fc700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1bbc0d13d0 0x7f1bbc15fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:49.251 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.248+0000 7f1bba7fc700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1bbc0d13d0 0x7f1bbc15fbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:59868/0 (socket says 172.21.15.32:59868) 2023-10-08T06:09:49.251 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.248+0000 7f1bba7fc700 1 -- 172.21.15.32:0/3187489267 learned_addr learned my addr 172.21.15.32:0/3187489267 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:09:49.251 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.248+0000 7f1bbb7fe700 1 --2- 172.21.15.32:0/3187489267 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1bbc15d490 0x7f1bbc14a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:49.251 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.248+0000 7f1bbaffd700 1 --2- 172.21.15.32:0/3187489267 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1bbc0ce310 0x7f1bbc14e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:49.251 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.248+0000 7f1bba7fc700 1 -- 172.21.15.32:0/3187489267 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1bbc15d490 msgr2=0x7f1bbc14a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:49.252 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.248+0000 7f1bba7fc700 1 --2- 172.21.15.32:0/3187489267 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1bbc15d490 0x7f1bbc14a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:49.252 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.248+0000 7f1bba7fc700 1 -- 172.21.15.32:0/3187489267 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1bbc0ce310 msgr2=0x7f1bbc14e2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:49.252 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.248+0000 7f1bba7fc700 1 --2- 172.21.15.32:0/3187489267 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1bbc0ce310 0x7f1bbc14e2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:49.252 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.248+0000 7f1bba7fc700 1 -- 172.21.15.32:0/3187489267 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bb00094b0 con 0x7f1bbc0d13d0 2023-10-08T06:09:49.252 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.248+0000 7f1bba7fc700 1 --2- 172.21.15.32:0/3187489267 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1bbc0d13d0 0x7f1bbc15fbc0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f1bac00e9d0 tx=0x7f1bac00ed90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:49.252 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.248+0000 7f1ba3fff700 1 -- 172.21.15.32:0/3187489267 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bac009720 con 0x7f1bbc0d13d0 2023-10-08T06:09:49.252 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.248+0000 7f1ba3fff700 1 -- 172.21.15.32:0/3187489267 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bac00c7f0 con 0x7f1bbc0d13d0 2023-10-08T06:09:49.252 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.248+0000 7f1bbbfff700 1 -- 172.21.15.32:0/3187489267 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1bbc1602c0 con 0x7f1bbc0d13d0 2023-10-08T06:09:49.252 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.248+0000 7f1ba3fff700 1 -- 172.21.15.32:0/3187489267 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bac00cb60 con 0x7f1bbc0d13d0 2023-10-08T06:09:49.252 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.248+0000 7f1bbbfff700 1 -- 172.21.15.32:0/3187489267 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bbc14ea10 con 0x7f1bbc0d13d0 2023-10-08T06:09:49.253 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.252+0000 7f1bbbfff700 1 -- 172.21.15.32:0/3187489267 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1bbc073f00 con 0x7f1bbc0d13d0 2023-10-08T06:09:49.253 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.252+0000 7f1ba3fff700 1 -- 172.21.15.32:0/3187489267 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f1bac00ccc0 con 0x7f1bbc0d13d0 2023-10-08T06:09:49.253 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.252+0000 7f1ba3fff700 1 --2- 172.21.15.32:0/3187489267 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f1ba8066510 0x7f1ba80689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:49.253 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.252+0000 7f1ba3fff700 1 -- 172.21.15.32:0/3187489267 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1bac083e80 con 0x7f1bbc0d13d0 2023-10-08T06:09:49.254 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.252+0000 7f1bbaffd700 1 --2- 172.21.15.32:0/3187489267 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f1ba8066510 0x7f1ba80689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:49.254 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.252+0000 7f1bbaffd700 1 --2- 172.21.15.32:0/3187489267 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f1ba8066510 0x7f1ba80689d0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f1bb0009fd0 tx=0x7f1bb0008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:49.260 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.260+0000 7f1ba3fff700 1 -- 172.21.15.32:0/3187489267 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f1bac051390 con 0x7f1bbc0d13d0 2023-10-08T06:09:49.431 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.428+0000 7f1bbbfff700 1 -- 172.21.15.32:0/3187489267 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f1bbc0b8bf0 con 0x7f1bbc0d13d0 2023-10-08T06:09:49.431 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.432+0000 7f1ba3fff700 1 -- 172.21.15.32:0/3187489267 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f1bac0549b0 con 0x7f1bbc0d13d0 2023-10-08T06:09:49.432 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 64 2023-10-08T06:09:49.434 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.432+0000 7f1bbbfff700 1 -- 172.21.15.32:0/3187489267 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f1ba8066510 msgr2=0x7f1ba80689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:49.434 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.432+0000 7f1bbbfff700 1 --2- 172.21.15.32:0/3187489267 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f1ba8066510 0x7f1ba80689d0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f1bb0009fd0 tx=0x7f1bb0008030 comp rx=0 tx=0).stop 2023-10-08T06:09:49.434 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.432+0000 7f1bbbfff700 1 -- 172.21.15.32:0/3187489267 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1bbc0d13d0 msgr2=0x7f1bbc15fbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:49.434 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.432+0000 7f1bbbfff700 1 --2- 172.21.15.32:0/3187489267 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1bbc0d13d0 0x7f1bbc15fbc0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f1bac00e9d0 tx=0x7f1bac00ed90 comp rx=0 tx=0).stop 2023-10-08T06:09:49.435 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.432+0000 7f1bbbfff700 1 -- 172.21.15.32:0/3187489267 shutdown_connections 2023-10-08T06:09:49.435 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.432+0000 7f1bbbfff700 1 --2- 172.21.15.32:0/3187489267 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f1ba8066510 0x7f1ba80689d0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:49.435 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.432+0000 7f1bbbfff700 1 --2- 172.21.15.32:0/3187489267 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1bbc0d13d0 0x7f1bbc15fbc0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:49.435 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.432+0000 7f1bbbfff700 1 --2- 172.21.15.32:0/3187489267 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1bbc15d490 0x7f1bbc14a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:49.435 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.432+0000 7f1bbbfff700 1 --2- 172.21.15.32:0/3187489267 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1bbc0ce310 0x7f1bbc14e2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:49.435 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.432+0000 7f1bbbfff700 1 -- 172.21.15.32:0/3187489267 >> 172.21.15.32:0/3187489267 conn(0x7f1bbc06ab40 msgr2=0x7f1bbc0c93f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:09:49.435 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.432+0000 7f1bbbfff700 1 -- 172.21.15.32:0/3187489267 shutdown_connections 2023-10-08T06:09:49.435 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.432+0000 7f1bbbfff700 1 -- 172.21.15.32:0/3187489267 wait complete. 2023-10-08T06:09:49.452 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T06:09:49.565 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.564+0000 7f1960df3700 1 Processor -- start 2023-10-08T06:09:49.566 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.564+0000 7f1960df3700 1 -- start start 2023-10-08T06:09:49.566 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.564+0000 7f1960df3700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f195c0c9b30 0x7f195c15bd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:49.566 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.564+0000 7f1960df3700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f195c06fc20 con 0x7f195c15b980 2023-10-08T06:09:49.567 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.564+0000 7f1960df3700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f195c06fe70 con 0x7f195c0719e0 2023-10-08T06:09:49.567 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.564+0000 7f1960df3700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f195c070430 con 0x7f195c0c9b30 2023-10-08T06:09:49.567 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.564+0000 7f195b7fe700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f195c15b980 0x7f195c15f780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:46288/0 (socket says 172.21.15.32:46288) 2023-10-08T06:09:49.567 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.564+0000 7f195b7fe700 1 -- 172.21.15.32:0/2862074174 learned_addr learned my addr 172.21.15.32:0/2862074174 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-08T06:09:49.569 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.564+0000 7f195bfff700 1 --2- 172.21.15.32:0/2862074174 >> v2:172.21.15.40:3300/0 conn(0x7f195c0c9b30 0x7f195c15bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:49.569 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.564+0000 7f195affd700 1 -- 172.21.15.32:0/2862074174 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3528863627 0 0) 0x7f195c06fc20 con 0x7f195c15b980 2023-10-08T06:09:49.569 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.564+0000 7f195affd700 1 -- 172.21.15.32:0/2862074174 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f193c0035d0 con 0x7f195c15b980 2023-10-08T06:09:49.569 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.564+0000 7f195affd700 1 -- 172.21.15.32:0/2862074174 <== mon.1 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1371249102 0 0) 0x7f195c06fe70 con 0x7f195c0719e0 2023-10-08T06:09:49.570 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.564+0000 7f195affd700 1 -- 172.21.15.32:0/2862074174 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f195c06fc20 con 0x7f195c0719e0 2023-10-08T06:09:49.570 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.568+0000 7f195affd700 1 -- 172.21.15.32:0/2862074174 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1519628012 0 0) 0x7f193c0035d0 con 0x7f195c15b980 2023-10-08T06:09:49.570 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.568+0000 7f195affd700 1 -- 172.21.15.32:0/2862074174 >> v2:172.21.15.40:3300/0 conn(0x7f195c0c9b30 msgr2=0x7f195c15bd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:09:49.570 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.568+0000 7f195affd700 1 --2- 172.21.15.32:0/2862074174 >> v2:172.21.15.40:3300/0 conn(0x7f195c0c9b30 0x7f195c15bd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:49.570 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.568+0000 7f195affd700 1 -- 172.21.15.32:0/2862074174 >> v1:172.21.15.40:6789/0 conn(0x7f195c0719e0 legacy=0x7f195c0c9420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:49.570 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.568+0000 7f195affd700 1 -- 172.21.15.32:0/2862074174 --> v1:172.21.15.32:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f195c070150 con 0x7f195c15b980 2023-10-08T06:09:49.570 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.568+0000 7f195affd700 1 -- 172.21.15.32:0/2862074174 <== mon.0 v1:172.21.15.32:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2364763317 0 0) 0x7f194c001670 con 0x7f195c15b980 2023-10-08T06:09:49.570 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.568+0000 7f195affd700 1 -- 172.21.15.32:0/2862074174 >> v1:172.21.15.32:6789/0 conn(0x7f195c15b980 legacy=0x7f195c15f780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:49.570 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.568+0000 7f195affd700 1 --2- 172.21.15.32:0/2862074174 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f193c003bb0 0x7f193c003fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:49.570 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.568+0000 7f195affd700 1 --2- 172.21.15.32:0/2862074174 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f193c004870 0x7f193c004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:49.570 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.568+0000 7f195affd700 1 --2- 172.21.15.32:0/2862074174 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f193c005230 0x7f193c00fe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:49.571 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.568+0000 7f195affd700 1 -- 172.21.15.32:0/2862074174 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f193c010490 con 0x7f193c005230 2023-10-08T06:09:49.571 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.568+0000 7f195affd700 1 -- 172.21.15.32:0/2862074174 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f193c010600 con 0x7f193c004870 2023-10-08T06:09:49.571 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.568+0000 7f195affd700 1 -- 172.21.15.32:0/2862074174 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f193c0107c0 con 0x7f193c003bb0 2023-10-08T06:09:49.571 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.568+0000 7f1953fff700 1 --2- 172.21.15.32:0/2862074174 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f193c004870 0x7f193c004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:49.571 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.568+0000 7f195b7fe700 1 --2- 172.21.15.32:0/2862074174 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f193c003bb0 0x7f193c003fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:49.571 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.568+0000 7f195bfff700 1 --2- 172.21.15.32:0/2862074174 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f193c005230 0x7f193c00fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:49.571 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.568+0000 7f1953fff700 1 -- 172.21.15.32:0/2862074174 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f193c003bb0 msgr2=0x7f193c003fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:09:49.571 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.568+0000 7f1953fff700 1 --2- 172.21.15.32:0/2862074174 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f193c003bb0 0x7f193c003fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:49.571 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.568+0000 7f1953fff700 1 -- 172.21.15.32:0/2862074174 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f193c005230 msgr2=0x7f193c00fe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:09:49.571 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.568+0000 7f1953fff700 1 --2- 172.21.15.32:0/2862074174 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f193c005230 0x7f193c00fe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:49.571 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.568+0000 7f1953fff700 1 -- 172.21.15.32:0/2862074174 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f193c0035d0 con 0x7f193c004870 2023-10-08T06:09:49.572 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.568+0000 7f195bfff700 1 -- 172.21.15.32:0/2862074174 reap_dead start 2023-10-08T06:09:49.572 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.568+0000 7f1953fff700 1 --2- 172.21.15.32:0/2862074174 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f193c004870 0x7f193c004cf0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f1944001960 tx=0x7f193c0058a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=64870c642a627044 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:49.572 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.568+0000 7f195affd700 1 -- 172.21.15.32:0/2862074174 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1944001450 con 0x7f193c004870 2023-10-08T06:09:49.572 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.568+0000 7f195affd700 1 -- 172.21.15.32:0/2862074174 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19440052f0 con 0x7f193c004870 2023-10-08T06:09:49.572 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.568+0000 7f195affd700 1 -- 172.21.15.32:0/2862074174 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19440036a0 con 0x7f193c004870 2023-10-08T06:09:49.573 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.568+0000 7f1960df3700 1 -- 172.21.15.32:0/2862074174 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f193c004870 msgr2=0x7f193c004cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:49.574 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.568+0000 7f1960df3700 1 --2- 172.21.15.32:0/2862074174 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f193c004870 0x7f193c004cf0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f1944001960 tx=0x7f193c0058a0 comp rx=0 tx=0).stop 2023-10-08T06:09:49.574 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.568+0000 7f1960df3700 1 -- 172.21.15.32:0/2862074174 shutdown_connections 2023-10-08T06:09:49.574 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.568+0000 7f1960df3700 1 --2- 172.21.15.32:0/2862074174 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f193c004870 0x7f193c004cf0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:49.574 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.568+0000 7f1960df3700 1 -- 172.21.15.32:0/2862074174 >> 172.21.15.32:0/2862074174 conn(0x7f195c0b0900 msgr2=0x7f195c0b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:09:49.574 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.568+0000 7f1960df3700 1 -- 172.21.15.32:0/2862074174 shutdown_connections 2023-10-08T06:09:49.574 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.568+0000 7f1960df3700 1 -- 172.21.15.32:0/2862074174 wait complete. 2023-10-08T06:09:49.574 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.572+0000 7f1960df3700 1 Processor -- start 2023-10-08T06:09:49.574 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.572+0000 7f1960df3700 1 -- start start 2023-10-08T06:09:49.574 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.572+0000 7f1960df3700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f193c004870 0x7f195c1588f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:49.575 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.572+0000 7f1960df3700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f195c14b1b0 0x7f195c150130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:49.575 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.572+0000 7f1960df3700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f195c150670 0x7f195c15bd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:49.575 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.572+0000 7f1960df3700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f195c14f090 con 0x7f195c14b1b0 2023-10-08T06:09:49.575 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.572+0000 7f1960df3700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f195c14f370 con 0x7f193c004870 2023-10-08T06:09:49.575 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.572+0000 7f1960df3700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f195c14f650 con 0x7f195c150670 2023-10-08T06:09:49.575 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.572+0000 7f1953fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f195c14b1b0 0x7f195c150130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:49.575 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.572+0000 7f1953fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f195c14b1b0 0x7f195c150130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:59882/0 (socket says 172.21.15.32:59882) 2023-10-08T06:09:49.575 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.572+0000 7f1953fff700 1 -- 172.21.15.32:0/2318627471 learned_addr learned my addr 172.21.15.32:0/2318627471 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:09:49.575 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.572+0000 7f195bfff700 1 --2- 172.21.15.32:0/2318627471 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f195c150670 0x7f195c15bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:49.575 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.572+0000 7f195b7fe700 1 --2- 172.21.15.32:0/2318627471 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f193c004870 0x7f195c1588f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:49.576 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.572+0000 7f1953fff700 1 -- 172.21.15.32:0/2318627471 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f195c150670 msgr2=0x7f195c15bd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:49.577 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.572+0000 7f1953fff700 1 --2- 172.21.15.32:0/2318627471 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f195c150670 0x7f195c15bd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:49.577 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.572+0000 7f1953fff700 1 -- 172.21.15.32:0/2318627471 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f193c004870 msgr2=0x7f195c1588f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:49.577 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.572+0000 7f1953fff700 1 --2- 172.21.15.32:0/2318627471 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f193c004870 0x7f195c1588f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:49.577 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.572+0000 7f1953fff700 1 -- 172.21.15.32:0/2318627471 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f195c14f930 con 0x7f195c14b1b0 2023-10-08T06:09:49.577 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.572+0000 7f195b7fe700 1 --2- 172.21.15.32:0/2318627471 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f193c004870 0x7f195c1588f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T06:09:49.577 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.572+0000 7f1953fff700 1 --2- 172.21.15.32:0/2318627471 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f195c14b1b0 0x7f195c150130 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f1944005040 tx=0x7f19440012d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:49.577 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.572+0000 7f1958ff9700 1 -- 172.21.15.32:0/2318627471 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19440013d0 con 0x7f195c14b1b0 2023-10-08T06:09:49.577 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.572+0000 7f1958ff9700 1 -- 172.21.15.32:0/2318627471 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1944006a90 con 0x7f195c14b1b0 2023-10-08T06:09:49.577 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.572+0000 7f1958ff9700 1 -- 172.21.15.32:0/2318627471 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1944006e40 con 0x7f195c14b1b0 2023-10-08T06:09:49.578 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.572+0000 7f1960df3700 1 -- 172.21.15.32:0/2318627471 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f195c14fc10 con 0x7f195c14b1b0 2023-10-08T06:09:49.578 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.572+0000 7f1960df3700 1 -- 172.21.15.32:0/2318627471 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f195c14ae70 con 0x7f195c14b1b0 2023-10-08T06:09:49.578 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.576+0000 7f1960df3700 1 -- 172.21.15.32:0/2318627471 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f195c14b000 con 0x7f195c14b1b0 2023-10-08T06:09:49.578 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.576+0000 7f1958ff9700 1 -- 172.21.15.32:0/2318627471 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f1944007040 con 0x7f195c14b1b0 2023-10-08T06:09:49.578 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.576+0000 7f1958ff9700 1 --2- 172.21.15.32:0/2318627471 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f1940066540 0x7f1940068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:49.579 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.576+0000 7f195b7fe700 1 --2- 172.21.15.32:0/2318627471 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f1940066540 0x7f1940068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:49.579 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.576+0000 7f1958ff9700 1 -- 172.21.15.32:0/2318627471 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1944084800 con 0x7f195c14b1b0 2023-10-08T06:09:49.579 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.576+0000 7f195b7fe700 1 --2- 172.21.15.32:0/2318627471 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f1940066540 0x7f1940068a00 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f194c000c00 tx=0x7f194c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:49.586 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.584+0000 7f1958ff9700 1 -- 172.21.15.32:0/2318627471 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f1944055840 con 0x7f195c14b1b0 2023-10-08T06:09:49.787 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.784+0000 7f1960df3700 1 -- 172.21.15.32:0/2318627471 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f195c14fda0 con 0x7f195c14b1b0 2023-10-08T06:09:49.787 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.788+0000 7f1958ff9700 1 -- 172.21.15.32:0/2318627471 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4907 (secure 0 0 0) 0x7f1944021090 con 0x7f195c14b1b0 2023-10-08T06:09:49.788 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:09:49.788 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6833/2405386193","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":2405386193},{"type":"v1","addr":"172.21.15.40:6833","nonce":2405386193}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4254,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6835/1810658720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6834","nonce":1810658720},{"type":"v1","addr":"172.21.15.32:6835","nonce":1810658720}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4257,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6837/2286934165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6836","nonce":2286934165},{"type":"v1","addr":"172.21.15.32:6837","nonce":2286934165}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T06:09:36.528026+0000","modified":"2023-10-08T06:09:38.533661+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4318},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4318":{"gid":4318,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.40:6835/3325966535","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":3325966535},{"type":"v1","addr":"172.21.15.40:6835","nonce":3325966535}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-08T06:09:49.790 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.788+0000 7f1960df3700 1 -- 172.21.15.32:0/2318627471 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f1940066540 msgr2=0x7f1940068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:49.790 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.788+0000 7f1960df3700 1 --2- 172.21.15.32:0/2318627471 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f1940066540 0x7f1940068a00 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f194c000c00 tx=0x7f194c009040 comp rx=0 tx=0).stop 2023-10-08T06:09:49.791 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.788+0000 7f1960df3700 1 -- 172.21.15.32:0/2318627471 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f195c14b1b0 msgr2=0x7f195c150130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:49.791 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.788+0000 7f1960df3700 1 --2- 172.21.15.32:0/2318627471 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f195c14b1b0 0x7f195c150130 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f1944005040 tx=0x7f19440012d0 comp rx=0 tx=0).stop 2023-10-08T06:09:49.791 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.788+0000 7f1960df3700 1 -- 172.21.15.32:0/2318627471 shutdown_connections 2023-10-08T06:09:49.791 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.788+0000 7f1960df3700 1 --2- 172.21.15.32:0/2318627471 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f1940066540 0x7f1940068a00 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:49.791 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.788+0000 7f1960df3700 1 --2- 172.21.15.32:0/2318627471 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f195c14b1b0 0x7f195c150130 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:49.791 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.788+0000 7f1960df3700 1 --2- 172.21.15.32:0/2318627471 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f195c150670 0x7f195c15bd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:49.791 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.788+0000 7f1960df3700 1 --2- 172.21.15.32:0/2318627471 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f193c004870 0x7f195c1588f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:49.791 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.788+0000 7f1960df3700 1 -- 172.21.15.32:0/2318627471 >> 172.21.15.32:0/2318627471 conn(0x7f195c0b0900 msgr2=0x7f195c0ca880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:09:49.791 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.788+0000 7f1960df3700 1 -- 172.21.15.32:0/2318627471 shutdown_connections 2023-10-08T06:09:49.791 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.788+0000 7f1960df3700 1 -- 172.21.15.32:0/2318627471 wait complete. 2023-10-08T06:09:49.792 INFO:teuthology.orchestra.run.smithi032.stderr:dumped fsmap epoch 6 2023-10-08T06:09:49.803 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T06:09:49.914 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.912+0000 7fe195e77700 1 Processor -- start 2023-10-08T06:09:49.914 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.912+0000 7fe195e77700 1 -- start start 2023-10-08T06:09:49.915 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.912+0000 7fe195e77700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe190159ed0 0x7fe1900ca9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:49.915 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.912+0000 7fe195e77700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe1900c98c0 0x7fe1900cb510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:49.915 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.912+0000 7fe195e77700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1900cca40 con 0x7fe19015a2b0 2023-10-08T06:09:49.916 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.912+0000 7fe195e77700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1900ccdb0 con 0x7fe190159ed0 2023-10-08T06:09:49.916 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.912+0000 7fe195e77700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1900caef0 con 0x7fe1900c98c0 2023-10-08T06:09:49.916 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.912+0000 7fe195676700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe1900c98c0 0x7fe1900cb510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:49.916 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.912+0000 7fe194e75700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe190159ed0 0x7fe1900ca9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:49.916 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.912+0000 7fe194e75700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe190159ed0 0x7fe1900ca9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.32:38758/0 (socket says 172.21.15.32:38758) 2023-10-08T06:09:49.916 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.912+0000 7fe18ffff700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fe19015a2b0 0x7fe1900706f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.32:46118/0 (socket says 172.21.15.32:46118) 2023-10-08T06:09:49.916 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.912+0000 7fe195676700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe1900c98c0 0x7fe1900cb510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.32:55104/0 (socket says 172.21.15.32:55104) 2023-10-08T06:09:49.916 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.912+0000 7fe194e75700 1 -- 172.21.15.32:0/2760668483 learned_addr learned my addr 172.21.15.32:0/2760668483 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:09:49.918 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.916+0000 7fe195676700 1 -- 172.21.15.32:0/2760668483 >> v2:172.21.15.40:3300/0 conn(0x7fe190159ed0 msgr2=0x7fe1900ca9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:09:49.918 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.916+0000 7fe195676700 1 --2- 172.21.15.32:0/2760668483 >> v2:172.21.15.40:3300/0 conn(0x7fe190159ed0 0x7fe1900ca9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:49.918 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.916+0000 7fe195676700 1 -- 172.21.15.32:0/2760668483 >> v1:172.21.15.40:6789/0 conn(0x7fe19015a2b0 legacy=0x7fe1900706f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:49.918 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.916+0000 7fe195676700 1 -- 172.21.15.32:0/2760668483 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1900cdf60 con 0x7fe1900c98c0 2023-10-08T06:09:49.918 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.916+0000 7fe195676700 1 --2- 172.21.15.32:0/2760668483 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe1900c98c0 0x7fe1900cb510 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fe188009850 tx=0x7fe188009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1cdde0c26226defc server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:49.918 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.916+0000 7fe18f7fe700 1 -- 172.21.15.32:0/2760668483 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe188011830 con 0x7fe1900c98c0 2023-10-08T06:09:49.918 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.916+0000 7fe18f7fe700 1 -- 172.21.15.32:0/2760668483 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe188011990 con 0x7fe1900c98c0 2023-10-08T06:09:49.918 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.916+0000 7fe18f7fe700 1 -- 172.21.15.32:0/2760668483 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe188011d40 con 0x7fe1900c98c0 2023-10-08T06:09:49.918 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.916+0000 7fe195e77700 1 -- 172.21.15.32:0/2760668483 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe1900c98c0 msgr2=0x7fe1900cb510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:49.919 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.916+0000 7fe195e77700 1 --2- 172.21.15.32:0/2760668483 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe1900c98c0 0x7fe1900cb510 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fe188009850 tx=0x7fe188009b60 comp rx=0 tx=0).stop 2023-10-08T06:09:49.919 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.916+0000 7fe195e77700 1 -- 172.21.15.32:0/2760668483 shutdown_connections 2023-10-08T06:09:49.919 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.916+0000 7fe195e77700 1 --2- 172.21.15.32:0/2760668483 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe1900c98c0 0x7fe1900cb510 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:49.919 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.916+0000 7fe195e77700 1 --2- 172.21.15.32:0/2760668483 >> v2:172.21.15.40:3300/0 conn(0x7fe190159ed0 0x7fe1900ca9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:49.919 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.916+0000 7fe195e77700 1 -- 172.21.15.32:0/2760668483 >> 172.21.15.32:0/2760668483 conn(0x7fe1900b0900 msgr2=0x7fe1900b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:09:49.919 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.916+0000 7fe195e77700 1 -- 172.21.15.32:0/2760668483 shutdown_connections 2023-10-08T06:09:49.919 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.916+0000 7fe195e77700 1 -- 172.21.15.32:0/2760668483 wait complete. 2023-10-08T06:09:49.920 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.916+0000 7fe195e77700 1 Processor -- start 2023-10-08T06:09:49.920 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.916+0000 7fe195e77700 1 -- start start 2023-10-08T06:09:49.921 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.920+0000 7fe195e77700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe1900c98c0 0x7fe190154fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:49.921 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.920+0000 7fe195e77700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe190159ed0 0x7fe1900c4bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:49.921 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.920+0000 7fe195e77700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe19015a2b0 0x7fe190154780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:49.921 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.920+0000 7fe195e77700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1900c5660 con 0x7fe190159ed0 2023-10-08T06:09:49.921 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.920+0000 7fe195e77700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1900c5110 con 0x7fe19015a2b0 2023-10-08T06:09:49.921 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.920+0000 7fe195e77700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1900c5380 con 0x7fe1900c98c0 2023-10-08T06:09:49.921 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.920+0000 7fe18ffff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe190159ed0 0x7fe1900c4bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:49.921 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.920+0000 7fe18ffff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe190159ed0 0x7fe1900c4bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:59894/0 (socket says 172.21.15.32:59894) 2023-10-08T06:09:49.921 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.920+0000 7fe18ffff700 1 -- 172.21.15.32:0/31858762 learned_addr learned my addr 172.21.15.32:0/31858762 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:09:49.921 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.920+0000 7fe194e75700 1 --2- 172.21.15.32:0/31858762 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe1900c98c0 0x7fe190154fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:49.922 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.920+0000 7fe195676700 1 --2- 172.21.15.32:0/31858762 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe19015a2b0 0x7fe190154780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:49.923 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.920+0000 7fe18ffff700 1 -- 172.21.15.32:0/31858762 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe1900c98c0 msgr2=0x7fe190154fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:49.923 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.920+0000 7fe18ffff700 1 --2- 172.21.15.32:0/31858762 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe1900c98c0 0x7fe190154fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:49.923 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.920+0000 7fe18ffff700 1 -- 172.21.15.32:0/31858762 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe19015a2b0 msgr2=0x7fe190154780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:49.923 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.920+0000 7fe18ffff700 1 --2- 172.21.15.32:0/31858762 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe19015a2b0 0x7fe190154780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:49.923 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.920+0000 7fe18ffff700 1 -- 172.21.15.32:0/31858762 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1880094b0 con 0x7fe190159ed0 2023-10-08T06:09:49.923 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.920+0000 7fe18ffff700 1 --2- 172.21.15.32:0/31858762 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe190159ed0 0x7fe1900c4bd0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fe18000cc80 tx=0x7fe18000cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:49.923 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.920+0000 7fe18d7fa700 1 -- 172.21.15.32:0/31858762 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe18000aac0 con 0x7fe190159ed0 2023-10-08T06:09:49.923 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.920+0000 7fe18d7fa700 1 -- 172.21.15.32:0/31858762 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe18000ac20 con 0x7fe190159ed0 2023-10-08T06:09:49.923 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.920+0000 7fe18d7fa700 1 -- 172.21.15.32:0/31858762 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe180007070 con 0x7fe190159ed0 2023-10-08T06:09:49.923 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.920+0000 7fe195e77700 1 -- 172.21.15.32:0/31858762 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1900aca00 con 0x7fe190159ed0 2023-10-08T06:09:49.923 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.920+0000 7fe195e77700 1 -- 172.21.15.32:0/31858762 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1900acfc0 con 0x7fe190159ed0 2023-10-08T06:09:49.924 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.924+0000 7fe195e77700 1 -- 172.21.15.32:0/31858762 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1900ad1e0 con 0x7fe190159ed0 2023-10-08T06:09:49.924 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.924+0000 7fe18d7fa700 1 -- 172.21.15.32:0/31858762 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fe1800071d0 con 0x7fe190159ed0 2023-10-08T06:09:49.925 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.924+0000 7fe18d7fa700 1 --2- 172.21.15.32:0/31858762 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fe17c066540 0x7fe17c068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:49.925 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.924+0000 7fe18d7fa700 1 -- 172.21.15.32:0/31858762 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe180083b90 con 0x7fe190159ed0 2023-10-08T06:09:49.925 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.924+0000 7fe194e75700 1 --2- 172.21.15.32:0/31858762 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fe17c066540 0x7fe17c068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:49.926 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.924+0000 7fe194e75700 1 --2- 172.21.15.32:0/31858762 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fe17c066540 0x7fe17c068a00 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fe184006d70 tx=0x7fe18400b4f0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:49.936 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:49.936+0000 7fe18d7fa700 1 -- 172.21.15.32:0/31858762 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fe180050fa0 con 0x7fe190159ed0 2023-10-08T06:09:50.104 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:50.104+0000 7fe195e77700 1 -- 172.21.15.32:0/31858762 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe190073f00 con 0x7fe190159ed0 2023-10-08T06:09:50.106 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:50.104+0000 7fe18d7fa700 1 -- 172.21.15.32:0/31858762 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16445 (secure 0 0 0) 0x7fe180017020 con 0x7fe190159ed0 2023-10-08T06:09:50.107 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:09:50.107 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":22,"fsid":"ac672d87-96ae-41e0-9314-623ba2cdbbba","created":"2023-10-08T06:09:11.175626+0000","modified":"2023-10-08T06:09:38.153256+0000","last_up_change":"2023-10-08T06:09:22.744643+0000","last_in_change":"2023-10-08T06:09:14.131580+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T06:09:23.307843+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T06:09:34.295012+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T06:09:35.515590+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"43433f0c-9592-4874-92d7-10f8f4acf07f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":587888964},{"type":"v1","addr":"172.21.15.32:6801","nonce":587888964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":587888964},{"type":"v1","addr":"172.21.15.32:6803","nonce":587888964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":587888964},{"type":"v1","addr":"172.21.15.32:6810","nonce":587888964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6805","nonce":587888964},{"type":"v1","addr":"172.21.15.32:6807","nonce":587888964}]},"public_addr":"172.21.15.32:6801/587888964","cluster_addr":"172.21.15.32:6803/587888964","heartbeat_back_addr":"172.21.15.32:6810/587888964","heartbeat_front_addr":"172.21.15.32:6807/587888964","state":["exists","up"]},{"osd":1,"uuid":"2ecb1008-b987-4ce7-b646-6cded55fc8d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":990576767},{"type":"v1","addr":"172.21.15.32:6817","nonce":990576767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":990576767},{"type":"v1","addr":"172.21.15.32:6819","nonce":990576767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":990576767},{"type":"v1","addr":"172.21.15.32:6823","nonce":990576767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":990576767},{"type":"v1","addr":"172.21.15.32:6821","nonce":990576767}]},"public_addr":"172.21.15.32:6817/990576767","cluster_addr":"172.21.15.32:6819/990576767","heartbeat_back_addr":"172.21.15.32:6823/990576767","heartbeat_front_addr":"172.21.15.32:6821/990576767","state":["exists","up"]},{"osd":2,"uuid":"1b131c94-c09b-4e80-8746-bf1b7bac362d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6824","nonce":1566874440},{"type":"v1","addr":"172.21.15.32:6825","nonce":1566874440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":1566874440},{"type":"v1","addr":"172.21.15.32:6827","nonce":1566874440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":1566874440},{"type":"v1","addr":"172.21.15.32:6831","nonce":1566874440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":1566874440},{"type":"v1","addr":"172.21.15.32:6829","nonce":1566874440}]},"public_addr":"172.21.15.32:6825/1566874440","cluster_addr":"172.21.15.32:6827/1566874440","heartbeat_back_addr":"172.21.15.32:6831/1566874440","heartbeat_front_addr":"172.21.15.32:6829/1566874440","state":["exists","up"]},{"osd":3,"uuid":"ad655af2-1f6f-4689-b21d-b07bbaeb68b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":3672614802},{"type":"v1","addr":"172.21.15.32:6806","nonce":3672614802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6809","nonce":3672614802},{"type":"v1","addr":"172.21.15.32:6811","nonce":3672614802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":3672614802},{"type":"v1","addr":"172.21.15.32:6815","nonce":3672614802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":3672614802},{"type":"v1","addr":"172.21.15.32:6813","nonce":3672614802}]},"public_addr":"172.21.15.32:6806/3672614802","cluster_addr":"172.21.15.32:6811/3672614802","heartbeat_back_addr":"172.21.15.32:6815/3672614802","heartbeat_front_addr":"172.21.15.32:6813/3672614802","state":["exists","up"]},{"osd":4,"uuid":"64a543a1-8c4f-458e-9aba-b35c1cd7dd03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":3369928244},{"type":"v1","addr":"172.21.15.40:6801","nonce":3369928244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":3369928244},{"type":"v1","addr":"172.21.15.40:6803","nonce":3369928244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":3369928244},{"type":"v1","addr":"172.21.15.40:6807","nonce":3369928244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":3369928244},{"type":"v1","addr":"172.21.15.40:6805","nonce":3369928244}]},"public_addr":"172.21.15.40:6801/3369928244","cluster_addr":"172.21.15.40:6803/3369928244","heartbeat_back_addr":"172.21.15.40:6807/3369928244","heartbeat_front_addr":"172.21.15.40:6805/3369928244","state":["exists","up"]},{"osd":5,"uuid":"0fef3e54-edb4-4678-878e-944663c51638","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":2395850297},{"type":"v1","addr":"172.21.15.40:6825","nonce":2395850297}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":2395850297},{"type":"v1","addr":"172.21.15.40:6827","nonce":2395850297}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":2395850297},{"type":"v1","addr":"172.21.15.40:6831","nonce":2395850297}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":2395850297},{"type":"v1","addr":"172.21.15.40:6829","nonce":2395850297}]},"public_addr":"172.21.15.40:6825/2395850297","cluster_addr":"172.21.15.40:6827/2395850297","heartbeat_back_addr":"172.21.15.40:6831/2395850297","heartbeat_front_addr":"172.21.15.40:6829/2395850297","state":["exists","up"]},{"osd":6,"uuid":"2eeb0472-6096-469d-9b2c-cab4bf41c31a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":4145283410},{"type":"v1","addr":"172.21.15.40:6809","nonce":4145283410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":4145283410},{"type":"v1","addr":"172.21.15.40:6811","nonce":4145283410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":4145283410},{"type":"v1","addr":"172.21.15.40:6815","nonce":4145283410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":4145283410},{"type":"v1","addr":"172.21.15.40:6813","nonce":4145283410}]},"public_addr":"172.21.15.40:6809/4145283410","cluster_addr":"172.21.15.40:6811/4145283410","heartbeat_back_addr":"172.21.15.40:6815/4145283410","heartbeat_front_addr":"172.21.15.40:6813/4145283410","state":["exists","up"]},{"osd":7,"uuid":"cf76e4c7-96a6-401f-a280-91aad4641940","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":2943297416},{"type":"v1","addr":"172.21.15.40:6817","nonce":2943297416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":2943297416},{"type":"v1","addr":"172.21.15.40:6819","nonce":2943297416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":2943297416},{"type":"v1","addr":"172.21.15.40:6823","nonce":2943297416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":2943297416},{"type":"v1","addr":"172.21.15.40:6821","nonce":2943297416}]},"public_addr":"172.21.15.40:6817/2943297416","cluster_addr":"172.21.15.40:6819/2943297416","heartbeat_back_addr":"172.21.15.40:6823/2943297416","heartbeat_front_addr":"172.21.15.40:6821/2943297416","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.411475+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.628841+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.599055+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.166100+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.384135+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.488403+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.307648+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.363541+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T06:09:50.109 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:50.108+0000 7fe195e77700 1 -- 172.21.15.32:0/31858762 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fe17c066540 msgr2=0x7fe17c068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:50.109 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:50.108+0000 7fe195e77700 1 --2- 172.21.15.32:0/31858762 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fe17c066540 0x7fe17c068a00 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fe184006d70 tx=0x7fe18400b4f0 comp rx=0 tx=0).stop 2023-10-08T06:09:50.109 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:50.108+0000 7fe195e77700 1 -- 172.21.15.32:0/31858762 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe190159ed0 msgr2=0x7fe1900c4bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:50.110 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:50.108+0000 7fe195e77700 1 --2- 172.21.15.32:0/31858762 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe190159ed0 0x7fe1900c4bd0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fe18000cc80 tx=0x7fe18000cf90 comp rx=0 tx=0).stop 2023-10-08T06:09:50.110 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:50.108+0000 7fe195e77700 1 -- 172.21.15.32:0/31858762 shutdown_connections 2023-10-08T06:09:50.110 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:50.108+0000 7fe195e77700 1 --2- 172.21.15.32:0/31858762 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fe17c066540 0x7fe17c068a00 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:50.110 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:50.108+0000 7fe195e77700 1 --2- 172.21.15.32:0/31858762 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe190159ed0 0x7fe1900c4bd0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:50.110 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:50.108+0000 7fe195e77700 1 --2- 172.21.15.32:0/31858762 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe19015a2b0 0x7fe190154780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:50.110 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:50.108+0000 7fe195e77700 1 --2- 172.21.15.32:0/31858762 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe1900c98c0 0x7fe190154fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:50.110 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:50.108+0000 7fe195e77700 1 -- 172.21.15.32:0/31858762 >> 172.21.15.32:0/31858762 conn(0x7fe1900b0900 msgr2=0x7fe1900afc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:09:50.110 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:50.108+0000 7fe195e77700 1 -- 172.21.15.32:0/31858762 shutdown_connections 2023-10-08T06:09:50.110 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:50.108+0000 7fe195e77700 1 -- 172.21.15.32:0/31858762 wait complete. 2023-10-08T06:09:50.126 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T06:09:50.234 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:50.232+0000 7f4876bc3700 1 Processor -- start 2023-10-08T06:09:50.234 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:50.232+0000 7f4876bc3700 1 -- start start 2023-10-08T06:09:50.235 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:50.232+0000 7f4876bc3700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4870159940 0x7f48700cea40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:50.236 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:50.232+0000 7f4876bc3700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f48700ca3e0 0x7f4870070780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:50.236 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:50.232+0000 7f4876bc3700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f487006ae50 con 0x7f48700cef80 2023-10-08T06:09:50.236 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:50.232+0000 7f4876bc3700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f487006b0f0 con 0x7f48700ca3e0 2023-10-08T06:09:50.236 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:50.232+0000 7f4876bc3700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f487006b3d0 con 0x7f4870159940 2023-10-08T06:09:50.236 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:50.236+0000 7f48753c0700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f48700cef80 0x7f48700c9cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:57020/0 (socket says 172.21.15.32:57020) 2023-10-08T06:09:50.236 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:50.236+0000 7f48753c0700 1 -- 172.21.15.32:0/2099182311 learned_addr learned my addr 172.21.15.32:0/2099182311 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-08T06:09:50.236 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:50.236+0000 7f48763c2700 1 --2- 172.21.15.32:0/2099182311 >> v2:172.21.15.32:3300/0 conn(0x7f48700ca3e0 0x7f4870070780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:50.236 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:50.236+0000 7f4875bc1700 1 --2- 172.21.15.32:0/2099182311 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4870159940 0x7f48700cea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:50.238 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:50.236+0000 7f4874bbf700 1 -- 172.21.15.32:0/2099182311 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2332097296 0 0) 0x7f487006ae50 con 0x7f48700cef80 2023-10-08T06:09:50.238 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:50.236+0000 7f4874bbf700 1 -- 172.21.15.32:0/2099182311 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f485c0035d0 con 0x7f48700cef80 2023-10-08T06:09:50.238 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:50.236+0000 7f48763c2700 1 -- 172.21.15.32:0/2099182311 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4870159940 msgr2=0x7f48700cea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:09:50.238 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:50.236+0000 7f48763c2700 1 --2- 172.21.15.32:0/2099182311 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4870159940 0x7f48700cea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:50.238 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:50.236+0000 7f48763c2700 1 -- 172.21.15.32:0/2099182311 >> v1:172.21.15.32:6789/0 conn(0x7f48700cef80 legacy=0x7f48700c9cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:50.238 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:50.236+0000 7f48763c2700 1 -- 172.21.15.32:0/2099182311 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f487006b6b0 con 0x7f48700ca3e0 2023-10-08T06:09:50.239 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:50.236+0000 7f48763c2700 1 --2- 172.21.15.32:0/2099182311 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f48700ca3e0 0x7f4870070780 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f4868009d90 tx=0x7f486800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69dd99b9ffba529a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:50.239 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:50.236+0000 7f4874bbf700 1 -- 172.21.15.32:0/2099182311 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f486800e070 con 0x7f48700ca3e0 2023-10-08T06:09:50.239 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:50.236+0000 7f4874bbf700 1 -- 172.21.15.32:0/2099182311 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f486800bb20 con 0x7f48700ca3e0 2023-10-08T06:09:50.239 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:50.236+0000 7f4874bbf700 1 -- 172.21.15.32:0/2099182311 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4868012430 con 0x7f48700ca3e0 2023-10-08T06:09:50.239 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:50.236+0000 7f4876bc3700 1 -- 172.21.15.32:0/2099182311 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f48700ca3e0 msgr2=0x7f4870070780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:50.239 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:50.236+0000 7f4876bc3700 1 --2- 172.21.15.32:0/2099182311 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f48700ca3e0 0x7f4870070780 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f4868009d90 tx=0x7f486800b330 comp rx=0 tx=0).stop 2023-10-08T06:09:50.239 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:50.236+0000 7f4876bc3700 1 -- 172.21.15.32:0/2099182311 shutdown_connections 2023-10-08T06:09:50.239 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:50.236+0000 7f4876bc3700 1 --2- 172.21.15.32:0/2099182311 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f48700ca3e0 0x7f4870070780 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:50.239 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:50.236+0000 7f4876bc3700 1 --2- 172.21.15.32:0/2099182311 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4870159940 0x7f48700cea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:50.239 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:50.236+0000 7f4876bc3700 1 -- 172.21.15.32:0/2099182311 >> 172.21.15.32:0/2099182311 conn(0x7f48700cf470 msgr2=0x7f48700cf880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:09:50.239 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:50.236+0000 7f4876bc3700 1 -- 172.21.15.32:0/2099182311 shutdown_connections 2023-10-08T06:09:50.240 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:50.236+0000 7f4876bc3700 1 -- 172.21.15.32:0/2099182311 wait complete. 2023-10-08T06:09:50.240 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:50.240+0000 7f4876bc3700 1 Processor -- start 2023-10-08T06:09:50.240 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:50.240+0000 7f4876bc3700 1 -- start start 2023-10-08T06:09:50.241 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:50.240+0000 7f4876bc3700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f48700ca3e0 0x7f4870070d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:50.242 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:50.240+0000 7f4876bc3700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f48700cef80 0x7f48701582e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:50.242 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:50.240+0000 7f4876bc3700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4870159940 0x7f48701e6390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:50.242 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:50.240+0000 7f4876bc3700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48700c4930 con 0x7f48700cef80 2023-10-08T06:09:50.242 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:50.240+0000 7f4876bc3700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48700c4bd0 con 0x7f4870159940 2023-10-08T06:09:50.242 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:50.240+0000 7f4876bc3700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48700c4eb0 con 0x7f48700ca3e0 2023-10-08T06:09:50.242 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:50.240+0000 7f48753c0700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f48700cef80 0x7f48701582e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:50.242 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:50.240+0000 7f48753c0700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f48700cef80 0x7f48701582e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:52756/0 (socket says 172.21.15.32:52756) 2023-10-08T06:09:50.242 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:50.240+0000 7f48753c0700 1 -- 172.21.15.32:0/1966316580 learned_addr learned my addr 172.21.15.32:0/1966316580 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:09:50.242 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:50.240+0000 7f4875bc1700 1 --2- 172.21.15.32:0/1966316580 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f48700ca3e0 0x7f4870070d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:50.243 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:50.240+0000 7f48763c2700 1 --2- 172.21.15.32:0/1966316580 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4870159940 0x7f48701e6390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:50.243 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:50.240+0000 7f48753c0700 1 -- 172.21.15.32:0/1966316580 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f48700ca3e0 msgr2=0x7f4870070d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:50.243 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:50.240+0000 7f48753c0700 1 --2- 172.21.15.32:0/1966316580 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f48700ca3e0 0x7f4870070d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:50.243 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:50.240+0000 7f48753c0700 1 -- 172.21.15.32:0/1966316580 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4870159940 msgr2=0x7f48701e6390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:50.243 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:50.240+0000 7f48753c0700 1 --2- 172.21.15.32:0/1966316580 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4870159940 0x7f48701e6390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:50.243 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:50.240+0000 7f48753c0700 1 -- 172.21.15.32:0/1966316580 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4868009a70 con 0x7f48700cef80 2023-10-08T06:09:50.243 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:50.240+0000 7f48763c2700 1 --2- 172.21.15.32:0/1966316580 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4870159940 0x7f48701e6390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T06:09:50.243 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:50.240+0000 7f48753c0700 1 --2- 172.21.15.32:0/1966316580 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f48700cef80 0x7f48701582e0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f486000c700 tx=0x7f486000ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:50.244 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:50.240+0000 7f48667fc700 1 -- 172.21.15.32:0/1966316580 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4860005d90 con 0x7f48700cef80 2023-10-08T06:09:50.244 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:50.240+0000 7f48667fc700 1 -- 172.21.15.32:0/1966316580 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48600070d0 con 0x7f48700cef80 2023-10-08T06:09:50.244 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:50.240+0000 7f48667fc700 1 -- 172.21.15.32:0/1966316580 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4860007480 con 0x7f48700cef80 2023-10-08T06:09:50.244 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:50.240+0000 7f4876bc3700 1 -- 172.21.15.32:0/1966316580 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48700c5190 con 0x7f48700cef80 2023-10-08T06:09:50.244 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:50.240+0000 7f4876bc3700 1 -- 172.21.15.32:0/1966316580 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48700c5750 con 0x7f48700cef80 2023-10-08T06:09:50.244 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:50.244+0000 7f4876bc3700 1 -- 172.21.15.32:0/1966316580 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48700686a0 con 0x7f48700cef80 2023-10-08T06:09:50.245 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:50.244+0000 7f48667fc700 1 -- 172.21.15.32:0/1966316580 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f48600075e0 con 0x7f48700cef80 2023-10-08T06:09:50.245 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:50.244+0000 7f48667fc700 1 --2- 172.21.15.32:0/1966316580 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f4854066510 0x7f48540689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:50.245 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:50.244+0000 7f48667fc700 1 -- 172.21.15.32:0/1966316580 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4860083310 con 0x7f48700cef80 2023-10-08T06:09:50.245 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:50.244+0000 7f4875bc1700 1 --2- 172.21.15.32:0/1966316580 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f4854066510 0x7f48540689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:50.246 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:50.244+0000 7f4875bc1700 1 --2- 172.21.15.32:0/1966316580 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f4854066510 0x7f48540689d0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f486c00ac50 tx=0x7f486c00a350 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:50.252 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:50.252+0000 7f48667fc700 1 -- 172.21.15.32:0/1966316580 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f4860050820 con 0x7f48700cef80 2023-10-08T06:09:50.453 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:50.452+0000 7f4876bc3700 1 -- 172.21.15.32:0/1966316580 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4870073360 con 0x7f48700cef80 2023-10-08T06:09:50.454 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:50.452+0000 7f48667fc700 1 -- 172.21.15.32:0/1966316580 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4907 (secure 0 0 0) 0x7f4860053e40 con 0x7f48700cef80 2023-10-08T06:09:50.454 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:09:50.454 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6833/2405386193","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":2405386193},{"type":"v1","addr":"172.21.15.40:6833","nonce":2405386193}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4254,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6835/1810658720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6834","nonce":1810658720},{"type":"v1","addr":"172.21.15.32:6835","nonce":1810658720}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4257,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6837/2286934165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6836","nonce":2286934165},{"type":"v1","addr":"172.21.15.32:6837","nonce":2286934165}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T06:09:36.528026+0000","modified":"2023-10-08T06:09:38.533661+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4318},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4318":{"gid":4318,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.40:6835/3325966535","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":3325966535},{"type":"v1","addr":"172.21.15.40:6835","nonce":3325966535}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-08T06:09:50.457 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:50.456+0000 7f4876bc3700 1 -- 172.21.15.32:0/1966316580 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f4854066510 msgr2=0x7f48540689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:50.457 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:50.456+0000 7f4876bc3700 1 --2- 172.21.15.32:0/1966316580 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f4854066510 0x7f48540689d0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f486c00ac50 tx=0x7f486c00a350 comp rx=0 tx=0).stop 2023-10-08T06:09:50.457 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:50.456+0000 7f4876bc3700 1 -- 172.21.15.32:0/1966316580 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f48700cef80 msgr2=0x7f48701582e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:50.457 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:50.456+0000 7f4876bc3700 1 --2- 172.21.15.32:0/1966316580 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f48700cef80 0x7f48701582e0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f486000c700 tx=0x7f486000ca10 comp rx=0 tx=0).stop 2023-10-08T06:09:50.457 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:50.456+0000 7f4876bc3700 1 -- 172.21.15.32:0/1966316580 shutdown_connections 2023-10-08T06:09:50.458 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:50.456+0000 7f4876bc3700 1 --2- 172.21.15.32:0/1966316580 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f4854066510 0x7f48540689d0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:50.458 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:50.456+0000 7f4876bc3700 1 --2- 172.21.15.32:0/1966316580 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f48700cef80 0x7f48701582e0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:50.458 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:50.456+0000 7f4876bc3700 1 --2- 172.21.15.32:0/1966316580 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4870159940 0x7f48701e6390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:50.458 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:50.456+0000 7f4876bc3700 1 --2- 172.21.15.32:0/1966316580 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f48700ca3e0 0x7f4870070d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:50.458 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:50.456+0000 7f4876bc3700 1 -- 172.21.15.32:0/1966316580 >> 172.21.15.32:0/1966316580 conn(0x7f48700cf470 msgr2=0x7f48700715f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:09:50.458 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:50.456+0000 7f4876bc3700 1 -- 172.21.15.32:0/1966316580 shutdown_connections 2023-10-08T06:09:50.459 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:50.456+0000 7f4876bc3700 1 -- 172.21.15.32:0/1966316580 wait complete. 2023-10-08T06:09:50.459 INFO:teuthology.orchestra.run.smithi032.stderr:dumped fsmap epoch 6 2023-10-08T06:09:50.871 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 6, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-08T06:09:36.528026+0000', 'modified': '2023-10-08T06:09:38.533661+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4318}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4318': {'gid': 4318, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.40:6835/3325966535', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.40:6834', 'nonce': 3325966535}, {'type': 'v1', 'addr': '172.21.15.40:6835', 'nonce': 3325966535}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-10-08T06:09:50.872 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-08T06:09:50.872 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-10-08T06:09:50.997 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:50.996+0000 7f12d898f700 1 Processor -- start 2023-10-08T06:09:50.997 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:50.996+0000 7f12d898f700 1 -- start start 2023-10-08T06:09:50.999 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:50.996+0000 7f12d898f700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f12d415b980 0x7f12d415f780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:50.999 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:50.996+0000 7f12d898f700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f12d40c9b30 0x7f12d415bd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:50.999 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:50.996+0000 7f12d898f700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12d406fc20 con 0x7f12d40719e0 2023-10-08T06:09:50.999 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:50.996+0000 7f12d898f700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12d4070430 con 0x7f12d415b980 2023-10-08T06:09:50.999 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:50.996+0000 7f12d898f700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12d415ed70 con 0x7f12d40c9b30 2023-10-08T06:09:50.999 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:50.996+0000 7f12d2d9d700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f12d415b980 0x7f12d415f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:50.999 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:50.996+0000 7f12d2d9d700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f12d415b980 0x7f12d415f780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:52768/0 (socket says 172.21.15.32:52768) 2023-10-08T06:09:51.000 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:50.996+0000 7f12d2d9d700 1 -- 172.21.15.32:0/1198667878 learned_addr learned my addr 172.21.15.32:0/1198667878 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:09:51.000 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:50.996+0000 7f12d359e700 1 --2- 172.21.15.32:0/1198667878 >> v2:172.21.15.40:3300/0 conn(0x7f12d40c9b30 0x7f12d415bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:51.000 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:50.996+0000 7f12d2d9d700 1 -- 172.21.15.32:0/1198667878 >> v2:172.21.15.40:3300/0 conn(0x7f12d40c9b30 msgr2=0x7f12d415bd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:09:51.000 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:50.996+0000 7f12d2d9d700 1 --2- 172.21.15.32:0/1198667878 >> v2:172.21.15.40:3300/0 conn(0x7f12d40c9b30 0x7f12d415bd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:51.000 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:50.996+0000 7f12d2d9d700 1 -- 172.21.15.32:0/1198667878 >> v1:172.21.15.40:6789/0 conn(0x7f12d40719e0 legacy=0x7f12d40c9420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:51.000 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:50.996+0000 7f12d2d9d700 1 -- 172.21.15.32:0/1198667878 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12d415fcc0 con 0x7f12d415b980 2023-10-08T06:09:51.001 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:50.996+0000 7f12d2d9d700 1 --2- 172.21.15.32:0/1198667878 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f12d415b980 0x7f12d415f780 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f12d40686d0 tx=0x7f12bc009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df8cf2bcbef8576e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:51.001 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.000+0000 7f12d1d9b700 1 -- 172.21.15.32:0/1198667878 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12bc00b8a0 con 0x7f12d415b980 2023-10-08T06:09:51.001 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.000+0000 7f12d1d9b700 1 -- 172.21.15.32:0/1198667878 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12bc00ba00 con 0x7f12d415b980 2023-10-08T06:09:51.001 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.000+0000 7f12d1d9b700 1 -- 172.21.15.32:0/1198667878 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12bc00bd90 con 0x7f12d415b980 2023-10-08T06:09:51.001 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.000+0000 7f12d898f700 1 -- 172.21.15.32:0/1198667878 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f12d415b980 msgr2=0x7f12d415f780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:51.002 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.000+0000 7f12d898f700 1 --2- 172.21.15.32:0/1198667878 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f12d415b980 0x7f12d415f780 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f12d40686d0 tx=0x7f12bc009bf0 comp rx=0 tx=0).stop 2023-10-08T06:09:51.002 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.000+0000 7f12d898f700 1 -- 172.21.15.32:0/1198667878 shutdown_connections 2023-10-08T06:09:51.002 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.000+0000 7f12d898f700 1 --2- 172.21.15.32:0/1198667878 >> v2:172.21.15.40:3300/0 conn(0x7f12d40c9b30 0x7f12d415bd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:51.002 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.000+0000 7f12d898f700 1 --2- 172.21.15.32:0/1198667878 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f12d415b980 0x7f12d415f780 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:51.002 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.000+0000 7f12d898f700 1 -- 172.21.15.32:0/1198667878 >> 172.21.15.32:0/1198667878 conn(0x7f12d40b0900 msgr2=0x7f12d40b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:09:51.002 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.000+0000 7f12d898f700 1 -- 172.21.15.32:0/1198667878 shutdown_connections 2023-10-08T06:09:51.002 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.000+0000 7f12d898f700 1 -- 172.21.15.32:0/1198667878 wait complete. 2023-10-08T06:09:51.003 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.000+0000 7f12d898f700 1 Processor -- start 2023-10-08T06:09:51.003 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.000+0000 7f12d898f700 1 -- start start 2023-10-08T06:09:51.004 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.000+0000 7f12d898f700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f12d40719e0 0x7f12d41578a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:51.004 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.000+0000 7f12d898f700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f12d40c9b30 0x7f12d4153c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:51.004 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.000+0000 7f12d898f700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f12d415b980 0x7f12d406bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:51.004 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.000+0000 7f12d898f700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12d40c4fc0 con 0x7f12d415b980 2023-10-08T06:09:51.004 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.000+0000 7f12d898f700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12d4157de0 con 0x7f12d40c9b30 2023-10-08T06:09:51.004 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.000+0000 7f12d898f700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12d40c40d0 con 0x7f12d40719e0 2023-10-08T06:09:51.004 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.004+0000 7f12d359e700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f12d415b980 0x7f12d406bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:51.004 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.004+0000 7f12d359e700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f12d415b980 0x7f12d406bcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:52784/0 (socket says 172.21.15.32:52784) 2023-10-08T06:09:51.004 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.004+0000 7f12d2d9d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f12d40719e0 0x7f12d41578a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:51.005 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.004+0000 7f12d359e700 1 -- 172.21.15.32:0/1299170830 learned_addr learned my addr 172.21.15.32:0/1299170830 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:09:51.005 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.004+0000 7f12d259c700 1 --2- 172.21.15.32:0/1299170830 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f12d40c9b30 0x7f12d4153c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:51.006 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.004+0000 7f12d359e700 1 -- 172.21.15.32:0/1299170830 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f12d40719e0 msgr2=0x7f12d41578a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:51.006 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.004+0000 7f12d359e700 1 --2- 172.21.15.32:0/1299170830 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f12d40719e0 0x7f12d41578a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:51.006 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.004+0000 7f12d359e700 1 -- 172.21.15.32:0/1299170830 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f12d40c9b30 msgr2=0x7f12d4153c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:51.006 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.004+0000 7f12d359e700 1 --2- 172.21.15.32:0/1299170830 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f12d40c9b30 0x7f12d4153c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:51.006 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.004+0000 7f12d359e700 1 -- 172.21.15.32:0/1299170830 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12bc009570 con 0x7f12d415b980 2023-10-08T06:09:51.006 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.004+0000 7f12d359e700 1 --2- 172.21.15.32:0/1299170830 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f12d415b980 0x7f12d406bcf0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f12cc00e810 tx=0x7f12cc00eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:51.006 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.004+0000 7f12cb7fe700 1 -- 172.21.15.32:0/1299170830 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12cc00c070 con 0x7f12d415b980 2023-10-08T06:09:51.006 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.004+0000 7f12cb7fe700 1 -- 172.21.15.32:0/1299170830 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12cc013630 con 0x7f12d415b980 2023-10-08T06:09:51.006 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.004+0000 7f12d898f700 1 -- 172.21.15.32:0/1299170830 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12d40c43b0 con 0x7f12d415b980 2023-10-08T06:09:51.007 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.004+0000 7f12cb7fe700 1 -- 172.21.15.32:0/1299170830 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12cc0139e0 con 0x7f12d415b980 2023-10-08T06:09:51.007 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.004+0000 7f12d898f700 1 -- 172.21.15.32:0/1299170830 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12d40c4970 con 0x7f12d415b980 2023-10-08T06:09:51.008 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.008+0000 7f12cb7fe700 1 -- 172.21.15.32:0/1299170830 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f12cc013b40 con 0x7f12d415b980 2023-10-08T06:09:51.009 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.008+0000 7f12cb7fe700 1 --2- 172.21.15.32:0/1299170830 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f12b4066510 0x7f12b40689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:51.010 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.008+0000 7f12d2d9d700 1 --2- 172.21.15.32:0/1299170830 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f12b4066510 0x7f12b40689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:51.010 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.008+0000 7f12cb7fe700 1 -- 172.21.15.32:0/1299170830 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f12cc083b80 con 0x7f12d415b980 2023-10-08T06:09:51.010 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.008+0000 7f12d2d9d700 1 --2- 172.21.15.32:0/1299170830 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f12b4066510 0x7f12b40689d0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f12bc000c00 tx=0x7f12bc008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:51.011 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.012+0000 7f12dc44c740 1 Processor -- start 2023-10-08T06:09:51.012 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.012+0000 7f12dc44c740 1 -- start start 2023-10-08T06:09:51.013 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.012+0000 7f12dc44c740 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x1f05ca0 0x1f06080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:51.013 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.012+0000 7f12dc44c740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x1eedb20 0x1ec74c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:51.014 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.012+0000 7f12dc44c740 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x1ec7a00 0x1ec7de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:51.014 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.012+0000 7f12dc44c740 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x1e37620 con 0x1ec7a00 2023-10-08T06:09:51.014 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.012+0000 7f12dc44c740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x1e34d10 con 0x1eedb20 2023-10-08T06:09:51.014 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.012+0000 7f12dc44c740 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x1e30600 con 0x1f05ca0 2023-10-08T06:09:51.014 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.012+0000 7f12d359e700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x1ec7a00 0x1ec7de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:51.014 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.012+0000 7f12d359e700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x1ec7a00 0x1ec7de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:52800/0 (socket says 172.21.15.32:52800) 2023-10-08T06:09:51.014 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.012+0000 7f12d359e700 1 -- 172.21.15.32:0/3335529891 learned_addr learned my addr 172.21.15.32:0/3335529891 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:09:51.014 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.012+0000 7f12d2d9d700 1 --2- 172.21.15.32:0/3335529891 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x1f05ca0 0x1f06080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:51.014 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.012+0000 7f12d259c700 1 --2- 172.21.15.32:0/3335529891 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x1eedb20 0x1ec74c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:51.015 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.012+0000 7f12d359e700 1 -- 172.21.15.32:0/3335529891 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x1f05ca0 msgr2=0x1f06080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:09:51.015 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.012+0000 7f12d359e700 1 --2- 172.21.15.32:0/3335529891 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x1f05ca0 0x1f06080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:51.015 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.012+0000 7f12d359e700 1 -- 172.21.15.32:0/3335529891 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x1eedb20 msgr2=0x1ec74c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:09:51.015 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.012+0000 7f12d359e700 1 --2- 172.21.15.32:0/3335529891 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x1eedb20 0x1ec74c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:51.015 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.012+0000 7f12d359e700 1 -- 172.21.15.32:0/3335529891 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1e55850 con 0x1ec7a00 2023-10-08T06:09:51.016 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.012+0000 7f12d359e700 1 --2- 172.21.15.32:0/3335529891 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x1ec7a00 0x1ec7de0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f12cc05ca90 tx=0x7f12cc054930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2bad9ada76968c3 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:51.016 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.012+0000 7f12c8ff9700 1 -- 172.21.15.32:0/3335529891 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12cc058e10 con 0x1ec7a00 2023-10-08T06:09:51.016 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.012+0000 7f12c8ff9700 1 -- 172.21.15.32:0/3335529891 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12cc05cfc0 con 0x1ec7a00 2023-10-08T06:09:51.016 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.012+0000 7f12c8ff9700 1 -- 172.21.15.32:0/3335529891 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12cc053060 con 0x1ec7a00 2023-10-08T06:09:51.017 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.012+0000 7f12dc44c740 1 -- 172.21.15.32:0/3335529891 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x1ec7a00 msgr2=0x1ec7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:51.017 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.012+0000 7f12dc44c740 1 --2- 172.21.15.32:0/3335529891 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x1ec7a00 0x1ec7de0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f12cc05ca90 tx=0x7f12cc054930 comp rx=0 tx=0).stop 2023-10-08T06:09:51.017 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.012+0000 7f12dc44c740 1 -- 172.21.15.32:0/3335529891 shutdown_connections 2023-10-08T06:09:51.017 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.012+0000 7f12dc44c740 1 --2- 172.21.15.32:0/3335529891 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x1ec7a00 0x1ec7de0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:51.017 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.016+0000 7f12dc44c740 1 --2- 172.21.15.32:0/3335529891 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x1eedb20 0x1ec74c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:51.017 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.016+0000 7f12dc44c740 1 --2- 172.21.15.32:0/3335529891 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x1f05ca0 0x1f06080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:51.017 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.016+0000 7f12dc44c740 1 -- 172.21.15.32:0/3335529891 >> 172.21.15.32:0/3335529891 conn(0x1c554d0 msgr2=0x1ef0160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:09:51.017 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.016+0000 7f12dc44c740 1 -- 172.21.15.32:0/3335529891 shutdown_connections 2023-10-08T06:09:51.017 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.016+0000 7f12dc44c740 1 -- 172.21.15.32:0/3335529891 wait complete. 2023-10-08T06:09:51.018 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.016+0000 7f12dc44c740 1 -- start start 2023-10-08T06:09:51.018 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.016+0000 7f12dc44c740 1 Processor -- start 2023-10-08T06:09:51.020 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.016+0000 7f12dc44c740 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x1ec7a00 0x1ef80b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:51.020 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.016+0000 7f12dc44c740 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x1eedb20 0x1ef65c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:51.020 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.016+0000 7f12dc44c740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x1f05ca0 0x1ee9910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:51.020 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.016+0000 7f12dc44c740 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x1dee6e0 con 0x1eedb20 2023-10-08T06:09:51.020 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.016+0000 7f12dc44c740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x1dee380 con 0x1f05ca0 2023-10-08T06:09:51.020 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.016+0000 7f12dc44c740 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x1cd9aa0 con 0x1ec7a00 2023-10-08T06:09:51.020 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.016+0000 7f12dc44c740 10 client.0 _ll_register_callbacks cb 0x1ddda10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T06:09:51.020 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.016+0000 7f12d259c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x1eedb20 0x1ef65c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:51.021 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.016+0000 7f12d259c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x1eedb20 0x1ef65c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:52802/0 (socket says 172.21.15.32:52802) 2023-10-08T06:09:51.021 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.016+0000 7f12d259c700 1 -- 172.21.15.32:0/1387573441 learned_addr learned my addr 172.21.15.32:0/1387573441 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:09:51.021 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.016+0000 7f12d2d9d700 1 --2- 172.21.15.32:0/1387573441 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x1ec7a00 0x1ef80b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:51.021 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.016+0000 7f12d359e700 1 --2- 172.21.15.32:0/1387573441 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x1f05ca0 0x1ee9910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:51.021 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.016+0000 7f12d259c700 1 -- 172.21.15.32:0/1387573441 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x1ec7a00 msgr2=0x1ef80b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:09:51.021 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.016+0000 7f12d259c700 1 --2- 172.21.15.32:0/1387573441 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x1ec7a00 0x1ef80b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:51.021 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.016+0000 7f12d259c700 1 -- 172.21.15.32:0/1387573441 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x1f05ca0 msgr2=0x1ee9910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:09:51.021 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.016+0000 7f12d259c700 1 --2- 172.21.15.32:0/1387573441 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x1f05ca0 0x1ee9910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:51.021 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.016+0000 7f12d259c700 1 -- 172.21.15.32:0/1387573441 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12d40c4970 con 0x1eedb20 2023-10-08T06:09:51.021 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.020+0000 7f12d259c700 1 --2- 172.21.15.32:0/1387573441 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x1eedb20 0x1ef65c0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f12c4012a10 tx=0x7f12c4012d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90ed8c05f353ebf0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:51.021 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.020+0000 7f12b1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.32:3300/0 2023-10-08T06:09:51.022 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.020+0000 7f12b1ffb700 1 -- 172.21.15.32:0/1387573441 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12c4012eb0 con 0x1eedb20 2023-10-08T06:09:51.022 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.020+0000 7f12b1ffb700 1 -- 172.21.15.32:0/1387573441 <== mon.0 v2:172.21.15.32:3300/0 2 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f12c4003c30 con 0x1eedb20 2023-10-08T06:09:51.022 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.020+0000 7f12dc44c740 1 -- 172.21.15.32:0/1387573441 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x1e295e0 con 0x1eedb20 2023-10-08T06:09:51.023 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.020+0000 7f12b1ffb700 1 -- 172.21.15.32:0/1387573441 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) v2 ==== 24+0+0 (secure 0 0 0) 0x7f12c4003e10 con 0x1eedb20 2023-10-08T06:09:51.023 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.020+0000 7f12dc44c740 10 client.4671 fetch_fsmap learned FSMap version 6 2023-10-08T06:09:51.023 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.020+0000 7f12dc44c740 1 -- 172.21.15.32:0/1387573441 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) v3 -- 0x1ca0960 con 0x1eedb20 2023-10-08T06:09:51.023 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.020+0000 7f12b1ffb700 1 -- 172.21.15.32:0/1387573441 <== mon.0 v2:172.21.15.32:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x1e295e0 con 0x1eedb20 2023-10-08T06:09:51.023 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.020+0000 7f12b1ffb700 1 -- 172.21.15.32:0/1387573441 <== mon.0 v2:172.21.15.32:3300/0 5 ==== fsmap(e 6) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f12c4010730 con 0x1eedb20 2023-10-08T06:09:51.024 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.020+0000 7f12dc44c740 10 client.4671 fetch_fsmap finished waiting for FSMap version 6 2023-10-08T06:09:51.024 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.020+0000 7f12dc44c740 10 client.4671 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-08T06:09:51.024 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.020+0000 7f12dc44c740 20 client.4671 populate_metadata read hostname 'smithi032' 2023-10-08T06:09:51.024 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.020+0000 7f12dc44c740 1 --2- 172.21.15.32:0/1387573441 >> [v2:172.21.15.40:6834/3325966535,v1:172.21.15.40:6835/3325966535] conn(0x1eeac80 0x1eeba80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:51.024 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.020+0000 7f12dc44c740 4 client.4671 mds_command: new command op to 4318 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T06:09:51.024 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.020+0000 7f12dc44c740 1 -- 172.21.15.32:0/1387573441 --> [v2:172.21.15.40:6834/3325966535,v1:172.21.15.40:6835/3325966535] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x1de9470 con 0x1eeac80 2023-10-08T06:09:51.024 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.020+0000 7f12d2d9d700 1 --2- 172.21.15.32:0/1387573441 >> [v2:172.21.15.40:6834/3325966535,v1:172.21.15.40:6835/3325966535] conn(0x1eeac80 0x1eeba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:51.024 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.020+0000 7f12d2d9d700 1 --2- 172.21.15.32:0/1387573441 >> [v2:172.21.15.40:6834/3325966535,v1:172.21.15.40:6835/3325966535] conn(0x1eeac80 0x1eeba80 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2a033126c7139705 server_cookie=33d44c909e8ccbbb in_seq=0 out_seq=0 2023-10-08T06:09:51.024 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.020+0000 7f12b1ffb700 10 client.4671 ms_handle_connect on v2:172.21.15.40:6834/3325966535 2023-10-08T06:09:51.025 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.024+0000 7f12b1ffb700 1 -- 172.21.15.32:0/1387573441 <== mds.0 v2:172.21.15.40:6834/3325966535 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x1de9470 con 0x1eeac80 2023-10-08T06:09:51.025 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.024+0000 7f12b1ffb700 10 client.4671 handle_command_reply: tid=0 2023-10-08T06:09:51.026 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.024+0000 7f12dc44c740 1 client.4671 shutdown 2023-10-08T06:09:51.026 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.024+0000 7f12dc44c740 1 -- 172.21.15.32:0/1387573441 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x1eedb20 msgr2=0x1ef65c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:51.026 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.024+0000 7f12dc44c740 1 --2- 172.21.15.32:0/1387573441 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x1eedb20 0x1ef65c0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f12c4012a10 tx=0x7f12c4012d20 comp rx=0 tx=0).stop 2023-10-08T06:09:51.026 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.024+0000 7f12dc44c740 1 -- 172.21.15.32:0/1387573441 shutdown_connections 2023-10-08T06:09:51.026 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.024+0000 7f12dc44c740 1 --2- 172.21.15.32:0/1387573441 >> [v2:172.21.15.40:6834/3325966535,v1:172.21.15.40:6835/3325966535] conn(0x1eeac80 0x1eeba80 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:51.026 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.024+0000 7f12dc44c740 1 --2- 172.21.15.32:0/1387573441 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x1eedb20 0x1ef65c0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:51.026 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.024+0000 7f12dc44c740 1 --2- 172.21.15.32:0/1387573441 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x1f05ca0 0x1ee9910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:51.026 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.024+0000 7f12b1ffb700 0 client.4671 ms_handle_reset on v2:172.21.15.40:6834/3325966535 2023-10-08T06:09:51.026 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.024+0000 7f12dc44c740 1 --2- 172.21.15.32:0/1387573441 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x1ec7a00 0x1ef80b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:51.026 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.024+0000 7f12dc44c740 1 -- 172.21.15.32:0/1387573441 >> 172.21.15.32:0/1387573441 conn(0x1c554d0 msgr2=0x1ec95c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:09:51.027 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.024+0000 7f12dc44c740 1 -- 172.21.15.32:0/1387573441 shutdown_connections 2023-10-08T06:09:51.027 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.024+0000 7f12dc44c740 1 -- 172.21.15.32:0/1387573441 wait complete. 2023-10-08T06:09:51.027 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.024+0000 7f12dc44c740 20 client.4671 trim_cache size 0 max 16384 2023-10-08T06:09:51.047 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.044+0000 7f12dc44c740 1 Processor -- start 2023-10-08T06:09:51.047 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.044+0000 7f12dc44c740 1 -- start start 2023-10-08T06:09:51.049 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.044+0000 7f12dc44c740 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x1ec7a00 0x1ec96c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:51.049 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.044+0000 7f12dc44c740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x1eedb20 0x1ee8160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:51.049 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.044+0000 7f12dc44c740 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x1f05ca0 0x1ee86a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:51.049 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.044+0000 7f12dc44c740 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x1ebe440 con 0x1f05ca0 2023-10-08T06:09:51.049 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.044+0000 7f12dc44c740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x1e30eb0 con 0x1eedb20 2023-10-08T06:09:51.049 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.044+0000 7f12dc44c740 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x1ddc6d0 con 0x1ec7a00 2023-10-08T06:09:51.050 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.048+0000 7f12d359e700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x1f05ca0 0x1ee86a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:51.050 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.048+0000 7f12d359e700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x1f05ca0 0x1ee86a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:52806/0 (socket says 172.21.15.32:52806) 2023-10-08T06:09:51.050 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.048+0000 7f12d359e700 1 -- 172.21.15.32:0/3483210106 learned_addr learned my addr 172.21.15.32:0/3483210106 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:09:51.050 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.048+0000 7f12d259c700 1 --2- 172.21.15.32:0/3483210106 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x1eedb20 0x1ee8160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:51.050 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.048+0000 7f12d2d9d700 1 --2- 172.21.15.32:0/3483210106 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x1ec7a00 0x1ec96c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:51.050 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.048+0000 7f12d359e700 1 -- 172.21.15.32:0/3483210106 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x1ec7a00 msgr2=0x1ec96c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:09:51.050 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.048+0000 7f12d359e700 1 --2- 172.21.15.32:0/3483210106 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x1ec7a00 0x1ec96c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:51.050 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.048+0000 7f12d359e700 1 -- 172.21.15.32:0/3483210106 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x1eedb20 msgr2=0x1ee8160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:09:51.050 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.048+0000 7f12d359e700 1 --2- 172.21.15.32:0/3483210106 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x1eedb20 0x1ee8160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:51.050 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.048+0000 7f12d359e700 1 -- 172.21.15.32:0/3483210106 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1df34f0 con 0x1f05ca0 2023-10-08T06:09:51.050 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.048+0000 7f12d259c700 1 --2- 172.21.15.32:0/3483210106 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x1eedb20 0x1ee8160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T06:09:51.051 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.048+0000 7f12d359e700 1 --2- 172.21.15.32:0/3483210106 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x1f05ca0 0x1ee86a0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f12cc054c50 tx=0x7f12cc069000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57e5c504fc3de334 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:51.051 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.048+0000 7f12c97fa700 1 -- 172.21.15.32:0/3483210106 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12cc009e90 con 0x1f05ca0 2023-10-08T06:09:51.051 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.048+0000 7f12c97fa700 1 -- 172.21.15.32:0/3483210106 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12cc072e90 con 0x1f05ca0 2023-10-08T06:09:51.051 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.048+0000 7f12c97fa700 1 -- 172.21.15.32:0/3483210106 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12cc058e10 con 0x1f05ca0 2023-10-08T06:09:51.054 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.048+0000 7f12dc44c740 1 -- 172.21.15.32:0/3483210106 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x1f05ca0 msgr2=0x1ee86a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:51.055 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.048+0000 7f12dc44c740 1 --2- 172.21.15.32:0/3483210106 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x1f05ca0 0x1ee86a0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f12cc054c50 tx=0x7f12cc069000 comp rx=0 tx=0).stop 2023-10-08T06:09:51.055 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.048+0000 7f12dc44c740 1 -- 172.21.15.32:0/3483210106 shutdown_connections 2023-10-08T06:09:51.055 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.048+0000 7f12dc44c740 1 --2- 172.21.15.32:0/3483210106 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x1f05ca0 0x1ee86a0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:51.055 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.048+0000 7f12dc44c740 1 --2- 172.21.15.32:0/3483210106 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x1eedb20 0x1ee8160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:51.055 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.048+0000 7f12dc44c740 1 --2- 172.21.15.32:0/3483210106 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x1ec7a00 0x1ec96c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:51.055 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.048+0000 7f12dc44c740 1 -- 172.21.15.32:0/3483210106 >> 172.21.15.32:0/3483210106 conn(0x1c554d0 msgr2=0x1ef7ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:09:51.055 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.048+0000 7f12dc44c740 1 -- 172.21.15.32:0/3483210106 shutdown_connections 2023-10-08T06:09:51.055 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.048+0000 7f12dc44c740 1 -- 172.21.15.32:0/3483210106 wait complete. 2023-10-08T06:09:51.055 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.048+0000 7f12dc44c740 1 -- start start 2023-10-08T06:09:51.055 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.048+0000 7f12dc44c740 1 Processor -- start 2023-10-08T06:09:51.056 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.052+0000 7f12dc44c740 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x1ec7a00 0x1f29750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:51.056 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.052+0000 7f12dc44c740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x1eedb20 0x1ee91b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:51.056 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.052+0000 7f12dc44c740 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x1f05ca0 0x1ee96f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:51.056 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.052+0000 7f12dc44c740 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x1f275b0 con 0x1f05ca0 2023-10-08T06:09:51.056 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.052+0000 7f12dc44c740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x1f04f20 con 0x1eedb20 2023-10-08T06:09:51.056 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.052+0000 7f12dc44c740 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x1f27790 con 0x1ec7a00 2023-10-08T06:09:51.056 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.052+0000 7f12dc44c740 10 client.0 _ll_register_callbacks cb 0x1df54b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T06:09:51.056 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.052+0000 7f12d359e700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x1f05ca0 0x1ee96f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:51.056 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.052+0000 7f12d2d9d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x1ec7a00 0x1f29750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:51.056 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.052+0000 7f12d359e700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x1f05ca0 0x1ee96f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:52808/0 (socket says 172.21.15.32:52808) 2023-10-08T06:09:51.056 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.052+0000 7f12d359e700 1 -- 172.21.15.32:0/2850657170 learned_addr learned my addr 172.21.15.32:0/2850657170 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:09:51.057 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.052+0000 7f12d259c700 1 --2- 172.21.15.32:0/2850657170 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x1eedb20 0x1ee91b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:51.057 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.052+0000 7f12d359e700 1 -- 172.21.15.32:0/2850657170 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x1ec7a00 msgr2=0x1f29750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:09:51.057 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.052+0000 7f12d359e700 1 --2- 172.21.15.32:0/2850657170 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x1ec7a00 0x1f29750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:51.057 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.052+0000 7f12d359e700 1 -- 172.21.15.32:0/2850657170 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x1eedb20 msgr2=0x1ee91b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:09:51.057 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.052+0000 7f12d359e700 1 --2- 172.21.15.32:0/2850657170 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x1eedb20 0x1ee91b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:51.057 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.052+0000 7f12d359e700 1 -- 172.21.15.32:0/2850657170 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x1ca0960 con 0x1f05ca0 2023-10-08T06:09:51.057 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.052+0000 7f12d2d9d700 1 --2- 172.21.15.32:0/2850657170 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x1ec7a00 0x1f29750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T06:09:51.057 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.052+0000 7f12d259c700 1 --2- 172.21.15.32:0/2850657170 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x1eedb20 0x1ee91b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T06:09:51.057 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.052+0000 7f12d359e700 1 --2- 172.21.15.32:0/2850657170 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x1f05ca0 0x1ee96f0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f12cc00ee70 tx=0x7f12cc01e040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12d49d9fbe1ec538 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:51.057 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.052+0000 7f12b1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.32:3300/0 2023-10-08T06:09:51.057 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.052+0000 7f12b1ffb700 1 -- 172.21.15.32:0/2850657170 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12cc009e90 con 0x1f05ca0 2023-10-08T06:09:51.058 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.052+0000 7f12b1ffb700 1 -- 172.21.15.32:0/2850657170 <== mon.0 v2:172.21.15.32:3300/0 2 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f12cc058e10 con 0x1f05ca0 2023-10-08T06:09:51.058 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.052+0000 7f12dc44c740 1 -- 172.21.15.32:0/2850657170 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f12cc05cfc0 con 0x1f05ca0 2023-10-08T06:09:51.058 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.052+0000 7f12b1ffb700 1 -- 172.21.15.32:0/2850657170 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) v2 ==== 24+0+0 (secure 0 0 0) 0x7f12cc052e00 con 0x1f05ca0 2023-10-08T06:09:51.058 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.052+0000 7f12dc44c740 10 client.4677 fetch_fsmap learned FSMap version 6 2023-10-08T06:09:51.058 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.052+0000 7f12dc44c740 1 -- 172.21.15.32:0/2850657170 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) v3 -- 0x7f12cc07f040 con 0x1f05ca0 2023-10-08T06:09:51.058 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.052+0000 7f12b1ffb700 1 -- 172.21.15.32:0/2850657170 <== mon.0 v2:172.21.15.32:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12cc05cfc0 con 0x1f05ca0 2023-10-08T06:09:51.058 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.052+0000 7f12b1ffb700 1 -- 172.21.15.32:0/2850657170 <== mon.0 v2:172.21.15.32:3300/0 5 ==== fsmap(e 6) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f12cc05f020 con 0x1f05ca0 2023-10-08T06:09:51.058 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.052+0000 7f12dc44c740 10 client.4677 fetch_fsmap finished waiting for FSMap version 6 2023-10-08T06:09:51.058 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.052+0000 7f12dc44c740 10 client.4677 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-08T06:09:51.058 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.052+0000 7f12dc44c740 20 client.4677 populate_metadata read hostname 'smithi032' 2023-10-08T06:09:51.058 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.052+0000 7f12dc44c740 1 --2- 172.21.15.32:0/2850657170 >> [v2:172.21.15.40:6834/3325966535,v1:172.21.15.40:6835/3325966535] conn(0x1f27ed0 0x1f282b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:51.059 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.052+0000 7f12dc44c740 4 client.4677 mds_command: new command op to 4318 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-08T06:09:51.059 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.052+0000 7f12dc44c740 1 -- 172.21.15.32:0/2850657170 --> [v2:172.21.15.40:6834/3325966535,v1:172.21.15.40:6835/3325966535] -- command(tid 0: {"prefix": "status"}) v1 -- 0x1cac460 con 0x1f27ed0 2023-10-08T06:09:51.059 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.052+0000 7f12d2d9d700 1 --2- 172.21.15.32:0/2850657170 >> [v2:172.21.15.40:6834/3325966535,v1:172.21.15.40:6835/3325966535] conn(0x1f27ed0 0x1f282b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:51.060 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.056+0000 7f12d2d9d700 1 --2- 172.21.15.32:0/2850657170 >> [v2:172.21.15.40:6834/3325966535,v1:172.21.15.40:6835/3325966535] conn(0x1f27ed0 0x1f282b0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9ee4946ae6081675 server_cookie=592c24535d5be50 in_seq=0 out_seq=0 2023-10-08T06:09:51.060 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.056+0000 7f12b1ffb700 10 client.4677 ms_handle_connect on v2:172.21.15.40:6834/3325966535 2023-10-08T06:09:51.060 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.056+0000 7f12b1ffb700 1 -- 172.21.15.32:0/2850657170 <== mds.0 v2:172.21.15.40:6834/3325966535 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x1cac460 con 0x1f27ed0 2023-10-08T06:09:51.060 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.056+0000 7f12b1ffb700 10 client.4677 handle_command_reply: tid=0 2023-10-08T06:09:51.060 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.056+0000 7f12dc44c740 1 client.4677 shutdown 2023-10-08T06:09:51.061 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.056+0000 7f12dc44c740 1 -- 172.21.15.32:0/2850657170 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x1f05ca0 msgr2=0x1ee96f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:51.061 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.056+0000 7f12dc44c740 1 --2- 172.21.15.32:0/2850657170 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x1f05ca0 0x1ee96f0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f12cc00ee70 tx=0x7f12cc01e040 comp rx=0 tx=0).stop 2023-10-08T06:09:51.061 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.056+0000 7f12dc44c740 1 -- 172.21.15.32:0/2850657170 shutdown_connections 2023-10-08T06:09:51.061 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.056+0000 7f12dc44c740 1 --2- 172.21.15.32:0/2850657170 >> [v2:172.21.15.40:6834/3325966535,v1:172.21.15.40:6835/3325966535] conn(0x1f27ed0 0x1f282b0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:51.061 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.056+0000 7f12dc44c740 1 --2- 172.21.15.32:0/2850657170 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x1f05ca0 0x1ee96f0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:51.061 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.056+0000 7f12b1ffb700 0 client.4677 ms_handle_reset on v2:172.21.15.40:6834/3325966535 2023-10-08T06:09:51.061 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.056+0000 7f12dc44c740 1 --2- 172.21.15.32:0/2850657170 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x1eedb20 0x1ee91b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:51.061 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.056+0000 7f12dc44c740 1 --2- 172.21.15.32:0/2850657170 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x1ec7a00 0x1f29750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:51.061 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.056+0000 7f12dc44c740 1 -- 172.21.15.32:0/2850657170 >> 172.21.15.32:0/2850657170 conn(0x1c554d0 msgr2=0x1ef8750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:09:51.061 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.056+0000 7f12dc44c740 1 -- 172.21.15.32:0/2850657170 shutdown_connections 2023-10-08T06:09:51.061 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.056+0000 7f12dc44c740 1 -- 172.21.15.32:0/2850657170 wait complete. 2023-10-08T06:09:51.062 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.056+0000 7f12dc44c740 20 client.4677 trim_cache size 0 max 16384 2023-10-08T06:09:51.062 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2023-10-08T06:09:51.062 INFO:teuthology.orchestra.run.smithi032.stdout: "cluster_fsid": "ac672d87-96ae-41e0-9314-623ba2cdbbba", 2023-10-08T06:09:51.062 INFO:teuthology.orchestra.run.smithi032.stdout: "whoami": 0, 2023-10-08T06:09:51.062 INFO:teuthology.orchestra.run.smithi032.stdout: "id": 4318, 2023-10-08T06:09:51.062 INFO:teuthology.orchestra.run.smithi032.stdout: "want_state": "up:active", 2023-10-08T06:09:51.062 INFO:teuthology.orchestra.run.smithi032.stdout: "state": "up:active", 2023-10-08T06:09:51.062 INFO:teuthology.orchestra.run.smithi032.stdout: "fs_name": "cephfs", 2023-10-08T06:09:51.063 INFO:teuthology.orchestra.run.smithi032.stdout: "rank_uptime": 13.901165768, 2023-10-08T06:09:51.063 INFO:teuthology.orchestra.run.smithi032.stdout: "mdsmap_epoch": 6, 2023-10-08T06:09:51.063 INFO:teuthology.orchestra.run.smithi032.stdout: "osdmap_epoch": 22, 2023-10-08T06:09:51.063 INFO:teuthology.orchestra.run.smithi032.stdout: "osdmap_epoch_barrier": 22, 2023-10-08T06:09:51.063 INFO:teuthology.orchestra.run.smithi032.stdout: "uptime": 21.332439357999998 2023-10-08T06:09:51.063 INFO:teuthology.orchestra.run.smithi032.stdout:} 2023-10-08T06:09:51.064 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.056+0000 7f12d898f700 1 -- 172.21.15.32:0/1299170830 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f12b4066510 msgr2=0x7f12b40689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:51.064 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.056+0000 7f12d898f700 1 --2- 172.21.15.32:0/1299170830 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f12b4066510 0x7f12b40689d0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f12bc000c00 tx=0x7f12bc008030 comp rx=0 tx=0).stop 2023-10-08T06:09:51.064 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.056+0000 7f12d898f700 1 -- 172.21.15.32:0/1299170830 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f12d415b980 msgr2=0x7f12d406bcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:51.064 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.056+0000 7f12d898f700 1 --2- 172.21.15.32:0/1299170830 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f12d415b980 0x7f12d406bcf0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f12cc00e810 tx=0x7f12cc00eb20 comp rx=0 tx=0).stop 2023-10-08T06:09:51.064 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.056+0000 7f12d898f700 1 -- 172.21.15.32:0/1299170830 shutdown_connections 2023-10-08T06:09:51.064 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.056+0000 7f12d898f700 1 --2- 172.21.15.32:0/1299170830 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f12b4066510 0x7f12b40689d0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:51.064 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.056+0000 7f12d898f700 1 --2- 172.21.15.32:0/1299170830 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f12d415b980 0x7f12d406bcf0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:51.065 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.056+0000 7f12d898f700 1 --2- 172.21.15.32:0/1299170830 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f12d40c9b30 0x7f12d4153c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:51.065 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.056+0000 7f12d898f700 1 --2- 172.21.15.32:0/1299170830 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f12d40719e0 0x7f12d41578a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:51.065 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.056+0000 7f12d898f700 1 -- 172.21.15.32:0/1299170830 >> 172.21.15.32:0/1299170830 conn(0x7f12d40b0900 msgr2=0x7f12d4159380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:09:51.065 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.056+0000 7f12d898f700 1 -- 172.21.15.32:0/1299170830 shutdown_connections 2023-10-08T06:09:51.065 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.056+0000 7f12d898f700 1 -- 172.21.15.32:0/1299170830 wait complete. 2023-10-08T06:09:51.076 INFO:teuthology.run_tasks:Running task ceph-fuse... 2023-10-08T06:09:51.099 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2023-10-08T06:09:51.100 INFO:tasks.ceph_fuse:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2023-10-08T06:09:51.101 INFO:tasks.ceph_fuse:client.0 config is {} 2023-10-08T06:09:51.101 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-10-08T06:09:51.101 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-08T06:09:51.101 INFO:tasks.ceph_fuse:client.2 config is {} 2023-10-08T06:09:51.101 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-10-08T06:09:51.101 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-10-08T06:09:51.101 INFO:tasks.ceph_fuse:client.1 config is {} 2023-10-08T06:09:51.101 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-10-08T06:09:51.101 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-08T06:09:51.102 INFO:tasks.ceph_fuse:client.3 config is {} 2023-10-08T06:09:51.102 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-10-08T06:09:51.102 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-10-08T06:09:51.102 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T06:09:51.102 DEBUG:teuthology.orchestra.run.smithi040:> ip netns list 2023-10-08T06:09:51.110 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T06:09:51.110 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip link delete ceph-brx 2023-10-08T06:09:51.127 INFO:teuthology.orchestra.run.smithi040.stderr:Cannot find device "ceph-brx" 2023-10-08T06:09:51.128 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T06:09:51.129 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T06:09:51.129 DEBUG:teuthology.orchestra.run.smithi032:> ip netns list 2023-10-08T06:09:51.136 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T06:09:51.136 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip link delete ceph-brx 2023-10-08T06:09:51.198 INFO:teuthology.orchestra.run.smithi032.stderr:Cannot find device "ceph-brx" 2023-10-08T06:09:51.198 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T06:09:51.199 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2023-10-08T06:09:51.199 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-08T06:09:51.319 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.316+0000 7f468eac3700 1 Processor -- start 2023-10-08T06:09:51.319 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.316+0000 7f468eac3700 1 -- start start 2023-10-08T06:09:51.320 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.320+0000 7f468eac3700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f46880c9ac0 0x7f468815aed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:51.320 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.320+0000 7f468eac3700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4688070e50 0x7f46880712e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:51.320 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.320+0000 7f468eac3700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f468815b410 con 0x7f468806b3b0 2023-10-08T06:09:51.320 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.320+0000 7f468eac3700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46880cb300 con 0x7f46880c9ac0 2023-10-08T06:09:51.321 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.320+0000 7f468eac3700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46880ca260 con 0x7f4688070e50 2023-10-08T06:09:51.322 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.320+0000 7f468dac1700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f468806b3b0 0x7f468806b790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:57024/0 (socket says 172.21.15.32:57024) 2023-10-08T06:09:51.322 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.320+0000 7f468dac1700 1 -- 172.21.15.32:0/3346432537 learned_addr learned my addr 172.21.15.32:0/3346432537 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-08T06:09:51.322 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.320+0000 7f468e2c2700 1 --2- 172.21.15.32:0/3346432537 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4688070e50 0x7f46880712e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:51.322 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.320+0000 7f468d2c0700 1 --2- 172.21.15.32:0/3346432537 >> v2:172.21.15.40:3300/0 conn(0x7f46880c9ac0 0x7f468815aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:51.322 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.320+0000 7f468cabf700 1 -- 172.21.15.32:0/3346432537 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2129008772 0 0) 0x7f468815b410 con 0x7f468806b3b0 2023-10-08T06:09:51.322 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.320+0000 7f468cabf700 1 -- 172.21.15.32:0/3346432537 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f46740035d0 con 0x7f468806b3b0 2023-10-08T06:09:51.322 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.320+0000 7f468e2c2700 1 -- 172.21.15.32:0/3346432537 >> v2:172.21.15.40:3300/0 conn(0x7f46880c9ac0 msgr2=0x7f468815aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:09:51.322 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.320+0000 7f468e2c2700 1 --2- 172.21.15.32:0/3346432537 >> v2:172.21.15.40:3300/0 conn(0x7f46880c9ac0 0x7f468815aed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:51.323 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.320+0000 7f468e2c2700 1 -- 172.21.15.32:0/3346432537 >> v1:172.21.15.32:6789/0 conn(0x7f468806b3b0 legacy=0x7f468806b790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:51.323 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.320+0000 7f468e2c2700 1 -- 172.21.15.32:0/3346432537 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46880ca540 con 0x7f4688070e50 2023-10-08T06:09:51.323 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.320+0000 7f468d2c0700 1 --2- 172.21.15.32:0/3346432537 >> v2:172.21.15.40:3300/0 conn(0x7f46880c9ac0 0x7f468815aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T06:09:51.323 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.320+0000 7f468e2c2700 1 --2- 172.21.15.32:0/3346432537 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4688070e50 0x7f46880712e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f4680009dc0 tx=0x7f468000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=81d6a972e0c4e352 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:51.324 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.320+0000 7f468cabf700 1 -- 172.21.15.32:0/3346432537 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f468000e070 con 0x7f4688070e50 2023-10-08T06:09:51.324 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.320+0000 7f468cabf700 1 -- 172.21.15.32:0/3346432537 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f468000bae0 con 0x7f4688070e50 2023-10-08T06:09:51.324 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.320+0000 7f468cabf700 1 -- 172.21.15.32:0/3346432537 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f468000be90 con 0x7f4688070e50 2023-10-08T06:09:51.324 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.320+0000 7f468eac3700 1 -- 172.21.15.32:0/3346432537 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4688070e50 msgr2=0x7f46880712e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:51.324 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.320+0000 7f468eac3700 1 --2- 172.21.15.32:0/3346432537 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4688070e50 0x7f46880712e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f4680009dc0 tx=0x7f468000b330 comp rx=0 tx=0).stop 2023-10-08T06:09:51.324 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.320+0000 7f468eac3700 1 -- 172.21.15.32:0/3346432537 shutdown_connections 2023-10-08T06:09:51.324 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.320+0000 7f468eac3700 1 --2- 172.21.15.32:0/3346432537 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4688070e50 0x7f46880712e0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:51.325 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.320+0000 7f468eac3700 1 --2- 172.21.15.32:0/3346432537 >> v2:172.21.15.40:3300/0 conn(0x7f46880c9ac0 0x7f468815aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:51.325 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.320+0000 7f468eac3700 1 -- 172.21.15.32:0/3346432537 >> 172.21.15.32:0/3346432537 conn(0x7f46880cf470 msgr2=0x7f46880cf880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:09:51.325 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.324+0000 7f468eac3700 1 -- 172.21.15.32:0/3346432537 shutdown_connections 2023-10-08T06:09:51.325 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.324+0000 7f468eac3700 1 -- 172.21.15.32:0/3346432537 wait complete. 2023-10-08T06:09:51.326 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.324+0000 7f468eac3700 1 Processor -- start 2023-10-08T06:09:51.326 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.324+0000 7f468eac3700 1 -- start start 2023-10-08T06:09:51.327 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.324+0000 7f468eac3700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f468806b3b0 0x7f46881574a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:51.328 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.324+0000 7f468eac3700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4688070e50 0x7f46880c2fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:51.328 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.324+0000 7f468eac3700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f46880c9ac0 0x7f46880c34e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:51.328 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.324+0000 7f468eac3700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46880ce9a0 con 0x7f4688070e50 2023-10-08T06:09:51.328 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.324+0000 7f468eac3700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46880cbe40 con 0x7f46880c9ac0 2023-10-08T06:09:51.328 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.324+0000 7f468eac3700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46881579e0 con 0x7f468806b3b0 2023-10-08T06:09:51.328 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.324+0000 7f468d2c0700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4688070e50 0x7f46880c2fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:51.328 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.328+0000 7f468d2c0700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4688070e50 0x7f46880c2fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:52812/0 (socket says 172.21.15.32:52812) 2023-10-08T06:09:51.328 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.328+0000 7f468d2c0700 1 -- 172.21.15.32:0/4272950487 learned_addr learned my addr 172.21.15.32:0/4272950487 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:09:51.328 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.328+0000 7f468dac1700 1 --2- 172.21.15.32:0/4272950487 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f468806b3b0 0x7f46881574a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:51.328 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.328+0000 7f468e2c2700 1 --2- 172.21.15.32:0/4272950487 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f46880c9ac0 0x7f46880c34e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:51.329 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.328+0000 7f468d2c0700 1 -- 172.21.15.32:0/4272950487 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f468806b3b0 msgr2=0x7f46881574a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:51.330 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.328+0000 7f468d2c0700 1 --2- 172.21.15.32:0/4272950487 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f468806b3b0 0x7f46881574a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:51.330 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.328+0000 7f468d2c0700 1 -- 172.21.15.32:0/4272950487 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f46880c9ac0 msgr2=0x7f46880c34e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:51.330 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.328+0000 7f468d2c0700 1 --2- 172.21.15.32:0/4272950487 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f46880c9ac0 0x7f46880c34e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:51.330 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.328+0000 7f468d2c0700 1 -- 172.21.15.32:0/4272950487 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46780094b0 con 0x7f4688070e50 2023-10-08T06:09:51.330 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.328+0000 7f468d2c0700 1 --2- 172.21.15.32:0/4272950487 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4688070e50 0x7f46880c2fa0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f467800ebe0 tx=0x7f467800eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:51.330 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.328+0000 7f467e7fc700 1 -- 172.21.15.32:0/4272950487 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4678009770 con 0x7f4688070e50 2023-10-08T06:09:51.330 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.328+0000 7f468eac3700 1 -- 172.21.15.32:0/4272950487 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4680009a70 con 0x7f4688070e50 2023-10-08T06:09:51.330 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.328+0000 7f467e7fc700 1 -- 172.21.15.32:0/4272950487 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f467800c850 con 0x7f4688070e50 2023-10-08T06:09:51.330 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.328+0000 7f467e7fc700 1 -- 172.21.15.32:0/4272950487 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f467800cbe0 con 0x7f4688070e50 2023-10-08T06:09:51.330 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.328+0000 7f468eac3700 1 -- 172.21.15.32:0/4272950487 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4688148bc0 con 0x7f4688070e50 2023-10-08T06:09:51.331 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.328+0000 7f468eac3700 1 -- 172.21.15.32:0/4272950487 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46880cbff0 con 0x7f4688070e50 2023-10-08T06:09:51.331 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.332+0000 7f467e7fc700 1 -- 172.21.15.32:0/4272950487 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f467800cd40 con 0x7f4688070e50 2023-10-08T06:09:51.332 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.332+0000 7f467e7fc700 1 --2- 172.21.15.32:0/4272950487 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f466c066510 0x7f466c0689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:51.332 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.332+0000 7f467e7fc700 1 -- 172.21.15.32:0/4272950487 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f46780842b0 con 0x7f4688070e50 2023-10-08T06:09:51.332 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.332+0000 7f468dac1700 1 --2- 172.21.15.32:0/4272950487 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f466c066510 0x7f466c0689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:51.333 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.332+0000 7f468dac1700 1 --2- 172.21.15.32:0/4272950487 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f466c066510 0x7f466c0689d0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f4684007fd0 tx=0x7f4684009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:51.341 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.340+0000 7f467e7fc700 1 -- 172.21.15.32:0/4272950487 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f46880cbff0 con 0x7f4688070e50 2023-10-08T06:09:51.544 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.544+0000 7f468eac3700 1 -- 172.21.15.32:0/4272950487 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f46880cbff0 con 0x7f4688070e50 2023-10-08T06:09:51.544 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.544+0000 7f467e7fc700 1 -- 172.21.15.32:0/4272950487 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) v1 ==== 53+0+73 (secure 0 0 0) 0x7f46880cbff0 con 0x7f4688070e50 2023-10-08T06:09:51.545 INFO:teuthology.orchestra.run.smithi032.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-08T06:09:51.547 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.544+0000 7f468eac3700 1 -- 172.21.15.32:0/4272950487 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f466c066510 msgr2=0x7f466c0689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:51.547 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.544+0000 7f468eac3700 1 --2- 172.21.15.32:0/4272950487 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f466c066510 0x7f466c0689d0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f4684007fd0 tx=0x7f4684009040 comp rx=0 tx=0).stop 2023-10-08T06:09:51.547 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.544+0000 7f468eac3700 1 -- 172.21.15.32:0/4272950487 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4688070e50 msgr2=0x7f46880c2fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:51.547 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.544+0000 7f468eac3700 1 --2- 172.21.15.32:0/4272950487 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4688070e50 0x7f46880c2fa0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f467800ebe0 tx=0x7f467800eef0 comp rx=0 tx=0).stop 2023-10-08T06:09:51.548 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.544+0000 7f468eac3700 1 -- 172.21.15.32:0/4272950487 shutdown_connections 2023-10-08T06:09:51.548 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.544+0000 7f468eac3700 1 --2- 172.21.15.32:0/4272950487 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f466c066510 0x7f466c0689d0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:51.548 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.544+0000 7f468eac3700 1 --2- 172.21.15.32:0/4272950487 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4688070e50 0x7f46880c2fa0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:51.548 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.544+0000 7f468eac3700 1 --2- 172.21.15.32:0/4272950487 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f46880c9ac0 0x7f46880c34e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:51.548 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.544+0000 7f468eac3700 1 --2- 172.21.15.32:0/4272950487 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f468806b3b0 0x7f46881574a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:51.548 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.544+0000 7f468eac3700 1 -- 172.21.15.32:0/4272950487 >> 172.21.15.32:0/4272950487 conn(0x7f46880cf470 msgr2=0x7f468815d010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:09:51.548 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.544+0000 7f468eac3700 1 -- 172.21.15.32:0/4272950487 shutdown_connections 2023-10-08T06:09:51.548 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:51.544+0000 7f468eac3700 1 -- 172.21.15.32:0/4272950487 wait complete. 2023-10-08T06:09:51.560 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-08T06:09:51.560 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-08T06:09:51.560 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi032.front.sepia.ceph.com 2023-10-08T06:09:51.560 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-08T06:09:51.560 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-08T06:09:51.561 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-08T06:09:51.561 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-08T06:09:51.561 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-08T06:09:51.561 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-08T06:09:51.561 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T06:09:51.561 DEBUG:teuthology.orchestra.run.smithi032:> ip addr 2023-10-08T06:09:51.569 INFO:teuthology.orchestra.run.smithi032.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-08T06:09:51.569 INFO:teuthology.orchestra.run.smithi032.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-08T06:09:51.569 INFO:teuthology.orchestra.run.smithi032.stdout: inet 127.0.0.1/8 scope host lo 2023-10-08T06:09:51.569 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2023-10-08T06:09:51.569 INFO:teuthology.orchestra.run.smithi032.stdout: inet6 ::1/128 scope host 2023-10-08T06:09:51.569 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2023-10-08T06:09:51.569 INFO:teuthology.orchestra.run.smithi032.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-08T06:09:51.569 INFO:teuthology.orchestra.run.smithi032.stdout: link/ether 0c:c4:7a:6b:fd:0c brd ff:ff:ff:ff:ff:ff 2023-10-08T06:09:51.570 INFO:teuthology.orchestra.run.smithi032.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-08T06:09:51.570 INFO:teuthology.orchestra.run.smithi032.stdout: link/ether 0c:c4:7a:6b:fd:0d brd ff:ff:ff:ff:ff:ff 2023-10-08T06:09:51.570 INFO:teuthology.orchestra.run.smithi032.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-08T06:09:51.570 INFO:teuthology.orchestra.run.smithi032.stdout: link/ether ac:1f:6b:f8:26:02 brd ff:ff:ff:ff:ff:ff 2023-10-08T06:09:51.570 INFO:teuthology.orchestra.run.smithi032.stdout: inet 172.21.15.32/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-10-08T06:09:51.570 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft 42539sec preferred_lft 42539sec 2023-10-08T06:09:51.570 INFO:teuthology.orchestra.run.smithi032.stdout: inet6 fe80::ae1f:6bff:fef8:2602/64 scope link 2023-10-08T06:09:51.570 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2023-10-08T06:09:51.570 INFO:teuthology.orchestra.run.smithi032.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-08T06:09:51.570 INFO:teuthology.orchestra.run.smithi032.stdout: link/ether ac:1f:6b:f8:26:03 brd ff:ff:ff:ff:ff:ff 2023-10-08T06:09:51.570 INFO:teuthology.orchestra.run.smithi032.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-10-08T06:09:51.571 INFO:teuthology.orchestra.run.smithi032.stdout: link/ether 02:42:fd:c1:b9:57 brd ff:ff:ff:ff:ff:ff 2023-10-08T06:09:51.571 INFO:teuthology.orchestra.run.smithi032.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-10-08T06:09:51.571 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2023-10-08T06:09:51.571 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-10-08T06:09:51.571 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T06:09:51.571 DEBUG:teuthology.orchestra.run.smithi032:> (cd / && exec bash -c ' 2023-10-08T06:09:51.571 DEBUG:teuthology.orchestra.run.smithi032:> set -e 2023-10-08T06:09:51.572 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip link add name ceph-brx type bridge 2023-10-08T06:09:51.572 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip addr flush dev ceph-brx 2023-10-08T06:09:51.572 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip link set ceph-brx up 2023-10-08T06:09:51.572 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-10-08T06:09:51.572 DEBUG:teuthology.orchestra.run.smithi032:> ') 2023-10-08T06:09:51.656 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T06:09:51.656 DEBUG:teuthology.orchestra.run.smithi032:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-08T06:09:51.664 INFO:teuthology.orchestra.run.smithi032.stdout:1 2023-10-08T06:09:51.666 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T06:09:51.666 DEBUG:teuthology.orchestra.run.smithi032:> route 2023-10-08T06:09:51.688 INFO:teuthology.orchestra.run.smithi032.stdout:Kernel IP routing table 2023-10-08T06:09:51.688 INFO:teuthology.orchestra.run.smithi032.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-08T06:09:51.688 INFO:teuthology.orchestra.run.smithi032.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-10-08T06:09:51.688 INFO:teuthology.orchestra.run.smithi032.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-10-08T06:09:51.688 INFO:teuthology.orchestra.run.smithi032.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-10-08T06:09:51.688 INFO:teuthology.orchestra.run.smithi032.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-08T06:09:51.689 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T06:09:51.689 DEBUG:teuthology.orchestra.run.smithi032:> (cd / && exec bash -c ' 2023-10-08T06:09:51.689 DEBUG:teuthology.orchestra.run.smithi032:> set -e 2023-10-08T06:09:51.689 DEBUG:teuthology.orchestra.run.smithi032:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-08T06:09:51.689 DEBUG:teuthology.orchestra.run.smithi032:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-08T06:09:51.689 DEBUG:teuthology.orchestra.run.smithi032:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-08T06:09:51.689 DEBUG:teuthology.orchestra.run.smithi032:> ') 2023-10-08T06:09:51.731 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T06:09:51.731 DEBUG:teuthology.orchestra.run.smithi032:> ip netns list 2023-10-08T06:09:51.739 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T06:09:51.739 DEBUG:teuthology.orchestra.run.smithi032:> ip netns list-id 2023-10-08T06:09:51.745 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T06:09:51.745 DEBUG:teuthology.orchestra.run.smithi032:> (cd / && exec bash -c ' 2023-10-08T06:09:51.745 DEBUG:teuthology.orchestra.run.smithi032:> set -e 2023-10-08T06:09:51.745 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-08T06:09:51.745 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-10-08T06:09:51.745 DEBUG:teuthology.orchestra.run.smithi032:> ') 2023-10-08T06:09:51.822 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-10-08T06:09:51.823 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T06:09:51.823 DEBUG:teuthology.orchestra.run.smithi032:> (cd / && exec bash -c ' 2023-10-08T06:09:51.823 DEBUG:teuthology.orchestra.run.smithi032:> set -e 2023-10-08T06:09:51.823 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-10-08T06:09:51.823 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-10-08T06:09:51.823 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-10-08T06:09:51.823 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-10-08T06:09:51.823 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-10-08T06:09:51.823 DEBUG:teuthology.orchestra.run.smithi032:> ') 2023-10-08T06:09:51.893 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T06:09:51.894 DEBUG:teuthology.orchestra.run.smithi032:> (cd / && exec bash -c ' 2023-10-08T06:09:51.894 DEBUG:teuthology.orchestra.run.smithi032:> set -e 2023-10-08T06:09:51.894 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip link set brx.0 up 2023-10-08T06:09:51.894 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip link set dev brx.0 master ceph-brx 2023-10-08T06:09:51.894 DEBUG:teuthology.orchestra.run.smithi032:> ') 2023-10-08T06:09:51.920 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-10-08T06:09:51.921 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T06:09:51.921 DEBUG:teuthology.orchestra.run.smithi032:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-08T06:09:51.974 INFO:teuthology.orchestra.run.smithi032.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-08T06:09:51.974 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T06:09:51.975 DEBUG:teuthology.orchestra.run.smithi032:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-08T06:09:51.981 DEBUG:teuthology.orchestra.run.smithi032:> sudo modprobe fuse 2023-10-08T06:09:51.998 DEBUG:teuthology.orchestra.run.smithi032:> cat /proc/self/mounts | awk '{print $2}' 2023-10-08T06:09:52.005 INFO:teuthology.orchestra.run.smithi032.stdout:/sys 2023-10-08T06:09:52.006 INFO:teuthology.orchestra.run.smithi032.stdout:/proc 2023-10-08T06:09:52.006 INFO:teuthology.orchestra.run.smithi032.stdout:/dev 2023-10-08T06:09:52.006 INFO:teuthology.orchestra.run.smithi032.stdout:/dev/pts 2023-10-08T06:09:52.006 INFO:teuthology.orchestra.run.smithi032.stdout:/run 2023-10-08T06:09:52.006 INFO:teuthology.orchestra.run.smithi032.stdout:/ 2023-10-08T06:09:52.006 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/kernel/security 2023-10-08T06:09:52.006 INFO:teuthology.orchestra.run.smithi032.stdout:/dev/shm 2023-10-08T06:09:52.006 INFO:teuthology.orchestra.run.smithi032.stdout:/run/lock 2023-10-08T06:09:52.006 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/cgroup 2023-10-08T06:09:52.006 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/cgroup/unified 2023-10-08T06:09:52.007 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/cgroup/systemd 2023-10-08T06:09:52.007 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/pstore 2023-10-08T06:09:52.007 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/bpf 2023-10-08T06:09:52.007 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/cgroup/cpu,cpuacct 2023-10-08T06:09:52.007 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/cgroup/net_cls,net_prio 2023-10-08T06:09:52.007 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/cgroup/blkio 2023-10-08T06:09:52.007 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/cgroup/pids 2023-10-08T06:09:52.007 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/cgroup/memory 2023-10-08T06:09:52.007 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/cgroup/freezer 2023-10-08T06:09:52.007 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/cgroup/perf_event 2023-10-08T06:09:52.007 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/cgroup/cpuset 2023-10-08T06:09:52.007 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/cgroup/devices 2023-10-08T06:09:52.008 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/cgroup/rdma 2023-10-08T06:09:52.008 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/cgroup/hugetlb 2023-10-08T06:09:52.008 INFO:teuthology.orchestra.run.smithi032.stdout:/proc/sys/fs/binfmt_misc 2023-10-08T06:09:52.008 INFO:teuthology.orchestra.run.smithi032.stdout:/dev/hugepages 2023-10-08T06:09:52.008 INFO:teuthology.orchestra.run.smithi032.stdout:/dev/mqueue 2023-10-08T06:09:52.008 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/kernel/debug 2023-10-08T06:09:52.008 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/kernel/tracing 2023-10-08T06:09:52.008 INFO:teuthology.orchestra.run.smithi032.stdout:/run/rpc_pipefs 2023-10-08T06:09:52.008 INFO:teuthology.orchestra.run.smithi032.stdout:/proc/fs/nfsd 2023-10-08T06:09:52.008 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/fuse/connections 2023-10-08T06:09:52.008 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/kernel/config 2023-10-08T06:09:52.009 INFO:teuthology.orchestra.run.smithi032.stdout:/run/user/1000 2023-10-08T06:09:52.009 INFO:teuthology.orchestra.run.smithi032.stdout:/var/lib/ceph 2023-10-08T06:09:52.009 INFO:teuthology.orchestra.run.smithi032.stdout:/var/lib/ceph/osd/ceph-0 2023-10-08T06:09:52.009 INFO:teuthology.orchestra.run.smithi032.stdout:/var/lib/ceph/osd/ceph-1 2023-10-08T06:09:52.009 INFO:teuthology.orchestra.run.smithi032.stdout:/var/lib/ceph/osd/ceph-2 2023-10-08T06:09:52.009 INFO:teuthology.orchestra.run.smithi032.stdout:/var/lib/ceph/osd/ceph-3 2023-10-08T06:09:52.009 INFO:teuthology.orchestra.run.smithi032.stdout:/run/netns 2023-10-08T06:09:52.009 INFO:teuthology.orchestra.run.smithi032.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-08T06:09:52.009 INFO:teuthology.orchestra.run.smithi032.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-08T06:09:52.010 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T06:09:52.010 DEBUG:teuthology.orchestra.run.smithi032:> ls /sys/fs/fuse/connections 2023-10-08T06:09:52.058 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-10-08T06:09:52.058 DEBUG:teuthology.orchestra.run.smithi032:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-10-08T06:09:52.060 DEBUG:teuthology.orchestra.run.smithi032:> sudo modprobe fuse 2023-10-08T06:09:52.080 DEBUG:teuthology.orchestra.run.smithi032:> cat /proc/self/mounts | awk '{print $2}' 2023-10-08T06:09:52.087 INFO:teuthology.orchestra.run.smithi032.stdout:/sys 2023-10-08T06:09:52.088 INFO:teuthology.orchestra.run.smithi032.stdout:/proc 2023-10-08T06:09:52.088 INFO:teuthology.orchestra.run.smithi032.stdout:/dev 2023-10-08T06:09:52.088 INFO:teuthology.orchestra.run.smithi032.stdout:/dev/pts 2023-10-08T06:09:52.088 INFO:teuthology.orchestra.run.smithi032.stdout:/run 2023-10-08T06:09:52.088 INFO:teuthology.orchestra.run.smithi032.stdout:/ 2023-10-08T06:09:52.088 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/kernel/security 2023-10-08T06:09:52.088 INFO:teuthology.orchestra.run.smithi032.stdout:/dev/shm 2023-10-08T06:09:52.088 INFO:teuthology.orchestra.run.smithi032.stdout:/run/lock 2023-10-08T06:09:52.088 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/cgroup 2023-10-08T06:09:52.088 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/cgroup/unified 2023-10-08T06:09:52.088 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/cgroup/systemd 2023-10-08T06:09:52.089 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/pstore 2023-10-08T06:09:52.089 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/bpf 2023-10-08T06:09:52.089 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/cgroup/cpu,cpuacct 2023-10-08T06:09:52.089 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/cgroup/net_cls,net_prio 2023-10-08T06:09:52.089 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/cgroup/blkio 2023-10-08T06:09:52.089 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/cgroup/pids 2023-10-08T06:09:52.089 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/cgroup/memory 2023-10-08T06:09:52.089 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/cgroup/freezer 2023-10-08T06:09:52.089 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/cgroup/perf_event 2023-10-08T06:09:52.089 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/cgroup/cpuset 2023-10-08T06:09:52.089 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/cgroup/devices 2023-10-08T06:09:52.089 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/cgroup/rdma 2023-10-08T06:09:52.090 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/cgroup/hugetlb 2023-10-08T06:09:52.090 INFO:teuthology.orchestra.run.smithi032.stdout:/proc/sys/fs/binfmt_misc 2023-10-08T06:09:52.090 INFO:teuthology.orchestra.run.smithi032.stdout:/dev/hugepages 2023-10-08T06:09:52.090 INFO:teuthology.orchestra.run.smithi032.stdout:/dev/mqueue 2023-10-08T06:09:52.090 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/kernel/debug 2023-10-08T06:09:52.090 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/kernel/tracing 2023-10-08T06:09:52.090 INFO:teuthology.orchestra.run.smithi032.stdout:/run/rpc_pipefs 2023-10-08T06:09:52.090 INFO:teuthology.orchestra.run.smithi032.stdout:/proc/fs/nfsd 2023-10-08T06:09:52.090 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/fuse/connections 2023-10-08T06:09:52.090 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/kernel/config 2023-10-08T06:09:52.090 INFO:teuthology.orchestra.run.smithi032.stdout:/run/user/1000 2023-10-08T06:09:52.090 INFO:teuthology.orchestra.run.smithi032.stdout:/var/lib/ceph 2023-10-08T06:09:52.091 INFO:teuthology.orchestra.run.smithi032.stdout:/var/lib/ceph/osd/ceph-0 2023-10-08T06:09:52.091 INFO:teuthology.orchestra.run.smithi032.stdout:/var/lib/ceph/osd/ceph-1 2023-10-08T06:09:52.091 INFO:teuthology.orchestra.run.smithi032.stdout:/var/lib/ceph/osd/ceph-2 2023-10-08T06:09:52.091 INFO:teuthology.orchestra.run.smithi032.stdout:/var/lib/ceph/osd/ceph-3 2023-10-08T06:09:52.091 INFO:teuthology.orchestra.run.smithi032.stdout:/run/netns 2023-10-08T06:09:52.091 INFO:teuthology.orchestra.run.smithi032.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-08T06:09:52.091 INFO:teuthology.orchestra.run.smithi032.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-08T06:09:52.092 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T06:09:52.092 DEBUG:teuthology.orchestra.run.smithi032:> ls /sys/fs/fuse/connections 2023-10-08T06:09:52.153 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi032.stderr:2023-10-08T06:09:52.152+0000 7f5c8ab91640 -1 init, newargv = 0x556c7c7e69b0 newargc=15 2023-10-08T06:09:52.154 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi032.stderr:ceph-fuse[42024]: starting ceph client 2023-10-08T06:09:52.164 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi032.stderr:ceph-fuse[42024]: starting fuse 2023-10-08T06:09:53.198 DEBUG:teuthology.orchestra.run.smithi032:> sudo modprobe fuse 2023-10-08T06:09:53.214 DEBUG:teuthology.orchestra.run.smithi032:> cat /proc/self/mounts | awk '{print $2}' 2023-10-08T06:09:53.223 INFO:teuthology.orchestra.run.smithi032.stdout:/sys 2023-10-08T06:09:53.223 INFO:teuthology.orchestra.run.smithi032.stdout:/proc 2023-10-08T06:09:53.223 INFO:teuthology.orchestra.run.smithi032.stdout:/dev 2023-10-08T06:09:53.223 INFO:teuthology.orchestra.run.smithi032.stdout:/dev/pts 2023-10-08T06:09:53.223 INFO:teuthology.orchestra.run.smithi032.stdout:/run 2023-10-08T06:09:53.223 INFO:teuthology.orchestra.run.smithi032.stdout:/ 2023-10-08T06:09:53.223 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/kernel/security 2023-10-08T06:09:53.224 INFO:teuthology.orchestra.run.smithi032.stdout:/dev/shm 2023-10-08T06:09:53.224 INFO:teuthology.orchestra.run.smithi032.stdout:/run/lock 2023-10-08T06:09:53.224 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/cgroup 2023-10-08T06:09:53.224 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/cgroup/unified 2023-10-08T06:09:53.224 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/cgroup/systemd 2023-10-08T06:09:53.224 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/pstore 2023-10-08T06:09:53.224 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/bpf 2023-10-08T06:09:53.224 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/cgroup/cpu,cpuacct 2023-10-08T06:09:53.224 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/cgroup/net_cls,net_prio 2023-10-08T06:09:53.224 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/cgroup/blkio 2023-10-08T06:09:53.224 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/cgroup/pids 2023-10-08T06:09:53.224 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/cgroup/memory 2023-10-08T06:09:53.225 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/cgroup/freezer 2023-10-08T06:09:53.225 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/cgroup/perf_event 2023-10-08T06:09:53.225 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/cgroup/cpuset 2023-10-08T06:09:53.225 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/cgroup/devices 2023-10-08T06:09:53.225 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/cgroup/rdma 2023-10-08T06:09:53.225 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/cgroup/hugetlb 2023-10-08T06:09:53.225 INFO:teuthology.orchestra.run.smithi032.stdout:/proc/sys/fs/binfmt_misc 2023-10-08T06:09:53.225 INFO:teuthology.orchestra.run.smithi032.stdout:/dev/hugepages 2023-10-08T06:09:53.225 INFO:teuthology.orchestra.run.smithi032.stdout:/dev/mqueue 2023-10-08T06:09:53.225 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/kernel/debug 2023-10-08T06:09:53.225 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/kernel/tracing 2023-10-08T06:09:53.225 INFO:teuthology.orchestra.run.smithi032.stdout:/run/rpc_pipefs 2023-10-08T06:09:53.226 INFO:teuthology.orchestra.run.smithi032.stdout:/proc/fs/nfsd 2023-10-08T06:09:53.226 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/fuse/connections 2023-10-08T06:09:53.226 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/kernel/config 2023-10-08T06:09:53.226 INFO:teuthology.orchestra.run.smithi032.stdout:/run/user/1000 2023-10-08T06:09:53.226 INFO:teuthology.orchestra.run.smithi032.stdout:/var/lib/ceph 2023-10-08T06:09:53.226 INFO:teuthology.orchestra.run.smithi032.stdout:/var/lib/ceph/osd/ceph-0 2023-10-08T06:09:53.226 INFO:teuthology.orchestra.run.smithi032.stdout:/var/lib/ceph/osd/ceph-1 2023-10-08T06:09:53.226 INFO:teuthology.orchestra.run.smithi032.stdout:/var/lib/ceph/osd/ceph-2 2023-10-08T06:09:53.226 INFO:teuthology.orchestra.run.smithi032.stdout:/var/lib/ceph/osd/ceph-3 2023-10-08T06:09:53.227 INFO:teuthology.orchestra.run.smithi032.stdout:/run/netns 2023-10-08T06:09:53.227 INFO:teuthology.orchestra.run.smithi032.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-08T06:09:53.227 INFO:teuthology.orchestra.run.smithi032.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-08T06:09:53.227 INFO:teuthology.orchestra.run.smithi032.stdout:/home/ubuntu/cephtest/mnt.0 2023-10-08T06:09:53.228 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T06:09:53.228 DEBUG:teuthology.orchestra.run.smithi032:> ls /sys/fs/fuse/connections 2023-10-08T06:09:53.235 INFO:teuthology.orchestra.run.smithi032.stdout:52 2023-10-08T06:09:53.235 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2023-10-08T06:09:53.235 DEBUG:teuthology.orchestra.run.smithi032:> sudo stdin-killer -- python3 -c ' 2023-10-08T06:09:53.235 DEBUG:teuthology.orchestra.run.smithi032:> import glob 2023-10-08T06:09:53.235 DEBUG:teuthology.orchestra.run.smithi032:> import re 2023-10-08T06:09:53.236 DEBUG:teuthology.orchestra.run.smithi032:> import os 2023-10-08T06:09:53.236 DEBUG:teuthology.orchestra.run.smithi032:> import subprocess 2023-10-08T06:09:53.236 DEBUG:teuthology.orchestra.run.smithi032:> 2023-10-08T06:09:53.236 DEBUG:teuthology.orchestra.run.smithi032:> def _find_admin_socket(client_name): 2023-10-08T06:09:53.236 DEBUG:teuthology.orchestra.run.smithi032:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-10-08T06:09:53.236 DEBUG:teuthology.orchestra.run.smithi032:> files = glob.glob(asok_path) 2023-10-08T06:09:53.236 DEBUG:teuthology.orchestra.run.smithi032:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-10-08T06:09:53.236 DEBUG:teuthology.orchestra.run.smithi032:> 2023-10-08T06:09:53.236 DEBUG:teuthology.orchestra.run.smithi032:> # Given a non-glob path, it better be there 2023-10-08T06:09:53.236 DEBUG:teuthology.orchestra.run.smithi032:> if "*" not in asok_path: 2023-10-08T06:09:53.236 DEBUG:teuthology.orchestra.run.smithi032:> assert(len(files) == 1) 2023-10-08T06:09:53.236 DEBUG:teuthology.orchestra.run.smithi032:> return files[0] 2023-10-08T06:09:53.236 DEBUG:teuthology.orchestra.run.smithi032:> 2023-10-08T06:09:53.237 DEBUG:teuthology.orchestra.run.smithi032:> for f in files: 2023-10-08T06:09:53.237 DEBUG:teuthology.orchestra.run.smithi032:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-08T06:09:53.237 DEBUG:teuthology.orchestra.run.smithi032:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-08T06:09:53.237 DEBUG:teuthology.orchestra.run.smithi032:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-08T06:09:53.237 DEBUG:teuthology.orchestra.run.smithi032:> contents = proc_f.read() 2023-10-08T06:09:53.237 DEBUG:teuthology.orchestra.run.smithi032:> if mountpoint in contents: 2023-10-08T06:09:53.237 DEBUG:teuthology.orchestra.run.smithi032:> return f 2023-10-08T06:09:53.237 DEBUG:teuthology.orchestra.run.smithi032:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-08T06:09:53.237 DEBUG:teuthology.orchestra.run.smithi032:> 2023-10-08T06:09:53.237 DEBUG:teuthology.orchestra.run.smithi032:> print(_find_admin_socket("client.0")) 2023-10-08T06:09:53.237 DEBUG:teuthology.orchestra.run.smithi032:> ' 2023-10-08T06:09:53.329 INFO:teuthology.orchestra.run.smithi032.stdout:/var/run/ceph/ceph-client.0.42024.asok 2023-10-08T06:09:53.333 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-08T06:09:53.347 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.42024.asok 2023-10-08T06:09:53.347 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T06:09:53.347 DEBUG:teuthology.orchestra.run.smithi032:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.42024.asok status 2023-10-08T06:09:53.498 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2023-10-08T06:09:53.499 INFO:teuthology.orchestra.run.smithi032.stdout: "metadata": { 2023-10-08T06:09:53.499 INFO:teuthology.orchestra.run.smithi032.stdout: "ceph_sha1": "9725b08fd801c82987c737f7e6d354878f036ee8", 2023-10-08T06:09:53.499 INFO:teuthology.orchestra.run.smithi032.stdout: "ceph_version": "ceph version 18.0.0-6609-g9725b08f (9725b08fd801c82987c737f7e6d354878f036ee8) reef (dev)", 2023-10-08T06:09:53.499 INFO:teuthology.orchestra.run.smithi032.stdout: "entity_id": "0", 2023-10-08T06:09:53.499 INFO:teuthology.orchestra.run.smithi032.stdout: "hostname": "smithi032", 2023-10-08T06:09:53.499 INFO:teuthology.orchestra.run.smithi032.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-10-08T06:09:53.499 INFO:teuthology.orchestra.run.smithi032.stdout: "pid": "42024", 2023-10-08T06:09:53.499 INFO:teuthology.orchestra.run.smithi032.stdout: "root": "/" 2023-10-08T06:09:53.499 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-10-08T06:09:53.499 INFO:teuthology.orchestra.run.smithi032.stdout: "dentry_count": 0, 2023-10-08T06:09:53.499 INFO:teuthology.orchestra.run.smithi032.stdout: "dentry_pinned_count": 0, 2023-10-08T06:09:53.500 INFO:teuthology.orchestra.run.smithi032.stdout: "id": 4686, 2023-10-08T06:09:53.500 INFO:teuthology.orchestra.run.smithi032.stdout: "inst": { 2023-10-08T06:09:53.500 INFO:teuthology.orchestra.run.smithi032.stdout: "name": { 2023-10-08T06:09:53.500 INFO:teuthology.orchestra.run.smithi032.stdout: "type": "client", 2023-10-08T06:09:53.500 INFO:teuthology.orchestra.run.smithi032.stdout: "num": 4686 2023-10-08T06:09:53.500 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-10-08T06:09:53.500 INFO:teuthology.orchestra.run.smithi032.stdout: "addr": { 2023-10-08T06:09:53.500 INFO:teuthology.orchestra.run.smithi032.stdout: "type": "v1", 2023-10-08T06:09:53.500 INFO:teuthology.orchestra.run.smithi032.stdout: "addr": "192.168.0.1:0", 2023-10-08T06:09:53.500 INFO:teuthology.orchestra.run.smithi032.stdout: "nonce": 1963180739 2023-10-08T06:09:53.500 INFO:teuthology.orchestra.run.smithi032.stdout: } 2023-10-08T06:09:53.501 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-10-08T06:09:53.501 INFO:teuthology.orchestra.run.smithi032.stdout: "addr": { 2023-10-08T06:09:53.501 INFO:teuthology.orchestra.run.smithi032.stdout: "type": "v1", 2023-10-08T06:09:53.501 INFO:teuthology.orchestra.run.smithi032.stdout: "addr": "192.168.0.1:0", 2023-10-08T06:09:53.501 INFO:teuthology.orchestra.run.smithi032.stdout: "nonce": 1963180739 2023-10-08T06:09:53.501 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-10-08T06:09:53.501 INFO:teuthology.orchestra.run.smithi032.stdout: "inst_str": "client.4686 192.168.0.1:0/1963180739", 2023-10-08T06:09:53.501 INFO:teuthology.orchestra.run.smithi032.stdout: "addr_str": "192.168.0.1:0/1963180739", 2023-10-08T06:09:53.501 INFO:teuthology.orchestra.run.smithi032.stdout: "inode_count": 1, 2023-10-08T06:09:53.501 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_epoch": 6, 2023-10-08T06:09:53.501 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_epoch": 22, 2023-10-08T06:09:53.501 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_epoch_barrier": 0, 2023-10-08T06:09:53.502 INFO:teuthology.orchestra.run.smithi032.stdout: "blocklisted": false, 2023-10-08T06:09:53.502 INFO:teuthology.orchestra.run.smithi032.stdout: "fs_name": "cephfs" 2023-10-08T06:09:53.502 INFO:teuthology.orchestra.run.smithi032.stdout:} 2023-10-08T06:09:53.508 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-08T06:09:53.623 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:53.620+0000 7faa13fff700 1 Processor -- start 2023-10-08T06:09:53.624 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:53.620+0000 7faa13fff700 1 -- start start 2023-10-08T06:09:53.625 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:53.624+0000 7faa13fff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faa0c0340d0 0x7faa0c0eb340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:53.625 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:53.624+0000 7faa13fff700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7faa0c047de0 0x7faa0c053090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:53.625 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:53.624+0000 7faa13fff700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa0c04ff40 con 0x7faa0c048330 2023-10-08T06:09:53.625 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:53.624+0000 7faa13fff700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa0c04fca0 con 0x7faa0c047de0 2023-10-08T06:09:53.625 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:53.624+0000 7faa13fff700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa0c0503d0 con 0x7faa0c0340d0 2023-10-08T06:09:53.625 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:53.624+0000 7faa137fe700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7faa0c047de0 0x7faa0c053090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:53.626 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:53.624+0000 7faa127fc700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7faa0c048330 0x7faa0c0eb880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:57028/0 (socket says 172.21.15.32:57028) 2023-10-08T06:09:53.626 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:53.624+0000 7faa127fc700 1 -- 172.21.15.32:0/3492394837 learned_addr learned my addr 172.21.15.32:0/3492394837 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-08T06:09:53.626 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:53.624+0000 7faa12ffd700 1 --2- 172.21.15.32:0/3492394837 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faa0c0340d0 0x7faa0c0eb340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:53.626 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:53.624+0000 7faa11ffb700 1 -- 172.21.15.32:0/3492394837 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1826411830 0 0) 0x7faa0c04ff40 con 0x7faa0c048330 2023-10-08T06:09:53.626 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:53.624+0000 7faa11ffb700 1 -- 172.21.15.32:0/3492394837 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faa000035d0 con 0x7faa0c048330 2023-10-08T06:09:53.626 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:53.624+0000 7faa137fe700 1 -- 172.21.15.32:0/3492394837 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faa0c0340d0 msgr2=0x7faa0c0eb340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:09:53.626 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:53.624+0000 7faa137fe700 1 --2- 172.21.15.32:0/3492394837 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faa0c0340d0 0x7faa0c0eb340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:53.626 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:53.624+0000 7faa137fe700 1 -- 172.21.15.32:0/3492394837 >> v1:172.21.15.32:6789/0 conn(0x7faa0c048330 legacy=0x7faa0c0eb880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:53.626 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:53.624+0000 7faa137fe700 1 -- 172.21.15.32:0/3492394837 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa0c0ebf90 con 0x7faa0c047de0 2023-10-08T06:09:53.628 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:53.624+0000 7faa137fe700 1 --2- 172.21.15.32:0/3492394837 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faa0c047de0 0x7faa0c053090 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7faa14064300 tx=0x7faa14074710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af8358837245a1bc server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:53.628 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:53.624+0000 7faa11ffb700 1 -- 172.21.15.32:0/3492394837 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa1404ef60 con 0x7faa0c047de0 2023-10-08T06:09:53.628 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:53.624+0000 7faa11ffb700 1 -- 172.21.15.32:0/3492394837 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa14073f00 con 0x7faa0c047de0 2023-10-08T06:09:53.628 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:53.624+0000 7faa11ffb700 1 -- 172.21.15.32:0/3492394837 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa14068450 con 0x7faa0c047de0 2023-10-08T06:09:53.628 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:53.624+0000 7faa13fff700 1 -- 172.21.15.32:0/3492394837 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faa0c047de0 msgr2=0x7faa0c053090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:53.628 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:53.624+0000 7faa13fff700 1 --2- 172.21.15.32:0/3492394837 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faa0c047de0 0x7faa0c053090 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7faa14064300 tx=0x7faa14074710 comp rx=0 tx=0).stop 2023-10-08T06:09:53.628 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:53.624+0000 7faa13fff700 1 -- 172.21.15.32:0/3492394837 shutdown_connections 2023-10-08T06:09:53.628 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:53.624+0000 7faa13fff700 1 --2- 172.21.15.32:0/3492394837 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faa0c047de0 0x7faa0c053090 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:53.628 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:53.624+0000 7faa13fff700 1 --2- 172.21.15.32:0/3492394837 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faa0c0340d0 0x7faa0c0eb340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:53.629 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:53.624+0000 7faa13fff700 1 -- 172.21.15.32:0/3492394837 >> 172.21.15.32:0/3492394837 conn(0x7faa0c054c90 msgr2=0x7faa0c0550a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:09:53.629 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:53.624+0000 7faa13fff700 1 -- 172.21.15.32:0/3492394837 shutdown_connections 2023-10-08T06:09:53.629 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:53.624+0000 7faa13fff700 1 -- 172.21.15.32:0/3492394837 wait complete. 2023-10-08T06:09:53.630 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:53.628+0000 7faa13fff700 1 Processor -- start 2023-10-08T06:09:53.631 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:53.628+0000 7faa13fff700 1 -- start start 2023-10-08T06:09:53.631 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:53.628+0000 7faa13fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faa0c0340d0 0x7faa0c0dc210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:53.631 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:53.628+0000 7faa13fff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faa0c047de0 0x7faa0c049d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:53.631 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:53.628+0000 7faa13fff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faa0c048330 0x7faa0c0e4630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:53.631 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:53.628+0000 7faa13fff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa0c0dc750 con 0x7faa0c0340d0 2023-10-08T06:09:53.631 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:53.628+0000 7faa13fff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa0c048cf0 con 0x7faa0c047de0 2023-10-08T06:09:53.631 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:53.628+0000 7faa13fff700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa0c048fd0 con 0x7faa0c048330 2023-10-08T06:09:53.631 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:53.628+0000 7faa12ffd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faa0c0340d0 0x7faa0c0dc210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:53.631 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:53.628+0000 7faa12ffd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faa0c0340d0 0x7faa0c0dc210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:52826/0 (socket says 172.21.15.32:52826) 2023-10-08T06:09:53.631 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:53.628+0000 7faa12ffd700 1 -- 172.21.15.32:0/2145068012 learned_addr learned my addr 172.21.15.32:0/2145068012 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:09:53.632 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:53.628+0000 7faa137fe700 1 --2- 172.21.15.32:0/2145068012 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faa0c048330 0x7faa0c0e4630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:53.632 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:53.628+0000 7faa127fc700 1 --2- 172.21.15.32:0/2145068012 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faa0c047de0 0x7faa0c049d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:53.632 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:53.628+0000 7faa12ffd700 1 -- 172.21.15.32:0/2145068012 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faa0c048330 msgr2=0x7faa0c0e4630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:53.632 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:53.628+0000 7faa12ffd700 1 --2- 172.21.15.32:0/2145068012 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faa0c048330 0x7faa0c0e4630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:53.632 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:53.628+0000 7faa12ffd700 1 -- 172.21.15.32:0/2145068012 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faa0c047de0 msgr2=0x7faa0c049d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:53.632 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:53.628+0000 7faa12ffd700 1 --2- 172.21.15.32:0/2145068012 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faa0c047de0 0x7faa0c049d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:53.632 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:53.628+0000 7faa12ffd700 1 -- 172.21.15.32:0/2145068012 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa14066ea0 con 0x7faa0c0340d0 2023-10-08T06:09:53.632 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:53.628+0000 7faa127fc700 1 --2- 172.21.15.32:0/2145068012 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faa0c047de0 0x7faa0c049d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T06:09:53.632 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:53.628+0000 7faa137fe700 1 --2- 172.21.15.32:0/2145068012 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faa0c048330 0x7faa0c0e4630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T06:09:53.632 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:53.628+0000 7faa12ffd700 1 --2- 172.21.15.32:0/2145068012 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faa0c0340d0 0x7faa0c0dc210 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7faa0400e840 tx=0x7faa0400ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:53.633 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:53.628+0000 7faa0bfff700 1 -- 172.21.15.32:0/2145068012 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa040095a0 con 0x7faa0c0340d0 2023-10-08T06:09:53.634 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:53.628+0000 7faa0bfff700 1 -- 172.21.15.32:0/2145068012 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa0400c690 con 0x7faa0c0340d0 2023-10-08T06:09:53.634 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:53.628+0000 7faa13fff700 1 -- 172.21.15.32:0/2145068012 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa0c0492b0 con 0x7faa0c0340d0 2023-10-08T06:09:53.634 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:53.628+0000 7faa0bfff700 1 -- 172.21.15.32:0/2145068012 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa0400ca00 con 0x7faa0c0340d0 2023-10-08T06:09:53.634 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:53.628+0000 7faa13fff700 1 -- 172.21.15.32:0/2145068012 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa0c049870 con 0x7faa0c0340d0 2023-10-08T06:09:53.634 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:53.632+0000 7faa13fff700 1 -- 172.21.15.32:0/2145068012 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa0c005460 con 0x7faa0c0340d0 2023-10-08T06:09:53.634 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:53.632+0000 7faa0bfff700 1 -- 172.21.15.32:0/2145068012 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7faa0400cb60 con 0x7faa0c0340d0 2023-10-08T06:09:53.635 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:53.632+0000 7faa0bfff700 1 --2- 172.21.15.32:0/2145068012 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fa9f4066510 0x7fa9f40689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:53.635 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:53.632+0000 7faa127fc700 1 --2- 172.21.15.32:0/2145068012 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fa9f4066510 0x7fa9f40689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:53.635 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:53.632+0000 7faa0bfff700 1 -- 172.21.15.32:0/2145068012 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7faa04084180 con 0x7faa0c0340d0 2023-10-08T06:09:53.635 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:53.632+0000 7faa127fc700 1 --2- 172.21.15.32:0/2145068012 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fa9f4066510 0x7fa9f40689d0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7faa0c0e5360 tx=0x7fa9fc009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:53.640 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:53.640+0000 7faa0bfff700 1 -- 172.21.15.32:0/2145068012 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7faa04051600 con 0x7faa0c0340d0 2023-10-08T06:09:53.844 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:53.844+0000 7faa13fff700 1 -- 172.21.15.32:0/2145068012 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7faa0c052960 con 0x7faa0c0340d0 2023-10-08T06:09:53.844 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:53.844+0000 7faa0bfff700 1 -- 172.21.15.32:0/2145068012 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) v1 ==== 53+0+73 (secure 0 0 0) 0x7faa04054c20 con 0x7faa0c0340d0 2023-10-08T06:09:53.844 INFO:teuthology.orchestra.run.smithi032.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-08T06:09:53.847 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:53.844+0000 7faa13fff700 1 -- 172.21.15.32:0/2145068012 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fa9f4066510 msgr2=0x7fa9f40689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:53.847 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:53.844+0000 7faa13fff700 1 --2- 172.21.15.32:0/2145068012 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fa9f4066510 0x7fa9f40689d0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7faa0c0e5360 tx=0x7fa9fc009040 comp rx=0 tx=0).stop 2023-10-08T06:09:53.847 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:53.844+0000 7faa13fff700 1 -- 172.21.15.32:0/2145068012 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faa0c0340d0 msgr2=0x7faa0c0dc210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:53.847 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:53.844+0000 7faa13fff700 1 --2- 172.21.15.32:0/2145068012 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faa0c0340d0 0x7faa0c0dc210 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7faa0400e840 tx=0x7faa0400ec00 comp rx=0 tx=0).stop 2023-10-08T06:09:53.847 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:53.844+0000 7faa13fff700 1 -- 172.21.15.32:0/2145068012 shutdown_connections 2023-10-08T06:09:53.848 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:53.844+0000 7faa13fff700 1 --2- 172.21.15.32:0/2145068012 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fa9f4066510 0x7fa9f40689d0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:53.848 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:53.844+0000 7faa13fff700 1 --2- 172.21.15.32:0/2145068012 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7faa0c048330 0x7faa0c0e4630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:53.848 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:53.844+0000 7faa13fff700 1 --2- 172.21.15.32:0/2145068012 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faa0c047de0 0x7faa0c049d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:53.848 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:53.844+0000 7faa13fff700 1 --2- 172.21.15.32:0/2145068012 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faa0c0340d0 0x7faa0c0dc210 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:53.848 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:53.844+0000 7faa13fff700 1 -- 172.21.15.32:0/2145068012 >> 172.21.15.32:0/2145068012 conn(0x7faa0c054c90 msgr2=0x7faa0c0346f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:09:53.848 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:53.844+0000 7faa13fff700 1 -- 172.21.15.32:0/2145068012 shutdown_connections 2023-10-08T06:09:53.848 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:53.844+0000 7faa13fff700 1 -- 172.21.15.32:0/2145068012 wait complete. 2023-10-08T06:09:53.859 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-08T06:09:53.859 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-08T06:09:53.859 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi032.front.sepia.ceph.com 2023-10-08T06:09:53.859 INFO:tasks.cephfs.mount:self.client.name = client.2 2023-10-08T06:09:53.859 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-10-08T06:09:53.859 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-08T06:09:53.859 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-08T06:09:53.859 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-08T06:09:53.859 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2023-10-08T06:09:53.859 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T06:09:53.860 DEBUG:teuthology.orchestra.run.smithi032:> ip addr 2023-10-08T06:09:53.867 INFO:teuthology.orchestra.run.smithi032.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-08T06:09:53.868 INFO:teuthology.orchestra.run.smithi032.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-08T06:09:53.868 INFO:teuthology.orchestra.run.smithi032.stdout: inet 127.0.0.1/8 scope host lo 2023-10-08T06:09:53.868 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2023-10-08T06:09:53.868 INFO:teuthology.orchestra.run.smithi032.stdout: inet6 ::1/128 scope host 2023-10-08T06:09:53.868 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2023-10-08T06:09:53.868 INFO:teuthology.orchestra.run.smithi032.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-08T06:09:53.868 INFO:teuthology.orchestra.run.smithi032.stdout: link/ether 0c:c4:7a:6b:fd:0c brd ff:ff:ff:ff:ff:ff 2023-10-08T06:09:53.868 INFO:teuthology.orchestra.run.smithi032.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-08T06:09:53.868 INFO:teuthology.orchestra.run.smithi032.stdout: link/ether 0c:c4:7a:6b:fd:0d brd ff:ff:ff:ff:ff:ff 2023-10-08T06:09:53.868 INFO:teuthology.orchestra.run.smithi032.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-08T06:09:53.868 INFO:teuthology.orchestra.run.smithi032.stdout: link/ether ac:1f:6b:f8:26:02 brd ff:ff:ff:ff:ff:ff 2023-10-08T06:09:53.868 INFO:teuthology.orchestra.run.smithi032.stdout: inet 172.21.15.32/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-10-08T06:09:53.869 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft 42537sec preferred_lft 42537sec 2023-10-08T06:09:53.869 INFO:teuthology.orchestra.run.smithi032.stdout: inet6 fe80::ae1f:6bff:fef8:2602/64 scope link 2023-10-08T06:09:53.869 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2023-10-08T06:09:53.869 INFO:teuthology.orchestra.run.smithi032.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-08T06:09:53.869 INFO:teuthology.orchestra.run.smithi032.stdout: link/ether ac:1f:6b:f8:26:03 brd ff:ff:ff:ff:ff:ff 2023-10-08T06:09:53.869 INFO:teuthology.orchestra.run.smithi032.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-10-08T06:09:53.869 INFO:teuthology.orchestra.run.smithi032.stdout: link/ether 02:42:fd:c1:b9:57 brd ff:ff:ff:ff:ff:ff 2023-10-08T06:09:53.869 INFO:teuthology.orchestra.run.smithi032.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-10-08T06:09:53.869 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2023-10-08T06:09:53.869 INFO:teuthology.orchestra.run.smithi032.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-08T06:09:53.869 INFO:teuthology.orchestra.run.smithi032.stdout: link/ether 42:02:c9:15:f5:aa brd ff:ff:ff:ff:ff:ff 2023-10-08T06:09:53.869 INFO:teuthology.orchestra.run.smithi032.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-08T06:09:53.870 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2023-10-08T06:09:53.870 INFO:teuthology.orchestra.run.smithi032.stdout: inet6 fe80::a830:32ff:fe5d:13f4/64 scope link 2023-10-08T06:09:53.870 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2023-10-08T06:09:53.870 INFO:teuthology.orchestra.run.smithi032.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-08T06:09:53.870 INFO:teuthology.orchestra.run.smithi032.stdout: link/ether 42:02:c9:15:f5:aa brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-08T06:09:53.870 INFO:teuthology.orchestra.run.smithi032.stdout: inet6 fe80::4002:c9ff:fe15:f5aa/64 scope link 2023-10-08T06:09:53.870 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2023-10-08T06:09:53.870 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T06:09:53.870 DEBUG:teuthology.orchestra.run.smithi032:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-08T06:09:53.883 INFO:teuthology.orchestra.run.smithi032.stdout:1 2023-10-08T06:09:53.884 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T06:09:53.885 DEBUG:teuthology.orchestra.run.smithi032:> route 2023-10-08T06:09:53.936 INFO:teuthology.orchestra.run.smithi032.stdout:Kernel IP routing table 2023-10-08T06:09:53.936 INFO:teuthology.orchestra.run.smithi032.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-08T06:09:53.936 INFO:teuthology.orchestra.run.smithi032.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-10-08T06:09:53.936 INFO:teuthology.orchestra.run.smithi032.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-10-08T06:09:53.936 INFO:teuthology.orchestra.run.smithi032.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-10-08T06:09:53.936 INFO:teuthology.orchestra.run.smithi032.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-08T06:09:53.937 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T06:09:53.937 DEBUG:teuthology.orchestra.run.smithi032:> (cd / && exec bash -c ' 2023-10-08T06:09:53.937 DEBUG:teuthology.orchestra.run.smithi032:> set -e 2023-10-08T06:09:53.937 DEBUG:teuthology.orchestra.run.smithi032:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-08T06:09:53.937 DEBUG:teuthology.orchestra.run.smithi032:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-08T06:09:53.937 DEBUG:teuthology.orchestra.run.smithi032:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-08T06:09:53.937 DEBUG:teuthology.orchestra.run.smithi032:> ') 2023-10-08T06:09:53.978 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T06:09:53.978 DEBUG:teuthology.orchestra.run.smithi032:> ip netns list 2023-10-08T06:09:53.985 INFO:teuthology.orchestra.run.smithi032.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-08T06:09:53.985 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T06:09:53.985 DEBUG:teuthology.orchestra.run.smithi032:> ip netns list-id 2023-10-08T06:09:53.992 INFO:teuthology.orchestra.run.smithi032.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2023-10-08T06:09:53.993 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T06:09:53.993 DEBUG:teuthology.orchestra.run.smithi032:> (cd / && exec bash -c ' 2023-10-08T06:09:53.993 DEBUG:teuthology.orchestra.run.smithi032:> set -e 2023-10-08T06:09:53.993 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-08T06:09:53.993 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2023-10-08T06:09:53.993 DEBUG:teuthology.orchestra.run.smithi032:> ') 2023-10-08T06:09:54.065 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T06:09:54.065 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-10-08T06:09:54.083 INFO:teuthology.orchestra.run.smithi032.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-08T06:09:54.083 INFO:teuthology.orchestra.run.smithi032.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-08T06:09:54.083 INFO:teuthology.orchestra.run.smithi032.stdout: inet 127.0.0.1/8 scope host lo 2023-10-08T06:09:54.083 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2023-10-08T06:09:54.083 INFO:teuthology.orchestra.run.smithi032.stdout: inet6 ::1/128 scope host 2023-10-08T06:09:54.083 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2023-10-08T06:09:54.083 INFO:teuthology.orchestra.run.smithi032.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-08T06:09:54.083 INFO:teuthology.orchestra.run.smithi032.stdout: link/ether 52:c2:ac:1a:95:d9 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-08T06:09:54.083 INFO:teuthology.orchestra.run.smithi032.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-08T06:09:54.083 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2023-10-08T06:09:54.084 INFO:teuthology.orchestra.run.smithi032.stdout: inet6 fe80::50c2:acff:fe1a:95d9/64 scope link 2023-10-08T06:09:54.084 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2023-10-08T06:09:54.085 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T06:09:54.085 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-10-08T06:09:54.095 INFO:teuthology.orchestra.run.smithi032.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-08T06:09:54.095 INFO:teuthology.orchestra.run.smithi032.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-08T06:09:54.095 INFO:teuthology.orchestra.run.smithi032.stdout: inet 127.0.0.1/8 scope host lo 2023-10-08T06:09:54.095 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2023-10-08T06:09:54.095 INFO:teuthology.orchestra.run.smithi032.stdout: inet6 ::1/128 scope host 2023-10-08T06:09:54.095 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2023-10-08T06:09:54.095 INFO:teuthology.orchestra.run.smithi032.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-08T06:09:54.096 INFO:teuthology.orchestra.run.smithi032.stdout: link/ether 52:c2:ac:1a:95:d9 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-08T06:09:54.096 INFO:teuthology.orchestra.run.smithi032.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-08T06:09:54.096 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2023-10-08T06:09:54.096 INFO:teuthology.orchestra.run.smithi032.stdout: inet6 fe80::50c2:acff:fe1a:95d9/64 scope link 2023-10-08T06:09:54.096 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2023-10-08T06:09:54.097 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2023-10-08T06:09:54.097 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T06:09:54.097 DEBUG:teuthology.orchestra.run.smithi032:> (cd / && exec bash -c ' 2023-10-08T06:09:54.097 DEBUG:teuthology.orchestra.run.smithi032:> set -e 2023-10-08T06:09:54.097 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2023-10-08T06:09:54.097 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-10-08T06:09:54.098 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2023-10-08T06:09:54.098 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2023-10-08T06:09:54.098 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2023-10-08T06:09:54.098 DEBUG:teuthology.orchestra.run.smithi032:> ') 2023-10-08T06:09:54.196 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T06:09:54.196 DEBUG:teuthology.orchestra.run.smithi032:> (cd / && exec bash -c ' 2023-10-08T06:09:54.196 DEBUG:teuthology.orchestra.run.smithi032:> set -e 2023-10-08T06:09:54.196 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip link set brx.1 up 2023-10-08T06:09:54.197 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip link set dev brx.1 master ceph-brx 2023-10-08T06:09:54.197 DEBUG:teuthology.orchestra.run.smithi032:> ') 2023-10-08T06:09:54.222 INFO:tasks.cephfs.fuse_mount:Client client.2 config is {} 2023-10-08T06:09:54.223 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T06:09:54.223 DEBUG:teuthology.orchestra.run.smithi032:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2023-10-08T06:09:54.229 INFO:teuthology.orchestra.run.smithi032.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2023-10-08T06:09:54.230 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T06:09:54.230 DEBUG:teuthology.orchestra.run.smithi032:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2023-10-08T06:09:54.236 DEBUG:teuthology.orchestra.run.smithi032:> sudo modprobe fuse 2023-10-08T06:09:54.250 DEBUG:teuthology.orchestra.run.smithi032:> cat /proc/self/mounts | awk '{print $2}' 2023-10-08T06:09:54.299 INFO:teuthology.orchestra.run.smithi032.stdout:/sys 2023-10-08T06:09:54.299 INFO:teuthology.orchestra.run.smithi032.stdout:/proc 2023-10-08T06:09:54.300 INFO:teuthology.orchestra.run.smithi032.stdout:/dev 2023-10-08T06:09:54.300 INFO:teuthology.orchestra.run.smithi032.stdout:/dev/pts 2023-10-08T06:09:54.300 INFO:teuthology.orchestra.run.smithi032.stdout:/run 2023-10-08T06:09:54.300 INFO:teuthology.orchestra.run.smithi032.stdout:/ 2023-10-08T06:09:54.300 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/kernel/security 2023-10-08T06:09:54.300 INFO:teuthology.orchestra.run.smithi032.stdout:/dev/shm 2023-10-08T06:09:54.300 INFO:teuthology.orchestra.run.smithi032.stdout:/run/lock 2023-10-08T06:09:54.300 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/cgroup 2023-10-08T06:09:54.300 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/cgroup/unified 2023-10-08T06:09:54.300 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/cgroup/systemd 2023-10-08T06:09:54.300 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/pstore 2023-10-08T06:09:54.301 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/bpf 2023-10-08T06:09:54.301 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/cgroup/cpu,cpuacct 2023-10-08T06:09:54.301 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/cgroup/net_cls,net_prio 2023-10-08T06:09:54.301 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/cgroup/blkio 2023-10-08T06:09:54.301 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/cgroup/pids 2023-10-08T06:09:54.301 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/cgroup/memory 2023-10-08T06:09:54.301 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/cgroup/freezer 2023-10-08T06:09:54.301 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/cgroup/perf_event 2023-10-08T06:09:54.301 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/cgroup/cpuset 2023-10-08T06:09:54.301 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/cgroup/devices 2023-10-08T06:09:54.302 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/cgroup/rdma 2023-10-08T06:09:54.302 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/cgroup/hugetlb 2023-10-08T06:09:54.302 INFO:teuthology.orchestra.run.smithi032.stdout:/proc/sys/fs/binfmt_misc 2023-10-08T06:09:54.302 INFO:teuthology.orchestra.run.smithi032.stdout:/dev/hugepages 2023-10-08T06:09:54.302 INFO:teuthology.orchestra.run.smithi032.stdout:/dev/mqueue 2023-10-08T06:09:54.302 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/kernel/debug 2023-10-08T06:09:54.302 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/kernel/tracing 2023-10-08T06:09:54.302 INFO:teuthology.orchestra.run.smithi032.stdout:/run/rpc_pipefs 2023-10-08T06:09:54.302 INFO:teuthology.orchestra.run.smithi032.stdout:/proc/fs/nfsd 2023-10-08T06:09:54.302 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/fuse/connections 2023-10-08T06:09:54.302 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/kernel/config 2023-10-08T06:09:54.302 INFO:teuthology.orchestra.run.smithi032.stdout:/run/user/1000 2023-10-08T06:09:54.303 INFO:teuthology.orchestra.run.smithi032.stdout:/var/lib/ceph 2023-10-08T06:09:54.303 INFO:teuthology.orchestra.run.smithi032.stdout:/var/lib/ceph/osd/ceph-0 2023-10-08T06:09:54.303 INFO:teuthology.orchestra.run.smithi032.stdout:/var/lib/ceph/osd/ceph-1 2023-10-08T06:09:54.303 INFO:teuthology.orchestra.run.smithi032.stdout:/var/lib/ceph/osd/ceph-2 2023-10-08T06:09:54.303 INFO:teuthology.orchestra.run.smithi032.stdout:/var/lib/ceph/osd/ceph-3 2023-10-08T06:09:54.303 INFO:teuthology.orchestra.run.smithi032.stdout:/run/netns 2023-10-08T06:09:54.303 INFO:teuthology.orchestra.run.smithi032.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-08T06:09:54.303 INFO:teuthology.orchestra.run.smithi032.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-08T06:09:54.303 INFO:teuthology.orchestra.run.smithi032.stdout:/home/ubuntu/cephtest/mnt.0 2023-10-08T06:09:54.303 INFO:teuthology.orchestra.run.smithi032.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-08T06:09:54.303 INFO:teuthology.orchestra.run.smithi032.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-08T06:09:54.304 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T06:09:54.304 DEBUG:teuthology.orchestra.run.smithi032:> ls /sys/fs/fuse/connections 2023-10-08T06:09:54.311 INFO:teuthology.orchestra.run.smithi032.stdout:52 2023-10-08T06:09:54.311 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [52] 2023-10-08T06:09:54.311 DEBUG:teuthology.orchestra.run.smithi032:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.2 --id 2) 2023-10-08T06:09:54.313 DEBUG:teuthology.orchestra.run.smithi032:> sudo modprobe fuse 2023-10-08T06:09:54.330 DEBUG:teuthology.orchestra.run.smithi032:> cat /proc/self/mounts | awk '{print $2}' 2023-10-08T06:09:54.378 INFO:teuthology.orchestra.run.smithi032.stdout:/sys 2023-10-08T06:09:54.378 INFO:teuthology.orchestra.run.smithi032.stdout:/proc 2023-10-08T06:09:54.378 INFO:teuthology.orchestra.run.smithi032.stdout:/dev 2023-10-08T06:09:54.378 INFO:teuthology.orchestra.run.smithi032.stdout:/dev/pts 2023-10-08T06:09:54.378 INFO:teuthology.orchestra.run.smithi032.stdout:/run 2023-10-08T06:09:54.378 INFO:teuthology.orchestra.run.smithi032.stdout:/ 2023-10-08T06:09:54.378 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/kernel/security 2023-10-08T06:09:54.379 INFO:teuthology.orchestra.run.smithi032.stdout:/dev/shm 2023-10-08T06:09:54.379 INFO:teuthology.orchestra.run.smithi032.stdout:/run/lock 2023-10-08T06:09:54.379 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/cgroup 2023-10-08T06:09:54.379 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/cgroup/unified 2023-10-08T06:09:54.379 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/cgroup/systemd 2023-10-08T06:09:54.379 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/pstore 2023-10-08T06:09:54.379 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/bpf 2023-10-08T06:09:54.379 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/cgroup/cpu,cpuacct 2023-10-08T06:09:54.379 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/cgroup/net_cls,net_prio 2023-10-08T06:09:54.379 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/cgroup/blkio 2023-10-08T06:09:54.379 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/cgroup/pids 2023-10-08T06:09:54.380 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/cgroup/memory 2023-10-08T06:09:54.380 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/cgroup/freezer 2023-10-08T06:09:54.380 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/cgroup/perf_event 2023-10-08T06:09:54.380 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/cgroup/cpuset 2023-10-08T06:09:54.380 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/cgroup/devices 2023-10-08T06:09:54.380 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/cgroup/rdma 2023-10-08T06:09:54.380 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/cgroup/hugetlb 2023-10-08T06:09:54.380 INFO:teuthology.orchestra.run.smithi032.stdout:/proc/sys/fs/binfmt_misc 2023-10-08T06:09:54.380 INFO:teuthology.orchestra.run.smithi032.stdout:/dev/hugepages 2023-10-08T06:09:54.380 INFO:teuthology.orchestra.run.smithi032.stdout:/dev/mqueue 2023-10-08T06:09:54.380 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/kernel/debug 2023-10-08T06:09:54.380 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/kernel/tracing 2023-10-08T06:09:54.381 INFO:teuthology.orchestra.run.smithi032.stdout:/run/rpc_pipefs 2023-10-08T06:09:54.381 INFO:teuthology.orchestra.run.smithi032.stdout:/proc/fs/nfsd 2023-10-08T06:09:54.381 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/fuse/connections 2023-10-08T06:09:54.381 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/kernel/config 2023-10-08T06:09:54.381 INFO:teuthology.orchestra.run.smithi032.stdout:/run/user/1000 2023-10-08T06:09:54.381 INFO:teuthology.orchestra.run.smithi032.stdout:/var/lib/ceph 2023-10-08T06:09:54.381 INFO:teuthology.orchestra.run.smithi032.stdout:/var/lib/ceph/osd/ceph-0 2023-10-08T06:09:54.381 INFO:teuthology.orchestra.run.smithi032.stdout:/var/lib/ceph/osd/ceph-1 2023-10-08T06:09:54.381 INFO:teuthology.orchestra.run.smithi032.stdout:/var/lib/ceph/osd/ceph-2 2023-10-08T06:09:54.381 INFO:teuthology.orchestra.run.smithi032.stdout:/var/lib/ceph/osd/ceph-3 2023-10-08T06:09:54.381 INFO:teuthology.orchestra.run.smithi032.stdout:/run/netns 2023-10-08T06:09:54.382 INFO:teuthology.orchestra.run.smithi032.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-08T06:09:54.382 INFO:teuthology.orchestra.run.smithi032.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-08T06:09:54.382 INFO:teuthology.orchestra.run.smithi032.stdout:/home/ubuntu/cephtest/mnt.0 2023-10-08T06:09:54.382 INFO:teuthology.orchestra.run.smithi032.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-08T06:09:54.382 INFO:teuthology.orchestra.run.smithi032.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-08T06:09:54.383 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T06:09:54.383 DEBUG:teuthology.orchestra.run.smithi032:> ls /sys/fs/fuse/connections 2023-10-08T06:09:54.389 INFO:teuthology.orchestra.run.smithi032.stdout:52 2023-10-08T06:09:54.402 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi032.stderr:2023-10-08T06:09:54.400+0000 7f2944111640 -1 init, newargv = 0x55b1f319e850 newargc=15 2023-10-08T06:09:54.402 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi032.stderr:ceph-fuse[42164]: starting ceph client 2023-10-08T06:09:54.411 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi032.stderr:ceph-fuse[42164]: starting fuse 2023-10-08T06:09:55.491 DEBUG:teuthology.orchestra.run.smithi032:> sudo modprobe fuse 2023-10-08T06:09:55.508 DEBUG:teuthology.orchestra.run.smithi032:> cat /proc/self/mounts | awk '{print $2}' 2023-10-08T06:09:55.559 INFO:teuthology.orchestra.run.smithi032.stdout:/sys 2023-10-08T06:09:55.559 INFO:teuthology.orchestra.run.smithi032.stdout:/proc 2023-10-08T06:09:55.559 INFO:teuthology.orchestra.run.smithi032.stdout:/dev 2023-10-08T06:09:55.559 INFO:teuthology.orchestra.run.smithi032.stdout:/dev/pts 2023-10-08T06:09:55.560 INFO:teuthology.orchestra.run.smithi032.stdout:/run 2023-10-08T06:09:55.560 INFO:teuthology.orchestra.run.smithi032.stdout:/ 2023-10-08T06:09:55.560 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/kernel/security 2023-10-08T06:09:55.560 INFO:teuthology.orchestra.run.smithi032.stdout:/dev/shm 2023-10-08T06:09:55.560 INFO:teuthology.orchestra.run.smithi032.stdout:/run/lock 2023-10-08T06:09:55.560 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/cgroup 2023-10-08T06:09:55.560 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/cgroup/unified 2023-10-08T06:09:55.560 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/cgroup/systemd 2023-10-08T06:09:55.560 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/pstore 2023-10-08T06:09:55.560 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/bpf 2023-10-08T06:09:55.560 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/cgroup/cpu,cpuacct 2023-10-08T06:09:55.561 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/cgroup/net_cls,net_prio 2023-10-08T06:09:55.561 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/cgroup/blkio 2023-10-08T06:09:55.561 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/cgroup/pids 2023-10-08T06:09:55.561 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/cgroup/memory 2023-10-08T06:09:55.561 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/cgroup/freezer 2023-10-08T06:09:55.561 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/cgroup/perf_event 2023-10-08T06:09:55.561 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/cgroup/cpuset 2023-10-08T06:09:55.561 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/cgroup/devices 2023-10-08T06:09:55.561 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/cgroup/rdma 2023-10-08T06:09:55.561 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/cgroup/hugetlb 2023-10-08T06:09:55.561 INFO:teuthology.orchestra.run.smithi032.stdout:/proc/sys/fs/binfmt_misc 2023-10-08T06:09:55.561 INFO:teuthology.orchestra.run.smithi032.stdout:/dev/hugepages 2023-10-08T06:09:55.562 INFO:teuthology.orchestra.run.smithi032.stdout:/dev/mqueue 2023-10-08T06:09:55.562 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/kernel/debug 2023-10-08T06:09:55.562 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/kernel/tracing 2023-10-08T06:09:55.562 INFO:teuthology.orchestra.run.smithi032.stdout:/run/rpc_pipefs 2023-10-08T06:09:55.562 INFO:teuthology.orchestra.run.smithi032.stdout:/proc/fs/nfsd 2023-10-08T06:09:55.562 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/fuse/connections 2023-10-08T06:09:55.562 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/kernel/config 2023-10-08T06:09:55.562 INFO:teuthology.orchestra.run.smithi032.stdout:/run/user/1000 2023-10-08T06:09:55.562 INFO:teuthology.orchestra.run.smithi032.stdout:/var/lib/ceph 2023-10-08T06:09:55.562 INFO:teuthology.orchestra.run.smithi032.stdout:/var/lib/ceph/osd/ceph-0 2023-10-08T06:09:55.562 INFO:teuthology.orchestra.run.smithi032.stdout:/var/lib/ceph/osd/ceph-1 2023-10-08T06:09:55.563 INFO:teuthology.orchestra.run.smithi032.stdout:/var/lib/ceph/osd/ceph-2 2023-10-08T06:09:55.563 INFO:teuthology.orchestra.run.smithi032.stdout:/var/lib/ceph/osd/ceph-3 2023-10-08T06:09:55.563 INFO:teuthology.orchestra.run.smithi032.stdout:/run/netns 2023-10-08T06:09:55.563 INFO:teuthology.orchestra.run.smithi032.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-08T06:09:55.563 INFO:teuthology.orchestra.run.smithi032.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-08T06:09:55.563 INFO:teuthology.orchestra.run.smithi032.stdout:/home/ubuntu/cephtest/mnt.0 2023-10-08T06:09:55.563 INFO:teuthology.orchestra.run.smithi032.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-08T06:09:55.563 INFO:teuthology.orchestra.run.smithi032.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-08T06:09:55.563 INFO:teuthology.orchestra.run.smithi032.stdout:/home/ubuntu/cephtest/mnt.2 2023-10-08T06:09:55.564 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T06:09:55.564 DEBUG:teuthology.orchestra.run.smithi032:> ls /sys/fs/fuse/connections 2023-10-08T06:09:55.571 INFO:teuthology.orchestra.run.smithi032.stdout:52 2023-10-08T06:09:55.571 INFO:teuthology.orchestra.run.smithi032.stdout:53 2023-10-08T06:09:55.571 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52, 53] 2023-10-08T06:09:55.571 DEBUG:teuthology.orchestra.run.smithi032:> sudo stdin-killer -- python3 -c ' 2023-10-08T06:09:55.571 DEBUG:teuthology.orchestra.run.smithi032:> import glob 2023-10-08T06:09:55.571 DEBUG:teuthology.orchestra.run.smithi032:> import re 2023-10-08T06:09:55.571 DEBUG:teuthology.orchestra.run.smithi032:> import os 2023-10-08T06:09:55.572 DEBUG:teuthology.orchestra.run.smithi032:> import subprocess 2023-10-08T06:09:55.572 DEBUG:teuthology.orchestra.run.smithi032:> 2023-10-08T06:09:55.572 DEBUG:teuthology.orchestra.run.smithi032:> def _find_admin_socket(client_name): 2023-10-08T06:09:55.572 DEBUG:teuthology.orchestra.run.smithi032:> asok_path = "/var/run/ceph/ceph-client.2.*.asok" 2023-10-08T06:09:55.572 DEBUG:teuthology.orchestra.run.smithi032:> files = glob.glob(asok_path) 2023-10-08T06:09:55.572 DEBUG:teuthology.orchestra.run.smithi032:> mountpoint = "/home/ubuntu/cephtest/mnt.2" 2023-10-08T06:09:55.572 DEBUG:teuthology.orchestra.run.smithi032:> 2023-10-08T06:09:55.572 DEBUG:teuthology.orchestra.run.smithi032:> # Given a non-glob path, it better be there 2023-10-08T06:09:55.572 DEBUG:teuthology.orchestra.run.smithi032:> if "*" not in asok_path: 2023-10-08T06:09:55.572 DEBUG:teuthology.orchestra.run.smithi032:> assert(len(files) == 1) 2023-10-08T06:09:55.572 DEBUG:teuthology.orchestra.run.smithi032:> return files[0] 2023-10-08T06:09:55.572 DEBUG:teuthology.orchestra.run.smithi032:> 2023-10-08T06:09:55.573 DEBUG:teuthology.orchestra.run.smithi032:> for f in files: 2023-10-08T06:09:55.573 DEBUG:teuthology.orchestra.run.smithi032:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-08T06:09:55.573 DEBUG:teuthology.orchestra.run.smithi032:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-08T06:09:55.573 DEBUG:teuthology.orchestra.run.smithi032:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-08T06:09:55.573 DEBUG:teuthology.orchestra.run.smithi032:> contents = proc_f.read() 2023-10-08T06:09:55.573 DEBUG:teuthology.orchestra.run.smithi032:> if mountpoint in contents: 2023-10-08T06:09:55.573 DEBUG:teuthology.orchestra.run.smithi032:> return f 2023-10-08T06:09:55.573 DEBUG:teuthology.orchestra.run.smithi032:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-08T06:09:55.573 DEBUG:teuthology.orchestra.run.smithi032:> 2023-10-08T06:09:55.573 DEBUG:teuthology.orchestra.run.smithi032:> print(_find_admin_socket("client.2")) 2023-10-08T06:09:55.573 DEBUG:teuthology.orchestra.run.smithi032:> ' 2023-10-08T06:09:55.661 INFO:teuthology.orchestra.run.smithi032.stdout:/var/run/ceph/ceph-client.2.42164.asok 2023-10-08T06:09:55.665 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-08T06:09:55.678 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.2.42164.asok 2023-10-08T06:09:55.678 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T06:09:55.678 DEBUG:teuthology.orchestra.run.smithi032:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.2.42164.asok status 2023-10-08T06:09:55.823 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2023-10-08T06:09:55.823 INFO:teuthology.orchestra.run.smithi032.stdout: "metadata": { 2023-10-08T06:09:55.823 INFO:teuthology.orchestra.run.smithi032.stdout: "ceph_sha1": "9725b08fd801c82987c737f7e6d354878f036ee8", 2023-10-08T06:09:55.823 INFO:teuthology.orchestra.run.smithi032.stdout: "ceph_version": "ceph version 18.0.0-6609-g9725b08f (9725b08fd801c82987c737f7e6d354878f036ee8) reef (dev)", 2023-10-08T06:09:55.823 INFO:teuthology.orchestra.run.smithi032.stdout: "entity_id": "2", 2023-10-08T06:09:55.823 INFO:teuthology.orchestra.run.smithi032.stdout: "hostname": "smithi032", 2023-10-08T06:09:55.824 INFO:teuthology.orchestra.run.smithi032.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.2", 2023-10-08T06:09:55.824 INFO:teuthology.orchestra.run.smithi032.stdout: "pid": "42164", 2023-10-08T06:09:55.824 INFO:teuthology.orchestra.run.smithi032.stdout: "root": "/" 2023-10-08T06:09:55.824 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-10-08T06:09:55.824 INFO:teuthology.orchestra.run.smithi032.stdout: "dentry_count": 0, 2023-10-08T06:09:55.824 INFO:teuthology.orchestra.run.smithi032.stdout: "dentry_pinned_count": 0, 2023-10-08T06:09:55.824 INFO:teuthology.orchestra.run.smithi032.stdout: "id": 4698, 2023-10-08T06:09:55.824 INFO:teuthology.orchestra.run.smithi032.stdout: "inst": { 2023-10-08T06:09:55.824 INFO:teuthology.orchestra.run.smithi032.stdout: "name": { 2023-10-08T06:09:55.824 INFO:teuthology.orchestra.run.smithi032.stdout: "type": "client", 2023-10-08T06:09:55.824 INFO:teuthology.orchestra.run.smithi032.stdout: "num": 4698 2023-10-08T06:09:55.824 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-10-08T06:09:55.825 INFO:teuthology.orchestra.run.smithi032.stdout: "addr": { 2023-10-08T06:09:55.825 INFO:teuthology.orchestra.run.smithi032.stdout: "type": "v1", 2023-10-08T06:09:55.825 INFO:teuthology.orchestra.run.smithi032.stdout: "addr": "192.168.0.2:0", 2023-10-08T06:09:55.825 INFO:teuthology.orchestra.run.smithi032.stdout: "nonce": 3788400689 2023-10-08T06:09:55.825 INFO:teuthology.orchestra.run.smithi032.stdout: } 2023-10-08T06:09:55.825 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-10-08T06:09:55.825 INFO:teuthology.orchestra.run.smithi032.stdout: "addr": { 2023-10-08T06:09:55.825 INFO:teuthology.orchestra.run.smithi032.stdout: "type": "v1", 2023-10-08T06:09:55.825 INFO:teuthology.orchestra.run.smithi032.stdout: "addr": "192.168.0.2:0", 2023-10-08T06:09:55.825 INFO:teuthology.orchestra.run.smithi032.stdout: "nonce": 3788400689 2023-10-08T06:09:55.825 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-10-08T06:09:55.825 INFO:teuthology.orchestra.run.smithi032.stdout: "inst_str": "client.4698 192.168.0.2:0/3788400689", 2023-10-08T06:09:55.826 INFO:teuthology.orchestra.run.smithi032.stdout: "addr_str": "192.168.0.2:0/3788400689", 2023-10-08T06:09:55.826 INFO:teuthology.orchestra.run.smithi032.stdout: "inode_count": 1, 2023-10-08T06:09:55.826 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_epoch": 6, 2023-10-08T06:09:55.826 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_epoch": 22, 2023-10-08T06:09:55.826 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_epoch_barrier": 0, 2023-10-08T06:09:55.826 INFO:teuthology.orchestra.run.smithi032.stdout: "blocklisted": false, 2023-10-08T06:09:55.826 INFO:teuthology.orchestra.run.smithi032.stdout: "fs_name": "cephfs" 2023-10-08T06:09:55.826 INFO:teuthology.orchestra.run.smithi032.stdout:} 2023-10-08T06:09:55.834 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-08T06:09:55.945 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:55.944+0000 7f9771662700 1 Processor -- start 2023-10-08T06:09:55.946 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:55.944+0000 7f9771662700 1 -- start start 2023-10-08T06:09:55.947 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:55.944+0000 7f9771662700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f976c1652b0 0x7f976c0cb7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:55.947 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:55.944+0000 7f9771662700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f976c06c200 con 0x7f976c0c21a0 2023-10-08T06:09:55.947 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:55.944+0000 7f9771662700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f976c165d00 con 0x7f976c165740 2023-10-08T06:09:55.947 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:55.944+0000 7f9771662700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f976c1662c0 con 0x7f976c1652b0 2023-10-08T06:09:55.948 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:55.944+0000 7f976b7fe700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f976c1652b0 0x7f976c0cb7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:55.948 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:55.944+0000 7f976bfff700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f976c0c21a0 0x7f976c06c690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:57036/0 (socket says 172.21.15.32:57036) 2023-10-08T06:09:55.948 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:55.944+0000 7f976bfff700 1 -- 172.21.15.32:0/1709134390 learned_addr learned my addr 172.21.15.32:0/1709134390 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-08T06:09:55.948 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:55.948+0000 7f976b7fe700 1 -- 172.21.15.32:0/1709134390 >> v1:172.21.15.40:6789/0 conn(0x7f976c165740 legacy=0x7f976c0cc9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:55.949 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:55.948+0000 7f976b7fe700 1 -- 172.21.15.32:0/1709134390 >> v1:172.21.15.32:6789/0 conn(0x7f976c0c21a0 legacy=0x7f976c06c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:55.949 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:55.948+0000 7f976b7fe700 1 -- 172.21.15.32:0/1709134390 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f976c165fe0 con 0x7f976c1652b0 2023-10-08T06:09:55.949 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:55.948+0000 7f976affd700 1 -- 172.21.15.32:0/1709134390 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 510037488 0 0) 0x7f976c06c200 con 0x7f976c0c21a0 2023-10-08T06:09:55.949 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:55.948+0000 7f976b7fe700 1 --2- 172.21.15.32:0/1709134390 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f976c1652b0 0x7f976c0cb7e0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f975c009850 tx=0x7f975c009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=973f177b814362e2 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:55.949 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:55.948+0000 7f976affd700 1 -- 172.21.15.32:0/1709134390 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f975c011830 con 0x7f976c1652b0 2023-10-08T06:09:55.949 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:55.948+0000 7f976affd700 1 -- 172.21.15.32:0/1709134390 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f975c011990 con 0x7f976c1652b0 2023-10-08T06:09:55.949 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:55.948+0000 7f976affd700 1 -- 172.21.15.32:0/1709134390 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f975c011d20 con 0x7f976c1652b0 2023-10-08T06:09:55.950 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:55.948+0000 7f9771662700 1 -- 172.21.15.32:0/1709134390 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f976c1652b0 msgr2=0x7f976c0cb7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:55.950 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:55.948+0000 7f9771662700 1 --2- 172.21.15.32:0/1709134390 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f976c1652b0 0x7f976c0cb7e0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f975c009850 tx=0x7f975c009b60 comp rx=0 tx=0).stop 2023-10-08T06:09:55.950 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:55.948+0000 7f9771662700 1 -- 172.21.15.32:0/1709134390 shutdown_connections 2023-10-08T06:09:55.950 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:55.948+0000 7f9771662700 1 --2- 172.21.15.32:0/1709134390 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f976c1652b0 0x7f976c0cb7e0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:55.950 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:55.948+0000 7f9771662700 1 -- 172.21.15.32:0/1709134390 >> 172.21.15.32:0/1709134390 conn(0x7f976c0b0900 msgr2=0x7f976c0b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:09:55.950 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:55.948+0000 7f9771662700 1 -- 172.21.15.32:0/1709134390 shutdown_connections 2023-10-08T06:09:55.950 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:55.948+0000 7f9771662700 1 -- 172.21.15.32:0/1709134390 wait complete. 2023-10-08T06:09:55.951 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:55.948+0000 7f9771662700 1 Processor -- start 2023-10-08T06:09:55.951 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:55.948+0000 7f9771662700 1 -- start start 2023-10-08T06:09:55.953 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:55.952+0000 7f9771662700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f976c0c21a0 0x7f976c152230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:55.953 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:55.952+0000 7f9771662700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f976c1652b0 0x7f976c0c6060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:55.953 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:55.952+0000 7f9771662700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f976c165740 0x7f976c0afaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:55.953 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:55.952+0000 7f9771662700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f976c0c8b90 con 0x7f976c1652b0 2023-10-08T06:09:55.953 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:55.952+0000 7f9771662700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f976c0c3af0 con 0x7f976c165740 2023-10-08T06:09:55.954 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:55.952+0000 7f9771662700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f976c1fa6d0 con 0x7f976c0c21a0 2023-10-08T06:09:55.954 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:55.952+0000 7f976b7fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f976c1652b0 0x7f976c0c6060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:55.954 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:55.952+0000 7f976b7fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f976c1652b0 0x7f976c0c6060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:52846/0 (socket says 172.21.15.32:52846) 2023-10-08T06:09:55.954 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:55.952+0000 7f976bfff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f976c0c21a0 0x7f976c152230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:55.954 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:55.952+0000 7f976b7fe700 1 -- 172.21.15.32:0/1282181654 learned_addr learned my addr 172.21.15.32:0/1282181654 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:09:55.954 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:55.952+0000 7f9770e61700 1 --2- 172.21.15.32:0/1282181654 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f976c165740 0x7f976c0afaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:55.955 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:55.952+0000 7f976b7fe700 1 -- 172.21.15.32:0/1282181654 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f976c0c21a0 msgr2=0x7f976c152230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:55.955 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:55.952+0000 7f976b7fe700 1 --2- 172.21.15.32:0/1282181654 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f976c0c21a0 0x7f976c152230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:55.955 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:55.952+0000 7f976b7fe700 1 -- 172.21.15.32:0/1282181654 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f976c165740 msgr2=0x7f976c0afaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:55.956 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:55.952+0000 7f976b7fe700 1 --2- 172.21.15.32:0/1282181654 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f976c165740 0x7f976c0afaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:55.956 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:55.952+0000 7f976b7fe700 1 -- 172.21.15.32:0/1282181654 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f975c0094b0 con 0x7f976c1652b0 2023-10-08T06:09:55.956 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:55.952+0000 7f9770e61700 1 --2- 172.21.15.32:0/1282181654 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f976c165740 0x7f976c0afaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T06:09:55.956 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:55.952+0000 7f976b7fe700 1 --2- 172.21.15.32:0/1282181654 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f976c1652b0 0x7f976c0c6060 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f975c0090b0 tx=0x7f975c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:55.956 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:55.952+0000 7f9768ff9700 1 -- 172.21.15.32:0/1282181654 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f975c00bb60 con 0x7f976c1652b0 2023-10-08T06:09:55.956 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:55.952+0000 7f9768ff9700 1 -- 172.21.15.32:0/1282181654 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f975c01f070 con 0x7f976c1652b0 2023-10-08T06:09:55.956 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:55.952+0000 7f9768ff9700 1 -- 172.21.15.32:0/1282181654 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f975c01a430 con 0x7f976c1652b0 2023-10-08T06:09:55.956 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:55.952+0000 7f9771662700 1 -- 172.21.15.32:0/1282181654 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f976c1fa9b0 con 0x7f976c1652b0 2023-10-08T06:09:55.956 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:55.952+0000 7f9771662700 1 -- 172.21.15.32:0/1282181654 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f976c152770 con 0x7f976c1652b0 2023-10-08T06:09:55.957 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:55.956+0000 7f9771662700 1 -- 172.21.15.32:0/1282181654 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f976c0c3c30 con 0x7f976c1652b0 2023-10-08T06:09:55.958 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:55.956+0000 7f9768ff9700 1 -- 172.21.15.32:0/1282181654 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f975c01a590 con 0x7f976c1652b0 2023-10-08T06:09:55.959 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:55.956+0000 7f9768ff9700 1 --2- 172.21.15.32:0/1282181654 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f9758066510 0x7f97580689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:55.959 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:55.956+0000 7f976bfff700 1 --2- 172.21.15.32:0/1282181654 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f9758066510 0x7f97580689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:55.959 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:55.956+0000 7f9768ff9700 1 -- 172.21.15.32:0/1282181654 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f975c021070 con 0x7f976c1652b0 2023-10-08T06:09:55.960 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:55.960+0000 7f976bfff700 1 --2- 172.21.15.32:0/1282181654 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f9758066510 0x7f97580689d0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f9760007b30 tx=0x7f9760007a80 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:55.967 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:55.964+0000 7f9768ff9700 1 -- 172.21.15.32:0/1282181654 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f976c0c3c30 con 0x7f976c1652b0 2023-10-08T06:09:56.160 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:56.160+0000 7f9771662700 1 -- 172.21.15.32:0/1282181654 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f976c0c3c30 con 0x7f976c1652b0 2023-10-08T06:09:56.161 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:56.160+0000 7f9768ff9700 1 -- 172.21.15.32:0/1282181654 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) v1 ==== 53+0+73 (secure 0 0 0) 0x7f976c0c3c30 con 0x7f976c1652b0 2023-10-08T06:09:56.161 INFO:teuthology.orchestra.run.smithi032.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-08T06:09:56.163 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:56.160+0000 7f9771662700 1 -- 172.21.15.32:0/1282181654 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f9758066510 msgr2=0x7f97580689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:56.164 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:56.160+0000 7f9771662700 1 --2- 172.21.15.32:0/1282181654 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f9758066510 0x7f97580689d0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f9760007b30 tx=0x7f9760007a80 comp rx=0 tx=0).stop 2023-10-08T06:09:56.164 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:56.160+0000 7f9771662700 1 -- 172.21.15.32:0/1282181654 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f976c1652b0 msgr2=0x7f976c0c6060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:56.164 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:56.160+0000 7f9771662700 1 --2- 172.21.15.32:0/1282181654 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f976c1652b0 0x7f976c0c6060 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f975c0090b0 tx=0x7f975c004770 comp rx=0 tx=0).stop 2023-10-08T06:09:56.164 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:56.160+0000 7f9771662700 1 -- 172.21.15.32:0/1282181654 shutdown_connections 2023-10-08T06:09:56.164 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:56.160+0000 7f9771662700 1 --2- 172.21.15.32:0/1282181654 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f9758066510 0x7f97580689d0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:56.164 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:56.160+0000 7f9771662700 1 --2- 172.21.15.32:0/1282181654 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f976c1652b0 0x7f976c0c6060 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:56.164 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:56.160+0000 7f9771662700 1 --2- 172.21.15.32:0/1282181654 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f976c165740 0x7f976c0afaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:56.164 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:56.160+0000 7f9771662700 1 --2- 172.21.15.32:0/1282181654 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f976c0c21a0 0x7f976c152230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:56.164 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:56.160+0000 7f9771662700 1 -- 172.21.15.32:0/1282181654 >> 172.21.15.32:0/1282181654 conn(0x7f976c0b0900 msgr2=0x7f976c163c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:09:56.164 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:56.164+0000 7f9771662700 1 -- 172.21.15.32:0/1282181654 shutdown_connections 2023-10-08T06:09:56.164 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:56.164+0000 7f9771662700 1 -- 172.21.15.32:0/1282181654 wait complete. 2023-10-08T06:09:56.179 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-08T06:09:56.179 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-08T06:09:56.179 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi040.front.sepia.ceph.com 2023-10-08T06:09:56.180 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-08T06:09:56.180 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-08T06:09:56.180 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-08T06:09:56.180 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-08T06:09:56.180 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-08T06:09:56.180 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-08T06:09:56.180 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T06:09:56.180 DEBUG:teuthology.orchestra.run.smithi040:> ip addr 2023-10-08T06:09:56.188 INFO:teuthology.orchestra.run.smithi040.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-08T06:09:56.188 INFO:teuthology.orchestra.run.smithi040.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-08T06:09:56.188 INFO:teuthology.orchestra.run.smithi040.stdout: inet 127.0.0.1/8 scope host lo 2023-10-08T06:09:56.189 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-10-08T06:09:56.189 INFO:teuthology.orchestra.run.smithi040.stdout: inet6 ::1/128 scope host 2023-10-08T06:09:56.189 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-10-08T06:09:56.189 INFO:teuthology.orchestra.run.smithi040.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-08T06:09:56.189 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 0c:c4:7a:6b:fd:16 brd ff:ff:ff:ff:ff:ff 2023-10-08T06:09:56.189 INFO:teuthology.orchestra.run.smithi040.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-08T06:09:56.189 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 0c:c4:7a:6b:fd:17 brd ff:ff:ff:ff:ff:ff 2023-10-08T06:09:56.189 INFO:teuthology.orchestra.run.smithi040.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-08T06:09:56.189 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 0c:c4:7a:bd:12:cc brd ff:ff:ff:ff:ff:ff 2023-10-08T06:09:56.189 INFO:teuthology.orchestra.run.smithi040.stdout: inet 172.21.15.40/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-10-08T06:09:56.189 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft 42540sec preferred_lft 42540sec 2023-10-08T06:09:56.189 INFO:teuthology.orchestra.run.smithi040.stdout: inet6 fe80::ec4:7aff:febd:12cc/64 scope link 2023-10-08T06:09:56.190 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-10-08T06:09:56.190 INFO:teuthology.orchestra.run.smithi040.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-08T06:09:56.190 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 0c:c4:7a:bd:12:cd brd ff:ff:ff:ff:ff:ff 2023-10-08T06:09:56.190 INFO:teuthology.orchestra.run.smithi040.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-10-08T06:09:56.190 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 02:42:cb:19:5e:4c brd ff:ff:ff:ff:ff:ff 2023-10-08T06:09:56.190 INFO:teuthology.orchestra.run.smithi040.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-10-08T06:09:56.190 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-10-08T06:09:56.190 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-10-08T06:09:56.190 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T06:09:56.191 DEBUG:teuthology.orchestra.run.smithi040:> (cd / && exec bash -c ' 2023-10-08T06:09:56.191 DEBUG:teuthology.orchestra.run.smithi040:> set -e 2023-10-08T06:09:56.191 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip link add name ceph-brx type bridge 2023-10-08T06:09:56.191 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip addr flush dev ceph-brx 2023-10-08T06:09:56.191 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip link set ceph-brx up 2023-10-08T06:09:56.191 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-10-08T06:09:56.191 DEBUG:teuthology.orchestra.run.smithi040:> ') 2023-10-08T06:09:56.276 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T06:09:56.276 DEBUG:teuthology.orchestra.run.smithi040:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-08T06:09:56.286 INFO:teuthology.orchestra.run.smithi040.stdout:1 2023-10-08T06:09:56.287 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T06:09:56.287 DEBUG:teuthology.orchestra.run.smithi040:> route 2023-10-08T06:09:56.315 INFO:teuthology.orchestra.run.smithi040.stdout:Kernel IP routing table 2023-10-08T06:09:56.315 INFO:teuthology.orchestra.run.smithi040.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-08T06:09:56.315 INFO:teuthology.orchestra.run.smithi040.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-10-08T06:09:56.315 INFO:teuthology.orchestra.run.smithi040.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-10-08T06:09:56.315 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-10-08T06:09:56.315 INFO:teuthology.orchestra.run.smithi040.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-08T06:09:56.315 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T06:09:56.316 DEBUG:teuthology.orchestra.run.smithi040:> (cd / && exec bash -c ' 2023-10-08T06:09:56.316 DEBUG:teuthology.orchestra.run.smithi040:> set -e 2023-10-08T06:09:56.316 DEBUG:teuthology.orchestra.run.smithi040:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-08T06:09:56.316 DEBUG:teuthology.orchestra.run.smithi040:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-08T06:09:56.316 DEBUG:teuthology.orchestra.run.smithi040:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-08T06:09:56.316 DEBUG:teuthology.orchestra.run.smithi040:> ') 2023-10-08T06:09:56.356 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T06:09:56.356 DEBUG:teuthology.orchestra.run.smithi040:> ip netns list 2023-10-08T06:09:56.361 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T06:09:56.362 DEBUG:teuthology.orchestra.run.smithi040:> ip netns list-id 2023-10-08T06:09:56.412 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T06:09:56.413 DEBUG:teuthology.orchestra.run.smithi040:> (cd / && exec bash -c ' 2023-10-08T06:09:56.413 DEBUG:teuthology.orchestra.run.smithi040:> set -e 2023-10-08T06:09:56.413 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-08T06:09:56.413 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-10-08T06:09:56.413 DEBUG:teuthology.orchestra.run.smithi040:> ') 2023-10-08T06:09:56.442 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-10-08T06:09:56.443 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T06:09:56.443 DEBUG:teuthology.orchestra.run.smithi040:> (cd / && exec bash -c ' 2023-10-08T06:09:56.443 DEBUG:teuthology.orchestra.run.smithi040:> set -e 2023-10-08T06:09:56.443 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-10-08T06:09:56.443 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-10-08T06:09:56.443 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-10-08T06:09:56.443 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-10-08T06:09:56.443 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-10-08T06:09:56.443 DEBUG:teuthology.orchestra.run.smithi040:> ') 2023-10-08T06:09:56.520 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T06:09:56.521 DEBUG:teuthology.orchestra.run.smithi040:> (cd / && exec bash -c ' 2023-10-08T06:09:56.521 DEBUG:teuthology.orchestra.run.smithi040:> set -e 2023-10-08T06:09:56.521 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip link set brx.0 up 2023-10-08T06:09:56.521 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip link set dev brx.0 master ceph-brx 2023-10-08T06:09:56.521 DEBUG:teuthology.orchestra.run.smithi040:> ') 2023-10-08T06:09:56.547 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2023-10-08T06:09:56.548 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T06:09:56.548 DEBUG:teuthology.orchestra.run.smithi040:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-08T06:09:56.601 INFO:teuthology.orchestra.run.smithi040.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-08T06:09:56.601 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T06:09:56.601 DEBUG:teuthology.orchestra.run.smithi040:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-08T06:09:56.607 DEBUG:teuthology.orchestra.run.smithi040:> sudo modprobe fuse 2023-10-08T06:09:56.623 DEBUG:teuthology.orchestra.run.smithi040:> cat /proc/self/mounts | awk '{print $2}' 2023-10-08T06:09:56.631 INFO:teuthology.orchestra.run.smithi040.stdout:/sys 2023-10-08T06:09:56.631 INFO:teuthology.orchestra.run.smithi040.stdout:/proc 2023-10-08T06:09:56.631 INFO:teuthology.orchestra.run.smithi040.stdout:/dev 2023-10-08T06:09:56.631 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/pts 2023-10-08T06:09:56.631 INFO:teuthology.orchestra.run.smithi040.stdout:/run 2023-10-08T06:09:56.632 INFO:teuthology.orchestra.run.smithi040.stdout:/ 2023-10-08T06:09:56.632 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/security 2023-10-08T06:09:56.632 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/shm 2023-10-08T06:09:56.632 INFO:teuthology.orchestra.run.smithi040.stdout:/run/lock 2023-10-08T06:09:56.632 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/cgroup 2023-10-08T06:09:56.632 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/cgroup/unified 2023-10-08T06:09:56.632 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/cgroup/systemd 2023-10-08T06:09:56.632 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/pstore 2023-10-08T06:09:56.633 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/bpf 2023-10-08T06:09:56.633 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/cgroup/devices 2023-10-08T06:09:56.633 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/cgroup/cpu,cpuacct 2023-10-08T06:09:56.633 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/cgroup/rdma 2023-10-08T06:09:56.633 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/cgroup/freezer 2023-10-08T06:09:56.633 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/cgroup/net_cls,net_prio 2023-10-08T06:09:56.633 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/cgroup/blkio 2023-10-08T06:09:56.633 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/cgroup/cpuset 2023-10-08T06:09:56.634 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/cgroup/hugetlb 2023-10-08T06:09:56.634 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/cgroup/memory 2023-10-08T06:09:56.634 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/cgroup/pids 2023-10-08T06:09:56.634 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/cgroup/perf_event 2023-10-08T06:09:56.634 INFO:teuthology.orchestra.run.smithi040.stdout:/proc/sys/fs/binfmt_misc 2023-10-08T06:09:56.634 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/hugepages 2023-10-08T06:09:56.634 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/mqueue 2023-10-08T06:09:56.635 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/debug 2023-10-08T06:09:56.635 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/tracing 2023-10-08T06:09:56.635 INFO:teuthology.orchestra.run.smithi040.stdout:/run/rpc_pipefs 2023-10-08T06:09:56.635 INFO:teuthology.orchestra.run.smithi040.stdout:/proc/fs/nfsd 2023-10-08T06:09:56.635 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/fuse/connections 2023-10-08T06:09:56.635 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/config 2023-10-08T06:09:56.635 INFO:teuthology.orchestra.run.smithi040.stdout:/run/user/1000 2023-10-08T06:09:56.635 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph 2023-10-08T06:09:56.635 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph/osd/ceph-4 2023-10-08T06:09:56.636 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph/osd/ceph-5 2023-10-08T06:09:56.636 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph/osd/ceph-6 2023-10-08T06:09:56.636 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph/osd/ceph-7 2023-10-08T06:09:56.636 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns 2023-10-08T06:09:56.636 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-08T06:09:56.636 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-08T06:09:56.637 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T06:09:56.637 DEBUG:teuthology.orchestra.run.smithi040:> ls /sys/fs/fuse/connections 2023-10-08T06:09:56.684 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-10-08T06:09:56.684 DEBUG:teuthology.orchestra.run.smithi040:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2023-10-08T06:09:56.686 DEBUG:teuthology.orchestra.run.smithi040:> sudo modprobe fuse 2023-10-08T06:09:56.701 DEBUG:teuthology.orchestra.run.smithi040:> cat /proc/self/mounts | awk '{print $2}' 2023-10-08T06:09:56.707 INFO:teuthology.orchestra.run.smithi040.stdout:/sys 2023-10-08T06:09:56.708 INFO:teuthology.orchestra.run.smithi040.stdout:/proc 2023-10-08T06:09:56.708 INFO:teuthology.orchestra.run.smithi040.stdout:/dev 2023-10-08T06:09:56.708 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/pts 2023-10-08T06:09:56.708 INFO:teuthology.orchestra.run.smithi040.stdout:/run 2023-10-08T06:09:56.708 INFO:teuthology.orchestra.run.smithi040.stdout:/ 2023-10-08T06:09:56.708 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/security 2023-10-08T06:09:56.708 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/shm 2023-10-08T06:09:56.709 INFO:teuthology.orchestra.run.smithi040.stdout:/run/lock 2023-10-08T06:09:56.709 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/cgroup 2023-10-08T06:09:56.709 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/cgroup/unified 2023-10-08T06:09:56.709 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/cgroup/systemd 2023-10-08T06:09:56.709 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/pstore 2023-10-08T06:09:56.709 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/bpf 2023-10-08T06:09:56.709 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/cgroup/devices 2023-10-08T06:09:56.709 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/cgroup/cpu,cpuacct 2023-10-08T06:09:56.710 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/cgroup/rdma 2023-10-08T06:09:56.710 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/cgroup/freezer 2023-10-08T06:09:56.710 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/cgroup/net_cls,net_prio 2023-10-08T06:09:56.710 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/cgroup/blkio 2023-10-08T06:09:56.710 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/cgroup/cpuset 2023-10-08T06:09:56.710 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/cgroup/hugetlb 2023-10-08T06:09:56.710 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/cgroup/memory 2023-10-08T06:09:56.711 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/cgroup/pids 2023-10-08T06:09:56.711 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/cgroup/perf_event 2023-10-08T06:09:56.711 INFO:teuthology.orchestra.run.smithi040.stdout:/proc/sys/fs/binfmt_misc 2023-10-08T06:09:56.711 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/hugepages 2023-10-08T06:09:56.711 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/mqueue 2023-10-08T06:09:56.711 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/debug 2023-10-08T06:09:56.711 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/tracing 2023-10-08T06:09:56.711 INFO:teuthology.orchestra.run.smithi040.stdout:/run/rpc_pipefs 2023-10-08T06:09:56.712 INFO:teuthology.orchestra.run.smithi040.stdout:/proc/fs/nfsd 2023-10-08T06:09:56.712 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/fuse/connections 2023-10-08T06:09:56.712 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/config 2023-10-08T06:09:56.712 INFO:teuthology.orchestra.run.smithi040.stdout:/run/user/1000 2023-10-08T06:09:56.712 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph 2023-10-08T06:09:56.712 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph/osd/ceph-4 2023-10-08T06:09:56.712 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph/osd/ceph-5 2023-10-08T06:09:56.712 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph/osd/ceph-6 2023-10-08T06:09:56.713 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph/osd/ceph-7 2023-10-08T06:09:56.713 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns 2023-10-08T06:09:56.713 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-08T06:09:56.713 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-08T06:09:56.714 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T06:09:56.714 DEBUG:teuthology.orchestra.run.smithi040:> ls /sys/fs/fuse/connections 2023-10-08T06:09:56.781 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi040.stderr:2023-10-08T06:09:56.774+0000 7fe2bc105640 -1 init, newargv = 0x555a24cd26a0 newargc=15 2023-10-08T06:09:56.781 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi040.stderr:ceph-fuse[41642]: starting ceph client 2023-10-08T06:09:56.790 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi040.stderr:ceph-fuse[41642]: starting fuse 2023-10-08T06:09:57.866 DEBUG:teuthology.orchestra.run.smithi040:> sudo modprobe fuse 2023-10-08T06:09:57.885 DEBUG:teuthology.orchestra.run.smithi040:> cat /proc/self/mounts | awk '{print $2}' 2023-10-08T06:09:57.891 INFO:teuthology.orchestra.run.smithi040.stdout:/sys 2023-10-08T06:09:57.892 INFO:teuthology.orchestra.run.smithi040.stdout:/proc 2023-10-08T06:09:57.892 INFO:teuthology.orchestra.run.smithi040.stdout:/dev 2023-10-08T06:09:57.892 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/pts 2023-10-08T06:09:57.892 INFO:teuthology.orchestra.run.smithi040.stdout:/run 2023-10-08T06:09:57.892 INFO:teuthology.orchestra.run.smithi040.stdout:/ 2023-10-08T06:09:57.892 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/security 2023-10-08T06:09:57.892 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/shm 2023-10-08T06:09:57.892 INFO:teuthology.orchestra.run.smithi040.stdout:/run/lock 2023-10-08T06:09:57.892 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/cgroup 2023-10-08T06:09:57.892 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/cgroup/unified 2023-10-08T06:09:57.892 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/cgroup/systemd 2023-10-08T06:09:57.892 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/pstore 2023-10-08T06:09:57.893 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/bpf 2023-10-08T06:09:57.893 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/cgroup/devices 2023-10-08T06:09:57.893 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/cgroup/cpu,cpuacct 2023-10-08T06:09:57.893 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/cgroup/rdma 2023-10-08T06:09:57.893 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/cgroup/freezer 2023-10-08T06:09:57.893 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/cgroup/net_cls,net_prio 2023-10-08T06:09:57.893 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/cgroup/blkio 2023-10-08T06:09:57.893 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/cgroup/cpuset 2023-10-08T06:09:57.893 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/cgroup/hugetlb 2023-10-08T06:09:57.893 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/cgroup/memory 2023-10-08T06:09:57.893 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/cgroup/pids 2023-10-08T06:09:57.893 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/cgroup/perf_event 2023-10-08T06:09:57.894 INFO:teuthology.orchestra.run.smithi040.stdout:/proc/sys/fs/binfmt_misc 2023-10-08T06:09:57.894 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/hugepages 2023-10-08T06:09:57.894 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/mqueue 2023-10-08T06:09:57.894 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/debug 2023-10-08T06:09:57.894 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/tracing 2023-10-08T06:09:57.894 INFO:teuthology.orchestra.run.smithi040.stdout:/run/rpc_pipefs 2023-10-08T06:09:57.894 INFO:teuthology.orchestra.run.smithi040.stdout:/proc/fs/nfsd 2023-10-08T06:09:57.894 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/fuse/connections 2023-10-08T06:09:57.894 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/config 2023-10-08T06:09:57.894 INFO:teuthology.orchestra.run.smithi040.stdout:/run/user/1000 2023-10-08T06:09:57.894 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph 2023-10-08T06:09:57.895 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph/osd/ceph-4 2023-10-08T06:09:57.895 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph/osd/ceph-5 2023-10-08T06:09:57.895 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph/osd/ceph-6 2023-10-08T06:09:57.895 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph/osd/ceph-7 2023-10-08T06:09:57.895 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns 2023-10-08T06:09:57.895 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-08T06:09:57.895 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-08T06:09:57.895 INFO:teuthology.orchestra.run.smithi040.stdout:/home/ubuntu/cephtest/mnt.1 2023-10-08T06:09:57.896 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T06:09:57.896 DEBUG:teuthology.orchestra.run.smithi040:> ls /sys/fs/fuse/connections 2023-10-08T06:09:57.944 INFO:teuthology.orchestra.run.smithi040.stdout:52 2023-10-08T06:09:57.944 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2023-10-08T06:09:57.945 DEBUG:teuthology.orchestra.run.smithi040:> sudo stdin-killer -- python3 -c ' 2023-10-08T06:09:57.945 DEBUG:teuthology.orchestra.run.smithi040:> import glob 2023-10-08T06:09:57.945 DEBUG:teuthology.orchestra.run.smithi040:> import re 2023-10-08T06:09:57.945 DEBUG:teuthology.orchestra.run.smithi040:> import os 2023-10-08T06:09:57.945 DEBUG:teuthology.orchestra.run.smithi040:> import subprocess 2023-10-08T06:09:57.945 DEBUG:teuthology.orchestra.run.smithi040:> 2023-10-08T06:09:57.945 DEBUG:teuthology.orchestra.run.smithi040:> def _find_admin_socket(client_name): 2023-10-08T06:09:57.945 DEBUG:teuthology.orchestra.run.smithi040:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2023-10-08T06:09:57.945 DEBUG:teuthology.orchestra.run.smithi040:> files = glob.glob(asok_path) 2023-10-08T06:09:57.945 DEBUG:teuthology.orchestra.run.smithi040:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2023-10-08T06:09:57.945 DEBUG:teuthology.orchestra.run.smithi040:> 2023-10-08T06:09:57.946 DEBUG:teuthology.orchestra.run.smithi040:> # Given a non-glob path, it better be there 2023-10-08T06:09:57.946 DEBUG:teuthology.orchestra.run.smithi040:> if "*" not in asok_path: 2023-10-08T06:09:57.946 DEBUG:teuthology.orchestra.run.smithi040:> assert(len(files) == 1) 2023-10-08T06:09:57.946 DEBUG:teuthology.orchestra.run.smithi040:> return files[0] 2023-10-08T06:09:57.946 DEBUG:teuthology.orchestra.run.smithi040:> 2023-10-08T06:09:57.946 DEBUG:teuthology.orchestra.run.smithi040:> for f in files: 2023-10-08T06:09:57.946 DEBUG:teuthology.orchestra.run.smithi040:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-08T06:09:57.946 DEBUG:teuthology.orchestra.run.smithi040:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-08T06:09:57.946 DEBUG:teuthology.orchestra.run.smithi040:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-08T06:09:57.946 DEBUG:teuthology.orchestra.run.smithi040:> contents = proc_f.read() 2023-10-08T06:09:57.947 DEBUG:teuthology.orchestra.run.smithi040:> if mountpoint in contents: 2023-10-08T06:09:57.947 DEBUG:teuthology.orchestra.run.smithi040:> return f 2023-10-08T06:09:57.947 DEBUG:teuthology.orchestra.run.smithi040:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-08T06:09:57.947 DEBUG:teuthology.orchestra.run.smithi040:> 2023-10-08T06:09:57.947 DEBUG:teuthology.orchestra.run.smithi040:> print(_find_admin_socket("client.1")) 2023-10-08T06:09:57.947 DEBUG:teuthology.orchestra.run.smithi040:> ' 2023-10-08T06:09:58.039 INFO:teuthology.orchestra.run.smithi040.stdout:/var/run/ceph/ceph-client.1.41642.asok 2023-10-08T06:09:58.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:09:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-08T06:09:58.054 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.41642.asok 2023-10-08T06:09:58.054 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T06:09:58.055 DEBUG:teuthology.orchestra.run.smithi040:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.41642.asok status 2023-10-08T06:09:58.156 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2023-10-08T06:09:58.156 INFO:teuthology.orchestra.run.smithi040.stdout: "metadata": { 2023-10-08T06:09:58.156 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph_sha1": "9725b08fd801c82987c737f7e6d354878f036ee8", 2023-10-08T06:09:58.156 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph_version": "ceph version 18.0.0-6609-g9725b08f (9725b08fd801c82987c737f7e6d354878f036ee8) reef (dev)", 2023-10-08T06:09:58.157 INFO:teuthology.orchestra.run.smithi040.stdout: "entity_id": "1", 2023-10-08T06:09:58.157 INFO:teuthology.orchestra.run.smithi040.stdout: "hostname": "smithi040", 2023-10-08T06:09:58.157 INFO:teuthology.orchestra.run.smithi040.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2023-10-08T06:09:58.157 INFO:teuthology.orchestra.run.smithi040.stdout: "pid": "41642", 2023-10-08T06:09:58.157 INFO:teuthology.orchestra.run.smithi040.stdout: "root": "/" 2023-10-08T06:09:58.157 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-10-08T06:09:58.157 INFO:teuthology.orchestra.run.smithi040.stdout: "dentry_count": 0, 2023-10-08T06:09:58.157 INFO:teuthology.orchestra.run.smithi040.stdout: "dentry_pinned_count": 0, 2023-10-08T06:09:58.157 INFO:teuthology.orchestra.run.smithi040.stdout: "id": 4789, 2023-10-08T06:09:58.157 INFO:teuthology.orchestra.run.smithi040.stdout: "inst": { 2023-10-08T06:09:58.157 INFO:teuthology.orchestra.run.smithi040.stdout: "name": { 2023-10-08T06:09:58.157 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "client", 2023-10-08T06:09:58.158 INFO:teuthology.orchestra.run.smithi040.stdout: "num": 4789 2023-10-08T06:09:58.158 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-10-08T06:09:58.158 INFO:teuthology.orchestra.run.smithi040.stdout: "addr": { 2023-10-08T06:09:58.158 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "v1", 2023-10-08T06:09:58.158 INFO:teuthology.orchestra.run.smithi040.stdout: "addr": "192.168.0.1:0", 2023-10-08T06:09:58.158 INFO:teuthology.orchestra.run.smithi040.stdout: "nonce": 1744982950 2023-10-08T06:09:58.158 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-10-08T06:09:58.158 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-10-08T06:09:58.158 INFO:teuthology.orchestra.run.smithi040.stdout: "addr": { 2023-10-08T06:09:58.158 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "v1", 2023-10-08T06:09:58.158 INFO:teuthology.orchestra.run.smithi040.stdout: "addr": "192.168.0.1:0", 2023-10-08T06:09:58.159 INFO:teuthology.orchestra.run.smithi040.stdout: "nonce": 1744982950 2023-10-08T06:09:58.159 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-10-08T06:09:58.159 INFO:teuthology.orchestra.run.smithi040.stdout: "inst_str": "client.4789 192.168.0.1:0/1744982950", 2023-10-08T06:09:58.159 INFO:teuthology.orchestra.run.smithi040.stdout: "addr_str": "192.168.0.1:0/1744982950", 2023-10-08T06:09:58.159 INFO:teuthology.orchestra.run.smithi040.stdout: "inode_count": 1, 2023-10-08T06:09:58.159 INFO:teuthology.orchestra.run.smithi040.stdout: "mds_epoch": 6, 2023-10-08T06:09:58.159 INFO:teuthology.orchestra.run.smithi040.stdout: "osd_epoch": 22, 2023-10-08T06:09:58.159 INFO:teuthology.orchestra.run.smithi040.stdout: "osd_epoch_barrier": 0, 2023-10-08T06:09:58.159 INFO:teuthology.orchestra.run.smithi040.stdout: "blocklisted": false, 2023-10-08T06:09:58.159 INFO:teuthology.orchestra.run.smithi040.stdout: "fs_name": "cephfs" 2023-10-08T06:09:58.159 INFO:teuthology.orchestra.run.smithi040.stdout:} 2023-10-08T06:09:58.166 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-08T06:09:58.292 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:58.288+0000 7f13b25c2700 1 Processor -- start 2023-10-08T06:09:58.292 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:58.288+0000 7f13b25c2700 1 -- start start 2023-10-08T06:09:58.293 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:58.292+0000 7f13b25c2700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f13ac0c9cd0 0x7f13ac0ca110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:58.293 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:58.292+0000 7f13b25c2700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13ac0ca650 con 0x7f13ac070780 2023-10-08T06:09:58.294 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:58.292+0000 7f13b25c2700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13ac06ae50 con 0x7f13ac159940 2023-10-08T06:09:58.294 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:58.292+0000 7f13b25c2700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13ac0cf150 con 0x7f13ac0c9cd0 2023-10-08T06:09:58.294 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:58.292+0000 7f13b1dc1700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f13ac070780 0x7f13ac070c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:57052/0 (socket says 172.21.15.32:57052) 2023-10-08T06:09:58.294 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:58.292+0000 7f13b1dc1700 1 -- 172.21.15.32:0/298482160 learned_addr learned my addr 172.21.15.32:0/298482160 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-08T06:09:58.294 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:58.292+0000 7f13b0dbf700 1 --2- 172.21.15.32:0/298482160 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f13ac0c9cd0 0x7f13ac0ca110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:58.295 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:58.292+0000 7f13a3fff700 1 -- 172.21.15.32:0/298482160 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2684051181 0 0) 0x7f13ac0ca650 con 0x7f13ac070780 2023-10-08T06:09:58.295 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:58.292+0000 7f13a3fff700 1 -- 172.21.15.32:0/298482160 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f13980057e0 con 0x7f13ac070780 2023-10-08T06:09:58.295 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:58.292+0000 7f13a3fff700 1 -- 172.21.15.32:0/298482160 <== mon.1 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3471968014 0 0) 0x7f13ac06ae50 con 0x7f13ac159940 2023-10-08T06:09:58.295 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:58.292+0000 7f13b0dbf700 1 -- 172.21.15.32:0/298482160 >> v1:172.21.15.40:6789/0 conn(0x7f13ac159940 legacy=0x7f13ac0cea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:58.295 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:58.292+0000 7f13b0dbf700 1 -- 172.21.15.32:0/298482160 >> v1:172.21.15.32:6789/0 conn(0x7f13ac070780 legacy=0x7f13ac070c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:58.296 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:58.292+0000 7f13b0dbf700 1 -- 172.21.15.32:0/298482160 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13ac06b0f0 con 0x7f13ac0c9cd0 2023-10-08T06:09:58.296 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:58.292+0000 7f13b0dbf700 1 --2- 172.21.15.32:0/298482160 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f13ac0c9cd0 0x7f13ac0ca110 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f139c00aa20 tx=0x7f139c00ad30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ed59b688045a20e9 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:58.296 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:58.292+0000 7f13a3fff700 1 -- 172.21.15.32:0/298482160 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f139c00cb70 con 0x7f13ac0c9cd0 2023-10-08T06:09:58.296 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:58.292+0000 7f13a3fff700 1 -- 172.21.15.32:0/298482160 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f139c00ccd0 con 0x7f13ac0c9cd0 2023-10-08T06:09:58.296 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:58.292+0000 7f13a3fff700 1 -- 172.21.15.32:0/298482160 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f139c00ae60 con 0x7f13ac0c9cd0 2023-10-08T06:09:58.297 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:58.296+0000 7f13b25c2700 1 -- 172.21.15.32:0/298482160 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f13ac0c9cd0 msgr2=0x7f13ac0ca110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:58.297 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:58.296+0000 7f13b25c2700 1 --2- 172.21.15.32:0/298482160 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f13ac0c9cd0 0x7f13ac0ca110 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f139c00aa20 tx=0x7f139c00ad30 comp rx=0 tx=0).stop 2023-10-08T06:09:58.297 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:58.296+0000 7f13b25c2700 1 -- 172.21.15.32:0/298482160 shutdown_connections 2023-10-08T06:09:58.297 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:58.296+0000 7f13b25c2700 1 --2- 172.21.15.32:0/298482160 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f13ac0c9cd0 0x7f13ac0ca110 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:58.297 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:58.296+0000 7f13b25c2700 1 -- 172.21.15.32:0/298482160 >> 172.21.15.32:0/298482160 conn(0x7f13ac0cf470 msgr2=0x7f13ac0cf880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:09:58.297 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:58.296+0000 7f13b25c2700 1 -- 172.21.15.32:0/298482160 shutdown_connections 2023-10-08T06:09:58.297 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:58.296+0000 7f13b25c2700 1 -- 172.21.15.32:0/298482160 wait complete. 2023-10-08T06:09:58.298 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:58.296+0000 7f13b25c2700 1 Processor -- start 2023-10-08T06:09:58.298 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:58.296+0000 7f13b25c2700 1 -- start start 2023-10-08T06:09:58.300 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:58.300+0000 7f13b25c2700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f13ac070780 0x7f13ac15c600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:58.301 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:58.300+0000 7f13b25c2700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f13ac0c9cd0 0x7f13ac0b3ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:58.301 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:58.300+0000 7f13b25c2700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f13ac159940 0x7f13ac0c6dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:58.301 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:58.300+0000 7f13b25c2700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13ac15cb40 con 0x7f13ac0c9cd0 2023-10-08T06:09:58.301 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:58.300+0000 7f13b25c2700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13ac159db0 con 0x7f13ac070780 2023-10-08T06:09:58.301 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:58.300+0000 7f13b25c2700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13ac0b4630 con 0x7f13ac159940 2023-10-08T06:09:58.301 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:58.300+0000 7f13b0dbf700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f13ac0c9cd0 0x7f13ac0b3ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:58.301 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:58.300+0000 7f13b0dbf700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f13ac0c9cd0 0x7f13ac0b3ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:52858/0 (socket says 172.21.15.32:52858) 2023-10-08T06:09:58.302 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:58.300+0000 7f13b0dbf700 1 -- 172.21.15.32:0/2405646053 learned_addr learned my addr 172.21.15.32:0/2405646053 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:09:58.302 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:58.300+0000 7f13b1dc1700 1 --2- 172.21.15.32:0/2405646053 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f13ac159940 0x7f13ac0c6dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:58.302 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:58.300+0000 7f13b15c0700 1 --2- 172.21.15.32:0/2405646053 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f13ac070780 0x7f13ac15c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:58.302 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:58.300+0000 7f13b0dbf700 1 -- 172.21.15.32:0/2405646053 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f13ac159940 msgr2=0x7f13ac0c6dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:58.302 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:58.300+0000 7f13b0dbf700 1 --2- 172.21.15.32:0/2405646053 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f13ac159940 0x7f13ac0c6dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:58.302 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:58.300+0000 7f13b0dbf700 1 -- 172.21.15.32:0/2405646053 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f13ac070780 msgr2=0x7f13ac15c600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:58.302 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:58.300+0000 7f13b0dbf700 1 --2- 172.21.15.32:0/2405646053 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f13ac070780 0x7f13ac15c600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:58.303 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:58.300+0000 7f13b0dbf700 1 -- 172.21.15.32:0/2405646053 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f139c00a650 con 0x7f13ac0c9cd0 2023-10-08T06:09:58.303 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:58.300+0000 7f13b0dbf700 1 --2- 172.21.15.32:0/2405646053 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f13ac0c9cd0 0x7f13ac0b3ce0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f139c00a550 tx=0x7f139c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:58.304 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:58.300+0000 7f13a1ffb700 1 -- 172.21.15.32:0/2405646053 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f139c01e070 con 0x7f13ac0c9cd0 2023-10-08T06:09:58.304 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:58.300+0000 7f13a1ffb700 1 -- 172.21.15.32:0/2405646053 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f139c00ce40 con 0x7f13ac0c9cd0 2023-10-08T06:09:58.304 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:58.300+0000 7f13b25c2700 1 -- 172.21.15.32:0/2405646053 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13ac15a000 con 0x7f13ac0c9cd0 2023-10-08T06:09:58.304 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:58.300+0000 7f13a1ffb700 1 -- 172.21.15.32:0/2405646053 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f139c0044a0 con 0x7f13ac0c9cd0 2023-10-08T06:09:58.304 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:58.300+0000 7f13b25c2700 1 -- 172.21.15.32:0/2405646053 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13ac15a5c0 con 0x7f13ac0c9cd0 2023-10-08T06:09:58.305 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:58.300+0000 7f13b25c2700 1 -- 172.21.15.32:0/2405646053 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13ac0686a0 con 0x7f13ac0c9cd0 2023-10-08T06:09:58.305 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:58.300+0000 7f13a1ffb700 1 -- 172.21.15.32:0/2405646053 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f139c019740 con 0x7f13ac0c9cd0 2023-10-08T06:09:58.305 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:58.304+0000 7f13a1ffb700 1 --2- 172.21.15.32:0/2405646053 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f1390066510 0x7f13900689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:09:58.305 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:58.304+0000 7f13b15c0700 1 --2- 172.21.15.32:0/2405646053 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f1390066510 0x7f13900689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:09:58.306 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:58.304+0000 7f13a1ffb700 1 -- 172.21.15.32:0/2405646053 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f139c084e40 con 0x7f13ac0c9cd0 2023-10-08T06:09:58.306 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:58.304+0000 7f13b15c0700 1 --2- 172.21.15.32:0/2405646053 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f1390066510 0x7f13900689d0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f13a8000f60 tx=0x7f13a8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:09:58.312 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:58.312+0000 7f13a1ffb700 1 -- 172.21.15.32:0/2405646053 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f139c0523f0 con 0x7f13ac0c9cd0 2023-10-08T06:09:58.519 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:58.516+0000 7f13b25c2700 1 -- 172.21.15.32:0/2405646053 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f13ac0c98a0 con 0x7f13ac0c9cd0 2023-10-08T06:09:58.520 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:58.520+0000 7f13a1ffb700 1 -- 172.21.15.32:0/2405646053 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) v1 ==== 53+0+73 (secure 0 0 0) 0x7f139c055a10 con 0x7f13ac0c9cd0 2023-10-08T06:09:58.520 INFO:teuthology.orchestra.run.smithi032.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-08T06:09:58.523 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:58.520+0000 7f13b25c2700 1 -- 172.21.15.32:0/2405646053 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f1390066510 msgr2=0x7f13900689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:58.523 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:58.520+0000 7f13b25c2700 1 --2- 172.21.15.32:0/2405646053 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f1390066510 0x7f13900689d0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f13a8000f60 tx=0x7f13a8009040 comp rx=0 tx=0).stop 2023-10-08T06:09:58.523 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:58.520+0000 7f13b25c2700 1 -- 172.21.15.32:0/2405646053 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f13ac0c9cd0 msgr2=0x7f13ac0b3ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:09:58.523 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:58.520+0000 7f13b25c2700 1 --2- 172.21.15.32:0/2405646053 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f13ac0c9cd0 0x7f13ac0b3ce0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f139c00a550 tx=0x7f139c004770 comp rx=0 tx=0).stop 2023-10-08T06:09:58.523 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:58.520+0000 7f13b25c2700 1 -- 172.21.15.32:0/2405646053 shutdown_connections 2023-10-08T06:09:58.523 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:58.520+0000 7f13b25c2700 1 --2- 172.21.15.32:0/2405646053 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f1390066510 0x7f13900689d0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:58.524 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:58.520+0000 7f13b25c2700 1 --2- 172.21.15.32:0/2405646053 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f13ac0c9cd0 0x7f13ac0b3ce0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:58.524 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:58.520+0000 7f13b25c2700 1 --2- 172.21.15.32:0/2405646053 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f13ac159940 0x7f13ac0c6dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:58.524 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:58.520+0000 7f13b25c2700 1 --2- 172.21.15.32:0/2405646053 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f13ac070780 0x7f13ac15c600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:09:58.524 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:58.520+0000 7f13b25c2700 1 -- 172.21.15.32:0/2405646053 >> 172.21.15.32:0/2405646053 conn(0x7f13ac0cf470 msgr2=0x7f13ac0af1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:09:58.524 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:58.520+0000 7f13b25c2700 1 -- 172.21.15.32:0/2405646053 shutdown_connections 2023-10-08T06:09:58.524 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:09:58.520+0000 7f13b25c2700 1 -- 172.21.15.32:0/2405646053 wait complete. 2023-10-08T06:09:58.535 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-08T06:09:58.535 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-08T06:09:58.535 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi040.front.sepia.ceph.com 2023-10-08T06:09:58.535 INFO:tasks.cephfs.mount:self.client.name = client.3 2023-10-08T06:09:58.535 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-10-08T06:09:58.535 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-08T06:09:58.535 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-08T06:09:58.536 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-08T06:09:58.536 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2023-10-08T06:09:58.536 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T06:09:58.536 DEBUG:teuthology.orchestra.run.smithi040:> ip addr 2023-10-08T06:09:58.544 INFO:teuthology.orchestra.run.smithi040.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-08T06:09:58.545 INFO:teuthology.orchestra.run.smithi040.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-08T06:09:58.545 INFO:teuthology.orchestra.run.smithi040.stdout: inet 127.0.0.1/8 scope host lo 2023-10-08T06:09:58.545 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-10-08T06:09:58.545 INFO:teuthology.orchestra.run.smithi040.stdout: inet6 ::1/128 scope host 2023-10-08T06:09:58.545 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-10-08T06:09:58.545 INFO:teuthology.orchestra.run.smithi040.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-08T06:09:58.545 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 0c:c4:7a:6b:fd:16 brd ff:ff:ff:ff:ff:ff 2023-10-08T06:09:58.545 INFO:teuthology.orchestra.run.smithi040.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-08T06:09:58.545 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 0c:c4:7a:6b:fd:17 brd ff:ff:ff:ff:ff:ff 2023-10-08T06:09:58.546 INFO:teuthology.orchestra.run.smithi040.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-08T06:09:58.546 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 0c:c4:7a:bd:12:cc brd ff:ff:ff:ff:ff:ff 2023-10-08T06:09:58.546 INFO:teuthology.orchestra.run.smithi040.stdout: inet 172.21.15.40/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-10-08T06:09:58.546 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft 42537sec preferred_lft 42537sec 2023-10-08T06:09:58.546 INFO:teuthology.orchestra.run.smithi040.stdout: inet6 fe80::ec4:7aff:febd:12cc/64 scope link 2023-10-08T06:09:58.546 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-10-08T06:09:58.546 INFO:teuthology.orchestra.run.smithi040.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-08T06:09:58.546 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 0c:c4:7a:bd:12:cd brd ff:ff:ff:ff:ff:ff 2023-10-08T06:09:58.546 INFO:teuthology.orchestra.run.smithi040.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-10-08T06:09:58.546 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 02:42:cb:19:5e:4c brd ff:ff:ff:ff:ff:ff 2023-10-08T06:09:58.547 INFO:teuthology.orchestra.run.smithi040.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-10-08T06:09:58.547 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-10-08T06:09:58.547 INFO:teuthology.orchestra.run.smithi040.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-08T06:09:58.547 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether d2:b6:58:81:c0:01 brd ff:ff:ff:ff:ff:ff 2023-10-08T06:09:58.547 INFO:teuthology.orchestra.run.smithi040.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-08T06:09:58.547 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-10-08T06:09:58.547 INFO:teuthology.orchestra.run.smithi040.stdout: inet6 fe80::cca7:23ff:fe92:7e3e/64 scope link 2023-10-08T06:09:58.547 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-10-08T06:09:58.547 INFO:teuthology.orchestra.run.smithi040.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-08T06:09:58.547 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether d2:b6:58:81:c0:01 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-08T06:09:58.547 INFO:teuthology.orchestra.run.smithi040.stdout: inet6 fe80::d0b6:58ff:fe81:c001/64 scope link 2023-10-08T06:09:58.547 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-10-08T06:09:58.548 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T06:09:58.548 DEBUG:teuthology.orchestra.run.smithi040:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-08T06:09:58.601 INFO:teuthology.orchestra.run.smithi040.stdout:1 2023-10-08T06:09:58.604 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T06:09:58.604 DEBUG:teuthology.orchestra.run.smithi040:> route 2023-10-08T06:09:58.612 INFO:teuthology.orchestra.run.smithi040.stdout:Kernel IP routing table 2023-10-08T06:09:58.612 INFO:teuthology.orchestra.run.smithi040.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-08T06:09:58.612 INFO:teuthology.orchestra.run.smithi040.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-10-08T06:09:58.612 INFO:teuthology.orchestra.run.smithi040.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-10-08T06:09:58.612 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-10-08T06:09:58.612 INFO:teuthology.orchestra.run.smithi040.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-08T06:09:58.613 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T06:09:58.613 DEBUG:teuthology.orchestra.run.smithi040:> (cd / && exec bash -c ' 2023-10-08T06:09:58.613 DEBUG:teuthology.orchestra.run.smithi040:> set -e 2023-10-08T06:09:58.613 DEBUG:teuthology.orchestra.run.smithi040:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-08T06:09:58.613 DEBUG:teuthology.orchestra.run.smithi040:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-08T06:09:58.613 DEBUG:teuthology.orchestra.run.smithi040:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-08T06:09:58.613 DEBUG:teuthology.orchestra.run.smithi040:> ') 2023-10-08T06:09:58.651 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T06:09:58.652 DEBUG:teuthology.orchestra.run.smithi040:> ip netns list 2023-10-08T06:09:58.659 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-08T06:09:58.659 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T06:09:58.659 DEBUG:teuthology.orchestra.run.smithi040:> ip netns list-id 2023-10-08T06:09:58.665 INFO:teuthology.orchestra.run.smithi040.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2023-10-08T06:09:58.665 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T06:09:58.665 DEBUG:teuthology.orchestra.run.smithi040:> (cd / && exec bash -c ' 2023-10-08T06:09:58.665 DEBUG:teuthology.orchestra.run.smithi040:> set -e 2023-10-08T06:09:58.665 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-08T06:09:58.665 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2023-10-08T06:09:58.666 DEBUG:teuthology.orchestra.run.smithi040:> ') 2023-10-08T06:09:58.738 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T06:09:58.738 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-10-08T06:09:58.755 INFO:teuthology.orchestra.run.smithi040.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-08T06:09:58.755 INFO:teuthology.orchestra.run.smithi040.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-08T06:09:58.755 INFO:teuthology.orchestra.run.smithi040.stdout: inet 127.0.0.1/8 scope host lo 2023-10-08T06:09:58.755 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-10-08T06:09:58.755 INFO:teuthology.orchestra.run.smithi040.stdout: inet6 ::1/128 scope host 2023-10-08T06:09:58.755 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-10-08T06:09:58.755 INFO:teuthology.orchestra.run.smithi040.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-08T06:09:58.756 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether aa:b9:d4:97:ba:61 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-08T06:09:58.756 INFO:teuthology.orchestra.run.smithi040.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-08T06:09:58.756 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-10-08T06:09:58.756 INFO:teuthology.orchestra.run.smithi040.stdout: inet6 fe80::a8b9:d4ff:fe97:ba61/64 scope link 2023-10-08T06:09:58.756 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-10-08T06:09:58.757 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T06:09:58.757 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-10-08T06:09:58.767 INFO:teuthology.orchestra.run.smithi040.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-08T06:09:58.767 INFO:teuthology.orchestra.run.smithi040.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-08T06:09:58.767 INFO:teuthology.orchestra.run.smithi040.stdout: inet 127.0.0.1/8 scope host lo 2023-10-08T06:09:58.768 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-10-08T06:09:58.768 INFO:teuthology.orchestra.run.smithi040.stdout: inet6 ::1/128 scope host 2023-10-08T06:09:58.768 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-10-08T06:09:58.768 INFO:teuthology.orchestra.run.smithi040.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-08T06:09:58.768 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether aa:b9:d4:97:ba:61 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-08T06:09:58.768 INFO:teuthology.orchestra.run.smithi040.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-08T06:09:58.768 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-10-08T06:09:58.768 INFO:teuthology.orchestra.run.smithi040.stdout: inet6 fe80::a8b9:d4ff:fe97:ba61/64 scope link 2023-10-08T06:09:58.768 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-10-08T06:09:58.769 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2023-10-08T06:09:58.769 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T06:09:58.769 DEBUG:teuthology.orchestra.run.smithi040:> (cd / && exec bash -c ' 2023-10-08T06:09:58.770 DEBUG:teuthology.orchestra.run.smithi040:> set -e 2023-10-08T06:09:58.770 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2023-10-08T06:09:58.770 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-10-08T06:09:58.770 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2023-10-08T06:09:58.770 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2023-10-08T06:09:58.770 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2023-10-08T06:09:58.770 DEBUG:teuthology.orchestra.run.smithi040:> ') 2023-10-08T06:09:58.826 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T06:09:58.826 DEBUG:teuthology.orchestra.run.smithi040:> (cd / && exec bash -c ' 2023-10-08T06:09:58.827 DEBUG:teuthology.orchestra.run.smithi040:> set -e 2023-10-08T06:09:58.827 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip link set brx.1 up 2023-10-08T06:09:58.827 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip link set dev brx.1 master ceph-brx 2023-10-08T06:09:58.827 DEBUG:teuthology.orchestra.run.smithi040:> ') 2023-10-08T06:09:58.855 INFO:tasks.cephfs.fuse_mount:Client client.3 config is {} 2023-10-08T06:09:58.855 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T06:09:58.855 DEBUG:teuthology.orchestra.run.smithi040:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2023-10-08T06:09:58.861 INFO:teuthology.orchestra.run.smithi040.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2023-10-08T06:09:58.861 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T06:09:58.861 DEBUG:teuthology.orchestra.run.smithi040:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2023-10-08T06:09:58.907 DEBUG:teuthology.orchestra.run.smithi040:> sudo modprobe fuse 2023-10-08T06:09:58.924 DEBUG:teuthology.orchestra.run.smithi040:> cat /proc/self/mounts | awk '{print $2}' 2023-10-08T06:09:58.932 INFO:teuthology.orchestra.run.smithi040.stdout:/sys 2023-10-08T06:09:58.932 INFO:teuthology.orchestra.run.smithi040.stdout:/proc 2023-10-08T06:09:58.932 INFO:teuthology.orchestra.run.smithi040.stdout:/dev 2023-10-08T06:09:58.932 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/pts 2023-10-08T06:09:58.932 INFO:teuthology.orchestra.run.smithi040.stdout:/run 2023-10-08T06:09:58.932 INFO:teuthology.orchestra.run.smithi040.stdout:/ 2023-10-08T06:09:58.933 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/security 2023-10-08T06:09:58.933 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/shm 2023-10-08T06:09:58.933 INFO:teuthology.orchestra.run.smithi040.stdout:/run/lock 2023-10-08T06:09:58.933 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/cgroup 2023-10-08T06:09:58.933 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/cgroup/unified 2023-10-08T06:09:58.933 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/cgroup/systemd 2023-10-08T06:09:58.933 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/pstore 2023-10-08T06:09:58.933 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/bpf 2023-10-08T06:09:58.933 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/cgroup/devices 2023-10-08T06:09:58.933 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/cgroup/cpu,cpuacct 2023-10-08T06:09:58.933 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/cgroup/rdma 2023-10-08T06:09:58.934 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/cgroup/freezer 2023-10-08T06:09:58.934 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/cgroup/net_cls,net_prio 2023-10-08T06:09:58.934 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/cgroup/blkio 2023-10-08T06:09:58.934 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/cgroup/cpuset 2023-10-08T06:09:58.934 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/cgroup/hugetlb 2023-10-08T06:09:58.934 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/cgroup/memory 2023-10-08T06:09:58.934 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/cgroup/pids 2023-10-08T06:09:58.934 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/cgroup/perf_event 2023-10-08T06:09:58.934 INFO:teuthology.orchestra.run.smithi040.stdout:/proc/sys/fs/binfmt_misc 2023-10-08T06:09:58.934 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/hugepages 2023-10-08T06:09:58.934 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/mqueue 2023-10-08T06:09:58.934 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/debug 2023-10-08T06:09:58.935 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/tracing 2023-10-08T06:09:58.935 INFO:teuthology.orchestra.run.smithi040.stdout:/run/rpc_pipefs 2023-10-08T06:09:58.935 INFO:teuthology.orchestra.run.smithi040.stdout:/proc/fs/nfsd 2023-10-08T06:09:58.935 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/fuse/connections 2023-10-08T06:09:58.935 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/config 2023-10-08T06:09:58.935 INFO:teuthology.orchestra.run.smithi040.stdout:/run/user/1000 2023-10-08T06:09:58.935 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph 2023-10-08T06:09:58.935 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph/osd/ceph-4 2023-10-08T06:09:58.935 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph/osd/ceph-5 2023-10-08T06:09:58.935 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph/osd/ceph-6 2023-10-08T06:09:58.935 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph/osd/ceph-7 2023-10-08T06:09:58.935 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns 2023-10-08T06:09:58.936 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-08T06:09:58.936 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-08T06:09:58.936 INFO:teuthology.orchestra.run.smithi040.stdout:/home/ubuntu/cephtest/mnt.1 2023-10-08T06:09:58.936 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-08T06:09:58.936 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-08T06:09:58.937 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T06:09:58.937 DEBUG:teuthology.orchestra.run.smithi040:> ls /sys/fs/fuse/connections 2023-10-08T06:09:58.942 INFO:teuthology.orchestra.run.smithi040.stdout:52 2023-10-08T06:09:58.942 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [52] 2023-10-08T06:09:58.942 DEBUG:teuthology.orchestra.run.smithi040:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.3 --id 3) 2023-10-08T06:09:58.944 DEBUG:teuthology.orchestra.run.smithi040:> sudo modprobe fuse 2023-10-08T06:09:58.959 DEBUG:teuthology.orchestra.run.smithi040:> cat /proc/self/mounts | awk '{print $2}' 2023-10-08T06:09:59.008 INFO:teuthology.orchestra.run.smithi040.stdout:/sys 2023-10-08T06:09:59.008 INFO:teuthology.orchestra.run.smithi040.stdout:/proc 2023-10-08T06:09:59.008 INFO:teuthology.orchestra.run.smithi040.stdout:/dev 2023-10-08T06:09:59.009 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/pts 2023-10-08T06:09:59.009 INFO:teuthology.orchestra.run.smithi040.stdout:/run 2023-10-08T06:09:59.009 INFO:teuthology.orchestra.run.smithi040.stdout:/ 2023-10-08T06:09:59.009 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/security 2023-10-08T06:09:59.009 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/shm 2023-10-08T06:09:59.009 INFO:teuthology.orchestra.run.smithi040.stdout:/run/lock 2023-10-08T06:09:59.009 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/cgroup 2023-10-08T06:09:59.009 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/cgroup/unified 2023-10-08T06:09:59.009 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/cgroup/systemd 2023-10-08T06:09:59.009 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/pstore 2023-10-08T06:09:59.009 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/bpf 2023-10-08T06:09:59.010 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/cgroup/devices 2023-10-08T06:09:59.010 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/cgroup/cpu,cpuacct 2023-10-08T06:09:59.010 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/cgroup/rdma 2023-10-08T06:09:59.010 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/cgroup/freezer 2023-10-08T06:09:59.010 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/cgroup/net_cls,net_prio 2023-10-08T06:09:59.010 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/cgroup/blkio 2023-10-08T06:09:59.010 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/cgroup/cpuset 2023-10-08T06:09:59.010 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/cgroup/hugetlb 2023-10-08T06:09:59.010 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/cgroup/memory 2023-10-08T06:09:59.010 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/cgroup/pids 2023-10-08T06:09:59.010 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/cgroup/perf_event 2023-10-08T06:09:59.010 INFO:teuthology.orchestra.run.smithi040.stdout:/proc/sys/fs/binfmt_misc 2023-10-08T06:09:59.011 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/hugepages 2023-10-08T06:09:59.011 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/mqueue 2023-10-08T06:09:59.011 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/debug 2023-10-08T06:09:59.011 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/tracing 2023-10-08T06:09:59.011 INFO:teuthology.orchestra.run.smithi040.stdout:/run/rpc_pipefs 2023-10-08T06:09:59.011 INFO:teuthology.orchestra.run.smithi040.stdout:/proc/fs/nfsd 2023-10-08T06:09:59.011 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/fuse/connections 2023-10-08T06:09:59.011 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/config 2023-10-08T06:09:59.011 INFO:teuthology.orchestra.run.smithi040.stdout:/run/user/1000 2023-10-08T06:09:59.011 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph 2023-10-08T06:09:59.011 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph/osd/ceph-4 2023-10-08T06:09:59.012 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph/osd/ceph-5 2023-10-08T06:09:59.012 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph/osd/ceph-6 2023-10-08T06:09:59.012 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph/osd/ceph-7 2023-10-08T06:09:59.012 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns 2023-10-08T06:09:59.012 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-08T06:09:59.012 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-08T06:09:59.012 INFO:teuthology.orchestra.run.smithi040.stdout:/home/ubuntu/cephtest/mnt.1 2023-10-08T06:09:59.012 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-08T06:09:59.012 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-08T06:09:59.013 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T06:09:59.013 DEBUG:teuthology.orchestra.run.smithi040:> ls /sys/fs/fuse/connections 2023-10-08T06:09:59.020 INFO:teuthology.orchestra.run.smithi040.stdout:52 2023-10-08T06:09:59.037 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi040.stderr:2023-10-08T06:09:59.030+0000 7f541df30640 -1 init, newargv = 0x556967b0a950 newargc=15 2023-10-08T06:09:59.037 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi040.stderr:ceph-fuse[41756]: starting ceph client 2023-10-08T06:09:59.047 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi040.stderr:ceph-fuse[41756]: starting fuse 2023-10-08T06:10:00.121 DEBUG:teuthology.orchestra.run.smithi040:> sudo modprobe fuse 2023-10-08T06:10:00.138 DEBUG:teuthology.orchestra.run.smithi040:> cat /proc/self/mounts | awk '{print $2}' 2023-10-08T06:10:00.189 INFO:teuthology.orchestra.run.smithi040.stdout:/sys 2023-10-08T06:10:00.189 INFO:teuthology.orchestra.run.smithi040.stdout:/proc 2023-10-08T06:10:00.189 INFO:teuthology.orchestra.run.smithi040.stdout:/dev 2023-10-08T06:10:00.189 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/pts 2023-10-08T06:10:00.189 INFO:teuthology.orchestra.run.smithi040.stdout:/run 2023-10-08T06:10:00.190 INFO:teuthology.orchestra.run.smithi040.stdout:/ 2023-10-08T06:10:00.190 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/security 2023-10-08T06:10:00.190 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/shm 2023-10-08T06:10:00.190 INFO:teuthology.orchestra.run.smithi040.stdout:/run/lock 2023-10-08T06:10:00.190 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/cgroup 2023-10-08T06:10:00.190 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/cgroup/unified 2023-10-08T06:10:00.190 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/cgroup/systemd 2023-10-08T06:10:00.190 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/pstore 2023-10-08T06:10:00.190 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/bpf 2023-10-08T06:10:00.190 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/cgroup/devices 2023-10-08T06:10:00.190 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/cgroup/cpu,cpuacct 2023-10-08T06:10:00.191 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/cgroup/rdma 2023-10-08T06:10:00.191 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/cgroup/freezer 2023-10-08T06:10:00.191 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/cgroup/net_cls,net_prio 2023-10-08T06:10:00.191 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/cgroup/blkio 2023-10-08T06:10:00.191 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/cgroup/cpuset 2023-10-08T06:10:00.191 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/cgroup/hugetlb 2023-10-08T06:10:00.191 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/cgroup/memory 2023-10-08T06:10:00.191 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/cgroup/pids 2023-10-08T06:10:00.191 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/cgroup/perf_event 2023-10-08T06:10:00.191 INFO:teuthology.orchestra.run.smithi040.stdout:/proc/sys/fs/binfmt_misc 2023-10-08T06:10:00.191 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/hugepages 2023-10-08T06:10:00.192 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/mqueue 2023-10-08T06:10:00.192 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/debug 2023-10-08T06:10:00.192 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/tracing 2023-10-08T06:10:00.192 INFO:teuthology.orchestra.run.smithi040.stdout:/run/rpc_pipefs 2023-10-08T06:10:00.192 INFO:teuthology.orchestra.run.smithi040.stdout:/proc/fs/nfsd 2023-10-08T06:10:00.192 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/fuse/connections 2023-10-08T06:10:00.192 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/config 2023-10-08T06:10:00.192 INFO:teuthology.orchestra.run.smithi040.stdout:/run/user/1000 2023-10-08T06:10:00.192 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph 2023-10-08T06:10:00.192 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph/osd/ceph-4 2023-10-08T06:10:00.192 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph/osd/ceph-5 2023-10-08T06:10:00.193 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph/osd/ceph-6 2023-10-08T06:10:00.193 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph/osd/ceph-7 2023-10-08T06:10:00.193 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns 2023-10-08T06:10:00.193 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-08T06:10:00.193 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-08T06:10:00.193 INFO:teuthology.orchestra.run.smithi040.stdout:/home/ubuntu/cephtest/mnt.1 2023-10-08T06:10:00.193 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-08T06:10:00.193 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-08T06:10:00.193 INFO:teuthology.orchestra.run.smithi040.stdout:/home/ubuntu/cephtest/mnt.3 2023-10-08T06:10:00.194 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T06:10:00.194 DEBUG:teuthology.orchestra.run.smithi040:> ls /sys/fs/fuse/connections 2023-10-08T06:10:00.201 INFO:teuthology.orchestra.run.smithi040.stdout:52 2023-10-08T06:10:00.201 INFO:teuthology.orchestra.run.smithi040.stdout:53 2023-10-08T06:10:00.201 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52, 53] 2023-10-08T06:10:00.201 DEBUG:teuthology.orchestra.run.smithi040:> sudo stdin-killer -- python3 -c ' 2023-10-08T06:10:00.201 DEBUG:teuthology.orchestra.run.smithi040:> import glob 2023-10-08T06:10:00.201 DEBUG:teuthology.orchestra.run.smithi040:> import re 2023-10-08T06:10:00.201 DEBUG:teuthology.orchestra.run.smithi040:> import os 2023-10-08T06:10:00.201 DEBUG:teuthology.orchestra.run.smithi040:> import subprocess 2023-10-08T06:10:00.202 DEBUG:teuthology.orchestra.run.smithi040:> 2023-10-08T06:10:00.202 DEBUG:teuthology.orchestra.run.smithi040:> def _find_admin_socket(client_name): 2023-10-08T06:10:00.202 DEBUG:teuthology.orchestra.run.smithi040:> asok_path = "/var/run/ceph/ceph-client.3.*.asok" 2023-10-08T06:10:00.202 DEBUG:teuthology.orchestra.run.smithi040:> files = glob.glob(asok_path) 2023-10-08T06:10:00.202 DEBUG:teuthology.orchestra.run.smithi040:> mountpoint = "/home/ubuntu/cephtest/mnt.3" 2023-10-08T06:10:00.202 DEBUG:teuthology.orchestra.run.smithi040:> 2023-10-08T06:10:00.202 DEBUG:teuthology.orchestra.run.smithi040:> # Given a non-glob path, it better be there 2023-10-08T06:10:00.202 DEBUG:teuthology.orchestra.run.smithi040:> if "*" not in asok_path: 2023-10-08T06:10:00.202 DEBUG:teuthology.orchestra.run.smithi040:> assert(len(files) == 1) 2023-10-08T06:10:00.202 DEBUG:teuthology.orchestra.run.smithi040:> return files[0] 2023-10-08T06:10:00.202 DEBUG:teuthology.orchestra.run.smithi040:> 2023-10-08T06:10:00.202 DEBUG:teuthology.orchestra.run.smithi040:> for f in files: 2023-10-08T06:10:00.203 DEBUG:teuthology.orchestra.run.smithi040:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-08T06:10:00.203 DEBUG:teuthology.orchestra.run.smithi040:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-08T06:10:00.203 DEBUG:teuthology.orchestra.run.smithi040:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-08T06:10:00.203 DEBUG:teuthology.orchestra.run.smithi040:> contents = proc_f.read() 2023-10-08T06:10:00.203 DEBUG:teuthology.orchestra.run.smithi040:> if mountpoint in contents: 2023-10-08T06:10:00.203 DEBUG:teuthology.orchestra.run.smithi040:> return f 2023-10-08T06:10:00.203 DEBUG:teuthology.orchestra.run.smithi040:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-08T06:10:00.203 DEBUG:teuthology.orchestra.run.smithi040:> 2023-10-08T06:10:00.203 DEBUG:teuthology.orchestra.run.smithi040:> print(_find_admin_socket("client.3")) 2023-10-08T06:10:00.203 DEBUG:teuthology.orchestra.run.smithi040:> ' 2023-10-08T06:10:00.291 INFO:teuthology.orchestra.run.smithi040.stdout:/var/run/ceph/ceph-client.3.41756.asok 2023-10-08T06:10:00.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-10-08T06:10:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-08T06:10:00.304 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.3.41756.asok 2023-10-08T06:10:00.305 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T06:10:00.305 DEBUG:teuthology.orchestra.run.smithi040:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.3.41756.asok status 2023-10-08T06:10:00.452 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2023-10-08T06:10:00.452 INFO:teuthology.orchestra.run.smithi040.stdout: "metadata": { 2023-10-08T06:10:00.452 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph_sha1": "9725b08fd801c82987c737f7e6d354878f036ee8", 2023-10-08T06:10:00.452 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph_version": "ceph version 18.0.0-6609-g9725b08f (9725b08fd801c82987c737f7e6d354878f036ee8) reef (dev)", 2023-10-08T06:10:00.453 INFO:teuthology.orchestra.run.smithi040.stdout: "entity_id": "3", 2023-10-08T06:10:00.453 INFO:teuthology.orchestra.run.smithi040.stdout: "hostname": "smithi040", 2023-10-08T06:10:00.453 INFO:teuthology.orchestra.run.smithi040.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.3", 2023-10-08T06:10:00.453 INFO:teuthology.orchestra.run.smithi040.stdout: "pid": "41756", 2023-10-08T06:10:00.453 INFO:teuthology.orchestra.run.smithi040.stdout: "root": "/" 2023-10-08T06:10:00.453 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-10-08T06:10:00.453 INFO:teuthology.orchestra.run.smithi040.stdout: "dentry_count": 0, 2023-10-08T06:10:00.453 INFO:teuthology.orchestra.run.smithi040.stdout: "dentry_pinned_count": 0, 2023-10-08T06:10:00.453 INFO:teuthology.orchestra.run.smithi040.stdout: "id": 4598, 2023-10-08T06:10:00.453 INFO:teuthology.orchestra.run.smithi040.stdout: "inst": { 2023-10-08T06:10:00.453 INFO:teuthology.orchestra.run.smithi040.stdout: "name": { 2023-10-08T06:10:00.454 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "client", 2023-10-08T06:10:00.454 INFO:teuthology.orchestra.run.smithi040.stdout: "num": 4598 2023-10-08T06:10:00.454 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-10-08T06:10:00.454 INFO:teuthology.orchestra.run.smithi040.stdout: "addr": { 2023-10-08T06:10:00.454 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "v1", 2023-10-08T06:10:00.454 INFO:teuthology.orchestra.run.smithi040.stdout: "addr": "192.168.0.2:0", 2023-10-08T06:10:00.454 INFO:teuthology.orchestra.run.smithi040.stdout: "nonce": 4255841067 2023-10-08T06:10:00.454 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-10-08T06:10:00.454 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-10-08T06:10:00.454 INFO:teuthology.orchestra.run.smithi040.stdout: "addr": { 2023-10-08T06:10:00.454 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "v1", 2023-10-08T06:10:00.454 INFO:teuthology.orchestra.run.smithi040.stdout: "addr": "192.168.0.2:0", 2023-10-08T06:10:00.455 INFO:teuthology.orchestra.run.smithi040.stdout: "nonce": 4255841067 2023-10-08T06:10:00.455 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-10-08T06:10:00.455 INFO:teuthology.orchestra.run.smithi040.stdout: "inst_str": "client.4598 192.168.0.2:0/4255841067", 2023-10-08T06:10:00.455 INFO:teuthology.orchestra.run.smithi040.stdout: "addr_str": "192.168.0.2:0/4255841067", 2023-10-08T06:10:00.455 INFO:teuthology.orchestra.run.smithi040.stdout: "inode_count": 1, 2023-10-08T06:10:00.455 INFO:teuthology.orchestra.run.smithi040.stdout: "mds_epoch": 6, 2023-10-08T06:10:00.455 INFO:teuthology.orchestra.run.smithi040.stdout: "osd_epoch": 22, 2023-10-08T06:10:00.455 INFO:teuthology.orchestra.run.smithi040.stdout: "osd_epoch_barrier": 0, 2023-10-08T06:10:00.455 INFO:teuthology.orchestra.run.smithi040.stdout: "blocklisted": false, 2023-10-08T06:10:00.455 INFO:teuthology.orchestra.run.smithi040.stdout: "fs_name": "cephfs" 2023-10-08T06:10:00.455 INFO:teuthology.orchestra.run.smithi040.stdout:} 2023-10-08T06:10:00.462 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T06:10:00.462 DEBUG:teuthology.orchestra.run.smithi032:> stat --file-system '--printf=%T 2023-10-08T06:10:00.462 DEBUG:teuthology.orchestra.run.smithi032:> ' -- /home/ubuntu/cephtest/mnt.0 2023-10-08T06:10:00.471 INFO:teuthology.orchestra.run.smithi032.stdout:fuseblk 2023-10-08T06:10:00.471 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-10-08T06:10:00.471 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T06:10:00.471 DEBUG:teuthology.orchestra.run.smithi032:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-08T06:10:00.486 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T06:10:00.486 DEBUG:teuthology.orchestra.run.smithi032:> stat --file-system '--printf=%T 2023-10-08T06:10:00.487 DEBUG:teuthology.orchestra.run.smithi032:> ' -- /home/ubuntu/cephtest/mnt.2 2023-10-08T06:10:00.535 INFO:teuthology.orchestra.run.smithi032.stdout:fuseblk 2023-10-08T06:10:00.535 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.2 2023-10-08T06:10:00.535 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T06:10:00.535 DEBUG:teuthology.orchestra.run.smithi032:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2023-10-08T06:10:00.554 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T06:10:00.555 DEBUG:teuthology.orchestra.run.smithi040:> stat --file-system '--printf=%T 2023-10-08T06:10:00.555 DEBUG:teuthology.orchestra.run.smithi040:> ' -- /home/ubuntu/cephtest/mnt.1 2023-10-08T06:10:00.563 INFO:teuthology.orchestra.run.smithi040.stdout:fuseblk 2023-10-08T06:10:00.563 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2023-10-08T06:10:00.563 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T06:10:00.564 DEBUG:teuthology.orchestra.run.smithi040:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-08T06:10:00.627 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T06:10:00.627 DEBUG:teuthology.orchestra.run.smithi040:> stat --file-system '--printf=%T 2023-10-08T06:10:00.627 DEBUG:teuthology.orchestra.run.smithi040:> ' -- /home/ubuntu/cephtest/mnt.3 2023-10-08T06:10:00.634 INFO:teuthology.orchestra.run.smithi040.stdout:fuseblk 2023-10-08T06:10:00.635 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.3 2023-10-08T06:10:00.635 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T06:10:00.635 DEBUG:teuthology.orchestra.run.smithi040:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2023-10-08T06:10:00.647 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-10-08T06:10:00.663 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T06:10:00.786 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:00.784+0000 7f26bebf0700 1 Processor -- start 2023-10-08T06:10:00.787 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:00.784+0000 7f26bebf0700 1 -- start start 2023-10-08T06:10:00.787 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:00.784+0000 7f26bebf0700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f26b8164c10 0x7f26b8165bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:00.788 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:00.784+0000 7f26bebf0700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26b8164ff0 con 0x7f26b806d490 2023-10-08T06:10:00.788 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:00.784+0000 7f26bebf0700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26b806bca0 con 0x7f26b80cf460 2023-10-08T06:10:00.788 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:00.784+0000 7f26bebf0700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26b80cfc00 con 0x7f26b8164c10 2023-10-08T06:10:00.788 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:00.784+0000 7f26be3ef700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f26b806d490 0x7f26b8070d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:46822/0 (socket says 172.21.15.32:46822) 2023-10-08T06:10:00.788 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:00.784+0000 7f26be3ef700 1 -- 172.21.15.32:0/1509671059 learned_addr learned my addr 172.21.15.32:0/1509671059 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-08T06:10:00.788 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:00.788+0000 7f26bdbee700 1 --2- 172.21.15.32:0/1509671059 >> v2:172.21.15.40:3300/0 conn(0x7f26b8164c10 0x7f26b8165bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:00.789 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:00.788+0000 7f26bcbec700 1 -- 172.21.15.32:0/1509671059 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 70427338 0 0) 0x7f26b8164ff0 con 0x7f26b806d490 2023-10-08T06:10:00.789 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:00.788+0000 7f26bcbec700 1 -- 172.21.15.32:0/1509671059 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f26a40035d0 con 0x7f26b806d490 2023-10-08T06:10:00.789 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:00.788+0000 7f26bcbec700 1 -- 172.21.15.32:0/1509671059 <== mon.1 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3876323002 0 0) 0x7f26b806bca0 con 0x7f26b80cf460 2023-10-08T06:10:00.789 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:00.788+0000 7f26bcbec700 1 -- 172.21.15.32:0/1509671059 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f26b8164ff0 con 0x7f26b80cf460 2023-10-08T06:10:00.790 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:00.788+0000 7f26bdbee700 1 -- 172.21.15.32:0/1509671059 >> v1:172.21.15.40:6789/0 conn(0x7f26b80cf460 legacy=0x7f26b806cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:00.790 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:00.788+0000 7f26bdbee700 1 -- 172.21.15.32:0/1509671059 >> v1:172.21.15.32:6789/0 conn(0x7f26b806d490 legacy=0x7f26b8070d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:00.790 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:00.788+0000 7f26bdbee700 1 -- 172.21.15.32:0/1509671059 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26b81660f0 con 0x7f26b8164c10 2023-10-08T06:10:00.790 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:00.788+0000 7f26bdbee700 1 --2- 172.21.15.32:0/1509671059 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f26b8164c10 0x7f26b8165bb0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f26b0009d90 tx=0x7f26b000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=27a603eeea011c0e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:00.790 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:00.788+0000 7f26bcbec700 1 -- 172.21.15.32:0/1509671059 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26b000e070 con 0x7f26b8164c10 2023-10-08T06:10:00.790 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:00.788+0000 7f26bcbec700 1 -- 172.21.15.32:0/1509671059 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26b000bb20 con 0x7f26b8164c10 2023-10-08T06:10:00.790 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:00.788+0000 7f26bcbec700 1 -- 172.21.15.32:0/1509671059 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26b000be90 con 0x7f26b8164c10 2023-10-08T06:10:00.791 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:00.788+0000 7f26bebf0700 1 -- 172.21.15.32:0/1509671059 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f26b8164c10 msgr2=0x7f26b8165bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:00.791 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:00.788+0000 7f26bebf0700 1 --2- 172.21.15.32:0/1509671059 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f26b8164c10 0x7f26b8165bb0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f26b0009d90 tx=0x7f26b000b330 comp rx=0 tx=0).stop 2023-10-08T06:10:00.791 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:00.788+0000 7f26bebf0700 1 -- 172.21.15.32:0/1509671059 shutdown_connections 2023-10-08T06:10:00.791 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:00.788+0000 7f26bebf0700 1 --2- 172.21.15.32:0/1509671059 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f26b8164c10 0x7f26b8165bb0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:00.791 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:00.788+0000 7f26bebf0700 1 -- 172.21.15.32:0/1509671059 >> 172.21.15.32:0/1509671059 conn(0x7f26b80cc7d0 msgr2=0x7f26b80ccbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:10:00.791 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:00.788+0000 7f26bebf0700 1 -- 172.21.15.32:0/1509671059 shutdown_connections 2023-10-08T06:10:00.791 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:00.788+0000 7f26bebf0700 1 -- 172.21.15.32:0/1509671059 wait complete. 2023-10-08T06:10:00.792 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:00.792+0000 7f26bebf0700 1 Processor -- start 2023-10-08T06:10:00.792 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:00.792+0000 7f26bebf0700 1 -- start start 2023-10-08T06:10:00.794 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:00.792+0000 7f26bebf0700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f26b806d490 0x7f26b815c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:00.794 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:00.792+0000 7f26bebf0700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f26b80cf460 0x7f26b80c3d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:00.794 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:00.792+0000 7f26bebf0700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f26b8164c10 0x7f26b80c42c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:00.794 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:00.792+0000 7f26bebf0700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26b80c5170 con 0x7f26b8164c10 2023-10-08T06:10:00.794 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:00.792+0000 7f26bebf0700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26b81fae30 con 0x7f26b80cf460 2023-10-08T06:10:00.794 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:00.792+0000 7f26bebf0700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26b80c48d0 con 0x7f26b806d490 2023-10-08T06:10:00.794 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:00.792+0000 7f26be3ef700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f26b8164c10 0x7f26b80c42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:00.795 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:00.792+0000 7f26be3ef700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f26b8164c10 0x7f26b80c42c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:45112/0 (socket says 172.21.15.32:45112) 2023-10-08T06:10:00.795 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:00.792+0000 7f26be3ef700 1 -- 172.21.15.32:0/833564677 learned_addr learned my addr 172.21.15.32:0/833564677 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:10:00.795 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:00.792+0000 7f26bd3ed700 1 --2- 172.21.15.32:0/833564677 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f26b80cf460 0x7f26b80c3d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:00.795 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:00.792+0000 7f26bdbee700 1 --2- 172.21.15.32:0/833564677 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f26b806d490 0x7f26b815c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:00.796 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:00.792+0000 7f26be3ef700 1 -- 172.21.15.32:0/833564677 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f26b806d490 msgr2=0x7f26b815c5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:00.796 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:00.792+0000 7f26be3ef700 1 --2- 172.21.15.32:0/833564677 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f26b806d490 0x7f26b815c5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:00.796 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:00.792+0000 7f26be3ef700 1 -- 172.21.15.32:0/833564677 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f26b80cf460 msgr2=0x7f26b80c3d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:00.796 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:00.792+0000 7f26be3ef700 1 --2- 172.21.15.32:0/833564677 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f26b80cf460 0x7f26b80c3d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:00.796 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:00.792+0000 7f26be3ef700 1 -- 172.21.15.32:0/833564677 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26b0009a70 con 0x7f26b8164c10 2023-10-08T06:10:00.796 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:00.792+0000 7f26be3ef700 1 --2- 172.21.15.32:0/833564677 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f26b8164c10 0x7f26b80c42c0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f26a800c430 tx=0x7f26a800c740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:00.796 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:00.792+0000 7f26b67fc700 1 -- 172.21.15.32:0/833564677 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26a8005b90 con 0x7f26b8164c10 2023-10-08T06:10:00.796 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:00.792+0000 7f26bebf0700 1 -- 172.21.15.32:0/833564677 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26b80c4bb0 con 0x7f26b8164c10 2023-10-08T06:10:00.797 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:00.792+0000 7f26b67fc700 1 -- 172.21.15.32:0/833564677 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26a8005cf0 con 0x7f26b8164c10 2023-10-08T06:10:00.797 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:00.792+0000 7f26bebf0700 1 -- 172.21.15.32:0/833564677 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26b81609b0 con 0x7f26b8164c10 2023-10-08T06:10:00.797 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:00.792+0000 7f26b67fc700 1 -- 172.21.15.32:0/833564677 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26a8007310 con 0x7f26b8164c10 2023-10-08T06:10:00.797 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:00.796+0000 7f26bebf0700 1 -- 172.21.15.32:0/833564677 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26b8160bd0 con 0x7f26b8164c10 2023-10-08T06:10:00.798 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:00.796+0000 7f26b67fc700 1 -- 172.21.15.32:0/833564677 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f26a8007470 con 0x7f26b8164c10 2023-10-08T06:10:00.799 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:00.796+0000 7f26b67fc700 1 --2- 172.21.15.32:0/833564677 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f2698066510 0x7f26980689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:00.799 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:00.796+0000 7f26b67fc700 1 -- 172.21.15.32:0/833564677 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f26a80831c0 con 0x7f26b8164c10 2023-10-08T06:10:00.799 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:00.796+0000 7f26bdbee700 1 --2- 172.21.15.32:0/833564677 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f2698066510 0x7f26980689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:00.799 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:00.800+0000 7f26bdbee700 1 --2- 172.21.15.32:0/833564677 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f2698066510 0x7f26980689d0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f26b0009fd0 tx=0x7f26b0011000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:00.806 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:00.804+0000 7f26b67fc700 1 -- 172.21.15.32:0/833564677 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f26a80505b0 con 0x7f26b8164c10 2023-10-08T06:10:00.979 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:00.976+0000 7f26bebf0700 1 -- 172.21.15.32:0/833564677 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f26b80686a0 con 0x7f26b8164c10 2023-10-08T06:10:00.981 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:00.980+0000 7f26b67fc700 1 -- 172.21.15.32:0/833564677 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16445 (secure 0 0 0) 0x7f26a8005e60 con 0x7f26b8164c10 2023-10-08T06:10:00.982 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:10:00.982 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":22,"fsid":"ac672d87-96ae-41e0-9314-623ba2cdbbba","created":"2023-10-08T06:09:11.175626+0000","modified":"2023-10-08T06:09:38.153256+0000","last_up_change":"2023-10-08T06:09:22.744643+0000","last_in_change":"2023-10-08T06:09:14.131580+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T06:09:23.307843+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T06:09:34.295012+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T06:09:35.515590+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"43433f0c-9592-4874-92d7-10f8f4acf07f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":587888964},{"type":"v1","addr":"172.21.15.32:6801","nonce":587888964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":587888964},{"type":"v1","addr":"172.21.15.32:6803","nonce":587888964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":587888964},{"type":"v1","addr":"172.21.15.32:6810","nonce":587888964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6805","nonce":587888964},{"type":"v1","addr":"172.21.15.32:6807","nonce":587888964}]},"public_addr":"172.21.15.32:6801/587888964","cluster_addr":"172.21.15.32:6803/587888964","heartbeat_back_addr":"172.21.15.32:6810/587888964","heartbeat_front_addr":"172.21.15.32:6807/587888964","state":["exists","up"]},{"osd":1,"uuid":"2ecb1008-b987-4ce7-b646-6cded55fc8d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":990576767},{"type":"v1","addr":"172.21.15.32:6817","nonce":990576767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":990576767},{"type":"v1","addr":"172.21.15.32:6819","nonce":990576767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":990576767},{"type":"v1","addr":"172.21.15.32:6823","nonce":990576767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":990576767},{"type":"v1","addr":"172.21.15.32:6821","nonce":990576767}]},"public_addr":"172.21.15.32:6817/990576767","cluster_addr":"172.21.15.32:6819/990576767","heartbeat_back_addr":"172.21.15.32:6823/990576767","heartbeat_front_addr":"172.21.15.32:6821/990576767","state":["exists","up"]},{"osd":2,"uuid":"1b131c94-c09b-4e80-8746-bf1b7bac362d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6824","nonce":1566874440},{"type":"v1","addr":"172.21.15.32:6825","nonce":1566874440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":1566874440},{"type":"v1","addr":"172.21.15.32:6827","nonce":1566874440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":1566874440},{"type":"v1","addr":"172.21.15.32:6831","nonce":1566874440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":1566874440},{"type":"v1","addr":"172.21.15.32:6829","nonce":1566874440}]},"public_addr":"172.21.15.32:6825/1566874440","cluster_addr":"172.21.15.32:6827/1566874440","heartbeat_back_addr":"172.21.15.32:6831/1566874440","heartbeat_front_addr":"172.21.15.32:6829/1566874440","state":["exists","up"]},{"osd":3,"uuid":"ad655af2-1f6f-4689-b21d-b07bbaeb68b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":3672614802},{"type":"v1","addr":"172.21.15.32:6806","nonce":3672614802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6809","nonce":3672614802},{"type":"v1","addr":"172.21.15.32:6811","nonce":3672614802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":3672614802},{"type":"v1","addr":"172.21.15.32:6815","nonce":3672614802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":3672614802},{"type":"v1","addr":"172.21.15.32:6813","nonce":3672614802}]},"public_addr":"172.21.15.32:6806/3672614802","cluster_addr":"172.21.15.32:6811/3672614802","heartbeat_back_addr":"172.21.15.32:6815/3672614802","heartbeat_front_addr":"172.21.15.32:6813/3672614802","state":["exists","up"]},{"osd":4,"uuid":"64a543a1-8c4f-458e-9aba-b35c1cd7dd03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":3369928244},{"type":"v1","addr":"172.21.15.40:6801","nonce":3369928244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":3369928244},{"type":"v1","addr":"172.21.15.40:6803","nonce":3369928244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":3369928244},{"type":"v1","addr":"172.21.15.40:6807","nonce":3369928244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":3369928244},{"type":"v1","addr":"172.21.15.40:6805","nonce":3369928244}]},"public_addr":"172.21.15.40:6801/3369928244","cluster_addr":"172.21.15.40:6803/3369928244","heartbeat_back_addr":"172.21.15.40:6807/3369928244","heartbeat_front_addr":"172.21.15.40:6805/3369928244","state":["exists","up"]},{"osd":5,"uuid":"0fef3e54-edb4-4678-878e-944663c51638","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":2395850297},{"type":"v1","addr":"172.21.15.40:6825","nonce":2395850297}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":2395850297},{"type":"v1","addr":"172.21.15.40:6827","nonce":2395850297}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":2395850297},{"type":"v1","addr":"172.21.15.40:6831","nonce":2395850297}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":2395850297},{"type":"v1","addr":"172.21.15.40:6829","nonce":2395850297}]},"public_addr":"172.21.15.40:6825/2395850297","cluster_addr":"172.21.15.40:6827/2395850297","heartbeat_back_addr":"172.21.15.40:6831/2395850297","heartbeat_front_addr":"172.21.15.40:6829/2395850297","state":["exists","up"]},{"osd":6,"uuid":"2eeb0472-6096-469d-9b2c-cab4bf41c31a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":4145283410},{"type":"v1","addr":"172.21.15.40:6809","nonce":4145283410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":4145283410},{"type":"v1","addr":"172.21.15.40:6811","nonce":4145283410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":4145283410},{"type":"v1","addr":"172.21.15.40:6815","nonce":4145283410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":4145283410},{"type":"v1","addr":"172.21.15.40:6813","nonce":4145283410}]},"public_addr":"172.21.15.40:6809/4145283410","cluster_addr":"172.21.15.40:6811/4145283410","heartbeat_back_addr":"172.21.15.40:6815/4145283410","heartbeat_front_addr":"172.21.15.40:6813/4145283410","state":["exists","up"]},{"osd":7,"uuid":"cf76e4c7-96a6-401f-a280-91aad4641940","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":2943297416},{"type":"v1","addr":"172.21.15.40:6817","nonce":2943297416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":2943297416},{"type":"v1","addr":"172.21.15.40:6819","nonce":2943297416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":2943297416},{"type":"v1","addr":"172.21.15.40:6823","nonce":2943297416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":2943297416},{"type":"v1","addr":"172.21.15.40:6821","nonce":2943297416}]},"public_addr":"172.21.15.40:6817/2943297416","cluster_addr":"172.21.15.40:6819/2943297416","heartbeat_back_addr":"172.21.15.40:6823/2943297416","heartbeat_front_addr":"172.21.15.40:6821/2943297416","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.411475+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.628841+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.599055+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.166100+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.384135+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.488403+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.307648+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.363541+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T06:10:00.984 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:00.984+0000 7f26bebf0700 1 -- 172.21.15.32:0/833564677 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f2698066510 msgr2=0x7f26980689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:00.984 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:00.984+0000 7f26bebf0700 1 --2- 172.21.15.32:0/833564677 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f2698066510 0x7f26980689d0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f26b0009fd0 tx=0x7f26b0011000 comp rx=0 tx=0).stop 2023-10-08T06:10:00.984 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:00.984+0000 7f26bebf0700 1 -- 172.21.15.32:0/833564677 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f26b8164c10 msgr2=0x7f26b80c42c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:00.984 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:00.984+0000 7f26bebf0700 1 --2- 172.21.15.32:0/833564677 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f26b8164c10 0x7f26b80c42c0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f26a800c430 tx=0x7f26a800c740 comp rx=0 tx=0).stop 2023-10-08T06:10:00.984 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:00.984+0000 7f26bebf0700 1 -- 172.21.15.32:0/833564677 shutdown_connections 2023-10-08T06:10:00.984 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:00.984+0000 7f26bebf0700 1 --2- 172.21.15.32:0/833564677 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f2698066510 0x7f26980689d0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:00.985 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:00.984+0000 7f26bebf0700 1 --2- 172.21.15.32:0/833564677 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f26b8164c10 0x7f26b80c42c0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:00.985 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:00.984+0000 7f26bebf0700 1 --2- 172.21.15.32:0/833564677 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f26b80cf460 0x7f26b80c3d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:00.985 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:00.984+0000 7f26bebf0700 1 --2- 172.21.15.32:0/833564677 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f26b806d490 0x7f26b815c5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:00.985 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:00.984+0000 7f26bebf0700 1 -- 172.21.15.32:0/833564677 >> 172.21.15.32:0/833564677 conn(0x7f26b80cc7d0 msgr2=0x7f26b806a2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:10:00.985 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:00.984+0000 7f26bebf0700 1 -- 172.21.15.32:0/833564677 shutdown_connections 2023-10-08T06:10:00.985 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:00.984+0000 7f26bebf0700 1 -- 172.21.15.32:0/833564677 wait complete. 2023-10-08T06:10:00.996 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T06:09:23.307843+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-08T06:09:34.295012+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-08T06:09:35.515590+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-08T06:10:00.997 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T06:10:01.114 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.112+0000 7fbad359e700 1 Processor -- start 2023-10-08T06:10:01.114 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.112+0000 7fbad359e700 1 -- start start 2023-10-08T06:10:01.117 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.112+0000 7fbad359e700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fbad40cbc20 0x7fbad40ca9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:01.117 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.112+0000 7fbad359e700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbad40cca40 con 0x7fbad4159ed0 2023-10-08T06:10:01.117 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.112+0000 7fbad359e700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbad40cdf60 con 0x7fbad415a2b0 2023-10-08T06:10:01.117 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.112+0000 7fbad359e700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbad40ccdb0 con 0x7fbad40cbc20 2023-10-08T06:10:01.117 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.112+0000 7fbad2d9d700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fbad40cbc20 0x7fbad40ca9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:01.118 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.112+0000 7fbad259c700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fbad4159ed0 0x7fbad40706f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:46830/0 (socket says 172.21.15.32:46830) 2023-10-08T06:10:01.118 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.112+0000 7fbad259c700 1 -- 172.21.15.32:0/4276904404 learned_addr learned my addr 172.21.15.32:0/4276904404 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-08T06:10:01.118 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.116+0000 7fbad2d9d700 1 -- 172.21.15.32:0/4276904404 >> v1:172.21.15.40:6789/0 conn(0x7fbad415a2b0 legacy=0x7fbad40cb510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:01.118 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.116+0000 7fbad2d9d700 1 -- 172.21.15.32:0/4276904404 >> v1:172.21.15.32:6789/0 conn(0x7fbad4159ed0 legacy=0x7fbad40706f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:01.118 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.116+0000 7fbad2d9d700 1 -- 172.21.15.32:0/4276904404 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbad40ce240 con 0x7fbad40cbc20 2023-10-08T06:10:01.118 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.116+0000 7fbad2d9d700 1 --2- 172.21.15.32:0/4276904404 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbad40cbc20 0x7fbad40ca9b0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fbacc009d90 tx=0x7fbacc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3366efd7887d52d1 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:01.121 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.116+0000 7fbad1d9b700 1 -- 172.21.15.32:0/4276904404 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbacc00e070 con 0x7fbad40cbc20 2023-10-08T06:10:01.121 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.116+0000 7fbad1d9b700 1 -- 172.21.15.32:0/4276904404 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbacc00bbd0 con 0x7fbad40cbc20 2023-10-08T06:10:01.121 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.116+0000 7fbad1d9b700 1 -- 172.21.15.32:0/4276904404 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbacc012430 con 0x7fbad40cbc20 2023-10-08T06:10:01.121 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.116+0000 7fbad359e700 1 -- 172.21.15.32:0/4276904404 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbad40cbc20 msgr2=0x7fbad40ca9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:01.121 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.116+0000 7fbad359e700 1 --2- 172.21.15.32:0/4276904404 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbad40cbc20 0x7fbad40ca9b0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fbacc009d90 tx=0x7fbacc00b330 comp rx=0 tx=0).stop 2023-10-08T06:10:01.121 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.116+0000 7fbad359e700 1 -- 172.21.15.32:0/4276904404 shutdown_connections 2023-10-08T06:10:01.122 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.116+0000 7fbad359e700 1 --2- 172.21.15.32:0/4276904404 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbad40cbc20 0x7fbad40ca9b0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:01.122 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.116+0000 7fbad359e700 1 -- 172.21.15.32:0/4276904404 >> 172.21.15.32:0/4276904404 conn(0x7fbad40b0900 msgr2=0x7fbad40b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:10:01.122 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.116+0000 7fbad359e700 1 -- 172.21.15.32:0/4276904404 shutdown_connections 2023-10-08T06:10:01.122 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.116+0000 7fbad359e700 1 -- 172.21.15.32:0/4276904404 wait complete. 2023-10-08T06:10:01.122 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.120+0000 7fbad359e700 1 Processor -- start 2023-10-08T06:10:01.123 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.120+0000 7fbad359e700 1 -- start start 2023-10-08T06:10:01.126 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.120+0000 7fbad359e700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbad40cbc20 0x7fbad414eff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:01.126 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.120+0000 7fbad359e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbad4159ed0 0x7fbad414f530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:01.126 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.120+0000 7fbad359e700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbad415a2b0 0x7fbad4168020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:01.127 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.120+0000 7fbad359e700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbad40caef0 con 0x7fbad415a2b0 2023-10-08T06:10:01.127 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.120+0000 7fbad359e700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbad414c8a0 con 0x7fbad40cbc20 2023-10-08T06:10:01.127 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.120+0000 7fbad359e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbad414c4c0 con 0x7fbad4159ed0 2023-10-08T06:10:01.127 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.120+0000 7fbad2d9d700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbad415a2b0 0x7fbad4168020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:01.127 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.120+0000 7fbad2d9d700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbad415a2b0 0x7fbad4168020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:45126/0 (socket says 172.21.15.32:45126) 2023-10-08T06:10:01.127 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.120+0000 7fbad2d9d700 1 -- 172.21.15.32:0/2489696492 learned_addr learned my addr 172.21.15.32:0/2489696492 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:10:01.127 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.120+0000 7fbad259c700 1 --2- 172.21.15.32:0/2489696492 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbad40cbc20 0x7fbad414eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:01.127 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.120+0000 7fbacbfff700 1 --2- 172.21.15.32:0/2489696492 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbad4159ed0 0x7fbad414f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:01.127 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.120+0000 7fbad2d9d700 1 -- 172.21.15.32:0/2489696492 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbad4159ed0 msgr2=0x7fbad414f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:01.127 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.120+0000 7fbad2d9d700 1 --2- 172.21.15.32:0/2489696492 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbad4159ed0 0x7fbad414f530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:01.127 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.120+0000 7fbad2d9d700 1 -- 172.21.15.32:0/2489696492 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbad40cbc20 msgr2=0x7fbad414eff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:01.128 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.120+0000 7fbad2d9d700 1 --2- 172.21.15.32:0/2489696492 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbad40cbc20 0x7fbad414eff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:01.128 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.120+0000 7fbad2d9d700 1 -- 172.21.15.32:0/2489696492 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbacc009a70 con 0x7fbad415a2b0 2023-10-08T06:10:01.128 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.120+0000 7fbad2d9d700 1 --2- 172.21.15.32:0/2489696492 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbad415a2b0 0x7fbad4168020 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fbad406b7d0 tx=0x7fbacc004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:01.128 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.120+0000 7fbacaffd700 1 -- 172.21.15.32:0/2489696492 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbacc012dd0 con 0x7fbad415a2b0 2023-10-08T06:10:01.128 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.120+0000 7fbacaffd700 1 -- 172.21.15.32:0/2489696492 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbacc020070 con 0x7fbad415a2b0 2023-10-08T06:10:01.128 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.120+0000 7fbacaffd700 1 -- 172.21.15.32:0/2489696492 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbacc004280 con 0x7fbad415a2b0 2023-10-08T06:10:01.128 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.120+0000 7fbad359e700 1 -- 172.21.15.32:0/2489696492 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbad414b140 con 0x7fbad415a2b0 2023-10-08T06:10:01.128 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.120+0000 7fbad359e700 1 -- 172.21.15.32:0/2489696492 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbad414b700 con 0x7fbad415a2b0 2023-10-08T06:10:01.128 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.124+0000 7fbad359e700 1 -- 172.21.15.32:0/2489696492 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbad40cc7d0 con 0x7fbad415a2b0 2023-10-08T06:10:01.128 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.124+0000 7fbacaffd700 1 -- 172.21.15.32:0/2489696492 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fbacc0043e0 con 0x7fbad415a2b0 2023-10-08T06:10:01.128 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.124+0000 7fbacaffd700 1 --2- 172.21.15.32:0/2489696492 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fbab4066510 0x7fbab40689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:01.129 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.124+0000 7fbacaffd700 1 -- 172.21.15.32:0/2489696492 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbacc022070 con 0x7fbad415a2b0 2023-10-08T06:10:01.129 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.124+0000 7fbad259c700 1 --2- 172.21.15.32:0/2489696492 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fbab4066510 0x7fbab40689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:01.129 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.128+0000 7fbad259c700 1 --2- 172.21.15.32:0/2489696492 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fbab4066510 0x7fbab40689d0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fbac4005930 tx=0x7fbac4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:01.136 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.136+0000 7fbacaffd700 1 -- 172.21.15.32:0/2489696492 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fbacc053090 con 0x7fbad415a2b0 2023-10-08T06:10:01.298 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.296+0000 7fbad359e700 1 -- 172.21.15.32:0/2489696492 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fbad4073f00 con 0x7fbad415a2b0 2023-10-08T06:10:01.299 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.296+0000 7fbacaffd700 1 -- 172.21.15.32:0/2489696492 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7fbacc02c0a0 con 0x7fbad415a2b0 2023-10-08T06:10:01.299 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 1 2023-10-08T06:10:01.302 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.300+0000 7fbad359e700 1 -- 172.21.15.32:0/2489696492 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fbab4066510 msgr2=0x7fbab40689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:01.302 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.300+0000 7fbad359e700 1 --2- 172.21.15.32:0/2489696492 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fbab4066510 0x7fbab40689d0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fbac4005930 tx=0x7fbac4009040 comp rx=0 tx=0).stop 2023-10-08T06:10:01.302 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.300+0000 7fbad359e700 1 -- 172.21.15.32:0/2489696492 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbad415a2b0 msgr2=0x7fbad4168020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:01.302 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.300+0000 7fbad359e700 1 --2- 172.21.15.32:0/2489696492 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbad415a2b0 0x7fbad4168020 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fbad406b7d0 tx=0x7fbacc004af0 comp rx=0 tx=0).stop 2023-10-08T06:10:01.302 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.300+0000 7fbad359e700 1 -- 172.21.15.32:0/2489696492 shutdown_connections 2023-10-08T06:10:01.302 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.300+0000 7fbad359e700 1 --2- 172.21.15.32:0/2489696492 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fbab4066510 0x7fbab40689d0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:01.302 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.300+0000 7fbad359e700 1 --2- 172.21.15.32:0/2489696492 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbad415a2b0 0x7fbad4168020 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:01.302 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.300+0000 7fbad359e700 1 --2- 172.21.15.32:0/2489696492 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbad4159ed0 0x7fbad414f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:01.302 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.300+0000 7fbad359e700 1 --2- 172.21.15.32:0/2489696492 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbad40cbc20 0x7fbad414eff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:01.302 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.300+0000 7fbad359e700 1 -- 172.21.15.32:0/2489696492 >> 172.21.15.32:0/2489696492 conn(0x7fbad40b0900 msgr2=0x7fbad415a850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:10:01.303 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.300+0000 7fbad359e700 1 -- 172.21.15.32:0/2489696492 shutdown_connections 2023-10-08T06:10:01.303 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.300+0000 7fbad359e700 1 -- 172.21.15.32:0/2489696492 wait complete. 2023-10-08T06:10:01.314 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-08T06:10:01.438 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.436+0000 7f8ea9561700 1 Processor -- start 2023-10-08T06:10:01.438 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.436+0000 7f8ea9561700 1 -- start start 2023-10-08T06:10:01.440 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.436+0000 7f8ea9561700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f8ea415e1c0 0x7f8ea40ce8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:01.440 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.436+0000 7f8ea9561700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8ea40c9c20 0x7f8ea40ca070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:01.440 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.436+0000 7f8ea9561700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ea40ca5b0 con 0x7f8ea415dde0 2023-10-08T06:10:01.440 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.436+0000 7f8ea9561700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ea40cf200 con 0x7f8ea415e1c0 2023-10-08T06:10:01.440 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.436+0000 7f8ea9561700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ea40cd1a0 con 0x7f8ea40c9c20 2023-10-08T06:10:01.440 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.440+0000 7f8ea8d60700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8ea40c9c20 0x7f8ea40ca070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:01.440 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.440+0000 7f8ea37fe700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f8ea415e1c0 0x7f8ea40ce8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:01.440 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.440+0000 7f8ea8d60700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8ea40c9c20 0x7f8ea40ca070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.32:39010/0 (socket says 172.21.15.32:39010) 2023-10-08T06:10:01.441 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.440+0000 7f8ea37fe700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f8ea415e1c0 0x7f8ea40ce8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.32:51522/0 (socket says 172.21.15.32:51522) 2023-10-08T06:10:01.441 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.440+0000 7f8ea8d60700 1 -- 172.21.15.32:0/3082096486 learned_addr learned my addr 172.21.15.32:0/3082096486 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:10:01.441 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.440+0000 7f8ea3fff700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f8ea415dde0 0x7f8ea40cdf60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.32:41024/0 (socket says 172.21.15.32:41024) 2023-10-08T06:10:01.443 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.440+0000 7f8ea37fe700 1 -- 172.21.15.32:0/3082096486 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8ea40c9c20 msgr2=0x7f8ea40ca070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:10:01.443 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.440+0000 7f8ea37fe700 1 --2- 172.21.15.32:0/3082096486 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8ea40c9c20 0x7f8ea40ca070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:01.444 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.440+0000 7f8ea37fe700 1 -- 172.21.15.32:0/3082096486 >> v1:172.21.15.40:6789/0 conn(0x7f8ea415dde0 legacy=0x7f8ea40cdf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:01.444 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.440+0000 7f8ea37fe700 1 -- 172.21.15.32:0/3082096486 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ea40cd480 con 0x7f8ea415e1c0 2023-10-08T06:10:01.444 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.440+0000 7f8ea8d60700 1 --2- 172.21.15.32:0/3082096486 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8ea40c9c20 0x7f8ea40ca070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T06:10:01.444 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.440+0000 7f8ea37fe700 1 --2- 172.21.15.32:0/3082096486 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8ea415e1c0 0x7f8ea40ce8d0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f8e94009850 tx=0x7f8e94009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b87ac8f02853f171 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:01.444 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.440+0000 7f8ea2ffd700 1 -- 172.21.15.32:0/3082096486 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e94011830 con 0x7f8ea415e1c0 2023-10-08T06:10:01.445 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.440+0000 7f8ea2ffd700 1 -- 172.21.15.32:0/3082096486 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e94011990 con 0x7f8ea415e1c0 2023-10-08T06:10:01.445 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.440+0000 7f8ea2ffd700 1 -- 172.21.15.32:0/3082096486 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e94011d40 con 0x7f8ea415e1c0 2023-10-08T06:10:01.445 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.440+0000 7f8ea9561700 1 -- 172.21.15.32:0/3082096486 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8ea415e1c0 msgr2=0x7f8ea40ce8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:01.445 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.440+0000 7f8ea9561700 1 --2- 172.21.15.32:0/3082096486 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8ea415e1c0 0x7f8ea40ce8d0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f8e94009850 tx=0x7f8e94009b60 comp rx=0 tx=0).stop 2023-10-08T06:10:01.445 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.440+0000 7f8ea9561700 1 -- 172.21.15.32:0/3082096486 shutdown_connections 2023-10-08T06:10:01.445 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.440+0000 7f8ea9561700 1 --2- 172.21.15.32:0/3082096486 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8ea40c9c20 0x7f8ea40ca070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:01.446 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.440+0000 7f8ea9561700 1 --2- 172.21.15.32:0/3082096486 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8ea415e1c0 0x7f8ea40ce8d0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:01.446 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.440+0000 7f8ea9561700 1 -- 172.21.15.32:0/3082096486 >> 172.21.15.32:0/3082096486 conn(0x7f8ea40cf5d0 msgr2=0x7f8ea40cf9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:10:01.446 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.440+0000 7f8ea9561700 1 -- 172.21.15.32:0/3082096486 shutdown_connections 2023-10-08T06:10:01.446 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.440+0000 7f8ea9561700 1 -- 172.21.15.32:0/3082096486 wait complete. 2023-10-08T06:10:01.450 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.444+0000 7f8ea9561700 1 Processor -- start 2023-10-08T06:10:01.450 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.444+0000 7f8ea9561700 1 -- start start 2023-10-08T06:10:01.450 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.444+0000 7f8ea9561700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8ea40c9c20 0x7f8ea41f2130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:01.450 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.444+0000 7f8ea9561700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8ea415dde0 0x7f8ea40b43d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:01.450 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.444+0000 7f8ea9561700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8ea415e1c0 0x7f8ea40b0c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:01.451 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.444+0000 7f8ea9561700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ea41f2670 con 0x7f8ea40c9c20 2023-10-08T06:10:01.451 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.444+0000 7f8ea9561700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ea40b08a0 con 0x7f8ea415dde0 2023-10-08T06:10:01.451 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.444+0000 7f8ea9561700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ea40afa10 con 0x7f8ea415e1c0 2023-10-08T06:10:01.451 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.444+0000 7f8ea3fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8ea40c9c20 0x7f8ea41f2130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:01.451 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.444+0000 7f8ea3fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8ea40c9c20 0x7f8ea41f2130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:45128/0 (socket says 172.21.15.32:45128) 2023-10-08T06:10:01.451 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.444+0000 7f8ea3fff700 1 -- 172.21.15.32:0/3338486309 learned_addr learned my addr 172.21.15.32:0/3338486309 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:10:01.451 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.444+0000 7f8ea37fe700 1 --2- 172.21.15.32:0/3338486309 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8ea415dde0 0x7f8ea40b43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:01.451 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.444+0000 7f8ea8d60700 1 --2- 172.21.15.32:0/3338486309 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8ea415e1c0 0x7f8ea40b0c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:01.451 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.444+0000 7f8ea3fff700 1 -- 172.21.15.32:0/3338486309 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8ea415e1c0 msgr2=0x7f8ea40b0c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:01.451 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.444+0000 7f8ea3fff700 1 --2- 172.21.15.32:0/3338486309 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8ea415e1c0 0x7f8ea40b0c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:01.451 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.444+0000 7f8ea3fff700 1 -- 172.21.15.32:0/3338486309 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8ea415dde0 msgr2=0x7f8ea40b43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:01.452 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.444+0000 7f8ea3fff700 1 --2- 172.21.15.32:0/3338486309 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8ea415dde0 0x7f8ea40b43d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:01.452 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.444+0000 7f8ea3fff700 1 -- 172.21.15.32:0/3338486309 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e9c009b30 con 0x7f8ea40c9c20 2023-10-08T06:10:01.452 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.444+0000 7f8ea3fff700 1 --2- 172.21.15.32:0/3338486309 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8ea40c9c20 0x7f8ea41f2130 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f8e9800c730 tx=0x7f8e9800ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:01.452 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.444+0000 7f8ea0ff9700 1 -- 172.21.15.32:0/3338486309 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e98005cd0 con 0x7f8ea40c9c20 2023-10-08T06:10:01.452 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.444+0000 7f8ea0ff9700 1 -- 172.21.15.32:0/3338486309 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e98005e30 con 0x7f8ea40c9c20 2023-10-08T06:10:01.452 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.444+0000 7f8ea9561700 1 -- 172.21.15.32:0/3338486309 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e940094b0 con 0x7f8ea40c9c20 2023-10-08T06:10:01.452 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.444+0000 7f8ea0ff9700 1 -- 172.21.15.32:0/3338486309 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e980072f0 con 0x7f8ea40c9c20 2023-10-08T06:10:01.452 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.444+0000 7f8ea9561700 1 -- 172.21.15.32:0/3338486309 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ea40aff70 con 0x7f8ea40c9c20 2023-10-08T06:10:01.452 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.448+0000 7f8ea9561700 1 -- 172.21.15.32:0/3338486309 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ea4073f00 con 0x7f8ea40c9c20 2023-10-08T06:10:01.452 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.448+0000 7f8ea0ff9700 1 -- 172.21.15.32:0/3338486309 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f8e98007450 con 0x7f8ea40c9c20 2023-10-08T06:10:01.453 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.448+0000 7f8ea0ff9700 1 --2- 172.21.15.32:0/3338486309 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f8e90066510 0x7f8e900689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:01.453 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.448+0000 7f8ea37fe700 1 --2- 172.21.15.32:0/3338486309 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f8e90066510 0x7f8e900689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:01.453 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.448+0000 7f8ea0ff9700 1 -- 172.21.15.32:0/3338486309 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8e98082fe0 con 0x7f8ea40c9c20 2023-10-08T06:10:01.453 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.448+0000 7f8ea37fe700 1 --2- 172.21.15.32:0/3338486309 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f8e90066510 0x7f8e900689d0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f8e940090b0 tx=0x7f8e9401c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:01.455 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.456+0000 7f8ea0ff9700 1 -- 172.21.15.32:0/3338486309 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f8e980504f0 con 0x7f8ea40c9c20 2023-10-08T06:10:01.624 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.624+0000 7f8ea9561700 1 -- 172.21.15.32:0/3338486309 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8ea40ca5b0 con 0x7f8ea40c9c20 2023-10-08T06:10:01.625 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.624+0000 7f8ea0ff9700 1 -- 172.21.15.32:0/3338486309 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8e98017020 con 0x7f8ea40c9c20 2023-10-08T06:10:01.625 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 32 2023-10-08T06:10:01.627 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.624+0000 7f8ea9561700 1 -- 172.21.15.32:0/3338486309 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f8e90066510 msgr2=0x7f8e900689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:01.628 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.624+0000 7f8ea9561700 1 --2- 172.21.15.32:0/3338486309 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f8e90066510 0x7f8e900689d0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f8e940090b0 tx=0x7f8e9401c040 comp rx=0 tx=0).stop 2023-10-08T06:10:01.628 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.624+0000 7f8ea9561700 1 -- 172.21.15.32:0/3338486309 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8ea40c9c20 msgr2=0x7f8ea41f2130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:01.628 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.624+0000 7f8ea9561700 1 --2- 172.21.15.32:0/3338486309 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8ea40c9c20 0x7f8ea41f2130 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f8e9800c730 tx=0x7f8e9800ca40 comp rx=0 tx=0).stop 2023-10-08T06:10:01.628 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.624+0000 7f8ea9561700 1 -- 172.21.15.32:0/3338486309 shutdown_connections 2023-10-08T06:10:01.628 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.624+0000 7f8ea9561700 1 --2- 172.21.15.32:0/3338486309 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f8e90066510 0x7f8e900689d0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:01.628 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.624+0000 7f8ea9561700 1 --2- 172.21.15.32:0/3338486309 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8ea415e1c0 0x7f8ea40b0c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:01.628 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.624+0000 7f8ea9561700 1 --2- 172.21.15.32:0/3338486309 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8ea415dde0 0x7f8ea40b43d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:01.628 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.624+0000 7f8ea9561700 1 --2- 172.21.15.32:0/3338486309 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8ea40c9c20 0x7f8ea41f2130 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:01.628 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.624+0000 7f8ea9561700 1 -- 172.21.15.32:0/3338486309 >> 172.21.15.32:0/3338486309 conn(0x7f8ea40cf5d0 msgr2=0x7f8ea40ce690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:10:01.628 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.628+0000 7f8ea9561700 1 -- 172.21.15.32:0/3338486309 shutdown_connections 2023-10-08T06:10:01.629 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.628+0000 7f8ea9561700 1 -- 172.21.15.32:0/3338486309 wait complete. 2023-10-08T06:10:01.639 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-08T06:10:01.762 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.760+0000 7fbbdd5c9700 1 Processor -- start 2023-10-08T06:10:01.763 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.760+0000 7fbbdd5c9700 1 -- start start 2023-10-08T06:10:01.764 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.764+0000 7fbbdd5c9700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fbbd815d980 0x7fbbd80b4d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:01.764 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.764+0000 7fbbdd5c9700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbd80b6750 con 0x7fbbd80b5270 2023-10-08T06:10:01.764 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.764+0000 7fbbdd5c9700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbd80b56d0 con 0x7fbbd80d1e70 2023-10-08T06:10:01.765 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.764+0000 7fbbdd5c9700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbd80d2a30 con 0x7fbbd815d980 2023-10-08T06:10:01.765 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.764+0000 7fbbd67fc700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fbbd80b5270 0x7fbbd80d1760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:46840/0 (socket says 172.21.15.32:46840) 2023-10-08T06:10:01.765 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.764+0000 7fbbd67fc700 1 -- 172.21.15.32:0/2231136569 learned_addr learned my addr 172.21.15.32:0/2231136569 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-08T06:10:01.765 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.764+0000 7fbbd6ffd700 1 --2- 172.21.15.32:0/2231136569 >> v2:172.21.15.32:3300/0 conn(0x7fbbd815d980 0x7fbbd80b4d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:01.768 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.764+0000 7fbbd5ffb700 1 -- 172.21.15.32:0/2231136569 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3258211689 0 0) 0x7fbbd80b6750 con 0x7fbbd80b5270 2023-10-08T06:10:01.768 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.764+0000 7fbbd5ffb700 1 -- 172.21.15.32:0/2231136569 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbbc00035d0 con 0x7fbbd80b5270 2023-10-08T06:10:01.768 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.764+0000 7fbbd5ffb700 1 -- 172.21.15.32:0/2231136569 <== mon.1 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2798410678 0 0) 0x7fbbd80b56d0 con 0x7fbbd80d1e70 2023-10-08T06:10:01.768 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.764+0000 7fbbd5ffb700 1 -- 172.21.15.32:0/2231136569 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbbd80b6750 con 0x7fbbd80d1e70 2023-10-08T06:10:01.768 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.764+0000 7fbbd5ffb700 1 -- 172.21.15.32:0/2231136569 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4115129264 0 0) 0x7fbbc00035d0 con 0x7fbbd80b5270 2023-10-08T06:10:01.768 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.764+0000 7fbbd5ffb700 1 -- 172.21.15.32:0/2231136569 >> v2:172.21.15.32:3300/0 conn(0x7fbbd815d980 msgr2=0x7fbbd80b4d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:10:01.768 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.764+0000 7fbbd5ffb700 1 --2- 172.21.15.32:0/2231136569 >> v2:172.21.15.32:3300/0 conn(0x7fbbd815d980 0x7fbbd80b4d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:01.768 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.764+0000 7fbbd5ffb700 1 -- 172.21.15.32:0/2231136569 >> v1:172.21.15.40:6789/0 conn(0x7fbbd80d1e70 legacy=0x7fbbd80b7140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:01.769 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.764+0000 7fbbd5ffb700 1 -- 172.21.15.32:0/2231136569 --> v1:172.21.15.32:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbd80b6980 con 0x7fbbd80b5270 2023-10-08T06:10:01.769 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.764+0000 7fbbd5ffb700 1 -- 172.21.15.32:0/2231136569 <== mon.0 v1:172.21.15.32:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2364763317 0 0) 0x7fbbc8001670 con 0x7fbbd80b5270 2023-10-08T06:10:01.769 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.764+0000 7fbbd6ffd700 1 --2- 172.21.15.32:0/2231136569 >> v2:172.21.15.32:3300/0 conn(0x7fbbd815d980 0x7fbbd80b4d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T06:10:01.769 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.764+0000 7fbbd5ffb700 1 -- 172.21.15.32:0/2231136569 >> v1:172.21.15.32:6789/0 conn(0x7fbbd80b5270 legacy=0x7fbbd80d1760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:01.769 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.764+0000 7fbbd5ffb700 1 --2- 172.21.15.32:0/2231136569 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbbc0003bb0 0x7fbbc0003fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:01.769 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.764+0000 7fbbd5ffb700 1 --2- 172.21.15.32:0/2231136569 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbbc0004870 0x7fbbc0004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:01.769 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.764+0000 7fbbd5ffb700 1 --2- 172.21.15.32:0/2231136569 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbbc0005230 0x7fbbc000ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:01.769 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.764+0000 7fbbd5ffb700 1 -- 172.21.15.32:0/2231136569 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbd80d2a30 con 0x7fbbc0004870 2023-10-08T06:10:01.769 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.764+0000 7fbbd5ffb700 1 -- 172.21.15.32:0/2231136569 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbc000c0b0 con 0x7fbbc0003bb0 2023-10-08T06:10:01.769 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.764+0000 7fbbd5ffb700 1 -- 172.21.15.32:0/2231136569 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbc000c270 con 0x7fbbc0005230 2023-10-08T06:10:01.769 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.764+0000 7fbbd67fc700 1 --2- 172.21.15.32:0/2231136569 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbbc0004870 0x7fbbc0004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:01.770 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.764+0000 7fbbd6ffd700 1 --2- 172.21.15.32:0/2231136569 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbbc0003bb0 0x7fbbc0003fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:01.770 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.764+0000 7fbbd77fe700 1 --2- 172.21.15.32:0/2231136569 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbbc0005230 0x7fbbc000ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:01.770 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.764+0000 7fbbd67fc700 1 -- 172.21.15.32:0/2231136569 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbbc0005230 msgr2=0x7fbbc000ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:10:01.770 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.764+0000 7fbbd67fc700 1 --2- 172.21.15.32:0/2231136569 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbbc0005230 0x7fbbc000ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:01.770 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.764+0000 7fbbd67fc700 1 -- 172.21.15.32:0/2231136569 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbbc0003bb0 msgr2=0x7fbbc0003fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:10:01.770 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.764+0000 7fbbd67fc700 1 --2- 172.21.15.32:0/2231136569 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbbc0003bb0 0x7fbbc0003fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:01.770 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.764+0000 7fbbd67fc700 1 -- 172.21.15.32:0/2231136569 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbc00035d0 con 0x7fbbc0004870 2023-10-08T06:10:01.770 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.764+0000 7fbbd77fe700 1 -- 172.21.15.32:0/2231136569 reap_dead start 2023-10-08T06:10:01.770 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.764+0000 7fbbd6ffd700 1 --2- 172.21.15.32:0/2231136569 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbbc0003bb0 0x7fbbc0003fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T06:10:01.770 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.764+0000 7fbbd67fc700 1 --2- 172.21.15.32:0/2231136569 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbbc0004870 0x7fbbc0004cf0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fbbc8007fd0 tx=0x7fbbc00058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=baa98ab1b6fdfa1d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:01.770 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.764+0000 7fbbd5ffb700 1 -- 172.21.15.32:0/2231136569 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbc800cd80 con 0x7fbbc0004870 2023-10-08T06:10:01.770 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.764+0000 7fbbd5ffb700 1 -- 172.21.15.32:0/2231136569 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbc8001af0 con 0x7fbbc0004870 2023-10-08T06:10:01.771 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.764+0000 7fbbd5ffb700 1 -- 172.21.15.32:0/2231136569 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbc8005bc0 con 0x7fbbc0004870 2023-10-08T06:10:01.771 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.768+0000 7fbbdd5c9700 1 -- 172.21.15.32:0/2231136569 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbbc0004870 msgr2=0x7fbbc0004cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:01.771 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.768+0000 7fbbdd5c9700 1 --2- 172.21.15.32:0/2231136569 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbbc0004870 0x7fbbc0004cf0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fbbc8007fd0 tx=0x7fbbc00058a0 comp rx=0 tx=0).stop 2023-10-08T06:10:01.771 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.768+0000 7fbbdd5c9700 1 -- 172.21.15.32:0/2231136569 shutdown_connections 2023-10-08T06:10:01.771 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.768+0000 7fbbdd5c9700 1 --2- 172.21.15.32:0/2231136569 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbbc0004870 0x7fbbc0004cf0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:01.771 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.768+0000 7fbbdd5c9700 1 -- 172.21.15.32:0/2231136569 >> 172.21.15.32:0/2231136569 conn(0x7fbbd80cfd30 msgr2=0x7fbbd80d0110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:10:01.771 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.768+0000 7fbbdd5c9700 1 -- 172.21.15.32:0/2231136569 shutdown_connections 2023-10-08T06:10:01.771 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.768+0000 7fbbdd5c9700 1 -- 172.21.15.32:0/2231136569 wait complete. 2023-10-08T06:10:01.773 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.768+0000 7fbbdd5c9700 1 Processor -- start 2023-10-08T06:10:01.773 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.768+0000 7fbbdd5c9700 1 -- start start 2023-10-08T06:10:01.773 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.768+0000 7fbbdd5c9700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbbc0004870 0x7fbbd814fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:01.773 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.768+0000 7fbbdd5c9700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbbd80a9f20 0x7fbbd815ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:01.773 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.768+0000 7fbbdd5c9700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbbd814d2e0 0x7fbbd814d770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:01.773 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.768+0000 7fbbdd5c9700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbd8150330 con 0x7fbbd814d2e0 2023-10-08T06:10:01.773 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.768+0000 7fbbdd5c9700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbd815f8a0 con 0x7fbbc0004870 2023-10-08T06:10:01.773 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.768+0000 7fbbdd5c9700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbd815fb80 con 0x7fbbd80a9f20 2023-10-08T06:10:01.774 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.768+0000 7fbbd77fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbbd814d2e0 0x7fbbd814d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:01.774 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.768+0000 7fbbd77fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbbd814d2e0 0x7fbbd814d770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:45150/0 (socket says 172.21.15.32:45150) 2023-10-08T06:10:01.774 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.768+0000 7fbbd67fc700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbbd80a9f20 0x7fbbd815ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:01.774 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.768+0000 7fbbd6ffd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbbc0004870 0x7fbbd814fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:01.774 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.768+0000 7fbbd77fe700 1 -- 172.21.15.32:0/1747085367 learned_addr learned my addr 172.21.15.32:0/1747085367 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:10:01.774 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.768+0000 7fbbd77fe700 1 -- 172.21.15.32:0/1747085367 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbbd80a9f20 msgr2=0x7fbbd815ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:01.774 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.768+0000 7fbbd77fe700 1 --2- 172.21.15.32:0/1747085367 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbbd80a9f20 0x7fbbd815ef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:01.774 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.768+0000 7fbbd77fe700 1 -- 172.21.15.32:0/1747085367 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbbc0004870 msgr2=0x7fbbd814fdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:01.774 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.768+0000 7fbbd77fe700 1 --2- 172.21.15.32:0/1747085367 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbbc0004870 0x7fbbd814fdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:01.774 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.768+0000 7fbbd77fe700 1 -- 172.21.15.32:0/1747085367 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbd815fe60 con 0x7fbbd814d2e0 2023-10-08T06:10:01.774 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.772+0000 7fbbd77fe700 1 --2- 172.21.15.32:0/1747085367 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbbd814d2e0 0x7fbbd814d770 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fbbd80ca310 tx=0x7fbbd000d430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:01.774 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.772+0000 7fbbbf7fe700 1 -- 172.21.15.32:0/1747085367 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbd0003c30 con 0x7fbbd814d2e0 2023-10-08T06:10:01.775 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.772+0000 7fbbbf7fe700 1 -- 172.21.15.32:0/1747085367 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbd0003d90 con 0x7fbbd814d2e0 2023-10-08T06:10:01.775 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.772+0000 7fbbdd5c9700 1 -- 172.21.15.32:0/1747085367 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbd8160140 con 0x7fbbd814d2e0 2023-10-08T06:10:01.775 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.772+0000 7fbbbf7fe700 1 -- 172.21.15.32:0/1747085367 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbd000dbd0 con 0x7fbbd814d2e0 2023-10-08T06:10:01.775 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.772+0000 7fbbdd5c9700 1 -- 172.21.15.32:0/1747085367 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbd815f490 con 0x7fbbd814d2e0 2023-10-08T06:10:01.776 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.772+0000 7fbbdd5c9700 1 -- 172.21.15.32:0/1747085367 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbd8160660 con 0x7fbbd814d2e0 2023-10-08T06:10:01.776 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.772+0000 7fbbbf7fe700 1 -- 172.21.15.32:0/1747085367 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fbbd000dd30 con 0x7fbbd814d2e0 2023-10-08T06:10:01.776 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.772+0000 7fbbbf7fe700 1 --2- 172.21.15.32:0/1747085367 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fbbc4066540 0x7fbbc4068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:01.776 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.776+0000 7fbbbf7fe700 1 -- 172.21.15.32:0/1747085367 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbbd0083ff0 con 0x7fbbd814d2e0 2023-10-08T06:10:01.776 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.776+0000 7fbbd6ffd700 1 --2- 172.21.15.32:0/1747085367 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fbbc4066540 0x7fbbc4068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:01.776 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.776+0000 7fbbd6ffd700 1 --2- 172.21.15.32:0/1747085367 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fbbc4066540 0x7fbbc4068a00 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fbbd80b4480 tx=0x7fbbcc008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:01.784 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.784+0000 7fbbbf7fe700 1 -- 172.21.15.32:0/1747085367 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fbbd8160660 con 0x7fbbd814d2e0 2023-10-08T06:10:01.948 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.948+0000 7fbbdd5c9700 1 -- 172.21.15.32:0/1747085367 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fbbd8160660 con 0x7fbbd814d2e0 2023-10-08T06:10:01.949 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.948+0000 7fbbbf7fe700 1 -- 172.21.15.32:0/1747085367 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7fbbd8160660 con 0x7fbbd814d2e0 2023-10-08T06:10:01.949 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 64 2023-10-08T06:10:01.952 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.948+0000 7fbbdd5c9700 1 -- 172.21.15.32:0/1747085367 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fbbc4066540 msgr2=0x7fbbc4068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:01.952 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.948+0000 7fbbdd5c9700 1 --2- 172.21.15.32:0/1747085367 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fbbc4066540 0x7fbbc4068a00 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fbbd80b4480 tx=0x7fbbcc008040 comp rx=0 tx=0).stop 2023-10-08T06:10:01.952 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.948+0000 7fbbdd5c9700 1 -- 172.21.15.32:0/1747085367 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbbd814d2e0 msgr2=0x7fbbd814d770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:01.952 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.948+0000 7fbbdd5c9700 1 --2- 172.21.15.32:0/1747085367 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbbd814d2e0 0x7fbbd814d770 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fbbd80ca310 tx=0x7fbbd000d430 comp rx=0 tx=0).stop 2023-10-08T06:10:01.952 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.948+0000 7fbbdd5c9700 1 -- 172.21.15.32:0/1747085367 shutdown_connections 2023-10-08T06:10:01.952 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.948+0000 7fbbdd5c9700 1 --2- 172.21.15.32:0/1747085367 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fbbc4066540 0x7fbbc4068a00 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:01.952 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.948+0000 7fbbdd5c9700 1 --2- 172.21.15.32:0/1747085367 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbbd814d2e0 0x7fbbd814d770 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:01.952 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.948+0000 7fbbdd5c9700 1 --2- 172.21.15.32:0/1747085367 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbbd80a9f20 0x7fbbd815ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:01.953 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.948+0000 7fbbdd5c9700 1 --2- 172.21.15.32:0/1747085367 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbbc0004870 0x7fbbd814fdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:01.953 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.948+0000 7fbbdd5c9700 1 -- 172.21.15.32:0/1747085367 >> 172.21.15.32:0/1747085367 conn(0x7fbbd80cfd30 msgr2=0x7fbbd80ccb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:10:01.953 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.948+0000 7fbbdd5c9700 1 -- 172.21.15.32:0/1747085367 shutdown_connections 2023-10-08T06:10:01.953 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:01.952+0000 7fbbdd5c9700 1 -- 172.21.15.32:0/1747085367 wait complete. 2023-10-08T06:10:01.964 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T06:10:02.077 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.076+0000 7fba6b59e700 1 Processor -- start 2023-10-08T06:10:02.077 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.076+0000 7fba6b59e700 1 -- start start 2023-10-08T06:10:02.078 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.076+0000 7fba6b59e700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fba6c0719e0 0x7fba6c0c9420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:02.078 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.076+0000 7fba6b59e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fba6c0c9960 0x7fba6c15bd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:02.078 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.076+0000 7fba6b59e700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba6c06fc20 con 0x7fba6c15b980 2023-10-08T06:10:02.078 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.076+0000 7fba6b59e700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba6c070430 con 0x7fba6c0719e0 2023-10-08T06:10:02.078 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.076+0000 7fba6b59e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba6c15ed70 con 0x7fba6c0c9960 2023-10-08T06:10:02.078 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.076+0000 7fba6a59c700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fba6c15b980 0x7fba6c15f780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:46852/0 (socket says 172.21.15.32:46852) 2023-10-08T06:10:02.078 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.076+0000 7fba6a59c700 1 -- 172.21.15.32:0/3492430294 learned_addr learned my addr 172.21.15.32:0/3492430294 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-08T06:10:02.078 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.076+0000 7fba69d9b700 1 --2- 172.21.15.32:0/3492430294 >> v2:172.21.15.40:3300/0 conn(0x7fba6c0719e0 0x7fba6c0c9420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:02.079 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.076+0000 7fba6ad9d700 1 --2- 172.21.15.32:0/3492430294 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fba6c0c9960 0x7fba6c15bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:02.080 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.076+0000 7fba6959a700 1 -- 172.21.15.32:0/3492430294 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3862503453 0 0) 0x7fba6c06fc20 con 0x7fba6c15b980 2023-10-08T06:10:02.080 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.076+0000 7fba6959a700 1 -- 172.21.15.32:0/3492430294 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fba580035d0 con 0x7fba6c15b980 2023-10-08T06:10:02.080 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.076+0000 7fba69d9b700 1 -- 172.21.15.32:0/3492430294 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fba6c0c9960 msgr2=0x7fba6c15bd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:10:02.080 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.076+0000 7fba69d9b700 1 --2- 172.21.15.32:0/3492430294 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fba6c0c9960 0x7fba6c15bd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:02.080 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.076+0000 7fba69d9b700 1 -- 172.21.15.32:0/3492430294 >> v1:172.21.15.32:6789/0 conn(0x7fba6c15b980 legacy=0x7fba6c15f780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:02.080 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.076+0000 7fba69d9b700 1 -- 172.21.15.32:0/3492430294 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba6c06fe70 con 0x7fba6c0719e0 2023-10-08T06:10:02.080 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.076+0000 7fba69d9b700 1 --2- 172.21.15.32:0/3492430294 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fba6c0719e0 0x7fba6c0c9420 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fba6c15eeb0 tx=0x7fba5400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=74b7af003ba7979d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:02.080 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.076+0000 7fba6959a700 1 -- 172.21.15.32:0/3492430294 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba54016070 con 0x7fba6c0719e0 2023-10-08T06:10:02.081 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.076+0000 7fba6959a700 1 -- 172.21.15.32:0/3492430294 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba5400bb20 con 0x7fba6c0719e0 2023-10-08T06:10:02.081 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.076+0000 7fba6959a700 1 -- 172.21.15.32:0/3492430294 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba5400e070 con 0x7fba6c0719e0 2023-10-08T06:10:02.081 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.080+0000 7fba6b59e700 1 -- 172.21.15.32:0/3492430294 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fba6c0719e0 msgr2=0x7fba6c0c9420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:02.081 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.080+0000 7fba6b59e700 1 --2- 172.21.15.32:0/3492430294 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fba6c0719e0 0x7fba6c0c9420 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fba6c15eeb0 tx=0x7fba5400b330 comp rx=0 tx=0).stop 2023-10-08T06:10:02.081 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.080+0000 7fba6b59e700 1 -- 172.21.15.32:0/3492430294 shutdown_connections 2023-10-08T06:10:02.081 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.080+0000 7fba6b59e700 1 --2- 172.21.15.32:0/3492430294 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fba6c0c9960 0x7fba6c15bd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:02.081 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.080+0000 7fba6b59e700 1 --2- 172.21.15.32:0/3492430294 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fba6c0719e0 0x7fba6c0c9420 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:02.081 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.080+0000 7fba6b59e700 1 -- 172.21.15.32:0/3492430294 >> 172.21.15.32:0/3492430294 conn(0x7fba6c0b0900 msgr2=0x7fba6c0b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:10:02.081 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.080+0000 7fba6b59e700 1 -- 172.21.15.32:0/3492430294 shutdown_connections 2023-10-08T06:10:02.081 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.080+0000 7fba6b59e700 1 -- 172.21.15.32:0/3492430294 wait complete. 2023-10-08T06:10:02.083 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.080+0000 7fba6b59e700 1 Processor -- start 2023-10-08T06:10:02.083 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.080+0000 7fba6b59e700 1 -- start start 2023-10-08T06:10:02.084 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.080+0000 7fba6b59e700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fba6c0719e0 0x7fba6c1f30f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:02.084 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.080+0000 7fba6b59e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fba6c0c9960 0x7fba6c0c6a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:02.084 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.080+0000 7fba6b59e700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fba6c15b980 0x7fba6c0c6fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:02.084 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.080+0000 7fba6b59e700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba6c0ac8f0 con 0x7fba6c0719e0 2023-10-08T06:10:02.084 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.080+0000 7fba6b59e700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba6c1f3630 con 0x7fba6c15b980 2023-10-08T06:10:02.084 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.080+0000 7fba6b59e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba6c0c80f0 con 0x7fba6c0c9960 2023-10-08T06:10:02.084 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.080+0000 7fba6a59c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fba6c0719e0 0x7fba6c1f30f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:02.084 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.080+0000 7fba6a59c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fba6c0719e0 0x7fba6c1f30f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:45166/0 (socket says 172.21.15.32:45166) 2023-10-08T06:10:02.084 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.080+0000 7fba6a59c700 1 -- 172.21.15.32:0/3271509832 learned_addr learned my addr 172.21.15.32:0/3271509832 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:10:02.084 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.080+0000 7fba69d9b700 1 --2- 172.21.15.32:0/3271509832 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fba6c0c9960 0x7fba6c0c6a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:02.085 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.080+0000 7fba6ad9d700 1 --2- 172.21.15.32:0/3271509832 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fba6c15b980 0x7fba6c0c6fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:02.085 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.080+0000 7fba6a59c700 1 -- 172.21.15.32:0/3271509832 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fba6c0c9960 msgr2=0x7fba6c0c6a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:02.085 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.080+0000 7fba6a59c700 1 --2- 172.21.15.32:0/3271509832 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fba6c0c9960 0x7fba6c0c6a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:02.085 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.080+0000 7fba6a59c700 1 -- 172.21.15.32:0/3271509832 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fba6c15b980 msgr2=0x7fba6c0c6fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:02.085 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.080+0000 7fba6a59c700 1 --2- 172.21.15.32:0/3271509832 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fba6c15b980 0x7fba6c0c6fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:02.085 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.080+0000 7fba6a59c700 1 -- 172.21.15.32:0/3271509832 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba54009a70 con 0x7fba6c0719e0 2023-10-08T06:10:02.085 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.080+0000 7fba6a59c700 1 --2- 172.21.15.32:0/3271509832 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fba6c0719e0 0x7fba6c1f30f0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fba5c00c500 tx=0x7fba5c00c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:02.085 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.080+0000 7fba62ffd700 1 -- 172.21.15.32:0/3271509832 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba5c005d90 con 0x7fba6c0719e0 2023-10-08T06:10:02.085 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.080+0000 7fba62ffd700 1 -- 172.21.15.32:0/3271509832 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba5c00ce10 con 0x7fba6c0719e0 2023-10-08T06:10:02.085 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.080+0000 7fba6b59e700 1 -- 172.21.15.32:0/3271509832 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba6c0c7850 con 0x7fba6c0719e0 2023-10-08T06:10:02.085 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.080+0000 7fba62ffd700 1 -- 172.21.15.32:0/3271509832 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba5c0072d0 con 0x7fba6c0719e0 2023-10-08T06:10:02.086 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.084+0000 7fba6b59e700 1 -- 172.21.15.32:0/3271509832 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba6c0c7e10 con 0x7fba6c0719e0 2023-10-08T06:10:02.086 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.084+0000 7fba6b59e700 1 -- 172.21.15.32:0/3271509832 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba6c073f00 con 0x7fba6c0719e0 2023-10-08T06:10:02.086 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.084+0000 7fba62ffd700 1 -- 172.21.15.32:0/3271509832 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fba5c007430 con 0x7fba6c0719e0 2023-10-08T06:10:02.087 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.084+0000 7fba62ffd700 1 --2- 172.21.15.32:0/3271509832 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fba4c066510 0x7fba4c0689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:02.087 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.084+0000 7fba62ffd700 1 -- 172.21.15.32:0/3271509832 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fba5c083050 con 0x7fba6c0719e0 2023-10-08T06:10:02.087 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.084+0000 7fba69d9b700 1 --2- 172.21.15.32:0/3271509832 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fba4c066510 0x7fba4c0689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:02.087 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.088+0000 7fba69d9b700 1 --2- 172.21.15.32:0/3271509832 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fba4c066510 0x7fba4c0689d0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fba54000f80 tx=0x7fba54011000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:02.097 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.096+0000 7fba62ffd700 1 -- 172.21.15.32:0/3271509832 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fba5c050500 con 0x7fba6c0719e0 2023-10-08T06:10:02.262 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.260+0000 7fba6b59e700 1 -- 172.21.15.32:0/3271509832 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fba6c0cc690 con 0x7fba6c0719e0 2023-10-08T06:10:02.294 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.264+0000 7fba62ffd700 1 -- 172.21.15.32:0/3271509832 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16445 (secure 0 0 0) 0x7fba5c053b20 con 0x7fba6c0719e0 2023-10-08T06:10:02.294 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:10:02.294 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":22,"fsid":"ac672d87-96ae-41e0-9314-623ba2cdbbba","created":"2023-10-08T06:09:11.175626+0000","modified":"2023-10-08T06:09:38.153256+0000","last_up_change":"2023-10-08T06:09:22.744643+0000","last_in_change":"2023-10-08T06:09:14.131580+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T06:09:23.307843+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T06:09:34.295012+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T06:09:35.515590+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"43433f0c-9592-4874-92d7-10f8f4acf07f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":587888964},{"type":"v1","addr":"172.21.15.32:6801","nonce":587888964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":587888964},{"type":"v1","addr":"172.21.15.32:6803","nonce":587888964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":587888964},{"type":"v1","addr":"172.21.15.32:6810","nonce":587888964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6805","nonce":587888964},{"type":"v1","addr":"172.21.15.32:6807","nonce":587888964}]},"public_addr":"172.21.15.32:6801/587888964","cluster_addr":"172.21.15.32:6803/587888964","heartbeat_back_addr":"172.21.15.32:6810/587888964","heartbeat_front_addr":"172.21.15.32:6807/587888964","state":["exists","up"]},{"osd":1,"uuid":"2ecb1008-b987-4ce7-b646-6cded55fc8d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":990576767},{"type":"v1","addr":"172.21.15.32:6817","nonce":990576767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":990576767},{"type":"v1","addr":"172.21.15.32:6819","nonce":990576767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":990576767},{"type":"v1","addr":"172.21.15.32:6823","nonce":990576767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":990576767},{"type":"v1","addr":"172.21.15.32:6821","nonce":990576767}]},"public_addr":"172.21.15.32:6817/990576767","cluster_addr":"172.21.15.32:6819/990576767","heartbeat_back_addr":"172.21.15.32:6823/990576767","heartbeat_front_addr":"172.21.15.32:6821/990576767","state":["exists","up"]},{"osd":2,"uuid":"1b131c94-c09b-4e80-8746-bf1b7bac362d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6824","nonce":1566874440},{"type":"v1","addr":"172.21.15.32:6825","nonce":1566874440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":1566874440},{"type":"v1","addr":"172.21.15.32:6827","nonce":1566874440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":1566874440},{"type":"v1","addr":"172.21.15.32:6831","nonce":1566874440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":1566874440},{"type":"v1","addr":"172.21.15.32:6829","nonce":1566874440}]},"public_addr":"172.21.15.32:6825/1566874440","cluster_addr":"172.21.15.32:6827/1566874440","heartbeat_back_addr":"172.21.15.32:6831/1566874440","heartbeat_front_addr":"172.21.15.32:6829/1566874440","state":["exists","up"]},{"osd":3,"uuid":"ad655af2-1f6f-4689-b21d-b07bbaeb68b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":3672614802},{"type":"v1","addr":"172.21.15.32:6806","nonce":3672614802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6809","nonce":3672614802},{"type":"v1","addr":"172.21.15.32:6811","nonce":3672614802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":3672614802},{"type":"v1","addr":"172.21.15.32:6815","nonce":3672614802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":3672614802},{"type":"v1","addr":"172.21.15.32:6813","nonce":3672614802}]},"public_addr":"172.21.15.32:6806/3672614802","cluster_addr":"172.21.15.32:6811/3672614802","heartbeat_back_addr":"172.21.15.32:6815/3672614802","heartbeat_front_addr":"172.21.15.32:6813/3672614802","state":["exists","up"]},{"osd":4,"uuid":"64a543a1-8c4f-458e-9aba-b35c1cd7dd03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":3369928244},{"type":"v1","addr":"172.21.15.40:6801","nonce":3369928244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":3369928244},{"type":"v1","addr":"172.21.15.40:6803","nonce":3369928244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":3369928244},{"type":"v1","addr":"172.21.15.40:6807","nonce":3369928244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":3369928244},{"type":"v1","addr":"172.21.15.40:6805","nonce":3369928244}]},"public_addr":"172.21.15.40:6801/3369928244","cluster_addr":"172.21.15.40:6803/3369928244","heartbeat_back_addr":"172.21.15.40:6807/3369928244","heartbeat_front_addr":"172.21.15.40:6805/3369928244","state":["exists","up"]},{"osd":5,"uuid":"0fef3e54-edb4-4678-878e-944663c51638","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":2395850297},{"type":"v1","addr":"172.21.15.40:6825","nonce":2395850297}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":2395850297},{"type":"v1","addr":"172.21.15.40:6827","nonce":2395850297}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":2395850297},{"type":"v1","addr":"172.21.15.40:6831","nonce":2395850297}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":2395850297},{"type":"v1","addr":"172.21.15.40:6829","nonce":2395850297}]},"public_addr":"172.21.15.40:6825/2395850297","cluster_addr":"172.21.15.40:6827/2395850297","heartbeat_back_addr":"172.21.15.40:6831/2395850297","heartbeat_front_addr":"172.21.15.40:6829/2395850297","state":["exists","up"]},{"osd":6,"uuid":"2eeb0472-6096-469d-9b2c-cab4bf41c31a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":4145283410},{"type":"v1","addr":"172.21.15.40:6809","nonce":4145283410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":4145283410},{"type":"v1","addr":"172.21.15.40:6811","nonce":4145283410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":4145283410},{"type":"v1","addr":"172.21.15.40:6815","nonce":4145283410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":4145283410},{"type":"v1","addr":"172.21.15.40:6813","nonce":4145283410}]},"public_addr":"172.21.15.40:6809/4145283410","cluster_addr":"172.21.15.40:6811/4145283410","heartbeat_back_addr":"172.21.15.40:6815/4145283410","heartbeat_front_addr":"172.21.15.40:6813/4145283410","state":["exists","up"]},{"osd":7,"uuid":"cf76e4c7-96a6-401f-a280-91aad4641940","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":2943297416},{"type":"v1","addr":"172.21.15.40:6817","nonce":2943297416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":2943297416},{"type":"v1","addr":"172.21.15.40:6819","nonce":2943297416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":2943297416},{"type":"v1","addr":"172.21.15.40:6823","nonce":2943297416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":2943297416},{"type":"v1","addr":"172.21.15.40:6821","nonce":2943297416}]},"public_addr":"172.21.15.40:6817/2943297416","cluster_addr":"172.21.15.40:6819/2943297416","heartbeat_back_addr":"172.21.15.40:6823/2943297416","heartbeat_front_addr":"172.21.15.40:6821/2943297416","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.411475+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.628841+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.599055+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.166100+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.384135+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.488403+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.307648+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.363541+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T06:10:02.296 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.268+0000 7fba6b59e700 1 -- 172.21.15.32:0/3271509832 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fba4c066510 msgr2=0x7fba4c0689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:02.296 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.268+0000 7fba6b59e700 1 --2- 172.21.15.32:0/3271509832 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fba4c066510 0x7fba4c0689d0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fba54000f80 tx=0x7fba54011000 comp rx=0 tx=0).stop 2023-10-08T06:10:02.296 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.268+0000 7fba6b59e700 1 -- 172.21.15.32:0/3271509832 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fba6c0719e0 msgr2=0x7fba6c1f30f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:02.296 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.268+0000 7fba6b59e700 1 --2- 172.21.15.32:0/3271509832 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fba6c0719e0 0x7fba6c1f30f0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fba5c00c500 tx=0x7fba5c00c810 comp rx=0 tx=0).stop 2023-10-08T06:10:02.296 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.268+0000 7fba6b59e700 1 -- 172.21.15.32:0/3271509832 shutdown_connections 2023-10-08T06:10:02.296 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.268+0000 7fba6b59e700 1 --2- 172.21.15.32:0/3271509832 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fba4c066510 0x7fba4c0689d0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:02.296 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.268+0000 7fba6b59e700 1 --2- 172.21.15.32:0/3271509832 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fba6c15b980 0x7fba6c0c6fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:02.296 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.268+0000 7fba6b59e700 1 --2- 172.21.15.32:0/3271509832 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fba6c0c9960 0x7fba6c0c6a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:02.296 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.268+0000 7fba6b59e700 1 --2- 172.21.15.32:0/3271509832 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fba6c0719e0 0x7fba6c1f30f0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:02.297 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.268+0000 7fba6b59e700 1 -- 172.21.15.32:0/3271509832 >> 172.21.15.32:0/3271509832 conn(0x7fba6c0b0900 msgr2=0x7fba6c15df30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:10:02.297 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.268+0000 7fba6b59e700 1 -- 172.21.15.32:0/3271509832 shutdown_connections 2023-10-08T06:10:02.297 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.268+0000 7fba6b59e700 1 -- 172.21.15.32:0/3271509832 wait complete. 2023-10-08T06:10:02.297 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T06:09:23.307843+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-08T06:09:34.295012+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-08T06:09:35.515590+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-08T06:10:02.298 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T06:10:02.422 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.420+0000 7f35cdf62700 1 Processor -- start 2023-10-08T06:10:02.422 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.420+0000 7f35cdf62700 1 -- start start 2023-10-08T06:10:02.423 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.420+0000 7f35cdf62700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f35c815d490 0x7f35c80b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:02.423 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.420+0000 7f35cdf62700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35c80d1bb0 con 0x7f35c80d13d0 2023-10-08T06:10:02.423 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.420+0000 7f35cdf62700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35c80d1e90 con 0x7f35c80ce4e0 2023-10-08T06:10:02.423 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.420+0000 7f35cdf62700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35c80d2170 con 0x7f35c815d490 2023-10-08T06:10:02.423 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.420+0000 7f35ccf60700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f35c815d490 0x7f35c80b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:02.423 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.420+0000 7f35ccf60700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f35c815d490 0x7f35c80b8bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:45180/0 (socket says 172.21.15.32:45180) 2023-10-08T06:10:02.424 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.420+0000 7f35ccf60700 1 -- 172.21.15.32:0/4203494214 learned_addr learned my addr 172.21.15.32:0/4203494214 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:10:02.425 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.424+0000 7f35ccf60700 1 -- 172.21.15.32:0/4203494214 >> v1:172.21.15.40:6789/0 conn(0x7f35c80ce4e0 legacy=0x7f35c80b6130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:02.425 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.424+0000 7f35ccf60700 1 -- 172.21.15.32:0/4203494214 >> v1:172.21.15.32:6789/0 conn(0x7f35c80d13d0 legacy=0x7f35c80cddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:02.425 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.424+0000 7f35ccf60700 1 -- 172.21.15.32:0/4203494214 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35c80d2450 con 0x7f35c815d490 2023-10-08T06:10:02.425 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.424+0000 7f35ccf60700 1 --2- 172.21.15.32:0/4203494214 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f35c815d490 0x7f35c80b8bc0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f35b8009e50 tx=0x7f35b800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6708e6df56bbe0e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:02.425 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.424+0000 7f35c77fe700 1 -- 172.21.15.32:0/4203494214 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35b800e070 con 0x7f35c815d490 2023-10-08T06:10:02.425 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.424+0000 7f35c77fe700 1 -- 172.21.15.32:0/4203494214 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35b800b9c0 con 0x7f35c815d490 2023-10-08T06:10:02.425 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.424+0000 7f35c77fe700 1 -- 172.21.15.32:0/4203494214 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35b800bd70 con 0x7f35c815d490 2023-10-08T06:10:02.425 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.424+0000 7f35cdf62700 1 -- 172.21.15.32:0/4203494214 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f35c815d490 msgr2=0x7f35c80b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:02.425 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.424+0000 7f35cdf62700 1 --2- 172.21.15.32:0/4203494214 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f35c815d490 0x7f35c80b8bc0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f35b8009e50 tx=0x7f35b800b330 comp rx=0 tx=0).stop 2023-10-08T06:10:02.426 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.424+0000 7f35cdf62700 1 -- 172.21.15.32:0/4203494214 shutdown_connections 2023-10-08T06:10:02.426 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.424+0000 7f35cdf62700 1 --2- 172.21.15.32:0/4203494214 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f35c815d490 0x7f35c80b8bc0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:02.426 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.424+0000 7f35cdf62700 1 -- 172.21.15.32:0/4203494214 >> 172.21.15.32:0/4203494214 conn(0x7f35c806ab40 msgr2=0x7f35c806af20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:10:02.426 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.424+0000 7f35cdf62700 1 -- 172.21.15.32:0/4203494214 shutdown_connections 2023-10-08T06:10:02.426 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.424+0000 7f35cdf62700 1 -- 172.21.15.32:0/4203494214 wait complete. 2023-10-08T06:10:02.426 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.424+0000 7f35cdf62700 1 Processor -- start 2023-10-08T06:10:02.426 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.424+0000 7f35cdf62700 1 -- start start 2023-10-08T06:10:02.428 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.424+0000 7f35cdf62700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f35c80ce4e0 0x7f35c814a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:02.428 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.424+0000 7f35cdf62700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f35c80d13d0 0x7f35c814c140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:02.428 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.424+0000 7f35cdf62700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f35c815d490 0x7f35c814c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:02.428 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.424+0000 7f35cdf62700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35c814d530 con 0x7f35c815d490 2023-10-08T06:10:02.428 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.424+0000 7f35cdf62700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35c814cc90 con 0x7f35c80d13d0 2023-10-08T06:10:02.428 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.424+0000 7f35cdf62700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35c814cf70 con 0x7f35c80ce4e0 2023-10-08T06:10:02.429 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.424+0000 7f35cd761700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f35c815d490 0x7f35c814c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:02.429 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.424+0000 7f35cd761700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f35c815d490 0x7f35c814c680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:45186/0 (socket says 172.21.15.32:45186) 2023-10-08T06:10:02.429 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.424+0000 7f35cd761700 1 -- 172.21.15.32:0/3490070446 learned_addr learned my addr 172.21.15.32:0/3490070446 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:10:02.429 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.428+0000 7f35ccf60700 1 --2- 172.21.15.32:0/3490070446 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f35c80ce4e0 0x7f35c814a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:02.429 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.428+0000 7f35c7fff700 1 --2- 172.21.15.32:0/3490070446 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f35c80d13d0 0x7f35c814c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:02.429 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.428+0000 7f35cd761700 1 -- 172.21.15.32:0/3490070446 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f35c80ce4e0 msgr2=0x7f35c814a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:02.429 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.428+0000 7f35cd761700 1 --2- 172.21.15.32:0/3490070446 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f35c80ce4e0 0x7f35c814a630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:02.429 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.428+0000 7f35cd761700 1 -- 172.21.15.32:0/3490070446 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f35c80d13d0 msgr2=0x7f35c814c140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:02.429 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.428+0000 7f35cd761700 1 --2- 172.21.15.32:0/3490070446 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f35c80d13d0 0x7f35c814c140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:02.429 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.428+0000 7f35cd761700 1 -- 172.21.15.32:0/3490070446 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35b8009b30 con 0x7f35c815d490 2023-10-08T06:10:02.429 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.428+0000 7f35cd761700 1 --2- 172.21.15.32:0/3490070446 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f35c815d490 0x7f35c814c680 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f35c000c400 tx=0x7f35c000c710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:02.430 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.428+0000 7f35c57fa700 1 -- 172.21.15.32:0/3490070446 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35c00052d0 con 0x7f35c815d490 2023-10-08T06:10:02.430 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.428+0000 7f35c57fa700 1 -- 172.21.15.32:0/3490070446 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35c0005430 con 0x7f35c815d490 2023-10-08T06:10:02.430 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.428+0000 7f35cdf62700 1 -- 172.21.15.32:0/3490070446 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35c814d250 con 0x7f35c815d490 2023-10-08T06:10:02.430 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.428+0000 7f35c57fa700 1 -- 172.21.15.32:0/3490070446 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35c00055a0 con 0x7f35c815d490 2023-10-08T06:10:02.431 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.428+0000 7f35cdf62700 1 -- 172.21.15.32:0/3490070446 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35c814ab70 con 0x7f35c815d490 2023-10-08T06:10:02.431 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.428+0000 7f35cdf62700 1 -- 172.21.15.32:0/3490070446 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35c814ea90 con 0x7f35c815d490 2023-10-08T06:10:02.431 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.428+0000 7f35c57fa700 1 -- 172.21.15.32:0/3490070446 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f35c00038e0 con 0x7f35c815d490 2023-10-08T06:10:02.433 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.432+0000 7f35c57fa700 1 --2- 172.21.15.32:0/3490070446 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f35b4066510 0x7f35b40689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:02.433 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.432+0000 7f35ccf60700 1 --2- 172.21.15.32:0/3490070446 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f35b4066510 0x7f35b40689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:02.433 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.432+0000 7f35c57fa700 1 -- 172.21.15.32:0/3490070446 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f35c0083160 con 0x7f35c815d490 2023-10-08T06:10:02.433 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.432+0000 7f35ccf60700 1 --2- 172.21.15.32:0/3490070446 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f35b4066510 0x7f35b40689d0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f35b800b370 tx=0x7f35b8009000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:02.440 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.440+0000 7f35c57fa700 1 -- 172.21.15.32:0/3490070446 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f35c814ea90 con 0x7f35c815d490 2023-10-08T06:10:02.602 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.600+0000 7f35cdf62700 1 -- 172.21.15.32:0/3490070446 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f35c814ea90 con 0x7f35c815d490 2023-10-08T06:10:02.603 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.600+0000 7f35c57fa700 1 -- 172.21.15.32:0/3490070446 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7f35c814ea90 con 0x7f35c815d490 2023-10-08T06:10:02.603 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 1 2023-10-08T06:10:02.605 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.604+0000 7f35cdf62700 1 -- 172.21.15.32:0/3490070446 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f35b4066510 msgr2=0x7f35b40689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:02.605 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.604+0000 7f35cdf62700 1 --2- 172.21.15.32:0/3490070446 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f35b4066510 0x7f35b40689d0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f35b800b370 tx=0x7f35b8009000 comp rx=0 tx=0).stop 2023-10-08T06:10:02.605 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.604+0000 7f35cdf62700 1 -- 172.21.15.32:0/3490070446 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f35c815d490 msgr2=0x7f35c814c680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:02.605 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.604+0000 7f35cdf62700 1 --2- 172.21.15.32:0/3490070446 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f35c815d490 0x7f35c814c680 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f35c000c400 tx=0x7f35c000c710 comp rx=0 tx=0).stop 2023-10-08T06:10:02.605 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.604+0000 7f35cdf62700 1 -- 172.21.15.32:0/3490070446 shutdown_connections 2023-10-08T06:10:02.606 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.604+0000 7f35cdf62700 1 --2- 172.21.15.32:0/3490070446 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f35b4066510 0x7f35b40689d0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:02.606 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.604+0000 7f35cdf62700 1 --2- 172.21.15.32:0/3490070446 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f35c815d490 0x7f35c814c680 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:02.606 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.604+0000 7f35cdf62700 1 --2- 172.21.15.32:0/3490070446 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f35c80d13d0 0x7f35c814c140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:02.606 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.604+0000 7f35cdf62700 1 --2- 172.21.15.32:0/3490070446 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f35c80ce4e0 0x7f35c814a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:02.606 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.604+0000 7f35cdf62700 1 -- 172.21.15.32:0/3490070446 >> 172.21.15.32:0/3490070446 conn(0x7f35c806ab40 msgr2=0x7f35c815bb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:10:02.606 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.604+0000 7f35cdf62700 1 -- 172.21.15.32:0/3490070446 shutdown_connections 2023-10-08T06:10:02.606 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.604+0000 7f35cdf62700 1 -- 172.21.15.32:0/3490070446 wait complete. 2023-10-08T06:10:02.617 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-08T06:10:02.736 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.736+0000 7fe7e71ab700 1 Processor -- start 2023-10-08T06:10:02.736 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.736+0000 7fe7e71ab700 1 -- start start 2023-10-08T06:10:02.738 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.736+0000 7fe7e71ab700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe7d8006b10 0x7fe7d8006ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:02.738 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.736+0000 7fe7e71ab700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fe7d8050630 0x7fe7d80e3a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:02.738 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.736+0000 7fe7e71ab700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe7d80e3f80 0x7fe7d80546b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:02.738 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.736+0000 7fe7e71ab700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7d8053980 con 0x7fe7d8050630 2023-10-08T06:10:02.738 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.736+0000 7fe7e71ab700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7d8007430 con 0x7fe7d8006b10 2023-10-08T06:10:02.738 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.736+0000 7fe7e71ab700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7d80e47b0 con 0x7fe7d80e3f80 2023-10-08T06:10:02.738 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.736+0000 7fe7e59a8700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fe7d8050630 0x7fe7d80e3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:02.739 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.736+0000 7fe7e59a8700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fe7d8050630 0x7fe7d80e3a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:45190/0 (socket says 172.21.15.32:45190) 2023-10-08T06:10:02.739 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.736+0000 7fe7e59a8700 1 -- 172.21.15.32:0/2504458762 learned_addr learned my addr 172.21.15.32:0/2504458762 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:10:02.739 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.736+0000 7fe7e69aa700 1 --2- 172.21.15.32:0/2504458762 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe7d80e3f80 0x7fe7d80546b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:02.739 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.736+0000 7fe7e61a9700 1 --2- 172.21.15.32:0/2504458762 >> v2:172.21.15.40:3300/0 conn(0x7fe7d8006b10 0x7fe7d8006ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:02.740 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.736+0000 7fe7e59a8700 1 -- 172.21.15.32:0/2504458762 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe7d80e3f80 msgr2=0x7fe7d80546b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:10:02.740 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.736+0000 7fe7e59a8700 1 --2- 172.21.15.32:0/2504458762 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe7d80e3f80 0x7fe7d80546b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:02.740 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.736+0000 7fe7e59a8700 1 -- 172.21.15.32:0/2504458762 >> v2:172.21.15.40:3300/0 conn(0x7fe7d8006b10 msgr2=0x7fe7d8006ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:10:02.740 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.736+0000 7fe7e59a8700 1 --2- 172.21.15.32:0/2504458762 >> v2:172.21.15.40:3300/0 conn(0x7fe7d8006b10 0x7fe7d8006ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:02.740 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.736+0000 7fe7e59a8700 1 -- 172.21.15.32:0/2504458762 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7d8053bd0 con 0x7fe7d8050630 2023-10-08T06:10:02.740 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.736+0000 7fe7e61a9700 1 --2- 172.21.15.32:0/2504458762 >> v2:172.21.15.40:3300/0 conn(0x7fe7d8006b10 0x7fe7d8006ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T06:10:02.741 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.736+0000 7fe7e59a8700 1 --2- 172.21.15.32:0/2504458762 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe7d8050630 0x7fe7d80e3a40 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fe7d800e850 tx=0x7fe7d4009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd484455b1df98cd server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:02.741 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.736+0000 7fe7e51a7700 1 -- 172.21.15.32:0/2504458762 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7d4011830 con 0x7fe7d8050630 2023-10-08T06:10:02.741 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.736+0000 7fe7e51a7700 1 -- 172.21.15.32:0/2504458762 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7d4011990 con 0x7fe7d8050630 2023-10-08T06:10:02.741 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.736+0000 7fe7e51a7700 1 -- 172.21.15.32:0/2504458762 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7d4011d20 con 0x7fe7d8050630 2023-10-08T06:10:02.741 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.740+0000 7fe7e71ab700 1 -- 172.21.15.32:0/2504458762 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe7d8050630 msgr2=0x7fe7d80e3a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:02.741 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.740+0000 7fe7e71ab700 1 --2- 172.21.15.32:0/2504458762 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe7d8050630 0x7fe7d80e3a40 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fe7d800e850 tx=0x7fe7d4009bf0 comp rx=0 tx=0).stop 2023-10-08T06:10:02.741 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.740+0000 7fe7e71ab700 1 -- 172.21.15.32:0/2504458762 shutdown_connections 2023-10-08T06:10:02.741 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.740+0000 7fe7e71ab700 1 --2- 172.21.15.32:0/2504458762 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe7d8050630 0x7fe7d80e3a40 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:02.741 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.740+0000 7fe7e71ab700 1 --2- 172.21.15.32:0/2504458762 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe7d80e3f80 0x7fe7d80546b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:02.741 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.740+0000 7fe7e71ab700 1 --2- 172.21.15.32:0/2504458762 >> v2:172.21.15.40:3300/0 conn(0x7fe7d8006b10 0x7fe7d8006ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:02.741 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.740+0000 7fe7e71ab700 1 -- 172.21.15.32:0/2504458762 >> 172.21.15.32:0/2504458762 conn(0x7fe7d8055db0 msgr2=0x7fe7d80561c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:10:02.741 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.740+0000 7fe7e71ab700 1 -- 172.21.15.32:0/2504458762 shutdown_connections 2023-10-08T06:10:02.742 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.740+0000 7fe7e71ab700 1 -- 172.21.15.32:0/2504458762 wait complete. 2023-10-08T06:10:02.743 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.740+0000 7fe7e71ab700 1 Processor -- start 2023-10-08T06:10:02.743 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.740+0000 7fe7e71ab700 1 -- start start 2023-10-08T06:10:02.744 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.740+0000 7fe7e71ab700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe7d8006b10 0x7fe7d80d7bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:02.744 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.740+0000 7fe7e71ab700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe7d8050630 0x7fe7d8036050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:02.744 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.740+0000 7fe7e71ab700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe7d80e3f80 0x7fe7d817d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:02.744 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.740+0000 7fe7e71ab700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7d80e01e0 con 0x7fe7d8006b10 2023-10-08T06:10:02.744 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.740+0000 7fe7e71ab700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7d80369c0 con 0x7fe7d80e3f80 2023-10-08T06:10:02.744 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.740+0000 7fe7e71ab700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7d8036ca0 con 0x7fe7d8050630 2023-10-08T06:10:02.744 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.740+0000 7fe7e61a9700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe7d8006b10 0x7fe7d80d7bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:02.744 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.740+0000 7fe7e61a9700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe7d8006b10 0x7fe7d80d7bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:45196/0 (socket says 172.21.15.32:45196) 2023-10-08T06:10:02.744 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.740+0000 7fe7e61a9700 1 -- 172.21.15.32:0/1016888266 learned_addr learned my addr 172.21.15.32:0/1016888266 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:10:02.744 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.740+0000 7fe7e59a8700 1 --2- 172.21.15.32:0/1016888266 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe7d8050630 0x7fe7d8036050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:02.744 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.740+0000 7fe7e69aa700 1 --2- 172.21.15.32:0/1016888266 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe7d80e3f80 0x7fe7d817d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:02.745 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.740+0000 7fe7e61a9700 1 -- 172.21.15.32:0/1016888266 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe7d8050630 msgr2=0x7fe7d8036050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:02.745 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.740+0000 7fe7e61a9700 1 --2- 172.21.15.32:0/1016888266 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe7d8050630 0x7fe7d8036050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:02.745 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.740+0000 7fe7e61a9700 1 -- 172.21.15.32:0/1016888266 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe7d80e3f80 msgr2=0x7fe7d817d410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:02.745 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.740+0000 7fe7e61a9700 1 --2- 172.21.15.32:0/1016888266 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe7d80e3f80 0x7fe7d817d410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:02.745 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.740+0000 7fe7e61a9700 1 -- 172.21.15.32:0/1016888266 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7d4009570 con 0x7fe7d8006b10 2023-10-08T06:10:02.745 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.740+0000 7fe7e61a9700 1 --2- 172.21.15.32:0/1016888266 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe7d8006b10 0x7fe7d80d7bf0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fe7dc00d800 tx=0x7fe7dc00dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:02.745 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.740+0000 7fe7d2ffd700 1 -- 172.21.15.32:0/1016888266 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7dc004030 con 0x7fe7d8006b10 2023-10-08T06:10:02.745 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.744+0000 7fe7d2ffd700 1 -- 172.21.15.32:0/1016888266 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7dc004190 con 0x7fe7d8006b10 2023-10-08T06:10:02.745 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.744+0000 7fe7e71ab700 1 -- 172.21.15.32:0/1016888266 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7d8036f80 con 0x7fe7d8006b10 2023-10-08T06:10:02.745 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.744+0000 7fe7d2ffd700 1 -- 172.21.15.32:0/1016888266 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7dc004540 con 0x7fe7d8006b10 2023-10-08T06:10:02.745 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.744+0000 7fe7e71ab700 1 -- 172.21.15.32:0/1016888266 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7d8037540 con 0x7fe7d8006b10 2023-10-08T06:10:02.746 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.744+0000 7fe7e71ab700 1 -- 172.21.15.32:0/1016888266 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7d8007df0 con 0x7fe7d8006b10 2023-10-08T06:10:02.746 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.744+0000 7fe7d2ffd700 1 -- 172.21.15.32:0/1016888266 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fe7dc0036c0 con 0x7fe7d8006b10 2023-10-08T06:10:02.746 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.744+0000 7fe7d2ffd700 1 --2- 172.21.15.32:0/1016888266 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fe7c4066540 0x7fe7c4068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:02.747 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.744+0000 7fe7d2ffd700 1 -- 172.21.15.32:0/1016888266 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe7dc084380 con 0x7fe7d8006b10 2023-10-08T06:10:02.747 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.744+0000 7fe7e59a8700 1 --2- 172.21.15.32:0/1016888266 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fe7c4066540 0x7fe7c4068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:02.747 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.748+0000 7fe7e59a8700 1 --2- 172.21.15.32:0/1016888266 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fe7c4066540 0x7fe7c4068a00 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fe7d4000c00 tx=0x7fe7d4008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:02.754 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.752+0000 7fe7d2ffd700 1 -- 172.21.15.32:0/1016888266 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fe7dc051800 con 0x7fe7d8006b10 2023-10-08T06:10:02.922 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.920+0000 7fe7e71ab700 1 -- 172.21.15.32:0/1016888266 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe7d80058c0 con 0x7fe7d8006b10 2023-10-08T06:10:02.923 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.920+0000 7fe7d2ffd700 1 -- 172.21.15.32:0/1016888266 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe7dc0094c0 con 0x7fe7d8006b10 2023-10-08T06:10:02.923 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 32 2023-10-08T06:10:02.925 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.924+0000 7fe7e71ab700 1 -- 172.21.15.32:0/1016888266 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fe7c4066540 msgr2=0x7fe7c4068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:02.925 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.924+0000 7fe7e71ab700 1 --2- 172.21.15.32:0/1016888266 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fe7c4066540 0x7fe7c4068a00 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fe7d4000c00 tx=0x7fe7d4008030 comp rx=0 tx=0).stop 2023-10-08T06:10:02.926 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.924+0000 7fe7e71ab700 1 -- 172.21.15.32:0/1016888266 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe7d8006b10 msgr2=0x7fe7d80d7bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:02.926 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.924+0000 7fe7e71ab700 1 --2- 172.21.15.32:0/1016888266 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe7d8006b10 0x7fe7d80d7bf0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fe7dc00d800 tx=0x7fe7dc00dbc0 comp rx=0 tx=0).stop 2023-10-08T06:10:02.926 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.924+0000 7fe7e71ab700 1 -- 172.21.15.32:0/1016888266 shutdown_connections 2023-10-08T06:10:02.926 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.924+0000 7fe7e71ab700 1 --2- 172.21.15.32:0/1016888266 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fe7c4066540 0x7fe7c4068a00 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:02.926 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.924+0000 7fe7e71ab700 1 --2- 172.21.15.32:0/1016888266 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe7d80e3f80 0x7fe7d817d410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:02.926 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.924+0000 7fe7e71ab700 1 --2- 172.21.15.32:0/1016888266 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe7d8050630 0x7fe7d8036050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:02.926 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.924+0000 7fe7e71ab700 1 --2- 172.21.15.32:0/1016888266 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe7d8006b10 0x7fe7d80d7bf0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:02.926 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.924+0000 7fe7e71ab700 1 -- 172.21.15.32:0/1016888266 >> 172.21.15.32:0/1016888266 conn(0x7fe7d8055db0 msgr2=0x7fe7d80e6790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:10:02.926 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.924+0000 7fe7e71ab700 1 -- 172.21.15.32:0/1016888266 shutdown_connections 2023-10-08T06:10:02.926 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:02.924+0000 7fe7e71ab700 1 -- 172.21.15.32:0/1016888266 wait complete. 2023-10-08T06:10:02.938 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-08T06:10:03.061 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.060+0000 7fc52ffff700 1 Processor -- start 2023-10-08T06:10:03.061 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.060+0000 7fc52ffff700 1 -- start start 2023-10-08T06:10:03.063 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.060+0000 7fc52ffff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc5300d0230 0x7fc5300d2040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:03.063 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.060+0000 7fc52ffff700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5301621b0 con 0x7fc53015d980 2023-10-08T06:10:03.063 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.060+0000 7fc52ffff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc530161630 con 0x7fc53015d5a0 2023-10-08T06:10:03.063 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.060+0000 7fc52ffff700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc530161910 con 0x7fc5300d0230 2023-10-08T06:10:03.063 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.060+0000 7fc52e7fc700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fc53015d980 0x7fc5300d1930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:46880/0 (socket says 172.21.15.32:46880) 2023-10-08T06:10:03.063 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.060+0000 7fc52e7fc700 1 -- 172.21.15.32:0/240682525 learned_addr learned my addr 172.21.15.32:0/240682525 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-08T06:10:03.063 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.060+0000 7fc52f7fe700 1 --2- 172.21.15.32:0/240682525 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc5300d0230 0x7fc5300d2040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:03.063 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.060+0000 7fc52dffb700 1 -- 172.21.15.32:0/240682525 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1635543854 0 0) 0x7fc5301621b0 con 0x7fc53015d980 2023-10-08T06:10:03.064 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.060+0000 7fc52dffb700 1 -- 172.21.15.32:0/240682525 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc5180035d0 con 0x7fc53015d980 2023-10-08T06:10:03.066 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.060+0000 7fc52dffb700 1 -- 172.21.15.32:0/240682525 <== mon.1 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 525544567 0 0) 0x7fc530161630 con 0x7fc53015d5a0 2023-10-08T06:10:03.066 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.064+0000 7fc52dffb700 1 -- 172.21.15.32:0/240682525 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc5301621b0 con 0x7fc53015d5a0 2023-10-08T06:10:03.066 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.064+0000 7fc52dffb700 1 -- 172.21.15.32:0/240682525 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2021114686 0 0) 0x7fc5180035d0 con 0x7fc53015d980 2023-10-08T06:10:03.066 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.064+0000 7fc52dffb700 1 -- 172.21.15.32:0/240682525 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc5300d0230 msgr2=0x7fc5300d2040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:10:03.066 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.064+0000 7fc52dffb700 1 --2- 172.21.15.32:0/240682525 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc5300d0230 0x7fc5300d2040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:03.066 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.064+0000 7fc52dffb700 1 -- 172.21.15.32:0/240682525 >> v1:172.21.15.40:6789/0 conn(0x7fc53015d5a0 legacy=0x7fc5300cfb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:03.066 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.064+0000 7fc52dffb700 1 -- 172.21.15.32:0/240682525 --> v1:172.21.15.32:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc530161bf0 con 0x7fc53015d980 2023-10-08T06:10:03.066 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.064+0000 7fc52dffb700 1 -- 172.21.15.32:0/240682525 <== mon.0 v1:172.21.15.32:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2364763317 0 0) 0x7fc520001670 con 0x7fc53015d980 2023-10-08T06:10:03.067 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.064+0000 7fc52dffb700 1 -- 172.21.15.32:0/240682525 >> v1:172.21.15.32:6789/0 conn(0x7fc53015d980 legacy=0x7fc5300d1930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:03.067 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.064+0000 7fc52dffb700 1 --2- 172.21.15.32:0/240682525 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc518003be0 0x7fc518003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:03.067 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.064+0000 7fc52dffb700 1 --2- 172.21.15.32:0/240682525 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc518004870 0x7fc518004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:03.067 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.064+0000 7fc52dffb700 1 --2- 172.21.15.32:0/240682525 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc518005280 0x7fc51800ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:03.067 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.064+0000 7fc52dffb700 1 -- 172.21.15.32:0/240682525 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc530161910 con 0x7fc518004870 2023-10-08T06:10:03.067 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.064+0000 7fc52dffb700 1 -- 172.21.15.32:0/240682525 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc51800c160 con 0x7fc518003be0 2023-10-08T06:10:03.067 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.064+0000 7fc52dffb700 1 -- 172.21.15.32:0/240682525 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc51800c320 con 0x7fc518005280 2023-10-08T06:10:03.067 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.064+0000 7fc52f7fe700 1 --2- 172.21.15.32:0/240682525 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc5300d0230 0x7fc5300d2040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T06:10:03.067 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.064+0000 7fc52e7fc700 1 --2- 172.21.15.32:0/240682525 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc518004870 0x7fc518004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:03.067 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.064+0000 7fc52f7fe700 1 --2- 172.21.15.32:0/240682525 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc518005280 0x7fc51800ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:03.068 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.064+0000 7fc52effd700 1 --2- 172.21.15.32:0/240682525 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc518003be0 0x7fc518003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:03.068 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.064+0000 7fc52e7fc700 1 -- 172.21.15.32:0/240682525 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc518005280 msgr2=0x7fc51800ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:10:03.068 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.064+0000 7fc52e7fc700 1 --2- 172.21.15.32:0/240682525 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc518005280 0x7fc51800ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:03.068 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.064+0000 7fc52e7fc700 1 -- 172.21.15.32:0/240682525 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc518003be0 msgr2=0x7fc518003fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:10:03.068 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.064+0000 7fc52e7fc700 1 --2- 172.21.15.32:0/240682525 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc518003be0 0x7fc518003fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:03.068 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.064+0000 7fc52e7fc700 1 -- 172.21.15.32:0/240682525 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5180035d0 con 0x7fc518004870 2023-10-08T06:10:03.068 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.064+0000 7fc52e7fc700 1 --2- 172.21.15.32:0/240682525 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc518004870 0x7fc518004cf0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fc520007fd0 tx=0x7fc5180058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c819b4f77f0c53c9 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:03.068 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.064+0000 7fc52dffb700 1 -- 172.21.15.32:0/240682525 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc52000cd20 con 0x7fc518004870 2023-10-08T06:10:03.068 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.064+0000 7fc52dffb700 1 -- 172.21.15.32:0/240682525 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc520001af0 con 0x7fc518004870 2023-10-08T06:10:03.068 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.064+0000 7fc52dffb700 1 -- 172.21.15.32:0/240682525 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc52000cea0 con 0x7fc518004870 2023-10-08T06:10:03.068 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.064+0000 7fc52ffff700 1 -- 172.21.15.32:0/240682525 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc518004870 msgr2=0x7fc518004cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:03.069 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.064+0000 7fc52ffff700 1 --2- 172.21.15.32:0/240682525 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc518004870 0x7fc518004cf0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fc520007fd0 tx=0x7fc5180058a0 comp rx=0 tx=0).stop 2023-10-08T06:10:03.069 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.064+0000 7fc52f7fe700 1 -- 172.21.15.32:0/240682525 reap_dead start 2023-10-08T06:10:03.069 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.064+0000 7fc52ffff700 1 -- 172.21.15.32:0/240682525 shutdown_connections 2023-10-08T06:10:03.069 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.064+0000 7fc52ffff700 1 -- 172.21.15.32:0/240682525 >> 172.21.15.32:0/240682525 conn(0x7fc53006aca0 msgr2=0x7fc53006b0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:10:03.069 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.064+0000 7fc52ffff700 1 -- 172.21.15.32:0/240682525 shutdown_connections 2023-10-08T06:10:03.069 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.064+0000 7fc52ffff700 1 -- 172.21.15.32:0/240682525 wait complete. 2023-10-08T06:10:03.071 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.064+0000 7fc52ffff700 1 Processor -- start 2023-10-08T06:10:03.071 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.064+0000 7fc52ffff700 1 -- start start 2023-10-08T06:10:03.071 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.068+0000 7fc52ffff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc518004870 0x7fc5301520a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:03.071 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.068+0000 7fc52ffff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc5300c9450 0x7fc5300b7880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:03.071 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.068+0000 7fc52ffff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc5300b7dc0 0x7fc5301f6770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:03.072 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.068+0000 7fc52ffff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5300b8240 con 0x7fc5300c9450 2023-10-08T06:10:03.072 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.068+0000 7fc52ffff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5301525e0 con 0x7fc5300b7dc0 2023-10-08T06:10:03.072 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.068+0000 7fc52ffff700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5300c6c40 con 0x7fc518004870 2023-10-08T06:10:03.072 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.068+0000 7fc52e7fc700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc5300c9450 0x7fc5300b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:03.072 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.068+0000 7fc52e7fc700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc5300c9450 0x7fc5300b7880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:45218/0 (socket says 172.21.15.32:45218) 2023-10-08T06:10:03.072 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.068+0000 7fc52e7fc700 1 -- 172.21.15.32:0/728713448 learned_addr learned my addr 172.21.15.32:0/728713448 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:10:03.072 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.068+0000 7fc52f7fe700 1 --2- 172.21.15.32:0/728713448 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc5300b7dc0 0x7fc5301f6770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:03.072 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.068+0000 7fc52effd700 1 --2- 172.21.15.32:0/728713448 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc518004870 0x7fc5301520a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:03.072 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.068+0000 7fc52e7fc700 1 -- 172.21.15.32:0/728713448 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc518004870 msgr2=0x7fc5301520a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:03.072 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.068+0000 7fc52e7fc700 1 --2- 172.21.15.32:0/728713448 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc518004870 0x7fc5301520a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:03.072 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.068+0000 7fc52e7fc700 1 -- 172.21.15.32:0/728713448 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc5300b7dc0 msgr2=0x7fc5301f6770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:03.073 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.068+0000 7fc52e7fc700 1 --2- 172.21.15.32:0/728713448 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc5300b7dc0 0x7fc5301f6770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:03.073 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.068+0000 7fc52e7fc700 1 -- 172.21.15.32:0/728713448 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5300c6f20 con 0x7fc5300c9450 2023-10-08T06:10:03.073 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.068+0000 7fc52effd700 1 --2- 172.21.15.32:0/728713448 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc518004870 0x7fc5301520a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T06:10:03.073 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.068+0000 7fc52e7fc700 1 --2- 172.21.15.32:0/728713448 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc5300c9450 0x7fc5300b7880 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fc52000c7d0 tx=0x7fc520001980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:03.073 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.068+0000 7fc517fff700 1 -- 172.21.15.32:0/728713448 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc520004ca0 con 0x7fc5300c9450 2023-10-08T06:10:03.073 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.068+0000 7fc517fff700 1 -- 172.21.15.32:0/728713448 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc520004e00 con 0x7fc5300c9450 2023-10-08T06:10:03.073 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.068+0000 7fc52ffff700 1 -- 172.21.15.32:0/728713448 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5300c7200 con 0x7fc5300c9450 2023-10-08T06:10:03.073 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.068+0000 7fc517fff700 1 -- 172.21.15.32:0/728713448 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc520007310 con 0x7fc5300c9450 2023-10-08T06:10:03.073 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.068+0000 7fc52ffff700 1 -- 172.21.15.32:0/728713448 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5300c77c0 con 0x7fc5300c9450 2023-10-08T06:10:03.074 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.072+0000 7fc52ffff700 1 -- 172.21.15.32:0/728713448 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5300cd530 con 0x7fc5300c9450 2023-10-08T06:10:03.074 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.072+0000 7fc517fff700 1 -- 172.21.15.32:0/728713448 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fc520019070 con 0x7fc5300c9450 2023-10-08T06:10:03.074 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.072+0000 7fc517fff700 1 --2- 172.21.15.32:0/728713448 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fc51c066510 0x7fc51c0689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:03.075 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.072+0000 7fc517fff700 1 -- 172.21.15.32:0/728713448 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc520084ba0 con 0x7fc5300c9450 2023-10-08T06:10:03.075 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.072+0000 7fc52effd700 1 --2- 172.21.15.32:0/728713448 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fc51c066510 0x7fc51c0689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:03.075 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.072+0000 7fc52effd700 1 --2- 172.21.15.32:0/728713448 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fc51c066510 0x7fc51c0689d0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fc5240010e0 tx=0x7fc524009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:03.080 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.080+0000 7fc517fff700 1 -- 172.21.15.32:0/728713448 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fc5200520b0 con 0x7fc5300c9450 2023-10-08T06:10:03.245 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.244+0000 7fc52ffff700 1 -- 172.21.15.32:0/728713448 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc5300686a0 con 0x7fc5300c9450 2023-10-08T06:10:03.246 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.244+0000 7fc517fff700 1 -- 172.21.15.32:0/728713448 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc5200556d0 con 0x7fc5300c9450 2023-10-08T06:10:03.246 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 64 2023-10-08T06:10:03.249 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.248+0000 7fc52ffff700 1 -- 172.21.15.32:0/728713448 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fc51c066510 msgr2=0x7fc51c0689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:03.249 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.248+0000 7fc52ffff700 1 --2- 172.21.15.32:0/728713448 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fc51c066510 0x7fc51c0689d0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fc5240010e0 tx=0x7fc524009040 comp rx=0 tx=0).stop 2023-10-08T06:10:03.249 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.248+0000 7fc52ffff700 1 -- 172.21.15.32:0/728713448 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc5300c9450 msgr2=0x7fc5300b7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:03.249 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.248+0000 7fc52ffff700 1 --2- 172.21.15.32:0/728713448 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc5300c9450 0x7fc5300b7880 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fc52000c7d0 tx=0x7fc520001980 comp rx=0 tx=0).stop 2023-10-08T06:10:03.249 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.248+0000 7fc52ffff700 1 -- 172.21.15.32:0/728713448 shutdown_connections 2023-10-08T06:10:03.249 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.248+0000 7fc52ffff700 1 --2- 172.21.15.32:0/728713448 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fc51c066510 0x7fc51c0689d0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:03.249 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.248+0000 7fc52ffff700 1 --2- 172.21.15.32:0/728713448 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc5300c9450 0x7fc5300b7880 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:03.250 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.248+0000 7fc52ffff700 1 --2- 172.21.15.32:0/728713448 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc5300b7dc0 0x7fc5301f6770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:03.250 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.248+0000 7fc52ffff700 1 --2- 172.21.15.32:0/728713448 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc518004870 0x7fc5301520a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:03.250 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.248+0000 7fc52ffff700 1 -- 172.21.15.32:0/728713448 >> 172.21.15.32:0/728713448 conn(0x7fc53006aca0 msgr2=0x7fc53015ecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:10:03.250 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.248+0000 7fc52ffff700 1 -- 172.21.15.32:0/728713448 shutdown_connections 2023-10-08T06:10:03.250 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.248+0000 7fc52ffff700 1 -- 172.21.15.32:0/728713448 wait complete. 2023-10-08T06:10:03.262 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T06:10:03.375 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.372+0000 7fd264bd9700 1 Processor -- start 2023-10-08T06:10:03.375 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.372+0000 7fd264bd9700 1 -- start start 2023-10-08T06:10:03.376 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.376+0000 7fd264bd9700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fd26015b980 0x7fd26015f780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:03.376 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.376+0000 7fd264bd9700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd2600719e0 0x7fd2600c9420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:03.376 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.376+0000 7fd264bd9700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd26006fc20 con 0x7fd2600c9960 2023-10-08T06:10:03.376 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.376+0000 7fd264bd9700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2600c9e10 con 0x7fd26015b980 2023-10-08T06:10:03.377 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.376+0000 7fd264bd9700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd260070430 con 0x7fd2600719e0 2023-10-08T06:10:03.377 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.376+0000 7fd25f7fe700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fd26015b980 0x7fd26015f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:03.377 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.376+0000 7fd25ffff700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fd2600c9960 0x7fd26015bd60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:46896/0 (socket says 172.21.15.32:46896) 2023-10-08T06:10:03.377 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.376+0000 7fd25ffff700 1 -- 172.21.15.32:0/3339032636 learned_addr learned my addr 172.21.15.32:0/3339032636 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-08T06:10:03.377 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.376+0000 7fd25effd700 1 --2- 172.21.15.32:0/3339032636 >> v2:172.21.15.40:3300/0 conn(0x7fd2600719e0 0x7fd2600c9420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:03.379 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.376+0000 7fd25f7fe700 1 -- 172.21.15.32:0/3339032636 >> v2:172.21.15.40:3300/0 conn(0x7fd2600719e0 msgr2=0x7fd2600c9420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:10:03.379 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.376+0000 7fd25f7fe700 1 --2- 172.21.15.32:0/3339032636 >> v2:172.21.15.40:3300/0 conn(0x7fd2600719e0 0x7fd2600c9420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:03.379 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.376+0000 7fd25f7fe700 1 -- 172.21.15.32:0/3339032636 >> v1:172.21.15.32:6789/0 conn(0x7fd2600c9960 legacy=0x7fd26015bd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:03.379 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.376+0000 7fd25f7fe700 1 -- 172.21.15.32:0/3339032636 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd26015fcc0 con 0x7fd26015b980 2023-10-08T06:10:03.379 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.376+0000 7fd25effd700 1 --2- 172.21.15.32:0/3339032636 >> v2:172.21.15.40:3300/0 conn(0x7fd2600719e0 0x7fd2600c9420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T06:10:03.379 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.376+0000 7fd25f7fe700 1 --2- 172.21.15.32:0/3339032636 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd26015b980 0x7fd26015f780 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fd2600685e0 tx=0x7fd254009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=588ae428aae85046 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:03.379 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.376+0000 7fd25e7fc700 1 -- 172.21.15.32:0/3339032636 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd254011830 con 0x7fd26015b980 2023-10-08T06:10:03.379 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.376+0000 7fd25e7fc700 1 -- 172.21.15.32:0/3339032636 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd254011990 con 0x7fd26015b980 2023-10-08T06:10:03.380 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.376+0000 7fd25e7fc700 1 -- 172.21.15.32:0/3339032636 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd254011d20 con 0x7fd26015b980 2023-10-08T06:10:03.380 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.376+0000 7fd264bd9700 1 -- 172.21.15.32:0/3339032636 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd26015b980 msgr2=0x7fd26015f780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:03.380 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.376+0000 7fd264bd9700 1 --2- 172.21.15.32:0/3339032636 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd26015b980 0x7fd26015f780 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fd2600685e0 tx=0x7fd254009b30 comp rx=0 tx=0).stop 2023-10-08T06:10:03.380 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.376+0000 7fd264bd9700 1 -- 172.21.15.32:0/3339032636 shutdown_connections 2023-10-08T06:10:03.380 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.376+0000 7fd264bd9700 1 --2- 172.21.15.32:0/3339032636 >> v2:172.21.15.40:3300/0 conn(0x7fd2600719e0 0x7fd2600c9420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:03.380 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.376+0000 7fd264bd9700 1 --2- 172.21.15.32:0/3339032636 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd26015b980 0x7fd26015f780 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:03.380 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.376+0000 7fd264bd9700 1 -- 172.21.15.32:0/3339032636 >> 172.21.15.32:0/3339032636 conn(0x7fd2600b0900 msgr2=0x7fd2600b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:10:03.380 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.376+0000 7fd264bd9700 1 -- 172.21.15.32:0/3339032636 shutdown_connections 2023-10-08T06:10:03.380 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.376+0000 7fd264bd9700 1 -- 172.21.15.32:0/3339032636 wait complete. 2023-10-08T06:10:03.382 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.380+0000 7fd264bd9700 1 Processor -- start 2023-10-08T06:10:03.382 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.380+0000 7fd264bd9700 1 -- start start 2023-10-08T06:10:03.382 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.380+0000 7fd264bd9700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd2600719e0 0x7fd2600b4310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:03.382 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.380+0000 7fd264bd9700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd2600c9960 0x7fd26015dab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:03.382 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.380+0000 7fd264bd9700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd26015b980 0x7fd26015dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:03.382 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.380+0000 7fd264bd9700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2600c75d0 con 0x7fd2600c9960 2023-10-08T06:10:03.382 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.380+0000 7fd264bd9700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2600c69c0 con 0x7fd2600719e0 2023-10-08T06:10:03.383 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.380+0000 7fd264bd9700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2600c6ca0 con 0x7fd26015b980 2023-10-08T06:10:03.383 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.380+0000 7fd25effd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd2600c9960 0x7fd26015dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:03.383 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.380+0000 7fd25effd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd2600c9960 0x7fd26015dab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:45246/0 (socket says 172.21.15.32:45246) 2023-10-08T06:10:03.383 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.380+0000 7fd25effd700 1 -- 172.21.15.32:0/1454377371 learned_addr learned my addr 172.21.15.32:0/1454377371 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:10:03.383 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.380+0000 7fd25f7fe700 1 --2- 172.21.15.32:0/1454377371 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd2600719e0 0x7fd2600b4310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:03.383 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.380+0000 7fd25ffff700 1 --2- 172.21.15.32:0/1454377371 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd26015b980 0x7fd26015dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:03.383 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.380+0000 7fd25effd700 1 -- 172.21.15.32:0/1454377371 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd26015b980 msgr2=0x7fd26015dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:03.383 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.380+0000 7fd25effd700 1 --2- 172.21.15.32:0/1454377371 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd26015b980 0x7fd26015dff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:03.383 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.380+0000 7fd25effd700 1 -- 172.21.15.32:0/1454377371 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd2600719e0 msgr2=0x7fd2600b4310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:03.384 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.380+0000 7fd25effd700 1 --2- 172.21.15.32:0/1454377371 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd2600719e0 0x7fd2600b4310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:03.384 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.380+0000 7fd25effd700 1 -- 172.21.15.32:0/1454377371 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd250009a70 con 0x7fd2600c9960 2023-10-08T06:10:03.384 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.380+0000 7fd25f7fe700 1 --2- 172.21.15.32:0/1454377371 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd2600719e0 0x7fd2600b4310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T06:10:03.384 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.380+0000 7fd25ffff700 1 --2- 172.21.15.32:0/1454377371 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd26015b980 0x7fd26015dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T06:10:03.384 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.380+0000 7fd25effd700 1 --2- 172.21.15.32:0/1454377371 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd2600c9960 0x7fd26015dab0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fd25000efc0 tx=0x7fd25000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:03.385 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.380+0000 7fd247fff700 1 -- 172.21.15.32:0/1454377371 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd25000cee0 con 0x7fd2600c9960 2023-10-08T06:10:03.386 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.380+0000 7fd247fff700 1 -- 172.21.15.32:0/1454377371 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd25000f040 con 0x7fd2600c9960 2023-10-08T06:10:03.386 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.380+0000 7fd264bd9700 1 -- 172.21.15.32:0/1454377371 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2540094b0 con 0x7fd2600c9960 2023-10-08T06:10:03.386 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.380+0000 7fd247fff700 1 -- 172.21.15.32:0/1454377371 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd250014680 con 0x7fd2600c9960 2023-10-08T06:10:03.386 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.380+0000 7fd264bd9700 1 -- 172.21.15.32:0/1454377371 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2600c7260 con 0x7fd2600c9960 2023-10-08T06:10:03.386 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.384+0000 7fd264bd9700 1 -- 172.21.15.32:0/1454377371 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd26004eef0 con 0x7fd2600c9960 2023-10-08T06:10:03.386 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.384+0000 7fd247fff700 1 -- 172.21.15.32:0/1454377371 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fd2500147e0 con 0x7fd2600c9960 2023-10-08T06:10:03.386 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.384+0000 7fd247fff700 1 --2- 172.21.15.32:0/1454377371 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fd24c066510 0x7fd24c0689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:03.386 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.384+0000 7fd247fff700 1 -- 172.21.15.32:0/1454377371 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd2500851d0 con 0x7fd2600c9960 2023-10-08T06:10:03.386 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.384+0000 7fd25f7fe700 1 --2- 172.21.15.32:0/1454377371 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fd24c066510 0x7fd24c0689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:03.387 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.384+0000 7fd25f7fe700 1 --2- 172.21.15.32:0/1454377371 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fd24c066510 0x7fd24c0689d0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fd254000c00 tx=0x7fd254008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:03.390 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.388+0000 7fd247fff700 1 -- 172.21.15.32:0/1454377371 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fd250052730 con 0x7fd2600c9960 2023-10-08T06:10:03.557 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.556+0000 7fd264bd9700 1 -- 172.21.15.32:0/1454377371 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd260073f00 con 0x7fd2600c9960 2023-10-08T06:10:03.559 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.556+0000 7fd247fff700 1 -- 172.21.15.32:0/1454377371 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16445 (secure 0 0 0) 0x7fd250055d50 con 0x7fd2600c9960 2023-10-08T06:10:03.560 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:10:03.560 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":22,"fsid":"ac672d87-96ae-41e0-9314-623ba2cdbbba","created":"2023-10-08T06:09:11.175626+0000","modified":"2023-10-08T06:09:38.153256+0000","last_up_change":"2023-10-08T06:09:22.744643+0000","last_in_change":"2023-10-08T06:09:14.131580+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T06:09:23.307843+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T06:09:34.295012+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T06:09:35.515590+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"43433f0c-9592-4874-92d7-10f8f4acf07f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":587888964},{"type":"v1","addr":"172.21.15.32:6801","nonce":587888964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":587888964},{"type":"v1","addr":"172.21.15.32:6803","nonce":587888964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":587888964},{"type":"v1","addr":"172.21.15.32:6810","nonce":587888964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6805","nonce":587888964},{"type":"v1","addr":"172.21.15.32:6807","nonce":587888964}]},"public_addr":"172.21.15.32:6801/587888964","cluster_addr":"172.21.15.32:6803/587888964","heartbeat_back_addr":"172.21.15.32:6810/587888964","heartbeat_front_addr":"172.21.15.32:6807/587888964","state":["exists","up"]},{"osd":1,"uuid":"2ecb1008-b987-4ce7-b646-6cded55fc8d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":990576767},{"type":"v1","addr":"172.21.15.32:6817","nonce":990576767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":990576767},{"type":"v1","addr":"172.21.15.32:6819","nonce":990576767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":990576767},{"type":"v1","addr":"172.21.15.32:6823","nonce":990576767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":990576767},{"type":"v1","addr":"172.21.15.32:6821","nonce":990576767}]},"public_addr":"172.21.15.32:6817/990576767","cluster_addr":"172.21.15.32:6819/990576767","heartbeat_back_addr":"172.21.15.32:6823/990576767","heartbeat_front_addr":"172.21.15.32:6821/990576767","state":["exists","up"]},{"osd":2,"uuid":"1b131c94-c09b-4e80-8746-bf1b7bac362d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6824","nonce":1566874440},{"type":"v1","addr":"172.21.15.32:6825","nonce":1566874440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":1566874440},{"type":"v1","addr":"172.21.15.32:6827","nonce":1566874440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":1566874440},{"type":"v1","addr":"172.21.15.32:6831","nonce":1566874440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":1566874440},{"type":"v1","addr":"172.21.15.32:6829","nonce":1566874440}]},"public_addr":"172.21.15.32:6825/1566874440","cluster_addr":"172.21.15.32:6827/1566874440","heartbeat_back_addr":"172.21.15.32:6831/1566874440","heartbeat_front_addr":"172.21.15.32:6829/1566874440","state":["exists","up"]},{"osd":3,"uuid":"ad655af2-1f6f-4689-b21d-b07bbaeb68b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":3672614802},{"type":"v1","addr":"172.21.15.32:6806","nonce":3672614802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6809","nonce":3672614802},{"type":"v1","addr":"172.21.15.32:6811","nonce":3672614802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":3672614802},{"type":"v1","addr":"172.21.15.32:6815","nonce":3672614802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":3672614802},{"type":"v1","addr":"172.21.15.32:6813","nonce":3672614802}]},"public_addr":"172.21.15.32:6806/3672614802","cluster_addr":"172.21.15.32:6811/3672614802","heartbeat_back_addr":"172.21.15.32:6815/3672614802","heartbeat_front_addr":"172.21.15.32:6813/3672614802","state":["exists","up"]},{"osd":4,"uuid":"64a543a1-8c4f-458e-9aba-b35c1cd7dd03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":3369928244},{"type":"v1","addr":"172.21.15.40:6801","nonce":3369928244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":3369928244},{"type":"v1","addr":"172.21.15.40:6803","nonce":3369928244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":3369928244},{"type":"v1","addr":"172.21.15.40:6807","nonce":3369928244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":3369928244},{"type":"v1","addr":"172.21.15.40:6805","nonce":3369928244}]},"public_addr":"172.21.15.40:6801/3369928244","cluster_addr":"172.21.15.40:6803/3369928244","heartbeat_back_addr":"172.21.15.40:6807/3369928244","heartbeat_front_addr":"172.21.15.40:6805/3369928244","state":["exists","up"]},{"osd":5,"uuid":"0fef3e54-edb4-4678-878e-944663c51638","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":2395850297},{"type":"v1","addr":"172.21.15.40:6825","nonce":2395850297}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":2395850297},{"type":"v1","addr":"172.21.15.40:6827","nonce":2395850297}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":2395850297},{"type":"v1","addr":"172.21.15.40:6831","nonce":2395850297}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":2395850297},{"type":"v1","addr":"172.21.15.40:6829","nonce":2395850297}]},"public_addr":"172.21.15.40:6825/2395850297","cluster_addr":"172.21.15.40:6827/2395850297","heartbeat_back_addr":"172.21.15.40:6831/2395850297","heartbeat_front_addr":"172.21.15.40:6829/2395850297","state":["exists","up"]},{"osd":6,"uuid":"2eeb0472-6096-469d-9b2c-cab4bf41c31a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":4145283410},{"type":"v1","addr":"172.21.15.40:6809","nonce":4145283410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":4145283410},{"type":"v1","addr":"172.21.15.40:6811","nonce":4145283410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":4145283410},{"type":"v1","addr":"172.21.15.40:6815","nonce":4145283410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":4145283410},{"type":"v1","addr":"172.21.15.40:6813","nonce":4145283410}]},"public_addr":"172.21.15.40:6809/4145283410","cluster_addr":"172.21.15.40:6811/4145283410","heartbeat_back_addr":"172.21.15.40:6815/4145283410","heartbeat_front_addr":"172.21.15.40:6813/4145283410","state":["exists","up"]},{"osd":7,"uuid":"cf76e4c7-96a6-401f-a280-91aad4641940","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":2943297416},{"type":"v1","addr":"172.21.15.40:6817","nonce":2943297416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":2943297416},{"type":"v1","addr":"172.21.15.40:6819","nonce":2943297416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":2943297416},{"type":"v1","addr":"172.21.15.40:6823","nonce":2943297416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":2943297416},{"type":"v1","addr":"172.21.15.40:6821","nonce":2943297416}]},"public_addr":"172.21.15.40:6817/2943297416","cluster_addr":"172.21.15.40:6819/2943297416","heartbeat_back_addr":"172.21.15.40:6823/2943297416","heartbeat_front_addr":"172.21.15.40:6821/2943297416","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.411475+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.628841+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.599055+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.166100+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.384135+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.488403+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.307648+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.363541+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T06:10:03.562 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.560+0000 7fd264bd9700 1 -- 172.21.15.32:0/1454377371 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fd24c066510 msgr2=0x7fd24c0689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:03.562 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.560+0000 7fd264bd9700 1 --2- 172.21.15.32:0/1454377371 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fd24c066510 0x7fd24c0689d0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fd254000c00 tx=0x7fd254008030 comp rx=0 tx=0).stop 2023-10-08T06:10:03.562 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.560+0000 7fd264bd9700 1 -- 172.21.15.32:0/1454377371 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd2600c9960 msgr2=0x7fd26015dab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:03.562 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.560+0000 7fd264bd9700 1 --2- 172.21.15.32:0/1454377371 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd2600c9960 0x7fd26015dab0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fd25000efc0 tx=0x7fd25000c3a0 comp rx=0 tx=0).stop 2023-10-08T06:10:03.563 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.560+0000 7fd264bd9700 1 -- 172.21.15.32:0/1454377371 shutdown_connections 2023-10-08T06:10:03.563 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.560+0000 7fd264bd9700 1 --2- 172.21.15.32:0/1454377371 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fd24c066510 0x7fd24c0689d0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:03.563 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.560+0000 7fd264bd9700 1 --2- 172.21.15.32:0/1454377371 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd2600c9960 0x7fd26015dab0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:03.563 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.560+0000 7fd264bd9700 1 --2- 172.21.15.32:0/1454377371 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd26015b980 0x7fd26015dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:03.563 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.560+0000 7fd264bd9700 1 --2- 172.21.15.32:0/1454377371 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd2600719e0 0x7fd2600b4310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:03.563 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.560+0000 7fd264bd9700 1 -- 172.21.15.32:0/1454377371 >> 172.21.15.32:0/1454377371 conn(0x7fd2600b0900 msgr2=0x7fd26006bcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:10:03.563 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.560+0000 7fd264bd9700 1 -- 172.21.15.32:0/1454377371 shutdown_connections 2023-10-08T06:10:03.563 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.560+0000 7fd264bd9700 1 -- 172.21.15.32:0/1454377371 wait complete. 2023-10-08T06:10:03.575 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T06:09:23.307843+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-08T06:09:34.295012+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-08T06:09:35.515590+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-08T06:10:03.576 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T06:10:03.693 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.692+0000 7fc105fe8700 1 Processor -- start 2023-10-08T06:10:03.693 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.692+0000 7fc105fe8700 1 -- start start 2023-10-08T06:10:03.695 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.692+0000 7fc105fe8700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc10015d490 0x7fc1000b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:03.695 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.692+0000 7fc105fe8700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc1000ce4e0 0x7fc1000b6130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:03.695 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.692+0000 7fc105fe8700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1000d1bb0 con 0x7fc1000d13d0 2023-10-08T06:10:03.695 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.692+0000 7fc105fe8700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1000d1e90 con 0x7fc10015d490 2023-10-08T06:10:03.696 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.692+0000 7fc105fe8700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1000d2170 con 0x7fc1000ce4e0 2023-10-08T06:10:03.696 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.692+0000 7fc0fffff700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fc1000d13d0 0x7fc1000cddd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:46912/0 (socket says 172.21.15.32:46912) 2023-10-08T06:10:03.696 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.692+0000 7fc0fffff700 1 -- 172.21.15.32:0/511383869 learned_addr learned my addr 172.21.15.32:0/511383869 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-08T06:10:03.696 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.692+0000 7fc104fe6700 1 --2- 172.21.15.32:0/511383869 >> v2:172.21.15.40:3300/0 conn(0x7fc10015d490 0x7fc1000b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:03.696 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.692+0000 7fc1057e7700 1 --2- 172.21.15.32:0/511383869 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc1000ce4e0 0x7fc1000b6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:03.698 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.696+0000 7fc0ff7fe700 1 -- 172.21.15.32:0/511383869 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 779795758 0 0) 0x7fc1000d1bb0 con 0x7fc1000d13d0 2023-10-08T06:10:03.698 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.696+0000 7fc0ff7fe700 1 -- 172.21.15.32:0/511383869 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc0ec0035d0 con 0x7fc1000d13d0 2023-10-08T06:10:03.698 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.696+0000 7fc104fe6700 1 -- 172.21.15.32:0/511383869 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc1000ce4e0 msgr2=0x7fc1000b6130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:10:03.698 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.696+0000 7fc104fe6700 1 --2- 172.21.15.32:0/511383869 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc1000ce4e0 0x7fc1000b6130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:03.698 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.696+0000 7fc104fe6700 1 -- 172.21.15.32:0/511383869 >> v1:172.21.15.32:6789/0 conn(0x7fc1000d13d0 legacy=0x7fc1000cddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:03.698 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.696+0000 7fc104fe6700 1 -- 172.21.15.32:0/511383869 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1000d2450 con 0x7fc10015d490 2023-10-08T06:10:03.698 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.696+0000 7fc104fe6700 1 --2- 172.21.15.32:0/511383869 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc10015d490 0x7fc1000b8bc0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fc0e8009850 tx=0x7fc0e8009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1842dbd139d32d7 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:03.698 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.696+0000 7fc0ff7fe700 1 -- 172.21.15.32:0/511383869 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0e8011830 con 0x7fc10015d490 2023-10-08T06:10:03.698 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.696+0000 7fc0ff7fe700 1 -- 172.21.15.32:0/511383869 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0e8011990 con 0x7fc10015d490 2023-10-08T06:10:03.699 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.696+0000 7fc0ff7fe700 1 -- 172.21.15.32:0/511383869 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0e8011d40 con 0x7fc10015d490 2023-10-08T06:10:03.699 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.696+0000 7fc105fe8700 1 -- 172.21.15.32:0/511383869 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc10015d490 msgr2=0x7fc1000b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:03.699 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.696+0000 7fc105fe8700 1 --2- 172.21.15.32:0/511383869 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc10015d490 0x7fc1000b8bc0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fc0e8009850 tx=0x7fc0e8009b60 comp rx=0 tx=0).stop 2023-10-08T06:10:03.699 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.696+0000 7fc105fe8700 1 -- 172.21.15.32:0/511383869 shutdown_connections 2023-10-08T06:10:03.699 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.696+0000 7fc105fe8700 1 --2- 172.21.15.32:0/511383869 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc1000ce4e0 0x7fc1000b6130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:03.699 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.696+0000 7fc105fe8700 1 --2- 172.21.15.32:0/511383869 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc10015d490 0x7fc1000b8bc0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:03.699 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.696+0000 7fc105fe8700 1 -- 172.21.15.32:0/511383869 >> 172.21.15.32:0/511383869 conn(0x7fc10006ab40 msgr2=0x7fc10006af20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:10:03.699 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.696+0000 7fc105fe8700 1 -- 172.21.15.32:0/511383869 shutdown_connections 2023-10-08T06:10:03.699 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.696+0000 7fc105fe8700 1 -- 172.21.15.32:0/511383869 wait complete. 2023-10-08T06:10:03.700 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.700+0000 7fc105fe8700 1 Processor -- start 2023-10-08T06:10:03.700 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.700+0000 7fc105fe8700 1 -- start start 2023-10-08T06:10:03.702 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.700+0000 7fc105fe8700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc1000ce4e0 0x7fc100148680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:03.702 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.700+0000 7fc105fe8700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc1000d13d0 0x7fc100154340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:03.702 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.700+0000 7fc105fe8700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc10015d490 0x7fc10015fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:03.702 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.700+0000 7fc105fe8700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc100148bc0 con 0x7fc1000ce4e0 2023-10-08T06:10:03.702 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.700+0000 7fc105fe8700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1001e6d80 con 0x7fc10015d490 2023-10-08T06:10:03.703 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.700+0000 7fc105fe8700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1001e7060 con 0x7fc1000d13d0 2023-10-08T06:10:03.703 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.700+0000 7fc104fe6700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc1000ce4e0 0x7fc100148680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:03.703 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.700+0000 7fc104fe6700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc1000ce4e0 0x7fc100148680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:45254/0 (socket says 172.21.15.32:45254) 2023-10-08T06:10:03.703 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.700+0000 7fc104fe6700 1 -- 172.21.15.32:0/3179221682 learned_addr learned my addr 172.21.15.32:0/3179221682 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:10:03.703 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.700+0000 7fc1057e7700 1 --2- 172.21.15.32:0/3179221682 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc10015d490 0x7fc10015fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:03.703 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.700+0000 7fc0fffff700 1 --2- 172.21.15.32:0/3179221682 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc1000d13d0 0x7fc100154340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:03.703 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.700+0000 7fc104fe6700 1 -- 172.21.15.32:0/3179221682 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc1000d13d0 msgr2=0x7fc100154340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:03.703 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.700+0000 7fc104fe6700 1 --2- 172.21.15.32:0/3179221682 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc1000d13d0 0x7fc100154340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:03.703 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.700+0000 7fc104fe6700 1 -- 172.21.15.32:0/3179221682 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc10015d490 msgr2=0x7fc10015fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:03.703 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.700+0000 7fc104fe6700 1 --2- 172.21.15.32:0/3179221682 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc10015d490 0x7fc10015fc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:03.703 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.700+0000 7fc104fe6700 1 -- 172.21.15.32:0/3179221682 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0e80094b0 con 0x7fc1000ce4e0 2023-10-08T06:10:03.704 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.700+0000 7fc1057e7700 1 --2- 172.21.15.32:0/3179221682 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc10015d490 0x7fc10015fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T06:10:03.704 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.700+0000 7fc0fffff700 1 --2- 172.21.15.32:0/3179221682 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc1000d13d0 0x7fc100154340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T06:10:03.704 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.700+0000 7fc104fe6700 1 --2- 172.21.15.32:0/3179221682 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc1000ce4e0 0x7fc100148680 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fc0e8014040 tx=0x7fc0e8004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:03.704 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.700+0000 7fc0fd7fa700 1 -- 172.21.15.32:0/3179221682 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0e80036c0 con 0x7fc1000ce4e0 2023-10-08T06:10:03.704 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.700+0000 7fc0fd7fa700 1 -- 172.21.15.32:0/3179221682 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0e801e070 con 0x7fc1000ce4e0 2023-10-08T06:10:03.704 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.700+0000 7fc105fe8700 1 -- 172.21.15.32:0/3179221682 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1001e7340 con 0x7fc1000ce4e0 2023-10-08T06:10:03.704 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.700+0000 7fc0fd7fa700 1 -- 172.21.15.32:0/3179221682 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0e8003a80 con 0x7fc1000ce4e0 2023-10-08T06:10:03.704 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.700+0000 7fc105fe8700 1 -- 172.21.15.32:0/3179221682 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1001e7900 con 0x7fc1000ce4e0 2023-10-08T06:10:03.705 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.704+0000 7fc105fe8700 1 -- 172.21.15.32:0/3179221682 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc100073910 con 0x7fc1000ce4e0 2023-10-08T06:10:03.705 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.704+0000 7fc0fd7fa700 1 -- 172.21.15.32:0/3179221682 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fc0e8003be0 con 0x7fc1000ce4e0 2023-10-08T06:10:03.705 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.704+0000 7fc0fd7fa700 1 --2- 172.21.15.32:0/3179221682 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fc0e0066510 0x7fc0e00689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:03.705 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.704+0000 7fc0fd7fa700 1 -- 172.21.15.32:0/3179221682 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc0e8020070 con 0x7fc1000ce4e0 2023-10-08T06:10:03.705 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.704+0000 7fc0fffff700 1 --2- 172.21.15.32:0/3179221682 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fc0e0066510 0x7fc0e00689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:03.706 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.704+0000 7fc0fffff700 1 --2- 172.21.15.32:0/3179221682 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fc0e0066510 0x7fc0e00689d0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fc100150c50 tx=0x7fc0f0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:03.713 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.712+0000 7fc0fd7fa700 1 -- 172.21.15.32:0/3179221682 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fc0e80527c0 con 0x7fc1000ce4e0 2023-10-08T06:10:03.878 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.876+0000 7fc105fe8700 1 -- 172.21.15.32:0/3179221682 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc100073f00 con 0x7fc1000ce4e0 2023-10-08T06:10:03.878 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.876+0000 7fc0fd7fa700 1 -- 172.21.15.32:0/3179221682 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc0e8006ce0 con 0x7fc1000ce4e0 2023-10-08T06:10:03.878 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 1 2023-10-08T06:10:03.881 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.880+0000 7fc105fe8700 1 -- 172.21.15.32:0/3179221682 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fc0e0066510 msgr2=0x7fc0e00689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:03.881 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.880+0000 7fc105fe8700 1 --2- 172.21.15.32:0/3179221682 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fc0e0066510 0x7fc0e00689d0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fc100150c50 tx=0x7fc0f0009040 comp rx=0 tx=0).stop 2023-10-08T06:10:03.881 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.880+0000 7fc105fe8700 1 -- 172.21.15.32:0/3179221682 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc1000ce4e0 msgr2=0x7fc100148680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:03.881 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.880+0000 7fc105fe8700 1 --2- 172.21.15.32:0/3179221682 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc1000ce4e0 0x7fc100148680 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fc0e8014040 tx=0x7fc0e8004770 comp rx=0 tx=0).stop 2023-10-08T06:10:03.881 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.880+0000 7fc105fe8700 1 -- 172.21.15.32:0/3179221682 shutdown_connections 2023-10-08T06:10:03.881 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.880+0000 7fc105fe8700 1 --2- 172.21.15.32:0/3179221682 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fc0e0066510 0x7fc0e00689d0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:03.882 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.880+0000 7fc105fe8700 1 --2- 172.21.15.32:0/3179221682 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc10015d490 0x7fc10015fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:03.882 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.880+0000 7fc105fe8700 1 --2- 172.21.15.32:0/3179221682 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc1000d13d0 0x7fc100154340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:03.882 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.880+0000 7fc105fe8700 1 --2- 172.21.15.32:0/3179221682 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc1000ce4e0 0x7fc100148680 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:03.882 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.880+0000 7fc105fe8700 1 -- 172.21.15.32:0/3179221682 >> 172.21.15.32:0/3179221682 conn(0x7fc10006ab40 msgr2=0x7fc10014a450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:10:03.882 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.880+0000 7fc105fe8700 1 -- 172.21.15.32:0/3179221682 shutdown_connections 2023-10-08T06:10:03.882 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:03.880+0000 7fc105fe8700 1 -- 172.21.15.32:0/3179221682 wait complete. 2023-10-08T06:10:03.893 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-08T06:10:04.008 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.008+0000 7f4c8d4eb700 1 Processor -- start 2023-10-08T06:10:04.009 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.008+0000 7f4c8d4eb700 1 -- start start 2023-10-08T06:10:04.009 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.008+0000 7f4c8d4eb700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f4c88071950 0x7f4c8815a780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:04.009 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.008+0000 7f4c8d4eb700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4c8815acc0 0x7f4c880b1800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:04.009 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.008+0000 7f4c8d4eb700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c8815b1b0 con 0x7f4c88071570 2023-10-08T06:10:04.009 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.008+0000 7f4c8d4eb700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c8815b770 con 0x7f4c88071950 2023-10-08T06:10:04.010 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.008+0000 7f4c8d4eb700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c8815b490 con 0x7f4c8815acc0 2023-10-08T06:10:04.011 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.008+0000 7f4c877fe700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f4c88071950 0x7f4c8815a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:04.011 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.008+0000 7f4c8ccea700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4c8815acc0 0x7f4c880b1800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:04.011 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.008+0000 7f4c8ccea700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4c8815acc0 0x7f4c880b1800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.32:39148/0 (socket says 172.21.15.32:39148) 2023-10-08T06:10:04.011 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.008+0000 7f4c87fff700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f4c88071570 0x7f4c8815e6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.32:41068/0 (socket says 172.21.15.32:41068) 2023-10-08T06:10:04.011 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.008+0000 7f4c8ccea700 1 -- 172.21.15.32:0/2120241820 learned_addr learned my addr 172.21.15.32:0/2120241820 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:10:04.011 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.008+0000 7f4c8ccea700 1 -- 172.21.15.32:0/2120241820 >> v2:172.21.15.40:3300/0 conn(0x7f4c88071950 msgr2=0x7f4c8815a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:10:04.011 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.008+0000 7f4c8ccea700 1 --2- 172.21.15.32:0/2120241820 >> v2:172.21.15.40:3300/0 conn(0x7f4c88071950 0x7f4c8815a780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:04.012 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.008+0000 7f4c8ccea700 1 -- 172.21.15.32:0/2120241820 >> v1:172.21.15.40:6789/0 conn(0x7f4c88071570 legacy=0x7f4c8815e6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:04.012 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.008+0000 7f4c8ccea700 1 -- 172.21.15.32:0/2120241820 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c8815def0 con 0x7f4c8815acc0 2023-10-08T06:10:04.012 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.008+0000 7f4c8ccea700 1 --2- 172.21.15.32:0/2120241820 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4c8815acc0 0x7f4c880b1800 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f4c78009910 tx=0x7f4c78009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4ee51e0c0c9c2afe server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:04.012 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.008+0000 7f4c86ffd700 1 -- 172.21.15.32:0/2120241820 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c78011830 con 0x7f4c8815acc0 2023-10-08T06:10:04.012 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.008+0000 7f4c86ffd700 1 -- 172.21.15.32:0/2120241820 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c78011990 con 0x7f4c8815acc0 2023-10-08T06:10:04.012 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.008+0000 7f4c86ffd700 1 -- 172.21.15.32:0/2120241820 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c78011d40 con 0x7f4c8815acc0 2023-10-08T06:10:04.013 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.012+0000 7f4c8d4eb700 1 -- 172.21.15.32:0/2120241820 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4c8815acc0 msgr2=0x7f4c880b1800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:04.013 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.012+0000 7f4c8d4eb700 1 --2- 172.21.15.32:0/2120241820 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4c8815acc0 0x7f4c880b1800 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f4c78009910 tx=0x7f4c78009c20 comp rx=0 tx=0).stop 2023-10-08T06:10:04.013 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.012+0000 7f4c8d4eb700 1 -- 172.21.15.32:0/2120241820 shutdown_connections 2023-10-08T06:10:04.013 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.012+0000 7f4c8d4eb700 1 --2- 172.21.15.32:0/2120241820 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4c8815acc0 0x7f4c880b1800 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:04.013 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.012+0000 7f4c8d4eb700 1 --2- 172.21.15.32:0/2120241820 >> v2:172.21.15.40:3300/0 conn(0x7f4c88071950 0x7f4c8815a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:04.013 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.012+0000 7f4c8d4eb700 1 -- 172.21.15.32:0/2120241820 >> 172.21.15.32:0/2120241820 conn(0x7f4c880cc800 msgr2=0x7f4c880ccbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:10:04.014 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.012+0000 7f4c8d4eb700 1 -- 172.21.15.32:0/2120241820 shutdown_connections 2023-10-08T06:10:04.014 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.012+0000 7f4c8d4eb700 1 -- 172.21.15.32:0/2120241820 wait complete. 2023-10-08T06:10:04.015 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.012+0000 7f4c8d4eb700 1 Processor -- start 2023-10-08T06:10:04.015 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.012+0000 7f4c8d4eb700 1 -- start start 2023-10-08T06:10:04.015 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.012+0000 7f4c8d4eb700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4c88071570 0x7f4c881543e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:04.015 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.012+0000 7f4c8d4eb700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4c88071950 0x7f4c880b4720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:04.015 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.012+0000 7f4c8d4eb700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4c8815acc0 0x7f4c880c9020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:04.016 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.012+0000 7f4c8d4eb700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c880b5930 con 0x7f4c88071950 2023-10-08T06:10:04.016 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.012+0000 7f4c8d4eb700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c88154920 con 0x7f4c8815acc0 2023-10-08T06:10:04.016 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.012+0000 7f4c8d4eb700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c880a8680 con 0x7f4c88071570 2023-10-08T06:10:04.016 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.012+0000 7f4c877fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4c88071950 0x7f4c880b4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:04.016 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.012+0000 7f4c87fff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4c88071570 0x7f4c881543e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:04.016 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.012+0000 7f4c877fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4c88071950 0x7f4c880b4720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:45264/0 (socket says 172.21.15.32:45264) 2023-10-08T06:10:04.017 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.012+0000 7f4c8ccea700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4c8815acc0 0x7f4c880c9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:04.017 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.012+0000 7f4c877fe700 1 -- 172.21.15.32:0/2669851297 learned_addr learned my addr 172.21.15.32:0/2669851297 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:10:04.018 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.016+0000 7f4c877fe700 1 -- 172.21.15.32:0/2669851297 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4c88071570 msgr2=0x7f4c881543e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:04.018 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.016+0000 7f4c877fe700 1 --2- 172.21.15.32:0/2669851297 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4c88071570 0x7f4c881543e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:04.018 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.016+0000 7f4c877fe700 1 -- 172.21.15.32:0/2669851297 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4c8815acc0 msgr2=0x7f4c880c9020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:04.018 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.016+0000 7f4c877fe700 1 --2- 172.21.15.32:0/2669851297 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4c8815acc0 0x7f4c880c9020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:04.019 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.016+0000 7f4c877fe700 1 -- 172.21.15.32:0/2669851297 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c78009570 con 0x7f4c88071950 2023-10-08T06:10:04.019 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.016+0000 7f4c877fe700 1 --2- 172.21.15.32:0/2669851297 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4c88071950 0x7f4c880b4720 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f4c7000ed20 tx=0x7f4c7000d630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:04.019 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.016+0000 7f4c84ff9700 1 -- 172.21.15.32:0/2669851297 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c7000dd90 con 0x7f4c88071950 2023-10-08T06:10:04.019 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.016+0000 7f4c84ff9700 1 -- 172.21.15.32:0/2669851297 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c70010440 con 0x7f4c88071950 2023-10-08T06:10:04.019 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.016+0000 7f4c8d4eb700 1 -- 172.21.15.32:0/2669851297 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c880b5090 con 0x7f4c88071950 2023-10-08T06:10:04.019 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.016+0000 7f4c84ff9700 1 -- 172.21.15.32:0/2669851297 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c700107b0 con 0x7f4c88071950 2023-10-08T06:10:04.019 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.016+0000 7f4c8d4eb700 1 -- 172.21.15.32:0/2669851297 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c880b5650 con 0x7f4c88071950 2023-10-08T06:10:04.020 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.016+0000 7f4c8d4eb700 1 -- 172.21.15.32:0/2669851297 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c880a84e0 con 0x7f4c88071950 2023-10-08T06:10:04.020 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.020+0000 7f4c84ff9700 1 -- 172.21.15.32:0/2669851297 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f4c70010910 con 0x7f4c88071950 2023-10-08T06:10:04.020 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.020+0000 7f4c84ff9700 1 --2- 172.21.15.32:0/2669851297 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f4c68066510 0x7f4c680689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:04.021 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.020+0000 7f4c84ff9700 1 -- 172.21.15.32:0/2669851297 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4c70084440 con 0x7f4c88071950 2023-10-08T06:10:04.021 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.020+0000 7f4c87fff700 1 --2- 172.21.15.32:0/2669851297 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f4c68066510 0x7f4c680689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:04.021 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.020+0000 7f4c87fff700 1 --2- 172.21.15.32:0/2669851297 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f4c68066510 0x7f4c680689d0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f4c880b4600 tx=0x7f4c80001af0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:04.029 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.028+0000 7f4c84ff9700 1 -- 172.21.15.32:0/2669851297 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f4c880a84e0 con 0x7f4c88071950 2023-10-08T06:10:04.189 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.188+0000 7f4c8d4eb700 1 -- 172.21.15.32:0/2669851297 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4c880a84e0 con 0x7f4c88071950 2023-10-08T06:10:04.189 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.188+0000 7f4c84ff9700 1 -- 172.21.15.32:0/2669851297 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4c880a84e0 con 0x7f4c88071950 2023-10-08T06:10:04.189 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 32 2023-10-08T06:10:04.192 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.188+0000 7f4c8d4eb700 1 -- 172.21.15.32:0/2669851297 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f4c68066510 msgr2=0x7f4c680689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:04.192 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.188+0000 7f4c8d4eb700 1 --2- 172.21.15.32:0/2669851297 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f4c68066510 0x7f4c680689d0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f4c880b4600 tx=0x7f4c80001af0 comp rx=0 tx=0).stop 2023-10-08T06:10:04.192 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.188+0000 7f4c8d4eb700 1 -- 172.21.15.32:0/2669851297 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4c88071950 msgr2=0x7f4c880b4720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:04.192 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.192+0000 7f4c8d4eb700 1 --2- 172.21.15.32:0/2669851297 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4c88071950 0x7f4c880b4720 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f4c7000ed20 tx=0x7f4c7000d630 comp rx=0 tx=0).stop 2023-10-08T06:10:04.192 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.192+0000 7f4c8d4eb700 1 -- 172.21.15.32:0/2669851297 shutdown_connections 2023-10-08T06:10:04.192 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.192+0000 7f4c8d4eb700 1 --2- 172.21.15.32:0/2669851297 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f4c68066510 0x7f4c680689d0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:04.192 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.192+0000 7f4c8d4eb700 1 --2- 172.21.15.32:0/2669851297 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4c88071950 0x7f4c880b4720 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:04.192 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.192+0000 7f4c8d4eb700 1 --2- 172.21.15.32:0/2669851297 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4c8815acc0 0x7f4c880c9020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:04.193 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.192+0000 7f4c8d4eb700 1 --2- 172.21.15.32:0/2669851297 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4c88071570 0x7f4c881543e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:04.193 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.192+0000 7f4c8d4eb700 1 -- 172.21.15.32:0/2669851297 >> 172.21.15.32:0/2669851297 conn(0x7f4c880cc800 msgr2=0x7f4c880cfb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:10:04.193 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.192+0000 7f4c8d4eb700 1 -- 172.21.15.32:0/2669851297 shutdown_connections 2023-10-08T06:10:04.193 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.192+0000 7f4c8d4eb700 1 -- 172.21.15.32:0/2669851297 wait complete. 2023-10-08T06:10:04.204 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-08T06:10:04.260 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T06:10:04.263 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T06:10:04.322 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.320+0000 7fa8b50a4700 1 Processor -- start 2023-10-08T06:10:04.322 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.320+0000 7fa8b50a4700 1 -- start start 2023-10-08T06:10:04.324 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.324+0000 7fa8b50a4700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa8b00ca220 0x7fa8b00ce190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:04.324 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.324+0000 7fa8b50a4700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8b00cd290 con 0x7fa8b0159bd0 2023-10-08T06:10:04.324 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.324+0000 7fa8b50a4700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8b00cec10 con 0x7fa8b01597f0 2023-10-08T06:10:04.325 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.324+0000 7fa8b50a4700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8b00cc9a0 con 0x7fa8b00ca220 2023-10-08T06:10:04.325 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.324+0000 7fa8af7fe700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fa8b0159bd0 0x7fa8b00c9b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:46918/0 (socket says 172.21.15.32:46918) 2023-10-08T06:10:04.325 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.324+0000 7fa8af7fe700 1 -- 172.21.15.32:0/4023233459 learned_addr learned my addr 172.21.15.32:0/4023233459 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-08T06:10:04.325 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.324+0000 7fa8b48a3700 1 --2- 172.21.15.32:0/4023233459 >> v2:172.21.15.40:3300/0 conn(0x7fa8b00ca220 0x7fa8b00ce190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:04.325 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.324+0000 7fa8aeffd700 1 -- 172.21.15.32:0/4023233459 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2199277384 0 0) 0x7fa8b00cd290 con 0x7fa8b0159bd0 2023-10-08T06:10:04.325 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.324+0000 7fa8aeffd700 1 -- 172.21.15.32:0/4023233459 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa89c0035d0 con 0x7fa8b0159bd0 2023-10-08T06:10:04.326 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.324+0000 7fa8b48a3700 1 -- 172.21.15.32:0/4023233459 >> v1:172.21.15.40:6789/0 conn(0x7fa8b01597f0 legacy=0x7fa8b00cd720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:04.326 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.324+0000 7fa8b48a3700 1 -- 172.21.15.32:0/4023233459 >> v1:172.21.15.32:6789/0 conn(0x7fa8b0159bd0 legacy=0x7fa8b00c9b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:04.327 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.324+0000 7fa8b48a3700 1 -- 172.21.15.32:0/4023233459 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8b006ce00 con 0x7fa8b00ca220 2023-10-08T06:10:04.327 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.324+0000 7fa8b48a3700 1 --2- 172.21.15.32:0/4023233459 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa8b00ca220 0x7fa8b00ce190 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fa8a8009850 tx=0x7fa8a8009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=301c644d6f895b8d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:04.327 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.324+0000 7fa8aeffd700 1 -- 172.21.15.32:0/4023233459 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8a8011830 con 0x7fa8b00ca220 2023-10-08T06:10:04.327 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.324+0000 7fa8aeffd700 1 -- 172.21.15.32:0/4023233459 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8a8011990 con 0x7fa8b00ca220 2023-10-08T06:10:04.327 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.324+0000 7fa8aeffd700 1 -- 172.21.15.32:0/4023233459 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8a8011d00 con 0x7fa8b00ca220 2023-10-08T06:10:04.327 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.324+0000 7fa8b50a4700 1 -- 172.21.15.32:0/4023233459 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa8b00ca220 msgr2=0x7fa8b00ce190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:04.327 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.324+0000 7fa8b50a4700 1 --2- 172.21.15.32:0/4023233459 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa8b00ca220 0x7fa8b00ce190 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fa8a8009850 tx=0x7fa8a8009b60 comp rx=0 tx=0).stop 2023-10-08T06:10:04.327 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.324+0000 7fa8b50a4700 1 -- 172.21.15.32:0/4023233459 shutdown_connections 2023-10-08T06:10:04.327 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.324+0000 7fa8b50a4700 1 --2- 172.21.15.32:0/4023233459 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa8b00ca220 0x7fa8b00ce190 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:04.327 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.324+0000 7fa8b50a4700 1 -- 172.21.15.32:0/4023233459 >> 172.21.15.32:0/4023233459 conn(0x7fa8b00b0900 msgr2=0x7fa8b00b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:10:04.328 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.324+0000 7fa8b50a4700 1 -- 172.21.15.32:0/4023233459 shutdown_connections 2023-10-08T06:10:04.328 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.324+0000 7fa8b50a4700 1 -- 172.21.15.32:0/4023233459 wait complete. 2023-10-08T06:10:04.328 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.328+0000 7fa8b50a4700 1 Processor -- start 2023-10-08T06:10:04.328 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.328+0000 7fa8b50a4700 1 -- start start 2023-10-08T06:10:04.330 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.328+0000 7fa8b50a4700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa8b00ca220 0x7fa8b014a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:04.330 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.328+0000 7fa8b50a4700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa8b01597f0 0x7fa8b00c2db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:04.330 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.328+0000 7fa8b50a4700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa8b0159bd0 0x7fa8b00c32f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:04.330 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.328+0000 7fa8b50a4700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8b00c5370 con 0x7fa8b0159bd0 2023-10-08T06:10:04.331 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.328+0000 7fa8b50a4700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8b015bf10 con 0x7fa8b00ca220 2023-10-08T06:10:04.331 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.328+0000 7fa8b50a4700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8b015c1f0 con 0x7fa8b01597f0 2023-10-08T06:10:04.331 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.328+0000 7fa8b48a3700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa8b0159bd0 0x7fa8b00c32f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:04.331 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.328+0000 7fa8af7fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa8b01597f0 0x7fa8b00c2db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:04.331 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.328+0000 7fa8affff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa8b00ca220 0x7fa8b014a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:04.331 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.328+0000 7fa8affff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa8b00ca220 0x7fa8b014a390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.32:51692/0 (socket says 172.21.15.32:51692) 2023-10-08T06:10:04.331 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.328+0000 7fa8b48a3700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa8b0159bd0 0x7fa8b00c32f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:45270/0 (socket says 172.21.15.32:45270) 2023-10-08T06:10:04.331 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.328+0000 7fa8af7fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa8b01597f0 0x7fa8b00c2db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.32:39172/0 (socket says 172.21.15.32:39172) 2023-10-08T06:10:04.331 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.328+0000 7fa8affff700 1 -- 172.21.15.32:0/1641312630 learned_addr learned my addr 172.21.15.32:0/1641312630 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:10:04.333 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.328+0000 7fa8b48a3700 1 -- 172.21.15.32:0/1641312630 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa8b01597f0 msgr2=0x7fa8b00c2db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:04.333 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.328+0000 7fa8b48a3700 1 --2- 172.21.15.32:0/1641312630 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa8b01597f0 0x7fa8b00c2db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:04.333 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.328+0000 7fa8b48a3700 1 -- 172.21.15.32:0/1641312630 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa8b00ca220 msgr2=0x7fa8b014a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:04.333 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.328+0000 7fa8b48a3700 1 --2- 172.21.15.32:0/1641312630 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa8b00ca220 0x7fa8b014a390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:04.333 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.328+0000 7fa8b48a3700 1 -- 172.21.15.32:0/1641312630 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8a80094b0 con 0x7fa8b0159bd0 2023-10-08T06:10:04.333 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.328+0000 7fa8affff700 1 --2- 172.21.15.32:0/1641312630 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa8b00ca220 0x7fa8b014a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T06:10:04.333 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.328+0000 7fa8b48a3700 1 --2- 172.21.15.32:0/1641312630 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa8b0159bd0 0x7fa8b00c32f0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fa8a8016000 tx=0x7fa8a8004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:04.333 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.332+0000 7fa8acff9700 1 -- 172.21.15.32:0/1641312630 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8a8004550 con 0x7fa8b0159bd0 2023-10-08T06:10:04.333 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.332+0000 7fa8acff9700 1 -- 172.21.15.32:0/1641312630 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8a80036c0 con 0x7fa8b0159bd0 2023-10-08T06:10:04.333 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.332+0000 7fa8acff9700 1 -- 172.21.15.32:0/1641312630 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8a8003a70 con 0x7fa8b0159bd0 2023-10-08T06:10:04.334 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.332+0000 7fa8b50a4700 1 -- 172.21.15.32:0/1641312630 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8b015c4d0 con 0x7fa8b0159bd0 2023-10-08T06:10:04.334 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.332+0000 7fa8b50a4700 1 -- 172.21.15.32:0/1641312630 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8b014a8d0 con 0x7fa8b0159bd0 2023-10-08T06:10:04.335 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.332+0000 7fa8b50a4700 1 -- 172.21.15.32:0/1641312630 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8b014aa60 con 0x7fa8b0159bd0 2023-10-08T06:10:04.335 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.332+0000 7fa8acff9700 1 -- 172.21.15.32:0/1641312630 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fa8a8003bd0 con 0x7fa8b0159bd0 2023-10-08T06:10:04.335 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.332+0000 7fa8acff9700 1 --2- 172.21.15.32:0/1641312630 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fa890066510 0x7fa8900689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:04.335 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.332+0000 7fa8acff9700 1 -- 172.21.15.32:0/1641312630 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa8a8021030 con 0x7fa8b0159bd0 2023-10-08T06:10:04.335 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.332+0000 7fa8affff700 1 --2- 172.21.15.32:0/1641312630 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fa890066510 0x7fa8900689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:04.335 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.332+0000 7fa8affff700 1 --2- 172.21.15.32:0/1641312630 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fa890066510 0x7fa8900689d0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fa8a000d6d0 tx=0x7fa8a0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:04.342 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.340+0000 7fa8acff9700 1 -- 172.21.15.32:0/1641312630 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fa8a8052850 con 0x7fa8b0159bd0 2023-10-08T06:10:04.504 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.504+0000 7fa8b50a4700 1 -- 172.21.15.32:0/1641312630 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa8b0073f00 con 0x7fa8b0159bd0 2023-10-08T06:10:04.505 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.504+0000 7fa8acff9700 1 -- 172.21.15.32:0/1641312630 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa8a802b020 con 0x7fa8b0159bd0 2023-10-08T06:10:04.505 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 64 2023-10-08T06:10:04.508 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.504+0000 7fa8b50a4700 1 -- 172.21.15.32:0/1641312630 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fa890066510 msgr2=0x7fa8900689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:04.508 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.504+0000 7fa8b50a4700 1 --2- 172.21.15.32:0/1641312630 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fa890066510 0x7fa8900689d0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fa8a000d6d0 tx=0x7fa8a0009040 comp rx=0 tx=0).stop 2023-10-08T06:10:04.508 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.508+0000 7fa8b50a4700 1 -- 172.21.15.32:0/1641312630 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa8b0159bd0 msgr2=0x7fa8b00c32f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:04.508 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.508+0000 7fa8b50a4700 1 --2- 172.21.15.32:0/1641312630 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa8b0159bd0 0x7fa8b00c32f0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fa8a8016000 tx=0x7fa8a8004770 comp rx=0 tx=0).stop 2023-10-08T06:10:04.508 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.508+0000 7fa8b50a4700 1 -- 172.21.15.32:0/1641312630 shutdown_connections 2023-10-08T06:10:04.509 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.508+0000 7fa8b50a4700 1 --2- 172.21.15.32:0/1641312630 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fa890066510 0x7fa8900689d0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:04.509 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.508+0000 7fa8b50a4700 1 --2- 172.21.15.32:0/1641312630 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa8b0159bd0 0x7fa8b00c32f0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:04.509 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.508+0000 7fa8b50a4700 1 --2- 172.21.15.32:0/1641312630 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa8b01597f0 0x7fa8b00c2db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:04.509 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.508+0000 7fa8b50a4700 1 --2- 172.21.15.32:0/1641312630 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa8b00ca220 0x7fa8b014a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:04.509 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.508+0000 7fa8b50a4700 1 -- 172.21.15.32:0/1641312630 >> 172.21.15.32:0/1641312630 conn(0x7fa8b00b0900 msgr2=0x7fa8b00adb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:10:04.509 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.508+0000 7fa8b50a4700 1 -- 172.21.15.32:0/1641312630 shutdown_connections 2023-10-08T06:10:04.509 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.508+0000 7fa8b50a4700 1 -- 172.21.15.32:0/1641312630 wait complete. 2023-10-08T06:10:04.521 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T06:10:04.685 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.684+0000 7f966bfff700 1 Processor -- start 2023-10-08T06:10:04.685 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.684+0000 7f966bfff700 1 -- start start 2023-10-08T06:10:04.686 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.684+0000 7f966bfff700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f966c161670 0x7f966c06c580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:04.686 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.684+0000 7f966bfff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f966c0cb5e0 0x7f966c0cba20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:04.686 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.684+0000 7f966bfff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f966c165250 0x7f966c1656e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:04.686 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.684+0000 7f966bfff700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f966c0c9910 con 0x7f966c161670 2023-10-08T06:10:04.686 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.684+0000 7f966bfff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f966c0cbf60 con 0x7f966c165250 2023-10-08T06:10:04.686 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.684+0000 7f966bfff700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f966c06cac0 con 0x7f966c0cb5e0 2023-10-08T06:10:04.687 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.684+0000 7f966affd700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f966c161670 0x7f966c06c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:04.688 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.684+0000 7f966a7fc700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f966c0cb5e0 0x7f966c0cba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:04.688 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.684+0000 7f966b7fe700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f966c165250 0x7f966c1656e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:04.688 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.684+0000 7f966affd700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f966c161670 0x7f966c06c580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:45276/0 (socket says 172.21.15.32:45276) 2023-10-08T06:10:04.688 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.684+0000 7f966a7fc700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f966c0cb5e0 0x7f966c0cba20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.32:39186/0 (socket says 172.21.15.32:39186) 2023-10-08T06:10:04.688 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.684+0000 7f966affd700 1 -- 172.21.15.32:0/1436481353 learned_addr learned my addr 172.21.15.32:0/1436481353 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:10:04.688 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.684+0000 7f966a7fc700 1 -- 172.21.15.32:0/1436481353 >> v2:172.21.15.40:3300/0 conn(0x7f966c165250 msgr2=0x7f966c1656e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:10:04.688 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.684+0000 7f966a7fc700 1 --2- 172.21.15.32:0/1436481353 >> v2:172.21.15.40:3300/0 conn(0x7f966c165250 0x7f966c1656e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:04.688 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.684+0000 7f966a7fc700 1 -- 172.21.15.32:0/1436481353 >> v2:172.21.15.32:3300/0 conn(0x7f966c161670 msgr2=0x7f966c06c580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:10:04.688 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.684+0000 7f966a7fc700 1 --2- 172.21.15.32:0/1436481353 >> v2:172.21.15.32:3300/0 conn(0x7f966c161670 0x7f966c06c580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:04.688 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.684+0000 7f966a7fc700 1 -- 172.21.15.32:0/1436481353 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f966c06fb30 con 0x7f966c0cb5e0 2023-10-08T06:10:04.689 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.684+0000 7f966b7fe700 1 --2- 172.21.15.32:0/1436481353 >> v2:172.21.15.40:3300/0 conn(0x7f966c165250 0x7f966c1656e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T06:10:04.689 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.684+0000 7f966a7fc700 1 --2- 172.21.15.32:0/1436481353 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f966c0cb5e0 0x7f966c0cba20 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f966c1662f0 tx=0x7f965c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bb4e01928f5d392a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:04.689 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.684+0000 7f9669ffb700 1 -- 172.21.15.32:0/1436481353 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f965c00e070 con 0x7f966c0cb5e0 2023-10-08T06:10:04.689 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.688+0000 7f9669ffb700 1 -- 172.21.15.32:0/1436481353 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f965c00bb20 con 0x7f966c0cb5e0 2023-10-08T06:10:04.689 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.688+0000 7f9669ffb700 1 -- 172.21.15.32:0/1436481353 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f965c012430 con 0x7f966c0cb5e0 2023-10-08T06:10:04.690 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.688+0000 7f966bfff700 1 -- 172.21.15.32:0/1436481353 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f966c0cb5e0 msgr2=0x7f966c0cba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:04.690 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.688+0000 7f966bfff700 1 --2- 172.21.15.32:0/1436481353 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f966c0cb5e0 0x7f966c0cba20 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f966c1662f0 tx=0x7f965c00b330 comp rx=0 tx=0).stop 2023-10-08T06:10:04.690 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.688+0000 7f966bfff700 1 -- 172.21.15.32:0/1436481353 shutdown_connections 2023-10-08T06:10:04.690 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.688+0000 7f966bfff700 1 --2- 172.21.15.32:0/1436481353 >> v2:172.21.15.40:3300/0 conn(0x7f966c165250 0x7f966c1656e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:04.690 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.688+0000 7f966bfff700 1 --2- 172.21.15.32:0/1436481353 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f966c0cb5e0 0x7f966c0cba20 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:04.690 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.688+0000 7f966bfff700 1 --2- 172.21.15.32:0/1436481353 >> v2:172.21.15.32:3300/0 conn(0x7f966c161670 0x7f966c06c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:04.691 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.688+0000 7f966bfff700 1 -- 172.21.15.32:0/1436481353 >> 172.21.15.32:0/1436481353 conn(0x7f966c0b0720 msgr2=0x7f966c0b0b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:10:04.691 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.688+0000 7f966bfff700 1 -- 172.21.15.32:0/1436481353 shutdown_connections 2023-10-08T06:10:04.691 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.688+0000 7f966bfff700 1 -- 172.21.15.32:0/1436481353 wait complete. 2023-10-08T06:10:04.691 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.688+0000 7f966bfff700 1 Processor -- start 2023-10-08T06:10:04.691 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.688+0000 7f966bfff700 1 -- start start 2023-10-08T06:10:04.693 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.688+0000 7f966bfff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f966c0cb5e0 0x7f966c15bea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:04.693 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.688+0000 7f966bfff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f966c161670 0x7f966c0b25d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:04.693 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.688+0000 7f966bfff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f966c165250 0x7f966c0b2b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:04.693 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.688+0000 7f966bfff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f966c0c8ab0 con 0x7f966c165250 2023-10-08T06:10:04.693 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.688+0000 7f966bfff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f966c1f7000 con 0x7f966c0cb5e0 2023-10-08T06:10:04.694 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.688+0000 7f966bfff700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f966c1f72e0 con 0x7f966c161670 2023-10-08T06:10:04.694 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.688+0000 7f966b7fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f966c165250 0x7f966c0b2b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:04.694 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.688+0000 7f966b7fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f966c165250 0x7f966c0b2b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:45292/0 (socket says 172.21.15.32:45292) 2023-10-08T06:10:04.694 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.688+0000 7f966b7fe700 1 -- 172.21.15.32:0/2157510336 learned_addr learned my addr 172.21.15.32:0/2157510336 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:10:04.694 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.688+0000 7f966affd700 1 --2- 172.21.15.32:0/2157510336 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f966c0cb5e0 0x7f966c15bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:04.694 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.692+0000 7f966a7fc700 1 --2- 172.21.15.32:0/2157510336 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f966c161670 0x7f966c0b25d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:04.694 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.692+0000 7f966b7fe700 1 -- 172.21.15.32:0/2157510336 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f966c161670 msgr2=0x7f966c0b25d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:04.694 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.692+0000 7f966b7fe700 1 --2- 172.21.15.32:0/2157510336 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f966c161670 0x7f966c0b25d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:04.694 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.692+0000 7f966b7fe700 1 -- 172.21.15.32:0/2157510336 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f966c0cb5e0 msgr2=0x7f966c15bea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:04.694 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.692+0000 7f966b7fe700 1 --2- 172.21.15.32:0/2157510336 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f966c0cb5e0 0x7f966c15bea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:04.694 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.692+0000 7f966b7fe700 1 -- 172.21.15.32:0/2157510336 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96640094b0 con 0x7f966c165250 2023-10-08T06:10:04.695 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.692+0000 7f966a7fc700 1 --2- 172.21.15.32:0/2157510336 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f966c161670 0x7f966c0b25d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T06:10:04.695 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.692+0000 7f966b7fe700 1 --2- 172.21.15.32:0/2157510336 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f966c165250 0x7f966c0b2b10 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f966400eb60 tx=0x7f966400ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:04.695 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.692+0000 7f96537fe700 1 -- 172.21.15.32:0/2157510336 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96640097b0 con 0x7f966c165250 2023-10-08T06:10:04.695 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.692+0000 7f96537fe700 1 -- 172.21.15.32:0/2157510336 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9664004020 con 0x7f966c165250 2023-10-08T06:10:04.695 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.692+0000 7f966bfff700 1 -- 172.21.15.32:0/2157510336 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f965c009a70 con 0x7f966c165250 2023-10-08T06:10:04.695 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.692+0000 7f96537fe700 1 -- 172.21.15.32:0/2157510336 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96640043b0 con 0x7f966c165250 2023-10-08T06:10:04.695 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.692+0000 7f966bfff700 1 -- 172.21.15.32:0/2157510336 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f966c1f78a0 con 0x7f966c165250 2023-10-08T06:10:04.696 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.692+0000 7f966bfff700 1 -- 172.21.15.32:0/2157510336 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f966c1f7a90 con 0x7f966c165250 2023-10-08T06:10:04.696 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.696+0000 7f96537fe700 1 -- 172.21.15.32:0/2157510336 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f966400c850 con 0x7f966c165250 2023-10-08T06:10:04.696 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.696+0000 7f96537fe700 1 --2- 172.21.15.32:0/2157510336 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f9658066510 0x7f96580689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:04.696 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.696+0000 7f96537fe700 1 -- 172.21.15.32:0/2157510336 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9664083c30 con 0x7f966c165250 2023-10-08T06:10:04.697 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.696+0000 7f966affd700 1 --2- 172.21.15.32:0/2157510336 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f9658066510 0x7f96580689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:04.697 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.696+0000 7f966affd700 1 --2- 172.21.15.32:0/2157510336 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f9658066510 0x7f96580689d0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f9660009b80 tx=0x7f96600092e0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:04.704 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.704+0000 7f96537fe700 1 -- 172.21.15.32:0/2157510336 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f9664051030 con 0x7f966c165250 2023-10-08T06:10:04.872 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.872+0000 7f966bfff700 1 -- 172.21.15.32:0/2157510336 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f966c073f00 con 0x7f966c165250 2023-10-08T06:10:04.874 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.872+0000 7f96537fe700 1 -- 172.21.15.32:0/2157510336 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16445 (secure 0 0 0) 0x7f9664054650 con 0x7f966c165250 2023-10-08T06:10:04.875 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:10:04.875 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":22,"fsid":"ac672d87-96ae-41e0-9314-623ba2cdbbba","created":"2023-10-08T06:09:11.175626+0000","modified":"2023-10-08T06:09:38.153256+0000","last_up_change":"2023-10-08T06:09:22.744643+0000","last_in_change":"2023-10-08T06:09:14.131580+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T06:09:23.307843+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T06:09:34.295012+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T06:09:35.515590+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"43433f0c-9592-4874-92d7-10f8f4acf07f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":587888964},{"type":"v1","addr":"172.21.15.32:6801","nonce":587888964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":587888964},{"type":"v1","addr":"172.21.15.32:6803","nonce":587888964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":587888964},{"type":"v1","addr":"172.21.15.32:6810","nonce":587888964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6805","nonce":587888964},{"type":"v1","addr":"172.21.15.32:6807","nonce":587888964}]},"public_addr":"172.21.15.32:6801/587888964","cluster_addr":"172.21.15.32:6803/587888964","heartbeat_back_addr":"172.21.15.32:6810/587888964","heartbeat_front_addr":"172.21.15.32:6807/587888964","state":["exists","up"]},{"osd":1,"uuid":"2ecb1008-b987-4ce7-b646-6cded55fc8d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":990576767},{"type":"v1","addr":"172.21.15.32:6817","nonce":990576767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":990576767},{"type":"v1","addr":"172.21.15.32:6819","nonce":990576767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":990576767},{"type":"v1","addr":"172.21.15.32:6823","nonce":990576767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":990576767},{"type":"v1","addr":"172.21.15.32:6821","nonce":990576767}]},"public_addr":"172.21.15.32:6817/990576767","cluster_addr":"172.21.15.32:6819/990576767","heartbeat_back_addr":"172.21.15.32:6823/990576767","heartbeat_front_addr":"172.21.15.32:6821/990576767","state":["exists","up"]},{"osd":2,"uuid":"1b131c94-c09b-4e80-8746-bf1b7bac362d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6824","nonce":1566874440},{"type":"v1","addr":"172.21.15.32:6825","nonce":1566874440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":1566874440},{"type":"v1","addr":"172.21.15.32:6827","nonce":1566874440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":1566874440},{"type":"v1","addr":"172.21.15.32:6831","nonce":1566874440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":1566874440},{"type":"v1","addr":"172.21.15.32:6829","nonce":1566874440}]},"public_addr":"172.21.15.32:6825/1566874440","cluster_addr":"172.21.15.32:6827/1566874440","heartbeat_back_addr":"172.21.15.32:6831/1566874440","heartbeat_front_addr":"172.21.15.32:6829/1566874440","state":["exists","up"]},{"osd":3,"uuid":"ad655af2-1f6f-4689-b21d-b07bbaeb68b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":3672614802},{"type":"v1","addr":"172.21.15.32:6806","nonce":3672614802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6809","nonce":3672614802},{"type":"v1","addr":"172.21.15.32:6811","nonce":3672614802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":3672614802},{"type":"v1","addr":"172.21.15.32:6815","nonce":3672614802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":3672614802},{"type":"v1","addr":"172.21.15.32:6813","nonce":3672614802}]},"public_addr":"172.21.15.32:6806/3672614802","cluster_addr":"172.21.15.32:6811/3672614802","heartbeat_back_addr":"172.21.15.32:6815/3672614802","heartbeat_front_addr":"172.21.15.32:6813/3672614802","state":["exists","up"]},{"osd":4,"uuid":"64a543a1-8c4f-458e-9aba-b35c1cd7dd03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":3369928244},{"type":"v1","addr":"172.21.15.40:6801","nonce":3369928244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":3369928244},{"type":"v1","addr":"172.21.15.40:6803","nonce":3369928244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":3369928244},{"type":"v1","addr":"172.21.15.40:6807","nonce":3369928244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":3369928244},{"type":"v1","addr":"172.21.15.40:6805","nonce":3369928244}]},"public_addr":"172.21.15.40:6801/3369928244","cluster_addr":"172.21.15.40:6803/3369928244","heartbeat_back_addr":"172.21.15.40:6807/3369928244","heartbeat_front_addr":"172.21.15.40:6805/3369928244","state":["exists","up"]},{"osd":5,"uuid":"0fef3e54-edb4-4678-878e-944663c51638","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":2395850297},{"type":"v1","addr":"172.21.15.40:6825","nonce":2395850297}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":2395850297},{"type":"v1","addr":"172.21.15.40:6827","nonce":2395850297}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":2395850297},{"type":"v1","addr":"172.21.15.40:6831","nonce":2395850297}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":2395850297},{"type":"v1","addr":"172.21.15.40:6829","nonce":2395850297}]},"public_addr":"172.21.15.40:6825/2395850297","cluster_addr":"172.21.15.40:6827/2395850297","heartbeat_back_addr":"172.21.15.40:6831/2395850297","heartbeat_front_addr":"172.21.15.40:6829/2395850297","state":["exists","up"]},{"osd":6,"uuid":"2eeb0472-6096-469d-9b2c-cab4bf41c31a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":4145283410},{"type":"v1","addr":"172.21.15.40:6809","nonce":4145283410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":4145283410},{"type":"v1","addr":"172.21.15.40:6811","nonce":4145283410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":4145283410},{"type":"v1","addr":"172.21.15.40:6815","nonce":4145283410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":4145283410},{"type":"v1","addr":"172.21.15.40:6813","nonce":4145283410}]},"public_addr":"172.21.15.40:6809/4145283410","cluster_addr":"172.21.15.40:6811/4145283410","heartbeat_back_addr":"172.21.15.40:6815/4145283410","heartbeat_front_addr":"172.21.15.40:6813/4145283410","state":["exists","up"]},{"osd":7,"uuid":"cf76e4c7-96a6-401f-a280-91aad4641940","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":2943297416},{"type":"v1","addr":"172.21.15.40:6817","nonce":2943297416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":2943297416},{"type":"v1","addr":"172.21.15.40:6819","nonce":2943297416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":2943297416},{"type":"v1","addr":"172.21.15.40:6823","nonce":2943297416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":2943297416},{"type":"v1","addr":"172.21.15.40:6821","nonce":2943297416}]},"public_addr":"172.21.15.40:6817/2943297416","cluster_addr":"172.21.15.40:6819/2943297416","heartbeat_back_addr":"172.21.15.40:6823/2943297416","heartbeat_front_addr":"172.21.15.40:6821/2943297416","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.411475+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.628841+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.599055+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.166100+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.384135+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.488403+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.307648+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.363541+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T06:10:04.877 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.876+0000 7f966bfff700 1 -- 172.21.15.32:0/2157510336 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f9658066510 msgr2=0x7f96580689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:04.877 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.876+0000 7f966bfff700 1 --2- 172.21.15.32:0/2157510336 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f9658066510 0x7f96580689d0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f9660009b80 tx=0x7f96600092e0 comp rx=0 tx=0).stop 2023-10-08T06:10:04.878 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.876+0000 7f966bfff700 1 -- 172.21.15.32:0/2157510336 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f966c165250 msgr2=0x7f966c0b2b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:04.878 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.876+0000 7f966bfff700 1 --2- 172.21.15.32:0/2157510336 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f966c165250 0x7f966c0b2b10 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f966400eb60 tx=0x7f966400ef20 comp rx=0 tx=0).stop 2023-10-08T06:10:04.878 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.876+0000 7f966bfff700 1 -- 172.21.15.32:0/2157510336 shutdown_connections 2023-10-08T06:10:04.878 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.876+0000 7f966bfff700 1 --2- 172.21.15.32:0/2157510336 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f9658066510 0x7f96580689d0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:04.878 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.876+0000 7f966bfff700 1 --2- 172.21.15.32:0/2157510336 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f966c165250 0x7f966c0b2b10 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:04.878 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.876+0000 7f966bfff700 1 --2- 172.21.15.32:0/2157510336 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f966c161670 0x7f966c0b25d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:04.878 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.876+0000 7f966bfff700 1 --2- 172.21.15.32:0/2157510336 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f966c0cb5e0 0x7f966c15bea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:04.878 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.876+0000 7f966bfff700 1 -- 172.21.15.32:0/2157510336 >> 172.21.15.32:0/2157510336 conn(0x7f966c0b0720 msgr2=0x7f966c0b3530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:10:04.878 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.876+0000 7f966bfff700 1 -- 172.21.15.32:0/2157510336 shutdown_connections 2023-10-08T06:10:04.878 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:04.876+0000 7f966bfff700 1 -- 172.21.15.32:0/2157510336 wait complete. 2023-10-08T06:10:04.891 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T06:09:23.307843+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-08T06:09:34.295012+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-08T06:09:35.515590+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-08T06:10:04.891 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T06:10:05.014 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.012+0000 7f3d33892700 1 Processor -- start 2023-10-08T06:10:05.015 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.012+0000 7f3d33892700 1 -- start start 2023-10-08T06:10:05.017 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.016+0000 7f3d33892700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3d2c158e10 0x7f3d2c0c9c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:05.017 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.016+0000 7f3d33892700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f3d2c15cf00 0x7f3d2c15b630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:05.017 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.016+0000 7f3d33892700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d2c0cbe00 con 0x7f3d2c06b5e0 2023-10-08T06:10:05.018 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.016+0000 7f3d33892700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d2c06b150 con 0x7f3d2c15cf00 2023-10-08T06:10:05.018 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.016+0000 7f3d33892700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d2c15d370 con 0x7f3d2c158e10 2023-10-08T06:10:05.018 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.016+0000 7f3d30e2d700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f3d2c06b5e0 0x7f3d2c15c7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:46920/0 (socket says 172.21.15.32:46920) 2023-10-08T06:10:05.018 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.016+0000 7f3d30e2d700 1 -- 172.21.15.32:0/3268849618 learned_addr learned my addr 172.21.15.32:0/3268849618 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-08T06:10:05.018 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.016+0000 7f3d31e2f700 1 --2- 172.21.15.32:0/3268849618 >> v2:172.21.15.32:3300/0 conn(0x7f3d2c15cf00 0x7f3d2c15b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:05.018 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.016+0000 7f3d3162e700 1 --2- 172.21.15.32:0/3268849618 >> v2:172.21.15.40:3300/0 conn(0x7f3d2c158e10 0x7f3d2c0c9c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:05.018 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.016+0000 7f3d23fff700 1 -- 172.21.15.32:0/3268849618 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2709374590 0 0) 0x7f3d2c0cbe00 con 0x7f3d2c06b5e0 2023-10-08T06:10:05.018 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.016+0000 7f3d23fff700 1 -- 172.21.15.32:0/3268849618 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3d180035d0 con 0x7f3d2c06b5e0 2023-10-08T06:10:05.018 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.016+0000 7f3d31e2f700 1 -- 172.21.15.32:0/3268849618 >> v2:172.21.15.40:3300/0 conn(0x7f3d2c158e10 msgr2=0x7f3d2c0c9c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:10:05.018 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.016+0000 7f3d31e2f700 1 --2- 172.21.15.32:0/3268849618 >> v2:172.21.15.40:3300/0 conn(0x7f3d2c158e10 0x7f3d2c0c9c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:05.018 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.016+0000 7f3d31e2f700 1 -- 172.21.15.32:0/3268849618 >> v1:172.21.15.32:6789/0 conn(0x7f3d2c06b5e0 legacy=0x7f3d2c15c7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:05.019 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.016+0000 7f3d31e2f700 1 -- 172.21.15.32:0/3268849618 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d2c0cb880 con 0x7f3d2c15cf00 2023-10-08T06:10:05.019 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.016+0000 7f3d31e2f700 1 --2- 172.21.15.32:0/3268849618 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3d2c15cf00 0x7f3d2c15b630 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f3d2c071800 tx=0x7f3d2400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d5f6d3d527c6c0f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:05.019 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.016+0000 7f3d23fff700 1 -- 172.21.15.32:0/3268849618 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d2400e070 con 0x7f3d2c15cf00 2023-10-08T06:10:05.019 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.016+0000 7f3d23fff700 1 -- 172.21.15.32:0/3268849618 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d2400bb20 con 0x7f3d2c15cf00 2023-10-08T06:10:05.019 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.016+0000 7f3d23fff700 1 -- 172.21.15.32:0/3268849618 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d24012430 con 0x7f3d2c15cf00 2023-10-08T06:10:05.020 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.016+0000 7f3d33892700 1 -- 172.21.15.32:0/3268849618 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3d2c15cf00 msgr2=0x7f3d2c15b630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:05.020 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.016+0000 7f3d33892700 1 --2- 172.21.15.32:0/3268849618 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3d2c15cf00 0x7f3d2c15b630 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f3d2c071800 tx=0x7f3d2400b330 comp rx=0 tx=0).stop 2023-10-08T06:10:05.020 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.016+0000 7f3d33892700 1 -- 172.21.15.32:0/3268849618 shutdown_connections 2023-10-08T06:10:05.020 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.016+0000 7f3d33892700 1 --2- 172.21.15.32:0/3268849618 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3d2c15cf00 0x7f3d2c15b630 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:05.020 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.016+0000 7f3d33892700 1 --2- 172.21.15.32:0/3268849618 >> v2:172.21.15.40:3300/0 conn(0x7f3d2c158e10 0x7f3d2c0c9c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:05.020 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.016+0000 7f3d33892700 1 -- 172.21.15.32:0/3268849618 >> 172.21.15.32:0/3268849618 conn(0x7f3d2c0cc0b0 msgr2=0x7f3d2c0cc4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:10:05.020 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.016+0000 7f3d33892700 1 -- 172.21.15.32:0/3268849618 shutdown_connections 2023-10-08T06:10:05.020 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.016+0000 7f3d33892700 1 -- 172.21.15.32:0/3268849618 wait complete. 2023-10-08T06:10:05.022 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.020+0000 7f3d33892700 1 Processor -- start 2023-10-08T06:10:05.022 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.020+0000 7f3d33892700 1 -- start start 2023-10-08T06:10:05.024 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.024+0000 7f3d33892700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3d2c06b5e0 0x7f3d2c1f47a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:05.024 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.024+0000 7f3d33892700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3d2c158e10 0x7f3d2c0c8c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:05.024 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.024+0000 7f3d33892700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3d2c15cf00 0x7f3d2c0c91b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:05.024 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.024+0000 7f3d33892700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d2c1f4ce0 con 0x7f3d2c158e10 2023-10-08T06:10:05.025 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.024+0000 7f3d33892700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d2c0c3480 con 0x7f3d2c15cf00 2023-10-08T06:10:05.025 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.024+0000 7f3d33892700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d2c0c6f60 con 0x7f3d2c06b5e0 2023-10-08T06:10:05.025 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.024+0000 7f3d30e2d700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3d2c158e10 0x7f3d2c0c8c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:05.025 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.024+0000 7f3d30e2d700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3d2c158e10 0x7f3d2c0c8c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:45312/0 (socket says 172.21.15.32:45312) 2023-10-08T06:10:05.025 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.024+0000 7f3d30e2d700 1 -- 172.21.15.32:0/3278700800 learned_addr learned my addr 172.21.15.32:0/3278700800 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:10:05.025 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.024+0000 7f3d31e2f700 1 --2- 172.21.15.32:0/3278700800 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3d2c15cf00 0x7f3d2c0c91b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:05.025 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.024+0000 7f3d3162e700 1 --2- 172.21.15.32:0/3278700800 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3d2c06b5e0 0x7f3d2c1f47a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:05.026 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.024+0000 7f3d30e2d700 1 -- 172.21.15.32:0/3278700800 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3d2c06b5e0 msgr2=0x7f3d2c1f47a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:05.026 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.024+0000 7f3d30e2d700 1 --2- 172.21.15.32:0/3278700800 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3d2c06b5e0 0x7f3d2c1f47a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:05.026 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.024+0000 7f3d30e2d700 1 -- 172.21.15.32:0/3278700800 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3d2c15cf00 msgr2=0x7f3d2c0c91b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:05.026 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.024+0000 7f3d30e2d700 1 --2- 172.21.15.32:0/3278700800 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3d2c15cf00 0x7f3d2c0c91b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:05.027 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.024+0000 7f3d30e2d700 1 -- 172.21.15.32:0/3278700800 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d24009a70 con 0x7f3d2c158e10 2023-10-08T06:10:05.027 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.024+0000 7f3d30e2d700 1 --2- 172.21.15.32:0/3278700800 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3d2c158e10 0x7f3d2c0c8c70 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f3d1c00c4d0 tx=0x7f3d1c00c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:05.027 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.024+0000 7f3d21ffb700 1 -- 172.21.15.32:0/3278700800 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d1c005d90 con 0x7f3d2c158e10 2023-10-08T06:10:05.027 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.024+0000 7f3d21ffb700 1 -- 172.21.15.32:0/3278700800 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d1c0070d0 con 0x7f3d2c158e10 2023-10-08T06:10:05.027 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.024+0000 7f3d33892700 1 -- 172.21.15.32:0/3278700800 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d2c0c7240 con 0x7f3d2c158e10 2023-10-08T06:10:05.027 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.024+0000 7f3d21ffb700 1 -- 172.21.15.32:0/3278700800 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d1c007480 con 0x7f3d2c158e10 2023-10-08T06:10:05.027 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.024+0000 7f3d33892700 1 -- 172.21.15.32:0/3278700800 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d2c0c7800 con 0x7f3d2c158e10 2023-10-08T06:10:05.027 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.024+0000 7f3d33892700 1 -- 172.21.15.32:0/3278700800 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d2c073f00 con 0x7f3d2c158e10 2023-10-08T06:10:05.028 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.028+0000 7f3d21ffb700 1 -- 172.21.15.32:0/3278700800 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f3d1c0075e0 con 0x7f3d2c158e10 2023-10-08T06:10:05.028 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.028+0000 7f3d21ffb700 1 --2- 172.21.15.32:0/3278700800 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f3d10066510 0x7f3d100689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:05.029 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.028+0000 7f3d21ffb700 1 -- 172.21.15.32:0/3278700800 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3d1c0831d0 con 0x7f3d2c158e10 2023-10-08T06:10:05.029 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.028+0000 7f3d3162e700 1 --2- 172.21.15.32:0/3278700800 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f3d10066510 0x7f3d100689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:05.029 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.028+0000 7f3d3162e700 1 --2- 172.21.15.32:0/3278700800 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f3d10066510 0x7f3d100689d0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f3d28009a00 tx=0x7f3d28008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:05.033 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.032+0000 7f3d21ffb700 1 -- 172.21.15.32:0/3278700800 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f3d1c0506e0 con 0x7f3d2c158e10 2023-10-08T06:10:05.196 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.196+0000 7f3d33892700 1 -- 172.21.15.32:0/3278700800 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3d2c15b070 con 0x7f3d2c158e10 2023-10-08T06:10:05.196 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.196+0000 7f3d21ffb700 1 -- 172.21.15.32:0/3278700800 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3d1c053d00 con 0x7f3d2c158e10 2023-10-08T06:10:05.197 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 1 2023-10-08T06:10:05.199 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.196+0000 7f3d33892700 1 -- 172.21.15.32:0/3278700800 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f3d10066510 msgr2=0x7f3d100689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:05.199 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.196+0000 7f3d33892700 1 --2- 172.21.15.32:0/3278700800 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f3d10066510 0x7f3d100689d0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f3d28009a00 tx=0x7f3d28008040 comp rx=0 tx=0).stop 2023-10-08T06:10:05.199 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.196+0000 7f3d33892700 1 -- 172.21.15.32:0/3278700800 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3d2c158e10 msgr2=0x7f3d2c0c8c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:05.199 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.196+0000 7f3d33892700 1 --2- 172.21.15.32:0/3278700800 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3d2c158e10 0x7f3d2c0c8c70 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f3d1c00c4d0 tx=0x7f3d1c00c7e0 comp rx=0 tx=0).stop 2023-10-08T06:10:05.199 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.196+0000 7f3d33892700 1 -- 172.21.15.32:0/3278700800 shutdown_connections 2023-10-08T06:10:05.199 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.196+0000 7f3d33892700 1 --2- 172.21.15.32:0/3278700800 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f3d10066510 0x7f3d100689d0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:05.200 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.196+0000 7f3d33892700 1 --2- 172.21.15.32:0/3278700800 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3d2c158e10 0x7f3d2c0c8c70 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:05.200 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.196+0000 7f3d33892700 1 --2- 172.21.15.32:0/3278700800 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3d2c15cf00 0x7f3d2c0c91b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:05.200 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.196+0000 7f3d33892700 1 --2- 172.21.15.32:0/3278700800 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3d2c06b5e0 0x7f3d2c1f47a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:05.200 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.196+0000 7f3d33892700 1 -- 172.21.15.32:0/3278700800 >> 172.21.15.32:0/3278700800 conn(0x7f3d2c0cc0b0 msgr2=0x7f3d2c0af8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:10:05.200 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.196+0000 7f3d33892700 1 -- 172.21.15.32:0/3278700800 shutdown_connections 2023-10-08T06:10:05.200 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.196+0000 7f3d33892700 1 -- 172.21.15.32:0/3278700800 wait complete. 2023-10-08T06:10:05.211 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-08T06:10:05.333 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.332+0000 7fb86b70e700 1 Processor -- start 2023-10-08T06:10:05.333 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.332+0000 7fb86b70e700 1 -- start start 2023-10-08T06:10:05.336 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.332+0000 7fb86b70e700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fb86415cee0 0x7fb86406b840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:05.336 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.332+0000 7fb86b70e700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb86406a2a0 0x7fb8640cecd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:05.336 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.332+0000 7fb86b70e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb86415d2c0 0x7fb86415d750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:05.337 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.332+0000 7fb86b70e700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb86406bd80 con 0x7fb86415cee0 2023-10-08T06:10:05.337 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.332+0000 7fb86b70e700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb86406a7a0 con 0x7fb86406a2a0 2023-10-08T06:10:05.337 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.332+0000 7fb86b70e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb86406aa80 con 0x7fb86415d2c0 2023-10-08T06:10:05.337 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.336+0000 7fb8694aa700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fb86415cee0 0x7fb86406b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:05.337 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.336+0000 7fb8694aa700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fb86415cee0 0x7fb86406b840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:45322/0 (socket says 172.21.15.32:45322) 2023-10-08T06:10:05.337 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.336+0000 7fb8694aa700 1 -- 172.21.15.32:0/2049079625 learned_addr learned my addr 172.21.15.32:0/2049079625 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:10:05.337 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.336+0000 7fb869cab700 1 --2- 172.21.15.32:0/2049079625 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb86415d2c0 0x7fb86415d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:05.337 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.336+0000 7fb868ca9700 1 --2- 172.21.15.32:0/2049079625 >> v2:172.21.15.40:3300/0 conn(0x7fb86406a2a0 0x7fb8640cecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:05.337 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.336+0000 7fb8694aa700 1 -- 172.21.15.32:0/2049079625 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb86415d2c0 msgr2=0x7fb86415d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:10:05.337 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.336+0000 7fb8694aa700 1 --2- 172.21.15.32:0/2049079625 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb86415d2c0 0x7fb86415d750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:05.337 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.336+0000 7fb8694aa700 1 -- 172.21.15.32:0/2049079625 >> v2:172.21.15.40:3300/0 conn(0x7fb86406a2a0 msgr2=0x7fb8640cecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:10:05.338 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.336+0000 7fb8694aa700 1 --2- 172.21.15.32:0/2049079625 >> v2:172.21.15.40:3300/0 conn(0x7fb86406a2a0 0x7fb8640cecd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:05.338 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.336+0000 7fb8694aa700 1 -- 172.21.15.32:0/2049079625 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb86406ad60 con 0x7fb86415cee0 2023-10-08T06:10:05.338 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.336+0000 7fb8694aa700 1 --2- 172.21.15.32:0/2049079625 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb86415cee0 0x7fb86406b840 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fb864071b30 tx=0x7fb86000be90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8dcc8945a7609b95 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:05.339 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.336+0000 7fb85bfff700 1 -- 172.21.15.32:0/2049079625 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb86000dd30 con 0x7fb86415cee0 2023-10-08T06:10:05.339 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.336+0000 7fb85bfff700 1 -- 172.21.15.32:0/2049079625 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb86000de90 con 0x7fb86415cee0 2023-10-08T06:10:05.339 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.336+0000 7fb85bfff700 1 -- 172.21.15.32:0/2049079625 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb860010690 con 0x7fb86415cee0 2023-10-08T06:10:05.339 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.336+0000 7fb86b70e700 1 -- 172.21.15.32:0/2049079625 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb86415cee0 msgr2=0x7fb86406b840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:05.339 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.336+0000 7fb86b70e700 1 --2- 172.21.15.32:0/2049079625 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb86415cee0 0x7fb86406b840 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fb864071b30 tx=0x7fb86000be90 comp rx=0 tx=0).stop 2023-10-08T06:10:05.339 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.336+0000 7fb86b70e700 1 -- 172.21.15.32:0/2049079625 shutdown_connections 2023-10-08T06:10:05.339 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.336+0000 7fb86b70e700 1 --2- 172.21.15.32:0/2049079625 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb86415d2c0 0x7fb86415d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:05.340 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.336+0000 7fb86b70e700 1 --2- 172.21.15.32:0/2049079625 >> v2:172.21.15.40:3300/0 conn(0x7fb86406a2a0 0x7fb8640cecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:05.340 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.336+0000 7fb86b70e700 1 --2- 172.21.15.32:0/2049079625 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb86415cee0 0x7fb86406b840 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:05.340 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.336+0000 7fb86b70e700 1 -- 172.21.15.32:0/2049079625 >> 172.21.15.32:0/2049079625 conn(0x7fb8640cc0d0 msgr2=0x7fb8640cc4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:10:05.340 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.336+0000 7fb86b70e700 1 -- 172.21.15.32:0/2049079625 shutdown_connections 2023-10-08T06:10:05.340 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.336+0000 7fb86b70e700 1 -- 172.21.15.32:0/2049079625 wait complete. 2023-10-08T06:10:05.340 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.340+0000 7fb86b70e700 1 Processor -- start 2023-10-08T06:10:05.340 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.340+0000 7fb86b70e700 1 -- start start 2023-10-08T06:10:05.342 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.340+0000 7fb86b70e700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb86406a2a0 0x7fb8640b1f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:05.342 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.340+0000 7fb86b70e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb86415cee0 0x7fb8640b4c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:05.342 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.340+0000 7fb86b70e700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb86415d2c0 0x7fb8640c8650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:05.343 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.340+0000 7fb86b70e700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8640c3cb0 con 0x7fb86415d2c0 2023-10-08T06:10:05.343 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.340+0000 7fb86b70e700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8640c9000 con 0x7fb86406a2a0 2023-10-08T06:10:05.343 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.340+0000 7fb86b70e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8640c3f70 con 0x7fb86415cee0 2023-10-08T06:10:05.343 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.340+0000 7fb869cab700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb86415d2c0 0x7fb8640c8650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:05.343 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.340+0000 7fb869cab700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb86415d2c0 0x7fb8640c8650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:45330/0 (socket says 172.21.15.32:45330) 2023-10-08T06:10:05.343 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.340+0000 7fb869cab700 1 -- 172.21.15.32:0/1969936210 learned_addr learned my addr 172.21.15.32:0/1969936210 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:10:05.343 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.340+0000 7fb8694aa700 1 --2- 172.21.15.32:0/1969936210 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb86406a2a0 0x7fb8640b1f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:05.343 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.340+0000 7fb868ca9700 1 --2- 172.21.15.32:0/1969936210 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb86415cee0 0x7fb8640b4c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:05.343 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.340+0000 7fb869cab700 1 -- 172.21.15.32:0/1969936210 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb86415cee0 msgr2=0x7fb8640b4c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:05.343 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.340+0000 7fb869cab700 1 --2- 172.21.15.32:0/1969936210 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb86415cee0 0x7fb8640b4c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:05.344 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.340+0000 7fb869cab700 1 -- 172.21.15.32:0/1969936210 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb86406a2a0 msgr2=0x7fb8640b1f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:05.344 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.340+0000 7fb869cab700 1 --2- 172.21.15.32:0/1969936210 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb86406a2a0 0x7fb8640b1f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:05.344 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.340+0000 7fb869cab700 1 -- 172.21.15.32:0/1969936210 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb86000b810 con 0x7fb86415d2c0 2023-10-08T06:10:05.344 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.340+0000 7fb869cab700 1 --2- 172.21.15.32:0/1969936210 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb86415d2c0 0x7fb8640c8650 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fb85c00efc0 tx=0x7fb85c00c0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:05.345 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.340+0000 7fb859ffb700 1 -- 172.21.15.32:0/1969936210 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb85c00cad0 con 0x7fb86415d2c0 2023-10-08T06:10:05.345 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.340+0000 7fb859ffb700 1 -- 172.21.15.32:0/1969936210 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb85c00f040 con 0x7fb86415d2c0 2023-10-08T06:10:05.345 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.340+0000 7fb86b70e700 1 -- 172.21.15.32:0/1969936210 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8640c4250 con 0x7fb86415d2c0 2023-10-08T06:10:05.345 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.340+0000 7fb859ffb700 1 -- 172.21.15.32:0/1969936210 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb85c00ce70 con 0x7fb86415d2c0 2023-10-08T06:10:05.345 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.340+0000 7fb86b70e700 1 -- 172.21.15.32:0/1969936210 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8640b5140 con 0x7fb86415d2c0 2023-10-08T06:10:05.345 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.344+0000 7fb86b70e700 1 -- 172.21.15.32:0/1969936210 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8640c4770 con 0x7fb86415d2c0 2023-10-08T06:10:05.346 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.344+0000 7fb859ffb700 1 -- 172.21.15.32:0/1969936210 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fb85c014480 con 0x7fb86415d2c0 2023-10-08T06:10:05.346 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.344+0000 7fb859ffb700 1 --2- 172.21.15.32:0/1969936210 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fb848066510 0x7fb8480689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:05.347 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.344+0000 7fb859ffb700 1 -- 172.21.15.32:0/1969936210 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb85c0851b0 con 0x7fb86415d2c0 2023-10-08T06:10:05.347 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.344+0000 7fb8694aa700 1 --2- 172.21.15.32:0/1969936210 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fb848066510 0x7fb8480689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:05.347 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.344+0000 7fb8694aa700 1 --2- 172.21.15.32:0/1969936210 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fb848066510 0x7fb8480689d0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fb860000c00 tx=0x7fb860013000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:05.352 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.352+0000 7fb859ffb700 1 -- 172.21.15.32:0/1969936210 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fb85c052590 con 0x7fb86415d2c0 2023-10-08T06:10:05.514 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.512+0000 7fb86b70e700 1 -- 172.21.15.32:0/1969936210 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb8640686a0 con 0x7fb86415d2c0 2023-10-08T06:10:05.515 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.512+0000 7fb859ffb700 1 -- 172.21.15.32:0/1969936210 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb85c0180a0 con 0x7fb86415d2c0 2023-10-08T06:10:05.515 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 32 2023-10-08T06:10:05.517 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.516+0000 7fb86b70e700 1 -- 172.21.15.32:0/1969936210 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fb848066510 msgr2=0x7fb8480689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:05.517 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.516+0000 7fb86b70e700 1 --2- 172.21.15.32:0/1969936210 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fb848066510 0x7fb8480689d0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fb860000c00 tx=0x7fb860013000 comp rx=0 tx=0).stop 2023-10-08T06:10:05.518 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.516+0000 7fb86b70e700 1 -- 172.21.15.32:0/1969936210 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb86415d2c0 msgr2=0x7fb8640c8650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:05.518 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.516+0000 7fb86b70e700 1 --2- 172.21.15.32:0/1969936210 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb86415d2c0 0x7fb8640c8650 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fb85c00efc0 tx=0x7fb85c00c0c0 comp rx=0 tx=0).stop 2023-10-08T06:10:05.518 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.516+0000 7fb86b70e700 1 -- 172.21.15.32:0/1969936210 shutdown_connections 2023-10-08T06:10:05.518 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.516+0000 7fb86b70e700 1 --2- 172.21.15.32:0/1969936210 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fb848066510 0x7fb8480689d0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:05.518 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.516+0000 7fb86b70e700 1 --2- 172.21.15.32:0/1969936210 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb86415d2c0 0x7fb8640c8650 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:05.518 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.516+0000 7fb86b70e700 1 --2- 172.21.15.32:0/1969936210 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb86415cee0 0x7fb8640b4c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:05.518 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.516+0000 7fb86b70e700 1 --2- 172.21.15.32:0/1969936210 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb86406a2a0 0x7fb8640b1f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:05.518 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.516+0000 7fb86b70e700 1 -- 172.21.15.32:0/1969936210 >> 172.21.15.32:0/1969936210 conn(0x7fb8640cc0d0 msgr2=0x7fb86415bdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:10:05.518 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.516+0000 7fb86b70e700 1 -- 172.21.15.32:0/1969936210 shutdown_connections 2023-10-08T06:10:05.518 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.516+0000 7fb86b70e700 1 -- 172.21.15.32:0/1969936210 wait complete. 2023-10-08T06:10:05.530 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-08T06:10:05.654 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.652+0000 7fbf7359e700 1 Processor -- start 2023-10-08T06:10:05.654 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.652+0000 7fbf7359e700 1 -- start start 2023-10-08T06:10:05.656 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.652+0000 7fbf7359e700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fbf7415d490 0x7fbf740b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:05.656 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.652+0000 7fbf7359e700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fbf740ce4e0 0x7fbf740b6130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:05.656 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.652+0000 7fbf7359e700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf740d1bb0 con 0x7fbf740d13d0 2023-10-08T06:10:05.656 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.652+0000 7fbf7359e700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf740d1e90 con 0x7fbf740ce4e0 2023-10-08T06:10:05.656 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.652+0000 7fbf7359e700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf740d2170 con 0x7fbf7415d490 2023-10-08T06:10:05.656 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.652+0000 7fbf72d9d700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fbf740ce4e0 0x7fbf740b6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:05.656 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.652+0000 7fbf72d9d700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fbf740ce4e0 0x7fbf740b6130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:45344/0 (socket says 172.21.15.32:45344) 2023-10-08T06:10:05.657 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.652+0000 7fbf72d9d700 1 -- 172.21.15.32:0/33543505 learned_addr learned my addr 172.21.15.32:0/33543505 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:10:05.657 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.656+0000 7fbf7259c700 1 --2- 172.21.15.32:0/33543505 >> v2:172.21.15.40:3300/0 conn(0x7fbf7415d490 0x7fbf740b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:05.657 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.656+0000 7fbf72d9d700 1 -- 172.21.15.32:0/33543505 >> v2:172.21.15.40:3300/0 conn(0x7fbf7415d490 msgr2=0x7fbf740b8bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:10:05.657 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.656+0000 7fbf72d9d700 1 --2- 172.21.15.32:0/33543505 >> v2:172.21.15.40:3300/0 conn(0x7fbf7415d490 0x7fbf740b8bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:05.657 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.656+0000 7fbf72d9d700 1 -- 172.21.15.32:0/33543505 >> v1:172.21.15.40:6789/0 conn(0x7fbf740d13d0 legacy=0x7fbf740cddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:05.657 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.656+0000 7fbf72d9d700 1 -- 172.21.15.32:0/33543505 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf740d2450 con 0x7fbf740ce4e0 2023-10-08T06:10:05.657 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.656+0000 7fbf72d9d700 1 --2- 172.21.15.32:0/33543505 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbf740ce4e0 0x7fbf740b6130 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fbf74066df0 tx=0x7fbf6c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eff8faf9c66a844 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:05.658 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.656+0000 7fbf7159a700 1 -- 172.21.15.32:0/33543505 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf6c00e070 con 0x7fbf740ce4e0 2023-10-08T06:10:05.658 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.656+0000 7fbf7159a700 1 -- 172.21.15.32:0/33543505 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf6c00b9c0 con 0x7fbf740ce4e0 2023-10-08T06:10:05.658 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.656+0000 7fbf7159a700 1 -- 172.21.15.32:0/33543505 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf6c00bd70 con 0x7fbf740ce4e0 2023-10-08T06:10:05.659 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.656+0000 7fbf7359e700 1 -- 172.21.15.32:0/33543505 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbf740ce4e0 msgr2=0x7fbf740b6130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:05.659 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.656+0000 7fbf7359e700 1 --2- 172.21.15.32:0/33543505 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbf740ce4e0 0x7fbf740b6130 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fbf74066df0 tx=0x7fbf6c00b330 comp rx=0 tx=0).stop 2023-10-08T06:10:05.659 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.656+0000 7fbf7359e700 1 -- 172.21.15.32:0/33543505 shutdown_connections 2023-10-08T06:10:05.659 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.656+0000 7fbf7359e700 1 --2- 172.21.15.32:0/33543505 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbf740ce4e0 0x7fbf740b6130 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:05.659 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.656+0000 7fbf7359e700 1 --2- 172.21.15.32:0/33543505 >> v2:172.21.15.40:3300/0 conn(0x7fbf7415d490 0x7fbf740b8bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:05.659 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.656+0000 7fbf7359e700 1 -- 172.21.15.32:0/33543505 >> 172.21.15.32:0/33543505 conn(0x7fbf7406ab40 msgr2=0x7fbf7406af20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:10:05.659 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.656+0000 7fbf7359e700 1 -- 172.21.15.32:0/33543505 shutdown_connections 2023-10-08T06:10:05.659 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.656+0000 7fbf7359e700 1 -- 172.21.15.32:0/33543505 wait complete. 2023-10-08T06:10:05.661 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.660+0000 7fbf7359e700 1 Processor -- start 2023-10-08T06:10:05.661 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.660+0000 7fbf7359e700 1 -- start start 2023-10-08T06:10:05.664 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.660+0000 7fbf7359e700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbf740ce4e0 0x7fbf74151940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:05.664 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.660+0000 7fbf7359e700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbf740d13d0 0x7fbf740b6080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:05.664 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.660+0000 7fbf7359e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbf7415d490 0x7fbf740b65c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:05.664 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.660+0000 7fbf7359e700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf741572d0 con 0x7fbf740d13d0 2023-10-08T06:10:05.664 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.660+0000 7fbf7359e700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf74151e80 con 0x7fbf740ce4e0 2023-10-08T06:10:05.665 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.660+0000 7fbf7359e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf74154e20 con 0x7fbf7415d490 2023-10-08T06:10:05.665 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.660+0000 7fbf71d9b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbf740d13d0 0x7fbf740b6080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:05.665 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.660+0000 7fbf7259c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbf740ce4e0 0x7fbf74151940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:05.665 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.660+0000 7fbf71d9b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbf740d13d0 0x7fbf740b6080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:45358/0 (socket says 172.21.15.32:45358) 2023-10-08T06:10:05.665 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.660+0000 7fbf71d9b700 1 -- 172.21.15.32:0/172242190 learned_addr learned my addr 172.21.15.32:0/172242190 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:10:05.665 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.660+0000 7fbf72d9d700 1 --2- 172.21.15.32:0/172242190 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbf7415d490 0x7fbf740b65c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:05.665 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.664+0000 7fbf71d9b700 1 -- 172.21.15.32:0/172242190 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbf7415d490 msgr2=0x7fbf740b65c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:05.665 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.664+0000 7fbf71d9b700 1 --2- 172.21.15.32:0/172242190 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbf7415d490 0x7fbf740b65c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:05.665 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.664+0000 7fbf71d9b700 1 -- 172.21.15.32:0/172242190 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbf740ce4e0 msgr2=0x7fbf74151940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:05.665 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.664+0000 7fbf71d9b700 1 --2- 172.21.15.32:0/172242190 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbf740ce4e0 0x7fbf74151940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:05.665 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.664+0000 7fbf71d9b700 1 -- 172.21.15.32:0/172242190 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf6c009b30 con 0x7fbf740d13d0 2023-10-08T06:10:05.666 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.664+0000 7fbf71d9b700 1 --2- 172.21.15.32:0/172242190 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbf740d13d0 0x7fbf740b6080 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fbf6800c500 tx=0x7fbf6800c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:05.666 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.664+0000 7fbf62ffd700 1 -- 172.21.15.32:0/172242190 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf680052d0 con 0x7fbf740d13d0 2023-10-08T06:10:05.667 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.664+0000 7fbf62ffd700 1 -- 172.21.15.32:0/172242190 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf68005430 con 0x7fbf740d13d0 2023-10-08T06:10:05.667 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.664+0000 7fbf7359e700 1 -- 172.21.15.32:0/172242190 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf74154060 con 0x7fbf740d13d0 2023-10-08T06:10:05.667 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.664+0000 7fbf62ffd700 1 -- 172.21.15.32:0/172242190 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf680055a0 con 0x7fbf740d13d0 2023-10-08T06:10:05.667 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.664+0000 7fbf7359e700 1 -- 172.21.15.32:0/172242190 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf74154620 con 0x7fbf740d13d0 2023-10-08T06:10:05.667 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.664+0000 7fbf7359e700 1 -- 172.21.15.32:0/172242190 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf74073f00 con 0x7fbf740d13d0 2023-10-08T06:10:05.667 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.664+0000 7fbf62ffd700 1 -- 172.21.15.32:0/172242190 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fbf680038e0 con 0x7fbf740d13d0 2023-10-08T06:10:05.668 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.668+0000 7fbf62ffd700 1 --2- 172.21.15.32:0/172242190 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fbf54066510 0x7fbf540689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:05.668 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.668+0000 7fbf7259c700 1 --2- 172.21.15.32:0/172242190 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fbf54066510 0x7fbf540689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:05.668 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.668+0000 7fbf62ffd700 1 -- 172.21.15.32:0/172242190 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbf68083650 con 0x7fbf740d13d0 2023-10-08T06:10:05.668 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.668+0000 7fbf7259c700 1 --2- 172.21.15.32:0/172242190 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fbf54066510 0x7fbf540689d0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fbf64007a60 tx=0x7fbf64008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:05.674 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.672+0000 7fbf62ffd700 1 -- 172.21.15.32:0/172242190 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fbf68050ac0 con 0x7fbf740d13d0 2023-10-08T06:10:05.841 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.840+0000 7fbf7359e700 1 -- 172.21.15.32:0/172242190 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fbf7415be40 con 0x7fbf740d13d0 2023-10-08T06:10:05.841 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.840+0000 7fbf62ffd700 1 -- 172.21.15.32:0/172242190 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7fbf680540e0 con 0x7fbf740d13d0 2023-10-08T06:10:05.842 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 64 2023-10-08T06:10:05.844 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.844+0000 7fbf7359e700 1 -- 172.21.15.32:0/172242190 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fbf54066510 msgr2=0x7fbf540689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:05.844 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.844+0000 7fbf7359e700 1 --2- 172.21.15.32:0/172242190 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fbf54066510 0x7fbf540689d0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fbf64007a60 tx=0x7fbf64008040 comp rx=0 tx=0).stop 2023-10-08T06:10:05.844 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.844+0000 7fbf7359e700 1 -- 172.21.15.32:0/172242190 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbf740d13d0 msgr2=0x7fbf740b6080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:05.844 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.844+0000 7fbf7359e700 1 --2- 172.21.15.32:0/172242190 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbf740d13d0 0x7fbf740b6080 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fbf6800c500 tx=0x7fbf6800c810 comp rx=0 tx=0).stop 2023-10-08T06:10:05.845 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.844+0000 7fbf7359e700 1 -- 172.21.15.32:0/172242190 shutdown_connections 2023-10-08T06:10:05.845 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.844+0000 7fbf7359e700 1 --2- 172.21.15.32:0/172242190 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fbf54066510 0x7fbf540689d0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:05.845 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.844+0000 7fbf7359e700 1 --2- 172.21.15.32:0/172242190 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbf740d13d0 0x7fbf740b6080 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:05.845 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.844+0000 7fbf7359e700 1 --2- 172.21.15.32:0/172242190 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbf7415d490 0x7fbf740b65c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:05.845 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.844+0000 7fbf7359e700 1 --2- 172.21.15.32:0/172242190 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbf740ce4e0 0x7fbf74151940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:05.845 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.844+0000 7fbf7359e700 1 -- 172.21.15.32:0/172242190 >> 172.21.15.32:0/172242190 conn(0x7fbf7406ab40 msgr2=0x7fbf7406af20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:10:05.845 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.844+0000 7fbf7359e700 1 -- 172.21.15.32:0/172242190 shutdown_connections 2023-10-08T06:10:05.845 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:05.844+0000 7fbf7359e700 1 -- 172.21.15.32:0/172242190 wait complete. 2023-10-08T06:10:05.907 INFO:tasks.cephfs_test_runner:Starting test: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2023-10-08T06:10:05.908 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T06:10:06.028 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.028+0000 7f4f369be700 1 Processor -- start 2023-10-08T06:10:06.028 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.028+0000 7f4f369be700 1 -- start start 2023-10-08T06:10:06.029 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.028+0000 7f4f369be700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f4f3015b340 0x7f4f300cda10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:06.029 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.028+0000 7f4f369be700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4f300cd0d0 0x7f4f300cdf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:06.029 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.028+0000 7f4f369be700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f300b2ee0 con 0x7f4f3015af60 2023-10-08T06:10:06.029 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.028+0000 7f4f369be700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f300cba00 con 0x7f4f3015b340 2023-10-08T06:10:06.029 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.028+0000 7f4f369be700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f300cd660 con 0x7f4f300cd0d0 2023-10-08T06:10:06.030 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.028+0000 7f4f2ffff700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f4f3015af60 0x7f4f300cf5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:46936/0 (socket says 172.21.15.32:46936) 2023-10-08T06:10:06.030 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.028+0000 7f4f2ffff700 1 -- 172.21.15.32:0/57892870 learned_addr learned my addr 172.21.15.32:0/57892870 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-08T06:10:06.030 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.028+0000 7f4f2f7fe700 1 --2- 172.21.15.32:0/57892870 >> v2:172.21.15.40:3300/0 conn(0x7f4f3015b340 0x7f4f300cda10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:06.030 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.028+0000 7f4f34f5b700 1 --2- 172.21.15.32:0/57892870 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4f300cd0d0 0x7f4f300cdf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:06.031 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.028+0000 7f4f2effd700 1 -- 172.21.15.32:0/57892870 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4012914614 0 0) 0x7f4f300b2ee0 con 0x7f4f3015af60 2023-10-08T06:10:06.031 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.028+0000 7f4f2effd700 1 -- 172.21.15.32:0/57892870 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4f1c0035d0 con 0x7f4f3015af60 2023-10-08T06:10:06.031 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.028+0000 7f4f2f7fe700 1 -- 172.21.15.32:0/57892870 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4f300cd0d0 msgr2=0x7f4f300cdf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:10:06.031 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.028+0000 7f4f2f7fe700 1 --2- 172.21.15.32:0/57892870 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4f300cd0d0 0x7f4f300cdf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:06.031 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.028+0000 7f4f2f7fe700 1 -- 172.21.15.32:0/57892870 >> v1:172.21.15.32:6789/0 conn(0x7f4f3015af60 legacy=0x7f4f300cf5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:06.032 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.028+0000 7f4f2f7fe700 1 -- 172.21.15.32:0/57892870 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f300b3130 con 0x7f4f3015b340 2023-10-08T06:10:06.032 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.028+0000 7f4f2f7fe700 1 --2- 172.21.15.32:0/57892870 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4f3015b340 0x7f4f300cda10 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f4f28009d90 tx=0x7f4f2800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2226d0a2bbfc1ccd server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:06.032 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.028+0000 7f4f2effd700 1 -- 172.21.15.32:0/57892870 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f2800e070 con 0x7f4f3015b340 2023-10-08T06:10:06.032 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.028+0000 7f4f2effd700 1 -- 172.21.15.32:0/57892870 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f2800bb20 con 0x7f4f3015b340 2023-10-08T06:10:06.032 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.028+0000 7f4f2effd700 1 -- 172.21.15.32:0/57892870 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f28012430 con 0x7f4f3015b340 2023-10-08T06:10:06.033 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.032+0000 7f4f369be700 1 -- 172.21.15.32:0/57892870 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4f3015b340 msgr2=0x7f4f300cda10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:06.033 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.032+0000 7f4f369be700 1 --2- 172.21.15.32:0/57892870 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4f3015b340 0x7f4f300cda10 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f4f28009d90 tx=0x7f4f2800b330 comp rx=0 tx=0).stop 2023-10-08T06:10:06.033 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.032+0000 7f4f369be700 1 -- 172.21.15.32:0/57892870 shutdown_connections 2023-10-08T06:10:06.033 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.032+0000 7f4f369be700 1 --2- 172.21.15.32:0/57892870 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4f300cd0d0 0x7f4f300cdf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:06.033 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.032+0000 7f4f369be700 1 --2- 172.21.15.32:0/57892870 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4f3015b340 0x7f4f300cda10 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:06.033 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.032+0000 7f4f369be700 1 -- 172.21.15.32:0/57892870 >> 172.21.15.32:0/57892870 conn(0x7f4f30065e90 msgr2=0x7f4f300662a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:10:06.033 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.032+0000 7f4f369be700 1 -- 172.21.15.32:0/57892870 shutdown_connections 2023-10-08T06:10:06.033 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.032+0000 7f4f369be700 1 -- 172.21.15.32:0/57892870 wait complete. 2023-10-08T06:10:06.034 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.032+0000 7f4f369be700 1 Processor -- start 2023-10-08T06:10:06.034 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.032+0000 7f4f369be700 1 -- start start 2023-10-08T06:10:06.036 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.032+0000 7f4f369be700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4f300cd0d0 0x7f4f300c75b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:06.036 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.032+0000 7f4f369be700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4f3015af60 0x7f4f3014e470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:06.036 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.032+0000 7f4f369be700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4f3015b340 0x7f4f30158f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:06.036 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.032+0000 7f4f369be700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f30158a60 con 0x7f4f3015b340 2023-10-08T06:10:06.036 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.032+0000 7f4f369be700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f3014d410 con 0x7f4f3015af60 2023-10-08T06:10:06.037 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.032+0000 7f4f369be700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f300c7af0 con 0x7f4f300cd0d0 2023-10-08T06:10:06.037 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.032+0000 7f4f34f5b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4f3015b340 0x7f4f30158f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:06.037 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.032+0000 7f4f34f5b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4f3015b340 0x7f4f30158f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:45364/0 (socket says 172.21.15.32:45364) 2023-10-08T06:10:06.037 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.032+0000 7f4f34f5b700 1 -- 172.21.15.32:0/2004761571 learned_addr learned my addr 172.21.15.32:0/2004761571 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:10:06.037 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.032+0000 7f4f2ffff700 1 --2- 172.21.15.32:0/2004761571 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4f300cd0d0 0x7f4f300c75b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:06.037 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.032+0000 7f4f2f7fe700 1 --2- 172.21.15.32:0/2004761571 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4f3015af60 0x7f4f3014e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:06.037 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.036+0000 7f4f34f5b700 1 -- 172.21.15.32:0/2004761571 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4f300cd0d0 msgr2=0x7f4f300c75b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:06.037 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.036+0000 7f4f34f5b700 1 --2- 172.21.15.32:0/2004761571 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4f300cd0d0 0x7f4f300c75b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:06.037 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.036+0000 7f4f34f5b700 1 -- 172.21.15.32:0/2004761571 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4f3015af60 msgr2=0x7f4f3014e470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:06.037 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.036+0000 7f4f34f5b700 1 --2- 172.21.15.32:0/2004761571 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4f3015af60 0x7f4f3014e470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:06.037 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.036+0000 7f4f34f5b700 1 -- 172.21.15.32:0/2004761571 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f28009a70 con 0x7f4f3015b340 2023-10-08T06:10:06.038 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.036+0000 7f4f34f5b700 1 --2- 172.21.15.32:0/2004761571 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4f3015b340 0x7f4f30158f20 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f4f2000eb60 tx=0x7f4f2000ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:06.038 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.036+0000 7f4f2cff9700 1 -- 172.21.15.32:0/2004761571 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f20009740 con 0x7f4f3015b340 2023-10-08T06:10:06.038 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.036+0000 7f4f2cff9700 1 -- 172.21.15.32:0/2004761571 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f2000c850 con 0x7f4f3015b340 2023-10-08T06:10:06.038 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.036+0000 7f4f2cff9700 1 -- 172.21.15.32:0/2004761571 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f2000cbe0 con 0x7f4f3015b340 2023-10-08T06:10:06.038 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.036+0000 7f4f369be700 1 -- 172.21.15.32:0/2004761571 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f3014d6b0 con 0x7f4f3015b340 2023-10-08T06:10:06.038 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.036+0000 7f4f369be700 1 -- 172.21.15.32:0/2004761571 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f3014dc70 con 0x7f4f3015b340 2023-10-08T06:10:06.038 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.036+0000 7f4f369be700 1 -- 172.21.15.32:0/2004761571 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f30073f00 con 0x7f4f3015b340 2023-10-08T06:10:06.039 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.036+0000 7f4f2cff9700 1 -- 172.21.15.32:0/2004761571 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f4f2000cd40 con 0x7f4f3015b340 2023-10-08T06:10:06.040 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.040+0000 7f4f2cff9700 1 --2- 172.21.15.32:0/2004761571 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f4f10066510 0x7f4f100689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:06.040 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.040+0000 7f4f2ffff700 1 --2- 172.21.15.32:0/2004761571 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f4f10066510 0x7f4f100689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:06.040 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.040+0000 7f4f2cff9700 1 -- 172.21.15.32:0/2004761571 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4f20084050 con 0x7f4f3015b340 2023-10-08T06:10:06.040 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.040+0000 7f4f2ffff700 1 --2- 172.21.15.32:0/2004761571 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f4f10066510 0x7f4f100689d0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f4f180011e0 tx=0x7f4f18009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:06.044 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.044+0000 7f4f2cff9700 1 -- 172.21.15.32:0/2004761571 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f4f20051450 con 0x7f4f3015b340 2023-10-08T06:10:06.212 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.212+0000 7f4f369be700 1 -- 172.21.15.32:0/2004761571 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4f300c7dd0 con 0x7f4f3015b340 2023-10-08T06:10:06.215 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.212+0000 7f4f2cff9700 1 -- 172.21.15.32:0/2004761571 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16445 (secure 0 0 0) 0x7f4f20054a70 con 0x7f4f3015b340 2023-10-08T06:10:06.215 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:10:06.215 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":22,"fsid":"ac672d87-96ae-41e0-9314-623ba2cdbbba","created":"2023-10-08T06:09:11.175626+0000","modified":"2023-10-08T06:09:38.153256+0000","last_up_change":"2023-10-08T06:09:22.744643+0000","last_in_change":"2023-10-08T06:09:14.131580+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T06:09:23.307843+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T06:09:34.295012+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T06:09:35.515590+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"43433f0c-9592-4874-92d7-10f8f4acf07f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":587888964},{"type":"v1","addr":"172.21.15.32:6801","nonce":587888964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":587888964},{"type":"v1","addr":"172.21.15.32:6803","nonce":587888964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":587888964},{"type":"v1","addr":"172.21.15.32:6810","nonce":587888964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6805","nonce":587888964},{"type":"v1","addr":"172.21.15.32:6807","nonce":587888964}]},"public_addr":"172.21.15.32:6801/587888964","cluster_addr":"172.21.15.32:6803/587888964","heartbeat_back_addr":"172.21.15.32:6810/587888964","heartbeat_front_addr":"172.21.15.32:6807/587888964","state":["exists","up"]},{"osd":1,"uuid":"2ecb1008-b987-4ce7-b646-6cded55fc8d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":990576767},{"type":"v1","addr":"172.21.15.32:6817","nonce":990576767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":990576767},{"type":"v1","addr":"172.21.15.32:6819","nonce":990576767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":990576767},{"type":"v1","addr":"172.21.15.32:6823","nonce":990576767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":990576767},{"type":"v1","addr":"172.21.15.32:6821","nonce":990576767}]},"public_addr":"172.21.15.32:6817/990576767","cluster_addr":"172.21.15.32:6819/990576767","heartbeat_back_addr":"172.21.15.32:6823/990576767","heartbeat_front_addr":"172.21.15.32:6821/990576767","state":["exists","up"]},{"osd":2,"uuid":"1b131c94-c09b-4e80-8746-bf1b7bac362d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6824","nonce":1566874440},{"type":"v1","addr":"172.21.15.32:6825","nonce":1566874440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":1566874440},{"type":"v1","addr":"172.21.15.32:6827","nonce":1566874440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":1566874440},{"type":"v1","addr":"172.21.15.32:6831","nonce":1566874440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":1566874440},{"type":"v1","addr":"172.21.15.32:6829","nonce":1566874440}]},"public_addr":"172.21.15.32:6825/1566874440","cluster_addr":"172.21.15.32:6827/1566874440","heartbeat_back_addr":"172.21.15.32:6831/1566874440","heartbeat_front_addr":"172.21.15.32:6829/1566874440","state":["exists","up"]},{"osd":3,"uuid":"ad655af2-1f6f-4689-b21d-b07bbaeb68b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":3672614802},{"type":"v1","addr":"172.21.15.32:6806","nonce":3672614802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6809","nonce":3672614802},{"type":"v1","addr":"172.21.15.32:6811","nonce":3672614802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":3672614802},{"type":"v1","addr":"172.21.15.32:6815","nonce":3672614802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":3672614802},{"type":"v1","addr":"172.21.15.32:6813","nonce":3672614802}]},"public_addr":"172.21.15.32:6806/3672614802","cluster_addr":"172.21.15.32:6811/3672614802","heartbeat_back_addr":"172.21.15.32:6815/3672614802","heartbeat_front_addr":"172.21.15.32:6813/3672614802","state":["exists","up"]},{"osd":4,"uuid":"64a543a1-8c4f-458e-9aba-b35c1cd7dd03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":3369928244},{"type":"v1","addr":"172.21.15.40:6801","nonce":3369928244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":3369928244},{"type":"v1","addr":"172.21.15.40:6803","nonce":3369928244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":3369928244},{"type":"v1","addr":"172.21.15.40:6807","nonce":3369928244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":3369928244},{"type":"v1","addr":"172.21.15.40:6805","nonce":3369928244}]},"public_addr":"172.21.15.40:6801/3369928244","cluster_addr":"172.21.15.40:6803/3369928244","heartbeat_back_addr":"172.21.15.40:6807/3369928244","heartbeat_front_addr":"172.21.15.40:6805/3369928244","state":["exists","up"]},{"osd":5,"uuid":"0fef3e54-edb4-4678-878e-944663c51638","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":2395850297},{"type":"v1","addr":"172.21.15.40:6825","nonce":2395850297}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":2395850297},{"type":"v1","addr":"172.21.15.40:6827","nonce":2395850297}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":2395850297},{"type":"v1","addr":"172.21.15.40:6831","nonce":2395850297}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":2395850297},{"type":"v1","addr":"172.21.15.40:6829","nonce":2395850297}]},"public_addr":"172.21.15.40:6825/2395850297","cluster_addr":"172.21.15.40:6827/2395850297","heartbeat_back_addr":"172.21.15.40:6831/2395850297","heartbeat_front_addr":"172.21.15.40:6829/2395850297","state":["exists","up"]},{"osd":6,"uuid":"2eeb0472-6096-469d-9b2c-cab4bf41c31a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":4145283410},{"type":"v1","addr":"172.21.15.40:6809","nonce":4145283410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":4145283410},{"type":"v1","addr":"172.21.15.40:6811","nonce":4145283410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":4145283410},{"type":"v1","addr":"172.21.15.40:6815","nonce":4145283410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":4145283410},{"type":"v1","addr":"172.21.15.40:6813","nonce":4145283410}]},"public_addr":"172.21.15.40:6809/4145283410","cluster_addr":"172.21.15.40:6811/4145283410","heartbeat_back_addr":"172.21.15.40:6815/4145283410","heartbeat_front_addr":"172.21.15.40:6813/4145283410","state":["exists","up"]},{"osd":7,"uuid":"cf76e4c7-96a6-401f-a280-91aad4641940","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":2943297416},{"type":"v1","addr":"172.21.15.40:6817","nonce":2943297416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":2943297416},{"type":"v1","addr":"172.21.15.40:6819","nonce":2943297416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":2943297416},{"type":"v1","addr":"172.21.15.40:6823","nonce":2943297416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":2943297416},{"type":"v1","addr":"172.21.15.40:6821","nonce":2943297416}]},"public_addr":"172.21.15.40:6817/2943297416","cluster_addr":"172.21.15.40:6819/2943297416","heartbeat_back_addr":"172.21.15.40:6823/2943297416","heartbeat_front_addr":"172.21.15.40:6821/2943297416","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.411475+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.628841+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.599055+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.166100+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.384135+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.488403+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.307648+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.363541+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T06:10:06.217 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.216+0000 7f4f369be700 1 -- 172.21.15.32:0/2004761571 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f4f10066510 msgr2=0x7f4f100689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:06.217 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.216+0000 7f4f369be700 1 --2- 172.21.15.32:0/2004761571 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f4f10066510 0x7f4f100689d0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f4f180011e0 tx=0x7f4f18009040 comp rx=0 tx=0).stop 2023-10-08T06:10:06.218 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.216+0000 7f4f369be700 1 -- 172.21.15.32:0/2004761571 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4f3015b340 msgr2=0x7f4f30158f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:06.218 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.216+0000 7f4f369be700 1 --2- 172.21.15.32:0/2004761571 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4f3015b340 0x7f4f30158f20 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f4f2000eb60 tx=0x7f4f2000ef20 comp rx=0 tx=0).stop 2023-10-08T06:10:06.218 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.216+0000 7f4f369be700 1 -- 172.21.15.32:0/2004761571 shutdown_connections 2023-10-08T06:10:06.218 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.216+0000 7f4f369be700 1 --2- 172.21.15.32:0/2004761571 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f4f10066510 0x7f4f100689d0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:06.218 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.216+0000 7f4f369be700 1 --2- 172.21.15.32:0/2004761571 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4f3015b340 0x7f4f30158f20 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:06.218 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.216+0000 7f4f369be700 1 --2- 172.21.15.32:0/2004761571 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4f3015af60 0x7f4f3014e470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:06.218 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.216+0000 7f4f369be700 1 --2- 172.21.15.32:0/2004761571 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4f300cd0d0 0x7f4f300c75b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:06.218 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.216+0000 7f4f369be700 1 -- 172.21.15.32:0/2004761571 >> 172.21.15.32:0/2004761571 conn(0x7f4f30065e90 msgr2=0x7f4f30159960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:10:06.218 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.216+0000 7f4f369be700 1 -- 172.21.15.32:0/2004761571 shutdown_connections 2023-10-08T06:10:06.218 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.216+0000 7f4f369be700 1 -- 172.21.15.32:0/2004761571 wait complete. 2023-10-08T06:10:06.230 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T06:09:23.307843+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-08T06:09:34.295012+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-08T06:09:35.515590+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-08T06:10:06.231 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T06:10:06.348 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.344+0000 7f040698a700 1 Processor -- start 2023-10-08T06:10:06.348 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.344+0000 7f040698a700 1 -- start start 2023-10-08T06:10:06.349 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.348+0000 7f040698a700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f040015d370 0x7f040006d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:06.349 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.348+0000 7f040698a700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0400161620 0x7f040006fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:06.349 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.348+0000 7f040698a700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04000ad8e0 con 0x7f04000add70 2023-10-08T06:10:06.350 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.348+0000 7f040698a700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0400161d60 con 0x7f040015d370 2023-10-08T06:10:06.350 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.348+0000 7f040698a700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f040006dbe0 con 0x7f0400161620 2023-10-08T06:10:06.350 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.348+0000 7f03ff7fe700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f04000add70 0x7f0400160f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:46950/0 (socket says 172.21.15.32:46950) 2023-10-08T06:10:06.350 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.348+0000 7f03ff7fe700 1 -- 172.21.15.32:0/3219842063 learned_addr learned my addr 172.21.15.32:0/3219842063 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-08T06:10:06.350 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.348+0000 7f0404f27700 1 --2- 172.21.15.32:0/3219842063 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0400161620 0x7f040006fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:06.350 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.348+0000 7f03fffff700 1 --2- 172.21.15.32:0/3219842063 >> v2:172.21.15.40:3300/0 conn(0x7f040015d370 0x7f040006d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:06.353 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.348+0000 7f03feffd700 1 -- 172.21.15.32:0/3219842063 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2403630578 0 0) 0x7f04000ad8e0 con 0x7f04000add70 2023-10-08T06:10:06.353 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.348+0000 7f03feffd700 1 -- 172.21.15.32:0/3219842063 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f03e80035d0 con 0x7f04000add70 2023-10-08T06:10:06.353 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.348+0000 7f03feffd700 1 -- 172.21.15.32:0/3219842063 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1714960689 0 0) 0x7f03e80035d0 con 0x7f04000add70 2023-10-08T06:10:06.353 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.348+0000 7f03feffd700 1 -- 172.21.15.32:0/3219842063 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0400161620 msgr2=0x7f040006fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:10:06.353 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.348+0000 7f03feffd700 1 --2- 172.21.15.32:0/3219842063 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0400161620 0x7f040006fdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:06.354 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.348+0000 7f03feffd700 1 -- 172.21.15.32:0/3219842063 >> v2:172.21.15.40:3300/0 conn(0x7f040015d370 msgr2=0x7f040006d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:10:06.354 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.348+0000 7f03feffd700 1 --2- 172.21.15.32:0/3219842063 >> v2:172.21.15.40:3300/0 conn(0x7f040015d370 0x7f040006d6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:06.354 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.348+0000 7f03feffd700 1 -- 172.21.15.32:0/3219842063 --> v1:172.21.15.32:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04000accd0 con 0x7f04000add70 2023-10-08T06:10:06.354 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.348+0000 7f03feffd700 1 -- 172.21.15.32:0/3219842063 <== mon.0 v1:172.21.15.32:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2364763317 0 0) 0x7f03f00019f0 con 0x7f04000add70 2023-10-08T06:10:06.354 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.348+0000 7f03feffd700 1 -- 172.21.15.32:0/3219842063 >> v1:172.21.15.32:6789/0 conn(0x7f04000add70 legacy=0x7f0400160f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:06.354 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.348+0000 7f03feffd700 1 --2- 172.21.15.32:0/3219842063 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f03e8003a20 0x7f03e8003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:06.354 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.348+0000 7f03feffd700 1 --2- 172.21.15.32:0/3219842063 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f03e8004870 0x7f03e8004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:06.354 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.348+0000 7f03feffd700 1 --2- 172.21.15.32:0/3219842063 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f03e8005230 0x7f03e800ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:06.354 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.348+0000 7f03feffd700 1 -- 172.21.15.32:0/3219842063 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0400161d60 con 0x7f03e8005230 2023-10-08T06:10:06.354 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.348+0000 7f03feffd700 1 -- 172.21.15.32:0/3219842063 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f040006dbe0 con 0x7f03e8003a20 2023-10-08T06:10:06.355 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.348+0000 7f03feffd700 1 -- 172.21.15.32:0/3219842063 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03e800bf70 con 0x7f03e8004870 2023-10-08T06:10:06.355 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.348+0000 7f0404f27700 1 --2- 172.21.15.32:0/3219842063 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0400161620 0x7f040006fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T06:10:06.355 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.348+0000 7f03fffff700 1 --2- 172.21.15.32:0/3219842063 >> v2:172.21.15.40:3300/0 conn(0x7f040015d370 0x7f040006d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T06:10:06.355 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.348+0000 7f03ff7fe700 1 --2- 172.21.15.32:0/3219842063 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f03e8004870 0x7f03e8004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:06.355 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.348+0000 7f0404f27700 1 --2- 172.21.15.32:0/3219842063 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f03e8005230 0x7f03e800ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:06.355 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.348+0000 7f03fffff700 1 --2- 172.21.15.32:0/3219842063 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f03e8003a20 0x7f03e8003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:06.355 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.348+0000 7f03ff7fe700 1 -- 172.21.15.32:0/3219842063 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f03e8003a20 msgr2=0x7f03e8003e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:10:06.355 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.348+0000 7f03ff7fe700 1 --2- 172.21.15.32:0/3219842063 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f03e8003a20 0x7f03e8003e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:06.355 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.348+0000 7f03ff7fe700 1 -- 172.21.15.32:0/3219842063 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f03e8005230 msgr2=0x7f03e800ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:10:06.355 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.348+0000 7f03ff7fe700 1 --2- 172.21.15.32:0/3219842063 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f03e8005230 0x7f03e800ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:06.355 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.348+0000 7f03ff7fe700 1 -- 172.21.15.32:0/3219842063 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03e80035d0 con 0x7f03e8004870 2023-10-08T06:10:06.355 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.352+0000 7f03ff7fe700 1 --2- 172.21.15.32:0/3219842063 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f03e8004870 0x7f03e8004cf0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f03f000a860 tx=0x7f03e80058a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e6e689f3b73f39de server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:06.356 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.352+0000 7f03feffd700 1 -- 172.21.15.32:0/3219842063 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03f00072d0 con 0x7f03e8004870 2023-10-08T06:10:06.356 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.352+0000 7f03feffd700 1 -- 172.21.15.32:0/3219842063 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03f0007450 con 0x7f03e8004870 2023-10-08T06:10:06.356 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.352+0000 7f03feffd700 1 -- 172.21.15.32:0/3219842063 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03f0007800 con 0x7f03e8004870 2023-10-08T06:10:06.356 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.352+0000 7f040698a700 1 -- 172.21.15.32:0/3219842063 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f03e8004870 msgr2=0x7f03e8004cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:06.356 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.352+0000 7f040698a700 1 --2- 172.21.15.32:0/3219842063 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f03e8004870 0x7f03e8004cf0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f03f000a860 tx=0x7f03e80058a0 comp rx=0 tx=0).stop 2023-10-08T06:10:06.356 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.352+0000 7f0404f27700 1 -- 172.21.15.32:0/3219842063 reap_dead start 2023-10-08T06:10:06.356 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.352+0000 7f040698a700 1 -- 172.21.15.32:0/3219842063 shutdown_connections 2023-10-08T06:10:06.356 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.352+0000 7f040698a700 1 -- 172.21.15.32:0/3219842063 >> 172.21.15.32:0/3219842063 conn(0x7f04000cee80 msgr2=0x7f04000cf290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:10:06.356 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.352+0000 7f040698a700 1 -- 172.21.15.32:0/3219842063 shutdown_connections 2023-10-08T06:10:06.356 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.352+0000 7f040698a700 1 -- 172.21.15.32:0/3219842063 wait complete. 2023-10-08T06:10:06.358 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.352+0000 7f040698a700 1 Processor -- start 2023-10-08T06:10:06.358 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.352+0000 7f040698a700 1 -- start start 2023-10-08T06:10:06.358 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.356+0000 7f040698a700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f03e8004870 0x7f04000b4360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:06.359 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.356+0000 7f040698a700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f04001f2430 0x7f0400153000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:06.359 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.356+0000 7f040698a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f04001f28b0 0x7f0400153540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:06.359 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.356+0000 7f040698a700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04000b1cd0 con 0x7f03e8004870 2023-10-08T06:10:06.359 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.356+0000 7f040698a700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04001558d0 con 0x7f04001f28b0 2023-10-08T06:10:06.359 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.356+0000 7f040698a700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0400158750 con 0x7f04001f2430 2023-10-08T06:10:06.359 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.356+0000 7f03fffff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f03e8004870 0x7f04000b4360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:06.359 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.356+0000 7f03fffff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f03e8004870 0x7f04000b4360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:45382/0 (socket says 172.21.15.32:45382) 2023-10-08T06:10:06.359 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.356+0000 7f03fffff700 1 -- 172.21.15.32:0/875774305 learned_addr learned my addr 172.21.15.32:0/875774305 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:10:06.359 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.356+0000 7f03ff7fe700 1 --2- 172.21.15.32:0/875774305 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f04001f2430 0x7f0400153000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:06.359 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.356+0000 7f0404f27700 1 --2- 172.21.15.32:0/875774305 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f04001f28b0 0x7f0400153540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:06.359 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.356+0000 7f03ff7fe700 1 -- 172.21.15.32:0/875774305 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f04001f28b0 msgr2=0x7f0400153540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:06.360 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.356+0000 7f03ff7fe700 1 --2- 172.21.15.32:0/875774305 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f04001f28b0 0x7f0400153540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:06.360 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.356+0000 7f03ff7fe700 1 -- 172.21.15.32:0/875774305 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f03e8004870 msgr2=0x7f04000b4360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:06.360 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.356+0000 7f03ff7fe700 1 --2- 172.21.15.32:0/875774305 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f03e8004870 0x7f04000b4360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:06.360 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.356+0000 7f03ff7fe700 1 -- 172.21.15.32:0/875774305 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0400157eb0 con 0x7f04001f2430 2023-10-08T06:10:06.360 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.356+0000 7f03fffff700 1 --2- 172.21.15.32:0/875774305 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f03e8004870 0x7f04000b4360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T06:10:06.360 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.356+0000 7f03ff7fe700 1 --2- 172.21.15.32:0/875774305 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f04001f2430 0x7f0400153000 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f03f0015000 tx=0x7f03f0001d80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:06.360 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.356+0000 7f03fcff9700 1 -- 172.21.15.32:0/875774305 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03f0012400 con 0x7f04001f2430 2023-10-08T06:10:06.360 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.356+0000 7f03fcff9700 1 -- 172.21.15.32:0/875774305 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03f0012560 con 0x7f04001f2430 2023-10-08T06:10:06.360 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.356+0000 7f040698a700 1 -- 172.21.15.32:0/875774305 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0400158190 con 0x7f04001f2430 2023-10-08T06:10:06.360 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.356+0000 7f03fcff9700 1 -- 172.21.15.32:0/875774305 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03f00128d0 con 0x7f04001f2430 2023-10-08T06:10:06.360 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.356+0000 7f040698a700 1 -- 172.21.15.32:0/875774305 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04000b48a0 con 0x7f04001f2430 2023-10-08T06:10:06.361 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.360+0000 7f040698a700 1 -- 172.21.15.32:0/875774305 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04000cf4c0 con 0x7f04001f2430 2023-10-08T06:10:06.361 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.360+0000 7f03fcff9700 1 -- 172.21.15.32:0/875774305 <== mon.2 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f03f001a070 con 0x7f04001f2430 2023-10-08T06:10:06.362 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.360+0000 7f03fcff9700 1 --2- 172.21.15.32:0/875774305 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f03ec066510 0x7f03ec0689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:06.362 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.360+0000 7f03fcff9700 1 -- 172.21.15.32:0/875774305 <== mon.2 v2:172.21.15.40:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f03f0086420 con 0x7f04001f2430 2023-10-08T06:10:06.362 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.360+0000 7f03fffff700 1 --2- 172.21.15.32:0/875774305 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f03ec066510 0x7f03ec0689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:06.362 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.360+0000 7f03fffff700 1 --2- 172.21.15.32:0/875774305 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f03ec066510 0x7f03ec0689d0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f03f4009fd0 tx=0x7f03f4009240 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:06.371 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.372+0000 7f03fcff9700 1 -- 172.21.15.32:0/875774305 <== mon.2 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f03f00539b0 con 0x7f04001f2430 2023-10-08T06:10:06.535 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.532+0000 7f040698a700 1 -- 172.21.15.32:0/875774305 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0400073f00 con 0x7f04001f2430 2023-10-08T06:10:06.537 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.536+0000 7f03fcff9700 1 -- 172.21.15.32:0/875774305 <== mon.2 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7f03f0056fd0 con 0x7f04001f2430 2023-10-08T06:10:06.537 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 1 2023-10-08T06:10:06.539 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.536+0000 7f040698a700 1 -- 172.21.15.32:0/875774305 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f03ec066510 msgr2=0x7f03ec0689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:06.540 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.536+0000 7f040698a700 1 --2- 172.21.15.32:0/875774305 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f03ec066510 0x7f03ec0689d0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f03f4009fd0 tx=0x7f03f4009240 comp rx=0 tx=0).stop 2023-10-08T06:10:06.540 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.536+0000 7f040698a700 1 -- 172.21.15.32:0/875774305 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f04001f2430 msgr2=0x7f0400153000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:06.540 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.536+0000 7f040698a700 1 --2- 172.21.15.32:0/875774305 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f04001f2430 0x7f0400153000 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f03f0015000 tx=0x7f03f0001d80 comp rx=0 tx=0).stop 2023-10-08T06:10:06.540 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.536+0000 7f040698a700 1 -- 172.21.15.32:0/875774305 shutdown_connections 2023-10-08T06:10:06.540 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.536+0000 7f040698a700 1 --2- 172.21.15.32:0/875774305 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f03ec066510 0x7f03ec0689d0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:06.540 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.536+0000 7f040698a700 1 --2- 172.21.15.32:0/875774305 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f04001f28b0 0x7f0400153540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:06.540 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.536+0000 7f040698a700 1 --2- 172.21.15.32:0/875774305 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f04001f2430 0x7f0400153000 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:06.540 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.536+0000 7f040698a700 1 --2- 172.21.15.32:0/875774305 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f03e8004870 0x7f04000b4360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:06.540 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.536+0000 7f040698a700 1 -- 172.21.15.32:0/875774305 >> 172.21.15.32:0/875774305 conn(0x7f04000cee80 msgr2=0x7f04000b06a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:10:06.540 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.536+0000 7f040698a700 1 -- 172.21.15.32:0/875774305 shutdown_connections 2023-10-08T06:10:06.541 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.536+0000 7f040698a700 1 -- 172.21.15.32:0/875774305 wait complete. 2023-10-08T06:10:06.552 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-08T06:10:06.678 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.676+0000 7f7e52a45700 1 Processor -- start 2023-10-08T06:10:06.679 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.676+0000 7f7e52a45700 1 -- start start 2023-10-08T06:10:06.680 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.680+0000 7f7e52a45700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f7e4c06e8d0 0x7f7e4c15eda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:06.681 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.680+0000 7f7e52a45700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e4c06ecb0 con 0x7f7e4c06a9b0 2023-10-08T06:10:06.681 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.680+0000 7f7e52a45700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e4c0b1800 con 0x7f7e4c0cbd10 2023-10-08T06:10:06.681 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.680+0000 7f7e52a45700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e4c155d30 con 0x7f7e4c06e8d0 2023-10-08T06:10:06.681 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.680+0000 7f7e51a43700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f7e4c06e8d0 0x7f7e4c15eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:06.681 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.680+0000 7f7e52244700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f7e4c06a9b0 0x7f7e4c15ba90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:46962/0 (socket says 172.21.15.32:46962) 2023-10-08T06:10:06.681 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.680+0000 7f7e52244700 1 -- 172.21.15.32:0/2449857649 learned_addr learned my addr 172.21.15.32:0/2449857649 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-08T06:10:06.682 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.680+0000 7f7e51a43700 1 -- 172.21.15.32:0/2449857649 >> v1:172.21.15.40:6789/0 conn(0x7f7e4c0cbd10 legacy=0x7f7e4c06a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:06.683 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.680+0000 7f7e51a43700 1 -- 172.21.15.32:0/2449857649 >> v1:172.21.15.32:6789/0 conn(0x7f7e4c06a9b0 legacy=0x7f7e4c15ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:06.683 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.680+0000 7f7e51a43700 1 -- 172.21.15.32:0/2449857649 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e4c0b1a50 con 0x7f7e4c06e8d0 2023-10-08T06:10:06.683 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.680+0000 7f7e51a43700 1 --2- 172.21.15.32:0/2449857649 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7e4c06e8d0 0x7f7e4c15eda0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f7e48009850 tx=0x7f7e48009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83f8f74a0c84ac4e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:06.683 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.680+0000 7f7e50a41700 1 -- 172.21.15.32:0/2449857649 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e48011830 con 0x7f7e4c06e8d0 2023-10-08T06:10:06.683 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.680+0000 7f7e50a41700 1 -- 172.21.15.32:0/2449857649 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e48011990 con 0x7f7e4c06e8d0 2023-10-08T06:10:06.683 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.680+0000 7f7e50a41700 1 -- 172.21.15.32:0/2449857649 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e48011d20 con 0x7f7e4c06e8d0 2023-10-08T06:10:06.683 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.680+0000 7f7e52a45700 1 -- 172.21.15.32:0/2449857649 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7e4c06e8d0 msgr2=0x7f7e4c15eda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:06.683 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.680+0000 7f7e52a45700 1 --2- 172.21.15.32:0/2449857649 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7e4c06e8d0 0x7f7e4c15eda0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f7e48009850 tx=0x7f7e48009b60 comp rx=0 tx=0).stop 2023-10-08T06:10:06.683 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.680+0000 7f7e52a45700 1 -- 172.21.15.32:0/2449857649 shutdown_connections 2023-10-08T06:10:06.683 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.680+0000 7f7e52a45700 1 --2- 172.21.15.32:0/2449857649 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7e4c06e8d0 0x7f7e4c15eda0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:06.684 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.680+0000 7f7e52a45700 1 -- 172.21.15.32:0/2449857649 >> 172.21.15.32:0/2449857649 conn(0x7f7e4c0cc800 msgr2=0x7f7e4c0ccbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:10:06.684 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.680+0000 7f7e52a45700 1 -- 172.21.15.32:0/2449857649 shutdown_connections 2023-10-08T06:10:06.684 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.680+0000 7f7e52a45700 1 -- 172.21.15.32:0/2449857649 wait complete. 2023-10-08T06:10:06.685 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.684+0000 7f7e52a45700 1 Processor -- start 2023-10-08T06:10:06.685 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.684+0000 7f7e52a45700 1 -- start start 2023-10-08T06:10:06.687 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.684+0000 7f7e52a45700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7e4c06a9b0 0x7f7e4c1514d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:06.687 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.684+0000 7f7e52a45700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7e4c06e8d0 0x7f7e4c1e6890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:06.688 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.684+0000 7f7e52a45700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7e4c0cbd10 0x7f7e4c15a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:06.688 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.684+0000 7f7e52a45700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e4c0b3a60 con 0x7f7e4c0cbd10 2023-10-08T06:10:06.688 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.684+0000 7f7e52a45700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e4c151a10 con 0x7f7e4c06a9b0 2023-10-08T06:10:06.688 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.684+0000 7f7e52a45700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e4c0b2de0 con 0x7f7e4c06e8d0 2023-10-08T06:10:06.688 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.684+0000 7f7e52244700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7e4c0cbd10 0x7f7e4c15a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:06.688 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.684+0000 7f7e52244700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7e4c0cbd10 0x7f7e4c15a280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:45398/0 (socket says 172.21.15.32:45398) 2023-10-08T06:10:06.688 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.684+0000 7f7e52244700 1 -- 172.21.15.32:0/3636550916 learned_addr learned my addr 172.21.15.32:0/3636550916 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:10:06.688 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.684+0000 7f7e51a43700 1 --2- 172.21.15.32:0/3636550916 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7e4c06a9b0 0x7f7e4c1514d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:06.688 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.684+0000 7f7e51242700 1 --2- 172.21.15.32:0/3636550916 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7e4c06e8d0 0x7f7e4c1e6890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:06.689 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.688+0000 7f7e52244700 1 -- 172.21.15.32:0/3636550916 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7e4c06e8d0 msgr2=0x7f7e4c1e6890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:06.689 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.688+0000 7f7e52244700 1 --2- 172.21.15.32:0/3636550916 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7e4c06e8d0 0x7f7e4c1e6890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:06.689 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.688+0000 7f7e52244700 1 -- 172.21.15.32:0/3636550916 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7e4c06a9b0 msgr2=0x7f7e4c1514d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:06.690 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.688+0000 7f7e52244700 1 --2- 172.21.15.32:0/3636550916 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7e4c06a9b0 0x7f7e4c1514d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:06.690 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.688+0000 7f7e52244700 1 -- 172.21.15.32:0/3636550916 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e480094b0 con 0x7f7e4c0cbd10 2023-10-08T06:10:06.690 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.688+0000 7f7e52244700 1 --2- 172.21.15.32:0/3636550916 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7e4c0cbd10 0x7f7e4c15a280 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f7e4400caf0 tx=0x7f7e4400cb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:06.690 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.688+0000 7f7e3e7fc700 1 -- 172.21.15.32:0/3636550916 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e44007480 con 0x7f7e4c0cbd10 2023-10-08T06:10:06.690 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.688+0000 7f7e3e7fc700 1 -- 172.21.15.32:0/3636550916 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e440075e0 con 0x7f7e4c0cbd10 2023-10-08T06:10:06.690 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.688+0000 7f7e52a45700 1 -- 172.21.15.32:0/3636550916 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e4c0b30c0 con 0x7f7e4c0cbd10 2023-10-08T06:10:06.690 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.688+0000 7f7e3e7fc700 1 -- 172.21.15.32:0/3636550916 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e44007950 con 0x7f7e4c0cbd10 2023-10-08T06:10:06.690 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.688+0000 7f7e52a45700 1 -- 172.21.15.32:0/3636550916 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e4c0b3680 con 0x7f7e4c0cbd10 2023-10-08T06:10:06.691 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.688+0000 7f7e52a45700 1 -- 172.21.15.32:0/3636550916 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e4c0b3ba0 con 0x7f7e4c0cbd10 2023-10-08T06:10:06.691 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.688+0000 7f7e3e7fc700 1 -- 172.21.15.32:0/3636550916 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f7e4401b3b0 con 0x7f7e4c0cbd10 2023-10-08T06:10:06.692 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.692+0000 7f7e3e7fc700 1 --2- 172.21.15.32:0/3636550916 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f7e30066510 0x7f7e300689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:06.692 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.692+0000 7f7e3e7fc700 1 -- 172.21.15.32:0/3636550916 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7e440835d0 con 0x7f7e4c0cbd10 2023-10-08T06:10:06.692 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.692+0000 7f7e51a43700 1 --2- 172.21.15.32:0/3636550916 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f7e30066510 0x7f7e300689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:06.692 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.692+0000 7f7e51a43700 1 --2- 172.21.15.32:0/3636550916 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f7e30066510 0x7f7e300689d0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f7e48009fd0 tx=0x7f7e48008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:06.701 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.700+0000 7f7e3e7fc700 1 -- 172.21.15.32:0/3636550916 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f7e4c0b3ba0 con 0x7f7e4c0cbd10 2023-10-08T06:10:06.866 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.864+0000 7f7e52a45700 1 -- 172.21.15.32:0/3636550916 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7e4c0b3ba0 con 0x7f7e4c0cbd10 2023-10-08T06:10:06.867 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.864+0000 7f7e3e7fc700 1 -- 172.21.15.32:0/3636550916 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7e4c0b3ba0 con 0x7f7e4c0cbd10 2023-10-08T06:10:06.867 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 32 2023-10-08T06:10:06.870 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.868+0000 7f7e52a45700 1 -- 172.21.15.32:0/3636550916 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f7e30066510 msgr2=0x7f7e300689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:06.870 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.868+0000 7f7e52a45700 1 --2- 172.21.15.32:0/3636550916 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f7e30066510 0x7f7e300689d0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f7e48009fd0 tx=0x7f7e48008030 comp rx=0 tx=0).stop 2023-10-08T06:10:06.870 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.868+0000 7f7e52a45700 1 -- 172.21.15.32:0/3636550916 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7e4c0cbd10 msgr2=0x7f7e4c15a280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:06.870 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.868+0000 7f7e52a45700 1 --2- 172.21.15.32:0/3636550916 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7e4c0cbd10 0x7f7e4c15a280 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f7e4400caf0 tx=0x7f7e4400cb20 comp rx=0 tx=0).stop 2023-10-08T06:10:06.870 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.868+0000 7f7e52a45700 1 -- 172.21.15.32:0/3636550916 shutdown_connections 2023-10-08T06:10:06.870 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.868+0000 7f7e52a45700 1 --2- 172.21.15.32:0/3636550916 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f7e30066510 0x7f7e300689d0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:06.870 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.868+0000 7f7e52a45700 1 --2- 172.21.15.32:0/3636550916 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7e4c0cbd10 0x7f7e4c15a280 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:06.870 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.868+0000 7f7e52a45700 1 --2- 172.21.15.32:0/3636550916 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7e4c06e8d0 0x7f7e4c1e6890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:06.870 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.868+0000 7f7e52a45700 1 --2- 172.21.15.32:0/3636550916 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7e4c06a9b0 0x7f7e4c1514d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:06.871 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.868+0000 7f7e52a45700 1 -- 172.21.15.32:0/3636550916 >> 172.21.15.32:0/3636550916 conn(0x7f7e4c0cc800 msgr2=0x7f7e4c15ba90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:10:06.871 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.868+0000 7f7e52a45700 1 -- 172.21.15.32:0/3636550916 shutdown_connections 2023-10-08T06:10:06.871 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:06.868+0000 7f7e52a45700 1 -- 172.21.15.32:0/3636550916 wait complete. 2023-10-08T06:10:06.881 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-08T06:10:07.000 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:07.000+0000 7f56399b4700 1 Processor -- start 2023-10-08T06:10:07.001 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:07.000+0000 7f56399b4700 1 -- start start 2023-10-08T06:10:07.002 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:07.000+0000 7f56399b4700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f56340b6280 0x7f56340cb4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:07.002 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:07.000+0000 7f56399b4700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f563415c0c0 0x7f56340b28f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:07.002 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:07.000+0000 7f56399b4700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f56340b2e30 0x7f563415ec30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:07.002 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:07.000+0000 7f56399b4700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f563415c610 con 0x7f563415c0c0 2023-10-08T06:10:07.003 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:07.000+0000 7f56399b4700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56340b32c0 con 0x7f56340b6280 2023-10-08T06:10:07.003 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:07.000+0000 7f56399b4700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56340d0cd0 con 0x7f56340b2e30 2023-10-08T06:10:07.003 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:07.000+0000 7f5633fff700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f563415c0c0 0x7f56340b28f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:07.003 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:07.000+0000 7f56389b2700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f56340b6280 0x7f56340cb4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:07.003 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:07.000+0000 7f56389b2700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f56340b6280 0x7f56340cb4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.32:51820/0 (socket says 172.21.15.32:51820) 2023-10-08T06:10:07.003 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:07.000+0000 7f56389b2700 1 -- 172.21.15.32:0/1109040829 learned_addr learned my addr 172.21.15.32:0/1109040829 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:10:07.003 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:07.000+0000 7f5633fff700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f563415c0c0 0x7f56340b28f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:45402/0 (socket says 172.21.15.32:45402) 2023-10-08T06:10:07.003 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:07.000+0000 7f56391b3700 1 --2- 172.21.15.32:0/1109040829 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f56340b2e30 0x7f563415ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:07.005 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:07.000+0000 7f56389b2700 1 -- 172.21.15.32:0/1109040829 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f56340b2e30 msgr2=0x7f563415ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:10:07.005 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:07.000+0000 7f56389b2700 1 --2- 172.21.15.32:0/1109040829 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f56340b2e30 0x7f563415ec30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:07.005 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:07.000+0000 7f56389b2700 1 -- 172.21.15.32:0/1109040829 >> v2:172.21.15.32:3300/0 conn(0x7f563415c0c0 msgr2=0x7f56340b28f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:10:07.005 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:07.000+0000 7f56389b2700 1 --2- 172.21.15.32:0/1109040829 >> v2:172.21.15.32:3300/0 conn(0x7f563415c0c0 0x7f56340b28f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:07.006 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:07.000+0000 7f56389b2700 1 -- 172.21.15.32:0/1109040829 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56340d0560 con 0x7f56340b6280 2023-10-08T06:10:07.006 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:07.000+0000 7f56389b2700 1 --2- 172.21.15.32:0/1109040829 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f56340b6280 0x7f56340cb4c0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f563406dac0 tx=0x7f5624009bf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1a9a281c93168aad server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:07.006 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:07.000+0000 7f56337fe700 1 -- 172.21.15.32:0/1109040829 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5624011830 con 0x7f56340b6280 2023-10-08T06:10:07.006 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:07.000+0000 7f56337fe700 1 -- 172.21.15.32:0/1109040829 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5624011990 con 0x7f56340b6280 2023-10-08T06:10:07.006 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:07.000+0000 7f56337fe700 1 -- 172.21.15.32:0/1109040829 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5624011d20 con 0x7f56340b6280 2023-10-08T06:10:07.006 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:07.004+0000 7f56399b4700 1 -- 172.21.15.32:0/1109040829 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f56340b6280 msgr2=0x7f56340cb4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:07.006 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:07.004+0000 7f56399b4700 1 --2- 172.21.15.32:0/1109040829 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f56340b6280 0x7f56340cb4c0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f563406dac0 tx=0x7f5624009bf0 comp rx=0 tx=0).stop 2023-10-08T06:10:07.006 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:07.004+0000 7f56399b4700 1 -- 172.21.15.32:0/1109040829 shutdown_connections 2023-10-08T06:10:07.006 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:07.004+0000 7f56399b4700 1 --2- 172.21.15.32:0/1109040829 >> v2:172.21.15.32:3300/0 conn(0x7f563415c0c0 0x7f56340b28f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:07.007 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:07.004+0000 7f56399b4700 1 --2- 172.21.15.32:0/1109040829 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f56340b2e30 0x7f563415ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:07.007 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:07.004+0000 7f56399b4700 1 --2- 172.21.15.32:0/1109040829 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f56340b6280 0x7f56340cb4c0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:07.007 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:07.004+0000 7f56399b4700 1 -- 172.21.15.32:0/1109040829 >> 172.21.15.32:0/1109040829 conn(0x7f563406dfa0 msgr2=0x7f563406e380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:10:07.007 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:07.004+0000 7f56399b4700 1 -- 172.21.15.32:0/1109040829 shutdown_connections 2023-10-08T06:10:07.007 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:07.004+0000 7f56399b4700 1 -- 172.21.15.32:0/1109040829 wait complete. 2023-10-08T06:10:07.007 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:07.004+0000 7f56399b4700 1 Processor -- start 2023-10-08T06:10:07.008 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:07.004+0000 7f56399b4700 1 -- start start 2023-10-08T06:10:07.010 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:07.008+0000 7f56399b4700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f56340b2e30 0x7f563415c770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:07.010 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:07.008+0000 7f56399b4700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f56340b6280 0x7f56340c49a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:07.010 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:07.008+0000 7f56399b4700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f563415c0c0 0x7f56340c7370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:07.010 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:07.008+0000 7f56399b4700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56340c8950 con 0x7f563415c0c0 2023-10-08T06:10:07.010 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:07.008+0000 7f56399b4700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56340c8e80 con 0x7f56340b6280 2023-10-08T06:10:07.010 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:07.008+0000 7f56399b4700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56340c8ba0 con 0x7f56340b2e30 2023-10-08T06:10:07.011 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:07.008+0000 7f56391b3700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f563415c0c0 0x7f56340c7370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:07.011 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:07.008+0000 7f56389b2700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f56340b2e30 0x7f563415c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:07.011 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:07.008+0000 7f56391b3700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f563415c0c0 0x7f56340c7370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:45404/0 (socket says 172.21.15.32:45404) 2023-10-08T06:10:07.011 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:07.008+0000 7f56391b3700 1 -- 172.21.15.32:0/2889476279 learned_addr learned my addr 172.21.15.32:0/2889476279 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:10:07.011 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:07.008+0000 7f5633fff700 1 --2- 172.21.15.32:0/2889476279 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f56340b6280 0x7f56340c49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:07.011 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:07.008+0000 7f56391b3700 1 -- 172.21.15.32:0/2889476279 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f56340b2e30 msgr2=0x7f563415c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:07.011 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:07.008+0000 7f56391b3700 1 --2- 172.21.15.32:0/2889476279 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f56340b2e30 0x7f563415c770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:07.011 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:07.008+0000 7f56391b3700 1 -- 172.21.15.32:0/2889476279 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f56340b6280 msgr2=0x7f56340c49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:07.011 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:07.008+0000 7f56391b3700 1 --2- 172.21.15.32:0/2889476279 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f56340b6280 0x7f56340c49a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:07.012 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:07.008+0000 7f56391b3700 1 -- 172.21.15.32:0/2889476279 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5624009570 con 0x7f563415c0c0 2023-10-08T06:10:07.012 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:07.008+0000 7f56389b2700 1 --2- 172.21.15.32:0/2889476279 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f56340b2e30 0x7f563415c770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T06:10:07.012 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:07.008+0000 7f56391b3700 1 --2- 172.21.15.32:0/2889476279 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f563415c0c0 0x7f56340c7370 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f562c0116c0 tx=0x7f562c0119d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:07.013 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:07.008+0000 7f56317fa700 1 -- 172.21.15.32:0/2889476279 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f562c00bd00 con 0x7f563415c0c0 2023-10-08T06:10:07.013 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:07.008+0000 7f56317fa700 1 -- 172.21.15.32:0/2889476279 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f562c00e5e0 con 0x7f563415c0c0 2023-10-08T06:10:07.013 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:07.008+0000 7f56399b4700 1 -- 172.21.15.32:0/2889476279 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56340c5470 con 0x7f563415c0c0 2023-10-08T06:10:07.013 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:07.008+0000 7f56317fa700 1 -- 172.21.15.32:0/2889476279 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f562c00e970 con 0x7f563415c0c0 2023-10-08T06:10:07.013 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:07.008+0000 7f56399b4700 1 -- 172.21.15.32:0/2889476279 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56340c5ac0 con 0x7f563415c0c0 2023-10-08T06:10:07.013 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:07.012+0000 7f56399b4700 1 -- 172.21.15.32:0/2889476279 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56340b3790 con 0x7f563415c0c0 2023-10-08T06:10:07.013 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:07.012+0000 7f56317fa700 1 -- 172.21.15.32:0/2889476279 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f562c00ead0 con 0x7f563415c0c0 2023-10-08T06:10:07.014 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:07.012+0000 7f56317fa700 1 --2- 172.21.15.32:0/2889476279 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f5620066540 0x7f5620068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:07.015 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:07.012+0000 7f56317fa700 1 -- 172.21.15.32:0/2889476279 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f562c088fe0 con 0x7f563415c0c0 2023-10-08T06:10:07.015 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:07.012+0000 7f56389b2700 1 --2- 172.21.15.32:0/2889476279 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f5620066540 0x7f5620068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:07.015 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:07.012+0000 7f56389b2700 1 --2- 172.21.15.32:0/2889476279 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f5620066540 0x7f5620068a00 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f5624000c00 tx=0x7f5624008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:07.021 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:07.020+0000 7f56317fa700 1 -- 172.21.15.32:0/2889476279 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f562c0563c0 con 0x7f563415c0c0 2023-10-08T06:10:07.187 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:07.184+0000 7f56399b4700 1 -- 172.21.15.32:0/2889476279 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f56340686a0 con 0x7f563415c0c0 2023-10-08T06:10:07.188 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:07.188+0000 7f56317fa700 1 -- 172.21.15.32:0/2889476279 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f562c020020 con 0x7f563415c0c0 2023-10-08T06:10:07.188 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 64 2023-10-08T06:10:07.190 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:07.188+0000 7f56399b4700 1 -- 172.21.15.32:0/2889476279 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f5620066540 msgr2=0x7f5620068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:07.191 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:07.188+0000 7f56399b4700 1 --2- 172.21.15.32:0/2889476279 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f5620066540 0x7f5620068a00 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f5624000c00 tx=0x7f5624008030 comp rx=0 tx=0).stop 2023-10-08T06:10:07.191 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:07.188+0000 7f56399b4700 1 -- 172.21.15.32:0/2889476279 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f563415c0c0 msgr2=0x7f56340c7370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:07.191 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:07.188+0000 7f56399b4700 1 --2- 172.21.15.32:0/2889476279 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f563415c0c0 0x7f56340c7370 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f562c0116c0 tx=0x7f562c0119d0 comp rx=0 tx=0).stop 2023-10-08T06:10:07.191 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:07.188+0000 7f56399b4700 1 -- 172.21.15.32:0/2889476279 shutdown_connections 2023-10-08T06:10:07.191 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:07.188+0000 7f56399b4700 1 --2- 172.21.15.32:0/2889476279 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f5620066540 0x7f5620068a00 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:07.191 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:07.188+0000 7f56399b4700 1 --2- 172.21.15.32:0/2889476279 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f563415c0c0 0x7f56340c7370 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:07.191 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:07.188+0000 7f56399b4700 1 --2- 172.21.15.32:0/2889476279 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f56340b6280 0x7f56340c49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:07.191 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:07.188+0000 7f56399b4700 1 --2- 172.21.15.32:0/2889476279 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f56340b2e30 0x7f563415c770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:07.191 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:07.188+0000 7f56399b4700 1 -- 172.21.15.32:0/2889476279 >> 172.21.15.32:0/2889476279 conn(0x7f563406dfa0 msgr2=0x7f56340b4ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:10:07.192 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:07.188+0000 7f56399b4700 1 -- 172.21.15.32:0/2889476279 shutdown_connections 2023-10-08T06:10:07.192 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:07.188+0000 7f56399b4700 1 -- 172.21.15.32:0/2889476279 wait complete. 2023-10-08T06:10:07.202 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic' 2023-10-08T06:10:07.314 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:07.312+0000 7f1b127a2700 1 Processor -- start 2023-10-08T06:10:07.315 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:07.312+0000 7f1b127a2700 1 -- start start 2023-10-08T06:10:07.317 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:07.316+0000 7f1b127a2700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1b0c0c9cd0 0x7f1b0c0ca110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:07.317 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:07.316+0000 7f1b127a2700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f1b0c070780 0x7f1b0c070c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:07.317 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:07.316+0000 7f1b127a2700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b0c0ca650 con 0x7f1b0c159940 2023-10-08T06:10:07.317 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:07.316+0000 7f1b127a2700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b0c06ae50 con 0x7f1b0c070780 2023-10-08T06:10:07.318 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:07.316+0000 7f1b127a2700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b0c0cf150 con 0x7f1b0c0c9cd0 2023-10-08T06:10:07.318 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:07.316+0000 7f1b11fa1700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f1b0c070780 0x7f1b0c070c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:07.318 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:07.316+0000 7f1b10f9f700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1b0c0c9cd0 0x7f1b0c0ca110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:07.318 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:07.316+0000 7f1b117a0700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f1b0c159940 0x7f1b0c0cea40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.32:41106/0 (socket says 172.21.15.32:41106) 2023-10-08T06:10:07.318 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:07.316+0000 7f1b117a0700 1 -- 172.21.15.32:0/1081307173 learned_addr learned my addr 172.21.15.32:0/1081307173 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-08T06:10:07.319 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:07.316+0000 7f1b11fa1700 1 -- 172.21.15.32:0/1081307173 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1b0c0c9cd0 msgr2=0x7f1b0c0ca110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:10:07.320 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:07.316+0000 7f1b11fa1700 1 --2- 172.21.15.32:0/1081307173 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1b0c0c9cd0 0x7f1b0c0ca110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:07.321 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:07.316+0000 7f1b11fa1700 1 -- 172.21.15.32:0/1081307173 >> v1:172.21.15.40:6789/0 conn(0x7f1b0c159940 legacy=0x7f1b0c0cea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:07.321 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:07.316+0000 7f1b11fa1700 1 -- 172.21.15.32:0/1081307173 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b0c06b0f0 con 0x7f1b0c070780 2023-10-08T06:10:07.321 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:07.316+0000 7f1b10f9f700 1 --2- 172.21.15.32:0/1081307173 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1b0c0c9cd0 0x7f1b0c0ca110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T06:10:07.321 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:07.316+0000 7f1b11fa1700 1 --2- 172.21.15.32:0/1081307173 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1b0c070780 0x7f1b0c070c10 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f1b04009d90 tx=0x7f1b0400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fda323fe4c97795f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:07.321 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:07.316+0000 7f1b03fff700 1 -- 172.21.15.32:0/1081307173 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b0400e070 con 0x7f1b0c070780 2023-10-08T06:10:07.321 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:07.316+0000 7f1b03fff700 1 -- 172.21.15.32:0/1081307173 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b04003a40 con 0x7f1b0c070780 2023-10-08T06:10:07.321 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:07.316+0000 7f1b03fff700 1 -- 172.21.15.32:0/1081307173 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b04003df0 con 0x7f1b0c070780 2023-10-08T06:10:07.321 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:07.316+0000 7f1b127a2700 1 -- 172.21.15.32:0/1081307173 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1b0c070780 msgr2=0x7f1b0c070c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:07.321 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:07.316+0000 7f1b127a2700 1 --2- 172.21.15.32:0/1081307173 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1b0c070780 0x7f1b0c070c10 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f1b04009d90 tx=0x7f1b0400b330 comp rx=0 tx=0).stop 2023-10-08T06:10:07.321 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:07.320+0000 7f1b127a2700 1 -- 172.21.15.32:0/1081307173 shutdown_connections 2023-10-08T06:10:07.322 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:07.320+0000 7f1b127a2700 1 --2- 172.21.15.32:0/1081307173 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1b0c070780 0x7f1b0c070c10 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:07.322 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:07.320+0000 7f1b127a2700 1 --2- 172.21.15.32:0/1081307173 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1b0c0c9cd0 0x7f1b0c0ca110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:07.322 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:07.320+0000 7f1b127a2700 1 -- 172.21.15.32:0/1081307173 >> 172.21.15.32:0/1081307173 conn(0x7f1b0c0cf470 msgr2=0x7f1b0c0cf880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:10:07.322 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:07.320+0000 7f1b127a2700 1 -- 172.21.15.32:0/1081307173 shutdown_connections 2023-10-08T06:10:07.322 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:07.320+0000 7f1b127a2700 1 -- 172.21.15.32:0/1081307173 wait complete. 2023-10-08T06:10:07.324 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:07.320+0000 7f1b127a2700 1 Processor -- start 2023-10-08T06:10:07.324 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:07.320+0000 7f1b127a2700 1 -- start start 2023-10-08T06:10:07.324 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:07.320+0000 7f1b127a2700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1b0c070780 0x7f1b0c145480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:07.324 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:07.320+0000 7f1b127a2700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1b0c0c9cd0 0x7f1b0c147f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:07.324 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:07.320+0000 7f1b127a2700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1b0c159940 0x7f1b0c1f2340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:07.325 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:07.320+0000 7f1b127a2700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b0c148460 con 0x7f1b0c0c9cd0 2023-10-08T06:10:07.325 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:07.320+0000 7f1b127a2700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b0c146670 con 0x7f1b0c070780 2023-10-08T06:10:07.325 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:07.320+0000 7f1b127a2700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b0c1f2880 con 0x7f1b0c159940 2023-10-08T06:10:07.325 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:07.320+0000 7f1b10f9f700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1b0c0c9cd0 0x7f1b0c147f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:07.325 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:07.320+0000 7f1b10f9f700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1b0c0c9cd0 0x7f1b0c147f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:45406/0 (socket says 172.21.15.32:45406) 2023-10-08T06:10:07.325 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:07.320+0000 7f1b10f9f700 1 -- 172.21.15.32:0/2819288690 learned_addr learned my addr 172.21.15.32:0/2819288690 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:10:07.325 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:07.320+0000 7f1b117a0700 1 --2- 172.21.15.32:0/2819288690 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1b0c070780 0x7f1b0c145480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:07.325 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:07.320+0000 7f1b11fa1700 1 --2- 172.21.15.32:0/2819288690 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1b0c159940 0x7f1b0c1f2340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:07.325 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:07.320+0000 7f1b10f9f700 1 -- 172.21.15.32:0/2819288690 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1b0c159940 msgr2=0x7f1b0c1f2340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:07.325 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:07.320+0000 7f1b10f9f700 1 --2- 172.21.15.32:0/2819288690 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1b0c159940 0x7f1b0c1f2340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:07.326 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:07.320+0000 7f1b10f9f700 1 -- 172.21.15.32:0/2819288690 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1b0c070780 msgr2=0x7f1b0c145480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:07.326 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:07.320+0000 7f1b10f9f700 1 --2- 172.21.15.32:0/2819288690 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1b0c070780 0x7f1b0c145480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:07.326 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:07.324+0000 7f1b10f9f700 1 -- 172.21.15.32:0/2819288690 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1afc00a650 con 0x7f1b0c0c9cd0 2023-10-08T06:10:07.326 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:07.324+0000 7f1b10f9f700 1 --2- 172.21.15.32:0/2819288690 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1b0c0c9cd0 0x7f1b0c147f20 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f1afc00ea50 tx=0x7f1afc00ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:07.326 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:07.324+0000 7f1b01ffb700 1 -- 172.21.15.32:0/2819288690 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1afc00cb50 con 0x7f1b0c0c9cd0 2023-10-08T06:10:07.326 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:07.324+0000 7f1b01ffb700 1 -- 172.21.15.32:0/2819288690 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1afc00ccb0 con 0x7f1b0c0c9cd0 2023-10-08T06:10:07.326 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:07.324+0000 7f1b127a2700 1 -- 172.21.15.32:0/2819288690 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b04009a70 con 0x7f1b0c0c9cd0 2023-10-08T06:10:07.326 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:07.324+0000 7f1b01ffb700 1 -- 172.21.15.32:0/2819288690 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1afc011610 con 0x7f1b0c0c9cd0 2023-10-08T06:10:07.326 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:07.324+0000 7f1b127a2700 1 -- 172.21.15.32:0/2819288690 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b0c145d40 con 0x7f1b0c0c9cd0 2023-10-08T06:10:07.327 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:07.324+0000 7f1b01ffb700 1 -- 172.21.15.32:0/2819288690 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f1afc011770 con 0x7f1b0c0c9cd0 2023-10-08T06:10:07.327 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:07.324+0000 7f1b127a2700 1 -- 172.21.15.32:0/2819288690 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b0c0686a0 con 0x7f1b0c0c9cd0 2023-10-08T06:10:07.327 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:07.324+0000 7f1b01ffb700 1 --2- 172.21.15.32:0/2819288690 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f1af0066540 0x7f1af0068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:07.327 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:07.324+0000 7f1b01ffb700 1 -- 172.21.15.32:0/2819288690 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1afc083b90 con 0x7f1b0c0c9cd0 2023-10-08T06:10:07.327 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:07.324+0000 7f1b117a0700 1 --2- 172.21.15.32:0/2819288690 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f1af0066540 0x7f1af0068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:07.328 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:07.328+0000 7f1b117a0700 1 --2- 172.21.15.32:0/2819288690 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f1af0066540 0x7f1af0068a00 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f1b08001300 tx=0x7f1b08001290 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:07.335 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:07.332+0000 7f1b01ffb700 1 -- 172.21.15.32:0/2819288690 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f1afc051010 con 0x7f1b0c0c9cd0 2023-10-08T06:10:07.558 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:07.556+0000 7f1b127a2700 1 -- 172.21.15.32:0/2819288690 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]} v 0) v1 -- 0x7f1b0c073810 con 0x7f1b0c0c9cd0 2023-10-08T06:10:08.193 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:08.192+0000 7f1b01ffb700 1 -- 172.21.15.32:0/2819288690 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]}]=0 v51) v1 ==== 147+0+0 (secure 0 0 0) 0x7f1afc0160d0 con 0x7f1b0c0c9cd0 2023-10-08T06:10:08.196 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:08.196+0000 7f1b127a2700 1 -- 172.21.15.32:0/2819288690 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f1af0066540 msgr2=0x7f1af0068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:08.196 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:08.196+0000 7f1b127a2700 1 --2- 172.21.15.32:0/2819288690 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f1af0066540 0x7f1af0068a00 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f1b08001300 tx=0x7f1b08001290 comp rx=0 tx=0).stop 2023-10-08T06:10:08.197 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:08.196+0000 7f1b127a2700 1 -- 172.21.15.32:0/2819288690 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1b0c0c9cd0 msgr2=0x7f1b0c147f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:08.197 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:08.196+0000 7f1b127a2700 1 --2- 172.21.15.32:0/2819288690 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1b0c0c9cd0 0x7f1b0c147f20 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f1afc00ea50 tx=0x7f1afc00ed60 comp rx=0 tx=0).stop 2023-10-08T06:10:08.197 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:08.196+0000 7f1b127a2700 1 -- 172.21.15.32:0/2819288690 shutdown_connections 2023-10-08T06:10:08.197 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:08.196+0000 7f1b127a2700 1 --2- 172.21.15.32:0/2819288690 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f1af0066540 0x7f1af0068a00 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:08.197 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:08.196+0000 7f1b127a2700 1 --2- 172.21.15.32:0/2819288690 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1b0c0c9cd0 0x7f1b0c147f20 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:08.197 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:08.196+0000 7f1b127a2700 1 --2- 172.21.15.32:0/2819288690 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1b0c159940 0x7f1b0c1f2340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:08.197 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:08.196+0000 7f1b127a2700 1 --2- 172.21.15.32:0/2819288690 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1b0c070780 0x7f1b0c145480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:08.197 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:08.196+0000 7f1b127a2700 1 -- 172.21.15.32:0/2819288690 >> 172.21.15.32:0/2819288690 conn(0x7f1b0c0cf470 msgr2=0x7f1b0c0ce8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:10:08.197 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:08.196+0000 7f1b127a2700 1 -- 172.21.15.32:0/2819288690 shutdown_connections 2023-10-08T06:10:08.197 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:08.196+0000 7f1b127a2700 1 -- 172.21.15.32:0/2819288690 wait complete. 2023-10-08T06:10:08.212 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-08T06:10:08.331 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:08.328+0000 7f6120df8700 1 Processor -- start 2023-10-08T06:10:08.331 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:08.328+0000 7f6120df8700 1 -- start start 2023-10-08T06:10:08.333 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:08.332+0000 7f6120df8700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6114039090 0x7f61140e3c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:08.333 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:08.332+0000 7f6120df8700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6114055380 con 0x7f61140e0050 2023-10-08T06:10:08.333 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:08.332+0000 7f6120df8700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6114008130 con 0x7f61140e4850 2023-10-08T06:10:08.333 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:08.332+0000 7f6120df8700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6114055b80 con 0x7f6114039090 2023-10-08T06:10:08.333 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:08.332+0000 7f611b7fe700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f61140e0050 0x7f6114054c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:46976/0 (socket says 172.21.15.32:46976) 2023-10-08T06:10:08.334 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:08.332+0000 7f611b7fe700 1 -- 172.21.15.32:0/956601253 learned_addr learned my addr 172.21.15.32:0/956601253 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-08T06:10:08.335 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:08.332+0000 7f611affd700 1 --2- 172.21.15.32:0/956601253 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6114039090 0x7f61140e3c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:08.335 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:08.332+0000 7f611a7fc700 1 -- 172.21.15.32:0/956601253 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 599468115 0 0) 0x7f6110001110 con 0x7f61140e0050 2023-10-08T06:10:08.335 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:08.332+0000 7f611a7fc700 1 -- 172.21.15.32:0/956601253 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f610c0035d0 con 0x7f61140e0050 2023-10-08T06:10:08.335 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:08.332+0000 7f611a7fc700 1 -- 172.21.15.32:0/956601253 <== mon.1 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1068099722 0 0) 0x7f6114008130 con 0x7f61140e4850 2023-10-08T06:10:08.335 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:08.332+0000 7f611a7fc700 1 -- 172.21.15.32:0/956601253 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6110001110 con 0x7f61140e4850 2023-10-08T06:10:08.335 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:08.332+0000 7f611affd700 1 -- 172.21.15.32:0/956601253 >> v1:172.21.15.40:6789/0 conn(0x7f61140e4850 legacy=0x7f61140085c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:08.335 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:08.332+0000 7f611affd700 1 -- 172.21.15.32:0/956601253 >> v1:172.21.15.32:6789/0 conn(0x7f61140e0050 legacy=0x7f6114054c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:08.336 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:08.332+0000 7f611affd700 1 -- 172.21.15.32:0/956601253 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61140555c0 con 0x7f6114039090 2023-10-08T06:10:08.336 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:08.332+0000 7f611affd700 1 --2- 172.21.15.32:0/956601253 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6114039090 0x7f61140e3c90 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f6108009880 tx=0x7f6108009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a130693a5dd9cb4b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:08.336 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:08.332+0000 7f611a7fc700 1 -- 172.21.15.32:0/956601253 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6108011830 con 0x7f6114039090 2023-10-08T06:10:08.337 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:08.332+0000 7f611a7fc700 1 -- 172.21.15.32:0/956601253 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6108011990 con 0x7f6114039090 2023-10-08T06:10:08.337 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:08.332+0000 7f611a7fc700 1 -- 172.21.15.32:0/956601253 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6108011d00 con 0x7f6114039090 2023-10-08T06:10:08.337 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:08.336+0000 7f6120df8700 1 -- 172.21.15.32:0/956601253 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6114039090 msgr2=0x7f61140e3c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:08.337 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:08.336+0000 7f6120df8700 1 --2- 172.21.15.32:0/956601253 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6114039090 0x7f61140e3c90 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f6108009880 tx=0x7f6108009b90 comp rx=0 tx=0).stop 2023-10-08T06:10:08.337 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:08.336+0000 7f6120df8700 1 -- 172.21.15.32:0/956601253 shutdown_connections 2023-10-08T06:10:08.337 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:08.336+0000 7f6120df8700 1 --2- 172.21.15.32:0/956601253 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6114039090 0x7f61140e3c90 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:08.337 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:08.336+0000 7f6120df8700 1 -- 172.21.15.32:0/956601253 >> 172.21.15.32:0/956601253 conn(0x7f6114055db0 msgr2=0x7f61140561c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:10:08.337 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:08.336+0000 7f6120df8700 1 -- 172.21.15.32:0/956601253 shutdown_connections 2023-10-08T06:10:08.337 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:08.336+0000 7f6120df8700 1 -- 172.21.15.32:0/956601253 wait complete. 2023-10-08T06:10:08.340 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:08.340+0000 7f6120df8700 1 Processor -- start 2023-10-08T06:10:08.340 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:08.340+0000 7f6120df8700 1 -- start start 2023-10-08T06:10:08.343 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:08.340+0000 7f6120df8700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6114039090 0x7f61140cebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:08.343 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:08.340+0000 7f6120df8700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f61140e0050 0x7f6114050c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:08.343 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:08.340+0000 7f6120df8700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f61140e4850 0x7f61140511b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:08.343 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:08.340+0000 7f6120df8700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f611404f910 con 0x7f6114039090 2023-10-08T06:10:08.343 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:08.340+0000 7f6120df8700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f611404b3c0 con 0x7f61140e0050 2023-10-08T06:10:08.343 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:08.340+0000 7f6120df8700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f611404b6a0 con 0x7f61140e4850 2023-10-08T06:10:08.343 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:08.340+0000 7f611b7fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6114039090 0x7f61140cebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:08.343 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:08.340+0000 7f611b7fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6114039090 0x7f61140cebd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:45412/0 (socket says 172.21.15.32:45412) 2023-10-08T06:10:08.343 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:08.340+0000 7f611b7fe700 1 -- 172.21.15.32:0/2544316285 learned_addr learned my addr 172.21.15.32:0/2544316285 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:10:08.343 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:08.340+0000 7f611affd700 1 --2- 172.21.15.32:0/2544316285 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f61140e0050 0x7f6114050c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:08.344 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:08.340+0000 7f611bfff700 1 --2- 172.21.15.32:0/2544316285 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f61140e4850 0x7f61140511b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:08.344 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:08.340+0000 7f611b7fe700 1 -- 172.21.15.32:0/2544316285 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f61140e4850 msgr2=0x7f61140511b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:08.344 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:08.340+0000 7f611b7fe700 1 --2- 172.21.15.32:0/2544316285 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f61140e4850 0x7f61140511b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:08.344 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:08.340+0000 7f611b7fe700 1 -- 172.21.15.32:0/2544316285 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f61140e0050 msgr2=0x7f6114050c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:08.344 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:08.340+0000 7f611b7fe700 1 --2- 172.21.15.32:0/2544316285 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f61140e0050 0x7f6114050c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:08.344 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:08.340+0000 7f611b7fe700 1 -- 172.21.15.32:0/2544316285 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61080094b0 con 0x7f6114039090 2023-10-08T06:10:08.344 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:08.340+0000 7f611b7fe700 1 --2- 172.21.15.32:0/2544316285 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6114039090 0x7f61140cebd0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f6110000fd0 tx=0x7f611000c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:08.345 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:08.340+0000 7f6107fff700 1 -- 172.21.15.32:0/2544316285 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6110005d90 con 0x7f6114039090 2023-10-08T06:10:08.345 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:08.340+0000 7f6107fff700 1 -- 172.21.15.32:0/2544316285 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61100070d0 con 0x7f6114039090 2023-10-08T06:10:08.345 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:08.340+0000 7f6120df8700 1 -- 172.21.15.32:0/2544316285 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f611404b980 con 0x7f6114039090 2023-10-08T06:10:08.345 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:08.340+0000 7f6107fff700 1 -- 172.21.15.32:0/2544316285 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6110007460 con 0x7f6114039090 2023-10-08T06:10:08.345 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:08.340+0000 7f6120df8700 1 -- 172.21.15.32:0/2544316285 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f611404bf40 con 0x7f6114039090 2023-10-08T06:10:08.345 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:08.344+0000 7f6120df8700 1 -- 172.21.15.32:0/2544316285 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61140058c0 con 0x7f6114039090 2023-10-08T06:10:08.346 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:08.344+0000 7f6107fff700 1 -- 172.21.15.32:0/2544316285 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f61100075c0 con 0x7f6114039090 2023-10-08T06:10:08.347 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:08.344+0000 7f6107fff700 1 --2- 172.21.15.32:0/2544316285 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f6100066510 0x7f61000689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:08.347 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:08.344+0000 7f6107fff700 1 -- 172.21.15.32:0/2544316285 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f61100831d0 con 0x7f6114039090 2023-10-08T06:10:08.347 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:08.344+0000 7f611affd700 1 --2- 172.21.15.32:0/2544316285 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f6100066510 0x7f61000689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:08.347 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:08.348+0000 7f611affd700 1 --2- 172.21.15.32:0/2544316285 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f6100066510 0x7f61000689d0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f6114039490 tx=0x7f6108010000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:08.354 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:08.352+0000 7f6107fff700 1 -- 172.21.15.32:0/2544316285 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f6110050660 con 0x7f6114039090 2023-10-08T06:10:08.518 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:08.516+0000 7f6120df8700 1 -- 172.21.15.32:0/2544316285 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f6114055380 con 0x7f6114039090 2023-10-08T06:10:08.523 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:08.520+0000 7f6107fff700 1 -- 172.21.15.32:0/2544316285 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f6114055380 con 0x7f6114039090 2023-10-08T06:10:08.526 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:08.524+0000 7f6120df8700 1 -- 172.21.15.32:0/2544316285 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f6100066510 msgr2=0x7f61000689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:08.527 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:08.524+0000 7f6120df8700 1 --2- 172.21.15.32:0/2544316285 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f6100066510 0x7f61000689d0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f6114039490 tx=0x7f6108010000 comp rx=0 tx=0).stop 2023-10-08T06:10:08.527 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:08.524+0000 7f6120df8700 1 -- 172.21.15.32:0/2544316285 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6114039090 msgr2=0x7f61140cebd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:08.527 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:08.524+0000 7f6120df8700 1 --2- 172.21.15.32:0/2544316285 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6114039090 0x7f61140cebd0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f6110000fd0 tx=0x7f611000c930 comp rx=0 tx=0).stop 2023-10-08T06:10:08.527 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:08.524+0000 7f6120df8700 1 -- 172.21.15.32:0/2544316285 shutdown_connections 2023-10-08T06:10:08.527 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:08.524+0000 7f6120df8700 1 --2- 172.21.15.32:0/2544316285 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f6100066510 0x7f61000689d0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:08.527 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:08.524+0000 7f6120df8700 1 --2- 172.21.15.32:0/2544316285 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f61140e4850 0x7f61140511b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:08.527 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:08.524+0000 7f6120df8700 1 --2- 172.21.15.32:0/2544316285 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f61140e0050 0x7f6114050c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:08.527 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:08.524+0000 7f6120df8700 1 --2- 172.21.15.32:0/2544316285 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6114039090 0x7f61140cebd0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:08.528 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:08.524+0000 7f6120df8700 1 -- 172.21.15.32:0/2544316285 >> 172.21.15.32:0/2544316285 conn(0x7f6114055db0 msgr2=0x7f61140def40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:10:08.528 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:08.524+0000 7f6120df8700 1 -- 172.21.15.32:0/2544316285 shutdown_connections 2023-10-08T06:10:08.528 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:08.524+0000 7f6120df8700 1 -- 172.21.15.32:0/2544316285 wait complete. 2023-10-08T06:10:08.540 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-08T06:10:08.540 DEBUG:teuthology.orchestra.run.smithi032:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-08T06:10:08.562 DEBUG:teuthology.orchestra.run.smithi040:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-08T06:10:08.584 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-08T06:10:08.584 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2023-10-08T06:10:08.584 DEBUG:teuthology.orchestra.run.smithi032:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-08T06:10:08.591 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2023-10-08T06:10:08.591 DEBUG:teuthology.orchestra.run.smithi032:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-08T06:10:08.599 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T06:10:08.760 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:08.760+0000 7fe061b50700 1 Processor -- start 2023-10-08T06:10:08.761 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:08.760+0000 7fe061b50700 1 -- start start 2023-10-08T06:10:08.762 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:08.760+0000 7fe061b50700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fe05c1617a0 0x7fe05c0cba80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:08.762 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:08.760+0000 7fe061b50700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe05c0ce7a0 0x7fe05c0cc990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:08.762 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:08.760+0000 7fe061b50700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe05c166040 con 0x7fe05c0cbfc0 2023-10-08T06:10:08.762 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:08.760+0000 7fe061b50700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe05c0cc450 con 0x7fe05c1617a0 2023-10-08T06:10:08.762 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:08.760+0000 7fe061b50700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe05c0cec10 con 0x7fe05c0ce7a0 2023-10-08T06:10:08.762 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:08.760+0000 7fe05b7fe700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fe05c1617a0 0x7fe05c0cba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:08.763 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:08.760+0000 7fe05b7fe700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fe05c1617a0 0x7fe05c0cba80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:45414/0 (socket says 172.21.15.32:45414) 2023-10-08T06:10:08.763 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:08.760+0000 7fe05b7fe700 1 -- 172.21.15.32:0/2429075896 learned_addr learned my addr 172.21.15.32:0/2429075896 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:10:08.763 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:08.760+0000 7fe05bfff700 1 --2- 172.21.15.32:0/2429075896 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe05c0ce7a0 0x7fe05c0cc990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:08.763 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:08.760+0000 7fe05b7fe700 1 -- 172.21.15.32:0/2429075896 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe05c0ce7a0 msgr2=0x7fe05c0cc990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:10:08.763 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:08.760+0000 7fe05b7fe700 1 --2- 172.21.15.32:0/2429075896 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe05c0ce7a0 0x7fe05c0cc990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:08.763 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:08.760+0000 7fe05b7fe700 1 -- 172.21.15.32:0/2429075896 >> v1:172.21.15.40:6789/0 conn(0x7fe05c0cbfc0 legacy=0x7fe05c0ce090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:08.763 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:08.760+0000 7fe05b7fe700 1 -- 172.21.15.32:0/2429075896 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe05c165430 con 0x7fe05c1617a0 2023-10-08T06:10:08.763 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:08.760+0000 7fe05b7fe700 1 --2- 172.21.15.32:0/2429075896 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe05c1617a0 0x7fe05c0cba80 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fe044009910 tx=0x7fe044009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77afc19c08e28e1b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:08.764 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:08.760+0000 7fe05a7fc700 1 -- 172.21.15.32:0/2429075896 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe044011830 con 0x7fe05c1617a0 2023-10-08T06:10:08.765 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:08.760+0000 7fe05a7fc700 1 -- 172.21.15.32:0/2429075896 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe044011990 con 0x7fe05c1617a0 2023-10-08T06:10:08.765 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:08.760+0000 7fe05a7fc700 1 -- 172.21.15.32:0/2429075896 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe044011d40 con 0x7fe05c1617a0 2023-10-08T06:10:08.765 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:08.764+0000 7fe061b50700 1 -- 172.21.15.32:0/2429075896 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe05c1617a0 msgr2=0x7fe05c0cba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:08.765 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:08.764+0000 7fe061b50700 1 --2- 172.21.15.32:0/2429075896 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe05c1617a0 0x7fe05c0cba80 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fe044009910 tx=0x7fe044009c20 comp rx=0 tx=0).stop 2023-10-08T06:10:08.765 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:08.764+0000 7fe061b50700 1 -- 172.21.15.32:0/2429075896 shutdown_connections 2023-10-08T06:10:08.765 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:08.764+0000 7fe061b50700 1 --2- 172.21.15.32:0/2429075896 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe05c0ce7a0 0x7fe05c0cc990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:08.765 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:08.764+0000 7fe061b50700 1 --2- 172.21.15.32:0/2429075896 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe05c1617a0 0x7fe05c0cba80 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:08.765 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:08.764+0000 7fe061b50700 1 -- 172.21.15.32:0/2429075896 >> 172.21.15.32:0/2429075896 conn(0x7fe05c06a480 msgr2=0x7fe05c06a890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:10:08.765 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:08.764+0000 7fe061b50700 1 -- 172.21.15.32:0/2429075896 shutdown_connections 2023-10-08T06:10:08.766 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:08.764+0000 7fe061b50700 1 -- 172.21.15.32:0/2429075896 wait complete. 2023-10-08T06:10:08.767 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:08.764+0000 7fe061b50700 1 Processor -- start 2023-10-08T06:10:08.767 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:08.764+0000 7fe061b50700 1 -- start start 2023-10-08T06:10:08.769 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:08.768+0000 7fe061b50700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe05c0cbfc0 0x7fe05c15b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:08.769 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:08.768+0000 7fe061b50700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe05c0ce7a0 0x7fe05c0b3e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:08.769 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:08.768+0000 7fe061b50700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe05c1617a0 0x7fe05c0b43d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:08.769 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:08.768+0000 7fe061b50700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe05c15d360 con 0x7fe05c0ce7a0 2023-10-08T06:10:08.769 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:08.768+0000 7fe061b50700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe05c0b2a60 con 0x7fe05c0cbfc0 2023-10-08T06:10:08.769 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:08.768+0000 7fe061b50700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe05c0b4910 con 0x7fe05c1617a0 2023-10-08T06:10:08.769 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:08.768+0000 7fe05affd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe05c0ce7a0 0x7fe05c0b3e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:08.770 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:08.768+0000 7fe05affd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe05c0ce7a0 0x7fe05c0b3e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:45426/0 (socket says 172.21.15.32:45426) 2023-10-08T06:10:08.770 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:08.768+0000 7fe05affd700 1 -- 172.21.15.32:0/3648981011 learned_addr learned my addr 172.21.15.32:0/3648981011 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:10:08.770 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:08.768+0000 7fe05bfff700 1 --2- 172.21.15.32:0/3648981011 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe05c1617a0 0x7fe05c0b43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:08.770 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:08.768+0000 7fe05b7fe700 1 --2- 172.21.15.32:0/3648981011 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe05c0cbfc0 0x7fe05c15b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:08.771 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:08.768+0000 7fe05affd700 1 -- 172.21.15.32:0/3648981011 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe05c1617a0 msgr2=0x7fe05c0b43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:08.771 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:08.768+0000 7fe05affd700 1 --2- 172.21.15.32:0/3648981011 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe05c1617a0 0x7fe05c0b43d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:08.771 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:08.768+0000 7fe05affd700 1 -- 172.21.15.32:0/3648981011 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe05c0cbfc0 msgr2=0x7fe05c15b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:08.771 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:08.768+0000 7fe05affd700 1 --2- 172.21.15.32:0/3648981011 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe05c0cbfc0 0x7fe05c15b390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:08.772 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:08.768+0000 7fe05affd700 1 -- 172.21.15.32:0/3648981011 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe044009570 con 0x7fe05c0ce7a0 2023-10-08T06:10:08.772 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:08.768+0000 7fe05affd700 1 --2- 172.21.15.32:0/3648981011 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe05c0ce7a0 0x7fe05c0b3e90 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fe054001ed0 tx=0x7fe0540021e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:08.772 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:08.768+0000 7fe053fff700 1 -- 172.21.15.32:0/3648981011 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe054003c20 con 0x7fe05c0ce7a0 2023-10-08T06:10:08.772 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:08.768+0000 7fe053fff700 1 -- 172.21.15.32:0/3648981011 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe054003d80 con 0x7fe05c0ce7a0 2023-10-08T06:10:08.772 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:08.768+0000 7fe061b50700 1 -- 172.21.15.32:0/3648981011 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe05c15b8d0 con 0x7fe05c0ce7a0 2023-10-08T06:10:08.772 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:08.768+0000 7fe053fff700 1 -- 172.21.15.32:0/3648981011 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe05400ab40 con 0x7fe05c0ce7a0 2023-10-08T06:10:08.772 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:08.768+0000 7fe061b50700 1 -- 172.21.15.32:0/3648981011 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe05c0c7090 con 0x7fe05c0ce7a0 2023-10-08T06:10:08.773 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:08.772+0000 7fe061b50700 1 -- 172.21.15.32:0/3648981011 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe05c165150 con 0x7fe05c0ce7a0 2023-10-08T06:10:08.773 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:08.772+0000 7fe053fff700 1 -- 172.21.15.32:0/3648981011 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fe05400aca0 con 0x7fe05c0ce7a0 2023-10-08T06:10:08.774 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:08.772+0000 7fe053fff700 1 --2- 172.21.15.32:0/3648981011 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fe03c066540 0x7fe03c068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:08.774 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:08.772+0000 7fe053fff700 1 -- 172.21.15.32:0/3648981011 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe054083e50 con 0x7fe05c0ce7a0 2023-10-08T06:10:08.774 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:08.772+0000 7fe05b7fe700 1 --2- 172.21.15.32:0/3648981011 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fe03c066540 0x7fe03c068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:08.775 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:08.772+0000 7fe05b7fe700 1 --2- 172.21.15.32:0/3648981011 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fe03c066540 0x7fe03c068a00 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fe044000c00 tx=0x7fe044008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:08.780 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:08.780+0000 7fe053fff700 1 -- 172.21.15.32:0/3648981011 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fe054051360 con 0x7fe05c0ce7a0 2023-10-08T06:10:08.948 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:08.948+0000 7fe061b50700 1 -- 172.21.15.32:0/3648981011 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe05c073f00 con 0x7fe05c0ce7a0 2023-10-08T06:10:08.949 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:08.948+0000 7fe053fff700 1 -- 172.21.15.32:0/3648981011 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16445 (secure 0 0 0) 0x7fe054054980 con 0x7fe05c0ce7a0 2023-10-08T06:10:08.949 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:10:08.950 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":22,"fsid":"ac672d87-96ae-41e0-9314-623ba2cdbbba","created":"2023-10-08T06:09:11.175626+0000","modified":"2023-10-08T06:09:38.153256+0000","last_up_change":"2023-10-08T06:09:22.744643+0000","last_in_change":"2023-10-08T06:09:14.131580+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T06:09:23.307843+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T06:09:34.295012+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T06:09:35.515590+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"43433f0c-9592-4874-92d7-10f8f4acf07f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":587888964},{"type":"v1","addr":"172.21.15.32:6801","nonce":587888964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":587888964},{"type":"v1","addr":"172.21.15.32:6803","nonce":587888964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":587888964},{"type":"v1","addr":"172.21.15.32:6810","nonce":587888964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6805","nonce":587888964},{"type":"v1","addr":"172.21.15.32:6807","nonce":587888964}]},"public_addr":"172.21.15.32:6801/587888964","cluster_addr":"172.21.15.32:6803/587888964","heartbeat_back_addr":"172.21.15.32:6810/587888964","heartbeat_front_addr":"172.21.15.32:6807/587888964","state":["exists","up"]},{"osd":1,"uuid":"2ecb1008-b987-4ce7-b646-6cded55fc8d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":990576767},{"type":"v1","addr":"172.21.15.32:6817","nonce":990576767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":990576767},{"type":"v1","addr":"172.21.15.32:6819","nonce":990576767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":990576767},{"type":"v1","addr":"172.21.15.32:6823","nonce":990576767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":990576767},{"type":"v1","addr":"172.21.15.32:6821","nonce":990576767}]},"public_addr":"172.21.15.32:6817/990576767","cluster_addr":"172.21.15.32:6819/990576767","heartbeat_back_addr":"172.21.15.32:6823/990576767","heartbeat_front_addr":"172.21.15.32:6821/990576767","state":["exists","up"]},{"osd":2,"uuid":"1b131c94-c09b-4e80-8746-bf1b7bac362d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6824","nonce":1566874440},{"type":"v1","addr":"172.21.15.32:6825","nonce":1566874440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":1566874440},{"type":"v1","addr":"172.21.15.32:6827","nonce":1566874440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":1566874440},{"type":"v1","addr":"172.21.15.32:6831","nonce":1566874440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":1566874440},{"type":"v1","addr":"172.21.15.32:6829","nonce":1566874440}]},"public_addr":"172.21.15.32:6825/1566874440","cluster_addr":"172.21.15.32:6827/1566874440","heartbeat_back_addr":"172.21.15.32:6831/1566874440","heartbeat_front_addr":"172.21.15.32:6829/1566874440","state":["exists","up"]},{"osd":3,"uuid":"ad655af2-1f6f-4689-b21d-b07bbaeb68b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":3672614802},{"type":"v1","addr":"172.21.15.32:6806","nonce":3672614802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6809","nonce":3672614802},{"type":"v1","addr":"172.21.15.32:6811","nonce":3672614802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":3672614802},{"type":"v1","addr":"172.21.15.32:6815","nonce":3672614802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":3672614802},{"type":"v1","addr":"172.21.15.32:6813","nonce":3672614802}]},"public_addr":"172.21.15.32:6806/3672614802","cluster_addr":"172.21.15.32:6811/3672614802","heartbeat_back_addr":"172.21.15.32:6815/3672614802","heartbeat_front_addr":"172.21.15.32:6813/3672614802","state":["exists","up"]},{"osd":4,"uuid":"64a543a1-8c4f-458e-9aba-b35c1cd7dd03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":3369928244},{"type":"v1","addr":"172.21.15.40:6801","nonce":3369928244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":3369928244},{"type":"v1","addr":"172.21.15.40:6803","nonce":3369928244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":3369928244},{"type":"v1","addr":"172.21.15.40:6807","nonce":3369928244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":3369928244},{"type":"v1","addr":"172.21.15.40:6805","nonce":3369928244}]},"public_addr":"172.21.15.40:6801/3369928244","cluster_addr":"172.21.15.40:6803/3369928244","heartbeat_back_addr":"172.21.15.40:6807/3369928244","heartbeat_front_addr":"172.21.15.40:6805/3369928244","state":["exists","up"]},{"osd":5,"uuid":"0fef3e54-edb4-4678-878e-944663c51638","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":2395850297},{"type":"v1","addr":"172.21.15.40:6825","nonce":2395850297}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":2395850297},{"type":"v1","addr":"172.21.15.40:6827","nonce":2395850297}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":2395850297},{"type":"v1","addr":"172.21.15.40:6831","nonce":2395850297}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":2395850297},{"type":"v1","addr":"172.21.15.40:6829","nonce":2395850297}]},"public_addr":"172.21.15.40:6825/2395850297","cluster_addr":"172.21.15.40:6827/2395850297","heartbeat_back_addr":"172.21.15.40:6831/2395850297","heartbeat_front_addr":"172.21.15.40:6829/2395850297","state":["exists","up"]},{"osd":6,"uuid":"2eeb0472-6096-469d-9b2c-cab4bf41c31a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":4145283410},{"type":"v1","addr":"172.21.15.40:6809","nonce":4145283410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":4145283410},{"type":"v1","addr":"172.21.15.40:6811","nonce":4145283410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":4145283410},{"type":"v1","addr":"172.21.15.40:6815","nonce":4145283410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":4145283410},{"type":"v1","addr":"172.21.15.40:6813","nonce":4145283410}]},"public_addr":"172.21.15.40:6809/4145283410","cluster_addr":"172.21.15.40:6811/4145283410","heartbeat_back_addr":"172.21.15.40:6815/4145283410","heartbeat_front_addr":"172.21.15.40:6813/4145283410","state":["exists","up"]},{"osd":7,"uuid":"cf76e4c7-96a6-401f-a280-91aad4641940","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":2943297416},{"type":"v1","addr":"172.21.15.40:6817","nonce":2943297416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":2943297416},{"type":"v1","addr":"172.21.15.40:6819","nonce":2943297416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":2943297416},{"type":"v1","addr":"172.21.15.40:6823","nonce":2943297416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":2943297416},{"type":"v1","addr":"172.21.15.40:6821","nonce":2943297416}]},"public_addr":"172.21.15.40:6817/2943297416","cluster_addr":"172.21.15.40:6819/2943297416","heartbeat_back_addr":"172.21.15.40:6823/2943297416","heartbeat_front_addr":"172.21.15.40:6821/2943297416","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.411475+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.628841+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.599055+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.166100+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.384135+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.488403+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.307648+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.363541+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T06:10:08.952 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:08.948+0000 7fe061b50700 1 -- 172.21.15.32:0/3648981011 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fe03c066540 msgr2=0x7fe03c068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:08.952 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:08.948+0000 7fe061b50700 1 --2- 172.21.15.32:0/3648981011 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fe03c066540 0x7fe03c068a00 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fe044000c00 tx=0x7fe044008030 comp rx=0 tx=0).stop 2023-10-08T06:10:08.952 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:08.948+0000 7fe061b50700 1 -- 172.21.15.32:0/3648981011 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe05c0ce7a0 msgr2=0x7fe05c0b3e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:08.952 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:08.948+0000 7fe061b50700 1 --2- 172.21.15.32:0/3648981011 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe05c0ce7a0 0x7fe05c0b3e90 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fe054001ed0 tx=0x7fe0540021e0 comp rx=0 tx=0).stop 2023-10-08T06:10:08.952 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:08.952+0000 7fe061b50700 1 -- 172.21.15.32:0/3648981011 shutdown_connections 2023-10-08T06:10:08.952 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:08.952+0000 7fe061b50700 1 --2- 172.21.15.32:0/3648981011 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fe03c066540 0x7fe03c068a00 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:08.952 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:08.952+0000 7fe061b50700 1 --2- 172.21.15.32:0/3648981011 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe05c0ce7a0 0x7fe05c0b3e90 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:08.952 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:08.952+0000 7fe061b50700 1 --2- 172.21.15.32:0/3648981011 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe05c1617a0 0x7fe05c0b43d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:08.952 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:08.952+0000 7fe061b50700 1 --2- 172.21.15.32:0/3648981011 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe05c0cbfc0 0x7fe05c15b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:08.953 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:08.952+0000 7fe061b50700 1 -- 172.21.15.32:0/3648981011 >> 172.21.15.32:0/3648981011 conn(0x7fe05c06a480 msgr2=0x7fe05c06a860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:10:08.953 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:08.952+0000 7fe061b50700 1 -- 172.21.15.32:0/3648981011 shutdown_connections 2023-10-08T06:10:08.953 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:08.952+0000 7fe061b50700 1 -- 172.21.15.32:0/3648981011 wait complete. 2023-10-08T06:10:08.964 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T06:09:23.307843+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-08T06:09:34.295012+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-08T06:09:35.515590+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-08T06:10:08.965 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T06:10:09.086 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.084+0000 7f09a71b7700 1 Processor -- start 2023-10-08T06:10:09.086 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.084+0000 7f09a71b7700 1 -- start start 2023-10-08T06:10:09.087 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.084+0000 7f09a71b7700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f09a015d3d0 0x7f09a006d860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:09.087 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.084+0000 7f09a71b7700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f09a0160ff0 0x7f09a006a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:09.087 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.084+0000 7f09a71b7700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09a00cf440 con 0x7f09a006e070 2023-10-08T06:10:09.087 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.084+0000 7f09a71b7700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09a0071cb0 con 0x7f09a015d3d0 2023-10-08T06:10:09.087 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.084+0000 7f09a71b7700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09a0071f90 con 0x7f09a0160ff0 2023-10-08T06:10:09.088 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.084+0000 7f09a61b5700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f09a015d3d0 0x7f09a006d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:09.088 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.084+0000 7f09a59b4700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f09a006e070 0x7f09a00cd950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:46980/0 (socket says 172.21.15.32:46980) 2023-10-08T06:10:09.088 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.084+0000 7f09a59b4700 1 -- 172.21.15.32:0/2937413967 learned_addr learned my addr 172.21.15.32:0/2937413967 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-08T06:10:09.088 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.084+0000 7f09a69b6700 1 --2- 172.21.15.32:0/2937413967 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f09a0160ff0 0x7f09a006a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:09.089 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.088+0000 7f09a51b3700 1 -- 172.21.15.32:0/2937413967 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 692747923 0 0) 0x7f09a00cf440 con 0x7f09a006e070 2023-10-08T06:10:09.089 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.088+0000 7f09a51b3700 1 -- 172.21.15.32:0/2937413967 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f098c0035d0 con 0x7f09a006e070 2023-10-08T06:10:09.089 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.088+0000 7f09a61b5700 1 -- 172.21.15.32:0/2937413967 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f09a0160ff0 msgr2=0x7f09a006a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:10:09.089 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.088+0000 7f09a61b5700 1 --2- 172.21.15.32:0/2937413967 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f09a0160ff0 0x7f09a006a2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:09.089 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.088+0000 7f09a61b5700 1 -- 172.21.15.32:0/2937413967 >> v1:172.21.15.32:6789/0 conn(0x7f09a006e070 legacy=0x7f09a00cd950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:09.090 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.088+0000 7f09a61b5700 1 -- 172.21.15.32:0/2937413967 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09a006e750 con 0x7f09a015d3d0 2023-10-08T06:10:09.090 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.088+0000 7f09a61b5700 1 --2- 172.21.15.32:0/2937413967 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f09a015d3d0 0x7f09a006d860 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f0990009850 tx=0x7f0990009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d9c5bac921c6709 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:09.090 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.088+0000 7f09a51b3700 1 -- 172.21.15.32:0/2937413967 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0990011830 con 0x7f09a015d3d0 2023-10-08T06:10:09.090 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.088+0000 7f09a51b3700 1 -- 172.21.15.32:0/2937413967 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0990011990 con 0x7f09a015d3d0 2023-10-08T06:10:09.090 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.088+0000 7f09a51b3700 1 -- 172.21.15.32:0/2937413967 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0990011d00 con 0x7f09a015d3d0 2023-10-08T06:10:09.091 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.088+0000 7f09a71b7700 1 -- 172.21.15.32:0/2937413967 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f09a015d3d0 msgr2=0x7f09a006d860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:09.091 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.088+0000 7f09a71b7700 1 --2- 172.21.15.32:0/2937413967 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f09a015d3d0 0x7f09a006d860 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f0990009850 tx=0x7f0990009b60 comp rx=0 tx=0).stop 2023-10-08T06:10:09.091 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.088+0000 7f09a71b7700 1 -- 172.21.15.32:0/2937413967 shutdown_connections 2023-10-08T06:10:09.091 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.088+0000 7f09a71b7700 1 --2- 172.21.15.32:0/2937413967 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f09a0160ff0 0x7f09a006a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:09.091 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.088+0000 7f09a71b7700 1 --2- 172.21.15.32:0/2937413967 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f09a015d3d0 0x7f09a006d860 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:09.091 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.088+0000 7f09a71b7700 1 -- 172.21.15.32:0/2937413967 >> 172.21.15.32:0/2937413967 conn(0x7f09a00cc800 msgr2=0x7f09a00ccbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:10:09.091 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.088+0000 7f09a71b7700 1 -- 172.21.15.32:0/2937413967 shutdown_connections 2023-10-08T06:10:09.091 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.088+0000 7f09a71b7700 1 -- 172.21.15.32:0/2937413967 wait complete. 2023-10-08T06:10:09.092 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.092+0000 7f09a71b7700 1 Processor -- start 2023-10-08T06:10:09.092 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.092+0000 7f09a71b7700 1 -- start start 2023-10-08T06:10:09.095 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.092+0000 7f09a71b7700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f09a006e070 0x7f09a00af7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:09.095 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.092+0000 7f09a71b7700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f09a015d3d0 0x7f09a015a380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:09.095 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.092+0000 7f09a71b7700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f09a0160ff0 0x7f09a00c3a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:09.095 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.092+0000 7f09a71b7700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09a0159fe0 con 0x7f09a006e070 2023-10-08T06:10:09.095 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.092+0000 7f09a71b7700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09a00caba0 con 0x7f09a0160ff0 2023-10-08T06:10:09.095 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.092+0000 7f09a71b7700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09a0159d00 con 0x7f09a015d3d0 2023-10-08T06:10:09.095 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.092+0000 7f09a61b5700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f09a006e070 0x7f09a00af7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:09.095 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.092+0000 7f09a61b5700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f09a006e070 0x7f09a00af7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:45432/0 (socket says 172.21.15.32:45432) 2023-10-08T06:10:09.096 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.092+0000 7f09a69b6700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f09a0160ff0 0x7f09a00c3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:09.096 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.092+0000 7f09a59b4700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f09a015d3d0 0x7f09a015a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:09.096 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.092+0000 7f09a61b5700 1 -- 172.21.15.32:0/3625832307 learned_addr learned my addr 172.21.15.32:0/3625832307 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:10:09.096 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.092+0000 7f09a61b5700 1 -- 172.21.15.32:0/3625832307 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f09a015d3d0 msgr2=0x7f09a015a380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:09.096 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.092+0000 7f09a61b5700 1 --2- 172.21.15.32:0/3625832307 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f09a015d3d0 0x7f09a015a380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:09.096 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.092+0000 7f09a61b5700 1 -- 172.21.15.32:0/3625832307 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f09a0160ff0 msgr2=0x7f09a00c3a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:09.096 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.092+0000 7f09a61b5700 1 --2- 172.21.15.32:0/3625832307 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f09a0160ff0 0x7f09a00c3a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:09.096 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.092+0000 7f09a61b5700 1 -- 172.21.15.32:0/3625832307 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09900094b0 con 0x7f09a006e070 2023-10-08T06:10:09.096 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.092+0000 7f09a59b4700 1 --2- 172.21.15.32:0/3625832307 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f09a015d3d0 0x7f09a015a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T06:10:09.096 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.092+0000 7f09a69b6700 1 --2- 172.21.15.32:0/3625832307 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f09a0160ff0 0x7f09a00c3a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T06:10:09.097 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.092+0000 7f09a61b5700 1 --2- 172.21.15.32:0/3625832307 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f09a006e070 0x7f09a00af7e0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f09900090b0 tx=0x7f0990004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:09.097 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.096+0000 7f0996ffd700 1 -- 172.21.15.32:0/3625832307 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0990004590 con 0x7f09a006e070 2023-10-08T06:10:09.097 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.096+0000 7f0996ffd700 1 -- 172.21.15.32:0/3625832307 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f099001f070 con 0x7f09a006e070 2023-10-08T06:10:09.097 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.096+0000 7f09a71b7700 1 -- 172.21.15.32:0/3625832307 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09a00ca550 con 0x7f09a006e070 2023-10-08T06:10:09.098 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.096+0000 7f0996ffd700 1 -- 172.21.15.32:0/3625832307 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0990003900 con 0x7f09a006e070 2023-10-08T06:10:09.098 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.096+0000 7f09a71b7700 1 -- 172.21.15.32:0/3625832307 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09a015a8c0 con 0x7f09a006e070 2023-10-08T06:10:09.098 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.096+0000 7f09a71b7700 1 -- 172.21.15.32:0/3625832307 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09a00ca3b0 con 0x7f09a006e070 2023-10-08T06:10:09.099 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.096+0000 7f0996ffd700 1 -- 172.21.15.32:0/3625832307 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f0990003a60 con 0x7f09a006e070 2023-10-08T06:10:09.100 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.100+0000 7f0996ffd700 1 --2- 172.21.15.32:0/3625832307 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f0984066540 0x7f0984068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:09.100 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.100+0000 7f09a59b4700 1 --2- 172.21.15.32:0/3625832307 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f0984066540 0x7f0984068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:09.101 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.100+0000 7f0996ffd700 1 -- 172.21.15.32:0/3625832307 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0990021070 con 0x7f09a006e070 2023-10-08T06:10:09.101 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.100+0000 7f09a59b4700 1 --2- 172.21.15.32:0/3625832307 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f0984066540 0x7f0984068a00 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f09a01f5f10 tx=0x7f099c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:09.109 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.108+0000 7f0996ffd700 1 -- 172.21.15.32:0/3625832307 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f09a00ca3b0 con 0x7f09a006e070 2023-10-08T06:10:09.276 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.276+0000 7f09a71b7700 1 -- 172.21.15.32:0/3625832307 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f09a00ca3b0 con 0x7f09a006e070 2023-10-08T06:10:09.277 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.276+0000 7f0996ffd700 1 -- 172.21.15.32:0/3625832307 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7f09a00ca3b0 con 0x7f09a006e070 2023-10-08T06:10:09.277 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 1 2023-10-08T06:10:09.279 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.276+0000 7f09a71b7700 1 -- 172.21.15.32:0/3625832307 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f0984066540 msgr2=0x7f0984068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:09.279 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.276+0000 7f09a71b7700 1 --2- 172.21.15.32:0/3625832307 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f0984066540 0x7f0984068a00 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f09a01f5f10 tx=0x7f099c009040 comp rx=0 tx=0).stop 2023-10-08T06:10:09.279 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.276+0000 7f09a71b7700 1 -- 172.21.15.32:0/3625832307 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f09a006e070 msgr2=0x7f09a00af7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:09.280 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.276+0000 7f09a71b7700 1 --2- 172.21.15.32:0/3625832307 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f09a006e070 0x7f09a00af7e0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f09900090b0 tx=0x7f0990004770 comp rx=0 tx=0).stop 2023-10-08T06:10:09.280 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.276+0000 7f09a71b7700 1 -- 172.21.15.32:0/3625832307 shutdown_connections 2023-10-08T06:10:09.280 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.276+0000 7f09a71b7700 1 --2- 172.21.15.32:0/3625832307 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f0984066540 0x7f0984068a00 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:09.280 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.276+0000 7f09a71b7700 1 --2- 172.21.15.32:0/3625832307 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f09a0160ff0 0x7f09a00c3a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:09.280 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.276+0000 7f09a71b7700 1 --2- 172.21.15.32:0/3625832307 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f09a015d3d0 0x7f09a015a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:09.280 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.276+0000 7f09a71b7700 1 --2- 172.21.15.32:0/3625832307 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f09a006e070 0x7f09a00af7e0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:09.280 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.276+0000 7f09a71b7700 1 -- 172.21.15.32:0/3625832307 >> 172.21.15.32:0/3625832307 conn(0x7f09a00cc800 msgr2=0x7f09a015c350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:10:09.280 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.276+0000 7f09a71b7700 1 -- 172.21.15.32:0/3625832307 shutdown_connections 2023-10-08T06:10:09.280 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.276+0000 7f09a71b7700 1 -- 172.21.15.32:0/3625832307 wait complete. 2023-10-08T06:10:09.292 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-08T06:10:09.414 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.412+0000 7fae49e20700 1 Processor -- start 2023-10-08T06:10:09.415 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.412+0000 7fae49e20700 1 -- start start 2023-10-08T06:10:09.415 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.412+0000 7fae49e20700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fae44159ed0 0x7fae440ca9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:09.416 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.412+0000 7fae49e20700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae440cca40 con 0x7fae440c98c0 2023-10-08T06:10:09.416 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.412+0000 7fae49e20700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae440cdf60 con 0x7fae4415a2b0 2023-10-08T06:10:09.416 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.412+0000 7fae49e20700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae440ccdb0 con 0x7fae44159ed0 2023-10-08T06:10:09.416 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.416+0000 7fae4961f700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fae440c98c0 0x7fae440cb510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:46988/0 (socket says 172.21.15.32:46988) 2023-10-08T06:10:09.416 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.416+0000 7fae4961f700 1 -- 172.21.15.32:0/3923495926 learned_addr learned my addr 172.21.15.32:0/3923495926 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-08T06:10:09.419 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.416+0000 7fae48e1e700 1 --2- 172.21.15.32:0/3923495926 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fae44159ed0 0x7fae440ca9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:09.419 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.416+0000 7fae437fe700 1 -- 172.21.15.32:0/3923495926 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4150780715 0 0) 0x7fae440cca40 con 0x7fae440c98c0 2023-10-08T06:10:09.419 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.416+0000 7fae437fe700 1 -- 172.21.15.32:0/3923495926 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fae240035d0 con 0x7fae440c98c0 2023-10-08T06:10:09.419 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.416+0000 7fae437fe700 1 -- 172.21.15.32:0/3923495926 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3726194590 0 0) 0x7fae240035d0 con 0x7fae440c98c0 2023-10-08T06:10:09.419 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.416+0000 7fae437fe700 1 -- 172.21.15.32:0/3923495926 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fae44159ed0 msgr2=0x7fae440ca9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:10:09.419 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.416+0000 7fae437fe700 1 --2- 172.21.15.32:0/3923495926 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fae44159ed0 0x7fae440ca9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:09.419 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.416+0000 7fae437fe700 1 -- 172.21.15.32:0/3923495926 >> v1:172.21.15.40:6789/0 conn(0x7fae4415a2b0 legacy=0x7fae440706f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:09.420 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.416+0000 7fae437fe700 1 -- 172.21.15.32:0/3923495926 --> v1:172.21.15.32:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae440ce240 con 0x7fae440c98c0 2023-10-08T06:10:09.420 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.416+0000 7fae437fe700 1 -- 172.21.15.32:0/3923495926 <== mon.0 v1:172.21.15.32:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2364763317 0 0) 0x7fae3c0019f0 con 0x7fae440c98c0 2023-10-08T06:10:09.420 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.416+0000 7fae437fe700 1 -- 172.21.15.32:0/3923495926 >> v1:172.21.15.32:6789/0 conn(0x7fae440c98c0 legacy=0x7fae440cb510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:09.420 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.416+0000 7fae437fe700 1 --2- 172.21.15.32:0/3923495926 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fae24003a50 0x7fae24003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:09.420 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.416+0000 7fae437fe700 1 --2- 172.21.15.32:0/3923495926 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fae24004400 0x7fae240048d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:09.420 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.416+0000 7fae437fe700 1 --2- 172.21.15.32:0/3923495926 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fae44159ed0 0x7fae240051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:09.420 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.416+0000 7fae437fe700 1 -- 172.21.15.32:0/3923495926 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae440ccdb0 con 0x7fae24004400 2023-10-08T06:10:09.420 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.416+0000 7fae437fe700 1 -- 172.21.15.32:0/3923495926 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae2400bae0 con 0x7fae24003a50 2023-10-08T06:10:09.420 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.416+0000 7fae437fe700 1 -- 172.21.15.32:0/3923495926 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae2400deb0 con 0x7fae44159ed0 2023-10-08T06:10:09.420 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.416+0000 7fae43fff700 1 --2- 172.21.15.32:0/3923495926 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fae24004400 0x7fae240048d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:09.420 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.416+0000 7fae48e1e700 1 --2- 172.21.15.32:0/3923495926 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fae24003a50 0x7fae24003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:09.421 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.416+0000 7fae4961f700 1 --2- 172.21.15.32:0/3923495926 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fae44159ed0 0x7fae240051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:09.421 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.416+0000 7fae43fff700 1 -- 172.21.15.32:0/3923495926 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fae44159ed0 msgr2=0x7fae240051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:10:09.421 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.416+0000 7fae43fff700 1 --2- 172.21.15.32:0/3923495926 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fae44159ed0 0x7fae240051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:09.421 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.416+0000 7fae43fff700 1 -- 172.21.15.32:0/3923495926 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fae24003a50 msgr2=0x7fae24003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:10:09.421 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.416+0000 7fae43fff700 1 --2- 172.21.15.32:0/3923495926 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fae24003a50 0x7fae24003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:09.421 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.416+0000 7fae43fff700 1 -- 172.21.15.32:0/3923495926 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae240035d0 con 0x7fae24004400 2023-10-08T06:10:09.421 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.416+0000 7fae43fff700 1 --2- 172.21.15.32:0/3923495926 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fae24004400 0x7fae240048d0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fae340019a0 tx=0x7fae240058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1f0ceea2980515a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:09.421 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.416+0000 7fae437fe700 1 -- 172.21.15.32:0/3923495926 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae34001440 con 0x7fae24004400 2023-10-08T06:10:09.421 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.416+0000 7fae437fe700 1 -- 172.21.15.32:0/3923495926 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae34006aa0 con 0x7fae24004400 2023-10-08T06:10:09.421 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.416+0000 7fae437fe700 1 -- 172.21.15.32:0/3923495926 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae34006e50 con 0x7fae24004400 2023-10-08T06:10:09.421 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.416+0000 7fae49e20700 1 -- 172.21.15.32:0/3923495926 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fae24004400 msgr2=0x7fae240048d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:09.421 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.416+0000 7fae49e20700 1 --2- 172.21.15.32:0/3923495926 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fae24004400 0x7fae240048d0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fae340019a0 tx=0x7fae240058a0 comp rx=0 tx=0).stop 2023-10-08T06:10:09.422 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.416+0000 7fae4961f700 1 -- 172.21.15.32:0/3923495926 reap_dead start 2023-10-08T06:10:09.422 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.416+0000 7fae49e20700 1 -- 172.21.15.32:0/3923495926 shutdown_connections 2023-10-08T06:10:09.422 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.416+0000 7fae49e20700 1 -- 172.21.15.32:0/3923495926 >> 172.21.15.32:0/3923495926 conn(0x7fae440b0900 msgr2=0x7fae440b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:10:09.422 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.416+0000 7fae49e20700 1 -- 172.21.15.32:0/3923495926 shutdown_connections 2023-10-08T06:10:09.422 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.416+0000 7fae49e20700 1 -- 172.21.15.32:0/3923495926 wait complete. 2023-10-08T06:10:09.424 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.420+0000 7fae49e20700 1 Processor -- start 2023-10-08T06:10:09.424 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.420+0000 7fae49e20700 1 -- start start 2023-10-08T06:10:09.424 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.420+0000 7fae49e20700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fae24004400 0x7fae4415cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:09.424 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.420+0000 7fae49e20700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fae441573f0 0x7fae4415d320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:09.424 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.420+0000 7fae49e20700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fae4406bcf0 0x7fae4406c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:09.425 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.420+0000 7fae49e20700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae440caef0 con 0x7fae4406bcf0 2023-10-08T06:10:09.425 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.420+0000 7fae49e20700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae4406c6b0 con 0x7fae441573f0 2023-10-08T06:10:09.425 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.420+0000 7fae49e20700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae440b2920 con 0x7fae24004400 2023-10-08T06:10:09.425 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.420+0000 7fae4961f700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fae4406bcf0 0x7fae4406c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:09.425 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.420+0000 7fae4961f700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fae4406bcf0 0x7fae4406c170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:45450/0 (socket says 172.21.15.32:45450) 2023-10-08T06:10:09.425 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.420+0000 7fae4961f700 1 -- 172.21.15.32:0/2065987536 learned_addr learned my addr 172.21.15.32:0/2065987536 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:10:09.425 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.420+0000 7fae48e1e700 1 --2- 172.21.15.32:0/2065987536 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fae24004400 0x7fae4415cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:09.425 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.420+0000 7fae43fff700 1 --2- 172.21.15.32:0/2065987536 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fae441573f0 0x7fae4415d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:09.425 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.420+0000 7fae4961f700 1 -- 172.21.15.32:0/2065987536 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fae24004400 msgr2=0x7fae4415cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:09.425 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.420+0000 7fae4961f700 1 --2- 172.21.15.32:0/2065987536 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fae24004400 0x7fae4415cde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:09.425 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.420+0000 7fae4961f700 1 -- 172.21.15.32:0/2065987536 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fae441573f0 msgr2=0x7fae4415d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:09.426 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.420+0000 7fae4961f700 1 --2- 172.21.15.32:0/2065987536 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fae441573f0 0x7fae4415d320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:09.426 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.420+0000 7fae4961f700 1 -- 172.21.15.32:0/2065987536 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae440c7150 con 0x7fae4406bcf0 2023-10-08T06:10:09.426 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.420+0000 7fae4961f700 1 --2- 172.21.15.32:0/2065987536 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fae4406bcf0 0x7fae4406c170 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fae440cfed0 tx=0x7fae3c001a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:09.426 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.424+0000 7fae417fa700 1 -- 172.21.15.32:0/2065987536 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae3c00aa10 con 0x7fae4406bcf0 2023-10-08T06:10:09.426 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.424+0000 7fae417fa700 1 -- 172.21.15.32:0/2065987536 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae3c00ab70 con 0x7fae4406bcf0 2023-10-08T06:10:09.426 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.424+0000 7fae49e20700 1 -- 172.21.15.32:0/2065987536 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae440b2b70 con 0x7fae4406bcf0 2023-10-08T06:10:09.426 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.424+0000 7fae417fa700 1 -- 172.21.15.32:0/2065987536 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae3c0133f0 con 0x7fae4406bcf0 2023-10-08T06:10:09.426 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.424+0000 7fae49e20700 1 -- 172.21.15.32:0/2065987536 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae440b3130 con 0x7fae4406bcf0 2023-10-08T06:10:09.427 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.424+0000 7fae49e20700 1 -- 172.21.15.32:0/2065987536 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae44073f00 con 0x7fae4406bcf0 2023-10-08T06:10:09.427 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.424+0000 7fae417fa700 1 -- 172.21.15.32:0/2065987536 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fae3c013550 con 0x7fae4406bcf0 2023-10-08T06:10:09.427 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.424+0000 7fae417fa700 1 --2- 172.21.15.32:0/2065987536 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fae28066510 0x7fae280689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:09.427 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.424+0000 7fae48e1e700 1 --2- 172.21.15.32:0/2065987536 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fae28066510 0x7fae280689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:09.427 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.424+0000 7fae417fa700 1 -- 172.21.15.32:0/2065987536 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fae3c0845f0 con 0x7fae4406bcf0 2023-10-08T06:10:09.428 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.428+0000 7fae48e1e700 1 --2- 172.21.15.32:0/2065987536 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fae28066510 0x7fae280689d0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fae4406c900 tx=0x7fae2c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:09.434 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.432+0000 7fae417fa700 1 -- 172.21.15.32:0/2065987536 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fae3c051b00 con 0x7fae4406bcf0 2023-10-08T06:10:09.597 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.596+0000 7fae49e20700 1 -- 172.21.15.32:0/2065987536 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fae440b4d50 con 0x7fae4406bcf0 2023-10-08T06:10:09.597 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.596+0000 7fae417fa700 1 -- 172.21.15.32:0/2065987536 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7fae3c055120 con 0x7fae4406bcf0 2023-10-08T06:10:09.598 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 32 2023-10-08T06:10:09.600 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.600+0000 7fae49e20700 1 -- 172.21.15.32:0/2065987536 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fae28066510 msgr2=0x7fae280689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:09.600 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.600+0000 7fae49e20700 1 --2- 172.21.15.32:0/2065987536 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fae28066510 0x7fae280689d0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fae4406c900 tx=0x7fae2c008040 comp rx=0 tx=0).stop 2023-10-08T06:10:09.600 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.600+0000 7fae49e20700 1 -- 172.21.15.32:0/2065987536 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fae4406bcf0 msgr2=0x7fae4406c170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:09.600 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.600+0000 7fae49e20700 1 --2- 172.21.15.32:0/2065987536 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fae4406bcf0 0x7fae4406c170 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fae440cfed0 tx=0x7fae3c001a90 comp rx=0 tx=0).stop 2023-10-08T06:10:09.600 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.600+0000 7fae49e20700 1 -- 172.21.15.32:0/2065987536 shutdown_connections 2023-10-08T06:10:09.601 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.600+0000 7fae49e20700 1 --2- 172.21.15.32:0/2065987536 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fae28066510 0x7fae280689d0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:09.601 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.600+0000 7fae49e20700 1 --2- 172.21.15.32:0/2065987536 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fae4406bcf0 0x7fae4406c170 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:09.601 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.600+0000 7fae49e20700 1 --2- 172.21.15.32:0/2065987536 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fae441573f0 0x7fae4415d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:09.601 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.600+0000 7fae49e20700 1 --2- 172.21.15.32:0/2065987536 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fae24004400 0x7fae4415cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:09.601 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.600+0000 7fae49e20700 1 -- 172.21.15.32:0/2065987536 >> 172.21.15.32:0/2065987536 conn(0x7fae440b0900 msgr2=0x7fae440cf060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:10:09.601 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.600+0000 7fae49e20700 1 -- 172.21.15.32:0/2065987536 shutdown_connections 2023-10-08T06:10:09.601 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.600+0000 7fae49e20700 1 -- 172.21.15.32:0/2065987536 wait complete. 2023-10-08T06:10:09.612 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-08T06:10:09.736 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.736+0000 7fc57200a700 1 Processor -- start 2023-10-08T06:10:09.736 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.736+0000 7fc57200a700 1 -- start start 2023-10-08T06:10:09.737 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.736+0000 7fc57200a700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc56c0cdd60 0x7fc56c06cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:09.738 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.736+0000 7fc57200a700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fc56c0b3530 0x7fc56c0cc4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:09.738 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.736+0000 7fc57200a700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc56c0b2a90 con 0x7fc56c15cf80 2023-10-08T06:10:09.738 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.736+0000 7fc57200a700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc56c0d0cf0 con 0x7fc56c0b3530 2023-10-08T06:10:09.738 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.736+0000 7fc57200a700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc56c0d0a10 con 0x7fc56c0cdd60 2023-10-08T06:10:09.738 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.736+0000 7fc571809700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fc56c0b3530 0x7fc56c0cc4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:09.738 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.736+0000 7fc570807700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc56c0cdd60 0x7fc56c06cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:09.738 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.736+0000 7fc571809700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fc56c0b3530 0x7fc56c0cc4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:45452/0 (socket says 172.21.15.32:45452) 2023-10-08T06:10:09.738 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.736+0000 7fc570807700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc56c0cdd60 0x7fc56c06cfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.32:51894/0 (socket says 172.21.15.32:51894) 2023-10-08T06:10:09.738 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.736+0000 7fc571809700 1 -- 172.21.15.32:0/3976355784 learned_addr learned my addr 172.21.15.32:0/3976355784 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:10:09.739 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.736+0000 7fc571809700 1 -- 172.21.15.32:0/3976355784 >> v2:172.21.15.40:3300/0 conn(0x7fc56c0cdd60 msgr2=0x7fc56c06cfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:10:09.740 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.736+0000 7fc571809700 1 --2- 172.21.15.32:0/3976355784 >> v2:172.21.15.40:3300/0 conn(0x7fc56c0cdd60 0x7fc56c06cfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:09.740 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.736+0000 7fc571809700 1 -- 172.21.15.32:0/3976355784 >> v1:172.21.15.40:6789/0 conn(0x7fc56c15cf80 legacy=0x7fc56c0cd650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:09.740 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.736+0000 7fc571809700 1 -- 172.21.15.32:0/3976355784 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc56c0b2d30 con 0x7fc56c0b3530 2023-10-08T06:10:09.740 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.736+0000 7fc571809700 1 --2- 172.21.15.32:0/3976355784 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc56c0b3530 0x7fc56c0cc4d0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fc56c0b0860 tx=0x7fc56400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef7f141842082062 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:09.740 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.736+0000 7fc563fff700 1 -- 172.21.15.32:0/3976355784 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc56400e070 con 0x7fc56c0b3530 2023-10-08T06:10:09.740 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.736+0000 7fc563fff700 1 -- 172.21.15.32:0/3976355784 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc56400b910 con 0x7fc56c0b3530 2023-10-08T06:10:09.740 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.736+0000 7fc563fff700 1 -- 172.21.15.32:0/3976355784 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc56400bcc0 con 0x7fc56c0b3530 2023-10-08T06:10:09.741 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.740+0000 7fc57200a700 1 -- 172.21.15.32:0/3976355784 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc56c0b3530 msgr2=0x7fc56c0cc4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:09.741 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.740+0000 7fc57200a700 1 --2- 172.21.15.32:0/3976355784 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc56c0b3530 0x7fc56c0cc4d0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fc56c0b0860 tx=0x7fc56400b330 comp rx=0 tx=0).stop 2023-10-08T06:10:09.741 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.740+0000 7fc57200a700 1 -- 172.21.15.32:0/3976355784 shutdown_connections 2023-10-08T06:10:09.741 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.740+0000 7fc57200a700 1 --2- 172.21.15.32:0/3976355784 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc56c0b3530 0x7fc56c0cc4d0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:09.741 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.740+0000 7fc57200a700 1 --2- 172.21.15.32:0/3976355784 >> v2:172.21.15.40:3300/0 conn(0x7fc56c0cdd60 0x7fc56c06cfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:09.742 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.740+0000 7fc57200a700 1 -- 172.21.15.32:0/3976355784 >> 172.21.15.32:0/3976355784 conn(0x7fc56c06dfa0 msgr2=0x7fc56c06e380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:10:09.742 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.740+0000 7fc57200a700 1 -- 172.21.15.32:0/3976355784 shutdown_connections 2023-10-08T06:10:09.742 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.740+0000 7fc57200a700 1 -- 172.21.15.32:0/3976355784 wait complete. 2023-10-08T06:10:09.743 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.740+0000 7fc57200a700 1 Processor -- start 2023-10-08T06:10:09.743 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.740+0000 7fc57200a700 1 -- start start 2023-10-08T06:10:09.745 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.744+0000 7fc57200a700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc56c0b3530 0x7fc56c1f66e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:09.745 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.744+0000 7fc57200a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc56c0cdd60 0x7fc56c0b61a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:09.745 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.744+0000 7fc57200a700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc56c15cf80 0x7fc56c0b42d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:09.746 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.744+0000 7fc57200a700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc56c15de90 con 0x7fc56c15cf80 2023-10-08T06:10:09.746 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.744+0000 7fc57200a700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc56c15e5e0 con 0x7fc56c0cdd60 2023-10-08T06:10:09.746 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.744+0000 7fc57200a700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc56c15e8c0 con 0x7fc56c0b3530 2023-10-08T06:10:09.746 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.744+0000 7fc571809700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc56c15cf80 0x7fc56c0b42d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:09.746 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.744+0000 7fc571809700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc56c15cf80 0x7fc56c0b42d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:45462/0 (socket says 172.21.15.32:45462) 2023-10-08T06:10:09.746 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.744+0000 7fc571809700 1 -- 172.21.15.32:0/42402943 learned_addr learned my addr 172.21.15.32:0/42402943 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:10:09.746 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.744+0000 7fc571008700 1 --2- 172.21.15.32:0/42402943 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc56c0b3530 0x7fc56c1f66e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:09.746 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.744+0000 7fc570807700 1 --2- 172.21.15.32:0/42402943 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc56c0cdd60 0x7fc56c0b61a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:09.746 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.744+0000 7fc571809700 1 -- 172.21.15.32:0/42402943 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc56c0b3530 msgr2=0x7fc56c1f66e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:09.746 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.744+0000 7fc571809700 1 --2- 172.21.15.32:0/42402943 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc56c0b3530 0x7fc56c1f66e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:09.746 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.744+0000 7fc571809700 1 -- 172.21.15.32:0/42402943 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc56c0cdd60 msgr2=0x7fc56c0b61a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:09.747 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.744+0000 7fc571809700 1 --2- 172.21.15.32:0/42402943 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc56c0cdd60 0x7fc56c0b61a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:09.747 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.744+0000 7fc571809700 1 -- 172.21.15.32:0/42402943 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc564009b30 con 0x7fc56c15cf80 2023-10-08T06:10:09.747 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.744+0000 7fc571008700 1 --2- 172.21.15.32:0/42402943 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc56c0b3530 0x7fc56c1f66e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T06:10:09.747 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.744+0000 7fc571809700 1 --2- 172.21.15.32:0/42402943 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc56c15cf80 0x7fc56c0b42d0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fc564012000 tx=0x7fc564004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:09.748 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.744+0000 7fc561ffb700 1 -- 172.21.15.32:0/42402943 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5640099b0 con 0x7fc56c15cf80 2023-10-08T06:10:09.748 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.744+0000 7fc561ffb700 1 -- 172.21.15.32:0/42402943 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5640092e0 con 0x7fc56c15cf80 2023-10-08T06:10:09.748 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.744+0000 7fc57200a700 1 -- 172.21.15.32:0/42402943 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc56c0b3ad0 con 0x7fc56c15cf80 2023-10-08T06:10:09.748 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.744+0000 7fc561ffb700 1 -- 172.21.15.32:0/42402943 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc56401c640 con 0x7fc56c15cf80 2023-10-08T06:10:09.748 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.744+0000 7fc57200a700 1 -- 172.21.15.32:0/42402943 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc56c15eba0 con 0x7fc56c15cf80 2023-10-08T06:10:09.748 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.748+0000 7fc57200a700 1 -- 172.21.15.32:0/42402943 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc56c0b3f90 con 0x7fc56c15cf80 2023-10-08T06:10:09.749 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.748+0000 7fc561ffb700 1 -- 172.21.15.32:0/42402943 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fc56401c7a0 con 0x7fc56c15cf80 2023-10-08T06:10:09.749 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.748+0000 7fc561ffb700 1 --2- 172.21.15.32:0/42402943 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fc550066510 0x7fc5500689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:09.749 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.748+0000 7fc561ffb700 1 -- 172.21.15.32:0/42402943 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc564085850 con 0x7fc56c15cf80 2023-10-08T06:10:09.750 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.748+0000 7fc571008700 1 --2- 172.21.15.32:0/42402943 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fc550066510 0x7fc5500689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:09.750 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.748+0000 7fc571008700 1 --2- 172.21.15.32:0/42402943 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fc550066510 0x7fc5500689d0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fc568000f60 tx=0x7fc568009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:09.755 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.756+0000 7fc561ffb700 1 -- 172.21.15.32:0/42402943 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fc564052cc0 con 0x7fc56c15cf80 2023-10-08T06:10:09.918 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.916+0000 7fc57200a700 1 -- 172.21.15.32:0/42402943 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc56c0686a0 con 0x7fc56c15cf80 2023-10-08T06:10:09.919 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.916+0000 7fc561ffb700 1 -- 172.21.15.32:0/42402943 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc5640562e0 con 0x7fc56c15cf80 2023-10-08T06:10:09.919 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 64 2023-10-08T06:10:09.922 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.920+0000 7fc57200a700 1 -- 172.21.15.32:0/42402943 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fc550066510 msgr2=0x7fc5500689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:09.922 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.920+0000 7fc57200a700 1 --2- 172.21.15.32:0/42402943 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fc550066510 0x7fc5500689d0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fc568000f60 tx=0x7fc568009040 comp rx=0 tx=0).stop 2023-10-08T06:10:09.922 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.920+0000 7fc57200a700 1 -- 172.21.15.32:0/42402943 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc56c15cf80 msgr2=0x7fc56c0b42d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:09.922 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.920+0000 7fc57200a700 1 --2- 172.21.15.32:0/42402943 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc56c15cf80 0x7fc56c0b42d0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fc564012000 tx=0x7fc564004af0 comp rx=0 tx=0).stop 2023-10-08T06:10:09.922 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.920+0000 7fc57200a700 1 -- 172.21.15.32:0/42402943 shutdown_connections 2023-10-08T06:10:09.922 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.920+0000 7fc57200a700 1 --2- 172.21.15.32:0/42402943 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fc550066510 0x7fc5500689d0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:09.923 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.920+0000 7fc57200a700 1 --2- 172.21.15.32:0/42402943 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc56c15cf80 0x7fc56c0b42d0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:09.923 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.920+0000 7fc57200a700 1 --2- 172.21.15.32:0/42402943 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc56c0cdd60 0x7fc56c0b61a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:09.923 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.920+0000 7fc57200a700 1 --2- 172.21.15.32:0/42402943 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc56c0b3530 0x7fc56c1f66e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:09.923 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.920+0000 7fc57200a700 1 -- 172.21.15.32:0/42402943 >> 172.21.15.32:0/42402943 conn(0x7fc56c06dfa0 msgr2=0x7fc56c0cd320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:10:09.923 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.920+0000 7fc57200a700 1 -- 172.21.15.32:0/42402943 shutdown_connections 2023-10-08T06:10:09.923 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:09.920+0000 7fc57200a700 1 -- 172.21.15.32:0/42402943 wait complete. 2023-10-08T06:10:09.934 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-08T06:10:10.046 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.044+0000 7f53365db700 1 Processor -- start 2023-10-08T06:10:10.046 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.044+0000 7f53365db700 1 -- start start 2023-10-08T06:10:10.048 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.048+0000 7f53365db700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f53300b8bc0 0x7f53300cddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:10.048 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.048+0000 7f53365db700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53300b9000 con 0x7f533015d490 2023-10-08T06:10:10.048 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.048+0000 7f53365db700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53300d1bb0 con 0x7f53300ce310 2023-10-08T06:10:10.049 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.048+0000 7f53365db700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53300ce7c0 con 0x7f53300b8bc0 2023-10-08T06:10:10.049 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.048+0000 7f53355d9700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f533015d490 0x7f53300d13d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:46998/0 (socket says 172.21.15.32:46998) 2023-10-08T06:10:10.049 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.048+0000 7f53355d9700 1 -- 172.21.15.32:0/3139036772 learned_addr learned my addr 172.21.15.32:0/3139036772 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-08T06:10:10.049 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.048+0000 7f5334dd8700 1 --2- 172.21.15.32:0/3139036772 >> v2:172.21.15.40:3300/0 conn(0x7f53300b8bc0 0x7f53300cddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:10.050 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.048+0000 7f5327fff700 1 -- 172.21.15.32:0/3139036772 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 79704349 0 0) 0x7f5320001110 con 0x7f533015d490 2023-10-08T06:10:10.050 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.048+0000 7f5327fff700 1 -- 172.21.15.32:0/3139036772 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f531c0035d0 con 0x7f533015d490 2023-10-08T06:10:10.050 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.048+0000 7f5334dd8700 1 -- 172.21.15.32:0/3139036772 >> v1:172.21.15.40:6789/0 conn(0x7f53300ce310 legacy=0x7f53300b6130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:10.050 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.048+0000 7f5334dd8700 1 -- 172.21.15.32:0/3139036772 >> v1:172.21.15.32:6789/0 conn(0x7f533015d490 legacy=0x7f53300d13d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:10.050 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.048+0000 7f5327fff700 1 -- 172.21.15.32:0/3139036772 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2882051758 0 0) 0x7f531c0035d0 con 0x7f533015d490 2023-10-08T06:10:10.050 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.048+0000 7f5334dd8700 1 -- 172.21.15.32:0/3139036772 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53300d1e90 con 0x7f53300b8bc0 2023-10-08T06:10:10.051 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.048+0000 7f5334dd8700 1 --2- 172.21.15.32:0/3139036772 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f53300b8bc0 0x7f53300cddd0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f532c009850 tx=0x7f532c009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=daeaf41982d70cea server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:10.051 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.048+0000 7f5327fff700 1 -- 172.21.15.32:0/3139036772 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5320001800 con 0x7f53300b8bc0 2023-10-08T06:10:10.051 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.048+0000 7f5327fff700 1 -- 172.21.15.32:0/3139036772 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f532c004030 con 0x7f53300b8bc0 2023-10-08T06:10:10.051 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.048+0000 7f5327fff700 1 -- 172.21.15.32:0/3139036772 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f532c0043a0 con 0x7f53300b8bc0 2023-10-08T06:10:10.052 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.048+0000 7f53365db700 1 -- 172.21.15.32:0/3139036772 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f53300b8bc0 msgr2=0x7f53300cddd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:10.052 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.048+0000 7f53365db700 1 --2- 172.21.15.32:0/3139036772 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f53300b8bc0 0x7f53300cddd0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f532c009850 tx=0x7f532c009b60 comp rx=0 tx=0).stop 2023-10-08T06:10:10.052 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.048+0000 7f53365db700 1 -- 172.21.15.32:0/3139036772 shutdown_connections 2023-10-08T06:10:10.052 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.048+0000 7f53365db700 1 --2- 172.21.15.32:0/3139036772 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f53300b8bc0 0x7f53300cddd0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:10.052 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.048+0000 7f53365db700 1 -- 172.21.15.32:0/3139036772 >> 172.21.15.32:0/3139036772 conn(0x7f533006ab40 msgr2=0x7f533006af20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:10:10.052 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.048+0000 7f53365db700 1 -- 172.21.15.32:0/3139036772 shutdown_connections 2023-10-08T06:10:10.052 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.048+0000 7f53365db700 1 -- 172.21.15.32:0/3139036772 wait complete. 2023-10-08T06:10:10.053 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.052+0000 7f53365db700 1 Processor -- start 2023-10-08T06:10:10.053 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.052+0000 7f53365db700 1 -- start start 2023-10-08T06:10:10.056 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.052+0000 7f53365db700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f53300b8bc0 0x7f533015eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:10.056 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.052+0000 7f53365db700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f53300ce310 0x7f53300c8180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:10.056 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.052+0000 7f53365db700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f533015d490 0x7f53301f3110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:10.056 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.052+0000 7f53365db700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53301f3650 con 0x7f53300ce310 2023-10-08T06:10:10.056 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.052+0000 7f53365db700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f533015de10 con 0x7f53300b8bc0 2023-10-08T06:10:10.056 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.052+0000 7f5334dd8700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f53300ce310 0x7f53300c8180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:10.057 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.052+0000 7f53365db700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f533015e0f0 con 0x7f533015d490 2023-10-08T06:10:10.057 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.052+0000 7f5334dd8700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f53300ce310 0x7f53300c8180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:45474/0 (socket says 172.21.15.32:45474) 2023-10-08T06:10:10.057 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.052+0000 7f5334dd8700 1 -- 172.21.15.32:0/2480423562 learned_addr learned my addr 172.21.15.32:0/2480423562 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:10:10.057 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.052+0000 7f53355d9700 1 --2- 172.21.15.32:0/2480423562 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f53300b8bc0 0x7f533015eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:10.057 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.056+0000 7f5335dda700 1 --2- 172.21.15.32:0/2480423562 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f533015d490 0x7f53301f3110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:10.057 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.056+0000 7f5334dd8700 1 -- 172.21.15.32:0/2480423562 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f533015d490 msgr2=0x7f53301f3110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:10.057 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.056+0000 7f5334dd8700 1 --2- 172.21.15.32:0/2480423562 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f533015d490 0x7f53301f3110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:10.057 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.056+0000 7f5334dd8700 1 -- 172.21.15.32:0/2480423562 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f53300b8bc0 msgr2=0x7f533015eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:10.057 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.056+0000 7f5334dd8700 1 --2- 172.21.15.32:0/2480423562 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f53300b8bc0 0x7f533015eeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:10.057 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.056+0000 7f5334dd8700 1 -- 172.21.15.32:0/2480423562 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f532c0094b0 con 0x7f53300ce310 2023-10-08T06:10:10.058 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.056+0000 7f5334dd8700 1 --2- 172.21.15.32:0/2480423562 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f53300ce310 0x7f53300c8180 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f532c004000 tx=0x7f532c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:10.059 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.056+0000 7f5325ffb700 1 -- 172.21.15.32:0/2480423562 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f532c011630 con 0x7f53300ce310 2023-10-08T06:10:10.059 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.056+0000 7f5325ffb700 1 -- 172.21.15.32:0/2480423562 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f532c01f070 con 0x7f53300ce310 2023-10-08T06:10:10.059 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.056+0000 7f53365db700 1 -- 172.21.15.32:0/2480423562 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f533015e3d0 con 0x7f53300ce310 2023-10-08T06:10:10.059 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.056+0000 7f5325ffb700 1 -- 172.21.15.32:0/2480423562 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f532c0119f0 con 0x7f53300ce310 2023-10-08T06:10:10.059 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.056+0000 7f53365db700 1 -- 172.21.15.32:0/2480423562 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f533015e990 con 0x7f53300ce310 2023-10-08T06:10:10.059 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.056+0000 7f53365db700 1 -- 172.21.15.32:0/2480423562 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5330073f00 con 0x7f53300ce310 2023-10-08T06:10:10.059 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.056+0000 7f5325ffb700 1 -- 172.21.15.32:0/2480423562 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f532c011b50 con 0x7f53300ce310 2023-10-08T06:10:10.060 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.056+0000 7f5325ffb700 1 --2- 172.21.15.32:0/2480423562 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f5314066540 0x7f5314068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:10.060 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.056+0000 7f5325ffb700 1 -- 172.21.15.32:0/2480423562 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f532c021070 con 0x7f53300ce310 2023-10-08T06:10:10.060 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.056+0000 7f53355d9700 1 --2- 172.21.15.32:0/2480423562 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f5314066540 0x7f5314068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:10.060 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.060+0000 7f53355d9700 1 --2- 172.21.15.32:0/2480423562 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f5314066540 0x7f5314068a00 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f5320004a80 tx=0x7f5320001250 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:10.064 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.064+0000 7f5325ffb700 1 -- 172.21.15.32:0/2480423562 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f532c052bd0 con 0x7f53300ce310 2023-10-08T06:10:10.243 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.240+0000 7f53365db700 1 -- 172.21.15.32:0/2480423562 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f53300c95d0 con 0x7f53300ce310 2023-10-08T06:10:10.244 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.244+0000 7f5325ffb700 1 -- 172.21.15.32:0/2480423562 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v22) v1 ==== 80+0+0 (secure 0 0 0) 0x7f532c0561f0 con 0x7f53300ce310 2023-10-08T06:10:10.246 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.244+0000 7f53365db700 1 -- 172.21.15.32:0/2480423562 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f5314066540 msgr2=0x7f5314068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:10.246 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.244+0000 7f53365db700 1 --2- 172.21.15.32:0/2480423562 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f5314066540 0x7f5314068a00 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f5320004a80 tx=0x7f5320001250 comp rx=0 tx=0).stop 2023-10-08T06:10:10.247 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.244+0000 7f53365db700 1 -- 172.21.15.32:0/2480423562 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f53300ce310 msgr2=0x7f53300c8180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:10.247 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.244+0000 7f53365db700 1 --2- 172.21.15.32:0/2480423562 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f53300ce310 0x7f53300c8180 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f532c004000 tx=0x7f532c004770 comp rx=0 tx=0).stop 2023-10-08T06:10:10.247 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.244+0000 7f53365db700 1 -- 172.21.15.32:0/2480423562 shutdown_connections 2023-10-08T06:10:10.247 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.244+0000 7f53365db700 1 --2- 172.21.15.32:0/2480423562 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f5314066540 0x7f5314068a00 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:10.247 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.244+0000 7f53365db700 1 --2- 172.21.15.32:0/2480423562 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f53300ce310 0x7f53300c8180 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:10.247 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.244+0000 7f53365db700 1 --2- 172.21.15.32:0/2480423562 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f533015d490 0x7f53301f3110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:10.247 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.244+0000 7f53365db700 1 --2- 172.21.15.32:0/2480423562 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f53300b8bc0 0x7f533015eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:10.247 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.244+0000 7f53365db700 1 -- 172.21.15.32:0/2480423562 >> 172.21.15.32:0/2480423562 conn(0x7f533006ab40 msgr2=0x7f533015ba90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:10:10.247 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.244+0000 7f53365db700 1 -- 172.21.15.32:0/2480423562 shutdown_connections 2023-10-08T06:10:10.247 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.244+0000 7f53365db700 1 -- 172.21.15.32:0/2480423562 wait complete. 2023-10-08T06:10:10.248 INFO:teuthology.orchestra.run.smithi032.stderr:listed 0 entries 2023-10-08T06:10:10.259 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2023-10-08T06:10:10.259 DEBUG:teuthology.orchestra.run.smithi032:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-08T06:10:10.265 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T06:10:10.381 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.380+0000 7f5b00c16700 1 Processor -- start 2023-10-08T06:10:10.381 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.380+0000 7f5b00c16700 1 -- start start 2023-10-08T06:10:10.381 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.380+0000 7f5b00c16700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f5afc164c10 0x7f5afc165bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:10.382 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.380+0000 7f5b00c16700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5afc06d490 0x7f5afc070d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:10.382 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.380+0000 7f5b00c16700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5afc164ff0 con 0x7f5afc0cf460 2023-10-08T06:10:10.382 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.380+0000 7f5b00c16700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5afc0cfc00 con 0x7f5afc164c10 2023-10-08T06:10:10.382 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.380+0000 7f5b00c16700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5afc06bca0 con 0x7f5afc06d490 2023-10-08T06:10:10.383 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.380+0000 7f5afbfff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5afc06d490 0x7f5afc070d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:10.383 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.380+0000 7f5afb7fe700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f5afc164c10 0x7f5afc165bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:10.383 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.380+0000 7f5afaffd700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f5afc0cf460 0x7f5afc06cd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.32:48510/0 (socket says 172.21.15.32:48510) 2023-10-08T06:10:10.383 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.380+0000 7f5afaffd700 1 -- 172.21.15.32:0/3034255059 learned_addr learned my addr 172.21.15.32:0/3034255059 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-08T06:10:10.383 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.380+0000 7f5afbfff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5afc06d490 0x7f5afc070d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.32:38590/0 (socket says 172.21.15.32:38590) 2023-10-08T06:10:10.383 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.380+0000 7f5afb7fe700 1 -- 172.21.15.32:0/3034255059 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5afc06d490 msgr2=0x7f5afc070d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:10:10.383 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.380+0000 7f5afb7fe700 1 --2- 172.21.15.32:0/3034255059 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5afc06d490 0x7f5afc070d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:10.384 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.380+0000 7f5afb7fe700 1 -- 172.21.15.32:0/3034255059 >> v1:172.21.15.40:6789/0 conn(0x7f5afc0cf460 legacy=0x7f5afc06cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:10.384 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.380+0000 7f5afa7fc700 1 -- 172.21.15.32:0/3034255059 <== mon.1 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3253371325 0 0) 0x7f5afc164ff0 con 0x7f5afc0cf460 2023-10-08T06:10:10.384 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.380+0000 7f5afb7fe700 1 -- 172.21.15.32:0/3034255059 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5afc1660f0 con 0x7f5afc164c10 2023-10-08T06:10:10.384 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.380+0000 7f5afbfff700 1 --2- 172.21.15.32:0/3034255059 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5afc06d490 0x7f5afc070d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T06:10:10.385 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.380+0000 7f5afb7fe700 1 --2- 172.21.15.32:0/3034255059 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5afc164c10 0x7f5afc165bb0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f5aec009850 tx=0x7f5aec009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=db05a951b54b58db server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:10.385 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.384+0000 7f5afa7fc700 1 -- 172.21.15.32:0/3034255059 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5aec011830 con 0x7f5afc164c10 2023-10-08T06:10:10.385 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.384+0000 7f5afa7fc700 1 -- 172.21.15.32:0/3034255059 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5aec011990 con 0x7f5afc164c10 2023-10-08T06:10:10.385 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.384+0000 7f5afa7fc700 1 -- 172.21.15.32:0/3034255059 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5aec011d40 con 0x7f5afc164c10 2023-10-08T06:10:10.385 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.384+0000 7f5b00c16700 1 -- 172.21.15.32:0/3034255059 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5afc164c10 msgr2=0x7f5afc165bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:10.385 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.384+0000 7f5b00c16700 1 --2- 172.21.15.32:0/3034255059 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5afc164c10 0x7f5afc165bb0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f5aec009850 tx=0x7f5aec009b60 comp rx=0 tx=0).stop 2023-10-08T06:10:10.386 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.384+0000 7f5b00c16700 1 -- 172.21.15.32:0/3034255059 shutdown_connections 2023-10-08T06:10:10.386 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.384+0000 7f5b00c16700 1 --2- 172.21.15.32:0/3034255059 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5afc06d490 0x7f5afc070d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:10.386 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.384+0000 7f5b00c16700 1 --2- 172.21.15.32:0/3034255059 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5afc164c10 0x7f5afc165bb0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:10.386 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.384+0000 7f5b00c16700 1 -- 172.21.15.32:0/3034255059 >> 172.21.15.32:0/3034255059 conn(0x7f5afc0cc7d0 msgr2=0x7f5afc0ccbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:10:10.386 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.384+0000 7f5b00c16700 1 -- 172.21.15.32:0/3034255059 shutdown_connections 2023-10-08T06:10:10.386 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.384+0000 7f5b00c16700 1 -- 172.21.15.32:0/3034255059 wait complete. 2023-10-08T06:10:10.387 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.384+0000 7f5b00c16700 1 Processor -- start 2023-10-08T06:10:10.387 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.384+0000 7f5b00c16700 1 -- start start 2023-10-08T06:10:10.387 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.384+0000 7f5b00c16700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5afc06d490 0x7f5afc0c3350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:10.388 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.384+0000 7f5b00c16700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5afc0cf460 0x7f5afc1555f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:10.388 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.384+0000 7f5b00c16700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5afc164c10 0x7f5afc0c4b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:10.388 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.384+0000 7f5b00c16700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5afc0b4fc0 con 0x7f5afc06d490 2023-10-08T06:10:10.388 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.384+0000 7f5b00c16700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5afc0c3890 con 0x7f5afc164c10 2023-10-08T06:10:10.388 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.384+0000 7f5b00c16700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5afc0c46b0 con 0x7f5afc0cf460 2023-10-08T06:10:10.388 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.384+0000 7f5afb7fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5afc06d490 0x7f5afc0c3350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:10.388 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.384+0000 7f5afb7fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5afc06d490 0x7f5afc0c3350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:46610/0 (socket says 172.21.15.32:46610) 2023-10-08T06:10:10.388 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.384+0000 7f5afb7fe700 1 -- 172.21.15.32:0/3076832922 learned_addr learned my addr 172.21.15.32:0/3076832922 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:10:10.388 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.384+0000 7f5afbfff700 1 --2- 172.21.15.32:0/3076832922 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5afc164c10 0x7f5afc0c4b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:10.388 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.384+0000 7f5afaffd700 1 --2- 172.21.15.32:0/3076832922 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5afc0cf460 0x7f5afc1555f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:10.389 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.388+0000 7f5afb7fe700 1 -- 172.21.15.32:0/3076832922 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5afc0cf460 msgr2=0x7f5afc1555f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:10.390 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.388+0000 7f5afb7fe700 1 --2- 172.21.15.32:0/3076832922 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5afc0cf460 0x7f5afc1555f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:10.390 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.388+0000 7f5afb7fe700 1 -- 172.21.15.32:0/3076832922 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5afc164c10 msgr2=0x7f5afc0c4b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:10.390 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.388+0000 7f5afb7fe700 1 --2- 172.21.15.32:0/3076832922 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5afc164c10 0x7f5afc0c4b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:10.390 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.388+0000 7f5afb7fe700 1 -- 172.21.15.32:0/3076832922 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5af40094b0 con 0x7f5afc06d490 2023-10-08T06:10:10.390 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.388+0000 7f5afaffd700 1 --2- 172.21.15.32:0/3076832922 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5afc0cf460 0x7f5afc1555f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T06:10:10.390 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.388+0000 7f5afb7fe700 1 --2- 172.21.15.32:0/3076832922 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5afc06d490 0x7f5afc0c3350 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f5aec000c00 tx=0x7f5aec004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:10.390 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.388+0000 7f5af3fff700 1 -- 172.21.15.32:0/3076832922 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5aec01aac0 con 0x7f5afc06d490 2023-10-08T06:10:10.390 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.388+0000 7f5b00c16700 1 -- 172.21.15.32:0/3076832922 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5aec0094b0 con 0x7f5afc06d490 2023-10-08T06:10:10.390 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.388+0000 7f5af3fff700 1 -- 172.21.15.32:0/3076832922 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5aec01f070 con 0x7f5afc06d490 2023-10-08T06:10:10.390 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.388+0000 7f5b00c16700 1 -- 172.21.15.32:0/3076832922 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5afc0c3aa0 con 0x7f5afc06d490 2023-10-08T06:10:10.391 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.388+0000 7f5af3fff700 1 -- 172.21.15.32:0/3076832922 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5aec01ae60 con 0x7f5afc06d490 2023-10-08T06:10:10.391 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.388+0000 7f5af3fff700 1 -- 172.21.15.32:0/3076832922 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f5aec01b430 con 0x7f5afc06d490 2023-10-08T06:10:10.391 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.392+0000 7f5b00c16700 1 -- 172.21.15.32:0/3076832922 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5afc0686a0 con 0x7f5afc06d490 2023-10-08T06:10:10.392 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.392+0000 7f5af3fff700 1 --2- 172.21.15.32:0/3076832922 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f5adc066510 0x7f5adc0689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:10.392 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.392+0000 7f5af3fff700 1 -- 172.21.15.32:0/3076832922 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5aec085000 con 0x7f5afc06d490 2023-10-08T06:10:10.392 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.392+0000 7f5afaffd700 1 --2- 172.21.15.32:0/3076832922 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f5adc066510 0x7f5adc0689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:10.393 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.392+0000 7f5afaffd700 1 --2- 172.21.15.32:0/3076832922 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f5adc066510 0x7f5adc0689d0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f5afc0b5e30 tx=0x7f5ae4001960 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:10.401 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.400+0000 7f5af3fff700 1 -- 172.21.15.32:0/3076832922 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f5aec052490 con 0x7f5afc06d490 2023-10-08T06:10:10.568 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.568+0000 7f5b00c16700 1 -- 172.21.15.32:0/3076832922 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5afc0c2950 con 0x7f5afc06d490 2023-10-08T06:10:10.571 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.568+0000 7f5af3fff700 1 -- 172.21.15.32:0/3076832922 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16445 (secure 0 0 0) 0x7f5aec055ab0 con 0x7f5afc06d490 2023-10-08T06:10:10.571 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:10:10.572 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":22,"fsid":"ac672d87-96ae-41e0-9314-623ba2cdbbba","created":"2023-10-08T06:09:11.175626+0000","modified":"2023-10-08T06:09:38.153256+0000","last_up_change":"2023-10-08T06:09:22.744643+0000","last_in_change":"2023-10-08T06:09:14.131580+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T06:09:23.307843+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T06:09:34.295012+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T06:09:35.515590+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"43433f0c-9592-4874-92d7-10f8f4acf07f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":587888964},{"type":"v1","addr":"172.21.15.32:6801","nonce":587888964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":587888964},{"type":"v1","addr":"172.21.15.32:6803","nonce":587888964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":587888964},{"type":"v1","addr":"172.21.15.32:6810","nonce":587888964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6805","nonce":587888964},{"type":"v1","addr":"172.21.15.32:6807","nonce":587888964}]},"public_addr":"172.21.15.32:6801/587888964","cluster_addr":"172.21.15.32:6803/587888964","heartbeat_back_addr":"172.21.15.32:6810/587888964","heartbeat_front_addr":"172.21.15.32:6807/587888964","state":["exists","up"]},{"osd":1,"uuid":"2ecb1008-b987-4ce7-b646-6cded55fc8d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":990576767},{"type":"v1","addr":"172.21.15.32:6817","nonce":990576767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":990576767},{"type":"v1","addr":"172.21.15.32:6819","nonce":990576767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":990576767},{"type":"v1","addr":"172.21.15.32:6823","nonce":990576767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":990576767},{"type":"v1","addr":"172.21.15.32:6821","nonce":990576767}]},"public_addr":"172.21.15.32:6817/990576767","cluster_addr":"172.21.15.32:6819/990576767","heartbeat_back_addr":"172.21.15.32:6823/990576767","heartbeat_front_addr":"172.21.15.32:6821/990576767","state":["exists","up"]},{"osd":2,"uuid":"1b131c94-c09b-4e80-8746-bf1b7bac362d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6824","nonce":1566874440},{"type":"v1","addr":"172.21.15.32:6825","nonce":1566874440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":1566874440},{"type":"v1","addr":"172.21.15.32:6827","nonce":1566874440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":1566874440},{"type":"v1","addr":"172.21.15.32:6831","nonce":1566874440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":1566874440},{"type":"v1","addr":"172.21.15.32:6829","nonce":1566874440}]},"public_addr":"172.21.15.32:6825/1566874440","cluster_addr":"172.21.15.32:6827/1566874440","heartbeat_back_addr":"172.21.15.32:6831/1566874440","heartbeat_front_addr":"172.21.15.32:6829/1566874440","state":["exists","up"]},{"osd":3,"uuid":"ad655af2-1f6f-4689-b21d-b07bbaeb68b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":3672614802},{"type":"v1","addr":"172.21.15.32:6806","nonce":3672614802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6809","nonce":3672614802},{"type":"v1","addr":"172.21.15.32:6811","nonce":3672614802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":3672614802},{"type":"v1","addr":"172.21.15.32:6815","nonce":3672614802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":3672614802},{"type":"v1","addr":"172.21.15.32:6813","nonce":3672614802}]},"public_addr":"172.21.15.32:6806/3672614802","cluster_addr":"172.21.15.32:6811/3672614802","heartbeat_back_addr":"172.21.15.32:6815/3672614802","heartbeat_front_addr":"172.21.15.32:6813/3672614802","state":["exists","up"]},{"osd":4,"uuid":"64a543a1-8c4f-458e-9aba-b35c1cd7dd03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":3369928244},{"type":"v1","addr":"172.21.15.40:6801","nonce":3369928244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":3369928244},{"type":"v1","addr":"172.21.15.40:6803","nonce":3369928244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":3369928244},{"type":"v1","addr":"172.21.15.40:6807","nonce":3369928244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":3369928244},{"type":"v1","addr":"172.21.15.40:6805","nonce":3369928244}]},"public_addr":"172.21.15.40:6801/3369928244","cluster_addr":"172.21.15.40:6803/3369928244","heartbeat_back_addr":"172.21.15.40:6807/3369928244","heartbeat_front_addr":"172.21.15.40:6805/3369928244","state":["exists","up"]},{"osd":5,"uuid":"0fef3e54-edb4-4678-878e-944663c51638","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":2395850297},{"type":"v1","addr":"172.21.15.40:6825","nonce":2395850297}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":2395850297},{"type":"v1","addr":"172.21.15.40:6827","nonce":2395850297}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":2395850297},{"type":"v1","addr":"172.21.15.40:6831","nonce":2395850297}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":2395850297},{"type":"v1","addr":"172.21.15.40:6829","nonce":2395850297}]},"public_addr":"172.21.15.40:6825/2395850297","cluster_addr":"172.21.15.40:6827/2395850297","heartbeat_back_addr":"172.21.15.40:6831/2395850297","heartbeat_front_addr":"172.21.15.40:6829/2395850297","state":["exists","up"]},{"osd":6,"uuid":"2eeb0472-6096-469d-9b2c-cab4bf41c31a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":4145283410},{"type":"v1","addr":"172.21.15.40:6809","nonce":4145283410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":4145283410},{"type":"v1","addr":"172.21.15.40:6811","nonce":4145283410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":4145283410},{"type":"v1","addr":"172.21.15.40:6815","nonce":4145283410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":4145283410},{"type":"v1","addr":"172.21.15.40:6813","nonce":4145283410}]},"public_addr":"172.21.15.40:6809/4145283410","cluster_addr":"172.21.15.40:6811/4145283410","heartbeat_back_addr":"172.21.15.40:6815/4145283410","heartbeat_front_addr":"172.21.15.40:6813/4145283410","state":["exists","up"]},{"osd":7,"uuid":"cf76e4c7-96a6-401f-a280-91aad4641940","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":2943297416},{"type":"v1","addr":"172.21.15.40:6817","nonce":2943297416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":2943297416},{"type":"v1","addr":"172.21.15.40:6819","nonce":2943297416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":2943297416},{"type":"v1","addr":"172.21.15.40:6823","nonce":2943297416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":2943297416},{"type":"v1","addr":"172.21.15.40:6821","nonce":2943297416}]},"public_addr":"172.21.15.40:6817/2943297416","cluster_addr":"172.21.15.40:6819/2943297416","heartbeat_back_addr":"172.21.15.40:6823/2943297416","heartbeat_front_addr":"172.21.15.40:6821/2943297416","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.411475+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.628841+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.599055+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.166100+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.384135+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.488403+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.307648+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.363541+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T06:10:10.573 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.572+0000 7f5b00c16700 1 -- 172.21.15.32:0/3076832922 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f5adc066510 msgr2=0x7f5adc0689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:10.574 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.572+0000 7f5b00c16700 1 --2- 172.21.15.32:0/3076832922 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f5adc066510 0x7f5adc0689d0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f5afc0b5e30 tx=0x7f5ae4001960 comp rx=0 tx=0).stop 2023-10-08T06:10:10.574 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.572+0000 7f5b00c16700 1 -- 172.21.15.32:0/3076832922 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5afc06d490 msgr2=0x7f5afc0c3350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:10.574 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.572+0000 7f5b00c16700 1 --2- 172.21.15.32:0/3076832922 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5afc06d490 0x7f5afc0c3350 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f5aec000c00 tx=0x7f5aec004770 comp rx=0 tx=0).stop 2023-10-08T06:10:10.574 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.572+0000 7f5b00c16700 1 -- 172.21.15.32:0/3076832922 shutdown_connections 2023-10-08T06:10:10.574 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.572+0000 7f5b00c16700 1 --2- 172.21.15.32:0/3076832922 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f5adc066510 0x7f5adc0689d0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:10.574 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.572+0000 7f5b00c16700 1 --2- 172.21.15.32:0/3076832922 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5afc164c10 0x7f5afc0c4b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:10.574 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.572+0000 7f5b00c16700 1 --2- 172.21.15.32:0/3076832922 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5afc0cf460 0x7f5afc1555f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:10.574 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.572+0000 7f5b00c16700 1 --2- 172.21.15.32:0/3076832922 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5afc06d490 0x7f5afc0c3350 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:10.574 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.572+0000 7f5b00c16700 1 -- 172.21.15.32:0/3076832922 >> 172.21.15.32:0/3076832922 conn(0x7f5afc0cc7d0 msgr2=0x7f5afc0b0e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:10:10.575 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.572+0000 7f5b00c16700 1 -- 172.21.15.32:0/3076832922 shutdown_connections 2023-10-08T06:10:10.575 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.572+0000 7f5b00c16700 1 -- 172.21.15.32:0/3076832922 wait complete. 2023-10-08T06:10:10.587 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T06:09:23.307843+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-08T06:09:34.295012+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-08T06:09:35.515590+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-08T06:10:10.587 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T06:10:10.705 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.704+0000 7efc719a8700 1 Processor -- start 2023-10-08T06:10:10.705 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.704+0000 7efc719a8700 1 -- start start 2023-10-08T06:10:10.707 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.704+0000 7efc719a8700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7efc6c15d490 0x7efc6c0b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:10.707 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.704+0000 7efc719a8700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7efc6c0ce4e0 0x7efc6c0b6130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:10.707 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.704+0000 7efc719a8700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc6c0d1bb0 con 0x7efc6c0d13d0 2023-10-08T06:10:10.707 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.704+0000 7efc719a8700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc6c0d1e90 con 0x7efc6c0ce4e0 2023-10-08T06:10:10.707 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.704+0000 7efc719a8700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc6c0d2170 con 0x7efc6c15d490 2023-10-08T06:10:10.707 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.704+0000 7efc711a7700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7efc6c0ce4e0 0x7efc6c0b6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:10.707 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.704+0000 7efc711a7700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7efc6c0ce4e0 0x7efc6c0b6130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:46616/0 (socket says 172.21.15.32:46616) 2023-10-08T06:10:10.708 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.704+0000 7efc711a7700 1 -- 172.21.15.32:0/1610539984 learned_addr learned my addr 172.21.15.32:0/1610539984 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:10:10.708 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.704+0000 7efc709a6700 1 --2- 172.21.15.32:0/1610539984 >> v2:172.21.15.40:3300/0 conn(0x7efc6c15d490 0x7efc6c0b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:10.708 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.704+0000 7efc711a7700 1 -- 172.21.15.32:0/1610539984 >> v2:172.21.15.40:3300/0 conn(0x7efc6c15d490 msgr2=0x7efc6c0b8bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:10:10.708 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.704+0000 7efc711a7700 1 --2- 172.21.15.32:0/1610539984 >> v2:172.21.15.40:3300/0 conn(0x7efc6c15d490 0x7efc6c0b8bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:10.708 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.704+0000 7efc711a7700 1 -- 172.21.15.32:0/1610539984 >> v1:172.21.15.32:6789/0 conn(0x7efc6c0d13d0 legacy=0x7efc6c0cddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:10.708 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.704+0000 7efc637fe700 1 -- 172.21.15.32:0/1610539984 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3589047916 0 0) 0x7efc6c0d1bb0 con 0x7efc6c0d13d0 2023-10-08T06:10:10.708 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.704+0000 7efc711a7700 1 -- 172.21.15.32:0/1610539984 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc6c0d2450 con 0x7efc6c0ce4e0 2023-10-08T06:10:10.708 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.704+0000 7efc711a7700 1 --2- 172.21.15.32:0/1610539984 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efc6c0ce4e0 0x7efc6c0b6130 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7efc6c066df0 tx=0x7efc6400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6dfd4d3ce9c043b3 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:10.710 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.704+0000 7efc637fe700 1 -- 172.21.15.32:0/1610539984 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc6400e070 con 0x7efc6c0ce4e0 2023-10-08T06:10:10.710 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.704+0000 7efc637fe700 1 -- 172.21.15.32:0/1610539984 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc6400b910 con 0x7efc6c0ce4e0 2023-10-08T06:10:10.710 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.704+0000 7efc637fe700 1 -- 172.21.15.32:0/1610539984 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc6400bcc0 con 0x7efc6c0ce4e0 2023-10-08T06:10:10.710 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.708+0000 7efc719a8700 1 -- 172.21.15.32:0/1610539984 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efc6c0ce4e0 msgr2=0x7efc6c0b6130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:10.710 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.708+0000 7efc719a8700 1 --2- 172.21.15.32:0/1610539984 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efc6c0ce4e0 0x7efc6c0b6130 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7efc6c066df0 tx=0x7efc6400b330 comp rx=0 tx=0).stop 2023-10-08T06:10:10.710 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.708+0000 7efc719a8700 1 -- 172.21.15.32:0/1610539984 shutdown_connections 2023-10-08T06:10:10.710 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.708+0000 7efc719a8700 1 --2- 172.21.15.32:0/1610539984 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efc6c0ce4e0 0x7efc6c0b6130 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:10.710 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.708+0000 7efc719a8700 1 --2- 172.21.15.32:0/1610539984 >> v2:172.21.15.40:3300/0 conn(0x7efc6c15d490 0x7efc6c0b8bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:10.710 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.708+0000 7efc719a8700 1 -- 172.21.15.32:0/1610539984 >> 172.21.15.32:0/1610539984 conn(0x7efc6c06ab40 msgr2=0x7efc6c06af20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:10:10.710 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.708+0000 7efc719a8700 1 -- 172.21.15.32:0/1610539984 shutdown_connections 2023-10-08T06:10:10.711 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.708+0000 7efc719a8700 1 -- 172.21.15.32:0/1610539984 wait complete. 2023-10-08T06:10:10.711 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.708+0000 7efc719a8700 1 Processor -- start 2023-10-08T06:10:10.711 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.708+0000 7efc719a8700 1 -- start start 2023-10-08T06:10:10.712 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.708+0000 7efc719a8700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efc6c0ce4e0 0x7efc6c1f6650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:10.713 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.708+0000 7efc719a8700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efc6c0d13d0 0x7efc6c0c7b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:10.713 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.708+0000 7efc719a8700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efc6c15d490 0x7efc6c156fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:10.713 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.708+0000 7efc719a8700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc6c1f6b90 con 0x7efc6c15d490 2023-10-08T06:10:10.713 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.708+0000 7efc719a8700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc6c0c8b90 con 0x7efc6c0ce4e0 2023-10-08T06:10:10.713 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.708+0000 7efc719a8700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc6c1f5340 con 0x7efc6c0d13d0 2023-10-08T06:10:10.713 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.708+0000 7efc711a7700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efc6c15d490 0x7efc6c156fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:10.713 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.708+0000 7efc711a7700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efc6c15d490 0x7efc6c156fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:46626/0 (socket says 172.21.15.32:46626) 2023-10-08T06:10:10.713 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.708+0000 7efc711a7700 1 -- 172.21.15.32:0/4262050082 learned_addr learned my addr 172.21.15.32:0/4262050082 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:10:10.713 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.708+0000 7efc63fff700 1 --2- 172.21.15.32:0/4262050082 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efc6c0d13d0 0x7efc6c0c7b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:10.714 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.708+0000 7efc709a6700 1 --2- 172.21.15.32:0/4262050082 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efc6c0ce4e0 0x7efc6c1f6650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:10.714 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.708+0000 7efc711a7700 1 -- 172.21.15.32:0/4262050082 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efc6c0d13d0 msgr2=0x7efc6c0c7b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:10.714 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.708+0000 7efc711a7700 1 --2- 172.21.15.32:0/4262050082 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efc6c0d13d0 0x7efc6c0c7b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:10.714 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.708+0000 7efc711a7700 1 -- 172.21.15.32:0/4262050082 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efc6c0ce4e0 msgr2=0x7efc6c1f6650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:10.714 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.708+0000 7efc711a7700 1 --2- 172.21.15.32:0/4262050082 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efc6c0ce4e0 0x7efc6c1f6650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:10.714 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.708+0000 7efc711a7700 1 -- 172.21.15.32:0/4262050082 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc64009b30 con 0x7efc6c15d490 2023-10-08T06:10:10.714 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.712+0000 7efc711a7700 1 --2- 172.21.15.32:0/4262050082 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efc6c15d490 0x7efc6c156fa0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7efc6c066f10 tx=0x7efc64004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:10.714 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.712+0000 7efc617fa700 1 -- 172.21.15.32:0/4262050082 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc64004880 con 0x7efc6c15d490 2023-10-08T06:10:10.714 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.712+0000 7efc617fa700 1 -- 172.21.15.32:0/4262050082 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc640099b0 con 0x7efc6c15d490 2023-10-08T06:10:10.714 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.712+0000 7efc719a8700 1 -- 172.21.15.32:0/4262050082 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc6c0c85d0 con 0x7efc6c15d490 2023-10-08T06:10:10.715 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.712+0000 7efc617fa700 1 -- 172.21.15.32:0/4262050082 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc6401c680 con 0x7efc6c15d490 2023-10-08T06:10:10.715 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.712+0000 7efc719a8700 1 -- 172.21.15.32:0/4262050082 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc6c1f3890 con 0x7efc6c15d490 2023-10-08T06:10:10.716 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.712+0000 7efc719a8700 1 -- 172.21.15.32:0/4262050082 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc6c073f00 con 0x7efc6c15d490 2023-10-08T06:10:10.716 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.712+0000 7efc617fa700 1 -- 172.21.15.32:0/4262050082 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7efc6401c7e0 con 0x7efc6c15d490 2023-10-08T06:10:10.716 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.712+0000 7efc617fa700 1 --2- 172.21.15.32:0/4262050082 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7efc58066510 0x7efc580689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:10.716 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.716+0000 7efc709a6700 1 --2- 172.21.15.32:0/4262050082 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7efc58066510 0x7efc580689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:10.716 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.716+0000 7efc617fa700 1 -- 172.21.15.32:0/4262050082 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efc64085330 con 0x7efc6c15d490 2023-10-08T06:10:10.716 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.716+0000 7efc709a6700 1 --2- 172.21.15.32:0/4262050082 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7efc58066510 0x7efc580689d0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7efc6c0b7d50 tx=0x7efc68009240 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:10.723 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.720+0000 7efc617fa700 1 -- 172.21.15.32:0/4262050082 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7efc640527b0 con 0x7efc6c15d490 2023-10-08T06:10:10.887 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.884+0000 7efc719a8700 1 -- 172.21.15.32:0/4262050082 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7efc6c153210 con 0x7efc6c15d490 2023-10-08T06:10:10.888 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.888+0000 7efc617fa700 1 -- 172.21.15.32:0/4262050082 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7efc64055dd0 con 0x7efc6c15d490 2023-10-08T06:10:10.888 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 1 2023-10-08T06:10:10.890 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.888+0000 7efc719a8700 1 -- 172.21.15.32:0/4262050082 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7efc58066510 msgr2=0x7efc580689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:10.890 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.888+0000 7efc719a8700 1 --2- 172.21.15.32:0/4262050082 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7efc58066510 0x7efc580689d0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7efc6c0b7d50 tx=0x7efc68009240 comp rx=0 tx=0).stop 2023-10-08T06:10:10.890 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.888+0000 7efc719a8700 1 -- 172.21.15.32:0/4262050082 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efc6c15d490 msgr2=0x7efc6c156fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:10.890 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.888+0000 7efc719a8700 1 --2- 172.21.15.32:0/4262050082 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efc6c15d490 0x7efc6c156fa0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7efc6c066f10 tx=0x7efc64004af0 comp rx=0 tx=0).stop 2023-10-08T06:10:10.890 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.888+0000 7efc719a8700 1 -- 172.21.15.32:0/4262050082 shutdown_connections 2023-10-08T06:10:10.891 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.888+0000 7efc719a8700 1 --2- 172.21.15.32:0/4262050082 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7efc58066510 0x7efc580689d0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:10.891 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.888+0000 7efc719a8700 1 --2- 172.21.15.32:0/4262050082 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efc6c15d490 0x7efc6c156fa0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:10.891 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.888+0000 7efc719a8700 1 --2- 172.21.15.32:0/4262050082 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efc6c0d13d0 0x7efc6c0c7b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:10.891 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.888+0000 7efc719a8700 1 --2- 172.21.15.32:0/4262050082 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efc6c0ce4e0 0x7efc6c1f6650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:10.891 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.888+0000 7efc719a8700 1 -- 172.21.15.32:0/4262050082 >> 172.21.15.32:0/4262050082 conn(0x7efc6c06ab40 msgr2=0x7efc6c159f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:10:10.891 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.888+0000 7efc719a8700 1 -- 172.21.15.32:0/4262050082 shutdown_connections 2023-10-08T06:10:10.891 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:10.888+0000 7efc719a8700 1 -- 172.21.15.32:0/4262050082 wait complete. 2023-10-08T06:10:10.908 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-08T06:10:11.030 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.028+0000 7fac90066700 1 Processor -- start 2023-10-08T06:10:11.031 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.028+0000 7fac90066700 1 -- start start 2023-10-08T06:10:11.032 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.032+0000 7fac90066700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fac880add70 0x7fac88160f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:11.032 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.032+0000 7fac90066700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fac88161450 0x7fac8806fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:11.032 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.032+0000 7fac90066700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac880ad8e0 con 0x7fac8815d370 2023-10-08T06:10:11.033 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.032+0000 7fac90066700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac881618e0 con 0x7fac880add70 2023-10-08T06:10:11.033 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.032+0000 7fac90066700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac88161d60 con 0x7fac88161450 2023-10-08T06:10:11.033 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.032+0000 7fac8de02700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fac8815d370 0x7fac8806d6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:45816/0 (socket says 172.21.15.32:45816) 2023-10-08T06:10:11.033 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.032+0000 7fac8de02700 1 -- 172.21.15.32:0/3132273600 learned_addr learned my addr 172.21.15.32:0/3132273600 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-08T06:10:11.033 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.032+0000 7fac8d601700 1 --2- 172.21.15.32:0/3132273600 >> v2:172.21.15.40:3300/0 conn(0x7fac880add70 0x7fac88160f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:11.033 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.032+0000 7fac8e603700 1 --2- 172.21.15.32:0/3132273600 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fac88161450 0x7fac8806fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:11.035 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.032+0000 7fac8ce00700 1 -- 172.21.15.32:0/3132273600 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 672729342 0 0) 0x7fac880ad8e0 con 0x7fac8815d370 2023-10-08T06:10:11.035 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.032+0000 7fac8ce00700 1 -- 172.21.15.32:0/3132273600 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fac740035d0 con 0x7fac8815d370 2023-10-08T06:10:11.035 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.032+0000 7fac8d601700 1 -- 172.21.15.32:0/3132273600 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fac88161450 msgr2=0x7fac8806fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:10:11.035 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.032+0000 7fac8d601700 1 --2- 172.21.15.32:0/3132273600 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fac88161450 0x7fac8806fdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:11.035 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.032+0000 7fac8d601700 1 -- 172.21.15.32:0/3132273600 >> v1:172.21.15.32:6789/0 conn(0x7fac8815d370 legacy=0x7fac8806d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:11.035 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.032+0000 7fac8d601700 1 -- 172.21.15.32:0/3132273600 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac880accd0 con 0x7fac880add70 2023-10-08T06:10:11.036 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.032+0000 7fac8e603700 1 --2- 172.21.15.32:0/3132273600 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fac88161450 0x7fac8806fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T06:10:11.036 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.032+0000 7fac8d601700 1 --2- 172.21.15.32:0/3132273600 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fac880add70 0x7fac88160f10 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fac84009850 tx=0x7fac84009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=43008a2524da2905 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:11.036 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.032+0000 7fac8ce00700 1 -- 172.21.15.32:0/3132273600 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac84011830 con 0x7fac880add70 2023-10-08T06:10:11.036 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.032+0000 7fac8ce00700 1 -- 172.21.15.32:0/3132273600 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac84011990 con 0x7fac880add70 2023-10-08T06:10:11.036 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.032+0000 7fac8ce00700 1 -- 172.21.15.32:0/3132273600 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac84011d00 con 0x7fac880add70 2023-10-08T06:10:11.036 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.032+0000 7fac90066700 1 -- 172.21.15.32:0/3132273600 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fac880add70 msgr2=0x7fac88160f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:11.036 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.032+0000 7fac90066700 1 --2- 172.21.15.32:0/3132273600 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fac880add70 0x7fac88160f10 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fac84009850 tx=0x7fac84009b60 comp rx=0 tx=0).stop 2023-10-08T06:10:11.036 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.032+0000 7fac90066700 1 -- 172.21.15.32:0/3132273600 shutdown_connections 2023-10-08T06:10:11.036 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.032+0000 7fac90066700 1 --2- 172.21.15.32:0/3132273600 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fac88161450 0x7fac8806fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:11.037 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.032+0000 7fac90066700 1 --2- 172.21.15.32:0/3132273600 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fac880add70 0x7fac88160f10 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:11.037 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.032+0000 7fac90066700 1 -- 172.21.15.32:0/3132273600 >> 172.21.15.32:0/3132273600 conn(0x7fac880cee80 msgr2=0x7fac880cf290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:10:11.037 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.032+0000 7fac90066700 1 -- 172.21.15.32:0/3132273600 shutdown_connections 2023-10-08T06:10:11.037 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.032+0000 7fac90066700 1 -- 172.21.15.32:0/3132273600 wait complete. 2023-10-08T06:10:11.039 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.036+0000 7fac90066700 1 Processor -- start 2023-10-08T06:10:11.039 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.036+0000 7fac90066700 1 -- start start 2023-10-08T06:10:11.039 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.036+0000 7fac90066700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fac880add70 0x7fac88153680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:11.039 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.036+0000 7fac90066700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fac8815d370 0x7fac8815f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:11.040 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.036+0000 7fac90066700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fac88161450 0x7fac8815d750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:11.040 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.036+0000 7fac90066700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac8815e130 con 0x7fac8815d370 2023-10-08T06:10:11.040 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.036+0000 7fac90066700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac8815e410 con 0x7fac88161450 2023-10-08T06:10:11.040 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.036+0000 7fac90066700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac8815e6f0 con 0x7fac880add70 2023-10-08T06:10:11.040 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.036+0000 7fac8d601700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fac8815d370 0x7fac8815f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:11.040 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.036+0000 7fac8d601700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fac8815d370 0x7fac8815f1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:46640/0 (socket says 172.21.15.32:46640) 2023-10-08T06:10:11.040 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.036+0000 7fac8d601700 1 -- 172.21.15.32:0/2999855990 learned_addr learned my addr 172.21.15.32:0/2999855990 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:10:11.040 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.036+0000 7fac8e603700 1 --2- 172.21.15.32:0/2999855990 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fac88161450 0x7fac8815d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:11.040 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.036+0000 7fac8de02700 1 --2- 172.21.15.32:0/2999855990 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fac880add70 0x7fac88153680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:11.041 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.036+0000 7fac8d601700 1 -- 172.21.15.32:0/2999855990 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fac880add70 msgr2=0x7fac88153680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:11.041 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.036+0000 7fac8d601700 1 --2- 172.21.15.32:0/2999855990 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fac880add70 0x7fac88153680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:11.041 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.036+0000 7fac8d601700 1 -- 172.21.15.32:0/2999855990 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fac88161450 msgr2=0x7fac8815d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:11.041 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.036+0000 7fac8d601700 1 --2- 172.21.15.32:0/2999855990 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fac88161450 0x7fac8815d750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:11.041 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.036+0000 7fac8d601700 1 -- 172.21.15.32:0/2999855990 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac80009a70 con 0x7fac8815d370 2023-10-08T06:10:11.041 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.036+0000 7fac8d601700 1 --2- 172.21.15.32:0/2999855990 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fac8815d370 0x7fac8815f1d0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fac84009ba0 tx=0x7fac84004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:11.041 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.036+0000 7fac7a7fc700 1 -- 172.21.15.32:0/2999855990 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac840036c0 con 0x7fac8815d370 2023-10-08T06:10:11.041 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.036+0000 7fac7a7fc700 1 -- 172.21.15.32:0/2999855990 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac8401e070 con 0x7fac8815d370 2023-10-08T06:10:11.041 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.036+0000 7fac90066700 1 -- 172.21.15.32:0/2999855990 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac840094b0 con 0x7fac8815d370 2023-10-08T06:10:11.042 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.036+0000 7fac7a7fc700 1 -- 172.21.15.32:0/2999855990 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac84003a40 con 0x7fac8815d370 2023-10-08T06:10:11.042 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.036+0000 7fac90066700 1 -- 172.21.15.32:0/2999855990 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac8815ecb0 con 0x7fac8815d370 2023-10-08T06:10:11.043 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.040+0000 7fac90066700 1 -- 172.21.15.32:0/2999855990 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac880ad270 con 0x7fac8815d370 2023-10-08T06:10:11.043 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.040+0000 7fac7a7fc700 1 -- 172.21.15.32:0/2999855990 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fac84003ba0 con 0x7fac8815d370 2023-10-08T06:10:11.043 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.040+0000 7fac7a7fc700 1 --2- 172.21.15.32:0/2999855990 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fac6c066510 0x7fac6c0689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:11.043 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.040+0000 7fac7a7fc700 1 -- 172.21.15.32:0/2999855990 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fac84084e20 con 0x7fac8815d370 2023-10-08T06:10:11.043 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.040+0000 7fac8de02700 1 --2- 172.21.15.32:0/2999855990 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fac6c066510 0x7fac6c0689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:11.043 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.040+0000 7fac8de02700 1 --2- 172.21.15.32:0/2999855990 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fac6c066510 0x7fac6c0689d0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fac7c005930 tx=0x7fac7c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:11.051 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.048+0000 7fac7a7fc700 1 -- 172.21.15.32:0/2999855990 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fac880ad270 con 0x7fac8815d370 2023-10-08T06:10:11.215 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.212+0000 7fac90066700 1 -- 172.21.15.32:0/2999855990 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fac880ad270 con 0x7fac8815d370 2023-10-08T06:10:11.216 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.216+0000 7fac7a7fc700 1 -- 172.21.15.32:0/2999855990 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7fac84020020 con 0x7fac8815d370 2023-10-08T06:10:11.216 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 32 2023-10-08T06:10:11.219 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.216+0000 7fac90066700 1 -- 172.21.15.32:0/2999855990 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fac6c066510 msgr2=0x7fac6c0689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:11.219 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.216+0000 7fac90066700 1 --2- 172.21.15.32:0/2999855990 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fac6c066510 0x7fac6c0689d0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fac7c005930 tx=0x7fac7c009040 comp rx=0 tx=0).stop 2023-10-08T06:10:11.219 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.216+0000 7fac90066700 1 -- 172.21.15.32:0/2999855990 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fac8815d370 msgr2=0x7fac8815f1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:11.219 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.216+0000 7fac90066700 1 --2- 172.21.15.32:0/2999855990 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fac8815d370 0x7fac8815f1d0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fac84009ba0 tx=0x7fac84004770 comp rx=0 tx=0).stop 2023-10-08T06:10:11.219 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.216+0000 7fac90066700 1 -- 172.21.15.32:0/2999855990 shutdown_connections 2023-10-08T06:10:11.219 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.216+0000 7fac90066700 1 --2- 172.21.15.32:0/2999855990 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fac6c066510 0x7fac6c0689d0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:11.219 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.216+0000 7fac90066700 1 --2- 172.21.15.32:0/2999855990 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fac8815d370 0x7fac8815f1d0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:11.221 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.216+0000 7fac90066700 1 --2- 172.21.15.32:0/2999855990 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fac88161450 0x7fac8815d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:11.221 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.216+0000 7fac90066700 1 --2- 172.21.15.32:0/2999855990 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fac880add70 0x7fac88153680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:11.221 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.216+0000 7fac90066700 1 -- 172.21.15.32:0/2999855990 >> 172.21.15.32:0/2999855990 conn(0x7fac880cee80 msgr2=0x7fac8815b0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:10:11.221 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.216+0000 7fac90066700 1 -- 172.21.15.32:0/2999855990 shutdown_connections 2023-10-08T06:10:11.221 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.216+0000 7fac90066700 1 -- 172.21.15.32:0/2999855990 wait complete. 2023-10-08T06:10:11.233 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-08T06:10:11.353 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.352+0000 7fb0f730e700 1 Processor -- start 2023-10-08T06:10:11.354 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.352+0000 7fb0f730e700 1 -- start start 2023-10-08T06:10:11.355 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.352+0000 7fb0f730e700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fb0f01597f0 0x7fb0f00ce190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:11.355 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.352+0000 7fb0f730e700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb0f0159bd0 0x7fb0f006c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:11.355 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.352+0000 7fb0f730e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb0f00cd720 0x7fb0f00cdb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:11.355 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.352+0000 7fb0f730e700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0f006cc10 con 0x7fb0f01597f0 2023-10-08T06:10:11.355 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.352+0000 7fb0f730e700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0f00cd290 con 0x7fb0f0159bd0 2023-10-08T06:10:11.355 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.352+0000 7fb0f730e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0f00cec10 con 0x7fb0f00cd720 2023-10-08T06:10:11.356 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.352+0000 7fb0f630c700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fb0f01597f0 0x7fb0f00ce190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:11.356 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.352+0000 7fb0f630c700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fb0f01597f0 0x7fb0f00ce190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:46656/0 (socket says 172.21.15.32:46656) 2023-10-08T06:10:11.356 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.352+0000 7fb0f630c700 1 -- 172.21.15.32:0/4267510906 learned_addr learned my addr 172.21.15.32:0/4267510906 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:10:11.356 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.352+0000 7fb0f5b0b700 1 --2- 172.21.15.32:0/4267510906 >> v2:172.21.15.40:3300/0 conn(0x7fb0f0159bd0 0x7fb0f006c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:11.356 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.352+0000 7fb0f6b0d700 1 --2- 172.21.15.32:0/4267510906 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb0f00cd720 0x7fb0f00cdb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:11.358 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.356+0000 7fb0f630c700 1 -- 172.21.15.32:0/4267510906 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb0f00cd720 msgr2=0x7fb0f00cdb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:10:11.358 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.356+0000 7fb0f630c700 1 --2- 172.21.15.32:0/4267510906 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb0f00cd720 0x7fb0f00cdb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:11.358 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.356+0000 7fb0f630c700 1 -- 172.21.15.32:0/4267510906 >> v2:172.21.15.40:3300/0 conn(0x7fb0f0159bd0 msgr2=0x7fb0f006c6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:10:11.358 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.356+0000 7fb0f630c700 1 --2- 172.21.15.32:0/4267510906 >> v2:172.21.15.40:3300/0 conn(0x7fb0f0159bd0 0x7fb0f006c6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:11.358 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.356+0000 7fb0f630c700 1 -- 172.21.15.32:0/4267510906 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0f00cc9a0 con 0x7fb0f01597f0 2023-10-08T06:10:11.358 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.356+0000 7fb0f630c700 1 --2- 172.21.15.32:0/4267510906 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb0f01597f0 0x7fb0f00ce190 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fb0f015d520 tx=0x7fb0e0009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7ece7e9052aa1ea server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:11.358 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.356+0000 7fb0f530a700 1 -- 172.21.15.32:0/4267510906 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0e0011830 con 0x7fb0f01597f0 2023-10-08T06:10:11.358 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.356+0000 7fb0f530a700 1 -- 172.21.15.32:0/4267510906 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0e0011990 con 0x7fb0f01597f0 2023-10-08T06:10:11.359 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.356+0000 7fb0f530a700 1 -- 172.21.15.32:0/4267510906 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0e0011d20 con 0x7fb0f01597f0 2023-10-08T06:10:11.359 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.356+0000 7fb0f730e700 1 -- 172.21.15.32:0/4267510906 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb0f01597f0 msgr2=0x7fb0f00ce190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:11.359 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.356+0000 7fb0f730e700 1 --2- 172.21.15.32:0/4267510906 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb0f01597f0 0x7fb0f00ce190 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fb0f015d520 tx=0x7fb0e0009bf0 comp rx=0 tx=0).stop 2023-10-08T06:10:11.359 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.356+0000 7fb0f730e700 1 -- 172.21.15.32:0/4267510906 shutdown_connections 2023-10-08T06:10:11.359 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.356+0000 7fb0f730e700 1 --2- 172.21.15.32:0/4267510906 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb0f00cd720 0x7fb0f00cdb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:11.359 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.356+0000 7fb0f730e700 1 --2- 172.21.15.32:0/4267510906 >> v2:172.21.15.40:3300/0 conn(0x7fb0f0159bd0 0x7fb0f006c6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:11.359 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.356+0000 7fb0f730e700 1 --2- 172.21.15.32:0/4267510906 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb0f01597f0 0x7fb0f00ce190 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:11.359 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.356+0000 7fb0f730e700 1 -- 172.21.15.32:0/4267510906 >> 172.21.15.32:0/4267510906 conn(0x7fb0f00b0900 msgr2=0x7fb0f00b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:10:11.359 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.356+0000 7fb0f730e700 1 -- 172.21.15.32:0/4267510906 shutdown_connections 2023-10-08T06:10:11.359 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.356+0000 7fb0f730e700 1 -- 172.21.15.32:0/4267510906 wait complete. 2023-10-08T06:10:11.360 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.360+0000 7fb0f730e700 1 Processor -- start 2023-10-08T06:10:11.360 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.360+0000 7fb0f730e700 1 -- start start 2023-10-08T06:10:11.363 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.360+0000 7fb0f730e700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb0f00cd720 0x7fb0f0151e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:11.363 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.360+0000 7fb0f730e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb0f01597f0 0x7fb0f015b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:11.363 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.360+0000 7fb0f730e700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb0f0159bd0 0x7fb0f0151640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:11.363 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.360+0000 7fb0f730e700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0f015bbc0 con 0x7fb0f00cd720 2023-10-08T06:10:11.363 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.360+0000 7fb0f730e700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0f015bea0 con 0x7fb0f0159bd0 2023-10-08T06:10:11.363 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.360+0000 7fb0f730e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0f015c180 con 0x7fb0f01597f0 2023-10-08T06:10:11.363 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.360+0000 7fb0f630c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb0f00cd720 0x7fb0f0151e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:11.363 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.360+0000 7fb0f630c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb0f00cd720 0x7fb0f0151e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:46660/0 (socket says 172.21.15.32:46660) 2023-10-08T06:10:11.363 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.360+0000 7fb0f630c700 1 -- 172.21.15.32:0/2311823850 learned_addr learned my addr 172.21.15.32:0/2311823850 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:10:11.364 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.360+0000 7fb0f5b0b700 1 --2- 172.21.15.32:0/2311823850 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb0f01597f0 0x7fb0f015b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:11.364 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.360+0000 7fb0f6b0d700 1 --2- 172.21.15.32:0/2311823850 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb0f0159bd0 0x7fb0f0151640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:11.364 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.360+0000 7fb0f630c700 1 -- 172.21.15.32:0/2311823850 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb0f01597f0 msgr2=0x7fb0f015b530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:11.364 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.360+0000 7fb0f630c700 1 --2- 172.21.15.32:0/2311823850 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb0f01597f0 0x7fb0f015b530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:11.364 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.360+0000 7fb0f630c700 1 -- 172.21.15.32:0/2311823850 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb0f0159bd0 msgr2=0x7fb0f0151640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:11.364 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.360+0000 7fb0f630c700 1 --2- 172.21.15.32:0/2311823850 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb0f0159bd0 0x7fb0f0151640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:11.364 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.360+0000 7fb0f630c700 1 -- 172.21.15.32:0/2311823850 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0e0009570 con 0x7fb0f00cd720 2023-10-08T06:10:11.364 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.360+0000 7fb0f630c700 1 --2- 172.21.15.32:0/2311823850 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb0f00cd720 0x7fb0f0151e50 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fb0f006b7d0 tx=0x7fb0e0004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:11.365 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.360+0000 7fb0e6ffd700 1 -- 172.21.15.32:0/2311823850 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0e0004240 con 0x7fb0f00cd720 2023-10-08T06:10:11.365 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.360+0000 7fb0e6ffd700 1 -- 172.21.15.32:0/2311823850 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0e001f070 con 0x7fb0f00cd720 2023-10-08T06:10:11.365 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.360+0000 7fb0e6ffd700 1 -- 172.21.15.32:0/2311823850 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0e0004600 con 0x7fb0f00cd720 2023-10-08T06:10:11.366 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.360+0000 7fb0f730e700 1 -- 172.21.15.32:0/2311823850 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0f015c460 con 0x7fb0f00cd720 2023-10-08T06:10:11.366 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.360+0000 7fb0f730e700 1 -- 172.21.15.32:0/2311823850 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0f0152640 con 0x7fb0f00cd720 2023-10-08T06:10:11.366 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.364+0000 7fb0f730e700 1 -- 172.21.15.32:0/2311823850 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0f015c980 con 0x7fb0f00cd720 2023-10-08T06:10:11.366 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.364+0000 7fb0e6ffd700 1 -- 172.21.15.32:0/2311823850 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fb0e0021030 con 0x7fb0f00cd720 2023-10-08T06:10:11.367 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.364+0000 7fb0e6ffd700 1 --2- 172.21.15.32:0/2311823850 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fb0d4066510 0x7fb0d40689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:11.367 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.364+0000 7fb0e6ffd700 1 -- 172.21.15.32:0/2311823850 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb0e0084ec0 con 0x7fb0f00cd720 2023-10-08T06:10:11.367 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.364+0000 7fb0f5b0b700 1 --2- 172.21.15.32:0/2311823850 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fb0d4066510 0x7fb0d40689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:11.367 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.364+0000 7fb0f5b0b700 1 --2- 172.21.15.32:0/2311823850 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fb0d4066510 0x7fb0d40689d0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fb0f0152a10 tx=0x7fb0ec009240 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:11.374 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.372+0000 7fb0e6ffd700 1 -- 172.21.15.32:0/2311823850 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fb0f015c980 con 0x7fb0f00cd720 2023-10-08T06:10:11.535 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.532+0000 7fb0f730e700 1 -- 172.21.15.32:0/2311823850 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb0f015c980 con 0x7fb0f00cd720 2023-10-08T06:10:11.536 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.536+0000 7fb0e6ffd700 1 -- 172.21.15.32:0/2311823850 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb0f015c980 con 0x7fb0f00cd720 2023-10-08T06:10:11.536 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 64 2023-10-08T06:10:11.538 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.536+0000 7fb0f730e700 1 -- 172.21.15.32:0/2311823850 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fb0d4066510 msgr2=0x7fb0d40689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:11.539 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.536+0000 7fb0f730e700 1 --2- 172.21.15.32:0/2311823850 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fb0d4066510 0x7fb0d40689d0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fb0f0152a10 tx=0x7fb0ec009240 comp rx=0 tx=0).stop 2023-10-08T06:10:11.539 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.536+0000 7fb0f730e700 1 -- 172.21.15.32:0/2311823850 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb0f00cd720 msgr2=0x7fb0f0151e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:11.539 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.536+0000 7fb0f730e700 1 --2- 172.21.15.32:0/2311823850 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb0f00cd720 0x7fb0f0151e50 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fb0f006b7d0 tx=0x7fb0e0004770 comp rx=0 tx=0).stop 2023-10-08T06:10:11.539 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.536+0000 7fb0f730e700 1 -- 172.21.15.32:0/2311823850 shutdown_connections 2023-10-08T06:10:11.539 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.536+0000 7fb0f730e700 1 --2- 172.21.15.32:0/2311823850 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fb0d4066510 0x7fb0d40689d0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:11.539 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.536+0000 7fb0f730e700 1 --2- 172.21.15.32:0/2311823850 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb0f0159bd0 0x7fb0f0151640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:11.539 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.536+0000 7fb0f730e700 1 --2- 172.21.15.32:0/2311823850 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb0f01597f0 0x7fb0f015b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:11.539 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.536+0000 7fb0f730e700 1 --2- 172.21.15.32:0/2311823850 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb0f00cd720 0x7fb0f0151e50 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:11.539 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.536+0000 7fb0f730e700 1 -- 172.21.15.32:0/2311823850 >> 172.21.15.32:0/2311823850 conn(0x7fb0f00b0900 msgr2=0x7fb0f00b2140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:10:11.539 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.536+0000 7fb0f730e700 1 -- 172.21.15.32:0/2311823850 shutdown_connections 2023-10-08T06:10:11.539 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.536+0000 7fb0f730e700 1 -- 172.21.15.32:0/2311823850 wait complete. 2023-10-08T06:10:11.557 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-08T06:10:11.671 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.668+0000 7f278137f700 1 Processor -- start 2023-10-08T06:10:11.671 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.668+0000 7f278137f700 1 -- start start 2023-10-08T06:10:11.672 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.672+0000 7f278137f700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f277c0ca220 0x7f277c0ce190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:11.673 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.672+0000 7f278137f700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f277c0cd290 con 0x7f277c159bd0 2023-10-08T06:10:11.673 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.672+0000 7f278137f700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f277c0cec10 con 0x7f277c1597f0 2023-10-08T06:10:11.673 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.672+0000 7f278137f700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f277c0cc9a0 con 0x7f277c0ca220 2023-10-08T06:10:11.673 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.672+0000 7f277b7fe700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f277c159bd0 0x7f277c0c9b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:45824/0 (socket says 172.21.15.32:45824) 2023-10-08T06:10:11.673 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.672+0000 7f277b7fe700 1 -- 172.21.15.32:0/473433144 learned_addr learned my addr 172.21.15.32:0/473433144 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-08T06:10:11.673 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.672+0000 7f2780b7e700 1 --2- 172.21.15.32:0/473433144 >> v2:172.21.15.40:3300/0 conn(0x7f277c0ca220 0x7f277c0ce190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:11.674 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.672+0000 7f277affd700 1 -- 172.21.15.32:0/473433144 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3072162166 0 0) 0x7f277c0cd290 con 0x7f277c159bd0 2023-10-08T06:10:11.674 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.672+0000 7f277affd700 1 -- 172.21.15.32:0/473433144 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f27640035d0 con 0x7f277c159bd0 2023-10-08T06:10:11.674 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.672+0000 7f2780b7e700 1 -- 172.21.15.32:0/473433144 >> v1:172.21.15.40:6789/0 conn(0x7f277c1597f0 legacy=0x7f277c0cd720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:11.675 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.672+0000 7f2780b7e700 1 -- 172.21.15.32:0/473433144 >> v1:172.21.15.32:6789/0 conn(0x7f277c159bd0 legacy=0x7f277c0c9b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:11.675 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.672+0000 7f2780b7e700 1 -- 172.21.15.32:0/473433144 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f277c06ce00 con 0x7f277c0ca220 2023-10-08T06:10:11.675 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.672+0000 7f2780b7e700 1 --2- 172.21.15.32:0/473433144 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f277c0ca220 0x7f277c0ce190 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f2774009d90 tx=0x7f277400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1c3231f7d614b843 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:11.675 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.672+0000 7f277affd700 1 -- 172.21.15.32:0/473433144 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f277400e070 con 0x7f277c0ca220 2023-10-08T06:10:11.675 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.672+0000 7f277affd700 1 -- 172.21.15.32:0/473433144 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f277400bb20 con 0x7f277c0ca220 2023-10-08T06:10:11.675 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.672+0000 7f277affd700 1 -- 172.21.15.32:0/473433144 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2774012430 con 0x7f277c0ca220 2023-10-08T06:10:11.676 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.672+0000 7f278137f700 1 -- 172.21.15.32:0/473433144 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f277c0ca220 msgr2=0x7f277c0ce190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:11.676 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.672+0000 7f278137f700 1 --2- 172.21.15.32:0/473433144 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f277c0ca220 0x7f277c0ce190 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f2774009d90 tx=0x7f277400b330 comp rx=0 tx=0).stop 2023-10-08T06:10:11.676 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.672+0000 7f278137f700 1 -- 172.21.15.32:0/473433144 shutdown_connections 2023-10-08T06:10:11.677 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.672+0000 7f278137f700 1 --2- 172.21.15.32:0/473433144 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f277c0ca220 0x7f277c0ce190 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:11.677 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.672+0000 7f278137f700 1 -- 172.21.15.32:0/473433144 >> 172.21.15.32:0/473433144 conn(0x7f277c0b0900 msgr2=0x7f277c0b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:10:11.677 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.672+0000 7f278137f700 1 -- 172.21.15.32:0/473433144 shutdown_connections 2023-10-08T06:10:11.677 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.672+0000 7f278137f700 1 -- 172.21.15.32:0/473433144 wait complete. 2023-10-08T06:10:11.680 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.676+0000 7f278137f700 1 Processor -- start 2023-10-08T06:10:11.680 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.676+0000 7f278137f700 1 -- start start 2023-10-08T06:10:11.680 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.676+0000 7f278137f700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f277c0ca220 0x7f277c0b2c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:11.680 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.676+0000 7f278137f700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f277c1597f0 0x7f277c0be820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:11.680 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.676+0000 7f278137f700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f277c159bd0 0x7f277c0bed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:11.680 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.676+0000 7f278137f700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f277c15a570 con 0x7f277c159bd0 2023-10-08T06:10:11.680 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.676+0000 7f278137f700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f277c0b32b0 con 0x7f277c0ca220 2023-10-08T06:10:11.680 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.676+0000 7f278137f700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f277c0b3590 con 0x7f277c1597f0 2023-10-08T06:10:11.680 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.676+0000 7f2780b7e700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f277c159bd0 0x7f277c0bed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:11.681 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.676+0000 7f2780b7e700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f277c159bd0 0x7f277c0bed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:46666/0 (socket says 172.21.15.32:46666) 2023-10-08T06:10:11.681 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.676+0000 7f2780b7e700 1 -- 172.21.15.32:0/2240065103 learned_addr learned my addr 172.21.15.32:0/2240065103 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:10:11.681 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.676+0000 7f277b7fe700 1 --2- 172.21.15.32:0/2240065103 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f277c1597f0 0x7f277c0be820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:11.681 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.676+0000 7f277bfff700 1 --2- 172.21.15.32:0/2240065103 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f277c0ca220 0x7f277c0b2c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:11.681 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.676+0000 7f2780b7e700 1 -- 172.21.15.32:0/2240065103 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f277c1597f0 msgr2=0x7f277c0be820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:11.681 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.676+0000 7f2780b7e700 1 --2- 172.21.15.32:0/2240065103 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f277c1597f0 0x7f277c0be820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:11.681 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.676+0000 7f2780b7e700 1 -- 172.21.15.32:0/2240065103 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f277c0ca220 msgr2=0x7f277c0b2c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:11.681 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.676+0000 7f2780b7e700 1 --2- 172.21.15.32:0/2240065103 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f277c0ca220 0x7f277c0b2c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:11.681 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.676+0000 7f2780b7e700 1 -- 172.21.15.32:0/2240065103 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2774009a70 con 0x7f277c159bd0 2023-10-08T06:10:11.682 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.676+0000 7f277b7fe700 1 --2- 172.21.15.32:0/2240065103 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f277c1597f0 0x7f277c0be820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T06:10:11.682 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.676+0000 7f277bfff700 1 --2- 172.21.15.32:0/2240065103 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f277c0ca220 0x7f277c0b2c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T06:10:11.682 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.676+0000 7f2780b7e700 1 --2- 172.21.15.32:0/2240065103 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f277c159bd0 0x7f277c0bed60 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f277c0ceda0 tx=0x7f2774004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:11.682 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.676+0000 7f2778ff9700 1 -- 172.21.15.32:0/2240065103 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2774012430 con 0x7f277c159bd0 2023-10-08T06:10:11.682 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.676+0000 7f2778ff9700 1 -- 172.21.15.32:0/2240065103 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2774020070 con 0x7f277c159bd0 2023-10-08T06:10:11.682 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.676+0000 7f2778ff9700 1 -- 172.21.15.32:0/2240065103 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2774004280 con 0x7f277c159bd0 2023-10-08T06:10:11.682 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.676+0000 7f278137f700 1 -- 172.21.15.32:0/2240065103 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f277c0b3870 con 0x7f277c159bd0 2023-10-08T06:10:11.682 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.676+0000 7f278137f700 1 -- 172.21.15.32:0/2240065103 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f277c1486e0 con 0x7f277c159bd0 2023-10-08T06:10:11.683 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.680+0000 7f278137f700 1 -- 172.21.15.32:0/2240065103 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f277c0b3d90 con 0x7f277c159bd0 2023-10-08T06:10:11.683 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.680+0000 7f2778ff9700 1 -- 172.21.15.32:0/2240065103 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f27740043e0 con 0x7f277c159bd0 2023-10-08T06:10:11.683 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.680+0000 7f2778ff9700 1 --2- 172.21.15.32:0/2240065103 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f2768066510 0x7f27680689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:11.683 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.680+0000 7f2778ff9700 1 -- 172.21.15.32:0/2240065103 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2774022070 con 0x7f277c159bd0 2023-10-08T06:10:11.683 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.680+0000 7f277bfff700 1 --2- 172.21.15.32:0/2240065103 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f2768066510 0x7f27680689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:11.684 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.684+0000 7f277bfff700 1 --2- 172.21.15.32:0/2240065103 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f2768066510 0x7f27680689d0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f277c0bc6e0 tx=0x7f2770009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:11.687 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.684+0000 7f2778ff9700 1 -- 172.21.15.32:0/2240065103 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f277c0b3d90 con 0x7f277c159bd0 2023-10-08T06:10:11.865 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.864+0000 7f278137f700 1 -- 172.21.15.32:0/2240065103 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f277c0b3d90 con 0x7f277c159bd0 2023-10-08T06:10:11.866 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.864+0000 7f2778ff9700 1 -- 172.21.15.32:0/2240065103 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v22) v1 ==== 80+0+0 (secure 0 0 0) 0x7f277c0b3d90 con 0x7f277c159bd0 2023-10-08T06:10:11.868 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.868+0000 7f278137f700 1 -- 172.21.15.32:0/2240065103 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f2768066510 msgr2=0x7f27680689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:11.868 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.868+0000 7f278137f700 1 --2- 172.21.15.32:0/2240065103 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f2768066510 0x7f27680689d0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f277c0bc6e0 tx=0x7f2770009040 comp rx=0 tx=0).stop 2023-10-08T06:10:11.869 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.868+0000 7f278137f700 1 -- 172.21.15.32:0/2240065103 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f277c159bd0 msgr2=0x7f277c0bed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:11.869 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.868+0000 7f278137f700 1 --2- 172.21.15.32:0/2240065103 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f277c159bd0 0x7f277c0bed60 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f277c0ceda0 tx=0x7f2774004af0 comp rx=0 tx=0).stop 2023-10-08T06:10:11.869 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.868+0000 7f278137f700 1 -- 172.21.15.32:0/2240065103 shutdown_connections 2023-10-08T06:10:11.869 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.868+0000 7f278137f700 1 --2- 172.21.15.32:0/2240065103 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f2768066510 0x7f27680689d0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:11.869 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.868+0000 7f278137f700 1 --2- 172.21.15.32:0/2240065103 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f277c159bd0 0x7f277c0bed60 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:11.869 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.868+0000 7f278137f700 1 --2- 172.21.15.32:0/2240065103 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f277c1597f0 0x7f277c0be820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:11.869 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.868+0000 7f278137f700 1 --2- 172.21.15.32:0/2240065103 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f277c0ca220 0x7f277c0b2c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:11.869 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.868+0000 7f278137f700 1 -- 172.21.15.32:0/2240065103 >> 172.21.15.32:0/2240065103 conn(0x7f277c0b0900 msgr2=0x7f277c0cf6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:10:11.869 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.868+0000 7f278137f700 1 -- 172.21.15.32:0/2240065103 shutdown_connections 2023-10-08T06:10:11.869 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:11.868+0000 7f278137f700 1 -- 172.21.15.32:0/2240065103 wait complete. 2023-10-08T06:10:11.870 INFO:teuthology.orchestra.run.smithi032.stderr:listed 0 entries 2023-10-08T06:10:11.881 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi032.front.sepia.ceph.com... 2023-10-08T06:10:11.881 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T06:10:11.882 DEBUG:teuthology.orchestra.run.smithi032:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-10-08T06:10:11.907 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T06:10:11.907 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi032.front.sepia.ceph.com 2023-10-08T06:10:11.907 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T06:10:11.907 DEBUG:teuthology.orchestra.run.smithi032:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-08T06:10:11.942 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-10-08T06:10:11.942 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-08T06:10:11.950 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-10-08T06:10:11.950 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-08T06:10:12.001 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T06:10:12.127 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.124+0000 7f94bf408700 1 Processor -- start 2023-10-08T06:10:12.127 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.124+0000 7f94bf408700 1 -- start start 2023-10-08T06:10:12.128 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.128+0000 7f94bf408700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f94b80cd5a0 0x7f94b80cebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:12.128 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.128+0000 7f94bf408700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94b8159b30 con 0x7f94b80cf0f0 2023-10-08T06:10:12.128 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.128+0000 7f94bf408700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94b80cdb10 con 0x7f94b8159750 2023-10-08T06:10:12.128 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.128+0000 7f94bf408700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94b80cddf0 con 0x7f94b80cd5a0 2023-10-08T06:10:12.128 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.128+0000 7f94bec07700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f94b80cf0f0 0x7f94b815d250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:45828/0 (socket says 172.21.15.32:45828) 2023-10-08T06:10:12.128 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.128+0000 7f94bec07700 1 -- 172.21.15.32:0/976098999 learned_addr learned my addr 172.21.15.32:0/976098999 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-08T06:10:12.129 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.128+0000 7f94bdc05700 1 --2- 172.21.15.32:0/976098999 >> v2:172.21.15.40:3300/0 conn(0x7f94b80cd5a0 0x7f94b80cebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:12.130 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.128+0000 7f94bd404700 1 -- 172.21.15.32:0/976098999 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3011805915 0 0) 0x7f94b8159b30 con 0x7f94b80cf0f0 2023-10-08T06:10:12.130 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.128+0000 7f94bd404700 1 -- 172.21.15.32:0/976098999 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f94a40035d0 con 0x7f94b80cf0f0 2023-10-08T06:10:12.130 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.128+0000 7f94bdc05700 1 -- 172.21.15.32:0/976098999 >> v1:172.21.15.40:6789/0 conn(0x7f94b8159750 legacy=0x7f94b806b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:12.130 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.128+0000 7f94bdc05700 1 -- 172.21.15.32:0/976098999 >> v1:172.21.15.32:6789/0 conn(0x7f94b80cf0f0 legacy=0x7f94b815d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:12.130 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.128+0000 7f94bdc05700 1 -- 172.21.15.32:0/976098999 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94b80ce0d0 con 0x7f94b80cd5a0 2023-10-08T06:10:12.130 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.128+0000 7f94bd404700 1 -- 172.21.15.32:0/976098999 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3463413111 0 0) 0x7f94a40035d0 con 0x7f94b80cf0f0 2023-10-08T06:10:12.130 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.128+0000 7f94bdc05700 1 --2- 172.21.15.32:0/976098999 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f94b80cd5a0 0x7f94b80cebb0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f94b4009850 tx=0x7f94b4009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2b4e6acc2551f2b0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:12.130 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.128+0000 7f94bd404700 1 -- 172.21.15.32:0/976098999 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94b00019f0 con 0x7f94b80cd5a0 2023-10-08T06:10:12.130 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.128+0000 7f94bd404700 1 -- 172.21.15.32:0/976098999 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94b4004030 con 0x7f94b80cd5a0 2023-10-08T06:10:12.131 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.128+0000 7f94bd404700 1 -- 172.21.15.32:0/976098999 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94b40043c0 con 0x7f94b80cd5a0 2023-10-08T06:10:12.131 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.128+0000 7f94bf408700 1 -- 172.21.15.32:0/976098999 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f94b80cd5a0 msgr2=0x7f94b80cebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:12.131 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.128+0000 7f94bf408700 1 --2- 172.21.15.32:0/976098999 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f94b80cd5a0 0x7f94b80cebb0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f94b4009850 tx=0x7f94b4009b60 comp rx=0 tx=0).stop 2023-10-08T06:10:12.131 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.128+0000 7f94bf408700 1 -- 172.21.15.32:0/976098999 shutdown_connections 2023-10-08T06:10:12.131 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.128+0000 7f94bf408700 1 --2- 172.21.15.32:0/976098999 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f94b80cd5a0 0x7f94b80cebb0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:12.132 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.128+0000 7f94bf408700 1 -- 172.21.15.32:0/976098999 >> 172.21.15.32:0/976098999 conn(0x7f94b80cf5d0 msgr2=0x7f94b80cf9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:10:12.132 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.128+0000 7f94bf408700 1 -- 172.21.15.32:0/976098999 shutdown_connections 2023-10-08T06:10:12.132 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.128+0000 7f94bf408700 1 -- 172.21.15.32:0/976098999 wait complete. 2023-10-08T06:10:12.132 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.132+0000 7f94bf408700 1 Processor -- start 2023-10-08T06:10:12.132 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.132+0000 7f94bf408700 1 -- start start 2023-10-08T06:10:12.134 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.132+0000 7f94bf408700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f94b80cd5a0 0x7f94b80b4c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:12.134 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.132+0000 7f94bf408700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f94b8159750 0x7f94b814a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:12.134 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.132+0000 7f94bf408700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f94b8071c00 0x7f94b8072090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:12.134 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.132+0000 7f94bf408700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94b80b51d0 con 0x7f94b8159750 2023-10-08T06:10:12.134 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.132+0000 7f94bf408700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94b80725d0 con 0x7f94b8071c00 2023-10-08T06:10:12.134 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.132+0000 7f94bf408700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94b80b4800 con 0x7f94b80cd5a0 2023-10-08T06:10:12.134 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.132+0000 7f94bdc05700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f94b8159750 0x7f94b814a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:12.134 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.132+0000 7f94bdc05700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f94b8159750 0x7f94b814a7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:46668/0 (socket says 172.21.15.32:46668) 2023-10-08T06:10:12.135 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.132+0000 7f94bdc05700 1 -- 172.21.15.32:0/262924531 learned_addr learned my addr 172.21.15.32:0/262924531 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:10:12.135 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.132+0000 7f94be406700 1 --2- 172.21.15.32:0/262924531 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f94b80cd5a0 0x7f94b80b4c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:12.135 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.132+0000 7f94bec07700 1 --2- 172.21.15.32:0/262924531 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f94b8071c00 0x7f94b8072090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:12.135 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.132+0000 7f94bdc05700 1 -- 172.21.15.32:0/262924531 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f94b80cd5a0 msgr2=0x7f94b80b4c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:12.135 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.132+0000 7f94bdc05700 1 --2- 172.21.15.32:0/262924531 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f94b80cd5a0 0x7f94b80b4c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:12.135 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.132+0000 7f94bdc05700 1 -- 172.21.15.32:0/262924531 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f94b8071c00 msgr2=0x7f94b8072090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:12.135 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.132+0000 7f94bdc05700 1 --2- 172.21.15.32:0/262924531 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f94b8071c00 0x7f94b8072090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:12.135 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.132+0000 7f94bdc05700 1 -- 172.21.15.32:0/262924531 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94b40094b0 con 0x7f94b8159750 2023-10-08T06:10:12.135 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.132+0000 7f94bdc05700 1 --2- 172.21.15.32:0/262924531 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f94b8159750 0x7f94b814a7f0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f94b4009eb0 tx=0x7f94b4004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:12.136 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.132+0000 7f94aeffd700 1 -- 172.21.15.32:0/262924531 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94b4011630 con 0x7f94b8159750 2023-10-08T06:10:12.136 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.132+0000 7f94bf408700 1 -- 172.21.15.32:0/262924531 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94b8156c10 con 0x7f94b8159750 2023-10-08T06:10:12.136 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.132+0000 7f94bf408700 1 -- 172.21.15.32:0/262924531 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94b815a9f0 con 0x7f94b8159750 2023-10-08T06:10:12.136 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.132+0000 7f94aeffd700 1 -- 172.21.15.32:0/262924531 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94b401f070 con 0x7f94b8159750 2023-10-08T06:10:12.136 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.132+0000 7f94aeffd700 1 -- 172.21.15.32:0/262924531 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94b40119d0 con 0x7f94b8159750 2023-10-08T06:10:12.136 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.136+0000 7f94bf408700 1 -- 172.21.15.32:0/262924531 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94b80b4990 con 0x7f94b8159750 2023-10-08T06:10:12.137 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.136+0000 7f94aeffd700 1 -- 172.21.15.32:0/262924531 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f94b4011b30 con 0x7f94b8159750 2023-10-08T06:10:12.137 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.136+0000 7f94aeffd700 1 --2- 172.21.15.32:0/262924531 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f949c066510 0x7f949c0689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:12.138 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.136+0000 7f94aeffd700 1 -- 172.21.15.32:0/262924531 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f94b4021070 con 0x7f94b8159750 2023-10-08T06:10:12.138 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.136+0000 7f94be406700 1 --2- 172.21.15.32:0/262924531 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f949c066510 0x7f949c0689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:12.138 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.136+0000 7f94be406700 1 --2- 172.21.15.32:0/262924531 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f949c066510 0x7f949c0689d0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f94a8001800 tx=0x7f94a8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:12.149 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.148+0000 7f94aeffd700 1 -- 172.21.15.32:0/262924531 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f94b4052b70 con 0x7f94b8159750 2023-10-08T06:10:12.317 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.316+0000 7f94bf408700 1 -- 172.21.15.32:0/262924531 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f94b8073f00 con 0x7f94b8159750 2023-10-08T06:10:12.319 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.316+0000 7f94aeffd700 1 -- 172.21.15.32:0/262924531 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16445 (secure 0 0 0) 0x7f94b4056190 con 0x7f94b8159750 2023-10-08T06:10:12.320 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:10:12.320 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":22,"fsid":"ac672d87-96ae-41e0-9314-623ba2cdbbba","created":"2023-10-08T06:09:11.175626+0000","modified":"2023-10-08T06:09:38.153256+0000","last_up_change":"2023-10-08T06:09:22.744643+0000","last_in_change":"2023-10-08T06:09:14.131580+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T06:09:23.307843+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T06:09:34.295012+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T06:09:35.515590+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"43433f0c-9592-4874-92d7-10f8f4acf07f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":587888964},{"type":"v1","addr":"172.21.15.32:6801","nonce":587888964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":587888964},{"type":"v1","addr":"172.21.15.32:6803","nonce":587888964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":587888964},{"type":"v1","addr":"172.21.15.32:6810","nonce":587888964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6805","nonce":587888964},{"type":"v1","addr":"172.21.15.32:6807","nonce":587888964}]},"public_addr":"172.21.15.32:6801/587888964","cluster_addr":"172.21.15.32:6803/587888964","heartbeat_back_addr":"172.21.15.32:6810/587888964","heartbeat_front_addr":"172.21.15.32:6807/587888964","state":["exists","up"]},{"osd":1,"uuid":"2ecb1008-b987-4ce7-b646-6cded55fc8d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":990576767},{"type":"v1","addr":"172.21.15.32:6817","nonce":990576767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":990576767},{"type":"v1","addr":"172.21.15.32:6819","nonce":990576767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":990576767},{"type":"v1","addr":"172.21.15.32:6823","nonce":990576767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":990576767},{"type":"v1","addr":"172.21.15.32:6821","nonce":990576767}]},"public_addr":"172.21.15.32:6817/990576767","cluster_addr":"172.21.15.32:6819/990576767","heartbeat_back_addr":"172.21.15.32:6823/990576767","heartbeat_front_addr":"172.21.15.32:6821/990576767","state":["exists","up"]},{"osd":2,"uuid":"1b131c94-c09b-4e80-8746-bf1b7bac362d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6824","nonce":1566874440},{"type":"v1","addr":"172.21.15.32:6825","nonce":1566874440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":1566874440},{"type":"v1","addr":"172.21.15.32:6827","nonce":1566874440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":1566874440},{"type":"v1","addr":"172.21.15.32:6831","nonce":1566874440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":1566874440},{"type":"v1","addr":"172.21.15.32:6829","nonce":1566874440}]},"public_addr":"172.21.15.32:6825/1566874440","cluster_addr":"172.21.15.32:6827/1566874440","heartbeat_back_addr":"172.21.15.32:6831/1566874440","heartbeat_front_addr":"172.21.15.32:6829/1566874440","state":["exists","up"]},{"osd":3,"uuid":"ad655af2-1f6f-4689-b21d-b07bbaeb68b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":3672614802},{"type":"v1","addr":"172.21.15.32:6806","nonce":3672614802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6809","nonce":3672614802},{"type":"v1","addr":"172.21.15.32:6811","nonce":3672614802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":3672614802},{"type":"v1","addr":"172.21.15.32:6815","nonce":3672614802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":3672614802},{"type":"v1","addr":"172.21.15.32:6813","nonce":3672614802}]},"public_addr":"172.21.15.32:6806/3672614802","cluster_addr":"172.21.15.32:6811/3672614802","heartbeat_back_addr":"172.21.15.32:6815/3672614802","heartbeat_front_addr":"172.21.15.32:6813/3672614802","state":["exists","up"]},{"osd":4,"uuid":"64a543a1-8c4f-458e-9aba-b35c1cd7dd03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":3369928244},{"type":"v1","addr":"172.21.15.40:6801","nonce":3369928244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":3369928244},{"type":"v1","addr":"172.21.15.40:6803","nonce":3369928244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":3369928244},{"type":"v1","addr":"172.21.15.40:6807","nonce":3369928244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":3369928244},{"type":"v1","addr":"172.21.15.40:6805","nonce":3369928244}]},"public_addr":"172.21.15.40:6801/3369928244","cluster_addr":"172.21.15.40:6803/3369928244","heartbeat_back_addr":"172.21.15.40:6807/3369928244","heartbeat_front_addr":"172.21.15.40:6805/3369928244","state":["exists","up"]},{"osd":5,"uuid":"0fef3e54-edb4-4678-878e-944663c51638","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":2395850297},{"type":"v1","addr":"172.21.15.40:6825","nonce":2395850297}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":2395850297},{"type":"v1","addr":"172.21.15.40:6827","nonce":2395850297}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":2395850297},{"type":"v1","addr":"172.21.15.40:6831","nonce":2395850297}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":2395850297},{"type":"v1","addr":"172.21.15.40:6829","nonce":2395850297}]},"public_addr":"172.21.15.40:6825/2395850297","cluster_addr":"172.21.15.40:6827/2395850297","heartbeat_back_addr":"172.21.15.40:6831/2395850297","heartbeat_front_addr":"172.21.15.40:6829/2395850297","state":["exists","up"]},{"osd":6,"uuid":"2eeb0472-6096-469d-9b2c-cab4bf41c31a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":4145283410},{"type":"v1","addr":"172.21.15.40:6809","nonce":4145283410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":4145283410},{"type":"v1","addr":"172.21.15.40:6811","nonce":4145283410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":4145283410},{"type":"v1","addr":"172.21.15.40:6815","nonce":4145283410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":4145283410},{"type":"v1","addr":"172.21.15.40:6813","nonce":4145283410}]},"public_addr":"172.21.15.40:6809/4145283410","cluster_addr":"172.21.15.40:6811/4145283410","heartbeat_back_addr":"172.21.15.40:6815/4145283410","heartbeat_front_addr":"172.21.15.40:6813/4145283410","state":["exists","up"]},{"osd":7,"uuid":"cf76e4c7-96a6-401f-a280-91aad4641940","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":2943297416},{"type":"v1","addr":"172.21.15.40:6817","nonce":2943297416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":2943297416},{"type":"v1","addr":"172.21.15.40:6819","nonce":2943297416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":2943297416},{"type":"v1","addr":"172.21.15.40:6823","nonce":2943297416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":2943297416},{"type":"v1","addr":"172.21.15.40:6821","nonce":2943297416}]},"public_addr":"172.21.15.40:6817/2943297416","cluster_addr":"172.21.15.40:6819/2943297416","heartbeat_back_addr":"172.21.15.40:6823/2943297416","heartbeat_front_addr":"172.21.15.40:6821/2943297416","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.411475+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.628841+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.599055+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.166100+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.384135+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.488403+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.307648+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.363541+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T06:10:12.322 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.320+0000 7f94bf408700 1 -- 172.21.15.32:0/262924531 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f949c066510 msgr2=0x7f949c0689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:12.322 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.320+0000 7f94bf408700 1 --2- 172.21.15.32:0/262924531 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f949c066510 0x7f949c0689d0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f94a8001800 tx=0x7f94a8009040 comp rx=0 tx=0).stop 2023-10-08T06:10:12.322 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.320+0000 7f94bf408700 1 -- 172.21.15.32:0/262924531 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f94b8159750 msgr2=0x7f94b814a7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:12.322 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.320+0000 7f94bf408700 1 --2- 172.21.15.32:0/262924531 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f94b8159750 0x7f94b814a7f0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f94b4009eb0 tx=0x7f94b4004770 comp rx=0 tx=0).stop 2023-10-08T06:10:12.322 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.320+0000 7f94bf408700 1 -- 172.21.15.32:0/262924531 shutdown_connections 2023-10-08T06:10:12.322 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.320+0000 7f94bf408700 1 --2- 172.21.15.32:0/262924531 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f949c066510 0x7f949c0689d0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:12.322 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.320+0000 7f94bf408700 1 --2- 172.21.15.32:0/262924531 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f94b8159750 0x7f94b814a7f0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:12.323 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.320+0000 7f94bf408700 1 --2- 172.21.15.32:0/262924531 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f94b8071c00 0x7f94b8072090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:12.323 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.320+0000 7f94bf408700 1 --2- 172.21.15.32:0/262924531 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f94b80cd5a0 0x7f94b80b4c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:12.323 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.320+0000 7f94bf408700 1 -- 172.21.15.32:0/262924531 >> 172.21.15.32:0/262924531 conn(0x7f94b80cf5d0 msgr2=0x7f94b8073270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:10:12.323 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.320+0000 7f94bf408700 1 -- 172.21.15.32:0/262924531 shutdown_connections 2023-10-08T06:10:12.323 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.320+0000 7f94bf408700 1 -- 172.21.15.32:0/262924531 wait complete. 2023-10-08T06:10:12.335 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T06:09:23.307843+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-08T06:09:34.295012+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-08T06:09:35.515590+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-08T06:10:12.335 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T06:10:12.453 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.452+0000 7f712ebea700 1 Processor -- start 2023-10-08T06:10:12.453 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.452+0000 7f712ebea700 1 -- start start 2023-10-08T06:10:12.455 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.452+0000 7f712ebea700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7128160ab0 0x7f71280cd7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:12.455 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.452+0000 7f712ebea700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f71280d2aa0 0x7f71280cdd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:12.455 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.452+0000 7f712ebea700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71280ce440 con 0x7f71280d2600 2023-10-08T06:10:12.455 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.452+0000 7f712ebea700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71280ce260 con 0x7f71280d2aa0 2023-10-08T06:10:12.455 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.452+0000 7f712ebea700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7128160e90 con 0x7f7128160ab0 2023-10-08T06:10:12.455 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.452+0000 7f712d3e7700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f71280d2aa0 0x7f71280cdd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:12.456 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.452+0000 7f712e3e9700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f71280d2600 0x7f71280cf790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.32:48542/0 (socket says 172.21.15.32:48542) 2023-10-08T06:10:12.456 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.452+0000 7f712e3e9700 1 -- 172.21.15.32:0/1196248603 learned_addr learned my addr 172.21.15.32:0/1196248603 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-08T06:10:12.456 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.452+0000 7f712dbe8700 1 --2- 172.21.15.32:0/1196248603 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7128160ab0 0x7f71280cd7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:12.457 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.456+0000 7f712dbe8700 1 -- 172.21.15.32:0/1196248603 >> v2:172.21.15.40:3300/0 conn(0x7f71280d2aa0 msgr2=0x7f71280cdd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:10:12.457 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.456+0000 7f712dbe8700 1 --2- 172.21.15.32:0/1196248603 >> v2:172.21.15.40:3300/0 conn(0x7f71280d2aa0 0x7f71280cdd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:12.457 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.456+0000 7f712dbe8700 1 -- 172.21.15.32:0/1196248603 >> v1:172.21.15.40:6789/0 conn(0x7f71280d2600 legacy=0x7f71280cf790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:12.457 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.456+0000 7f712dbe8700 1 -- 172.21.15.32:0/1196248603 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71280d1690 con 0x7f7128160ab0 2023-10-08T06:10:12.457 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.456+0000 7f712cbe6700 1 -- 172.21.15.32:0/1196248603 <== mon.1 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 51780989 0 0) 0x7f71280ce440 con 0x7f71280d2600 2023-10-08T06:10:12.457 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.456+0000 7f712d3e7700 1 --2- 172.21.15.32:0/1196248603 >> v2:172.21.15.40:3300/0 conn(0x7f71280d2aa0 0x7f71280cdd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T06:10:12.458 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.456+0000 7f712dbe8700 1 --2- 172.21.15.32:0/1196248603 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7128160ab0 0x7f71280cd7e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f7120009850 tx=0x7f7120009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=12e77b75eb176727 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:12.458 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.456+0000 7f712cbe6700 1 -- 172.21.15.32:0/1196248603 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7120011830 con 0x7f7128160ab0 2023-10-08T06:10:12.458 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.456+0000 7f712cbe6700 1 -- 172.21.15.32:0/1196248603 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7120011990 con 0x7f7128160ab0 2023-10-08T06:10:12.458 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.456+0000 7f712cbe6700 1 -- 172.21.15.32:0/1196248603 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7120011d40 con 0x7f7128160ab0 2023-10-08T06:10:12.459 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.456+0000 7f712ebea700 1 -- 172.21.15.32:0/1196248603 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7128160ab0 msgr2=0x7f71280cd7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:12.459 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.456+0000 7f712ebea700 1 --2- 172.21.15.32:0/1196248603 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7128160ab0 0x7f71280cd7e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f7120009850 tx=0x7f7120009b60 comp rx=0 tx=0).stop 2023-10-08T06:10:12.459 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.456+0000 7f712ebea700 1 -- 172.21.15.32:0/1196248603 shutdown_connections 2023-10-08T06:10:12.459 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.456+0000 7f712ebea700 1 --2- 172.21.15.32:0/1196248603 >> v2:172.21.15.40:3300/0 conn(0x7f71280d2aa0 0x7f71280cdd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:12.459 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.456+0000 7f712ebea700 1 --2- 172.21.15.32:0/1196248603 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7128160ab0 0x7f71280cd7e0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:12.459 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.456+0000 7f712ebea700 1 -- 172.21.15.32:0/1196248603 >> 172.21.15.32:0/1196248603 conn(0x7f712806aaf0 msgr2=0x7f712806af00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:10:12.459 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.456+0000 7f712ebea700 1 -- 172.21.15.32:0/1196248603 shutdown_connections 2023-10-08T06:10:12.459 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.456+0000 7f712ebea700 1 -- 172.21.15.32:0/1196248603 wait complete. 2023-10-08T06:10:12.460 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.460+0000 7f712ebea700 1 Processor -- start 2023-10-08T06:10:12.460 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.460+0000 7f712ebea700 1 -- start start 2023-10-08T06:10:12.463 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.460+0000 7f712ebea700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f71280d2600 0x7f71281f2500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:12.463 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.460+0000 7f712ebea700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7128160ab0 0x7f71280cc490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:12.463 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.460+0000 7f712ebea700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f71281f60a0 0x7f71280cc9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:12.463 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.460+0000 7f712ebea700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71281f38a0 con 0x7f71280d2600 2023-10-08T06:10:12.463 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.460+0000 7f712ebea700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71281f2a40 con 0x7f71281f60a0 2023-10-08T06:10:12.463 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.460+0000 7f712ebea700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71281f2c90 con 0x7f7128160ab0 2023-10-08T06:10:12.463 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.460+0000 7f712dbe8700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f71280d2600 0x7f71281f2500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:12.463 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.460+0000 7f712dbe8700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f71280d2600 0x7f71281f2500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:46682/0 (socket says 172.21.15.32:46682) 2023-10-08T06:10:12.463 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.460+0000 7f712dbe8700 1 -- 172.21.15.32:0/2380456276 learned_addr learned my addr 172.21.15.32:0/2380456276 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:10:12.464 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.460+0000 7f712d3e7700 1 --2- 172.21.15.32:0/2380456276 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7128160ab0 0x7f71280cc490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:12.464 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.460+0000 7f712e3e9700 1 --2- 172.21.15.32:0/2380456276 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f71281f60a0 0x7f71280cc9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:12.465 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.460+0000 7f712dbe8700 1 -- 172.21.15.32:0/2380456276 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7128160ab0 msgr2=0x7f71280cc490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:12.465 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.460+0000 7f712dbe8700 1 --2- 172.21.15.32:0/2380456276 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7128160ab0 0x7f71280cc490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:12.465 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.460+0000 7f712dbe8700 1 -- 172.21.15.32:0/2380456276 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f71281f60a0 msgr2=0x7f71280cc9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:12.465 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.460+0000 7f712dbe8700 1 --2- 172.21.15.32:0/2380456276 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f71281f60a0 0x7f71280cc9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:12.465 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.464+0000 7f712dbe8700 1 -- 172.21.15.32:0/2380456276 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f711c0094b0 con 0x7f71280d2600 2023-10-08T06:10:12.465 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.464+0000 7f712dbe8700 1 --2- 172.21.15.32:0/2380456276 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f71280d2600 0x7f71281f2500 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f7120009ba0 tx=0x7f7120004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:12.465 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.464+0000 7f71267fc700 1 -- 172.21.15.32:0/2380456276 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7120004550 con 0x7f71280d2600 2023-10-08T06:10:12.465 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.464+0000 7f71267fc700 1 -- 172.21.15.32:0/2380456276 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f712001e070 con 0x7f71280d2600 2023-10-08T06:10:12.465 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.464+0000 7f712ebea700 1 -- 172.21.15.32:0/2380456276 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71200094b0 con 0x7f71280d2600 2023-10-08T06:10:12.466 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.464+0000 7f71267fc700 1 -- 172.21.15.32:0/2380456276 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7120003900 con 0x7f71280d2600 2023-10-08T06:10:12.466 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.464+0000 7f712ebea700 1 -- 172.21.15.32:0/2380456276 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71281f3250 con 0x7f71280d2600 2023-10-08T06:10:12.468 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.468+0000 7f712ebea700 1 -- 172.21.15.32:0/2380456276 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f712804eea0 con 0x7f71280d2600 2023-10-08T06:10:12.468 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.468+0000 7f71267fc700 1 -- 172.21.15.32:0/2380456276 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f7120003a60 con 0x7f71280d2600 2023-10-08T06:10:12.468 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.468+0000 7f71267fc700 1 --2- 172.21.15.32:0/2380456276 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f7114066510 0x7f71140689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:12.469 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.468+0000 7f712d3e7700 1 --2- 172.21.15.32:0/2380456276 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f7114066510 0x7f71140689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:12.469 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.468+0000 7f71267fc700 1 -- 172.21.15.32:0/2380456276 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7120084c30 con 0x7f71280d2600 2023-10-08T06:10:12.470 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.468+0000 7f712d3e7700 1 --2- 172.21.15.32:0/2380456276 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f7114066510 0x7f71140689d0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f711c009d80 tx=0x7f711c009240 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:12.477 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.476+0000 7f71267fc700 1 -- 172.21.15.32:0/2380456276 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f71200520c0 con 0x7f71280d2600 2023-10-08T06:10:12.640 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.640+0000 7f712ebea700 1 -- 172.21.15.32:0/2380456276 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f712815f940 con 0x7f71280d2600 2023-10-08T06:10:12.640 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.640+0000 7f71267fc700 1 -- 172.21.15.32:0/2380456276 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7f71200556e0 con 0x7f71280d2600 2023-10-08T06:10:12.640 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 1 2023-10-08T06:10:12.643 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.640+0000 7f712ebea700 1 -- 172.21.15.32:0/2380456276 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f7114066510 msgr2=0x7f71140689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:12.643 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.640+0000 7f712ebea700 1 --2- 172.21.15.32:0/2380456276 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f7114066510 0x7f71140689d0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f711c009d80 tx=0x7f711c009240 comp rx=0 tx=0).stop 2023-10-08T06:10:12.643 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.640+0000 7f712ebea700 1 -- 172.21.15.32:0/2380456276 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f71280d2600 msgr2=0x7f71281f2500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:12.643 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.640+0000 7f712ebea700 1 --2- 172.21.15.32:0/2380456276 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f71280d2600 0x7f71281f2500 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f7120009ba0 tx=0x7f7120004770 comp rx=0 tx=0).stop 2023-10-08T06:10:12.644 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.640+0000 7f712ebea700 1 -- 172.21.15.32:0/2380456276 shutdown_connections 2023-10-08T06:10:12.644 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.640+0000 7f712ebea700 1 --2- 172.21.15.32:0/2380456276 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f7114066510 0x7f71140689d0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:12.644 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.640+0000 7f712ebea700 1 --2- 172.21.15.32:0/2380456276 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f71281f60a0 0x7f71280cc9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:12.644 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.640+0000 7f712ebea700 1 --2- 172.21.15.32:0/2380456276 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7128160ab0 0x7f71280cc490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:12.644 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.640+0000 7f712ebea700 1 --2- 172.21.15.32:0/2380456276 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f71280d2600 0x7f71281f2500 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:12.644 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.640+0000 7f712ebea700 1 -- 172.21.15.32:0/2380456276 >> 172.21.15.32:0/2380456276 conn(0x7f712806aaf0 msgr2=0x7f71280b83c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:10:12.644 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.640+0000 7f712ebea700 1 -- 172.21.15.32:0/2380456276 shutdown_connections 2023-10-08T06:10:12.644 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.640+0000 7f712ebea700 1 -- 172.21.15.32:0/2380456276 wait complete. 2023-10-08T06:10:12.655 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-08T06:10:12.776 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.776+0000 7f3f17179700 1 Processor -- start 2023-10-08T06:10:12.776 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.776+0000 7f3f17179700 1 -- start start 2023-10-08T06:10:12.778 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.776+0000 7f3f17179700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3f08050900 0x7f3f080dfd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:12.779 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.776+0000 7f3f17179700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3f08050060 0x7f3f080336f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:12.779 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.776+0000 7f3f17179700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f080e0730 con 0x7f3f080e0290 2023-10-08T06:10:12.779 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.776+0000 7f3f17179700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f080d6ca0 con 0x7f3f08050060 2023-10-08T06:10:12.779 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.776+0000 7f3f17179700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f080e0cf0 con 0x7f3f08050900 2023-10-08T06:10:12.779 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.776+0000 7f3f15976700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f3f080e0290 0x7f3f08006840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:45836/0 (socket says 172.21.15.32:45836) 2023-10-08T06:10:12.779 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.776+0000 7f3f15976700 1 -- 172.21.15.32:0/4230282098 learned_addr learned my addr 172.21.15.32:0/4230282098 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-08T06:10:12.780 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.776+0000 7f3f16978700 1 --2- 172.21.15.32:0/4230282098 >> v2:172.21.15.40:3300/0 conn(0x7f3f08050060 0x7f3f080336f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:12.780 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.776+0000 7f3f16177700 1 --2- 172.21.15.32:0/4230282098 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3f08050900 0x7f3f080dfd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:12.780 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.776+0000 7f3f15175700 1 -- 172.21.15.32:0/4230282098 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 969698429 0 0) 0x7f3f080e0730 con 0x7f3f080e0290 2023-10-08T06:10:12.780 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.776+0000 7f3f15175700 1 -- 172.21.15.32:0/4230282098 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3efc0035d0 con 0x7f3f080e0290 2023-10-08T06:10:12.780 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.776+0000 7f3f16978700 1 -- 172.21.15.32:0/4230282098 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3f08050900 msgr2=0x7f3f080dfd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:10:12.780 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.776+0000 7f3f16978700 1 --2- 172.21.15.32:0/4230282098 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3f08050900 0x7f3f080dfd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:12.780 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.776+0000 7f3f16978700 1 -- 172.21.15.32:0/4230282098 >> v1:172.21.15.32:6789/0 conn(0x7f3f080e0290 legacy=0x7f3f08006840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:12.780 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.776+0000 7f3f16978700 1 -- 172.21.15.32:0/4230282098 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f080e0a10 con 0x7f3f08050060 2023-10-08T06:10:12.780 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.776+0000 7f3f15175700 1 -- 172.21.15.32:0/4230282098 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 549686978 0 0) 0x7f3efc0035d0 con 0x7f3f080e0290 2023-10-08T06:10:12.782 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.776+0000 7f3f16978700 1 --2- 172.21.15.32:0/4230282098 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3f08050060 0x7f3f080336f0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f3f1004e920 tx=0x7f3f10074710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f3adf3f3f4222c9f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:12.782 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.776+0000 7f3f15175700 1 -- 172.21.15.32:0/4230282098 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f1004ef60 con 0x7f3f08050060 2023-10-08T06:10:12.782 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.776+0000 7f3f15175700 1 -- 172.21.15.32:0/4230282098 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f1008e070 con 0x7f3f08050060 2023-10-08T06:10:12.782 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.776+0000 7f3f15175700 1 -- 172.21.15.32:0/4230282098 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f100684d0 con 0x7f3f08050060 2023-10-08T06:10:12.782 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.780+0000 7f3f17179700 1 -- 172.21.15.32:0/4230282098 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3f08050060 msgr2=0x7f3f080336f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:12.782 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.780+0000 7f3f17179700 1 --2- 172.21.15.32:0/4230282098 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3f08050060 0x7f3f080336f0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f3f1004e920 tx=0x7f3f10074710 comp rx=0 tx=0).stop 2023-10-08T06:10:12.782 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.780+0000 7f3f17179700 1 -- 172.21.15.32:0/4230282098 shutdown_connections 2023-10-08T06:10:12.782 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.780+0000 7f3f17179700 1 --2- 172.21.15.32:0/4230282098 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3f08050060 0x7f3f080336f0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:12.782 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.780+0000 7f3f17179700 1 --2- 172.21.15.32:0/4230282098 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3f08050900 0x7f3f080dfd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:12.782 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.780+0000 7f3f17179700 1 -- 172.21.15.32:0/4230282098 >> 172.21.15.32:0/4230282098 conn(0x7f3f08054ca0 msgr2=0x7f3f080550b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:10:12.783 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.780+0000 7f3f17179700 1 -- 172.21.15.32:0/4230282098 shutdown_connections 2023-10-08T06:10:12.783 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.780+0000 7f3f17179700 1 -- 172.21.15.32:0/4230282098 wait complete. 2023-10-08T06:10:12.783 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.780+0000 7f3f17179700 1 Processor -- start 2023-10-08T06:10:12.783 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.780+0000 7f3f17179700 1 -- start start 2023-10-08T06:10:12.785 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.784+0000 7f3f17179700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3f08050060 0x7f3f080d3e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:12.785 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.784+0000 7f3f17179700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3f08050900 0x7f3f0804ad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:12.785 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.784+0000 7f3f17179700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3f080e0290 0x7f3f080d92e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:12.785 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.784+0000 7f3f17179700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f08034ac0 con 0x7f3f08050060 2023-10-08T06:10:12.786 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.784+0000 7f3f17179700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f08034da0 con 0x7f3f080e0290 2023-10-08T06:10:12.786 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.784+0000 7f3f17179700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f08035080 con 0x7f3f08050900 2023-10-08T06:10:12.786 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.784+0000 7f3f16177700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3f08050060 0x7f3f080d3e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:12.786 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.784+0000 7f3f16177700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3f08050060 0x7f3f080d3e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:46696/0 (socket says 172.21.15.32:46696) 2023-10-08T06:10:12.786 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.784+0000 7f3f16177700 1 -- 172.21.15.32:0/2794072277 learned_addr learned my addr 172.21.15.32:0/2794072277 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:10:12.786 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.784+0000 7f3f15976700 1 --2- 172.21.15.32:0/2794072277 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3f08050900 0x7f3f0804ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:12.786 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.784+0000 7f3f16978700 1 --2- 172.21.15.32:0/2794072277 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3f080e0290 0x7f3f080d92e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:12.786 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.784+0000 7f3f16177700 1 -- 172.21.15.32:0/2794072277 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3f08050900 msgr2=0x7f3f0804ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:12.786 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.784+0000 7f3f16177700 1 --2- 172.21.15.32:0/2794072277 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3f08050900 0x7f3f0804ad20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:12.786 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.784+0000 7f3f16177700 1 -- 172.21.15.32:0/2794072277 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3f080e0290 msgr2=0x7f3f080d92e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:12.786 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.784+0000 7f3f16177700 1 --2- 172.21.15.32:0/2794072277 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3f080e0290 0x7f3f080d92e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:12.787 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.784+0000 7f3f16177700 1 -- 172.21.15.32:0/2794072277 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f10066ea0 con 0x7f3f08050060 2023-10-08T06:10:12.787 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.784+0000 7f3f15976700 1 --2- 172.21.15.32:0/2794072277 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3f08050900 0x7f3f0804ad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T06:10:12.787 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.784+0000 7f3f16177700 1 --2- 172.21.15.32:0/2794072277 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3f08050060 0x7f3f080d3e00 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f3f0c00e9d0 tx=0x7f3f0c00ed90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:12.787 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.784+0000 7f3f06ffd700 1 -- 172.21.15.32:0/2794072277 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f0c009720 con 0x7f3f08050060 2023-10-08T06:10:12.787 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.784+0000 7f3f06ffd700 1 -- 172.21.15.32:0/2794072277 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f0c00c850 con 0x7f3f08050060 2023-10-08T06:10:12.787 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.784+0000 7f3f17179700 1 -- 172.21.15.32:0/2794072277 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f08035360 con 0x7f3f08050060 2023-10-08T06:10:12.787 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.784+0000 7f3f06ffd700 1 -- 172.21.15.32:0/2794072277 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f0c00cbc0 con 0x7f3f08050060 2023-10-08T06:10:12.787 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.784+0000 7f3f17179700 1 -- 172.21.15.32:0/2794072277 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f0804b260 con 0x7f3f08050060 2023-10-08T06:10:12.788 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.784+0000 7f3f17179700 1 -- 172.21.15.32:0/2794072277 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f08176520 con 0x7f3f08050060 2023-10-08T06:10:12.788 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.788+0000 7f3f06ffd700 1 -- 172.21.15.32:0/2794072277 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f3f0c00cd20 con 0x7f3f08050060 2023-10-08T06:10:12.788 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.788+0000 7f3f06ffd700 1 --2- 172.21.15.32:0/2794072277 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f3ef4066510 0x7f3ef40689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:12.788 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.788+0000 7f3f06ffd700 1 -- 172.21.15.32:0/2794072277 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3f0c084010 con 0x7f3f08050060 2023-10-08T06:10:12.789 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.788+0000 7f3f15976700 1 --2- 172.21.15.32:0/2794072277 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f3ef4066510 0x7f3ef40689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:12.789 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.788+0000 7f3f15976700 1 --2- 172.21.15.32:0/2794072277 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f3ef4066510 0x7f3ef40689d0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f3f00007b30 tx=0x7f3f00009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:12.794 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.792+0000 7f3f06ffd700 1 -- 172.21.15.32:0/2794072277 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f3f0c051490 con 0x7f3f08050060 2023-10-08T06:10:12.960 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.960+0000 7f3f17179700 1 -- 172.21.15.32:0/2794072277 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3f08005470 con 0x7f3f08050060 2023-10-08T06:10:12.961 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.960+0000 7f3f06ffd700 1 -- 172.21.15.32:0/2794072277 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3f0c054ab0 con 0x7f3f08050060 2023-10-08T06:10:12.961 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 32 2023-10-08T06:10:12.963 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.960+0000 7f3f17179700 1 -- 172.21.15.32:0/2794072277 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f3ef4066510 msgr2=0x7f3ef40689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:12.963 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.960+0000 7f3f17179700 1 --2- 172.21.15.32:0/2794072277 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f3ef4066510 0x7f3ef40689d0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f3f00007b30 tx=0x7f3f00009040 comp rx=0 tx=0).stop 2023-10-08T06:10:12.963 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.960+0000 7f3f17179700 1 -- 172.21.15.32:0/2794072277 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3f08050060 msgr2=0x7f3f080d3e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:12.963 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.960+0000 7f3f17179700 1 --2- 172.21.15.32:0/2794072277 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3f08050060 0x7f3f080d3e00 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f3f0c00e9d0 tx=0x7f3f0c00ed90 comp rx=0 tx=0).stop 2023-10-08T06:10:12.963 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.960+0000 7f3f17179700 1 -- 172.21.15.32:0/2794072277 shutdown_connections 2023-10-08T06:10:12.963 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.960+0000 7f3f17179700 1 --2- 172.21.15.32:0/2794072277 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f3ef4066510 0x7f3ef40689d0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:12.963 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.960+0000 7f3f17179700 1 --2- 172.21.15.32:0/2794072277 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3f080e0290 0x7f3f080d92e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:12.964 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.960+0000 7f3f17179700 1 --2- 172.21.15.32:0/2794072277 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3f08050900 0x7f3f0804ad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:12.964 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.960+0000 7f3f17179700 1 --2- 172.21.15.32:0/2794072277 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3f08050060 0x7f3f080d3e00 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:12.964 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.960+0000 7f3f17179700 1 -- 172.21.15.32:0/2794072277 >> 172.21.15.32:0/2794072277 conn(0x7f3f08054ca0 msgr2=0x7f3f080d5fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:10:12.964 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.960+0000 7f3f17179700 1 -- 172.21.15.32:0/2794072277 shutdown_connections 2023-10-08T06:10:12.964 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:12.960+0000 7f3f17179700 1 -- 172.21.15.32:0/2794072277 wait complete. 2023-10-08T06:10:12.976 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-08T06:10:13.093 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.092+0000 7fe796a17700 1 Processor -- start 2023-10-08T06:10:13.094 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.092+0000 7fe796a17700 1 -- start start 2023-10-08T06:10:13.094 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.092+0000 7fe796a17700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe79015d980 0x7fe7900b4d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:13.095 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.092+0000 7fe796a17700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe7900b5270 0x7fe7900d1760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:13.095 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.092+0000 7fe796a17700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7900b6750 con 0x7fe7900d1ca0 2023-10-08T06:10:13.095 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.092+0000 7fe796a17700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7900d2a30 con 0x7fe7900b5270 2023-10-08T06:10:13.095 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.092+0000 7fe796a17700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7900b6980 con 0x7fe79015d980 2023-10-08T06:10:13.096 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.092+0000 7fe78f7fe700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe7900b5270 0x7fe7900d1760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:13.096 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.092+0000 7fe78ffff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe79015d980 0x7fe7900b4d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:13.096 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.092+0000 7fe78f7fe700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe7900b5270 0x7fe7900d1760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.32:43580/0 (socket says 172.21.15.32:43580) 2023-10-08T06:10:13.096 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.092+0000 7fe78f7fe700 1 -- 172.21.15.32:0/3273168303 learned_addr learned my addr 172.21.15.32:0/3273168303 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:10:13.096 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.096+0000 7fe78f7fe700 1 -- 172.21.15.32:0/3273168303 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe79015d980 msgr2=0x7fe7900b4d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:10:13.096 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.096+0000 7fe78f7fe700 1 --2- 172.21.15.32:0/3273168303 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe79015d980 0x7fe7900b4d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:13.096 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.096+0000 7fe78f7fe700 1 -- 172.21.15.32:0/3273168303 >> v1:172.21.15.40:6789/0 conn(0x7fe7900d1ca0 legacy=0x7fe79006ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:13.096 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.096+0000 7fe78f7fe700 1 -- 172.21.15.32:0/3273168303 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7900b56d0 con 0x7fe7900b5270 2023-10-08T06:10:13.098 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.096+0000 7fe78f7fe700 1 --2- 172.21.15.32:0/3273168303 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe7900b5270 0x7fe7900d1760 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fe780009910 tx=0x7fe780009c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=98485eb88d663294 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:13.098 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.096+0000 7fe78effd700 1 -- 172.21.15.32:0/3273168303 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe780011830 con 0x7fe7900b5270 2023-10-08T06:10:13.098 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.096+0000 7fe78effd700 1 -- 172.21.15.32:0/3273168303 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe780011990 con 0x7fe7900b5270 2023-10-08T06:10:13.098 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.096+0000 7fe78effd700 1 -- 172.21.15.32:0/3273168303 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe780011d40 con 0x7fe7900b5270 2023-10-08T06:10:13.098 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.096+0000 7fe796a17700 1 -- 172.21.15.32:0/3273168303 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe7900b5270 msgr2=0x7fe7900d1760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:13.098 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.096+0000 7fe796a17700 1 --2- 172.21.15.32:0/3273168303 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe7900b5270 0x7fe7900d1760 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fe780009910 tx=0x7fe780009c20 comp rx=0 tx=0).stop 2023-10-08T06:10:13.098 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.096+0000 7fe796a17700 1 -- 172.21.15.32:0/3273168303 shutdown_connections 2023-10-08T06:10:13.098 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.096+0000 7fe796a17700 1 --2- 172.21.15.32:0/3273168303 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe7900b5270 0x7fe7900d1760 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:13.098 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.096+0000 7fe796a17700 1 --2- 172.21.15.32:0/3273168303 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe79015d980 0x7fe7900b4d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:13.099 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.096+0000 7fe796a17700 1 -- 172.21.15.32:0/3273168303 >> 172.21.15.32:0/3273168303 conn(0x7fe7900cfd30 msgr2=0x7fe7900d0110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:10:13.099 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.096+0000 7fe796a17700 1 -- 172.21.15.32:0/3273168303 shutdown_connections 2023-10-08T06:10:13.099 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.096+0000 7fe796a17700 1 -- 172.21.15.32:0/3273168303 wait complete. 2023-10-08T06:10:13.099 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.096+0000 7fe796a17700 1 Processor -- start 2023-10-08T06:10:13.100 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.096+0000 7fe796a17700 1 -- start start 2023-10-08T06:10:13.101 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.100+0000 7fe796a17700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe7900b5270 0x7fe790155070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:13.101 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.100+0000 7fe796a17700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe7900d1ca0 0x7fe7900cbde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:13.101 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.100+0000 7fe796a17700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe79015dde0 0x7fe7900b3850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:13.101 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.100+0000 7fe796a17700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7900ccc90 con 0x7fe7900d1ca0 2023-10-08T06:10:13.101 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.100+0000 7fe796a17700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe790152ed0 con 0x7fe79015dde0 2023-10-08T06:10:13.101 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.100+0000 7fe796a17700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7900cc320 con 0x7fe7900b5270 2023-10-08T06:10:13.102 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.100+0000 7fe78f7fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe7900d1ca0 0x7fe7900cbde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:13.102 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.100+0000 7fe78f7fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe7900d1ca0 0x7fe7900cbde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:46702/0 (socket says 172.21.15.32:46702) 2023-10-08T06:10:13.102 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.100+0000 7fe78f7fe700 1 -- 172.21.15.32:0/1831385469 learned_addr learned my addr 172.21.15.32:0/1831385469 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:10:13.102 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.100+0000 7fe794fb4700 1 --2- 172.21.15.32:0/1831385469 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe79015dde0 0x7fe7900b3850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:13.102 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.100+0000 7fe78ffff700 1 --2- 172.21.15.32:0/1831385469 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe7900b5270 0x7fe790155070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:13.103 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.100+0000 7fe78f7fe700 1 -- 172.21.15.32:0/1831385469 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe7900b5270 msgr2=0x7fe790155070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:13.103 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.100+0000 7fe78f7fe700 1 --2- 172.21.15.32:0/1831385469 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe7900b5270 0x7fe790155070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:13.104 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.100+0000 7fe78f7fe700 1 -- 172.21.15.32:0/1831385469 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe79015dde0 msgr2=0x7fe7900b3850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:13.104 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.100+0000 7fe78f7fe700 1 --2- 172.21.15.32:0/1831385469 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe79015dde0 0x7fe7900b3850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:13.104 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.100+0000 7fe78f7fe700 1 -- 172.21.15.32:0/1831385469 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe780009570 con 0x7fe7900d1ca0 2023-10-08T06:10:13.104 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.100+0000 7fe78f7fe700 1 --2- 172.21.15.32:0/1831385469 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe7900d1ca0 0x7fe7900cbde0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fe7900b59c0 tx=0x7fe780004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:13.104 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.100+0000 7fe78cff9700 1 -- 172.21.15.32:0/1831385469 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe780004510 con 0x7fe7900d1ca0 2023-10-08T06:10:13.104 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.100+0000 7fe78cff9700 1 -- 172.21.15.32:0/1831385469 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe78001e070 con 0x7fe7900d1ca0 2023-10-08T06:10:13.104 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.100+0000 7fe796a17700 1 -- 172.21.15.32:0/1831385469 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe79015ee60 con 0x7fe7900d1ca0 2023-10-08T06:10:13.104 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.100+0000 7fe78cff9700 1 -- 172.21.15.32:0/1831385469 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe780003900 con 0x7fe7900d1ca0 2023-10-08T06:10:13.104 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.100+0000 7fe796a17700 1 -- 172.21.15.32:0/1831385469 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe79015e5c0 con 0x7fe7900d1ca0 2023-10-08T06:10:13.105 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.100+0000 7fe796a17700 1 -- 172.21.15.32:0/1831385469 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe790153060 con 0x7fe7900d1ca0 2023-10-08T06:10:13.105 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.104+0000 7fe78cff9700 1 -- 172.21.15.32:0/1831385469 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fe780003a60 con 0x7fe7900d1ca0 2023-10-08T06:10:13.106 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.104+0000 7fe78cff9700 1 --2- 172.21.15.32:0/1831385469 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fe77c066540 0x7fe77c068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:13.106 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.104+0000 7fe78cff9700 1 -- 172.21.15.32:0/1831385469 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe780084e10 con 0x7fe7900d1ca0 2023-10-08T06:10:13.106 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.104+0000 7fe78ffff700 1 --2- 172.21.15.32:0/1831385469 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fe77c066540 0x7fe77c068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:13.106 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.104+0000 7fe78ffff700 1 --2- 172.21.15.32:0/1831385469 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fe77c066540 0x7fe77c068a00 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fe784009bf0 tx=0x7fe784009240 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:13.116 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.116+0000 7fe78cff9700 1 -- 172.21.15.32:0/1831385469 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fe790153060 con 0x7fe7900d1ca0 2023-10-08T06:10:13.283 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.279+0000 7fe796a17700 1 -- 172.21.15.32:0/1831385469 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe7900d0b90 con 0x7fe7900d1ca0 2023-10-08T06:10:13.283 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.279+0000 7fe78cff9700 1 -- 172.21.15.32:0/1831385469 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe780088030 con 0x7fe7900d1ca0 2023-10-08T06:10:13.283 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 64 2023-10-08T06:10:13.286 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.283+0000 7fe796a17700 1 -- 172.21.15.32:0/1831385469 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fe77c066540 msgr2=0x7fe77c068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:13.286 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.283+0000 7fe796a17700 1 --2- 172.21.15.32:0/1831385469 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fe77c066540 0x7fe77c068a00 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fe784009bf0 tx=0x7fe784009240 comp rx=0 tx=0).stop 2023-10-08T06:10:13.286 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.283+0000 7fe796a17700 1 -- 172.21.15.32:0/1831385469 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe7900d1ca0 msgr2=0x7fe7900cbde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:13.286 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.283+0000 7fe796a17700 1 --2- 172.21.15.32:0/1831385469 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe7900d1ca0 0x7fe7900cbde0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fe7900b59c0 tx=0x7fe780004770 comp rx=0 tx=0).stop 2023-10-08T06:10:13.286 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.283+0000 7fe796a17700 1 -- 172.21.15.32:0/1831385469 shutdown_connections 2023-10-08T06:10:13.287 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.283+0000 7fe796a17700 1 --2- 172.21.15.32:0/1831385469 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fe77c066540 0x7fe77c068a00 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:13.287 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.283+0000 7fe796a17700 1 --2- 172.21.15.32:0/1831385469 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe7900d1ca0 0x7fe7900cbde0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:13.287 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.283+0000 7fe796a17700 1 --2- 172.21.15.32:0/1831385469 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe79015dde0 0x7fe7900b3850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:13.287 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.283+0000 7fe796a17700 1 --2- 172.21.15.32:0/1831385469 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe7900b5270 0x7fe790155070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:13.287 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.283+0000 7fe796a17700 1 -- 172.21.15.32:0/1831385469 >> 172.21.15.32:0/1831385469 conn(0x7fe7900cfd30 msgr2=0x7fe7900b7690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:10:13.287 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.283+0000 7fe796a17700 1 -- 172.21.15.32:0/1831385469 shutdown_connections 2023-10-08T06:10:13.287 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.283+0000 7fe796a17700 1 -- 172.21.15.32:0/1831385469 wait complete. 2023-10-08T06:10:13.297 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-08T06:10:13.417 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.415+0000 7ff2a3315700 1 Processor -- start 2023-10-08T06:10:13.418 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.415+0000 7ff2a3315700 1 -- start start 2023-10-08T06:10:13.419 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.415+0000 7ff2a3315700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff29c15d490 0x7ff29c0b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:13.420 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.415+0000 7ff2a3315700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff29c0ce4e0 0x7ff29c0b6130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:13.420 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.415+0000 7ff2a3315700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff29c0d1bb0 con 0x7ff29c0d13d0 2023-10-08T06:10:13.420 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.415+0000 7ff2a3315700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff29c0d1e90 con 0x7ff29c0ce4e0 2023-10-08T06:10:13.420 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.415+0000 7ff2a3315700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff29c0d2170 con 0x7ff29c15d490 2023-10-08T06:10:13.420 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.415+0000 7ff2a2b14700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff29c0ce4e0 0x7ff29c0b6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:13.420 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.415+0000 7ff2a2313700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff29c15d490 0x7ff29c0b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:13.420 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.415+0000 7ff2a1b12700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7ff29c0d13d0 0x7ff29c0cddd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.32:48560/0 (socket says 172.21.15.32:48560) 2023-10-08T06:10:13.420 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.415+0000 7ff2a1b12700 1 -- 172.21.15.32:0/2859979666 learned_addr learned my addr 172.21.15.32:0/2859979666 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-08T06:10:13.421 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.415+0000 7ff2a2b14700 1 --2- 172.21.15.32:0/2859979666 >> v2:172.21.15.40:3300/0 conn(0x7ff29c0ce4e0 0x7ff29c0b6130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.32:43600/0 (socket says 172.21.15.32:43600) 2023-10-08T06:10:13.425 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.419+0000 7ff2a2b14700 1 -- 172.21.15.32:0/2859979666 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff29c15d490 msgr2=0x7ff29c0b8bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:10:13.425 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.419+0000 7ff2a2b14700 1 --2- 172.21.15.32:0/2859979666 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff29c15d490 0x7ff29c0b8bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:13.426 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.419+0000 7ff2a2b14700 1 -- 172.21.15.32:0/2859979666 >> v1:172.21.15.40:6789/0 conn(0x7ff29c0d13d0 legacy=0x7ff29c0cddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:13.426 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.419+0000 7ff2a2b14700 1 -- 172.21.15.32:0/2859979666 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff29c0d2450 con 0x7ff29c0ce4e0 2023-10-08T06:10:13.426 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.419+0000 7ff2a2b14700 1 --2- 172.21.15.32:0/2859979666 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff29c0ce4e0 0x7ff29c0b6130 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7ff294009d90 tx=0x7ff29400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7456ab637ac334d7 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:13.426 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.419+0000 7ff2a1311700 1 -- 172.21.15.32:0/2859979666 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff29400e070 con 0x7ff29c0ce4e0 2023-10-08T06:10:13.426 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.419+0000 7ff2a1311700 1 -- 172.21.15.32:0/2859979666 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff294003a40 con 0x7ff29c0ce4e0 2023-10-08T06:10:13.426 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.419+0000 7ff2a1311700 1 -- 172.21.15.32:0/2859979666 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff294003df0 con 0x7ff29c0ce4e0 2023-10-08T06:10:13.426 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.419+0000 7ff2a3315700 1 -- 172.21.15.32:0/2859979666 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff29c0ce4e0 msgr2=0x7ff29c0b6130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:13.426 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.419+0000 7ff2a3315700 1 --2- 172.21.15.32:0/2859979666 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff29c0ce4e0 0x7ff29c0b6130 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7ff294009d90 tx=0x7ff29400b330 comp rx=0 tx=0).stop 2023-10-08T06:10:13.426 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.419+0000 7ff2a3315700 1 -- 172.21.15.32:0/2859979666 shutdown_connections 2023-10-08T06:10:13.426 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.419+0000 7ff2a3315700 1 --2- 172.21.15.32:0/2859979666 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff29c0ce4e0 0x7ff29c0b6130 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:13.427 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.419+0000 7ff2a3315700 1 --2- 172.21.15.32:0/2859979666 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff29c15d490 0x7ff29c0b8bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:13.427 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.419+0000 7ff2a3315700 1 -- 172.21.15.32:0/2859979666 >> 172.21.15.32:0/2859979666 conn(0x7ff29c06ab40 msgr2=0x7ff29c06af20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:10:13.427 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.419+0000 7ff2a3315700 1 -- 172.21.15.32:0/2859979666 shutdown_connections 2023-10-08T06:10:13.427 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.419+0000 7ff2a3315700 1 -- 172.21.15.32:0/2859979666 wait complete. 2023-10-08T06:10:13.427 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.419+0000 7ff2a3315700 1 Processor -- start 2023-10-08T06:10:13.427 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.419+0000 7ff2a3315700 1 -- start start 2023-10-08T06:10:13.427 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.423+0000 7ff2a3315700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff29c0ce4e0 0x7ff29c15f570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:13.427 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.423+0000 7ff2a3315700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff29c0d13d0 0x7ff29c1f30f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:13.427 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.423+0000 7ff2a3315700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff29c15d490 0x7ff29c1579b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:13.427 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.423+0000 7ff2a3315700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff29c15fab0 con 0x7ff29c15d490 2023-10-08T06:10:13.427 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.423+0000 7ff2a3315700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff29c1f3630 con 0x7ff29c0d13d0 2023-10-08T06:10:13.427 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.423+0000 7ff2a3315700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff29c15fd00 con 0x7ff29c0ce4e0 2023-10-08T06:10:13.428 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.423+0000 7ff2a2b14700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff29c15d490 0x7ff29c1579b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:13.428 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.423+0000 7ff2a2b14700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff29c15d490 0x7ff29c1579b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:46718/0 (socket says 172.21.15.32:46718) 2023-10-08T06:10:13.428 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.423+0000 7ff2a2b14700 1 -- 172.21.15.32:0/1428277810 learned_addr learned my addr 172.21.15.32:0/1428277810 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:10:13.428 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.423+0000 7ff2a1b12700 1 --2- 172.21.15.32:0/1428277810 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff29c0d13d0 0x7ff29c1f30f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:13.428 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.423+0000 7ff2a2313700 1 --2- 172.21.15.32:0/1428277810 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff29c0ce4e0 0x7ff29c15f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:13.428 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.423+0000 7ff2a2b14700 1 -- 172.21.15.32:0/1428277810 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff29c0ce4e0 msgr2=0x7ff29c15f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:13.428 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.423+0000 7ff2a2b14700 1 --2- 172.21.15.32:0/1428277810 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff29c0ce4e0 0x7ff29c15f570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:13.428 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.423+0000 7ff2a2b14700 1 -- 172.21.15.32:0/1428277810 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff29c0d13d0 msgr2=0x7ff29c1f30f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:13.428 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.423+0000 7ff2a2b14700 1 --2- 172.21.15.32:0/1428277810 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff29c0d13d0 0x7ff29c1f30f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:13.428 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.423+0000 7ff2a2b14700 1 -- 172.21.15.32:0/1428277810 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff294009a70 con 0x7ff29c15d490 2023-10-08T06:10:13.428 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.423+0000 7ff2a2b14700 1 --2- 172.21.15.32:0/1428277810 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff29c15d490 0x7ff29c1579b0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7ff29c066f10 tx=0x7ff294004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:13.429 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.423+0000 7ff28effd700 1 -- 172.21.15.32:0/1428277810 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff294009410 con 0x7ff29c15d490 2023-10-08T06:10:13.429 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.423+0000 7ff28effd700 1 -- 172.21.15.32:0/1428277810 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff294004560 con 0x7ff29c15d490 2023-10-08T06:10:13.429 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.423+0000 7ff2a3315700 1 -- 172.21.15.32:0/1428277810 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff29c15ffe0 con 0x7ff29c15d490 2023-10-08T06:10:13.429 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.423+0000 7ff28effd700 1 -- 172.21.15.32:0/1428277810 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff294004910 con 0x7ff29c15d490 2023-10-08T06:10:13.429 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.423+0000 7ff2a3315700 1 -- 172.21.15.32:0/1428277810 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff29c1605a0 con 0x7ff29c15d490 2023-10-08T06:10:13.430 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.423+0000 7ff2a3315700 1 -- 172.21.15.32:0/1428277810 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff29c1f38a0 con 0x7ff29c15d490 2023-10-08T06:10:13.430 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.427+0000 7ff28effd700 1 -- 172.21.15.32:0/1428277810 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7ff294012430 con 0x7ff29c15d490 2023-10-08T06:10:13.430 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.427+0000 7ff28effd700 1 --2- 172.21.15.32:0/1428277810 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7ff280066510 0x7ff2800689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:13.430 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.427+0000 7ff28effd700 1 -- 172.21.15.32:0/1428277810 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff294085e70 con 0x7ff29c15d490 2023-10-08T06:10:13.430 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.427+0000 7ff2a2313700 1 --2- 172.21.15.32:0/1428277810 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7ff280066510 0x7ff2800689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:13.430 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.427+0000 7ff2a2313700 1 --2- 172.21.15.32:0/1428277810 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7ff280066510 0x7ff2800689d0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7ff29c0c6600 tx=0x7ff290009240 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:13.435 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.435+0000 7ff28effd700 1 -- 172.21.15.32:0/1428277810 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7ff294089030 con 0x7ff29c15d490 2023-10-08T06:10:13.613 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.611+0000 7ff2a3315700 1 -- 172.21.15.32:0/1428277810 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7ff29c0d2730 con 0x7ff29c15d490 2023-10-08T06:10:13.614 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.611+0000 7ff28effd700 1 -- 172.21.15.32:0/1428277810 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v22) v1 ==== 80+0+0 (secure 0 0 0) 0x7ff294056d70 con 0x7ff29c15d490 2023-10-08T06:10:13.616 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.615+0000 7ff2a3315700 1 -- 172.21.15.32:0/1428277810 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7ff280066510 msgr2=0x7ff2800689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:13.617 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.615+0000 7ff2a3315700 1 --2- 172.21.15.32:0/1428277810 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7ff280066510 0x7ff2800689d0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7ff29c0c6600 tx=0x7ff290009240 comp rx=0 tx=0).stop 2023-10-08T06:10:13.617 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.615+0000 7ff2a3315700 1 -- 172.21.15.32:0/1428277810 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff29c15d490 msgr2=0x7ff29c1579b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:13.617 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.615+0000 7ff2a3315700 1 --2- 172.21.15.32:0/1428277810 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff29c15d490 0x7ff29c1579b0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7ff29c066f10 tx=0x7ff294004af0 comp rx=0 tx=0).stop 2023-10-08T06:10:13.617 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.615+0000 7ff2a3315700 1 -- 172.21.15.32:0/1428277810 shutdown_connections 2023-10-08T06:10:13.617 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.615+0000 7ff2a3315700 1 --2- 172.21.15.32:0/1428277810 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7ff280066510 0x7ff2800689d0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:13.617 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.615+0000 7ff2a3315700 1 --2- 172.21.15.32:0/1428277810 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff29c15d490 0x7ff29c1579b0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:13.617 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.615+0000 7ff2a3315700 1 --2- 172.21.15.32:0/1428277810 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff29c0d13d0 0x7ff29c1f30f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:13.617 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.615+0000 7ff2a3315700 1 --2- 172.21.15.32:0/1428277810 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff29c0ce4e0 0x7ff29c15f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:13.617 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.615+0000 7ff2a3315700 1 -- 172.21.15.32:0/1428277810 >> 172.21.15.32:0/1428277810 conn(0x7ff29c06ab40 msgr2=0x7ff29c15a000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:10:13.618 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.615+0000 7ff2a3315700 1 -- 172.21.15.32:0/1428277810 shutdown_connections 2023-10-08T06:10:13.618 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.615+0000 7ff2a3315700 1 -- 172.21.15.32:0/1428277810 wait complete. 2023-10-08T06:10:13.618 INFO:teuthology.orchestra.run.smithi032.stderr:listed 0 entries 2023-10-08T06:10:13.629 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-10-08T06:10:13.629 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-08T06:10:13.637 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T06:10:13.750 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.747+0000 7f4a6a343700 1 Processor -- start 2023-10-08T06:10:13.751 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.747+0000 7f4a6a343700 1 -- start start 2023-10-08T06:10:13.752 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.751+0000 7f4a6a343700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f4a640b8bc0 0x7f4a640cddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:13.752 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.751+0000 7f4a6a343700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f4a640ce310 0x7f4a640b6130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:13.752 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.751+0000 7f4a6a343700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a640b9000 con 0x7f4a6415d490 2023-10-08T06:10:13.753 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.751+0000 7f4a6a343700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a640ce7c0 con 0x7f4a640b8bc0 2023-10-08T06:10:13.753 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.751+0000 7f4a6a343700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a640d1bb0 con 0x7f4a640ce310 2023-10-08T06:10:13.753 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.751+0000 7f4a68b40700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f4a640b8bc0 0x7f4a640cddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:13.753 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.751+0000 7f4a68b40700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f4a640b8bc0 0x7f4a640cddd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:46728/0 (socket says 172.21.15.32:46728) 2023-10-08T06:10:13.753 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.751+0000 7f4a68b40700 1 -- 172.21.15.32:0/1134236253 learned_addr learned my addr 172.21.15.32:0/1134236253 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:10:13.753 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.751+0000 7f4a69b42700 1 --2- 172.21.15.32:0/1134236253 >> v2:172.21.15.40:3300/0 conn(0x7f4a640ce310 0x7f4a640b6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:13.754 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.751+0000 7f4a68b40700 1 -- 172.21.15.32:0/1134236253 >> v2:172.21.15.40:3300/0 conn(0x7f4a640ce310 msgr2=0x7f4a640b6130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:10:13.754 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.751+0000 7f4a68b40700 1 --2- 172.21.15.32:0/1134236253 >> v2:172.21.15.40:3300/0 conn(0x7f4a640ce310 0x7f4a640b6130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:13.754 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.751+0000 7f4a68b40700 1 -- 172.21.15.32:0/1134236253 >> v1:172.21.15.40:6789/0 conn(0x7f4a6415d490 legacy=0x7f4a640d13d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:13.754 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.751+0000 7f4a68b40700 1 -- 172.21.15.32:0/1134236253 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a640d1e90 con 0x7f4a640b8bc0 2023-10-08T06:10:13.754 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.751+0000 7f4a68b40700 1 --2- 172.21.15.32:0/1134236253 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4a640b8bc0 0x7f4a640cddd0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f4a640b5ee0 tx=0x7f4a54009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f31822fa1ee3d5c1 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:13.754 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.751+0000 7f4a5bfff700 1 -- 172.21.15.32:0/1134236253 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a54011830 con 0x7f4a640b8bc0 2023-10-08T06:10:13.754 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.751+0000 7f4a5bfff700 1 -- 172.21.15.32:0/1134236253 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a54011990 con 0x7f4a640b8bc0 2023-10-08T06:10:13.754 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.751+0000 7f4a5bfff700 1 -- 172.21.15.32:0/1134236253 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a54011d20 con 0x7f4a640b8bc0 2023-10-08T06:10:13.755 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.751+0000 7f4a6a343700 1 -- 172.21.15.32:0/1134236253 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4a640b8bc0 msgr2=0x7f4a640cddd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:13.755 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.751+0000 7f4a6a343700 1 --2- 172.21.15.32:0/1134236253 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4a640b8bc0 0x7f4a640cddd0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f4a640b5ee0 tx=0x7f4a54009bf0 comp rx=0 tx=0).stop 2023-10-08T06:10:13.755 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.751+0000 7f4a6a343700 1 -- 172.21.15.32:0/1134236253 shutdown_connections 2023-10-08T06:10:13.756 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.751+0000 7f4a6a343700 1 --2- 172.21.15.32:0/1134236253 >> v2:172.21.15.40:3300/0 conn(0x7f4a640ce310 0x7f4a640b6130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:13.756 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.751+0000 7f4a6a343700 1 --2- 172.21.15.32:0/1134236253 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4a640b8bc0 0x7f4a640cddd0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:13.756 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.751+0000 7f4a6a343700 1 -- 172.21.15.32:0/1134236253 >> 172.21.15.32:0/1134236253 conn(0x7f4a6406ab40 msgr2=0x7f4a6406af20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:10:13.756 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.751+0000 7f4a6a343700 1 -- 172.21.15.32:0/1134236253 shutdown_connections 2023-10-08T06:10:13.756 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.751+0000 7f4a6a343700 1 -- 172.21.15.32:0/1134236253 wait complete. 2023-10-08T06:10:13.756 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.755+0000 7f4a6a343700 1 Processor -- start 2023-10-08T06:10:13.757 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.755+0000 7f4a6a343700 1 -- start start 2023-10-08T06:10:13.759 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.755+0000 7f4a6a343700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4a640b8bc0 0x7f4a6414bc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:13.759 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.755+0000 7f4a6a343700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4a640ce310 0x7f4a6414f930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:13.759 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.755+0000 7f4a6a343700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4a6415d490 0x7f4a640c84b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:13.759 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.755+0000 7f4a6a343700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a640cd2d0 con 0x7f4a640ce310 2023-10-08T06:10:13.759 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.755+0000 7f4a6a343700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a64152880 con 0x7f4a640b8bc0 2023-10-08T06:10:13.760 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.755+0000 7f4a6a343700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a640ca8a0 con 0x7f4a6415d490 2023-10-08T06:10:13.760 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.755+0000 7f4a68b40700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4a640ce310 0x7f4a6414f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:13.760 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.755+0000 7f4a68b40700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4a640ce310 0x7f4a6414f930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:46740/0 (socket says 172.21.15.32:46740) 2023-10-08T06:10:13.760 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.755+0000 7f4a68b40700 1 -- 172.21.15.32:0/2322919501 learned_addr learned my addr 172.21.15.32:0/2322919501 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:10:13.760 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.755+0000 7f4a69341700 1 --2- 172.21.15.32:0/2322919501 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4a640b8bc0 0x7f4a6414bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:13.760 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.755+0000 7f4a69b42700 1 --2- 172.21.15.32:0/2322919501 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4a6415d490 0x7f4a640c84b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:13.760 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.755+0000 7f4a68b40700 1 -- 172.21.15.32:0/2322919501 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4a6415d490 msgr2=0x7f4a640c84b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:13.760 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.755+0000 7f4a68b40700 1 --2- 172.21.15.32:0/2322919501 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4a6415d490 0x7f4a640c84b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:13.760 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.755+0000 7f4a68b40700 1 -- 172.21.15.32:0/2322919501 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4a640b8bc0 msgr2=0x7f4a6414bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:13.760 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.755+0000 7f4a68b40700 1 --2- 172.21.15.32:0/2322919501 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4a640b8bc0 0x7f4a6414bc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:13.760 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.755+0000 7f4a68b40700 1 -- 172.21.15.32:0/2322919501 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a54009570 con 0x7f4a640ce310 2023-10-08T06:10:13.761 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.755+0000 7f4a69b42700 1 --2- 172.21.15.32:0/2322919501 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4a6415d490 0x7f4a640c84b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T06:10:13.761 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.755+0000 7f4a68b40700 1 --2- 172.21.15.32:0/2322919501 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4a640ce310 0x7f4a6414f930 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f4a54013000 tx=0x7f4a54004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:13.761 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.755+0000 7f4a59ffb700 1 -- 172.21.15.32:0/2322919501 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a54004340 con 0x7f4a640ce310 2023-10-08T06:10:13.761 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.755+0000 7f4a59ffb700 1 -- 172.21.15.32:0/2322919501 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a5401f070 con 0x7f4a640ce310 2023-10-08T06:10:13.761 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.755+0000 7f4a6a343700 1 -- 172.21.15.32:0/2322919501 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a6414c1d0 con 0x7f4a640ce310 2023-10-08T06:10:13.761 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.755+0000 7f4a59ffb700 1 -- 172.21.15.32:0/2322919501 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a540036c0 con 0x7f4a640ce310 2023-10-08T06:10:13.761 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.755+0000 7f4a6a343700 1 -- 172.21.15.32:0/2322919501 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a640ca250 con 0x7f4a640ce310 2023-10-08T06:10:13.762 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.759+0000 7f4a6a343700 1 -- 172.21.15.32:0/2322919501 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a64073f00 con 0x7f4a640ce310 2023-10-08T06:10:13.762 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.759+0000 7f4a59ffb700 1 -- 172.21.15.32:0/2322919501 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f4a54021030 con 0x7f4a640ce310 2023-10-08T06:10:13.762 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.759+0000 7f4a59ffb700 1 --2- 172.21.15.32:0/2322919501 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f4a48066510 0x7f4a480689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:13.762 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.759+0000 7f4a59ffb700 1 -- 172.21.15.32:0/2322919501 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4a54084740 con 0x7f4a640ce310 2023-10-08T06:10:13.762 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.759+0000 7f4a69341700 1 --2- 172.21.15.32:0/2322919501 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f4a48066510 0x7f4a480689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:13.763 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.759+0000 7f4a69341700 1 --2- 172.21.15.32:0/2322919501 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f4a48066510 0x7f4a480689d0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f4a60000f60 tx=0x7f4a60009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:13.769 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.767+0000 7f4a59ffb700 1 -- 172.21.15.32:0/2322919501 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f4a54051bd0 con 0x7f4a640ce310 2023-10-08T06:10:13.935 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.935+0000 7f4a6a343700 1 -- 172.21.15.32:0/2322919501 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4a640ca9e0 con 0x7f4a640ce310 2023-10-08T06:10:13.938 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.935+0000 7f4a59ffb700 1 -- 172.21.15.32:0/2322919501 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16445 (secure 0 0 0) 0x7f4a540551f0 con 0x7f4a640ce310 2023-10-08T06:10:13.939 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:10:13.939 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":22,"fsid":"ac672d87-96ae-41e0-9314-623ba2cdbbba","created":"2023-10-08T06:09:11.175626+0000","modified":"2023-10-08T06:09:38.153256+0000","last_up_change":"2023-10-08T06:09:22.744643+0000","last_in_change":"2023-10-08T06:09:14.131580+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T06:09:23.307843+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T06:09:34.295012+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T06:09:35.515590+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"43433f0c-9592-4874-92d7-10f8f4acf07f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":587888964},{"type":"v1","addr":"172.21.15.32:6801","nonce":587888964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":587888964},{"type":"v1","addr":"172.21.15.32:6803","nonce":587888964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":587888964},{"type":"v1","addr":"172.21.15.32:6810","nonce":587888964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6805","nonce":587888964},{"type":"v1","addr":"172.21.15.32:6807","nonce":587888964}]},"public_addr":"172.21.15.32:6801/587888964","cluster_addr":"172.21.15.32:6803/587888964","heartbeat_back_addr":"172.21.15.32:6810/587888964","heartbeat_front_addr":"172.21.15.32:6807/587888964","state":["exists","up"]},{"osd":1,"uuid":"2ecb1008-b987-4ce7-b646-6cded55fc8d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":990576767},{"type":"v1","addr":"172.21.15.32:6817","nonce":990576767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":990576767},{"type":"v1","addr":"172.21.15.32:6819","nonce":990576767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":990576767},{"type":"v1","addr":"172.21.15.32:6823","nonce":990576767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":990576767},{"type":"v1","addr":"172.21.15.32:6821","nonce":990576767}]},"public_addr":"172.21.15.32:6817/990576767","cluster_addr":"172.21.15.32:6819/990576767","heartbeat_back_addr":"172.21.15.32:6823/990576767","heartbeat_front_addr":"172.21.15.32:6821/990576767","state":["exists","up"]},{"osd":2,"uuid":"1b131c94-c09b-4e80-8746-bf1b7bac362d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6824","nonce":1566874440},{"type":"v1","addr":"172.21.15.32:6825","nonce":1566874440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":1566874440},{"type":"v1","addr":"172.21.15.32:6827","nonce":1566874440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":1566874440},{"type":"v1","addr":"172.21.15.32:6831","nonce":1566874440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":1566874440},{"type":"v1","addr":"172.21.15.32:6829","nonce":1566874440}]},"public_addr":"172.21.15.32:6825/1566874440","cluster_addr":"172.21.15.32:6827/1566874440","heartbeat_back_addr":"172.21.15.32:6831/1566874440","heartbeat_front_addr":"172.21.15.32:6829/1566874440","state":["exists","up"]},{"osd":3,"uuid":"ad655af2-1f6f-4689-b21d-b07bbaeb68b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":3672614802},{"type":"v1","addr":"172.21.15.32:6806","nonce":3672614802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6809","nonce":3672614802},{"type":"v1","addr":"172.21.15.32:6811","nonce":3672614802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":3672614802},{"type":"v1","addr":"172.21.15.32:6815","nonce":3672614802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":3672614802},{"type":"v1","addr":"172.21.15.32:6813","nonce":3672614802}]},"public_addr":"172.21.15.32:6806/3672614802","cluster_addr":"172.21.15.32:6811/3672614802","heartbeat_back_addr":"172.21.15.32:6815/3672614802","heartbeat_front_addr":"172.21.15.32:6813/3672614802","state":["exists","up"]},{"osd":4,"uuid":"64a543a1-8c4f-458e-9aba-b35c1cd7dd03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":3369928244},{"type":"v1","addr":"172.21.15.40:6801","nonce":3369928244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":3369928244},{"type":"v1","addr":"172.21.15.40:6803","nonce":3369928244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":3369928244},{"type":"v1","addr":"172.21.15.40:6807","nonce":3369928244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":3369928244},{"type":"v1","addr":"172.21.15.40:6805","nonce":3369928244}]},"public_addr":"172.21.15.40:6801/3369928244","cluster_addr":"172.21.15.40:6803/3369928244","heartbeat_back_addr":"172.21.15.40:6807/3369928244","heartbeat_front_addr":"172.21.15.40:6805/3369928244","state":["exists","up"]},{"osd":5,"uuid":"0fef3e54-edb4-4678-878e-944663c51638","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":2395850297},{"type":"v1","addr":"172.21.15.40:6825","nonce":2395850297}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":2395850297},{"type":"v1","addr":"172.21.15.40:6827","nonce":2395850297}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":2395850297},{"type":"v1","addr":"172.21.15.40:6831","nonce":2395850297}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":2395850297},{"type":"v1","addr":"172.21.15.40:6829","nonce":2395850297}]},"public_addr":"172.21.15.40:6825/2395850297","cluster_addr":"172.21.15.40:6827/2395850297","heartbeat_back_addr":"172.21.15.40:6831/2395850297","heartbeat_front_addr":"172.21.15.40:6829/2395850297","state":["exists","up"]},{"osd":6,"uuid":"2eeb0472-6096-469d-9b2c-cab4bf41c31a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":4145283410},{"type":"v1","addr":"172.21.15.40:6809","nonce":4145283410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":4145283410},{"type":"v1","addr":"172.21.15.40:6811","nonce":4145283410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":4145283410},{"type":"v1","addr":"172.21.15.40:6815","nonce":4145283410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":4145283410},{"type":"v1","addr":"172.21.15.40:6813","nonce":4145283410}]},"public_addr":"172.21.15.40:6809/4145283410","cluster_addr":"172.21.15.40:6811/4145283410","heartbeat_back_addr":"172.21.15.40:6815/4145283410","heartbeat_front_addr":"172.21.15.40:6813/4145283410","state":["exists","up"]},{"osd":7,"uuid":"cf76e4c7-96a6-401f-a280-91aad4641940","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":2943297416},{"type":"v1","addr":"172.21.15.40:6817","nonce":2943297416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":2943297416},{"type":"v1","addr":"172.21.15.40:6819","nonce":2943297416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":2943297416},{"type":"v1","addr":"172.21.15.40:6823","nonce":2943297416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":2943297416},{"type":"v1","addr":"172.21.15.40:6821","nonce":2943297416}]},"public_addr":"172.21.15.40:6817/2943297416","cluster_addr":"172.21.15.40:6819/2943297416","heartbeat_back_addr":"172.21.15.40:6823/2943297416","heartbeat_front_addr":"172.21.15.40:6821/2943297416","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.411475+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.628841+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.599055+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.166100+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.384135+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.488403+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.307648+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.363541+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T06:10:13.942 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.939+0000 7f4a6a343700 1 -- 172.21.15.32:0/2322919501 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f4a48066510 msgr2=0x7f4a480689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:13.942 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.939+0000 7f4a6a343700 1 --2- 172.21.15.32:0/2322919501 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f4a48066510 0x7f4a480689d0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f4a60000f60 tx=0x7f4a60009040 comp rx=0 tx=0).stop 2023-10-08T06:10:13.942 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.939+0000 7f4a6a343700 1 -- 172.21.15.32:0/2322919501 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4a640ce310 msgr2=0x7f4a6414f930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:13.943 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.939+0000 7f4a6a343700 1 --2- 172.21.15.32:0/2322919501 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4a640ce310 0x7f4a6414f930 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f4a54013000 tx=0x7f4a54004770 comp rx=0 tx=0).stop 2023-10-08T06:10:13.943 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.939+0000 7f4a6a343700 1 -- 172.21.15.32:0/2322919501 shutdown_connections 2023-10-08T06:10:13.943 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.939+0000 7f4a6a343700 1 --2- 172.21.15.32:0/2322919501 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f4a48066510 0x7f4a480689d0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:13.943 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.939+0000 7f4a6a343700 1 --2- 172.21.15.32:0/2322919501 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4a640ce310 0x7f4a6414f930 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:13.943 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.939+0000 7f4a6a343700 1 --2- 172.21.15.32:0/2322919501 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4a6415d490 0x7f4a640c84b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:13.943 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.939+0000 7f4a6a343700 1 --2- 172.21.15.32:0/2322919501 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4a640b8bc0 0x7f4a6414bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:13.943 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.939+0000 7f4a6a343700 1 -- 172.21.15.32:0/2322919501 >> 172.21.15.32:0/2322919501 conn(0x7f4a6406ab40 msgr2=0x7f4a640c6b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:10:13.943 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.939+0000 7f4a6a343700 1 -- 172.21.15.32:0/2322919501 shutdown_connections 2023-10-08T06:10:13.943 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:13.939+0000 7f4a6a343700 1 -- 172.21.15.32:0/2322919501 wait complete. 2023-10-08T06:10:13.958 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T06:09:23.307843+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-08T06:09:34.295012+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-08T06:09:35.515590+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-08T06:10:13.959 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T06:10:14.082 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.079+0000 7fc2a1c6f700 1 Processor -- start 2023-10-08T06:10:14.082 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.079+0000 7fc2a1c6f700 1 -- start start 2023-10-08T06:10:14.087 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.079+0000 7fc2a1c6f700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fc29c15d490 0x7fc29c0b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:14.088 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.083+0000 7fc2a1c6f700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc29c0ce4e0 0x7fc29c0b6130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:14.088 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.083+0000 7fc2a1c6f700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc29c0d1bb0 con 0x7fc29c0d13d0 2023-10-08T06:10:14.088 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.083+0000 7fc2a1c6f700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc29c0d1e90 con 0x7fc29c15d490 2023-10-08T06:10:14.088 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.083+0000 7fc2a1c6f700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc29c0d2170 con 0x7fc29c0ce4e0 2023-10-08T06:10:14.088 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.083+0000 7fc2a0c6d700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fc29c15d490 0x7fc29c0b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:14.088 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.083+0000 7fc293fff700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fc29c0d13d0 0x7fc29c0cddd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:45852/0 (socket says 172.21.15.32:45852) 2023-10-08T06:10:14.088 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.083+0000 7fc293fff700 1 -- 172.21.15.32:0/3352890517 learned_addr learned my addr 172.21.15.32:0/3352890517 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-08T06:10:14.088 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.083+0000 7fc2a146e700 1 --2- 172.21.15.32:0/3352890517 >> v2:172.21.15.40:3300/0 conn(0x7fc29c0ce4e0 0x7fc29c0b6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:14.088 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.083+0000 7fc2a0c6d700 1 -- 172.21.15.32:0/3352890517 >> v2:172.21.15.40:3300/0 conn(0x7fc29c0ce4e0 msgr2=0x7fc29c0b6130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:10:14.089 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.083+0000 7fc2a0c6d700 1 --2- 172.21.15.32:0/3352890517 >> v2:172.21.15.40:3300/0 conn(0x7fc29c0ce4e0 0x7fc29c0b6130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:14.089 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.083+0000 7fc2a0c6d700 1 -- 172.21.15.32:0/3352890517 >> v1:172.21.15.32:6789/0 conn(0x7fc29c0d13d0 legacy=0x7fc29c0cddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:14.089 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.083+0000 7fc2937fe700 1 -- 172.21.15.32:0/3352890517 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2608550227 0 0) 0x7fc29c0d1bb0 con 0x7fc29c0d13d0 2023-10-08T06:10:14.089 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.083+0000 7fc2a0c6d700 1 -- 172.21.15.32:0/3352890517 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc29c0d2450 con 0x7fc29c15d490 2023-10-08T06:10:14.089 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.083+0000 7fc2a146e700 1 --2- 172.21.15.32:0/3352890517 >> v2:172.21.15.40:3300/0 conn(0x7fc29c0ce4e0 0x7fc29c0b6130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T06:10:14.089 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.083+0000 7fc2a0c6d700 1 --2- 172.21.15.32:0/3352890517 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc29c15d490 0x7fc29c0b8bc0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fc29c072960 tx=0x7fc298009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9da4084d01ac3a80 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:14.089 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.083+0000 7fc2937fe700 1 -- 172.21.15.32:0/3352890517 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc298011830 con 0x7fc29c15d490 2023-10-08T06:10:14.089 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.083+0000 7fc2937fe700 1 -- 172.21.15.32:0/3352890517 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc298011990 con 0x7fc29c15d490 2023-10-08T06:10:14.089 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.083+0000 7fc2937fe700 1 -- 172.21.15.32:0/3352890517 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc298011d40 con 0x7fc29c15d490 2023-10-08T06:10:14.089 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.083+0000 7fc2a1c6f700 1 -- 172.21.15.32:0/3352890517 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc29c15d490 msgr2=0x7fc29c0b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:14.090 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.083+0000 7fc2a1c6f700 1 --2- 172.21.15.32:0/3352890517 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc29c15d490 0x7fc29c0b8bc0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fc29c072960 tx=0x7fc298009b30 comp rx=0 tx=0).stop 2023-10-08T06:10:14.090 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.083+0000 7fc2a1c6f700 1 -- 172.21.15.32:0/3352890517 shutdown_connections 2023-10-08T06:10:14.090 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.083+0000 7fc2a1c6f700 1 --2- 172.21.15.32:0/3352890517 >> v2:172.21.15.40:3300/0 conn(0x7fc29c0ce4e0 0x7fc29c0b6130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:14.090 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.083+0000 7fc2a1c6f700 1 --2- 172.21.15.32:0/3352890517 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc29c15d490 0x7fc29c0b8bc0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:14.090 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.083+0000 7fc2a1c6f700 1 -- 172.21.15.32:0/3352890517 >> 172.21.15.32:0/3352890517 conn(0x7fc29c06ab40 msgr2=0x7fc29c06af20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:10:14.090 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.083+0000 7fc2a1c6f700 1 -- 172.21.15.32:0/3352890517 shutdown_connections 2023-10-08T06:10:14.090 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.083+0000 7fc2a1c6f700 1 -- 172.21.15.32:0/3352890517 wait complete. 2023-10-08T06:10:14.093 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.087+0000 7fc2a1c6f700 1 Processor -- start 2023-10-08T06:10:14.093 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.087+0000 7fc2a1c6f700 1 -- start start 2023-10-08T06:10:14.093 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.087+0000 7fc2a1c6f700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc29c0ce4e0 0x7fc29c153050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:14.093 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.087+0000 7fc2a1c6f700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc29c0d13d0 0x7fc29c0cbaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:14.093 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.087+0000 7fc2a1c6f700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc29c15d490 0x7fc29c0cc030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:14.093 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.087+0000 7fc2a1c6f700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc29c1f2290 con 0x7fc29c0ce4e0 2023-10-08T06:10:14.093 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.087+0000 7fc2a1c6f700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc29c153590 con 0x7fc29c15d490 2023-10-08T06:10:14.093 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.087+0000 7fc2a1c6f700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc29c0cd090 con 0x7fc29c0d13d0 2023-10-08T06:10:14.093 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.087+0000 7fc2a0c6d700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc29c0ce4e0 0x7fc29c153050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:14.094 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.087+0000 7fc2a0c6d700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc29c0ce4e0 0x7fc29c153050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:46750/0 (socket says 172.21.15.32:46750) 2023-10-08T06:10:14.094 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.087+0000 7fc2a0c6d700 1 -- 172.21.15.32:0/3874021906 learned_addr learned my addr 172.21.15.32:0/3874021906 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:10:14.094 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.087+0000 7fc2a146e700 1 --2- 172.21.15.32:0/3874021906 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc29c15d490 0x7fc29c0cc030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:14.094 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.087+0000 7fc293fff700 1 --2- 172.21.15.32:0/3874021906 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc29c0d13d0 0x7fc29c0cbaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:14.094 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.087+0000 7fc2a0c6d700 1 -- 172.21.15.32:0/3874021906 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc29c0d13d0 msgr2=0x7fc29c0cbaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:14.094 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.087+0000 7fc2a0c6d700 1 --2- 172.21.15.32:0/3874021906 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc29c0d13d0 0x7fc29c0cbaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:14.094 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.087+0000 7fc2a0c6d700 1 -- 172.21.15.32:0/3874021906 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc29c15d490 msgr2=0x7fc29c0cc030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:14.094 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.087+0000 7fc2a0c6d700 1 --2- 172.21.15.32:0/3874021906 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc29c15d490 0x7fc29c0cc030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:14.094 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.087+0000 7fc2a0c6d700 1 -- 172.21.15.32:0/3874021906 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2980094b0 con 0x7fc29c0ce4e0 2023-10-08T06:10:14.094 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.087+0000 7fc2a0c6d700 1 --2- 172.21.15.32:0/3874021906 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc29c0ce4e0 0x7fc29c153050 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fc298014040 tx=0x7fc298004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:14.095 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.087+0000 7fc2917fa700 1 -- 172.21.15.32:0/3874021906 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc298004550 con 0x7fc29c0ce4e0 2023-10-08T06:10:14.095 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.087+0000 7fc2917fa700 1 -- 172.21.15.32:0/3874021906 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc29801e070 con 0x7fc29c0ce4e0 2023-10-08T06:10:14.095 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.087+0000 7fc2a1c6f700 1 -- 172.21.15.32:0/3874021906 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc29c0cd370 con 0x7fc29c0ce4e0 2023-10-08T06:10:14.095 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.087+0000 7fc2917fa700 1 -- 172.21.15.32:0/3874021906 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc298003900 con 0x7fc29c0ce4e0 2023-10-08T06:10:14.095 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.087+0000 7fc2a1c6f700 1 -- 172.21.15.32:0/3874021906 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc29c0cd930 con 0x7fc29c0ce4e0 2023-10-08T06:10:14.095 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.091+0000 7fc2a1c6f700 1 -- 172.21.15.32:0/3874021906 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc29c073f00 con 0x7fc29c0ce4e0 2023-10-08T06:10:14.096 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.091+0000 7fc2917fa700 1 -- 172.21.15.32:0/3874021906 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fc298003a60 con 0x7fc29c0ce4e0 2023-10-08T06:10:14.096 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.091+0000 7fc2917fa700 1 --2- 172.21.15.32:0/3874021906 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fc288066510 0x7fc2880689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:14.096 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.091+0000 7fc2917fa700 1 -- 172.21.15.32:0/3874021906 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc298084cc0 con 0x7fc29c0ce4e0 2023-10-08T06:10:14.096 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.091+0000 7fc293fff700 1 --2- 172.21.15.32:0/3874021906 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fc288066510 0x7fc2880689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:14.096 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.091+0000 7fc293fff700 1 --2- 172.21.15.32:0/3874021906 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fc288066510 0x7fc2880689d0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fc29c1542d0 tx=0x7fc28c007e00 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:14.103 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.099+0000 7fc2917fa700 1 -- 172.21.15.32:0/3874021906 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fc2980521d0 con 0x7fc29c0ce4e0 2023-10-08T06:10:14.269 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.267+0000 7fc2a1c6f700 1 -- 172.21.15.32:0/3874021906 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc29c0b7720 con 0x7fc29c0ce4e0 2023-10-08T06:10:14.270 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.267+0000 7fc2917fa700 1 -- 172.21.15.32:0/3874021906 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc2980200a0 con 0x7fc29c0ce4e0 2023-10-08T06:10:14.270 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 1 2023-10-08T06:10:14.273 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.271+0000 7fc2a1c6f700 1 -- 172.21.15.32:0/3874021906 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fc288066510 msgr2=0x7fc2880689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:14.273 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.271+0000 7fc2a1c6f700 1 --2- 172.21.15.32:0/3874021906 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fc288066510 0x7fc2880689d0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fc29c1542d0 tx=0x7fc28c007e00 comp rx=0 tx=0).stop 2023-10-08T06:10:14.273 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.271+0000 7fc2a1c6f700 1 -- 172.21.15.32:0/3874021906 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc29c0ce4e0 msgr2=0x7fc29c153050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:14.274 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.271+0000 7fc2a1c6f700 1 --2- 172.21.15.32:0/3874021906 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc29c0ce4e0 0x7fc29c153050 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fc298014040 tx=0x7fc298004770 comp rx=0 tx=0).stop 2023-10-08T06:10:14.274 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.271+0000 7fc2a1c6f700 1 -- 172.21.15.32:0/3874021906 shutdown_connections 2023-10-08T06:10:14.274 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.271+0000 7fc2a1c6f700 1 --2- 172.21.15.32:0/3874021906 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fc288066510 0x7fc2880689d0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:14.274 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.271+0000 7fc2a1c6f700 1 --2- 172.21.15.32:0/3874021906 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc29c15d490 0x7fc29c0cc030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:14.274 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.271+0000 7fc2a1c6f700 1 --2- 172.21.15.32:0/3874021906 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc29c0d13d0 0x7fc29c0cbaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:14.274 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.271+0000 7fc2a1c6f700 1 --2- 172.21.15.32:0/3874021906 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc29c0ce4e0 0x7fc29c153050 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:14.274 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.271+0000 7fc2a1c6f700 1 -- 172.21.15.32:0/3874021906 >> 172.21.15.32:0/3874021906 conn(0x7fc29c06ab40 msgr2=0x7fc29c0c6b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:10:14.274 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.271+0000 7fc2a1c6f700 1 -- 172.21.15.32:0/3874021906 shutdown_connections 2023-10-08T06:10:14.274 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.271+0000 7fc2a1c6f700 1 -- 172.21.15.32:0/3874021906 wait complete. 2023-10-08T06:10:14.285 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-08T06:10:14.402 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.399+0000 7f811220b700 1 Processor -- start 2023-10-08T06:10:14.402 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.399+0000 7f811220b700 1 -- start start 2023-10-08T06:10:14.403 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.399+0000 7f811220b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f810c15d490 0x7f810c0b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:14.404 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.399+0000 7f811220b700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f810c0d1bb0 con 0x7f810c0ce4e0 2023-10-08T06:10:14.404 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.399+0000 7f811220b700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f810c0d1e90 con 0x7f810c0d13d0 2023-10-08T06:10:14.404 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.399+0000 7f811220b700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f810c0d2170 con 0x7f810c15d490 2023-10-08T06:10:14.404 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.403+0000 7f8111a0a700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f810c0ce4e0 0x7f810c0b6130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:45868/0 (socket says 172.21.15.32:45868) 2023-10-08T06:10:14.404 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.403+0000 7f8111a0a700 1 -- 172.21.15.32:0/1248712005 learned_addr learned my addr 172.21.15.32:0/1248712005 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-08T06:10:14.404 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.403+0000 7f8111209700 1 --2- 172.21.15.32:0/1248712005 >> v2:172.21.15.40:3300/0 conn(0x7f810c15d490 0x7f810c0b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:14.405 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.403+0000 7f8103fff700 1 -- 172.21.15.32:0/1248712005 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 194787789 0 0) 0x7f810c0d1bb0 con 0x7f810c0ce4e0 2023-10-08T06:10:14.405 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.403+0000 7f8103fff700 1 -- 172.21.15.32:0/1248712005 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f80f80035d0 con 0x7f810c0ce4e0 2023-10-08T06:10:14.405 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.403+0000 7f8103fff700 1 -- 172.21.15.32:0/1248712005 <== mon.1 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4103920495 0 0) 0x7f810c0d1e90 con 0x7f810c0d13d0 2023-10-08T06:10:14.405 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.403+0000 7f8103fff700 1 -- 172.21.15.32:0/1248712005 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f810c0d1bb0 con 0x7f810c0d13d0 2023-10-08T06:10:14.405 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.403+0000 7f8111209700 1 -- 172.21.15.32:0/1248712005 >> v1:172.21.15.40:6789/0 conn(0x7f810c0d13d0 legacy=0x7f810c0cddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:14.406 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.403+0000 7f8103fff700 1 -- 172.21.15.32:0/1248712005 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2553340102 0 0) 0x7f80f80035d0 con 0x7f810c0ce4e0 2023-10-08T06:10:14.406 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.403+0000 7f8111209700 1 -- 172.21.15.32:0/1248712005 >> v1:172.21.15.32:6789/0 conn(0x7f810c0ce4e0 legacy=0x7f810c0b6130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:14.406 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.403+0000 7f8111209700 1 -- 172.21.15.32:0/1248712005 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f810c0d2450 con 0x7f810c15d490 2023-10-08T06:10:14.406 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.403+0000 7f8111209700 1 --2- 172.21.15.32:0/1248712005 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f810c15d490 0x7f810c0b8bc0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f8108009850 tx=0x7f8108009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c7816670e2d7d37 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:14.407 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.403+0000 7f8103fff700 1 -- 172.21.15.32:0/1248712005 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81040019f0 con 0x7f810c15d490 2023-10-08T06:10:14.407 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.403+0000 7f8103fff700 1 -- 172.21.15.32:0/1248712005 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8108004030 con 0x7f810c15d490 2023-10-08T06:10:14.407 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.403+0000 7f8103fff700 1 -- 172.21.15.32:0/1248712005 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81080043a0 con 0x7f810c15d490 2023-10-08T06:10:14.407 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.403+0000 7f811220b700 1 -- 172.21.15.32:0/1248712005 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f810c15d490 msgr2=0x7f810c0b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:14.407 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.403+0000 7f811220b700 1 --2- 172.21.15.32:0/1248712005 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f810c15d490 0x7f810c0b8bc0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f8108009850 tx=0x7f8108009b60 comp rx=0 tx=0).stop 2023-10-08T06:10:14.407 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.403+0000 7f811220b700 1 -- 172.21.15.32:0/1248712005 shutdown_connections 2023-10-08T06:10:14.408 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.403+0000 7f811220b700 1 --2- 172.21.15.32:0/1248712005 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f810c15d490 0x7f810c0b8bc0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:14.408 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.403+0000 7f811220b700 1 -- 172.21.15.32:0/1248712005 >> 172.21.15.32:0/1248712005 conn(0x7f810c06ab40 msgr2=0x7f810c06af20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:10:14.408 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.403+0000 7f811220b700 1 -- 172.21.15.32:0/1248712005 shutdown_connections 2023-10-08T06:10:14.408 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.403+0000 7f811220b700 1 -- 172.21.15.32:0/1248712005 wait complete. 2023-10-08T06:10:14.409 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.407+0000 7f811220b700 1 Processor -- start 2023-10-08T06:10:14.409 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.407+0000 7f811220b700 1 -- start start 2023-10-08T06:10:14.409 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.407+0000 7f811220b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f810c0ce4e0 0x7f810c14a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:14.409 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.407+0000 7f811220b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f810c0d13d0 0x7f810c14b010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:14.409 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.407+0000 7f811220b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f810c14b550 0x7f810c0b7550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:14.409 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.407+0000 7f811220b700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f810c14ea30 con 0x7f810c0ce4e0 2023-10-08T06:10:14.409 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.407+0000 7f811220b700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f810c14e770 con 0x7f810c14b550 2023-10-08T06:10:14.410 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.407+0000 7f811220b700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f810c14c290 con 0x7f810c0d13d0 2023-10-08T06:10:14.410 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.407+0000 7f8111209700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f810c0ce4e0 0x7f810c14a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:14.410 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.407+0000 7f8111209700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f810c0ce4e0 0x7f810c14a3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:46760/0 (socket says 172.21.15.32:46760) 2023-10-08T06:10:14.410 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.407+0000 7f8111a0a700 1 --2- 172.21.15.32:0/763688780 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f810c14b550 0x7f810c0b7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:14.410 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.407+0000 7f8111209700 1 -- 172.21.15.32:0/763688780 learned_addr learned my addr 172.21.15.32:0/763688780 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:10:14.410 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.407+0000 7f8110a08700 1 --2- 172.21.15.32:0/763688780 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f810c0d13d0 0x7f810c14b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:14.412 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.407+0000 7f8111209700 1 -- 172.21.15.32:0/763688780 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f810c0d13d0 msgr2=0x7f810c14b010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:14.412 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.407+0000 7f8111209700 1 --2- 172.21.15.32:0/763688780 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f810c0d13d0 0x7f810c14b010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:14.412 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.407+0000 7f8111209700 1 -- 172.21.15.32:0/763688780 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f810c14b550 msgr2=0x7f810c0b7550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:14.412 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.407+0000 7f8111209700 1 --2- 172.21.15.32:0/763688780 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f810c14b550 0x7f810c0b7550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:14.412 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.407+0000 7f8111209700 1 -- 172.21.15.32:0/763688780 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81080094b0 con 0x7f810c0ce4e0 2023-10-08T06:10:14.412 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.407+0000 7f8111209700 1 --2- 172.21.15.32:0/763688780 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f810c0ce4e0 0x7f810c14a3a0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f8108004000 tx=0x7f8108004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:14.412 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.407+0000 7f8101ffb700 1 -- 172.21.15.32:0/763688780 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8108003d10 con 0x7f810c0ce4e0 2023-10-08T06:10:14.412 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.407+0000 7f8101ffb700 1 -- 172.21.15.32:0/763688780 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f810801f070 con 0x7f810c0ce4e0 2023-10-08T06:10:14.412 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.407+0000 7f811220b700 1 -- 172.21.15.32:0/763688780 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f810c14a8e0 con 0x7f810c0ce4e0 2023-10-08T06:10:14.413 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.407+0000 7f8101ffb700 1 -- 172.21.15.32:0/763688780 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8108011870 con 0x7f810c0ce4e0 2023-10-08T06:10:14.413 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.407+0000 7f811220b700 1 -- 172.21.15.32:0/763688780 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f810c14bcd0 con 0x7f810c0ce4e0 2023-10-08T06:10:14.413 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.411+0000 7f811220b700 1 -- 172.21.15.32:0/763688780 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f810c073f00 con 0x7f810c0ce4e0 2023-10-08T06:10:14.413 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.411+0000 7f8101ffb700 1 -- 172.21.15.32:0/763688780 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f81080119d0 con 0x7f810c0ce4e0 2023-10-08T06:10:14.414 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.411+0000 7f8101ffb700 1 --2- 172.21.15.32:0/763688780 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f80f0066540 0x7f80f0068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:14.414 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.411+0000 7f8110a08700 1 --2- 172.21.15.32:0/763688780 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f80f0066540 0x7f80f0068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:14.414 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.411+0000 7f8101ffb700 1 -- 172.21.15.32:0/763688780 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8108021070 con 0x7f810c0ce4e0 2023-10-08T06:10:14.416 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.415+0000 7f8110a08700 1 --2- 172.21.15.32:0/763688780 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f80f0066540 0x7f80f0068a00 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f810c15f5c0 tx=0x7f80fc009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:14.423 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.419+0000 7f8101ffb700 1 -- 172.21.15.32:0/763688780 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f8108052a20 con 0x7f810c0ce4e0 2023-10-08T06:10:14.587 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.583+0000 7f811220b700 1 -- 172.21.15.32:0/763688780 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f810c0cd630 con 0x7f810c0ce4e0 2023-10-08T06:10:14.588 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.587+0000 7f8101ffb700 1 -- 172.21.15.32:0/763688780 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8108056040 con 0x7f810c0ce4e0 2023-10-08T06:10:14.589 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 32 2023-10-08T06:10:14.590 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.587+0000 7f811220b700 1 -- 172.21.15.32:0/763688780 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f80f0066540 msgr2=0x7f80f0068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:14.590 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.587+0000 7f811220b700 1 --2- 172.21.15.32:0/763688780 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f80f0066540 0x7f80f0068a00 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f810c15f5c0 tx=0x7f80fc009040 comp rx=0 tx=0).stop 2023-10-08T06:10:14.590 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.587+0000 7f811220b700 1 -- 172.21.15.32:0/763688780 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f810c0ce4e0 msgr2=0x7f810c14a3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:14.591 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.587+0000 7f811220b700 1 --2- 172.21.15.32:0/763688780 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f810c0ce4e0 0x7f810c14a3a0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f8108004000 tx=0x7f8108004770 comp rx=0 tx=0).stop 2023-10-08T06:10:14.591 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.587+0000 7f811220b700 1 -- 172.21.15.32:0/763688780 shutdown_connections 2023-10-08T06:10:14.591 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.587+0000 7f811220b700 1 --2- 172.21.15.32:0/763688780 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f80f0066540 0x7f80f0068a00 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:14.591 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.587+0000 7f811220b700 1 --2- 172.21.15.32:0/763688780 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f810c14b550 0x7f810c0b7550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:14.591 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.587+0000 7f811220b700 1 --2- 172.21.15.32:0/763688780 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f810c0d13d0 0x7f810c14b010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:14.591 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.587+0000 7f811220b700 1 --2- 172.21.15.32:0/763688780 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f810c0ce4e0 0x7f810c14a3a0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:14.591 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.587+0000 7f811220b700 1 -- 172.21.15.32:0/763688780 >> 172.21.15.32:0/763688780 conn(0x7f810c06ab40 msgr2=0x7f810c15c090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:10:14.591 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.587+0000 7f811220b700 1 -- 172.21.15.32:0/763688780 shutdown_connections 2023-10-08T06:10:14.591 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.587+0000 7f811220b700 1 -- 172.21.15.32:0/763688780 wait complete. 2023-10-08T06:10:14.603 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-08T06:10:14.720 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.719+0000 7fa5d481d700 1 Processor -- start 2023-10-08T06:10:14.720 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.719+0000 7fa5d481d700 1 -- start start 2023-10-08T06:10:14.722 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.719+0000 7fa5d481d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa5d015d490 0x7fa5d00b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:14.722 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.719+0000 7fa5d481d700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fa5d00d13d0 0x7fa5d00cddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:14.722 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.719+0000 7fa5d481d700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5d00ce770 con 0x7fa5d00ce310 2023-10-08T06:10:14.722 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.719+0000 7fa5d481d700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5d00d1bb0 con 0x7fa5d00d13d0 2023-10-08T06:10:14.722 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.719+0000 7fa5d481d700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5d00d1e90 con 0x7fa5d015d490 2023-10-08T06:10:14.723 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.719+0000 7fa5ce59c700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fa5d00d13d0 0x7fa5d00cddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:14.723 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.719+0000 7fa5ce59c700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fa5d00d13d0 0x7fa5d00cddd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:46762/0 (socket says 172.21.15.32:46762) 2023-10-08T06:10:14.723 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.719+0000 7fa5ce59c700 1 -- 172.21.15.32:0/3712988990 learned_addr learned my addr 172.21.15.32:0/3712988990 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:10:14.723 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.719+0000 7fa5ced9d700 1 --2- 172.21.15.32:0/3712988990 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa5d015d490 0x7fa5d00b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:14.723 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.719+0000 7fa5ce59c700 1 -- 172.21.15.32:0/3712988990 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa5d015d490 msgr2=0x7fa5d00b8bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:10:14.723 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.719+0000 7fa5ce59c700 1 --2- 172.21.15.32:0/3712988990 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa5d015d490 0x7fa5d00b8bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:14.723 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.719+0000 7fa5ce59c700 1 -- 172.21.15.32:0/3712988990 >> v1:172.21.15.32:6789/0 conn(0x7fa5d00ce310 legacy=0x7fa5d00b4a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:14.723 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.719+0000 7fa5ce59c700 1 -- 172.21.15.32:0/3712988990 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5d00d2170 con 0x7fa5d00d13d0 2023-10-08T06:10:14.724 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.719+0000 7fa5ce59c700 1 --2- 172.21.15.32:0/3712988990 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa5d00d13d0 0x7fa5d00cddd0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fa5c4009910 tx=0x7fa5c4009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9b2bb90c3a9d0f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:14.724 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.719+0000 7fa5cdd9b700 1 -- 172.21.15.32:0/3712988990 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5c4011830 con 0x7fa5d00d13d0 2023-10-08T06:10:14.725 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.719+0000 7fa5cdd9b700 1 -- 172.21.15.32:0/3712988990 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5c4011990 con 0x7fa5d00d13d0 2023-10-08T06:10:14.725 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.719+0000 7fa5cdd9b700 1 -- 172.21.15.32:0/3712988990 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5c4011d40 con 0x7fa5d00d13d0 2023-10-08T06:10:14.725 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.719+0000 7fa5d481d700 1 -- 172.21.15.32:0/3712988990 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa5d00d13d0 msgr2=0x7fa5d00cddd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:14.725 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.719+0000 7fa5d481d700 1 --2- 172.21.15.32:0/3712988990 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa5d00d13d0 0x7fa5d00cddd0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fa5c4009910 tx=0x7fa5c4009c20 comp rx=0 tx=0).stop 2023-10-08T06:10:14.725 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.719+0000 7fa5d481d700 1 -- 172.21.15.32:0/3712988990 shutdown_connections 2023-10-08T06:10:14.725 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.719+0000 7fa5d481d700 1 --2- 172.21.15.32:0/3712988990 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa5d00d13d0 0x7fa5d00cddd0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:14.725 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.719+0000 7fa5d481d700 1 --2- 172.21.15.32:0/3712988990 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa5d015d490 0x7fa5d00b8bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:14.725 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.719+0000 7fa5d481d700 1 -- 172.21.15.32:0/3712988990 >> 172.21.15.32:0/3712988990 conn(0x7fa5d006ab40 msgr2=0x7fa5d006af20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:10:14.725 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.723+0000 7fa5d481d700 1 -- 172.21.15.32:0/3712988990 shutdown_connections 2023-10-08T06:10:14.725 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.723+0000 7fa5d481d700 1 -- 172.21.15.32:0/3712988990 wait complete. 2023-10-08T06:10:14.727 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.723+0000 7fa5d481d700 1 Processor -- start 2023-10-08T06:10:14.727 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.723+0000 7fa5d481d700 1 -- start start 2023-10-08T06:10:14.727 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.723+0000 7fa5d481d700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa5d00ce310 0x7fa5d0150400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:14.727 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.723+0000 7fa5d481d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa5d00d13d0 0x7fa5d0155240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:14.728 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.723+0000 7fa5d481d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa5d015d490 0x7fa5d015b490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:14.728 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.723+0000 7fa5d481d700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5d0154250 con 0x7fa5d00ce310 2023-10-08T06:10:14.728 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.723+0000 7fa5d481d700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5d0154530 con 0x7fa5d00d13d0 2023-10-08T06:10:14.728 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.723+0000 7fa5d481d700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5d0154810 con 0x7fa5d015d490 2023-10-08T06:10:14.728 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.723+0000 7fa5ced9d700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa5d00ce310 0x7fa5d0150400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:14.728 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.723+0000 7fa5ced9d700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa5d00ce310 0x7fa5d0150400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:46778/0 (socket says 172.21.15.32:46778) 2023-10-08T06:10:14.728 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.723+0000 7fa5ced9d700 1 -- 172.21.15.32:0/108917000 learned_addr learned my addr 172.21.15.32:0/108917000 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:10:14.728 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.723+0000 7fa5ce59c700 1 --2- 172.21.15.32:0/108917000 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa5d00d13d0 0x7fa5d0155240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:14.728 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.723+0000 7fa5cf59e700 1 --2- 172.21.15.32:0/108917000 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa5d015d490 0x7fa5d015b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:14.728 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.723+0000 7fa5ce59c700 1 -- 172.21.15.32:0/108917000 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa5d015d490 msgr2=0x7fa5d015b490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:14.728 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.723+0000 7fa5ce59c700 1 --2- 172.21.15.32:0/108917000 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa5d015d490 0x7fa5d015b490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:14.728 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.723+0000 7fa5ce59c700 1 -- 172.21.15.32:0/108917000 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa5d00ce310 msgr2=0x7fa5d0150400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:14.729 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.723+0000 7fa5ce59c700 1 --2- 172.21.15.32:0/108917000 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa5d00ce310 0x7fa5d0150400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:14.729 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.723+0000 7fa5ce59c700 1 -- 172.21.15.32:0/108917000 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5c4009570 con 0x7fa5d00d13d0 2023-10-08T06:10:14.729 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.723+0000 7fa5ced9d700 1 --2- 172.21.15.32:0/108917000 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa5d00ce310 0x7fa5d0150400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T06:10:14.729 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.723+0000 7fa5ce59c700 1 --2- 172.21.15.32:0/108917000 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa5d00d13d0 0x7fa5d0155240 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fa5c4016000 tx=0x7fa5c4004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:14.730 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.727+0000 7fa5b77fe700 1 -- 172.21.15.32:0/108917000 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5c4004510 con 0x7fa5d00d13d0 2023-10-08T06:10:14.730 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.727+0000 7fa5b77fe700 1 -- 172.21.15.32:0/108917000 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5c40036c0 con 0x7fa5d00d13d0 2023-10-08T06:10:14.730 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.727+0000 7fa5d481d700 1 -- 172.21.15.32:0/108917000 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5d0154af0 con 0x7fa5d00d13d0 2023-10-08T06:10:14.730 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.727+0000 7fa5b77fe700 1 -- 172.21.15.32:0/108917000 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5c4003a70 con 0x7fa5d00d13d0 2023-10-08T06:10:14.730 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.727+0000 7fa5d481d700 1 -- 172.21.15.32:0/108917000 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5d0153e70 con 0x7fa5d00d13d0 2023-10-08T06:10:14.730 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.727+0000 7fa5d481d700 1 -- 172.21.15.32:0/108917000 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5d0073f00 con 0x7fa5d00d13d0 2023-10-08T06:10:14.731 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.727+0000 7fa5b77fe700 1 -- 172.21.15.32:0/108917000 <== mon.1 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fa5c4003bd0 con 0x7fa5d00d13d0 2023-10-08T06:10:14.732 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.731+0000 7fa5b77fe700 1 --2- 172.21.15.32:0/108917000 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fa5bc066510 0x7fa5bc0689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:14.732 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.731+0000 7fa5b77fe700 1 -- 172.21.15.32:0/108917000 <== mon.1 v2:172.21.15.40:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa5c4021030 con 0x7fa5d00d13d0 2023-10-08T06:10:14.732 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.731+0000 7fa5ced9d700 1 --2- 172.21.15.32:0/108917000 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fa5bc066510 0x7fa5bc0689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:14.732 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.731+0000 7fa5ced9d700 1 --2- 172.21.15.32:0/108917000 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fa5bc066510 0x7fa5bc0689d0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fa5c00112c0 tx=0x7fa5c0009240 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:14.740 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.739+0000 7fa5b77fe700 1 -- 172.21.15.32:0/108917000 <== mon.1 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fa5c4052c80 con 0x7fa5d00d13d0 2023-10-08T06:10:14.906 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.903+0000 7fa5d481d700 1 -- 172.21.15.32:0/108917000 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa5d0154670 con 0x7fa5d00d13d0 2023-10-08T06:10:14.907 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.903+0000 7fa5b77fe700 1 -- 172.21.15.32:0/108917000 <== mon.1 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa5d0154670 con 0x7fa5d00d13d0 2023-10-08T06:10:14.907 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 64 2023-10-08T06:10:14.909 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.907+0000 7fa5d481d700 1 -- 172.21.15.32:0/108917000 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fa5bc066510 msgr2=0x7fa5bc0689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:14.910 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.907+0000 7fa5d481d700 1 --2- 172.21.15.32:0/108917000 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fa5bc066510 0x7fa5bc0689d0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fa5c00112c0 tx=0x7fa5c0009240 comp rx=0 tx=0).stop 2023-10-08T06:10:14.910 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.907+0000 7fa5d481d700 1 -- 172.21.15.32:0/108917000 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa5d00d13d0 msgr2=0x7fa5d0155240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:14.910 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.907+0000 7fa5d481d700 1 --2- 172.21.15.32:0/108917000 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa5d00d13d0 0x7fa5d0155240 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fa5c4016000 tx=0x7fa5c4004770 comp rx=0 tx=0).stop 2023-10-08T06:10:14.910 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.907+0000 7fa5d481d700 1 -- 172.21.15.32:0/108917000 shutdown_connections 2023-10-08T06:10:14.910 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.907+0000 7fa5d481d700 1 --2- 172.21.15.32:0/108917000 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fa5bc066510 0x7fa5bc0689d0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:14.910 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.907+0000 7fa5d481d700 1 --2- 172.21.15.32:0/108917000 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa5d015d490 0x7fa5d015b490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:14.910 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.907+0000 7fa5d481d700 1 --2- 172.21.15.32:0/108917000 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa5d00d13d0 0x7fa5d0155240 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:14.910 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.907+0000 7fa5d481d700 1 --2- 172.21.15.32:0/108917000 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa5d00ce310 0x7fa5d0150400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:14.910 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.907+0000 7fa5d481d700 1 -- 172.21.15.32:0/108917000 >> 172.21.15.32:0/108917000 conn(0x7fa5d006ab40 msgr2=0x7fa5d00b74a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:10:14.911 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.907+0000 7fa5d481d700 1 -- 172.21.15.32:0/108917000 shutdown_connections 2023-10-08T06:10:14.911 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:14.907+0000 7fa5d481d700 1 -- 172.21.15.32:0/108917000 wait complete. 2023-10-08T06:10:14.922 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-08T06:10:15.036 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.035+0000 7f2d48ee0700 1 Processor -- start 2023-10-08T06:10:15.036 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.035+0000 7f2d48ee0700 1 -- start start 2023-10-08T06:10:15.038 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.035+0000 7f2d48ee0700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2d4415b980 0x7f2d4415f780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:15.038 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.035+0000 7f2d48ee0700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2d440719e0 0x7f2d440c9420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:15.038 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.035+0000 7f2d48ee0700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d4406fc20 con 0x7f2d440c9960 2023-10-08T06:10:15.038 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.035+0000 7f2d48ee0700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d44070430 con 0x7f2d440719e0 2023-10-08T06:10:15.038 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.035+0000 7f2d48ee0700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d4415ed70 con 0x7f2d4415b980 2023-10-08T06:10:15.038 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.035+0000 7f2d43fff700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f2d440c9960 0x7f2d4415bd60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:45884/0 (socket says 172.21.15.32:45884) 2023-10-08T06:10:15.039 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.035+0000 7f2d43fff700 1 -- 172.21.15.32:0/3279599602 learned_addr learned my addr 172.21.15.32:0/3279599602 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-08T06:10:15.039 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.035+0000 7f2d437fe700 1 --2- 172.21.15.32:0/3279599602 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2d4415b980 0x7f2d4415f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:15.039 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.035+0000 7f2d3affd700 1 --2- 172.21.15.32:0/3279599602 >> v2:172.21.15.40:3300/0 conn(0x7f2d440719e0 0x7f2d440c9420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:15.039 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.035+0000 7f2d42ffd700 1 -- 172.21.15.32:0/3279599602 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3765960093 0 0) 0x7f2d4406fc20 con 0x7f2d440c9960 2023-10-08T06:10:15.039 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.035+0000 7f2d42ffd700 1 -- 172.21.15.32:0/3279599602 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2d300035d0 con 0x7f2d440c9960 2023-10-08T06:10:15.039 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.035+0000 7f2d3affd700 1 -- 172.21.15.32:0/3279599602 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2d4415b980 msgr2=0x7f2d4415f780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:10:15.039 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.035+0000 7f2d3affd700 1 --2- 172.21.15.32:0/3279599602 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2d4415b980 0x7f2d4415f780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:15.039 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.035+0000 7f2d3affd700 1 -- 172.21.15.32:0/3279599602 >> v1:172.21.15.32:6789/0 conn(0x7f2d440c9960 legacy=0x7f2d4415bd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:15.040 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.035+0000 7f2d3affd700 1 -- 172.21.15.32:0/3279599602 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d4415fcc0 con 0x7f2d440719e0 2023-10-08T06:10:15.040 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.035+0000 7f2d437fe700 1 --2- 172.21.15.32:0/3279599602 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2d4415b980 0x7f2d4415f780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T06:10:15.040 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.035+0000 7f2d3affd700 1 --2- 172.21.15.32:0/3279599602 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2d440719e0 0x7f2d440c9420 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f2d2c009850 tx=0x7f2d2c009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=49bb611a32dbb1be server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:15.042 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.035+0000 7f2d42ffd700 1 -- 172.21.15.32:0/3279599602 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d2c011830 con 0x7f2d440719e0 2023-10-08T06:10:15.043 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.035+0000 7f2d42ffd700 1 -- 172.21.15.32:0/3279599602 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d2c011990 con 0x7f2d440719e0 2023-10-08T06:10:15.043 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.035+0000 7f2d42ffd700 1 -- 172.21.15.32:0/3279599602 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d2c011d40 con 0x7f2d440719e0 2023-10-08T06:10:15.043 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.035+0000 7f2d48ee0700 1 -- 172.21.15.32:0/3279599602 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2d440719e0 msgr2=0x7f2d440c9420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:15.043 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.035+0000 7f2d48ee0700 1 --2- 172.21.15.32:0/3279599602 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2d440719e0 0x7f2d440c9420 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f2d2c009850 tx=0x7f2d2c009b60 comp rx=0 tx=0).stop 2023-10-08T06:10:15.043 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.035+0000 7f2d48ee0700 1 -- 172.21.15.32:0/3279599602 shutdown_connections 2023-10-08T06:10:15.043 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.035+0000 7f2d48ee0700 1 --2- 172.21.15.32:0/3279599602 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2d440719e0 0x7f2d440c9420 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:15.043 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.035+0000 7f2d48ee0700 1 --2- 172.21.15.32:0/3279599602 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2d4415b980 0x7f2d4415f780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:15.044 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.035+0000 7f2d48ee0700 1 -- 172.21.15.32:0/3279599602 >> 172.21.15.32:0/3279599602 conn(0x7f2d440b0900 msgr2=0x7f2d440b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:10:15.044 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.035+0000 7f2d48ee0700 1 -- 172.21.15.32:0/3279599602 shutdown_connections 2023-10-08T06:10:15.044 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.035+0000 7f2d48ee0700 1 -- 172.21.15.32:0/3279599602 wait complete. 2023-10-08T06:10:15.044 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.039+0000 7f2d48ee0700 1 Processor -- start 2023-10-08T06:10:15.044 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.039+0000 7f2d48ee0700 1 -- start start 2023-10-08T06:10:15.044 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.039+0000 7f2d48ee0700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2d440719e0 0x7f2d441e4b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:15.044 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.039+0000 7f2d48ee0700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2d440c9960 0x7f2d44153ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:15.044 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.039+0000 7f2d48ee0700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2d4415b980 0x7f2d4415a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:15.045 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.039+0000 7f2d48ee0700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d440c5ea0 con 0x7f2d440719e0 2023-10-08T06:10:15.045 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.039+0000 7f2d48ee0700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d44154220 con 0x7f2d4415b980 2023-10-08T06:10:15.045 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.039+0000 7f2d48ee0700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d440c60f0 con 0x7f2d440c9960 2023-10-08T06:10:15.045 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.039+0000 7f2d437fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2d440719e0 0x7f2d441e4b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:15.045 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.039+0000 7f2d437fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2d440719e0 0x7f2d441e4b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:46788/0 (socket says 172.21.15.32:46788) 2023-10-08T06:10:15.045 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.039+0000 7f2d437fe700 1 -- 172.21.15.32:0/3544798622 learned_addr learned my addr 172.21.15.32:0/3544798622 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:10:15.045 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.039+0000 7f2d43fff700 1 --2- 172.21.15.32:0/3544798622 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2d4415b980 0x7f2d4415a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:15.045 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.039+0000 7f2d3affd700 1 --2- 172.21.15.32:0/3544798622 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2d440c9960 0x7f2d44153ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:15.046 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.039+0000 7f2d437fe700 1 -- 172.21.15.32:0/3544798622 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2d440c9960 msgr2=0x7f2d44153ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:15.046 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.039+0000 7f2d437fe700 1 --2- 172.21.15.32:0/3544798622 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2d440c9960 0x7f2d44153ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:15.046 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.039+0000 7f2d437fe700 1 -- 172.21.15.32:0/3544798622 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2d4415b980 msgr2=0x7f2d4415a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:15.046 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.039+0000 7f2d437fe700 1 --2- 172.21.15.32:0/3544798622 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2d4415b980 0x7f2d4415a250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:15.046 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.039+0000 7f2d437fe700 1 -- 172.21.15.32:0/3544798622 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d340094b0 con 0x7f2d440719e0 2023-10-08T06:10:15.046 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.039+0000 7f2d437fe700 1 --2- 172.21.15.32:0/3544798622 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2d440719e0 0x7f2d441e4b60 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f2d3400ebe0 tx=0x7f2d3400eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:15.047 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.039+0000 7f2d40ff9700 1 -- 172.21.15.32:0/3544798622 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d34009770 con 0x7f2d440719e0 2023-10-08T06:10:15.048 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.039+0000 7f2d40ff9700 1 -- 172.21.15.32:0/3544798622 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d3400c850 con 0x7f2d440719e0 2023-10-08T06:10:15.048 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.039+0000 7f2d48ee0700 1 -- 172.21.15.32:0/3544798622 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d2c0094b0 con 0x7f2d440719e0 2023-10-08T06:10:15.048 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.039+0000 7f2d40ff9700 1 -- 172.21.15.32:0/3544798622 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d3400cbe0 con 0x7f2d440719e0 2023-10-08T06:10:15.048 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.039+0000 7f2d48ee0700 1 -- 172.21.15.32:0/3544798622 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d440c66b0 con 0x7f2d440719e0 2023-10-08T06:10:15.048 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.043+0000 7f2d48ee0700 1 -- 172.21.15.32:0/3544798622 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d44073f00 con 0x7f2d440719e0 2023-10-08T06:10:15.048 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.043+0000 7f2d40ff9700 1 -- 172.21.15.32:0/3544798622 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f2d3400cd40 con 0x7f2d440719e0 2023-10-08T06:10:15.048 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.043+0000 7f2d40ff9700 1 --2- 172.21.15.32:0/3544798622 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f2d24066510 0x7f2d240689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:15.048 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.043+0000 7f2d40ff9700 1 -- 172.21.15.32:0/3544798622 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2d34083dc0 con 0x7f2d440719e0 2023-10-08T06:10:15.048 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.043+0000 7f2d3affd700 1 --2- 172.21.15.32:0/3544798622 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f2d24066510 0x7f2d240689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:15.048 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.043+0000 7f2d3affd700 1 --2- 172.21.15.32:0/3544798622 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f2d24066510 0x7f2d240689d0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f2d2c0090b0 tx=0x7f2d2c008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:15.053 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.051+0000 7f2d40ff9700 1 -- 172.21.15.32:0/3544798622 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f2d340512d0 con 0x7f2d440719e0 2023-10-08T06:10:15.229 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.227+0000 7f2d48ee0700 1 -- 172.21.15.32:0/3544798622 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f2d440cfc80 con 0x7f2d440719e0 2023-10-08T06:10:15.230 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.227+0000 7f2d40ff9700 1 -- 172.21.15.32:0/3544798622 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v22) v1 ==== 80+0+0 (secure 0 0 0) 0x7f2d340548f0 con 0x7f2d440719e0 2023-10-08T06:10:15.232 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.231+0000 7f2d48ee0700 1 -- 172.21.15.32:0/3544798622 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f2d24066510 msgr2=0x7f2d240689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:15.232 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.231+0000 7f2d48ee0700 1 --2- 172.21.15.32:0/3544798622 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f2d24066510 0x7f2d240689d0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f2d2c0090b0 tx=0x7f2d2c008030 comp rx=0 tx=0).stop 2023-10-08T06:10:15.233 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.231+0000 7f2d48ee0700 1 -- 172.21.15.32:0/3544798622 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2d440719e0 msgr2=0x7f2d441e4b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:15.233 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.231+0000 7f2d48ee0700 1 --2- 172.21.15.32:0/3544798622 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2d440719e0 0x7f2d441e4b60 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f2d3400ebe0 tx=0x7f2d3400eef0 comp rx=0 tx=0).stop 2023-10-08T06:10:15.233 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.231+0000 7f2d48ee0700 1 -- 172.21.15.32:0/3544798622 shutdown_connections 2023-10-08T06:10:15.233 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.231+0000 7f2d48ee0700 1 --2- 172.21.15.32:0/3544798622 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f2d24066510 0x7f2d240689d0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:15.233 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.231+0000 7f2d48ee0700 1 --2- 172.21.15.32:0/3544798622 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2d4415b980 0x7f2d4415a250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:15.233 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.231+0000 7f2d48ee0700 1 --2- 172.21.15.32:0/3544798622 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2d440c9960 0x7f2d44153ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:15.233 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.231+0000 7f2d48ee0700 1 --2- 172.21.15.32:0/3544798622 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2d440719e0 0x7f2d441e4b60 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:15.234 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.231+0000 7f2d48ee0700 1 -- 172.21.15.32:0/3544798622 >> 172.21.15.32:0/3544798622 conn(0x7f2d440b0900 msgr2=0x7f2d440af8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:10:15.234 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.231+0000 7f2d48ee0700 1 -- 172.21.15.32:0/3544798622 shutdown_connections 2023-10-08T06:10:15.234 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.231+0000 7f2d48ee0700 1 -- 172.21.15.32:0/3544798622 wait complete. 2023-10-08T06:10:15.234 INFO:teuthology.orchestra.run.smithi032.stderr:listed 0 entries 2023-10-08T06:10:15.245 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi040.front.sepia.ceph.com... 2023-10-08T06:10:15.245 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T06:10:15.245 DEBUG:teuthology.orchestra.run.smithi040:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2023-10-08T06:10:15.274 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T06:10:15.274 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi040.front.sepia.ceph.com 2023-10-08T06:10:15.274 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T06:10:15.275 DEBUG:teuthology.orchestra.run.smithi040:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-08T06:10:15.329 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2023-10-08T06:10:15.329 DEBUG:teuthology.orchestra.run.smithi032:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-08T06:10:15.336 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2023-10-08T06:10:15.337 DEBUG:teuthology.orchestra.run.smithi032:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-08T06:10:15.386 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T06:10:15.507 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.503+0000 7f994eed1700 1 Processor -- start 2023-10-08T06:10:15.507 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.503+0000 7f994eed1700 1 -- start start 2023-10-08T06:10:15.508 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.507+0000 7f994eed1700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f99480ce4e0 0x7f9948167e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:15.508 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.507+0000 7f994eed1700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99480b9000 con 0x7f99480b8bc0 2023-10-08T06:10:15.509 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.507+0000 7f994eed1700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99480d1bb0 con 0x7f994815d490 2023-10-08T06:10:15.509 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.507+0000 7f994eed1700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99480d1e90 con 0x7f99480ce4e0 2023-10-08T06:10:15.509 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.507+0000 7f994d6ce700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f99480b8bc0 0x7f99480cddd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:45898/0 (socket says 172.21.15.32:45898) 2023-10-08T06:10:15.509 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.507+0000 7f994d6ce700 1 -- 172.21.15.32:0/3541099463 learned_addr learned my addr 172.21.15.32:0/3541099463 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-08T06:10:15.509 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.507+0000 7f994e6d0700 1 --2- 172.21.15.32:0/3541099463 >> v2:172.21.15.40:3300/0 conn(0x7f99480ce4e0 0x7f9948167e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:15.509 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.507+0000 7f994cecd700 1 -- 172.21.15.32:0/3541099463 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 54109409 0 0) 0x7f993c001490 con 0x7f99480b8bc0 2023-10-08T06:10:15.509 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.507+0000 7f994cecd700 1 -- 172.21.15.32:0/3541099463 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f99340035d0 con 0x7f99480b8bc0 2023-10-08T06:10:15.511 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.507+0000 7f994cecd700 1 -- 172.21.15.32:0/3541099463 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 520965022 0 0) 0x7f99340035d0 con 0x7f99480b8bc0 2023-10-08T06:10:15.512 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.507+0000 7f994cecd700 1 -- 172.21.15.32:0/3541099463 >> v2:172.21.15.40:3300/0 conn(0x7f99480ce4e0 msgr2=0x7f9948167e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:10:15.512 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.507+0000 7f994cecd700 1 --2- 172.21.15.32:0/3541099463 >> v2:172.21.15.40:3300/0 conn(0x7f99480ce4e0 0x7f9948167e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:15.512 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.507+0000 7f994cecd700 1 -- 172.21.15.32:0/3541099463 >> v1:172.21.15.40:6789/0 conn(0x7f994815d490 legacy=0x7f99480d13d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:15.512 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.507+0000 7f994cecd700 1 -- 172.21.15.32:0/3541099463 --> v1:172.21.15.32:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99480d2170 con 0x7f99480b8bc0 2023-10-08T06:10:15.512 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.507+0000 7f994cecd700 1 -- 172.21.15.32:0/3541099463 <== mon.0 v1:172.21.15.32:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2364763317 0 0) 0x7f993c001b80 con 0x7f99480b8bc0 2023-10-08T06:10:15.512 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.507+0000 7f994e6d0700 1 --2- 172.21.15.32:0/3541099463 >> v2:172.21.15.40:3300/0 conn(0x7f99480ce4e0 0x7f9948167e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T06:10:15.512 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.507+0000 7f994cecd700 1 -- 172.21.15.32:0/3541099463 >> v1:172.21.15.32:6789/0 conn(0x7f99480b8bc0 legacy=0x7f99480cddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:15.512 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.507+0000 7f994cecd700 1 --2- 172.21.15.32:0/3541099463 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9934003a20 0x7f9934003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:15.512 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.507+0000 7f994cecd700 1 --2- 172.21.15.32:0/3541099463 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9934004870 0x7f9934004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:15.512 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.507+0000 7f994cecd700 1 --2- 172.21.15.32:0/3541099463 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9934005230 0x7f993400ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:15.512 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.507+0000 7f994cecd700 1 -- 172.21.15.32:0/3541099463 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99480d1e90 con 0x7f9934005230 2023-10-08T06:10:15.513 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.507+0000 7f994cecd700 1 -- 172.21.15.32:0/3541099463 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f993400c0e0 con 0x7f9934004870 2023-10-08T06:10:15.513 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.507+0000 7f994cecd700 1 -- 172.21.15.32:0/3541099463 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f993400c2a0 con 0x7f9934003a20 2023-10-08T06:10:15.513 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.507+0000 7f994e6d0700 1 --2- 172.21.15.32:0/3541099463 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9934005230 0x7f993400ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:15.513 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.507+0000 7f994decf700 1 --2- 172.21.15.32:0/3541099463 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9934003a20 0x7f9934003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:15.513 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.507+0000 7f994d6ce700 1 --2- 172.21.15.32:0/3541099463 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9934004870 0x7f9934004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:15.513 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.507+0000 7f994e6d0700 1 -- 172.21.15.32:0/3541099463 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9934003a20 msgr2=0x7f9934003e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:10:15.513 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.507+0000 7f994e6d0700 1 --2- 172.21.15.32:0/3541099463 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9934003a20 0x7f9934003e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:15.513 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.507+0000 7f994e6d0700 1 -- 172.21.15.32:0/3541099463 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9934004870 msgr2=0x7f9934004cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:10:15.513 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.507+0000 7f994e6d0700 1 --2- 172.21.15.32:0/3541099463 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9934004870 0x7f9934004cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:15.513 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.507+0000 7f994e6d0700 1 -- 172.21.15.32:0/3541099463 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99340035d0 con 0x7f9934005230 2023-10-08T06:10:15.513 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.507+0000 7f994e6d0700 1 -- 172.21.15.32:0/3541099463 reap_dead start 2023-10-08T06:10:15.514 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.507+0000 7f994e6d0700 1 --2- 172.21.15.32:0/3541099463 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9934005230 0x7f993400ba30 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f9940009d10 tx=0x7f99340058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f26e1665e94c764b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:15.514 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.507+0000 7f994cecd700 1 -- 172.21.15.32:0/3541099463 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9940009e60 con 0x7f9934005230 2023-10-08T06:10:15.514 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.507+0000 7f994cecd700 1 -- 172.21.15.32:0/3541099463 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f994000e9a0 con 0x7f9934005230 2023-10-08T06:10:15.514 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.507+0000 7f994cecd700 1 -- 172.21.15.32:0/3541099463 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f994000ed30 con 0x7f9934005230 2023-10-08T06:10:15.514 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.507+0000 7f994eed1700 1 -- 172.21.15.32:0/3541099463 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9934005230 msgr2=0x7f993400ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:15.514 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.507+0000 7f994eed1700 1 --2- 172.21.15.32:0/3541099463 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9934005230 0x7f993400ba30 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f9940009d10 tx=0x7f99340058a0 comp rx=0 tx=0).stop 2023-10-08T06:10:15.514 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.507+0000 7f994eed1700 1 -- 172.21.15.32:0/3541099463 shutdown_connections 2023-10-08T06:10:15.514 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.507+0000 7f994eed1700 1 --2- 172.21.15.32:0/3541099463 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9934005230 0x7f993400ba30 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:15.514 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.507+0000 7f994eed1700 1 -- 172.21.15.32:0/3541099463 >> 172.21.15.32:0/3541099463 conn(0x7f994806ab40 msgr2=0x7f994806af20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:10:15.514 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.507+0000 7f994eed1700 1 -- 172.21.15.32:0/3541099463 shutdown_connections 2023-10-08T06:10:15.515 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.507+0000 7f994eed1700 1 -- 172.21.15.32:0/3541099463 wait complete. 2023-10-08T06:10:15.516 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.511+0000 7f994eed1700 1 Processor -- start 2023-10-08T06:10:15.516 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.511+0000 7f994eed1700 1 -- start start 2023-10-08T06:10:15.516 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.511+0000 7f994eed1700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9934005230 0x7f99481f24c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:15.517 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.511+0000 7f994eed1700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f99480ccd70 0x7f994815fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:15.517 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.511+0000 7f994eed1700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f99480cbb30 0x7f9948160240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:15.517 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.511+0000 7f994eed1700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99481596c0 con 0x7f99480ccd70 2023-10-08T06:10:15.517 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.511+0000 7f994eed1700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99480cc0f0 con 0x7f9934005230 2023-10-08T06:10:15.517 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.511+0000 7f994eed1700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9948159070 con 0x7f99480cbb30 2023-10-08T06:10:15.517 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.511+0000 7f994d6ce700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f99480ccd70 0x7f994815fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:15.517 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.511+0000 7f994decf700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9934005230 0x7f99481f24c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:15.517 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.511+0000 7f994d6ce700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f99480ccd70 0x7f994815fd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:46800/0 (socket says 172.21.15.32:46800) 2023-10-08T06:10:15.517 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.511+0000 7f994d6ce700 1 -- 172.21.15.32:0/854608679 learned_addr learned my addr 172.21.15.32:0/854608679 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:10:15.517 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.515+0000 7f994e6d0700 1 --2- 172.21.15.32:0/854608679 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f99480cbb30 0x7f9948160240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:15.517 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.515+0000 7f994d6ce700 1 -- 172.21.15.32:0/854608679 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f99480cbb30 msgr2=0x7f9948160240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:15.518 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.515+0000 7f994d6ce700 1 --2- 172.21.15.32:0/854608679 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f99480cbb30 0x7f9948160240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:15.518 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.515+0000 7f994d6ce700 1 -- 172.21.15.32:0/854608679 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9934005230 msgr2=0x7f99481f24c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:15.518 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.515+0000 7f994d6ce700 1 --2- 172.21.15.32:0/854608679 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9934005230 0x7f99481f24c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:15.518 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.515+0000 7f994d6ce700 1 -- 172.21.15.32:0/854608679 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9948159350 con 0x7f99480ccd70 2023-10-08T06:10:15.518 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.515+0000 7f994decf700 1 --2- 172.21.15.32:0/854608679 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9934005230 0x7f99481f24c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T06:10:15.518 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.515+0000 7f994d6ce700 1 --2- 172.21.15.32:0/854608679 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f99480ccd70 0x7f994815fd00 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f993c00e440 tx=0x7f993c00e470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:15.519 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.515+0000 7f993a7fc700 1 -- 172.21.15.32:0/854608679 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f993c00ebe0 con 0x7f99480ccd70 2023-10-08T06:10:15.519 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.515+0000 7f993a7fc700 1 -- 172.21.15.32:0/854608679 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f993c00ed80 con 0x7f99480ccd70 2023-10-08T06:10:15.519 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.515+0000 7f994eed1700 1 -- 172.21.15.32:0/854608679 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f994815be20 con 0x7f99480ccd70 2023-10-08T06:10:15.519 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.515+0000 7f993a7fc700 1 -- 172.21.15.32:0/854608679 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f993c013660 con 0x7f99480ccd70 2023-10-08T06:10:15.519 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.515+0000 7f994eed1700 1 -- 172.21.15.32:0/854608679 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99481f6010 con 0x7f99480ccd70 2023-10-08T06:10:15.519 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.515+0000 7f994eed1700 1 -- 172.21.15.32:0/854608679 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99481594e0 con 0x7f99480ccd70 2023-10-08T06:10:15.520 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.519+0000 7f993a7fc700 1 -- 172.21.15.32:0/854608679 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f993c0137c0 con 0x7f99480ccd70 2023-10-08T06:10:15.520 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.519+0000 7f993a7fc700 1 --2- 172.21.15.32:0/854608679 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f992c066510 0x7f992c0689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:15.520 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.519+0000 7f993a7fc700 1 -- 172.21.15.32:0/854608679 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f993c0841d0 con 0x7f99480ccd70 2023-10-08T06:10:15.521 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.519+0000 7f994decf700 1 --2- 172.21.15.32:0/854608679 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f992c066510 0x7f992c0689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:15.521 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.519+0000 7f994decf700 1 --2- 172.21.15.32:0/854608679 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f992c066510 0x7f992c0689d0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f9944000c00 tx=0x7f9944009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:15.529 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.527+0000 7f993a7fc700 1 -- 172.21.15.32:0/854608679 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f993c0516e0 con 0x7f99480ccd70 2023-10-08T06:10:15.694 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.691+0000 7f994eed1700 1 -- 172.21.15.32:0/854608679 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f99480b9000 con 0x7f99480ccd70 2023-10-08T06:10:15.696 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.695+0000 7f993a7fc700 1 -- 172.21.15.32:0/854608679 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16445 (secure 0 0 0) 0x7f99480b9000 con 0x7f99480ccd70 2023-10-08T06:10:15.697 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:10:15.697 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":22,"fsid":"ac672d87-96ae-41e0-9314-623ba2cdbbba","created":"2023-10-08T06:09:11.175626+0000","modified":"2023-10-08T06:09:38.153256+0000","last_up_change":"2023-10-08T06:09:22.744643+0000","last_in_change":"2023-10-08T06:09:14.131580+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T06:09:23.307843+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T06:09:34.295012+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T06:09:35.515590+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"43433f0c-9592-4874-92d7-10f8f4acf07f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":587888964},{"type":"v1","addr":"172.21.15.32:6801","nonce":587888964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":587888964},{"type":"v1","addr":"172.21.15.32:6803","nonce":587888964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":587888964},{"type":"v1","addr":"172.21.15.32:6810","nonce":587888964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6805","nonce":587888964},{"type":"v1","addr":"172.21.15.32:6807","nonce":587888964}]},"public_addr":"172.21.15.32:6801/587888964","cluster_addr":"172.21.15.32:6803/587888964","heartbeat_back_addr":"172.21.15.32:6810/587888964","heartbeat_front_addr":"172.21.15.32:6807/587888964","state":["exists","up"]},{"osd":1,"uuid":"2ecb1008-b987-4ce7-b646-6cded55fc8d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":990576767},{"type":"v1","addr":"172.21.15.32:6817","nonce":990576767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":990576767},{"type":"v1","addr":"172.21.15.32:6819","nonce":990576767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":990576767},{"type":"v1","addr":"172.21.15.32:6823","nonce":990576767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":990576767},{"type":"v1","addr":"172.21.15.32:6821","nonce":990576767}]},"public_addr":"172.21.15.32:6817/990576767","cluster_addr":"172.21.15.32:6819/990576767","heartbeat_back_addr":"172.21.15.32:6823/990576767","heartbeat_front_addr":"172.21.15.32:6821/990576767","state":["exists","up"]},{"osd":2,"uuid":"1b131c94-c09b-4e80-8746-bf1b7bac362d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6824","nonce":1566874440},{"type":"v1","addr":"172.21.15.32:6825","nonce":1566874440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":1566874440},{"type":"v1","addr":"172.21.15.32:6827","nonce":1566874440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":1566874440},{"type":"v1","addr":"172.21.15.32:6831","nonce":1566874440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":1566874440},{"type":"v1","addr":"172.21.15.32:6829","nonce":1566874440}]},"public_addr":"172.21.15.32:6825/1566874440","cluster_addr":"172.21.15.32:6827/1566874440","heartbeat_back_addr":"172.21.15.32:6831/1566874440","heartbeat_front_addr":"172.21.15.32:6829/1566874440","state":["exists","up"]},{"osd":3,"uuid":"ad655af2-1f6f-4689-b21d-b07bbaeb68b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":3672614802},{"type":"v1","addr":"172.21.15.32:6806","nonce":3672614802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6809","nonce":3672614802},{"type":"v1","addr":"172.21.15.32:6811","nonce":3672614802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":3672614802},{"type":"v1","addr":"172.21.15.32:6815","nonce":3672614802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":3672614802},{"type":"v1","addr":"172.21.15.32:6813","nonce":3672614802}]},"public_addr":"172.21.15.32:6806/3672614802","cluster_addr":"172.21.15.32:6811/3672614802","heartbeat_back_addr":"172.21.15.32:6815/3672614802","heartbeat_front_addr":"172.21.15.32:6813/3672614802","state":["exists","up"]},{"osd":4,"uuid":"64a543a1-8c4f-458e-9aba-b35c1cd7dd03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":3369928244},{"type":"v1","addr":"172.21.15.40:6801","nonce":3369928244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":3369928244},{"type":"v1","addr":"172.21.15.40:6803","nonce":3369928244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":3369928244},{"type":"v1","addr":"172.21.15.40:6807","nonce":3369928244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":3369928244},{"type":"v1","addr":"172.21.15.40:6805","nonce":3369928244}]},"public_addr":"172.21.15.40:6801/3369928244","cluster_addr":"172.21.15.40:6803/3369928244","heartbeat_back_addr":"172.21.15.40:6807/3369928244","heartbeat_front_addr":"172.21.15.40:6805/3369928244","state":["exists","up"]},{"osd":5,"uuid":"0fef3e54-edb4-4678-878e-944663c51638","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":2395850297},{"type":"v1","addr":"172.21.15.40:6825","nonce":2395850297}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":2395850297},{"type":"v1","addr":"172.21.15.40:6827","nonce":2395850297}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":2395850297},{"type":"v1","addr":"172.21.15.40:6831","nonce":2395850297}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":2395850297},{"type":"v1","addr":"172.21.15.40:6829","nonce":2395850297}]},"public_addr":"172.21.15.40:6825/2395850297","cluster_addr":"172.21.15.40:6827/2395850297","heartbeat_back_addr":"172.21.15.40:6831/2395850297","heartbeat_front_addr":"172.21.15.40:6829/2395850297","state":["exists","up"]},{"osd":6,"uuid":"2eeb0472-6096-469d-9b2c-cab4bf41c31a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":4145283410},{"type":"v1","addr":"172.21.15.40:6809","nonce":4145283410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":4145283410},{"type":"v1","addr":"172.21.15.40:6811","nonce":4145283410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":4145283410},{"type":"v1","addr":"172.21.15.40:6815","nonce":4145283410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":4145283410},{"type":"v1","addr":"172.21.15.40:6813","nonce":4145283410}]},"public_addr":"172.21.15.40:6809/4145283410","cluster_addr":"172.21.15.40:6811/4145283410","heartbeat_back_addr":"172.21.15.40:6815/4145283410","heartbeat_front_addr":"172.21.15.40:6813/4145283410","state":["exists","up"]},{"osd":7,"uuid":"cf76e4c7-96a6-401f-a280-91aad4641940","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":2943297416},{"type":"v1","addr":"172.21.15.40:6817","nonce":2943297416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":2943297416},{"type":"v1","addr":"172.21.15.40:6819","nonce":2943297416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":2943297416},{"type":"v1","addr":"172.21.15.40:6823","nonce":2943297416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":2943297416},{"type":"v1","addr":"172.21.15.40:6821","nonce":2943297416}]},"public_addr":"172.21.15.40:6817/2943297416","cluster_addr":"172.21.15.40:6819/2943297416","heartbeat_back_addr":"172.21.15.40:6823/2943297416","heartbeat_front_addr":"172.21.15.40:6821/2943297416","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.411475+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.628841+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.599055+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.166100+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.384135+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.488403+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.307648+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.363541+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T06:10:15.699 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.695+0000 7f994eed1700 1 -- 172.21.15.32:0/854608679 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f992c066510 msgr2=0x7f992c0689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:15.699 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.695+0000 7f994eed1700 1 --2- 172.21.15.32:0/854608679 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f992c066510 0x7f992c0689d0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f9944000c00 tx=0x7f9944009040 comp rx=0 tx=0).stop 2023-10-08T06:10:15.699 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.695+0000 7f994eed1700 1 -- 172.21.15.32:0/854608679 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f99480ccd70 msgr2=0x7f994815fd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:15.699 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.695+0000 7f994eed1700 1 --2- 172.21.15.32:0/854608679 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f99480ccd70 0x7f994815fd00 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f993c00e440 tx=0x7f993c00e470 comp rx=0 tx=0).stop 2023-10-08T06:10:15.699 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.695+0000 7f994eed1700 1 -- 172.21.15.32:0/854608679 shutdown_connections 2023-10-08T06:10:15.699 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.695+0000 7f994eed1700 1 --2- 172.21.15.32:0/854608679 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f992c066510 0x7f992c0689d0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:15.699 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.695+0000 7f994eed1700 1 --2- 172.21.15.32:0/854608679 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f99480ccd70 0x7f994815fd00 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:15.700 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.695+0000 7f994eed1700 1 --2- 172.21.15.32:0/854608679 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f99480cbb30 0x7f9948160240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:15.700 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.695+0000 7f994eed1700 1 --2- 172.21.15.32:0/854608679 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9934005230 0x7f99481f24c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:15.700 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.695+0000 7f994eed1700 1 -- 172.21.15.32:0/854608679 >> 172.21.15.32:0/854608679 conn(0x7f994806ab40 msgr2=0x7f994815c500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:10:15.700 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.695+0000 7f994eed1700 1 -- 172.21.15.32:0/854608679 shutdown_connections 2023-10-08T06:10:15.700 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.695+0000 7f994eed1700 1 -- 172.21.15.32:0/854608679 wait complete. 2023-10-08T06:10:15.712 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T06:09:23.307843+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-08T06:09:34.295012+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-08T06:09:35.515590+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-08T06:10:15.712 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T06:10:15.836 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.835+0000 7f8daa600700 1 Processor -- start 2023-10-08T06:10:15.836 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.835+0000 7f8daa600700 1 -- start start 2023-10-08T06:10:15.839 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.835+0000 7f8daa600700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8da40b1800 0x7f8da40b1c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:15.839 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.835+0000 7f8daa600700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8da415b1b0 con 0x7f8da4071950 2023-10-08T06:10:15.839 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.835+0000 7f8daa600700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8da415b490 con 0x7f8da4071570 2023-10-08T06:10:15.840 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.835+0000 7f8daa600700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8da415b770 con 0x7f8da40b1800 2023-10-08T06:10:15.840 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.835+0000 7f8da8dfd700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f8da4071950 0x7f8da415a780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:45910/0 (socket says 172.21.15.32:45910) 2023-10-08T06:10:15.840 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.835+0000 7f8da8dfd700 1 -- 172.21.15.32:0/1254090935 learned_addr learned my addr 172.21.15.32:0/1254090935 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-08T06:10:15.840 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.835+0000 7f8da9dff700 1 --2- 172.21.15.32:0/1254090935 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8da40b1800 0x7f8da40b1c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:15.840 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.835+0000 7f8d9bfff700 1 -- 172.21.15.32:0/1254090935 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3249131232 0 0) 0x7f8da415b1b0 con 0x7f8da4071950 2023-10-08T06:10:15.840 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.835+0000 7f8d9bfff700 1 -- 172.21.15.32:0/1254090935 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8d900035d0 con 0x7f8da4071950 2023-10-08T06:10:15.840 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.835+0000 7f8d9bfff700 1 -- 172.21.15.32:0/1254090935 <== mon.1 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4151641490 0 0) 0x7f8da415b490 con 0x7f8da4071570 2023-10-08T06:10:15.840 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.835+0000 7f8d9bfff700 1 -- 172.21.15.32:0/1254090935 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8da415b1b0 con 0x7f8da4071570 2023-10-08T06:10:15.840 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.835+0000 7f8da9dff700 1 -- 172.21.15.32:0/1254090935 >> v1:172.21.15.40:6789/0 conn(0x7f8da4071570 legacy=0x7f8da415e6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:15.840 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.835+0000 7f8da9dff700 1 -- 172.21.15.32:0/1254090935 >> v1:172.21.15.32:6789/0 conn(0x7f8da4071950 legacy=0x7f8da415a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:15.841 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.835+0000 7f8da9dff700 1 -- 172.21.15.32:0/1254090935 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8da415def0 con 0x7f8da40b1800 2023-10-08T06:10:15.842 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.839+0000 7f8da9dff700 1 --2- 172.21.15.32:0/1254090935 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8da40b1800 0x7f8da40b1c70 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f8d9c009dc0 tx=0x7f8d9c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6547b37c7794479f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:15.842 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.839+0000 7f8d9bfff700 1 -- 172.21.15.32:0/1254090935 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d9c00e070 con 0x7f8da40b1800 2023-10-08T06:10:15.842 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.839+0000 7f8d9bfff700 1 -- 172.21.15.32:0/1254090935 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d9c00bb20 con 0x7f8da40b1800 2023-10-08T06:10:15.842 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.839+0000 7f8d9bfff700 1 -- 172.21.15.32:0/1254090935 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d9c00be90 con 0x7f8da40b1800 2023-10-08T06:10:15.842 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.839+0000 7f8daa600700 1 -- 172.21.15.32:0/1254090935 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8da40b1800 msgr2=0x7f8da40b1c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:15.842 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.839+0000 7f8daa600700 1 --2- 172.21.15.32:0/1254090935 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8da40b1800 0x7f8da40b1c70 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f8d9c009dc0 tx=0x7f8d9c00b330 comp rx=0 tx=0).stop 2023-10-08T06:10:15.843 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.839+0000 7f8daa600700 1 -- 172.21.15.32:0/1254090935 shutdown_connections 2023-10-08T06:10:15.843 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.839+0000 7f8daa600700 1 --2- 172.21.15.32:0/1254090935 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8da40b1800 0x7f8da40b1c70 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:15.843 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.839+0000 7f8daa600700 1 -- 172.21.15.32:0/1254090935 >> 172.21.15.32:0/1254090935 conn(0x7f8da40cc800 msgr2=0x7f8da40ccbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:10:15.843 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.839+0000 7f8daa600700 1 -- 172.21.15.32:0/1254090935 shutdown_connections 2023-10-08T06:10:15.843 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.839+0000 7f8daa600700 1 -- 172.21.15.32:0/1254090935 wait complete. 2023-10-08T06:10:15.843 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.839+0000 7f8daa600700 1 Processor -- start 2023-10-08T06:10:15.844 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.839+0000 7f8daa600700 1 -- start start 2023-10-08T06:10:15.846 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.843+0000 7f8daa600700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8da4071570 0x7f8da415b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:15.846 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.843+0000 7f8daa600700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8da4071950 0x7f8da41f6730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:15.846 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.843+0000 7f8daa600700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8da40b1800 0x7f8da4159430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:15.846 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.843+0000 7f8daa600700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8da41f6c70 con 0x7f8da4071570 2023-10-08T06:10:15.847 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.843+0000 7f8daa600700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8da41f2840 con 0x7f8da40b1800 2023-10-08T06:10:15.847 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.843+0000 7f8daa600700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8da41f2ae0 con 0x7f8da4071950 2023-10-08T06:10:15.847 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.843+0000 7f8da95fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8da4071570 0x7f8da415b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:15.847 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.843+0000 7f8da95fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8da4071570 0x7f8da415b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:46812/0 (socket says 172.21.15.32:46812) 2023-10-08T06:10:15.847 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.843+0000 7f8da95fe700 1 -- 172.21.15.32:0/1531817742 learned_addr learned my addr 172.21.15.32:0/1531817742 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:10:15.847 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.843+0000 7f8da9dff700 1 --2- 172.21.15.32:0/1531817742 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8da40b1800 0x7f8da4159430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:15.847 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.843+0000 7f8da8dfd700 1 --2- 172.21.15.32:0/1531817742 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8da4071950 0x7f8da41f6730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:15.847 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.843+0000 7f8da95fe700 1 -- 172.21.15.32:0/1531817742 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8da4071950 msgr2=0x7f8da41f6730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:15.847 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.843+0000 7f8da95fe700 1 --2- 172.21.15.32:0/1531817742 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8da4071950 0x7f8da41f6730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:15.847 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.843+0000 7f8da95fe700 1 -- 172.21.15.32:0/1531817742 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8da40b1800 msgr2=0x7f8da4159430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:15.848 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.843+0000 7f8da95fe700 1 --2- 172.21.15.32:0/1531817742 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8da40b1800 0x7f8da4159430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:15.848 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.843+0000 7f8da95fe700 1 -- 172.21.15.32:0/1531817742 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d9c009a70 con 0x7f8da4071570 2023-10-08T06:10:15.848 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.843+0000 7f8da95fe700 1 --2- 172.21.15.32:0/1531817742 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8da4071570 0x7f8da415b8b0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f8da000c730 tx=0x7f8da000ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:15.848 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.843+0000 7f8d99ffb700 1 -- 172.21.15.32:0/1531817742 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8da00052d0 con 0x7f8da4071570 2023-10-08T06:10:15.848 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.843+0000 7f8d99ffb700 1 -- 172.21.15.32:0/1531817742 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8da0005450 con 0x7f8da4071570 2023-10-08T06:10:15.848 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.843+0000 7f8daa600700 1 -- 172.21.15.32:0/1531817742 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8da41f2dc0 con 0x7f8da4071570 2023-10-08T06:10:15.848 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.843+0000 7f8d99ffb700 1 -- 172.21.15.32:0/1531817742 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8da00038e0 con 0x7f8da4071570 2023-10-08T06:10:15.848 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.843+0000 7f8daa600700 1 -- 172.21.15.32:0/1531817742 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8da415bed0 con 0x7f8da4071570 2023-10-08T06:10:15.849 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.847+0000 7f8daa600700 1 -- 172.21.15.32:0/1531817742 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8da40686a0 con 0x7f8da4071570 2023-10-08T06:10:15.849 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.847+0000 7f8d99ffb700 1 -- 172.21.15.32:0/1531817742 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f8da0003a40 con 0x7f8da4071570 2023-10-08T06:10:15.849 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.847+0000 7f8d99ffb700 1 --2- 172.21.15.32:0/1531817742 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f8d88066510 0x7f8d880689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:15.850 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.847+0000 7f8d99ffb700 1 -- 172.21.15.32:0/1531817742 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8da00832a0 con 0x7f8da4071570 2023-10-08T06:10:15.850 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.847+0000 7f8da8dfd700 1 --2- 172.21.15.32:0/1531817742 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f8d88066510 0x7f8d880689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:15.850 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.847+0000 7f8da8dfd700 1 --2- 172.21.15.32:0/1531817742 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f8d88066510 0x7f8d880689d0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f8da415da30 tx=0x7f8d94007de0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:15.857 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:15.855+0000 7f8d99ffb700 1 -- 172.21.15.32:0/1531817742 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f8da0050720 con 0x7f8da4071570 2023-10-08T06:10:16.031 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:16.027+0000 7f8daa600700 1 -- 172.21.15.32:0/1531817742 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8da40b5d00 con 0x7f8da4071570 2023-10-08T06:10:16.032 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:16.031+0000 7f8d99ffb700 1 -- 172.21.15.32:0/1531817742 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8da0053d40 con 0x7f8da4071570 2023-10-08T06:10:16.032 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 1 2023-10-08T06:10:16.035 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:16.031+0000 7f8daa600700 1 -- 172.21.15.32:0/1531817742 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f8d88066510 msgr2=0x7f8d880689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:16.035 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:16.031+0000 7f8daa600700 1 --2- 172.21.15.32:0/1531817742 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f8d88066510 0x7f8d880689d0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f8da415da30 tx=0x7f8d94007de0 comp rx=0 tx=0).stop 2023-10-08T06:10:16.035 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:16.031+0000 7f8daa600700 1 -- 172.21.15.32:0/1531817742 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8da4071570 msgr2=0x7f8da415b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:16.035 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:16.031+0000 7f8daa600700 1 --2- 172.21.15.32:0/1531817742 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8da4071570 0x7f8da415b8b0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f8da000c730 tx=0x7f8da000ca40 comp rx=0 tx=0).stop 2023-10-08T06:10:16.035 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:16.031+0000 7f8daa600700 1 -- 172.21.15.32:0/1531817742 shutdown_connections 2023-10-08T06:10:16.035 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:16.031+0000 7f8daa600700 1 --2- 172.21.15.32:0/1531817742 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f8d88066510 0x7f8d880689d0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:16.035 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:16.031+0000 7f8daa600700 1 --2- 172.21.15.32:0/1531817742 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8da40b1800 0x7f8da4159430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:16.035 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:16.031+0000 7f8daa600700 1 --2- 172.21.15.32:0/1531817742 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8da4071950 0x7f8da41f6730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:16.035 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:16.031+0000 7f8daa600700 1 --2- 172.21.15.32:0/1531817742 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8da4071570 0x7f8da415b8b0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:16.036 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:16.031+0000 7f8daa600700 1 -- 172.21.15.32:0/1531817742 >> 172.21.15.32:0/1531817742 conn(0x7f8da40cc800 msgr2=0x7f8da40afa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:10:16.036 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:16.031+0000 7f8daa600700 1 -- 172.21.15.32:0/1531817742 shutdown_connections 2023-10-08T06:10:16.036 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:16.031+0000 7f8daa600700 1 -- 172.21.15.32:0/1531817742 wait complete. 2023-10-08T06:10:16.053 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-08T06:10:16.173 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:16.171+0000 7f523bfff700 1 Processor -- start 2023-10-08T06:10:16.173 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:16.171+0000 7f523bfff700 1 -- start start 2023-10-08T06:10:16.175 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:16.171+0000 7f523bfff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f523c0719e0 0x7f523c0c9420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:16.175 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:16.171+0000 7f523bfff700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f523c0c9960 0x7f523c15bd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:16.175 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:16.171+0000 7f523bfff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f523c06fc20 con 0x7f523c15b980 2023-10-08T06:10:16.175 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:16.171+0000 7f523bfff700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f523c070430 con 0x7f523c0c9960 2023-10-08T06:10:16.175 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:16.171+0000 7f523bfff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f523c15ed70 con 0x7f523c0719e0 2023-10-08T06:10:16.175 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:16.171+0000 7f523b7fe700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f523c0c9960 0x7f523c15bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:16.175 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:16.171+0000 7f523a7fc700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f523c0719e0 0x7f523c0c9420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:16.176 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:16.171+0000 7f523affd700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f523c15b980 0x7f523c15f780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.32:48622/0 (socket says 172.21.15.32:48622) 2023-10-08T06:10:16.176 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:16.171+0000 7f523a7fc700 1 --2- 172.21.15.32:0/1146090574 >> v2:172.21.15.40:3300/0 conn(0x7f523c0719e0 0x7f523c0c9420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.32:43748/0 (socket says 172.21.15.32:43748) 2023-10-08T06:10:16.176 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:16.171+0000 7f523affd700 1 -- 172.21.15.32:0/1146090574 learned_addr learned my addr 172.21.15.32:0/1146090574 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-08T06:10:16.177 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:16.171+0000 7f523a7fc700 1 -- 172.21.15.32:0/1146090574 >> v2:172.21.15.32:3300/0 conn(0x7f523c0c9960 msgr2=0x7f523c15bd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:10:16.177 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:16.171+0000 7f523a7fc700 1 --2- 172.21.15.32:0/1146090574 >> v2:172.21.15.32:3300/0 conn(0x7f523c0c9960 0x7f523c15bd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:16.177 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:16.171+0000 7f523a7fc700 1 -- 172.21.15.32:0/1146090574 >> v1:172.21.15.40:6789/0 conn(0x7f523c15b980 legacy=0x7f523c15f780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:16.178 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:16.171+0000 7f523a7fc700 1 -- 172.21.15.32:0/1146090574 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f523c06fe70 con 0x7f523c0719e0 2023-10-08T06:10:16.178 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:16.175+0000 7f523a7fc700 1 --2- 172.21.15.32:0/1146090574 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f523c0719e0 0x7f523c0c9420 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f523c0ca950 tx=0x7f522400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ed42a2c1ae8fd5f0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:16.178 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:16.175+0000 7f5239ffb700 1 -- 172.21.15.32:0/1146090574 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f522400e070 con 0x7f523c0719e0 2023-10-08T06:10:16.178 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:16.175+0000 7f5239ffb700 1 -- 172.21.15.32:0/1146090574 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f522400bb20 con 0x7f523c0719e0 2023-10-08T06:10:16.178 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:16.175+0000 7f5239ffb700 1 -- 172.21.15.32:0/1146090574 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5224012430 con 0x7f523c0719e0 2023-10-08T06:10:16.178 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:16.175+0000 7f523bfff700 1 -- 172.21.15.32:0/1146090574 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f523c0719e0 msgr2=0x7f523c0c9420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:16.178 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:16.175+0000 7f523bfff700 1 --2- 172.21.15.32:0/1146090574 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f523c0719e0 0x7f523c0c9420 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f523c0ca950 tx=0x7f522400b330 comp rx=0 tx=0).stop 2023-10-08T06:10:16.178 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:16.175+0000 7f523bfff700 1 -- 172.21.15.32:0/1146090574 shutdown_connections 2023-10-08T06:10:16.178 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:16.175+0000 7f523bfff700 1 --2- 172.21.15.32:0/1146090574 >> v2:172.21.15.32:3300/0 conn(0x7f523c0c9960 0x7f523c15bd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:16.178 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:16.175+0000 7f523bfff700 1 --2- 172.21.15.32:0/1146090574 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f523c0719e0 0x7f523c0c9420 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:16.178 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:16.175+0000 7f523bfff700 1 -- 172.21.15.32:0/1146090574 >> 172.21.15.32:0/1146090574 conn(0x7f523c0b0900 msgr2=0x7f523c0b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:10:16.179 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:16.175+0000 7f523bfff700 1 -- 172.21.15.32:0/1146090574 shutdown_connections 2023-10-08T06:10:16.179 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:16.175+0000 7f523bfff700 1 -- 172.21.15.32:0/1146090574 wait complete. 2023-10-08T06:10:16.179 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:16.175+0000 7f523bfff700 1 Processor -- start 2023-10-08T06:10:16.179 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:16.175+0000 7f523bfff700 1 -- start start 2023-10-08T06:10:16.181 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:16.179+0000 7f523bfff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f523c0719e0 0x7f523c1562a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:16.181 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:16.179+0000 7f523bfff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f523c0c9960 0x7f523c0c7d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:16.181 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:16.179+0000 7f523bfff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f523c15b980 0x7f523c15a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:16.181 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:16.179+0000 7f523bfff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f523c156b90 con 0x7f523c15b980 2023-10-08T06:10:16.181 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:16.179+0000 7f523bfff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f523c0c83f0 con 0x7f523c0719e0 2023-10-08T06:10:16.181 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:16.179+0000 7f523bfff700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f523c0c86d0 con 0x7f523c0c9960 2023-10-08T06:10:16.181 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:16.179+0000 7f523b7fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f523c15b980 0x7f523c15a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:16.181 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:16.179+0000 7f523b7fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f523c15b980 0x7f523c15a490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:46830/0 (socket says 172.21.15.32:46830) 2023-10-08T06:10:16.181 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:16.179+0000 7f523b7fe700 1 -- 172.21.15.32:0/1865245933 learned_addr learned my addr 172.21.15.32:0/1865245933 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:10:16.182 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:16.179+0000 7f523a7fc700 1 --2- 172.21.15.32:0/1865245933 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f523c0c9960 0x7f523c0c7d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:16.182 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:16.179+0000 7f523affd700 1 --2- 172.21.15.32:0/1865245933 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f523c0719e0 0x7f523c1562a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:16.182 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:16.179+0000 7f523b7fe700 1 -- 172.21.15.32:0/1865245933 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f523c0c9960 msgr2=0x7f523c0c7d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:16.182 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:16.179+0000 7f523b7fe700 1 --2- 172.21.15.32:0/1865245933 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f523c0c9960 0x7f523c0c7d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:16.182 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:16.179+0000 7f523b7fe700 1 -- 172.21.15.32:0/1865245933 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f523c0719e0 msgr2=0x7f523c1562a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:16.182 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:16.179+0000 7f523b7fe700 1 --2- 172.21.15.32:0/1865245933 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f523c0719e0 0x7f523c1562a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:16.182 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:16.179+0000 7f523b7fe700 1 -- 172.21.15.32:0/1865245933 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5224009a70 con 0x7f523c15b980 2023-10-08T06:10:16.182 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:16.179+0000 7f523b7fe700 1 --2- 172.21.15.32:0/1865245933 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f523c15b980 0x7f523c15a490 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f522c00eb60 tx=0x7f522c00ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:16.183 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:16.179+0000 7f5233fff700 1 -- 172.21.15.32:0/1865245933 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f522c009740 con 0x7f523c15b980 2023-10-08T06:10:16.183 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:16.179+0000 7f523bfff700 1 -- 172.21.15.32:0/1865245933 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f523c0c89b0 con 0x7f523c15b980 2023-10-08T06:10:16.183 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:16.179+0000 7f5233fff700 1 -- 172.21.15.32:0/1865245933 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f522c00c850 con 0x7f523c15b980 2023-10-08T06:10:16.183 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:16.179+0000 7f5233fff700 1 -- 172.21.15.32:0/1865245933 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f522c00cbe0 con 0x7f523c15b980 2023-10-08T06:10:16.183 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:16.179+0000 7f523bfff700 1 -- 172.21.15.32:0/1865245933 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f523c1553d0 con 0x7f523c15b980 2023-10-08T06:10:16.183 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:16.179+0000 7f523bfff700 1 -- 172.21.15.32:0/1865245933 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f523c04eef0 con 0x7f523c15b980 2023-10-08T06:10:16.184 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:16.183+0000 7f5233fff700 1 -- 172.21.15.32:0/1865245933 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f522c013470 con 0x7f523c15b980 2023-10-08T06:10:16.184 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:16.183+0000 7f5233fff700 1 --2- 172.21.15.32:0/1865245933 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f5220066510 0x7f52200689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:16.184 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:16.183+0000 7f523affd700 1 --2- 172.21.15.32:0/1865245933 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f5220066510 0x7f52200689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:16.185 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:16.183+0000 7f5233fff700 1 -- 172.21.15.32:0/1865245933 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f522c084040 con 0x7f523c15b980 2023-10-08T06:10:16.185 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:16.183+0000 7f523affd700 1 --2- 172.21.15.32:0/1865245933 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f5220066510 0x7f52200689d0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f5234000f60 tx=0x7f5234009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:16.191 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:16.187+0000 7f5233fff700 1 -- 172.21.15.32:0/1865245933 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f522c0513b0 con 0x7f523c15b980 2023-10-08T06:10:16.355 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:16.351+0000 7f523bfff700 1 -- 172.21.15.32:0/1865245933 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f523c06e4d0 con 0x7f523c15b980 2023-10-08T06:10:16.355 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:16.355+0000 7f5233fff700 1 -- 172.21.15.32:0/1865245933 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f522c0549d0 con 0x7f523c15b980 2023-10-08T06:10:16.356 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 32 2023-10-08T06:10:16.358 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:16.355+0000 7f523bfff700 1 -- 172.21.15.32:0/1865245933 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f5220066510 msgr2=0x7f52200689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:16.358 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:16.355+0000 7f523bfff700 1 --2- 172.21.15.32:0/1865245933 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f5220066510 0x7f52200689d0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f5234000f60 tx=0x7f5234009040 comp rx=0 tx=0).stop 2023-10-08T06:10:16.359 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:16.355+0000 7f523bfff700 1 -- 172.21.15.32:0/1865245933 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f523c15b980 msgr2=0x7f523c15a490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:16.359 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:16.355+0000 7f523bfff700 1 --2- 172.21.15.32:0/1865245933 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f523c15b980 0x7f523c15a490 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f522c00eb60 tx=0x7f522c00ef20 comp rx=0 tx=0).stop 2023-10-08T06:10:16.359 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:16.355+0000 7f523bfff700 1 -- 172.21.15.32:0/1865245933 shutdown_connections 2023-10-08T06:10:16.359 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:16.355+0000 7f523bfff700 1 --2- 172.21.15.32:0/1865245933 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f5220066510 0x7f52200689d0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:16.359 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:16.355+0000 7f523bfff700 1 --2- 172.21.15.32:0/1865245933 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f523c15b980 0x7f523c15a490 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:16.359 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:16.355+0000 7f523bfff700 1 --2- 172.21.15.32:0/1865245933 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f523c0c9960 0x7f523c0c7d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:16.359 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:16.355+0000 7f523bfff700 1 --2- 172.21.15.32:0/1865245933 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f523c0719e0 0x7f523c1562a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:16.359 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:16.355+0000 7f523bfff700 1 -- 172.21.15.32:0/1865245933 >> 172.21.15.32:0/1865245933 conn(0x7f523c0b0900 msgr2=0x7f523c0c9f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:10:16.359 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:16.355+0000 7f523bfff700 1 -- 172.21.15.32:0/1865245933 shutdown_connections 2023-10-08T06:10:16.359 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:16.355+0000 7f523bfff700 1 -- 172.21.15.32:0/1865245933 wait complete. 2023-10-08T06:10:16.371 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-08T06:10:16.491 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:16.487+0000 7f06569c5700 1 Processor -- start 2023-10-08T06:10:16.491 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:16.487+0000 7f06569c5700 1 -- start start 2023-10-08T06:10:16.493 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:16.491+0000 7f06569c5700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f065015d5a0 0x7f06500cfb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:16.493 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:16.491+0000 7f06569c5700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06501621b0 con 0x7f065015d980 2023-10-08T06:10:16.493 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:16.491+0000 7f06569c5700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06500b59b0 con 0x7f06500b2600 2023-10-08T06:10:16.493 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:16.491+0000 7f06569c5700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0650161630 con 0x7f065015d5a0 2023-10-08T06:10:16.493 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:16.491+0000 7f06559c3700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f065015d5a0 0x7f06500cfb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:16.493 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:16.491+0000 7f06551c2700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f065015d980 0x7f06500b4b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:45922/0 (socket says 172.21.15.32:45922) 2023-10-08T06:10:16.493 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:16.491+0000 7f06551c2700 1 -- 172.21.15.32:0/1787636993 learned_addr learned my addr 172.21.15.32:0/1787636993 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-08T06:10:16.493 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:16.491+0000 7f06559c3700 1 -- 172.21.15.32:0/1787636993 >> v1:172.21.15.40:6789/0 conn(0x7f06500b2600 legacy=0x7f06500b52a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:16.494 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:16.491+0000 7f06559c3700 1 -- 172.21.15.32:0/1787636993 >> v1:172.21.15.32:6789/0 conn(0x7f065015d980 legacy=0x7f06500b4b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:16.494 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:16.491+0000 7f06549c1700 1 -- 172.21.15.32:0/1787636993 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 862411407 0 0) 0x7f06501621b0 con 0x7f065015d980 2023-10-08T06:10:16.494 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:16.491+0000 7f06559c3700 1 -- 172.21.15.32:0/1787636993 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0650161910 con 0x7f065015d5a0 2023-10-08T06:10:16.495 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:16.491+0000 7f06559c3700 1 --2- 172.21.15.32:0/1787636993 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f065015d5a0 0x7f06500cfb20 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f064c009850 tx=0x7f064c009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8dc850cc7d7ee2a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:16.495 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:16.491+0000 7f06549c1700 1 -- 172.21.15.32:0/1787636993 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f064c011830 con 0x7f065015d5a0 2023-10-08T06:10:16.495 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:16.491+0000 7f06549c1700 1 -- 172.21.15.32:0/1787636993 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f064c011990 con 0x7f065015d5a0 2023-10-08T06:10:16.495 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:16.491+0000 7f06549c1700 1 -- 172.21.15.32:0/1787636993 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f064c011d20 con 0x7f065015d5a0 2023-10-08T06:10:16.495 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:16.491+0000 7f06569c5700 1 -- 172.21.15.32:0/1787636993 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f065015d5a0 msgr2=0x7f06500cfb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:16.496 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:16.491+0000 7f06569c5700 1 --2- 172.21.15.32:0/1787636993 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f065015d5a0 0x7f06500cfb20 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f064c009850 tx=0x7f064c009b60 comp rx=0 tx=0).stop 2023-10-08T06:10:16.496 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:16.491+0000 7f06569c5700 1 -- 172.21.15.32:0/1787636993 shutdown_connections 2023-10-08T06:10:16.496 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:16.491+0000 7f06569c5700 1 --2- 172.21.15.32:0/1787636993 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f065015d5a0 0x7f06500cfb20 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:16.496 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:16.491+0000 7f06569c5700 1 -- 172.21.15.32:0/1787636993 >> 172.21.15.32:0/1787636993 conn(0x7f065006aca0 msgr2=0x7f065006b0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:10:16.496 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:16.491+0000 7f06569c5700 1 -- 172.21.15.32:0/1787636993 shutdown_connections 2023-10-08T06:10:16.496 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:16.491+0000 7f06569c5700 1 -- 172.21.15.32:0/1787636993 wait complete. 2023-10-08T06:10:16.497 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:16.495+0000 7f06569c5700 1 Processor -- start 2023-10-08T06:10:16.497 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:16.495+0000 7f06569c5700 1 -- start start 2023-10-08T06:10:16.500 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:16.495+0000 7f06569c5700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f06500b2600 0x7f06501583c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:16.501 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:16.495+0000 7f06569c5700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f065015d5a0 0x7f0650160750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:16.501 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:16.495+0000 7f06569c5700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f06500caf80 0x7f06500cb400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:16.501 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:16.495+0000 7f06569c5700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06500cc5e0 con 0x7f06500b2600 2023-10-08T06:10:16.501 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:16.495+0000 7f06569c5700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06500caaf0 con 0x7f06500caf80 2023-10-08T06:10:16.501 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:16.495+0000 7f06569c5700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06500ca1e0 con 0x7f065015d5a0 2023-10-08T06:10:16.501 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:16.495+0000 7f06559c3700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f06500b2600 0x7f06501583c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:16.501 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:16.495+0000 7f06559c3700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f06500b2600 0x7f06501583c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:46844/0 (socket says 172.21.15.32:46844) 2023-10-08T06:10:16.501 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:16.495+0000 7f06559c3700 1 -- 172.21.15.32:0/3762105348 learned_addr learned my addr 172.21.15.32:0/3762105348 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:10:16.501 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:16.499+0000 7f06551c2700 1 --2- 172.21.15.32:0/3762105348 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f065015d5a0 0x7f0650160750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:16.501 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:16.499+0000 7f06561c4700 1 --2- 172.21.15.32:0/3762105348 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f06500caf80 0x7f06500cb400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:16.501 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:16.499+0000 7f06559c3700 1 -- 172.21.15.32:0/3762105348 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f065015d5a0 msgr2=0x7f0650160750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:16.502 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:16.499+0000 7f06559c3700 1 --2- 172.21.15.32:0/3762105348 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f065015d5a0 0x7f0650160750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:16.502 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:16.499+0000 7f06559c3700 1 -- 172.21.15.32:0/3762105348 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f06500caf80 msgr2=0x7f06500cb400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:16.502 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:16.499+0000 7f06559c3700 1 --2- 172.21.15.32:0/3762105348 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f06500caf80 0x7f06500cb400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:16.502 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:16.499+0000 7f06559c3700 1 -- 172.21.15.32:0/3762105348 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f064c0094b0 con 0x7f06500b2600 2023-10-08T06:10:16.502 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:16.499+0000 7f06559c3700 1 --2- 172.21.15.32:0/3762105348 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f06500b2600 0x7f06501583c0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f065008b420 tx=0x7f064c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:16.502 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:16.499+0000 7f06427fc700 1 -- 172.21.15.32:0/3762105348 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f064c0036c0 con 0x7f06500b2600 2023-10-08T06:10:16.502 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:16.499+0000 7f06427fc700 1 -- 172.21.15.32:0/3762105348 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f064c01f070 con 0x7f06500b2600 2023-10-08T06:10:16.502 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:16.499+0000 7f06569c5700 1 -- 172.21.15.32:0/3762105348 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0650160240 con 0x7f06500b2600 2023-10-08T06:10:16.502 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:16.499+0000 7f06427fc700 1 -- 172.21.15.32:0/3762105348 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f064c003a40 con 0x7f06500b2600 2023-10-08T06:10:16.502 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:16.499+0000 7f06569c5700 1 -- 172.21.15.32:0/3762105348 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06500ca780 con 0x7f06500b2600 2023-10-08T06:10:16.503 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:16.499+0000 7f06569c5700 1 -- 172.21.15.32:0/3762105348 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06500ca910 con 0x7f06500b2600 2023-10-08T06:10:16.503 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:16.499+0000 7f06427fc700 1 -- 172.21.15.32:0/3762105348 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f064c021030 con 0x7f06500b2600 2023-10-08T06:10:16.504 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:16.503+0000 7f06427fc700 1 --2- 172.21.15.32:0/3762105348 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f0634066510 0x7f06340689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:16.504 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:16.503+0000 7f06551c2700 1 --2- 172.21.15.32:0/3762105348 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f0634066510 0x7f06340689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:16.504 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:16.503+0000 7f06427fc700 1 -- 172.21.15.32:0/3762105348 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f064c0854a0 con 0x7f06500b2600 2023-10-08T06:10:16.504 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:16.503+0000 7f06551c2700 1 --2- 172.21.15.32:0/3762105348 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f0634066510 0x7f06340689d0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f06501f6090 tx=0x7f0644007dd0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:16.512 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:16.511+0000 7f06427fc700 1 -- 172.21.15.32:0/3762105348 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f064c0529b0 con 0x7f06500b2600 2023-10-08T06:10:16.677 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:16.675+0000 7f06569c5700 1 -- 172.21.15.32:0/3762105348 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f06500686a0 con 0x7f06500b2600 2023-10-08T06:10:16.678 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:16.675+0000 7f06427fc700 1 -- 172.21.15.32:0/3762105348 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f064c055fd0 con 0x7f06500b2600 2023-10-08T06:10:16.678 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 64 2023-10-08T06:10:16.680 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:16.679+0000 7f06569c5700 1 -- 172.21.15.32:0/3762105348 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f0634066510 msgr2=0x7f06340689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:16.680 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:16.679+0000 7f06569c5700 1 --2- 172.21.15.32:0/3762105348 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f0634066510 0x7f06340689d0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f06501f6090 tx=0x7f0644007dd0 comp rx=0 tx=0).stop 2023-10-08T06:10:16.680 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:16.679+0000 7f06569c5700 1 -- 172.21.15.32:0/3762105348 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f06500b2600 msgr2=0x7f06501583c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:16.680 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:16.679+0000 7f06569c5700 1 --2- 172.21.15.32:0/3762105348 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f06500b2600 0x7f06501583c0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f065008b420 tx=0x7f064c004770 comp rx=0 tx=0).stop 2023-10-08T06:10:16.680 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:16.679+0000 7f06569c5700 1 -- 172.21.15.32:0/3762105348 shutdown_connections 2023-10-08T06:10:16.680 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:16.679+0000 7f06569c5700 1 --2- 172.21.15.32:0/3762105348 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f0634066510 0x7f06340689d0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:16.681 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:16.679+0000 7f06569c5700 1 --2- 172.21.15.32:0/3762105348 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f06500caf80 0x7f06500cb400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:16.681 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:16.679+0000 7f06569c5700 1 --2- 172.21.15.32:0/3762105348 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f065015d5a0 0x7f0650160750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:16.681 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:16.679+0000 7f06569c5700 1 --2- 172.21.15.32:0/3762105348 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f06500b2600 0x7f06501583c0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:16.681 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:16.679+0000 7f06569c5700 1 -- 172.21.15.32:0/3762105348 >> 172.21.15.32:0/3762105348 conn(0x7f065006aca0 msgr2=0x7f06500cfb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:10:16.681 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:16.679+0000 7f06569c5700 1 -- 172.21.15.32:0/3762105348 shutdown_connections 2023-10-08T06:10:16.681 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:16.679+0000 7f06569c5700 1 -- 172.21.15.32:0/3762105348 wait complete. 2023-10-08T06:10:16.693 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-08T06:10:16.806 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:16.803+0000 7f75d3fff700 1 Processor -- start 2023-10-08T06:10:16.806 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:16.803+0000 7f75d3fff700 1 -- start start 2023-10-08T06:10:16.807 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:16.803+0000 7f75d3fff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f75d4158aa0 0x7f75d415f550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:16.807 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:16.803+0000 7f75d3fff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f75d40cf150 0x7f75d415b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:16.807 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:16.803+0000 7f75d3fff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75d40d04d0 con 0x7f75d40cb4c0 2023-10-08T06:10:16.807 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:16.803+0000 7f75d3fff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75d40cfc60 con 0x7f75d4158aa0 2023-10-08T06:10:16.807 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:16.803+0000 7f75d3fff700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75d40d0c60 con 0x7f75d40cf150 2023-10-08T06:10:16.807 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:16.803+0000 7f75d37fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f75d40cf150 0x7f75d415b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:16.807 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:16.803+0000 7f75d2ffd700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f75d4158aa0 0x7f75d415f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:16.807 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:16.803+0000 7f75d37fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f75d40cf150 0x7f75d415b550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.32:38906/0 (socket says 172.21.15.32:38906) 2023-10-08T06:10:16.808 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:16.803+0000 7f75d37fe700 1 -- 172.21.15.32:0/3038514316 learned_addr learned my addr 172.21.15.32:0/3038514316 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:10:16.808 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:16.803+0000 7f75d37fe700 1 -- 172.21.15.32:0/3038514316 >> v2:172.21.15.40:3300/0 conn(0x7f75d4158aa0 msgr2=0x7f75d415f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:10:16.809 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:16.803+0000 7f75d37fe700 1 --2- 172.21.15.32:0/3038514316 >> v2:172.21.15.40:3300/0 conn(0x7f75d4158aa0 0x7f75d415f550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:16.809 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:16.803+0000 7f75d37fe700 1 -- 172.21.15.32:0/3038514316 >> v1:172.21.15.40:6789/0 conn(0x7f75d40cb4c0 legacy=0x7f75d40cea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:16.809 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:16.803+0000 7f75d37fe700 1 -- 172.21.15.32:0/3038514316 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75d40cfe70 con 0x7f75d40cf150 2023-10-08T06:10:16.809 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:16.807+0000 7f75d37fe700 1 --2- 172.21.15.32:0/3038514316 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f75d40cf150 0x7f75d415b550 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f75cc009e50 tx=0x7f75cc00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=815b2c918c2ba6ca server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:16.809 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:16.807+0000 7f75d1ffb700 1 -- 172.21.15.32:0/3038514316 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75cc00e070 con 0x7f75d40cf150 2023-10-08T06:10:16.809 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:16.807+0000 7f75d1ffb700 1 -- 172.21.15.32:0/3038514316 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75cc00b910 con 0x7f75d40cf150 2023-10-08T06:10:16.809 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:16.807+0000 7f75d1ffb700 1 -- 172.21.15.32:0/3038514316 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75cc00bcc0 con 0x7f75d40cf150 2023-10-08T06:10:16.810 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:16.807+0000 7f75d3fff700 1 -- 172.21.15.32:0/3038514316 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f75d40cf150 msgr2=0x7f75d415b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:16.810 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:16.807+0000 7f75d3fff700 1 --2- 172.21.15.32:0/3038514316 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f75d40cf150 0x7f75d415b550 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f75cc009e50 tx=0x7f75cc00b330 comp rx=0 tx=0).stop 2023-10-08T06:10:16.811 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:16.807+0000 7f75d3fff700 1 -- 172.21.15.32:0/3038514316 shutdown_connections 2023-10-08T06:10:16.811 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:16.807+0000 7f75d3fff700 1 --2- 172.21.15.32:0/3038514316 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f75d40cf150 0x7f75d415b550 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:16.811 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:16.807+0000 7f75d3fff700 1 --2- 172.21.15.32:0/3038514316 >> v2:172.21.15.40:3300/0 conn(0x7f75d4158aa0 0x7f75d415f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:16.811 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:16.807+0000 7f75d3fff700 1 -- 172.21.15.32:0/3038514316 >> 172.21.15.32:0/3038514316 conn(0x7f75d406df60 msgr2=0x7f75d406e340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:10:16.811 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:16.807+0000 7f75d3fff700 1 -- 172.21.15.32:0/3038514316 shutdown_connections 2023-10-08T06:10:16.811 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:16.807+0000 7f75d3fff700 1 -- 172.21.15.32:0/3038514316 wait complete. 2023-10-08T06:10:16.811 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:16.807+0000 7f75d3fff700 1 Processor -- start 2023-10-08T06:10:16.812 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:16.807+0000 7f75d3fff700 1 -- start start 2023-10-08T06:10:16.813 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:16.811+0000 7f75d3fff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f75d40cb4c0 0x7f75d4156440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:16.813 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:16.811+0000 7f75d3fff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f75d40cf150 0x7f75d406b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:16.813 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:16.811+0000 7f75d3fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f75d4158aa0 0x7f75d406b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:16.813 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:16.811+0000 7f75d3fff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75d40c8680 con 0x7f75d4158aa0 2023-10-08T06:10:16.813 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:16.811+0000 7f75d3fff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75d40c80c0 con 0x7f75d40cb4c0 2023-10-08T06:10:16.813 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:16.811+0000 7f75d3fff700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75d40c83a0 con 0x7f75d40cf150 2023-10-08T06:10:16.813 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:16.811+0000 7f75d37fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f75d4158aa0 0x7f75d406b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:16.813 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:16.811+0000 7f75d37fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f75d4158aa0 0x7f75d406b8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:46858/0 (socket says 172.21.15.32:46858) 2023-10-08T06:10:16.813 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:16.811+0000 7f75d37fe700 1 -- 172.21.15.32:0/481445142 learned_addr learned my addr 172.21.15.32:0/481445142 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:10:16.814 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:16.811+0000 7f75d27fc700 1 --2- 172.21.15.32:0/481445142 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f75d40cf150 0x7f75d406b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:16.814 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:16.811+0000 7f75d2ffd700 1 --2- 172.21.15.32:0/481445142 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f75d40cb4c0 0x7f75d4156440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:16.815 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:16.811+0000 7f75d37fe700 1 -- 172.21.15.32:0/481445142 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f75d40cf150 msgr2=0x7f75d406b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:16.815 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:16.811+0000 7f75d37fe700 1 --2- 172.21.15.32:0/481445142 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f75d40cf150 0x7f75d406b3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:16.815 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:16.811+0000 7f75d37fe700 1 -- 172.21.15.32:0/481445142 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f75d40cb4c0 msgr2=0x7f75d4156440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:16.815 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:16.811+0000 7f75d37fe700 1 --2- 172.21.15.32:0/481445142 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f75d40cb4c0 0x7f75d4156440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:16.815 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:16.811+0000 7f75d37fe700 1 -- 172.21.15.32:0/481445142 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75cc009b30 con 0x7f75d4158aa0 2023-10-08T06:10:16.815 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:16.811+0000 7f75d37fe700 1 --2- 172.21.15.32:0/481445142 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f75d4158aa0 0x7f75d406b8f0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f75d40cfda0 tx=0x7f75cc004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:16.815 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:16.811+0000 7f75bbfff700 1 -- 172.21.15.32:0/481445142 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75cc004800 con 0x7f75d4158aa0 2023-10-08T06:10:16.815 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:16.811+0000 7f75bbfff700 1 -- 172.21.15.32:0/481445142 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75cc0099b0 con 0x7f75d4158aa0 2023-10-08T06:10:16.816 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:16.811+0000 7f75d3fff700 1 -- 172.21.15.32:0/481445142 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75d40b0a70 con 0x7f75d4158aa0 2023-10-08T06:10:16.816 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:16.811+0000 7f75bbfff700 1 -- 172.21.15.32:0/481445142 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75cc01c680 con 0x7f75d4158aa0 2023-10-08T06:10:16.816 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:16.811+0000 7f75d3fff700 1 -- 172.21.15.32:0/481445142 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75d41e7410 con 0x7f75d4158aa0 2023-10-08T06:10:16.816 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:16.815+0000 7f75d3fff700 1 -- 172.21.15.32:0/481445142 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75d41e75a0 con 0x7f75d4158aa0 2023-10-08T06:10:16.817 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:16.815+0000 7f75bbfff700 1 -- 172.21.15.32:0/481445142 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f75cc01c7e0 con 0x7f75d4158aa0 2023-10-08T06:10:16.818 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:16.815+0000 7f75bbfff700 1 --2- 172.21.15.32:0/481445142 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f75c0066510 0x7f75c00689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:16.818 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:16.815+0000 7f75bbfff700 1 -- 172.21.15.32:0/481445142 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f75cc085a10 con 0x7f75d4158aa0 2023-10-08T06:10:16.818 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:16.815+0000 7f75d2ffd700 1 --2- 172.21.15.32:0/481445142 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f75c0066510 0x7f75c00689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:16.819 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:16.815+0000 7f75d2ffd700 1 --2- 172.21.15.32:0/481445142 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f75c0066510 0x7f75c00689d0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f75c8009bf0 tx=0x7f75c8009240 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:16.824 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:16.823+0000 7f75bbfff700 1 -- 172.21.15.32:0/481445142 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f75d41e75a0 con 0x7f75d4158aa0 2023-10-08T06:10:17.004 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.003+0000 7f75d3fff700 1 -- 172.21.15.32:0/481445142 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f75d40b08d0 con 0x7f75d4158aa0 2023-10-08T06:10:17.005 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.003+0000 7f75bbfff700 1 -- 172.21.15.32:0/481445142 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v22) v1 ==== 80+0+0 (secure 0 0 0) 0x7f75d40b08d0 con 0x7f75d4158aa0 2023-10-08T06:10:17.009 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.007+0000 7f75d3fff700 1 -- 172.21.15.32:0/481445142 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f75c0066510 msgr2=0x7f75c00689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:17.009 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.007+0000 7f75d3fff700 1 --2- 172.21.15.32:0/481445142 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f75c0066510 0x7f75c00689d0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f75c8009bf0 tx=0x7f75c8009240 comp rx=0 tx=0).stop 2023-10-08T06:10:17.009 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.007+0000 7f75d3fff700 1 -- 172.21.15.32:0/481445142 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f75d4158aa0 msgr2=0x7f75d406b8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:17.009 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.007+0000 7f75d3fff700 1 --2- 172.21.15.32:0/481445142 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f75d4158aa0 0x7f75d406b8f0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f75d40cfda0 tx=0x7f75cc004af0 comp rx=0 tx=0).stop 2023-10-08T06:10:17.009 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.007+0000 7f75d3fff700 1 -- 172.21.15.32:0/481445142 shutdown_connections 2023-10-08T06:10:17.009 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.007+0000 7f75d3fff700 1 --2- 172.21.15.32:0/481445142 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f75c0066510 0x7f75c00689d0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:17.009 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.007+0000 7f75d3fff700 1 --2- 172.21.15.32:0/481445142 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f75d4158aa0 0x7f75d406b8f0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:17.009 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.007+0000 7f75d3fff700 1 --2- 172.21.15.32:0/481445142 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f75d40cf150 0x7f75d406b3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:17.009 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.007+0000 7f75d3fff700 1 --2- 172.21.15.32:0/481445142 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f75d40cb4c0 0x7f75d4156440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:17.010 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.007+0000 7f75d3fff700 1 -- 172.21.15.32:0/481445142 >> 172.21.15.32:0/481445142 conn(0x7f75d406df60 msgr2=0x7f75d40b3a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:10:17.010 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.007+0000 7f75d3fff700 1 -- 172.21.15.32:0/481445142 shutdown_connections 2023-10-08T06:10:17.010 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.007+0000 7f75d3fff700 1 -- 172.21.15.32:0/481445142 wait complete. 2023-10-08T06:10:17.010 INFO:teuthology.orchestra.run.smithi032.stderr:listed 0 entries 2023-10-08T06:10:17.025 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2023-10-08T06:10:17.026 DEBUG:teuthology.orchestra.run.smithi032:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-08T06:10:17.031 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T06:10:17.149 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.147+0000 7fa568dd8700 1 Processor -- start 2023-10-08T06:10:17.150 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.147+0000 7fa568dd8700 1 -- start start 2023-10-08T06:10:17.151 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.147+0000 7fa568dd8700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fa56415b980 0x7fa56415f780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:17.151 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.147+0000 7fa568dd8700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa5640719e0 0x7fa5640c9420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:17.151 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.147+0000 7fa568dd8700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa5640c9960 0x7fa56415bd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:17.151 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.147+0000 7fa568dd8700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa564070430 con 0x7fa56415b980 2023-10-08T06:10:17.151 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.147+0000 7fa568dd8700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa56415ed70 con 0x7fa5640c9960 2023-10-08T06:10:17.151 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.147+0000 7fa568dd8700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5640c9dd0 con 0x7fa5640719e0 2023-10-08T06:10:17.153 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.147+0000 7fa5637fe700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fa56415b980 0x7fa56415f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:17.153 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.147+0000 7fa562ffd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa5640719e0 0x7fa5640c9420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:17.153 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.147+0000 7fa5637fe700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fa56415b980 0x7fa56415f780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:46870/0 (socket says 172.21.15.32:46870) 2023-10-08T06:10:17.153 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.147+0000 7fa563fff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa5640c9960 0x7fa56415bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:17.154 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.147+0000 7fa5637fe700 1 -- 172.21.15.32:0/2659401026 learned_addr learned my addr 172.21.15.32:0/2659401026 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:10:17.154 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.147+0000 7fa562ffd700 1 -- 172.21.15.32:0/2659401026 >> v2:172.21.15.40:3300/0 conn(0x7fa5640c9960 msgr2=0x7fa56415bd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:10:17.154 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.147+0000 7fa562ffd700 1 --2- 172.21.15.32:0/2659401026 >> v2:172.21.15.40:3300/0 conn(0x7fa5640c9960 0x7fa56415bd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:17.154 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.147+0000 7fa562ffd700 1 -- 172.21.15.32:0/2659401026 >> v2:172.21.15.32:3300/0 conn(0x7fa56415b980 msgr2=0x7fa56415f780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:10:17.154 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.147+0000 7fa562ffd700 1 --2- 172.21.15.32:0/2659401026 >> v2:172.21.15.32:3300/0 conn(0x7fa56415b980 0x7fa56415f780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:17.154 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.147+0000 7fa562ffd700 1 -- 172.21.15.32:0/2659401026 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa56406fc20 con 0x7fa5640719e0 2023-10-08T06:10:17.157 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.147+0000 7fa562ffd700 1 --2- 172.21.15.32:0/2659401026 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa5640719e0 0x7fa5640c9420 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fa5640cc950 tx=0x7fa55c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bdc9ba8396c44606 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:17.157 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.151+0000 7fa5627fc700 1 -- 172.21.15.32:0/2659401026 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa55c00e070 con 0x7fa5640719e0 2023-10-08T06:10:17.157 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.151+0000 7fa5627fc700 1 -- 172.21.15.32:0/2659401026 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa55c00bb20 con 0x7fa5640719e0 2023-10-08T06:10:17.157 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.151+0000 7fa5627fc700 1 -- 172.21.15.32:0/2659401026 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa55c012430 con 0x7fa5640719e0 2023-10-08T06:10:17.157 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.151+0000 7fa568dd8700 1 -- 172.21.15.32:0/2659401026 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa5640719e0 msgr2=0x7fa5640c9420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:17.157 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.151+0000 7fa568dd8700 1 --2- 172.21.15.32:0/2659401026 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa5640719e0 0x7fa5640c9420 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fa5640cc950 tx=0x7fa55c00b330 comp rx=0 tx=0).stop 2023-10-08T06:10:17.158 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.151+0000 7fa568dd8700 1 -- 172.21.15.32:0/2659401026 shutdown_connections 2023-10-08T06:10:17.158 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.151+0000 7fa568dd8700 1 --2- 172.21.15.32:0/2659401026 >> v2:172.21.15.40:3300/0 conn(0x7fa5640c9960 0x7fa56415bd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:17.158 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.151+0000 7fa568dd8700 1 --2- 172.21.15.32:0/2659401026 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa5640719e0 0x7fa5640c9420 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:17.158 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.151+0000 7fa568dd8700 1 --2- 172.21.15.32:0/2659401026 >> v2:172.21.15.32:3300/0 conn(0x7fa56415b980 0x7fa56415f780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:17.158 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.151+0000 7fa568dd8700 1 -- 172.21.15.32:0/2659401026 >> 172.21.15.32:0/2659401026 conn(0x7fa5640b0900 msgr2=0x7fa5640b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:10:17.158 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.151+0000 7fa568dd8700 1 -- 172.21.15.32:0/2659401026 shutdown_connections 2023-10-08T06:10:17.158 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.151+0000 7fa568dd8700 1 -- 172.21.15.32:0/2659401026 wait complete. 2023-10-08T06:10:17.158 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.151+0000 7fa568dd8700 1 Processor -- start 2023-10-08T06:10:17.158 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.151+0000 7fa568dd8700 1 -- start start 2023-10-08T06:10:17.158 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.151+0000 7fa568dd8700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa5640719e0 0x7fa564148dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:17.158 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.151+0000 7fa568dd8700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa5640c9960 0x7fa5640b19f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:17.159 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.151+0000 7fa568dd8700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa56415b980 0x7fa5640b1f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:17.159 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.151+0000 7fa568dd8700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5640b4440 con 0x7fa56415b980 2023-10-08T06:10:17.159 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.151+0000 7fa568dd8700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa564149300 con 0x7fa5640c9960 2023-10-08T06:10:17.159 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.151+0000 7fa568dd8700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5640b2560 con 0x7fa5640719e0 2023-10-08T06:10:17.159 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.155+0000 7fa563fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa56415b980 0x7fa5640b1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:17.159 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.155+0000 7fa563fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa56415b980 0x7fa5640b1f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:46874/0 (socket says 172.21.15.32:46874) 2023-10-08T06:10:17.159 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.155+0000 7fa563fff700 1 -- 172.21.15.32:0/3832986426 learned_addr learned my addr 172.21.15.32:0/3832986426 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:10:17.159 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.155+0000 7fa562ffd700 1 --2- 172.21.15.32:0/3832986426 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa5640c9960 0x7fa5640b19f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:17.159 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.155+0000 7fa5637fe700 1 --2- 172.21.15.32:0/3832986426 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa5640719e0 0x7fa564148dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:17.159 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.155+0000 7fa563fff700 1 -- 172.21.15.32:0/3832986426 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa5640719e0 msgr2=0x7fa564148dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:17.159 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.155+0000 7fa563fff700 1 --2- 172.21.15.32:0/3832986426 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa5640719e0 0x7fa564148dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:17.160 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.155+0000 7fa563fff700 1 -- 172.21.15.32:0/3832986426 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa5640c9960 msgr2=0x7fa5640b19f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:17.160 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.155+0000 7fa563fff700 1 --2- 172.21.15.32:0/3832986426 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa5640c9960 0x7fa5640b19f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:17.160 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.155+0000 7fa563fff700 1 -- 172.21.15.32:0/3832986426 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa55c009a70 con 0x7fa56415b980 2023-10-08T06:10:17.160 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.155+0000 7fa562ffd700 1 --2- 172.21.15.32:0/3832986426 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa5640c9960 0x7fa5640b19f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T06:10:17.160 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.155+0000 7fa563fff700 1 --2- 172.21.15.32:0/3832986426 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa56415b980 0x7fa5640b1f30 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fa55400e8e0 tx=0x7fa55400eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:17.160 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.155+0000 7fa54bfff700 1 -- 172.21.15.32:0/3832986426 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5540096c0 con 0x7fa56415b980 2023-10-08T06:10:17.160 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.155+0000 7fa54bfff700 1 -- 172.21.15.32:0/3832986426 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa55400c850 con 0x7fa56415b980 2023-10-08T06:10:17.160 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.155+0000 7fa568dd8700 1 -- 172.21.15.32:0/3832986426 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5640b2840 con 0x7fa56415b980 2023-10-08T06:10:17.160 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.155+0000 7fa54bfff700 1 -- 172.21.15.32:0/3832986426 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa55400eee0 con 0x7fa56415b980 2023-10-08T06:10:17.160 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.155+0000 7fa568dd8700 1 -- 172.21.15.32:0/3832986426 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5640b2e00 con 0x7fa56415b980 2023-10-08T06:10:17.161 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.155+0000 7fa568dd8700 1 -- 172.21.15.32:0/3832986426 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5640b2ff0 con 0x7fa56415b980 2023-10-08T06:10:17.161 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.155+0000 7fa54bfff700 1 -- 172.21.15.32:0/3832986426 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fa55400cc40 con 0x7fa56415b980 2023-10-08T06:10:17.161 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.159+0000 7fa54bfff700 1 --2- 172.21.15.32:0/3832986426 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fa550066510 0x7fa5500689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:17.162 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.159+0000 7fa54bfff700 1 -- 172.21.15.32:0/3832986426 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa554083f90 con 0x7fa56415b980 2023-10-08T06:10:17.162 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.159+0000 7fa5637fe700 1 --2- 172.21.15.32:0/3832986426 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fa550066510 0x7fa5500689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:17.162 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.159+0000 7fa5637fe700 1 --2- 172.21.15.32:0/3832986426 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fa550066510 0x7fa5500689d0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fa558009ba0 tx=0x7fa558008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:17.169 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.167+0000 7fa54bfff700 1 -- 172.21.15.32:0/3832986426 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fa5540b5090 con 0x7fa56415b980 2023-10-08T06:10:17.344 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.343+0000 7fa568dd8700 1 -- 172.21.15.32:0/3832986426 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa564073f00 con 0x7fa56415b980 2023-10-08T06:10:17.347 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.343+0000 7fa54bfff700 1 -- 172.21.15.32:0/3832986426 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16445 (secure 0 0 0) 0x7fa554051390 con 0x7fa56415b980 2023-10-08T06:10:17.347 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:10:17.348 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":22,"fsid":"ac672d87-96ae-41e0-9314-623ba2cdbbba","created":"2023-10-08T06:09:11.175626+0000","modified":"2023-10-08T06:09:38.153256+0000","last_up_change":"2023-10-08T06:09:22.744643+0000","last_in_change":"2023-10-08T06:09:14.131580+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T06:09:23.307843+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T06:09:34.295012+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T06:09:35.515590+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"43433f0c-9592-4874-92d7-10f8f4acf07f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":587888964},{"type":"v1","addr":"172.21.15.32:6801","nonce":587888964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":587888964},{"type":"v1","addr":"172.21.15.32:6803","nonce":587888964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":587888964},{"type":"v1","addr":"172.21.15.32:6810","nonce":587888964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6805","nonce":587888964},{"type":"v1","addr":"172.21.15.32:6807","nonce":587888964}]},"public_addr":"172.21.15.32:6801/587888964","cluster_addr":"172.21.15.32:6803/587888964","heartbeat_back_addr":"172.21.15.32:6810/587888964","heartbeat_front_addr":"172.21.15.32:6807/587888964","state":["exists","up"]},{"osd":1,"uuid":"2ecb1008-b987-4ce7-b646-6cded55fc8d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":990576767},{"type":"v1","addr":"172.21.15.32:6817","nonce":990576767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":990576767},{"type":"v1","addr":"172.21.15.32:6819","nonce":990576767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":990576767},{"type":"v1","addr":"172.21.15.32:6823","nonce":990576767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":990576767},{"type":"v1","addr":"172.21.15.32:6821","nonce":990576767}]},"public_addr":"172.21.15.32:6817/990576767","cluster_addr":"172.21.15.32:6819/990576767","heartbeat_back_addr":"172.21.15.32:6823/990576767","heartbeat_front_addr":"172.21.15.32:6821/990576767","state":["exists","up"]},{"osd":2,"uuid":"1b131c94-c09b-4e80-8746-bf1b7bac362d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6824","nonce":1566874440},{"type":"v1","addr":"172.21.15.32:6825","nonce":1566874440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":1566874440},{"type":"v1","addr":"172.21.15.32:6827","nonce":1566874440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":1566874440},{"type":"v1","addr":"172.21.15.32:6831","nonce":1566874440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":1566874440},{"type":"v1","addr":"172.21.15.32:6829","nonce":1566874440}]},"public_addr":"172.21.15.32:6825/1566874440","cluster_addr":"172.21.15.32:6827/1566874440","heartbeat_back_addr":"172.21.15.32:6831/1566874440","heartbeat_front_addr":"172.21.15.32:6829/1566874440","state":["exists","up"]},{"osd":3,"uuid":"ad655af2-1f6f-4689-b21d-b07bbaeb68b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":3672614802},{"type":"v1","addr":"172.21.15.32:6806","nonce":3672614802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6809","nonce":3672614802},{"type":"v1","addr":"172.21.15.32:6811","nonce":3672614802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":3672614802},{"type":"v1","addr":"172.21.15.32:6815","nonce":3672614802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":3672614802},{"type":"v1","addr":"172.21.15.32:6813","nonce":3672614802}]},"public_addr":"172.21.15.32:6806/3672614802","cluster_addr":"172.21.15.32:6811/3672614802","heartbeat_back_addr":"172.21.15.32:6815/3672614802","heartbeat_front_addr":"172.21.15.32:6813/3672614802","state":["exists","up"]},{"osd":4,"uuid":"64a543a1-8c4f-458e-9aba-b35c1cd7dd03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":3369928244},{"type":"v1","addr":"172.21.15.40:6801","nonce":3369928244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":3369928244},{"type":"v1","addr":"172.21.15.40:6803","nonce":3369928244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":3369928244},{"type":"v1","addr":"172.21.15.40:6807","nonce":3369928244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":3369928244},{"type":"v1","addr":"172.21.15.40:6805","nonce":3369928244}]},"public_addr":"172.21.15.40:6801/3369928244","cluster_addr":"172.21.15.40:6803/3369928244","heartbeat_back_addr":"172.21.15.40:6807/3369928244","heartbeat_front_addr":"172.21.15.40:6805/3369928244","state":["exists","up"]},{"osd":5,"uuid":"0fef3e54-edb4-4678-878e-944663c51638","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":2395850297},{"type":"v1","addr":"172.21.15.40:6825","nonce":2395850297}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":2395850297},{"type":"v1","addr":"172.21.15.40:6827","nonce":2395850297}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":2395850297},{"type":"v1","addr":"172.21.15.40:6831","nonce":2395850297}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":2395850297},{"type":"v1","addr":"172.21.15.40:6829","nonce":2395850297}]},"public_addr":"172.21.15.40:6825/2395850297","cluster_addr":"172.21.15.40:6827/2395850297","heartbeat_back_addr":"172.21.15.40:6831/2395850297","heartbeat_front_addr":"172.21.15.40:6829/2395850297","state":["exists","up"]},{"osd":6,"uuid":"2eeb0472-6096-469d-9b2c-cab4bf41c31a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":4145283410},{"type":"v1","addr":"172.21.15.40:6809","nonce":4145283410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":4145283410},{"type":"v1","addr":"172.21.15.40:6811","nonce":4145283410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":4145283410},{"type":"v1","addr":"172.21.15.40:6815","nonce":4145283410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":4145283410},{"type":"v1","addr":"172.21.15.40:6813","nonce":4145283410}]},"public_addr":"172.21.15.40:6809/4145283410","cluster_addr":"172.21.15.40:6811/4145283410","heartbeat_back_addr":"172.21.15.40:6815/4145283410","heartbeat_front_addr":"172.21.15.40:6813/4145283410","state":["exists","up"]},{"osd":7,"uuid":"cf76e4c7-96a6-401f-a280-91aad4641940","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":2943297416},{"type":"v1","addr":"172.21.15.40:6817","nonce":2943297416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":2943297416},{"type":"v1","addr":"172.21.15.40:6819","nonce":2943297416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":2943297416},{"type":"v1","addr":"172.21.15.40:6823","nonce":2943297416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":2943297416},{"type":"v1","addr":"172.21.15.40:6821","nonce":2943297416}]},"public_addr":"172.21.15.40:6817/2943297416","cluster_addr":"172.21.15.40:6819/2943297416","heartbeat_back_addr":"172.21.15.40:6823/2943297416","heartbeat_front_addr":"172.21.15.40:6821/2943297416","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.411475+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.628841+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.599055+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.166100+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.384135+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.488403+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.307648+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.363541+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T06:10:17.350 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.347+0000 7fa568dd8700 1 -- 172.21.15.32:0/3832986426 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fa550066510 msgr2=0x7fa5500689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:17.351 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.347+0000 7fa568dd8700 1 --2- 172.21.15.32:0/3832986426 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fa550066510 0x7fa5500689d0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fa558009ba0 tx=0x7fa558008040 comp rx=0 tx=0).stop 2023-10-08T06:10:17.351 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.347+0000 7fa568dd8700 1 -- 172.21.15.32:0/3832986426 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa56415b980 msgr2=0x7fa5640b1f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:17.351 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.347+0000 7fa568dd8700 1 --2- 172.21.15.32:0/3832986426 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa56415b980 0x7fa5640b1f30 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fa55400e8e0 tx=0x7fa55400eca0 comp rx=0 tx=0).stop 2023-10-08T06:10:17.351 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.347+0000 7fa568dd8700 1 -- 172.21.15.32:0/3832986426 shutdown_connections 2023-10-08T06:10:17.351 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.347+0000 7fa568dd8700 1 --2- 172.21.15.32:0/3832986426 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fa550066510 0x7fa5500689d0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:17.351 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.347+0000 7fa568dd8700 1 --2- 172.21.15.32:0/3832986426 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa56415b980 0x7fa5640b1f30 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:17.351 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.347+0000 7fa568dd8700 1 --2- 172.21.15.32:0/3832986426 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa5640c9960 0x7fa5640b19f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:17.351 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.347+0000 7fa568dd8700 1 --2- 172.21.15.32:0/3832986426 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa5640719e0 0x7fa564148dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:17.351 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.347+0000 7fa568dd8700 1 -- 172.21.15.32:0/3832986426 >> 172.21.15.32:0/3832986426 conn(0x7fa5640b0900 msgr2=0x7fa5640ca950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:10:17.351 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.347+0000 7fa568dd8700 1 -- 172.21.15.32:0/3832986426 shutdown_connections 2023-10-08T06:10:17.352 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.347+0000 7fa568dd8700 1 -- 172.21.15.32:0/3832986426 wait complete. 2023-10-08T06:10:17.363 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T06:09:23.307843+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-08T06:09:34.295012+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-08T06:09:35.515590+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-08T06:10:17.363 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T06:10:17.487 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.483+0000 7efcc0c37700 1 Processor -- start 2023-10-08T06:10:17.487 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.483+0000 7efcc0c37700 1 -- start start 2023-10-08T06:10:17.489 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.487+0000 7efcc0c37700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efcbc0b3530 0x7efcbc06cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:17.489 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.487+0000 7efcc0c37700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efcbc0b2a90 con 0x7efcbc0cdd60 2023-10-08T06:10:17.489 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.487+0000 7efcc0c37700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efcbc0d0a10 con 0x7efcbc15cf80 2023-10-08T06:10:17.489 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.487+0000 7efcc0c37700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcbc0d0cf0 con 0x7efcbc0b3530 2023-10-08T06:10:17.489 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.487+0000 7efcb3fff700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7efcbc0cdd60 0x7efcbc0cc4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:45938/0 (socket says 172.21.15.32:45938) 2023-10-08T06:10:17.490 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.487+0000 7efcb3fff700 1 -- 172.21.15.32:0/3556820597 learned_addr learned my addr 172.21.15.32:0/3556820597 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-08T06:10:17.491 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.487+0000 7efcbbfff700 1 --2- 172.21.15.32:0/3556820597 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efcbc0b3530 0x7efcbc06cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:17.491 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.487+0000 7efcbaffd700 1 -- 172.21.15.32:0/3556820597 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2847881520 0 0) 0x7efcbc0b2a90 con 0x7efcbc0cdd60 2023-10-08T06:10:17.491 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.487+0000 7efcbaffd700 1 -- 172.21.15.32:0/3556820597 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efc9c0035d0 con 0x7efcbc0cdd60 2023-10-08T06:10:17.491 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.487+0000 7efcbaffd700 1 -- 172.21.15.32:0/3556820597 <== mon.1 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2443529635 0 0) 0x7efcbc0d0a10 con 0x7efcbc15cf80 2023-10-08T06:10:17.491 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.487+0000 7efcbaffd700 1 -- 172.21.15.32:0/3556820597 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efcbc0b2a90 con 0x7efcbc15cf80 2023-10-08T06:10:17.492 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.487+0000 7efcbbfff700 1 -- 172.21.15.32:0/3556820597 >> v1:172.21.15.40:6789/0 conn(0x7efcbc15cf80 legacy=0x7efcbc0cd650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:17.492 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.487+0000 7efcbbfff700 1 -- 172.21.15.32:0/3556820597 >> v1:172.21.15.32:6789/0 conn(0x7efcbc0cdd60 legacy=0x7efcbc0cc4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:17.492 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.487+0000 7efcbbfff700 1 -- 172.21.15.32:0/3556820597 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcbc0b2d30 con 0x7efcbc0b3530 2023-10-08T06:10:17.492 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.487+0000 7efcbbfff700 1 --2- 172.21.15.32:0/3556820597 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efcbc0b3530 0x7efcbc06cfe0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7efcb4009dc0 tx=0x7efcb400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=214cc768ea3cc329 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:17.492 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.487+0000 7efcbaffd700 1 -- 172.21.15.32:0/3556820597 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcb400e070 con 0x7efcbc0b3530 2023-10-08T06:10:17.492 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.487+0000 7efcbaffd700 1 -- 172.21.15.32:0/3556820597 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcb400bb20 con 0x7efcbc0b3530 2023-10-08T06:10:17.492 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.487+0000 7efcbaffd700 1 -- 172.21.15.32:0/3556820597 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcb4012430 con 0x7efcbc0b3530 2023-10-08T06:10:17.493 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.491+0000 7efcc0c37700 1 -- 172.21.15.32:0/3556820597 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efcbc0b3530 msgr2=0x7efcbc06cfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:17.493 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.491+0000 7efcc0c37700 1 --2- 172.21.15.32:0/3556820597 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efcbc0b3530 0x7efcbc06cfe0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7efcb4009dc0 tx=0x7efcb400b330 comp rx=0 tx=0).stop 2023-10-08T06:10:17.493 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.491+0000 7efcc0c37700 1 -- 172.21.15.32:0/3556820597 shutdown_connections 2023-10-08T06:10:17.493 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.491+0000 7efcc0c37700 1 --2- 172.21.15.32:0/3556820597 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efcbc0b3530 0x7efcbc06cfe0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:17.493 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.491+0000 7efcc0c37700 1 -- 172.21.15.32:0/3556820597 >> 172.21.15.32:0/3556820597 conn(0x7efcbc06dfa0 msgr2=0x7efcbc06e380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:10:17.493 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.491+0000 7efcc0c37700 1 -- 172.21.15.32:0/3556820597 shutdown_connections 2023-10-08T06:10:17.493 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.491+0000 7efcc0c37700 1 -- 172.21.15.32:0/3556820597 wait complete. 2023-10-08T06:10:17.494 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.491+0000 7efcc0c37700 1 Processor -- start 2023-10-08T06:10:17.494 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.491+0000 7efcc0c37700 1 -- start start 2023-10-08T06:10:17.495 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.491+0000 7efcc0c37700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efcbc0b3530 0x7efcbc158850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:17.495 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.491+0000 7efcc0c37700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efcbc0cdd60 0x7efcbc0b4790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:17.495 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.491+0000 7efcc0c37700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efcbc15cf80 0x7efcbc0aeba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:17.496 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.491+0000 7efcc0c37700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcbc0aca90 con 0x7efcbc0b3530 2023-10-08T06:10:17.496 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.491+0000 7efcc0c37700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcbc0af440 con 0x7efcbc0cdd60 2023-10-08T06:10:17.496 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.491+0000 7efcc0c37700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcbc0acd30 con 0x7efcbc15cf80 2023-10-08T06:10:17.496 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.491+0000 7efcbb7fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efcbc0b3530 0x7efcbc158850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:17.497 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.491+0000 7efcbb7fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efcbc0b3530 0x7efcbc158850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:46876/0 (socket says 172.21.15.32:46876) 2023-10-08T06:10:17.497 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.491+0000 7efcbb7fe700 1 -- 172.21.15.32:0/1926031224 learned_addr learned my addr 172.21.15.32:0/1926031224 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:10:17.497 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.491+0000 7efcbbfff700 1 --2- 172.21.15.32:0/1926031224 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efcbc15cf80 0x7efcbc0aeba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:17.497 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.491+0000 7efcb3fff700 1 --2- 172.21.15.32:0/1926031224 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efcbc0cdd60 0x7efcbc0b4790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:17.497 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.495+0000 7efcbb7fe700 1 -- 172.21.15.32:0/1926031224 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efcbc15cf80 msgr2=0x7efcbc0aeba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:17.497 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.495+0000 7efcbb7fe700 1 --2- 172.21.15.32:0/1926031224 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efcbc15cf80 0x7efcbc0aeba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:17.497 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.495+0000 7efcbb7fe700 1 -- 172.21.15.32:0/1926031224 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efcbc0cdd60 msgr2=0x7efcbc0b4790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:17.497 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.495+0000 7efcbb7fe700 1 --2- 172.21.15.32:0/1926031224 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efcbc0cdd60 0x7efcbc0b4790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:17.497 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.495+0000 7efcbb7fe700 1 -- 172.21.15.32:0/1926031224 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcb4009a70 con 0x7efcbc0b3530 2023-10-08T06:10:17.498 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.495+0000 7efcb3fff700 1 --2- 172.21.15.32:0/1926031224 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efcbc0cdd60 0x7efcbc0b4790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T06:10:17.498 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.495+0000 7efcbbfff700 1 --2- 172.21.15.32:0/1926031224 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efcbc15cf80 0x7efcbc0aeba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T06:10:17.498 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.495+0000 7efcbb7fe700 1 --2- 172.21.15.32:0/1926031224 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efcbc0b3530 0x7efcbc158850 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7efcac00c730 tx=0x7efcac00caf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:17.498 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.495+0000 7efcb8ff9700 1 -- 172.21.15.32:0/1926031224 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcac0052d0 con 0x7efcbc0b3530 2023-10-08T06:10:17.498 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.495+0000 7efcb8ff9700 1 -- 172.21.15.32:0/1926031224 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcac005430 con 0x7efcbc0b3530 2023-10-08T06:10:17.498 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.495+0000 7efcc0c37700 1 -- 172.21.15.32:0/1926031224 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcbc0ad010 con 0x7efcbc0b3530 2023-10-08T06:10:17.498 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.495+0000 7efcc0c37700 1 -- 172.21.15.32:0/1926031224 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcbc0af0e0 con 0x7efcbc0b3530 2023-10-08T06:10:17.498 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.495+0000 7efcb8ff9700 1 -- 172.21.15.32:0/1926031224 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcac0055a0 con 0x7efcbc0b3530 2023-10-08T06:10:17.499 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.495+0000 7efcc0c37700 1 -- 172.21.15.32:0/1926031224 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efcbc0686a0 con 0x7efcbc0b3530 2023-10-08T06:10:17.499 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.499+0000 7efcb8ff9700 1 -- 172.21.15.32:0/1926031224 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7efcac0038e0 con 0x7efcbc0b3530 2023-10-08T06:10:17.500 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.499+0000 7efcb8ff9700 1 --2- 172.21.15.32:0/1926031224 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7efca0066510 0x7efca00689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:17.500 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.499+0000 7efcb8ff9700 1 -- 172.21.15.32:0/1926031224 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efcac0834a0 con 0x7efcbc0b3530 2023-10-08T06:10:17.500 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.499+0000 7efcb3fff700 1 --2- 172.21.15.32:0/1926031224 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7efca0066510 0x7efca00689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:17.501 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.499+0000 7efcb3fff700 1 --2- 172.21.15.32:0/1926031224 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7efca0066510 0x7efca00689d0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7efcbc0afaf0 tx=0x7efca4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:17.508 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.507+0000 7efcb8ff9700 1 -- 172.21.15.32:0/1926031224 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7efcac0508a0 con 0x7efcbc0b3530 2023-10-08T06:10:17.677 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.675+0000 7efcc0c37700 1 -- 172.21.15.32:0/1926031224 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7efcbc06ff40 con 0x7efcbc0b3530 2023-10-08T06:10:17.678 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.675+0000 7efcb8ff9700 1 -- 172.21.15.32:0/1926031224 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7efcac053ec0 con 0x7efcbc0b3530 2023-10-08T06:10:17.678 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 1 2023-10-08T06:10:17.680 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.679+0000 7efcc0c37700 1 -- 172.21.15.32:0/1926031224 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7efca0066510 msgr2=0x7efca00689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:17.680 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.679+0000 7efcc0c37700 1 --2- 172.21.15.32:0/1926031224 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7efca0066510 0x7efca00689d0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7efcbc0afaf0 tx=0x7efca4009040 comp rx=0 tx=0).stop 2023-10-08T06:10:17.680 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.679+0000 7efcc0c37700 1 -- 172.21.15.32:0/1926031224 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efcbc0b3530 msgr2=0x7efcbc158850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:17.681 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.679+0000 7efcc0c37700 1 --2- 172.21.15.32:0/1926031224 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efcbc0b3530 0x7efcbc158850 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7efcac00c730 tx=0x7efcac00caf0 comp rx=0 tx=0).stop 2023-10-08T06:10:17.681 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.679+0000 7efcc0c37700 1 -- 172.21.15.32:0/1926031224 shutdown_connections 2023-10-08T06:10:17.681 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.679+0000 7efcc0c37700 1 --2- 172.21.15.32:0/1926031224 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7efca0066510 0x7efca00689d0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:17.681 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.679+0000 7efcc0c37700 1 --2- 172.21.15.32:0/1926031224 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efcbc15cf80 0x7efcbc0aeba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:17.681 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.679+0000 7efcc0c37700 1 --2- 172.21.15.32:0/1926031224 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efcbc0cdd60 0x7efcbc0b4790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:17.681 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.679+0000 7efcc0c37700 1 --2- 172.21.15.32:0/1926031224 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efcbc0b3530 0x7efcbc158850 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:17.681 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.679+0000 7efcc0c37700 1 -- 172.21.15.32:0/1926031224 >> 172.21.15.32:0/1926031224 conn(0x7efcbc06dfa0 msgr2=0x7efcbc15dff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:10:17.681 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.679+0000 7efcc0c37700 1 -- 172.21.15.32:0/1926031224 shutdown_connections 2023-10-08T06:10:17.681 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.679+0000 7efcc0c37700 1 -- 172.21.15.32:0/1926031224 wait complete. 2023-10-08T06:10:17.693 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-08T06:10:17.811 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.807+0000 7f391a814700 1 Processor -- start 2023-10-08T06:10:17.811 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.807+0000 7f391a814700 1 -- start start 2023-10-08T06:10:17.813 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.811+0000 7f391a814700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f391406e8d0 0x7f391415eda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:17.813 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.811+0000 7f391a814700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f391406a9b0 0x7f39140cc170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:17.813 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.811+0000 7f391a814700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f391406ecb0 con 0x7f39140cbd10 2023-10-08T06:10:17.813 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.811+0000 7f391a814700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3914155d30 con 0x7f391406a9b0 2023-10-08T06:10:17.813 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.811+0000 7f391a814700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39140b1800 con 0x7f391406e8d0 2023-10-08T06:10:17.813 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.811+0000 7f3919011700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f39140cbd10 0x7f391406a2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:45948/0 (socket says 172.21.15.32:45948) 2023-10-08T06:10:17.813 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.811+0000 7f3919011700 1 -- 172.21.15.32:0/1838570957 learned_addr learned my addr 172.21.15.32:0/1838570957 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-08T06:10:17.814 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.811+0000 7f391a013700 1 --2- 172.21.15.32:0/1838570957 >> v2:172.21.15.40:3300/0 conn(0x7f391406a9b0 0x7f39140cc170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:17.814 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.811+0000 7f3919812700 1 --2- 172.21.15.32:0/1838570957 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f391406e8d0 0x7f391415eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:17.814 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.811+0000 7f3918810700 1 -- 172.21.15.32:0/1838570957 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3761067629 0 0) 0x7f391406ecb0 con 0x7f39140cbd10 2023-10-08T06:10:17.814 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.811+0000 7f3918810700 1 -- 172.21.15.32:0/1838570957 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f39000035d0 con 0x7f39140cbd10 2023-10-08T06:10:17.815 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.811+0000 7f391a013700 1 -- 172.21.15.32:0/1838570957 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f391406e8d0 msgr2=0x7f391415eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:10:17.816 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.811+0000 7f391a013700 1 --2- 172.21.15.32:0/1838570957 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f391406e8d0 0x7f391415eda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:17.816 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.811+0000 7f391a013700 1 -- 172.21.15.32:0/1838570957 >> v1:172.21.15.32:6789/0 conn(0x7f39140cbd10 legacy=0x7f391406a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:17.816 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.811+0000 7f391a013700 1 -- 172.21.15.32:0/1838570957 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39140b1a50 con 0x7f391406a9b0 2023-10-08T06:10:17.816 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.811+0000 7f391a013700 1 --2- 172.21.15.32:0/1838570957 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f391406a9b0 0x7f39140cc170 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f390c009d90 tx=0x7f390c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=19a363b4054049fb server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:17.816 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.811+0000 7f3918810700 1 -- 172.21.15.32:0/1838570957 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f390c00e070 con 0x7f391406a9b0 2023-10-08T06:10:17.816 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.811+0000 7f3918810700 1 -- 172.21.15.32:0/1838570957 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f390c00bb20 con 0x7f391406a9b0 2023-10-08T06:10:17.816 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.811+0000 7f3918810700 1 -- 172.21.15.32:0/1838570957 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f390c012430 con 0x7f391406a9b0 2023-10-08T06:10:17.816 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.811+0000 7f391a814700 1 -- 172.21.15.32:0/1838570957 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f391406a9b0 msgr2=0x7f39140cc170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:17.816 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.811+0000 7f391a814700 1 --2- 172.21.15.32:0/1838570957 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f391406a9b0 0x7f39140cc170 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f390c009d90 tx=0x7f390c00b330 comp rx=0 tx=0).stop 2023-10-08T06:10:17.816 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.811+0000 7f391a814700 1 -- 172.21.15.32:0/1838570957 shutdown_connections 2023-10-08T06:10:17.817 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.811+0000 7f391a814700 1 --2- 172.21.15.32:0/1838570957 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f391406a9b0 0x7f39140cc170 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:17.817 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.811+0000 7f391a814700 1 --2- 172.21.15.32:0/1838570957 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f391406e8d0 0x7f391415eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:17.817 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.811+0000 7f391a814700 1 -- 172.21.15.32:0/1838570957 >> 172.21.15.32:0/1838570957 conn(0x7f39140cc800 msgr2=0x7f39140ccbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:10:17.817 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.811+0000 7f391a814700 1 -- 172.21.15.32:0/1838570957 shutdown_connections 2023-10-08T06:10:17.817 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.815+0000 7f391a814700 1 -- 172.21.15.32:0/1838570957 wait complete. 2023-10-08T06:10:17.818 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.815+0000 7f391a814700 1 Processor -- start 2023-10-08T06:10:17.819 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.815+0000 7f391a814700 1 -- start start 2023-10-08T06:10:17.821 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.819+0000 7f391a814700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f391406a9b0 0x7f3914154600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:17.822 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.819+0000 7f391a814700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f391406e8d0 0x7f39140c4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:17.822 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.819+0000 7f391a814700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f39140cbd10 0x7f39140c53e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:17.822 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.819+0000 7f391a814700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f391415b040 con 0x7f39140cbd10 2023-10-08T06:10:17.822 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.819+0000 7f391a814700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39141551e0 con 0x7f391406e8d0 2023-10-08T06:10:17.822 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.819+0000 7f391a814700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f391415a3c0 con 0x7f391406a9b0 2023-10-08T06:10:17.822 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.819+0000 7f391a013700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f39140cbd10 0x7f39140c53e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:17.822 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.819+0000 7f391a013700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f39140cbd10 0x7f39140c53e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:46884/0 (socket says 172.21.15.32:46884) 2023-10-08T06:10:17.822 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.819+0000 7f391a013700 1 -- 172.21.15.32:0/2898021090 learned_addr learned my addr 172.21.15.32:0/2898021090 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:10:17.822 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.819+0000 7f3919011700 1 --2- 172.21.15.32:0/2898021090 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f391406e8d0 0x7f39140c4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:17.822 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.819+0000 7f3919812700 1 --2- 172.21.15.32:0/2898021090 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f391406a9b0 0x7f3914154600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:17.823 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.819+0000 7f391a013700 1 -- 172.21.15.32:0/2898021090 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f391406a9b0 msgr2=0x7f3914154600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:17.823 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.819+0000 7f391a013700 1 --2- 172.21.15.32:0/2898021090 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f391406a9b0 0x7f3914154600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:17.823 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.819+0000 7f391a013700 1 -- 172.21.15.32:0/2898021090 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f391406e8d0 msgr2=0x7f39140c4ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:17.823 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.819+0000 7f391a013700 1 --2- 172.21.15.32:0/2898021090 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f391406e8d0 0x7f39140c4ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:17.823 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.819+0000 7f391a013700 1 -- 172.21.15.32:0/2898021090 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f390c009a70 con 0x7f39140cbd10 2023-10-08T06:10:17.823 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.819+0000 7f391a013700 1 --2- 172.21.15.32:0/2898021090 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f39140cbd10 0x7f39140c53e0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f390c014040 tx=0x7f390c004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:17.824 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.819+0000 7f39067fc700 1 -- 172.21.15.32:0/2898021090 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f390c012430 con 0x7f39140cbd10 2023-10-08T06:10:17.824 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.819+0000 7f39067fc700 1 -- 172.21.15.32:0/2898021090 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f390c020070 con 0x7f39140cbd10 2023-10-08T06:10:17.824 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.819+0000 7f39067fc700 1 -- 172.21.15.32:0/2898021090 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f390c0098f0 con 0x7f39140cbd10 2023-10-08T06:10:17.824 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.819+0000 7f391a814700 1 -- 172.21.15.32:0/2898021090 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f391415a6a0 con 0x7f39140cbd10 2023-10-08T06:10:17.824 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.819+0000 7f391a814700 1 -- 172.21.15.32:0/2898021090 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f391415ac60 con 0x7f39140cbd10 2023-10-08T06:10:17.824 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.823+0000 7f391a814700 1 -- 172.21.15.32:0/2898021090 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39140686a0 con 0x7f39140cbd10 2023-10-08T06:10:17.825 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.823+0000 7f39067fc700 1 -- 172.21.15.32:0/2898021090 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f390c004040 con 0x7f39140cbd10 2023-10-08T06:10:17.825 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.823+0000 7f39067fc700 1 --2- 172.21.15.32:0/2898021090 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f38f8066540 0x7f38f8068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:17.826 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.823+0000 7f39067fc700 1 -- 172.21.15.32:0/2898021090 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f390c022070 con 0x7f39140cbd10 2023-10-08T06:10:17.826 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.823+0000 7f3919812700 1 --2- 172.21.15.32:0/2898021090 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f38f8066540 0x7f38f8068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:17.826 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.823+0000 7f3919812700 1 --2- 172.21.15.32:0/2898021090 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f38f8066540 0x7f38f8068a00 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f3914155940 tx=0x7f3910009240 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:17.830 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.827+0000 7f39067fc700 1 -- 172.21.15.32:0/2898021090 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f390c056850 con 0x7f39140cbd10 2023-10-08T06:10:17.995 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.991+0000 7f391a814700 1 -- 172.21.15.32:0/2898021090 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f39140b1fe0 con 0x7f39140cbd10 2023-10-08T06:10:17.996 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.995+0000 7f39067fc700 1 -- 172.21.15.32:0/2898021090 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f390c02c020 con 0x7f39140cbd10 2023-10-08T06:10:17.996 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 32 2023-10-08T06:10:17.998 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.995+0000 7f391a814700 1 -- 172.21.15.32:0/2898021090 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f38f8066540 msgr2=0x7f38f8068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:17.998 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.995+0000 7f391a814700 1 --2- 172.21.15.32:0/2898021090 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f38f8066540 0x7f38f8068a00 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f3914155940 tx=0x7f3910009240 comp rx=0 tx=0).stop 2023-10-08T06:10:17.998 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.995+0000 7f391a814700 1 -- 172.21.15.32:0/2898021090 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f39140cbd10 msgr2=0x7f39140c53e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:17.998 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.995+0000 7f391a814700 1 --2- 172.21.15.32:0/2898021090 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f39140cbd10 0x7f39140c53e0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f390c014040 tx=0x7f390c004af0 comp rx=0 tx=0).stop 2023-10-08T06:10:17.999 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.995+0000 7f391a814700 1 -- 172.21.15.32:0/2898021090 shutdown_connections 2023-10-08T06:10:17.999 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.995+0000 7f391a814700 1 --2- 172.21.15.32:0/2898021090 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f38f8066540 0x7f38f8068a00 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:17.999 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.995+0000 7f391a814700 1 --2- 172.21.15.32:0/2898021090 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f39140cbd10 0x7f39140c53e0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:17.999 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.995+0000 7f391a814700 1 --2- 172.21.15.32:0/2898021090 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f391406e8d0 0x7f39140c4ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:17.999 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.995+0000 7f391a814700 1 --2- 172.21.15.32:0/2898021090 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f391406a9b0 0x7f3914154600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:17.999 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.995+0000 7f391a814700 1 -- 172.21.15.32:0/2898021090 >> 172.21.15.32:0/2898021090 conn(0x7f39140cc800 msgr2=0x7f39140d03f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:10:17.999 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.995+0000 7f391a814700 1 -- 172.21.15.32:0/2898021090 shutdown_connections 2023-10-08T06:10:17.999 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:17.995+0000 7f391a814700 1 -- 172.21.15.32:0/2898021090 wait complete. 2023-10-08T06:10:18.011 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-08T06:10:18.134 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.131+0000 7fc373fff700 1 Processor -- start 2023-10-08T06:10:18.134 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.131+0000 7fc373fff700 1 -- start start 2023-10-08T06:10:18.136 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.131+0000 7fc373fff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc37415d490 0x7fc3740b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:18.136 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.131+0000 7fc373fff700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fc3740ce4e0 0x7fc3740b6130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:18.136 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.131+0000 7fc373fff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3740d1bb0 con 0x7fc3740d13d0 2023-10-08T06:10:18.136 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.131+0000 7fc373fff700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3740d1e90 con 0x7fc3740ce4e0 2023-10-08T06:10:18.137 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.131+0000 7fc373fff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3740d2170 con 0x7fc37415d490 2023-10-08T06:10:18.137 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.131+0000 7fc3737fe700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fc3740ce4e0 0x7fc3740b6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:18.137 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.131+0000 7fc3737fe700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fc3740ce4e0 0x7fc3740b6130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:46900/0 (socket says 172.21.15.32:46900) 2023-10-08T06:10:18.137 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.131+0000 7fc3737fe700 1 -- 172.21.15.32:0/1643059508 learned_addr learned my addr 172.21.15.32:0/1643059508 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:10:18.137 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.131+0000 7fc372ffd700 1 --2- 172.21.15.32:0/1643059508 >> v2:172.21.15.40:3300/0 conn(0x7fc37415d490 0x7fc3740b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:18.137 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.131+0000 7fc3737fe700 1 -- 172.21.15.32:0/1643059508 >> v2:172.21.15.40:3300/0 conn(0x7fc37415d490 msgr2=0x7fc3740b8bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:10:18.138 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.131+0000 7fc3737fe700 1 --2- 172.21.15.32:0/1643059508 >> v2:172.21.15.40:3300/0 conn(0x7fc37415d490 0x7fc3740b8bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:18.138 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.135+0000 7fc3737fe700 1 -- 172.21.15.32:0/1643059508 >> v1:172.21.15.40:6789/0 conn(0x7fc3740d13d0 legacy=0x7fc3740cddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:18.138 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.135+0000 7fc3737fe700 1 -- 172.21.15.32:0/1643059508 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3740d2450 con 0x7fc3740ce4e0 2023-10-08T06:10:18.138 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.135+0000 7fc372ffd700 1 --2- 172.21.15.32:0/1643059508 >> v2:172.21.15.40:3300/0 conn(0x7fc37415d490 0x7fc3740b8bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T06:10:18.138 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.135+0000 7fc3737fe700 1 --2- 172.21.15.32:0/1643059508 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc3740ce4e0 0x7fc3740b6130 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fc374066df0 tx=0x7fc36c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d215274e0d3dae87 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:18.138 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.135+0000 7fc371ffb700 1 -- 172.21.15.32:0/1643059508 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc36c00e070 con 0x7fc3740ce4e0 2023-10-08T06:10:18.138 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.135+0000 7fc371ffb700 1 -- 172.21.15.32:0/1643059508 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc36c00b9c0 con 0x7fc3740ce4e0 2023-10-08T06:10:18.139 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.135+0000 7fc371ffb700 1 -- 172.21.15.32:0/1643059508 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc36c00bd70 con 0x7fc3740ce4e0 2023-10-08T06:10:18.140 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.135+0000 7fc373fff700 1 -- 172.21.15.32:0/1643059508 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc3740ce4e0 msgr2=0x7fc3740b6130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:18.140 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.135+0000 7fc373fff700 1 --2- 172.21.15.32:0/1643059508 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc3740ce4e0 0x7fc3740b6130 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fc374066df0 tx=0x7fc36c00b330 comp rx=0 tx=0).stop 2023-10-08T06:10:18.140 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.135+0000 7fc373fff700 1 -- 172.21.15.32:0/1643059508 shutdown_connections 2023-10-08T06:10:18.140 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.135+0000 7fc373fff700 1 --2- 172.21.15.32:0/1643059508 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc3740ce4e0 0x7fc3740b6130 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:18.140 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.135+0000 7fc373fff700 1 --2- 172.21.15.32:0/1643059508 >> v2:172.21.15.40:3300/0 conn(0x7fc37415d490 0x7fc3740b8bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:18.140 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.135+0000 7fc373fff700 1 -- 172.21.15.32:0/1643059508 >> 172.21.15.32:0/1643059508 conn(0x7fc37406ab40 msgr2=0x7fc37406af20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:10:18.140 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.135+0000 7fc373fff700 1 -- 172.21.15.32:0/1643059508 shutdown_connections 2023-10-08T06:10:18.141 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.135+0000 7fc373fff700 1 -- 172.21.15.32:0/1643059508 wait complete. 2023-10-08T06:10:18.141 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.139+0000 7fc373fff700 1 Processor -- start 2023-10-08T06:10:18.141 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.139+0000 7fc373fff700 1 -- start start 2023-10-08T06:10:18.144 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.139+0000 7fc373fff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc3740ce4e0 0x7fc3740d39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:18.144 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.139+0000 7fc373fff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc3740d13d0 0x7fc3740d3120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:18.144 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.139+0000 7fc373fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc37415d490 0x7fc3741f2190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:18.144 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.139+0000 7fc373fff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3740d3660 con 0x7fc37415d490 2023-10-08T06:10:18.144 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.139+0000 7fc373fff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc37414dae0 con 0x7fc3740d13d0 2023-10-08T06:10:18.144 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.139+0000 7fc373fff700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3741f26d0 con 0x7fc3740ce4e0 2023-10-08T06:10:18.145 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.139+0000 7fc3737fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc37415d490 0x7fc3741f2190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:18.145 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.139+0000 7fc3737fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc37415d490 0x7fc3741f2190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:46910/0 (socket says 172.21.15.32:46910) 2023-10-08T06:10:18.145 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.139+0000 7fc3737fe700 1 -- 172.21.15.32:0/3831872173 learned_addr learned my addr 172.21.15.32:0/3831872173 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:10:18.145 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.139+0000 7fc3727fc700 1 --2- 172.21.15.32:0/3831872173 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc3740d13d0 0x7fc3740d3120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:18.145 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.139+0000 7fc372ffd700 1 --2- 172.21.15.32:0/3831872173 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc3740ce4e0 0x7fc3740d39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:18.145 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.139+0000 7fc3737fe700 1 -- 172.21.15.32:0/3831872173 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc3740ce4e0 msgr2=0x7fc3740d39d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:18.146 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.139+0000 7fc3737fe700 1 --2- 172.21.15.32:0/3831872173 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc3740ce4e0 0x7fc3740d39d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:18.146 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.139+0000 7fc3737fe700 1 -- 172.21.15.32:0/3831872173 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc3740d13d0 msgr2=0x7fc3740d3120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:18.146 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.139+0000 7fc3737fe700 1 --2- 172.21.15.32:0/3831872173 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc3740d13d0 0x7fc3740d3120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:18.146 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.139+0000 7fc3737fe700 1 -- 172.21.15.32:0/3831872173 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc36c009b30 con 0x7fc37415d490 2023-10-08T06:10:18.146 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.139+0000 7fc372ffd700 1 --2- 172.21.15.32:0/3831872173 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc3740ce4e0 0x7fc3740d39d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T06:10:18.146 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.139+0000 7fc3737fe700 1 --2- 172.21.15.32:0/3831872173 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc37415d490 0x7fc3741f2190 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fc36c012000 tx=0x7fc36c004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:18.146 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.139+0000 7fc35b7fe700 1 -- 172.21.15.32:0/3831872173 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc36c004930 con 0x7fc37415d490 2023-10-08T06:10:18.147 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.139+0000 7fc35b7fe700 1 -- 172.21.15.32:0/3831872173 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc36c0099b0 con 0x7fc37415d490 2023-10-08T06:10:18.147 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.139+0000 7fc35b7fe700 1 -- 172.21.15.32:0/3831872173 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc36c01c680 con 0x7fc37415d490 2023-10-08T06:10:18.147 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.143+0000 7fc373fff700 1 -- 172.21.15.32:0/3831872173 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc37414d240 con 0x7fc37415d490 2023-10-08T06:10:18.147 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.143+0000 7fc373fff700 1 -- 172.21.15.32:0/3831872173 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc37414d800 con 0x7fc37415d490 2023-10-08T06:10:18.148 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.143+0000 7fc373fff700 1 -- 172.21.15.32:0/3831872173 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc374148170 con 0x7fc37415d490 2023-10-08T06:10:18.148 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.143+0000 7fc35b7fe700 1 -- 172.21.15.32:0/3831872173 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fc36c01c7e0 con 0x7fc37415d490 2023-10-08T06:10:18.148 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.147+0000 7fc35b7fe700 1 --2- 172.21.15.32:0/3831872173 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fc360066510 0x7fc3600689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:18.148 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.147+0000 7fc35b7fe700 1 -- 172.21.15.32:0/3831872173 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc36c085790 con 0x7fc37415d490 2023-10-08T06:10:18.148 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.147+0000 7fc372ffd700 1 --2- 172.21.15.32:0/3831872173 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fc360066510 0x7fc3600689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:18.149 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.147+0000 7fc372ffd700 1 --2- 172.21.15.32:0/3831872173 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fc360066510 0x7fc3600689d0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fc36800c9a0 tx=0x7fc368008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:18.154 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.151+0000 7fc35b7fe700 1 -- 172.21.15.32:0/3831872173 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fc374148170 con 0x7fc37415d490 2023-10-08T06:10:18.326 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.323+0000 7fc373fff700 1 -- 172.21.15.32:0/3831872173 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc374148170 con 0x7fc37415d490 2023-10-08T06:10:18.326 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.323+0000 7fc35b7fe700 1 -- 172.21.15.32:0/3831872173 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc374148170 con 0x7fc37415d490 2023-10-08T06:10:18.326 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 64 2023-10-08T06:10:18.329 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.327+0000 7fc373fff700 1 -- 172.21.15.32:0/3831872173 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fc360066510 msgr2=0x7fc3600689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:18.329 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.327+0000 7fc373fff700 1 --2- 172.21.15.32:0/3831872173 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fc360066510 0x7fc3600689d0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fc36800c9a0 tx=0x7fc368008040 comp rx=0 tx=0).stop 2023-10-08T06:10:18.329 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.327+0000 7fc373fff700 1 -- 172.21.15.32:0/3831872173 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc37415d490 msgr2=0x7fc3741f2190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:18.329 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.327+0000 7fc373fff700 1 --2- 172.21.15.32:0/3831872173 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc37415d490 0x7fc3741f2190 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fc36c012000 tx=0x7fc36c004af0 comp rx=0 tx=0).stop 2023-10-08T06:10:18.329 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.327+0000 7fc373fff700 1 -- 172.21.15.32:0/3831872173 shutdown_connections 2023-10-08T06:10:18.329 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.327+0000 7fc373fff700 1 --2- 172.21.15.32:0/3831872173 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fc360066510 0x7fc3600689d0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:18.329 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.327+0000 7fc373fff700 1 --2- 172.21.15.32:0/3831872173 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc37415d490 0x7fc3741f2190 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:18.329 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.327+0000 7fc373fff700 1 --2- 172.21.15.32:0/3831872173 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc3740d13d0 0x7fc3740d3120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:18.330 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.327+0000 7fc373fff700 1 --2- 172.21.15.32:0/3831872173 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc3740ce4e0 0x7fc3740d39d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:18.330 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.327+0000 7fc373fff700 1 -- 172.21.15.32:0/3831872173 >> 172.21.15.32:0/3831872173 conn(0x7fc37406ab40 msgr2=0x7fc37415c7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:10:18.330 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.327+0000 7fc373fff700 1 -- 172.21.15.32:0/3831872173 shutdown_connections 2023-10-08T06:10:18.330 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.327+0000 7fc373fff700 1 -- 172.21.15.32:0/3831872173 wait complete. 2023-10-08T06:10:18.345 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-08T06:10:18.452 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.447+0000 7fd3bd421700 1 Processor -- start 2023-10-08T06:10:18.452 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.447+0000 7fd3bd421700 1 -- start start 2023-10-08T06:10:18.452 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.451+0000 7fd3bd421700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd3b8158aa0 0x7fd3b815f550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:18.453 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.451+0000 7fd3bd421700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3b80d04d0 con 0x7fd3b80cb4c0 2023-10-08T06:10:18.453 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.451+0000 7fd3bd421700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3b80d0c60 con 0x7fd3b80cf150 2023-10-08T06:10:18.453 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.451+0000 7fd3bd421700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3b80cfc60 con 0x7fd3b8158aa0 2023-10-08T06:10:18.453 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.451+0000 7fd3b77fe700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fd3b80cb4c0 0x7fd3b80cea40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:45958/0 (socket says 172.21.15.32:45958) 2023-10-08T06:10:18.453 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.451+0000 7fd3b77fe700 1 -- 172.21.15.32:0/3625198793 learned_addr learned my addr 172.21.15.32:0/3625198793 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-08T06:10:18.456 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.451+0000 7fd3b7fff700 1 --2- 172.21.15.32:0/3625198793 >> v2:172.21.15.40:3300/0 conn(0x7fd3b8158aa0 0x7fd3b815f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:18.456 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.451+0000 7fd3b6ffd700 1 -- 172.21.15.32:0/3625198793 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1260284572 0 0) 0x7fd3b80d04d0 con 0x7fd3b80cb4c0 2023-10-08T06:10:18.456 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.451+0000 7fd3b6ffd700 1 -- 172.21.15.32:0/3625198793 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd3980035d0 con 0x7fd3b80cb4c0 2023-10-08T06:10:18.456 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.451+0000 7fd3b6ffd700 1 -- 172.21.15.32:0/3625198793 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3805603855 0 0) 0x7fd3980035d0 con 0x7fd3b80cb4c0 2023-10-08T06:10:18.456 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.451+0000 7fd3b6ffd700 1 -- 172.21.15.32:0/3625198793 >> v2:172.21.15.40:3300/0 conn(0x7fd3b8158aa0 msgr2=0x7fd3b815f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:10:18.456 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.451+0000 7fd3b6ffd700 1 --2- 172.21.15.32:0/3625198793 >> v2:172.21.15.40:3300/0 conn(0x7fd3b8158aa0 0x7fd3b815f550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:18.456 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.451+0000 7fd3b6ffd700 1 -- 172.21.15.32:0/3625198793 >> v1:172.21.15.40:6789/0 conn(0x7fd3b80cf150 legacy=0x7fd3b815b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:18.456 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.451+0000 7fd3b6ffd700 1 -- 172.21.15.32:0/3625198793 --> v1:172.21.15.32:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3b80cfe70 con 0x7fd3b80cb4c0 2023-10-08T06:10:18.456 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.451+0000 7fd3b6ffd700 1 -- 172.21.15.32:0/3625198793 <== mon.0 v1:172.21.15.32:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2364763317 0 0) 0x7fd3a00019f0 con 0x7fd3b80cb4c0 2023-10-08T06:10:18.456 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.451+0000 7fd3b6ffd700 1 -- 172.21.15.32:0/3625198793 >> v1:172.21.15.32:6789/0 conn(0x7fd3b80cb4c0 legacy=0x7fd3b80cea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:18.456 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.451+0000 7fd3b6ffd700 1 --2- 172.21.15.32:0/3625198793 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd398003a20 0x7fd398003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:18.457 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.451+0000 7fd3b6ffd700 1 --2- 172.21.15.32:0/3625198793 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd398004870 0x7fd398004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:18.457 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.451+0000 7fd3b6ffd700 1 --2- 172.21.15.32:0/3625198793 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd398005230 0x7fd39800ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:18.457 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.451+0000 7fd3b6ffd700 1 -- 172.21.15.32:0/3625198793 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3b80cfc60 con 0x7fd398003a20 2023-10-08T06:10:18.457 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.451+0000 7fd3b6ffd700 1 -- 172.21.15.32:0/3625198793 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd39800c0d0 con 0x7fd398005230 2023-10-08T06:10:18.457 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.451+0000 7fd3b6ffd700 1 -- 172.21.15.32:0/3625198793 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd39800c290 con 0x7fd398004870 2023-10-08T06:10:18.457 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.451+0000 7fd3b7fff700 1 --2- 172.21.15.32:0/3625198793 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd398003a20 0x7fd398003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:18.457 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.451+0000 7fd3b77fe700 1 --2- 172.21.15.32:0/3625198793 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd398004870 0x7fd398004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:18.457 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.451+0000 7fd3bcc20700 1 --2- 172.21.15.32:0/3625198793 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd398005230 0x7fd39800ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:18.458 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.451+0000 7fd3b7fff700 1 -- 172.21.15.32:0/3625198793 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd398004870 msgr2=0x7fd398004cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:10:18.458 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.451+0000 7fd3b7fff700 1 --2- 172.21.15.32:0/3625198793 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd398004870 0x7fd398004cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:18.458 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.451+0000 7fd3b7fff700 1 -- 172.21.15.32:0/3625198793 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd398005230 msgr2=0x7fd39800ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:10:18.458 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.451+0000 7fd3b7fff700 1 --2- 172.21.15.32:0/3625198793 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd398005230 0x7fd39800ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:18.458 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.451+0000 7fd3bcc20700 1 -- 172.21.15.32:0/3625198793 reap_dead start 2023-10-08T06:10:18.459 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.451+0000 7fd3b7fff700 1 -- 172.21.15.32:0/3625198793 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3980035d0 con 0x7fd398003a20 2023-10-08T06:10:18.459 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.451+0000 7fd3b7fff700 1 --2- 172.21.15.32:0/3625198793 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd398003a20 0x7fd398003e40 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fd3a8009b70 tx=0x7fd3980058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18c544ea9b4a4658 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:18.459 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.451+0000 7fd3b6ffd700 1 -- 172.21.15.32:0/3625198793 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3a800e6c0 con 0x7fd398003a20 2023-10-08T06:10:18.459 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.455+0000 7fd3b6ffd700 1 -- 172.21.15.32:0/3625198793 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3a800e820 con 0x7fd398003a20 2023-10-08T06:10:18.459 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.455+0000 7fd3b6ffd700 1 -- 172.21.15.32:0/3625198793 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3a800eb90 con 0x7fd398003a20 2023-10-08T06:10:18.462 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.455+0000 7fd3bd421700 1 -- 172.21.15.32:0/3625198793 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd398003a20 msgr2=0x7fd398003e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:18.462 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.455+0000 7fd3bd421700 1 --2- 172.21.15.32:0/3625198793 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd398003a20 0x7fd398003e40 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fd3a8009b70 tx=0x7fd3980058a0 comp rx=0 tx=0).stop 2023-10-08T06:10:18.462 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.455+0000 7fd3bd421700 1 -- 172.21.15.32:0/3625198793 shutdown_connections 2023-10-08T06:10:18.462 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.455+0000 7fd3bd421700 1 --2- 172.21.15.32:0/3625198793 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd398003a20 0x7fd398003e40 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:18.462 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.455+0000 7fd3bd421700 1 -- 172.21.15.32:0/3625198793 >> 172.21.15.32:0/3625198793 conn(0x7fd3b806df60 msgr2=0x7fd3b806e340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:10:18.462 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.455+0000 7fd3bd421700 1 -- 172.21.15.32:0/3625198793 shutdown_connections 2023-10-08T06:10:18.462 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.455+0000 7fd3bd421700 1 -- 172.21.15.32:0/3625198793 wait complete. 2023-10-08T06:10:18.462 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.455+0000 7fd3bd421700 1 Processor -- start 2023-10-08T06:10:18.462 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.455+0000 7fd3bd421700 1 -- start start 2023-10-08T06:10:18.462 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.459+0000 7fd3bd421700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd398003a20 0x7fd3b815db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:18.463 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.459+0000 7fd3bd421700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd3b815e0c0 0x7fd3b80c9600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:18.463 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.459+0000 7fd3bd421700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd3b8150c90 0x7fd3b80c9b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:18.463 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.459+0000 7fd3bd421700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3b815b6a0 con 0x7fd3b8150c90 2023-10-08T06:10:18.463 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.459+0000 7fd3bd421700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3b80ca480 con 0x7fd3b815e0c0 2023-10-08T06:10:18.463 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.459+0000 7fd3bd421700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3b80ca760 con 0x7fd398003a20 2023-10-08T06:10:18.463 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.459+0000 7fd3bcc20700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd3b8150c90 0x7fd3b80c9b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:18.463 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.459+0000 7fd3b7fff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd398003a20 0x7fd3b815db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:18.463 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.459+0000 7fd3bcc20700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd3b8150c90 0x7fd3b80c9b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:46924/0 (socket says 172.21.15.32:46924) 2023-10-08T06:10:18.463 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.459+0000 7fd3bcc20700 1 -- 172.21.15.32:0/1490680125 learned_addr learned my addr 172.21.15.32:0/1490680125 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:10:18.463 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.459+0000 7fd3b77fe700 1 --2- 172.21.15.32:0/1490680125 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd3b815e0c0 0x7fd3b80c9600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:18.463 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.459+0000 7fd3bcc20700 1 -- 172.21.15.32:0/1490680125 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd398003a20 msgr2=0x7fd3b815db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:18.464 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.459+0000 7fd3bcc20700 1 --2- 172.21.15.32:0/1490680125 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd398003a20 0x7fd3b815db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:18.464 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.459+0000 7fd3bcc20700 1 -- 172.21.15.32:0/1490680125 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd3b815e0c0 msgr2=0x7fd3b80c9600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:18.464 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.459+0000 7fd3bcc20700 1 --2- 172.21.15.32:0/1490680125 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd3b815e0c0 0x7fd3b80c9600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:18.464 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.459+0000 7fd3bcc20700 1 -- 172.21.15.32:0/1490680125 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3b80caa40 con 0x7fd3b8150c90 2023-10-08T06:10:18.464 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.459+0000 7fd3bcc20700 1 --2- 172.21.15.32:0/1490680125 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd3b8150c90 0x7fd3b80c9b40 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fd3b80b3a00 tx=0x7fd3b000e670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:18.464 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.459+0000 7fd3b4ff9700 1 -- 172.21.15.32:0/1490680125 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3b000edb0 con 0x7fd3b8150c90 2023-10-08T06:10:18.464 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.459+0000 7fd3b4ff9700 1 -- 172.21.15.32:0/1490680125 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3b0005070 con 0x7fd3b8150c90 2023-10-08T06:10:18.464 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.459+0000 7fd3bd421700 1 -- 172.21.15.32:0/1490680125 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3b815b330 con 0x7fd3b8150c90 2023-10-08T06:10:18.464 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.459+0000 7fd3b4ff9700 1 -- 172.21.15.32:0/1490680125 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3b0005420 con 0x7fd3b8150c90 2023-10-08T06:10:18.464 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.459+0000 7fd3bd421700 1 -- 172.21.15.32:0/1490680125 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3b80ca080 con 0x7fd3b8150c90 2023-10-08T06:10:18.465 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.459+0000 7fd3b4ff9700 1 -- 172.21.15.32:0/1490680125 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fd3b0006880 con 0x7fd3b8150c90 2023-10-08T06:10:18.465 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.459+0000 7fd3bd421700 1 -- 172.21.15.32:0/1490680125 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3b815b4f0 con 0x7fd3b8150c90 2023-10-08T06:10:18.465 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.463+0000 7fd3b4ff9700 1 --2- 172.21.15.32:0/1490680125 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fd39c066540 0x7fd39c068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:18.465 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.463+0000 7fd3b7fff700 1 --2- 172.21.15.32:0/1490680125 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fd39c066540 0x7fd39c068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:18.465 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.463+0000 7fd3b4ff9700 1 -- 172.21.15.32:0/1490680125 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fd3b0082db0 con 0x7fd3b8150c90 2023-10-08T06:10:18.466 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.463+0000 7fd3b7fff700 1 --2- 172.21.15.32:0/1490680125 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fd39c066540 0x7fd39c068a00 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fd3a80090b0 tx=0x7fd3a801f040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:18.472 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.471+0000 7fd3b4ff9700 1 -- 172.21.15.32:0/1490680125 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fd3b0050130 con 0x7fd3b8150c90 2023-10-08T06:10:18.652 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.651+0000 7fd3bd421700 1 -- 172.21.15.32:0/1490680125 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fd3b80686a0 con 0x7fd3b8150c90 2023-10-08T06:10:18.652 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.651+0000 7fd3b4ff9700 1 -- 172.21.15.32:0/1490680125 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v23) v1 ==== 80+0+0 (secure 0 0 0) 0x7fd3b0053750 con 0x7fd3b8150c90 2023-10-08T06:10:18.655 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.651+0000 7fd3bd421700 1 -- 172.21.15.32:0/1490680125 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fd39c066540 msgr2=0x7fd39c068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:18.655 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.651+0000 7fd3bd421700 1 --2- 172.21.15.32:0/1490680125 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fd39c066540 0x7fd39c068a00 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fd3a80090b0 tx=0x7fd3a801f040 comp rx=0 tx=0).stop 2023-10-08T06:10:18.655 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.651+0000 7fd3bd421700 1 -- 172.21.15.32:0/1490680125 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd3b8150c90 msgr2=0x7fd3b80c9b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:18.655 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.651+0000 7fd3bd421700 1 --2- 172.21.15.32:0/1490680125 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd3b8150c90 0x7fd3b80c9b40 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fd3b80b3a00 tx=0x7fd3b000e670 comp rx=0 tx=0).stop 2023-10-08T06:10:18.655 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.651+0000 7fd3bd421700 1 -- 172.21.15.32:0/1490680125 shutdown_connections 2023-10-08T06:10:18.655 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.651+0000 7fd3bd421700 1 --2- 172.21.15.32:0/1490680125 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fd39c066540 0x7fd39c068a00 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:18.656 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.651+0000 7fd3bd421700 1 --2- 172.21.15.32:0/1490680125 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd3b8150c90 0x7fd3b80c9b40 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:18.656 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.651+0000 7fd3bd421700 1 --2- 172.21.15.32:0/1490680125 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd3b815e0c0 0x7fd3b80c9600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:18.656 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.651+0000 7fd3bd421700 1 --2- 172.21.15.32:0/1490680125 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd398003a20 0x7fd3b815db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:18.656 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.651+0000 7fd3bd421700 1 -- 172.21.15.32:0/1490680125 >> 172.21.15.32:0/1490680125 conn(0x7fd3b806df60 msgr2=0x7fd3b80cd750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:10:18.656 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.651+0000 7fd3bd421700 1 -- 172.21.15.32:0/1490680125 shutdown_connections 2023-10-08T06:10:18.656 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.651+0000 7fd3bd421700 1 -- 172.21.15.32:0/1490680125 wait complete. 2023-10-08T06:10:18.656 INFO:teuthology.orchestra.run.smithi032.stderr:listed 0 entries 2023-10-08T06:10:18.667 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi032.front.sepia.ceph.com... 2023-10-08T06:10:18.667 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T06:10:18.667 DEBUG:teuthology.orchestra.run.smithi032:> sudo fusermount -u /home/ubuntu/cephtest/mnt.2 2023-10-08T06:10:18.681 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T06:10:18.681 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi032.front.sepia.ceph.com 2023-10-08T06:10:18.681 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T06:10:18.681 DEBUG:teuthology.orchestra.run.smithi032:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-10-08T06:10:18.687 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-10-08T06:10:18.687 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-08T06:10:18.695 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-10-08T06:10:18.695 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-08T06:10:18.703 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T06:10:18.852 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.847+0000 7fea7ffff700 1 Processor -- start 2023-10-08T06:10:18.852 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.847+0000 7fea7ffff700 1 -- start start 2023-10-08T06:10:18.853 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.851+0000 7fea7ffff700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fea8015b980 0x7fea8015f780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:18.853 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.851+0000 7fea7ffff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fea800c9b30 0x7fea8015bd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:18.853 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.851+0000 7fea7ffff700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea8006fc20 con 0x7fea800719e0 2023-10-08T06:10:18.853 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.851+0000 7fea7ffff700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea80070430 con 0x7fea8015b980 2023-10-08T06:10:18.853 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.851+0000 7fea7ffff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea8015ed70 con 0x7fea800c9b30 2023-10-08T06:10:18.853 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.851+0000 7fea7effd700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fea8015b980 0x7fea8015f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:18.853 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.851+0000 7fea7e7fc700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fea800719e0 0x7fea800c9420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:45960/0 (socket says 172.21.15.32:45960) 2023-10-08T06:10:18.854 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.851+0000 7fea7e7fc700 1 -- 172.21.15.32:0/4011670881 learned_addr learned my addr 172.21.15.32:0/4011670881 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-08T06:10:18.854 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.851+0000 7fea7f7fe700 1 --2- 172.21.15.32:0/4011670881 >> v2:172.21.15.40:3300/0 conn(0x7fea800c9b30 0x7fea8015bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:18.854 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.851+0000 7fea7dffb700 1 -- 172.21.15.32:0/4011670881 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2787905784 0 0) 0x7fea8006fc20 con 0x7fea800719e0 2023-10-08T06:10:18.854 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.851+0000 7fea7dffb700 1 -- 172.21.15.32:0/4011670881 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fea680035d0 con 0x7fea800719e0 2023-10-08T06:10:18.855 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.851+0000 7fea7effd700 1 -- 172.21.15.32:0/4011670881 >> v2:172.21.15.40:3300/0 conn(0x7fea800c9b30 msgr2=0x7fea8015bd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:10:18.855 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.851+0000 7fea7effd700 1 --2- 172.21.15.32:0/4011670881 >> v2:172.21.15.40:3300/0 conn(0x7fea800c9b30 0x7fea8015bd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:18.855 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.851+0000 7fea7effd700 1 -- 172.21.15.32:0/4011670881 >> v1:172.21.15.32:6789/0 conn(0x7fea800719e0 legacy=0x7fea800c9420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:18.855 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.851+0000 7fea7dffb700 1 -- 172.21.15.32:0/4011670881 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 892344975 0 0) 0x7fea680035d0 con 0x7fea800719e0 2023-10-08T06:10:18.855 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.851+0000 7fea7effd700 1 -- 172.21.15.32:0/4011670881 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea8015fcc0 con 0x7fea8015b980 2023-10-08T06:10:18.856 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.851+0000 7fea7effd700 1 --2- 172.21.15.32:0/4011670881 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fea8015b980 0x7fea8015f780 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fea800686d0 tx=0x7fea74009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2f6e7fad417e871 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:18.856 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.851+0000 7fea7dffb700 1 -- 172.21.15.32:0/4011670881 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea74011830 con 0x7fea8015b980 2023-10-08T06:10:18.856 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.851+0000 7fea7dffb700 1 -- 172.21.15.32:0/4011670881 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea74011990 con 0x7fea8015b980 2023-10-08T06:10:18.856 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.851+0000 7fea7dffb700 1 -- 172.21.15.32:0/4011670881 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea74011d00 con 0x7fea8015b980 2023-10-08T06:10:18.856 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.851+0000 7fea7ffff700 1 -- 172.21.15.32:0/4011670881 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fea8015b980 msgr2=0x7fea8015f780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:18.856 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.851+0000 7fea7ffff700 1 --2- 172.21.15.32:0/4011670881 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fea8015b980 0x7fea8015f780 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fea800686d0 tx=0x7fea74009b30 comp rx=0 tx=0).stop 2023-10-08T06:10:18.856 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.851+0000 7fea7ffff700 1 -- 172.21.15.32:0/4011670881 shutdown_connections 2023-10-08T06:10:18.856 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.851+0000 7fea7ffff700 1 --2- 172.21.15.32:0/4011670881 >> v2:172.21.15.40:3300/0 conn(0x7fea800c9b30 0x7fea8015bd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:18.856 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.851+0000 7fea7ffff700 1 --2- 172.21.15.32:0/4011670881 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fea8015b980 0x7fea8015f780 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:18.856 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.851+0000 7fea7ffff700 1 -- 172.21.15.32:0/4011670881 >> 172.21.15.32:0/4011670881 conn(0x7fea800b0900 msgr2=0x7fea800b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:10:18.856 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.851+0000 7fea7ffff700 1 -- 172.21.15.32:0/4011670881 shutdown_connections 2023-10-08T06:10:18.857 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.851+0000 7fea7ffff700 1 -- 172.21.15.32:0/4011670881 wait complete. 2023-10-08T06:10:18.858 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.855+0000 7fea7ffff700 1 Processor -- start 2023-10-08T06:10:18.858 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.855+0000 7fea7ffff700 1 -- start start 2023-10-08T06:10:18.862 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.859+0000 7fea7ffff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fea800719e0 0x7fea80149110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:18.862 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.859+0000 7fea7ffff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fea800c9b30 0x7fea8015de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:18.862 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.859+0000 7fea7ffff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fea8015b980 0x7fea8015e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:18.862 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.859+0000 7fea7ffff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea801f4260 con 0x7fea800719e0 2023-10-08T06:10:18.862 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.859+0000 7fea7ffff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea801f50c0 con 0x7fea8015b980 2023-10-08T06:10:18.862 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.859+0000 7fea7ffff700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea801f44b0 con 0x7fea800c9b30 2023-10-08T06:10:18.862 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.859+0000 7fea7effd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fea800719e0 0x7fea80149110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:18.862 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.859+0000 7fea7effd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fea800719e0 0x7fea80149110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:46954/0 (socket says 172.21.15.32:46954) 2023-10-08T06:10:18.862 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.859+0000 7fea7effd700 1 -- 172.21.15.32:0/572904091 learned_addr learned my addr 172.21.15.32:0/572904091 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:10:18.863 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.859+0000 7fea7e7fc700 1 --2- 172.21.15.32:0/572904091 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fea800c9b30 0x7fea8015de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:18.863 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.859+0000 7fea7f7fe700 1 --2- 172.21.15.32:0/572904091 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fea8015b980 0x7fea8015e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:18.863 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.859+0000 7fea7effd700 1 -- 172.21.15.32:0/572904091 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fea800c9b30 msgr2=0x7fea8015de80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:18.863 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.859+0000 7fea7effd700 1 --2- 172.21.15.32:0/572904091 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fea800c9b30 0x7fea8015de80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:18.863 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.859+0000 7fea7effd700 1 -- 172.21.15.32:0/572904091 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fea8015b980 msgr2=0x7fea8015e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:18.863 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.859+0000 7fea7effd700 1 --2- 172.21.15.32:0/572904091 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fea8015b980 0x7fea8015e3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:18.863 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.859+0000 7fea7effd700 1 -- 172.21.15.32:0/572904091 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea740094b0 con 0x7fea800719e0 2023-10-08T06:10:18.863 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.859+0000 7fea7effd700 1 --2- 172.21.15.32:0/572904091 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fea800719e0 0x7fea80149110 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fea74014040 tx=0x7fea74004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:18.863 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.859+0000 7fea677fe700 1 -- 172.21.15.32:0/572904091 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea74004510 con 0x7fea800719e0 2023-10-08T06:10:18.863 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.859+0000 7fea677fe700 1 -- 172.21.15.32:0/572904091 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea7401e070 con 0x7fea800719e0 2023-10-08T06:10:18.863 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.859+0000 7fea7ffff700 1 -- 172.21.15.32:0/572904091 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea801f4790 con 0x7fea800719e0 2023-10-08T06:10:18.864 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.859+0000 7fea677fe700 1 -- 172.21.15.32:0/572904091 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea74003900 con 0x7fea800719e0 2023-10-08T06:10:18.864 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.859+0000 7fea7ffff700 1 -- 172.21.15.32:0/572904091 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea801f4d50 con 0x7fea800719e0 2023-10-08T06:10:18.864 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.859+0000 7fea7ffff700 1 -- 172.21.15.32:0/572904091 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea8015f990 con 0x7fea800719e0 2023-10-08T06:10:18.864 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.863+0000 7fea677fe700 1 -- 172.21.15.32:0/572904091 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fea74003a60 con 0x7fea800719e0 2023-10-08T06:10:18.865 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.863+0000 7fea677fe700 1 --2- 172.21.15.32:0/572904091 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fea6c066540 0x7fea6c068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:18.865 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.863+0000 7fea677fe700 1 -- 172.21.15.32:0/572904091 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fea74084bd0 con 0x7fea800719e0 2023-10-08T06:10:18.865 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.863+0000 7fea7e7fc700 1 --2- 172.21.15.32:0/572904091 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fea6c066540 0x7fea6c068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:18.865 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.863+0000 7fea7e7fc700 1 --2- 172.21.15.32:0/572904091 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fea6c066540 0x7fea6c068a00 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fea80153e70 tx=0x7fea70009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:18.873 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:18.871+0000 7fea677fe700 1 -- 172.21.15.32:0/572904091 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fea74051fc0 con 0x7fea800719e0 2023-10-08T06:10:19.042 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.039+0000 7fea7ffff700 1 -- 172.21.15.32:0/572904091 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fea80073f00 con 0x7fea800719e0 2023-10-08T06:10:19.045 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.043+0000 7fea677fe700 1 -- 172.21.15.32:0/572904091 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16694 (secure 0 0 0) 0x7fea74020090 con 0x7fea800719e0 2023-10-08T06:10:19.045 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:10:19.045 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":23,"fsid":"ac672d87-96ae-41e0-9314-623ba2cdbbba","created":"2023-10-08T06:09:11.175626+0000","modified":"2023-10-08T06:10:18.249505+0000","last_up_change":"2023-10-08T06:09:22.744643+0000","last_in_change":"2023-10-08T06:09:14.131580+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T06:09:23.307843+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T06:09:34.295012+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T06:09:35.515590+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"43433f0c-9592-4874-92d7-10f8f4acf07f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":587888964},{"type":"v1","addr":"172.21.15.32:6801","nonce":587888964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":587888964},{"type":"v1","addr":"172.21.15.32:6803","nonce":587888964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":587888964},{"type":"v1","addr":"172.21.15.32:6810","nonce":587888964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6805","nonce":587888964},{"type":"v1","addr":"172.21.15.32:6807","nonce":587888964}]},"public_addr":"172.21.15.32:6801/587888964","cluster_addr":"172.21.15.32:6803/587888964","heartbeat_back_addr":"172.21.15.32:6810/587888964","heartbeat_front_addr":"172.21.15.32:6807/587888964","state":["exists","up"]},{"osd":1,"uuid":"2ecb1008-b987-4ce7-b646-6cded55fc8d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":990576767},{"type":"v1","addr":"172.21.15.32:6817","nonce":990576767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":990576767},{"type":"v1","addr":"172.21.15.32:6819","nonce":990576767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":990576767},{"type":"v1","addr":"172.21.15.32:6823","nonce":990576767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":990576767},{"type":"v1","addr":"172.21.15.32:6821","nonce":990576767}]},"public_addr":"172.21.15.32:6817/990576767","cluster_addr":"172.21.15.32:6819/990576767","heartbeat_back_addr":"172.21.15.32:6823/990576767","heartbeat_front_addr":"172.21.15.32:6821/990576767","state":["exists","up"]},{"osd":2,"uuid":"1b131c94-c09b-4e80-8746-bf1b7bac362d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6824","nonce":1566874440},{"type":"v1","addr":"172.21.15.32:6825","nonce":1566874440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":1566874440},{"type":"v1","addr":"172.21.15.32:6827","nonce":1566874440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":1566874440},{"type":"v1","addr":"172.21.15.32:6831","nonce":1566874440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":1566874440},{"type":"v1","addr":"172.21.15.32:6829","nonce":1566874440}]},"public_addr":"172.21.15.32:6825/1566874440","cluster_addr":"172.21.15.32:6827/1566874440","heartbeat_back_addr":"172.21.15.32:6831/1566874440","heartbeat_front_addr":"172.21.15.32:6829/1566874440","state":["exists","up"]},{"osd":3,"uuid":"ad655af2-1f6f-4689-b21d-b07bbaeb68b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":3672614802},{"type":"v1","addr":"172.21.15.32:6806","nonce":3672614802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6809","nonce":3672614802},{"type":"v1","addr":"172.21.15.32:6811","nonce":3672614802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":3672614802},{"type":"v1","addr":"172.21.15.32:6815","nonce":3672614802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":3672614802},{"type":"v1","addr":"172.21.15.32:6813","nonce":3672614802}]},"public_addr":"172.21.15.32:6806/3672614802","cluster_addr":"172.21.15.32:6811/3672614802","heartbeat_back_addr":"172.21.15.32:6815/3672614802","heartbeat_front_addr":"172.21.15.32:6813/3672614802","state":["exists","up"]},{"osd":4,"uuid":"64a543a1-8c4f-458e-9aba-b35c1cd7dd03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":3369928244},{"type":"v1","addr":"172.21.15.40:6801","nonce":3369928244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":3369928244},{"type":"v1","addr":"172.21.15.40:6803","nonce":3369928244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":3369928244},{"type":"v1","addr":"172.21.15.40:6807","nonce":3369928244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":3369928244},{"type":"v1","addr":"172.21.15.40:6805","nonce":3369928244}]},"public_addr":"172.21.15.40:6801/3369928244","cluster_addr":"172.21.15.40:6803/3369928244","heartbeat_back_addr":"172.21.15.40:6807/3369928244","heartbeat_front_addr":"172.21.15.40:6805/3369928244","state":["exists","up"]},{"osd":5,"uuid":"0fef3e54-edb4-4678-878e-944663c51638","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":2395850297},{"type":"v1","addr":"172.21.15.40:6825","nonce":2395850297}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":2395850297},{"type":"v1","addr":"172.21.15.40:6827","nonce":2395850297}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":2395850297},{"type":"v1","addr":"172.21.15.40:6831","nonce":2395850297}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":2395850297},{"type":"v1","addr":"172.21.15.40:6829","nonce":2395850297}]},"public_addr":"172.21.15.40:6825/2395850297","cluster_addr":"172.21.15.40:6827/2395850297","heartbeat_back_addr":"172.21.15.40:6831/2395850297","heartbeat_front_addr":"172.21.15.40:6829/2395850297","state":["exists","up"]},{"osd":6,"uuid":"2eeb0472-6096-469d-9b2c-cab4bf41c31a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":4145283410},{"type":"v1","addr":"172.21.15.40:6809","nonce":4145283410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":4145283410},{"type":"v1","addr":"172.21.15.40:6811","nonce":4145283410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":4145283410},{"type":"v1","addr":"172.21.15.40:6815","nonce":4145283410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":4145283410},{"type":"v1","addr":"172.21.15.40:6813","nonce":4145283410}]},"public_addr":"172.21.15.40:6809/4145283410","cluster_addr":"172.21.15.40:6811/4145283410","heartbeat_back_addr":"172.21.15.40:6815/4145283410","heartbeat_front_addr":"172.21.15.40:6813/4145283410","state":["exists","up"]},{"osd":7,"uuid":"cf76e4c7-96a6-401f-a280-91aad4641940","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":2943297416},{"type":"v1","addr":"172.21.15.40:6817","nonce":2943297416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":2943297416},{"type":"v1","addr":"172.21.15.40:6819","nonce":2943297416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":2943297416},{"type":"v1","addr":"172.21.15.40:6823","nonce":2943297416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":2943297416},{"type":"v1","addr":"172.21.15.40:6821","nonce":2943297416}]},"public_addr":"172.21.15.40:6817/2943297416","cluster_addr":"172.21.15.40:6819/2943297416","heartbeat_back_addr":"172.21.15.40:6823/2943297416","heartbeat_front_addr":"172.21.15.40:6821/2943297416","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.411475+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.628841+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.599055+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.166100+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.384135+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.488403+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.307648+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.363541+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":3,"to":2}]},{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"3.39","mappings":[{"from":7,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T06:10:19.047 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.043+0000 7fea7ffff700 1 -- 172.21.15.32:0/572904091 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fea6c066540 msgr2=0x7fea6c068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:19.048 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.043+0000 7fea7ffff700 1 --2- 172.21.15.32:0/572904091 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fea6c066540 0x7fea6c068a00 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fea80153e70 tx=0x7fea70009040 comp rx=0 tx=0).stop 2023-10-08T06:10:19.048 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.043+0000 7fea7ffff700 1 -- 172.21.15.32:0/572904091 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fea800719e0 msgr2=0x7fea80149110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:19.048 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.043+0000 7fea7ffff700 1 --2- 172.21.15.32:0/572904091 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fea800719e0 0x7fea80149110 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fea74014040 tx=0x7fea74004770 comp rx=0 tx=0).stop 2023-10-08T06:10:19.048 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.043+0000 7fea7ffff700 1 -- 172.21.15.32:0/572904091 shutdown_connections 2023-10-08T06:10:19.048 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.043+0000 7fea7ffff700 1 --2- 172.21.15.32:0/572904091 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fea6c066540 0x7fea6c068a00 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:19.048 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.043+0000 7fea7ffff700 1 --2- 172.21.15.32:0/572904091 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fea8015b980 0x7fea8015e3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:19.048 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.043+0000 7fea7ffff700 1 --2- 172.21.15.32:0/572904091 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fea800c9b30 0x7fea8015de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:19.048 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.043+0000 7fea7ffff700 1 --2- 172.21.15.32:0/572904091 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fea800719e0 0x7fea80149110 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:19.048 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.043+0000 7fea7ffff700 1 -- 172.21.15.32:0/572904091 >> 172.21.15.32:0/572904091 conn(0x7fea800b0900 msgr2=0x7fea8015c150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:10:19.048 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.047+0000 7fea7ffff700 1 -- 172.21.15.32:0/572904091 shutdown_connections 2023-10-08T06:10:19.048 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.047+0000 7fea7ffff700 1 -- 172.21.15.32:0/572904091 wait complete. 2023-10-08T06:10:19.062 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T06:09:23.307843+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-08T06:09:34.295012+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-08T06:09:35.515590+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-08T06:10:19.062 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T06:10:19.181 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.179+0000 7f781c81e700 1 Processor -- start 2023-10-08T06:10:19.182 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.179+0000 7f781c81e700 1 -- start start 2023-10-08T06:10:19.184 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.183+0000 7f781c81e700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f781815b9d0 0x7f781806b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:19.184 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.183+0000 7f781c81e700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f781806b150 con 0x7f7818070930 2023-10-08T06:10:19.184 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.183+0000 7f781c81e700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78180720a0 con 0x7f78180704a0 2023-10-08T06:10:19.184 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.183+0000 7f781c81e700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7818159190 con 0x7f781815b9d0 2023-10-08T06:10:19.184 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.183+0000 7f7816d9d700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f781815b9d0 0x7f781806b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:19.184 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.183+0000 7f781759e700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f7818070930 0x7f781815cbe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:45972/0 (socket says 172.21.15.32:45972) 2023-10-08T06:10:19.184 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.183+0000 7f781759e700 1 -- 172.21.15.32:0/1563031509 learned_addr learned my addr 172.21.15.32:0/1563031509 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-08T06:10:19.185 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.183+0000 7f7816d9d700 1 -- 172.21.15.32:0/1563031509 >> v1:172.21.15.40:6789/0 conn(0x7f78180704a0 legacy=0x7f781815bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:19.185 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.183+0000 7f7816d9d700 1 -- 172.21.15.32:0/1563031509 >> v1:172.21.15.32:6789/0 conn(0x7f7818070930 legacy=0x7f781815cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:19.185 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.183+0000 7f7816d9d700 1 -- 172.21.15.32:0/1563031509 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7818072900 con 0x7f781815b9d0 2023-10-08T06:10:19.186 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.183+0000 7f7816d9d700 1 --2- 172.21.15.32:0/1563031509 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f781815b9d0 0x7f781806b5e0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f7808009850 tx=0x7f7808009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9e5f1f9474e1f08 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:19.186 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.183+0000 7f7815d9b700 1 -- 172.21.15.32:0/1563031509 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7808011830 con 0x7f781815b9d0 2023-10-08T06:10:19.186 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.183+0000 7f7815d9b700 1 -- 172.21.15.32:0/1563031509 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7808011990 con 0x7f781815b9d0 2023-10-08T06:10:19.186 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.183+0000 7f7815d9b700 1 -- 172.21.15.32:0/1563031509 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7808011d20 con 0x7f781815b9d0 2023-10-08T06:10:19.187 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.183+0000 7f781c81e700 1 -- 172.21.15.32:0/1563031509 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f781815b9d0 msgr2=0x7f781806b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:19.187 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.183+0000 7f781c81e700 1 --2- 172.21.15.32:0/1563031509 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f781815b9d0 0x7f781806b5e0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f7808009850 tx=0x7f7808009b60 comp rx=0 tx=0).stop 2023-10-08T06:10:19.187 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.183+0000 7f781c81e700 1 -- 172.21.15.32:0/1563031509 shutdown_connections 2023-10-08T06:10:19.187 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.183+0000 7f781c81e700 1 --2- 172.21.15.32:0/1563031509 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f781815b9d0 0x7f781806b5e0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:19.187 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.183+0000 7f781c81e700 1 -- 172.21.15.32:0/1563031509 >> 172.21.15.32:0/1563031509 conn(0x7f78180cf5d0 msgr2=0x7f78180cf9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:10:19.188 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.183+0000 7f781c81e700 1 -- 172.21.15.32:0/1563031509 shutdown_connections 2023-10-08T06:10:19.188 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.183+0000 7f781c81e700 1 -- 172.21.15.32:0/1563031509 wait complete. 2023-10-08T06:10:19.189 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.187+0000 7f781c81e700 1 Processor -- start 2023-10-08T06:10:19.189 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.187+0000 7f781c81e700 1 -- start start 2023-10-08T06:10:19.193 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.191+0000 7f781c81e700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f78180704a0 0x7f78181587b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:19.193 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.191+0000 7f781c81e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7818070930 0x7f78180c70b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:19.193 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.191+0000 7f781c81e700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f781815b9d0 0x7f78180c7b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:19.193 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.191+0000 7f781c81e700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78180b2610 con 0x7f78180704a0 2023-10-08T06:10:19.194 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.191+0000 7f781c81e700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f781814d120 con 0x7f781815b9d0 2023-10-08T06:10:19.194 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.191+0000 7f781c81e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f781814c510 con 0x7f7818070930 2023-10-08T06:10:19.194 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.191+0000 7f7816d9d700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f78180704a0 0x7f78181587b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:19.194 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.191+0000 7f7816d9d700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f78180704a0 0x7f78181587b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:46976/0 (socket says 172.21.15.32:46976) 2023-10-08T06:10:19.194 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.191+0000 7f7816d9d700 1 -- 172.21.15.32:0/944468463 learned_addr learned my addr 172.21.15.32:0/944468463 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:10:19.194 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.191+0000 7f781659c700 1 --2- 172.21.15.32:0/944468463 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7818070930 0x7f78180c70b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:19.194 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.191+0000 7f781759e700 1 --2- 172.21.15.32:0/944468463 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f781815b9d0 0x7f78180c7b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:19.194 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.191+0000 7f7816d9d700 1 -- 172.21.15.32:0/944468463 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7818070930 msgr2=0x7f78180c70b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:19.194 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.191+0000 7f7816d9d700 1 --2- 172.21.15.32:0/944468463 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7818070930 0x7f78180c70b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:19.194 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.191+0000 7f7816d9d700 1 -- 172.21.15.32:0/944468463 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f781815b9d0 msgr2=0x7f78180c7b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:19.195 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.191+0000 7f7816d9d700 1 --2- 172.21.15.32:0/944468463 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f781815b9d0 0x7f78180c7b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:19.195 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.191+0000 7f7816d9d700 1 -- 172.21.15.32:0/944468463 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78080094b0 con 0x7f78180704a0 2023-10-08T06:10:19.195 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.191+0000 7f781659c700 1 --2- 172.21.15.32:0/944468463 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7818070930 0x7f78180c70b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T06:10:19.195 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.191+0000 7f7816d9d700 1 --2- 172.21.15.32:0/944468463 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f78180704a0 0x7f78181587b0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f7808014040 tx=0x7f7808004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:19.195 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.191+0000 7f77ff7fe700 1 -- 172.21.15.32:0/944468463 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78080036c0 con 0x7f78180704a0 2023-10-08T06:10:19.195 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.191+0000 7f77ff7fe700 1 -- 172.21.15.32:0/944468463 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f780801e070 con 0x7f78180704a0 2023-10-08T06:10:19.195 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.191+0000 7f781c81e700 1 -- 172.21.15.32:0/944468463 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f781814c7f0 con 0x7f78180704a0 2023-10-08T06:10:19.195 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.191+0000 7f77ff7fe700 1 -- 172.21.15.32:0/944468463 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7808003a80 con 0x7f78180704a0 2023-10-08T06:10:19.195 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.191+0000 7f781c81e700 1 -- 172.21.15.32:0/944468463 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f781814cdb0 con 0x7f78180704a0 2023-10-08T06:10:19.196 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.191+0000 7f781c81e700 1 -- 172.21.15.32:0/944468463 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7818073f00 con 0x7f78180704a0 2023-10-08T06:10:19.196 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.195+0000 7f77ff7fe700 1 -- 172.21.15.32:0/944468463 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f7808003be0 con 0x7f78180704a0 2023-10-08T06:10:19.196 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.195+0000 7f77ff7fe700 1 --2- 172.21.15.32:0/944468463 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f7804066510 0x7f78040689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:19.197 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.195+0000 7f781659c700 1 --2- 172.21.15.32:0/944468463 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f7804066510 0x7f78040689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:19.197 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.195+0000 7f77ff7fe700 1 -- 172.21.15.32:0/944468463 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f7808020070 con 0x7f78180704a0 2023-10-08T06:10:19.197 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.195+0000 7f781659c700 1 --2- 172.21.15.32:0/944468463 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f7804066510 0x7f78040689d0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f78180af6d0 tx=0x7f780c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:19.201 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.199+0000 7f77ff7fe700 1 -- 172.21.15.32:0/944468463 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f7808052ac0 con 0x7f78180704a0 2023-10-08T06:10:19.375 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.371+0000 7f781c81e700 1 -- 172.21.15.32:0/944468463 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f78180c7960 con 0x7f78180704a0 2023-10-08T06:10:19.376 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.375+0000 7f77ff7fe700 1 -- 172.21.15.32:0/944468463 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f78080560e0 con 0x7f78180704a0 2023-10-08T06:10:19.376 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 1 2023-10-08T06:10:19.378 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.375+0000 7f781c81e700 1 -- 172.21.15.32:0/944468463 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f7804066510 msgr2=0x7f78040689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:19.378 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.375+0000 7f781c81e700 1 --2- 172.21.15.32:0/944468463 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f7804066510 0x7f78040689d0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f78180af6d0 tx=0x7f780c009040 comp rx=0 tx=0).stop 2023-10-08T06:10:19.378 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.375+0000 7f781c81e700 1 -- 172.21.15.32:0/944468463 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f78180704a0 msgr2=0x7f78181587b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:19.378 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.375+0000 7f781c81e700 1 --2- 172.21.15.32:0/944468463 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f78180704a0 0x7f78181587b0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f7808014040 tx=0x7f7808004770 comp rx=0 tx=0).stop 2023-10-08T06:10:19.379 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.375+0000 7f781c81e700 1 -- 172.21.15.32:0/944468463 shutdown_connections 2023-10-08T06:10:19.379 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.375+0000 7f781c81e700 1 --2- 172.21.15.32:0/944468463 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f7804066510 0x7f78040689d0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:19.379 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.375+0000 7f781c81e700 1 --2- 172.21.15.32:0/944468463 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f781815b9d0 0x7f78180c7b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:19.379 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.375+0000 7f781c81e700 1 --2- 172.21.15.32:0/944468463 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7818070930 0x7f78180c70b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:19.379 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.375+0000 7f781c81e700 1 --2- 172.21.15.32:0/944468463 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f78180704a0 0x7f78181587b0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:19.379 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.375+0000 7f781c81e700 1 -- 172.21.15.32:0/944468463 >> 172.21.15.32:0/944468463 conn(0x7f78180cf5d0 msgr2=0x7f781815d130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:10:19.379 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.375+0000 7f781c81e700 1 -- 172.21.15.32:0/944468463 shutdown_connections 2023-10-08T06:10:19.379 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.375+0000 7f781c81e700 1 -- 172.21.15.32:0/944468463 wait complete. 2023-10-08T06:10:19.390 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-08T06:10:19.508 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.507+0000 7f5ed72ba700 1 Processor -- start 2023-10-08T06:10:19.508 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.507+0000 7f5ed72ba700 1 -- start start 2023-10-08T06:10:19.509 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.507+0000 7f5ed72ba700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f5ed015b980 0x7f5ed015f780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:19.510 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.507+0000 7f5ed72ba700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f5ed00719e0 0x7f5ed00c9420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:19.510 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.507+0000 7f5ed72ba700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5ed00c9960 0x7f5ed015bd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:19.510 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.507+0000 7f5ed72ba700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ed00c9e10 con 0x7f5ed00719e0 2023-10-08T06:10:19.510 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.507+0000 7f5ed72ba700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ed0070430 con 0x7f5ed015b980 2023-10-08T06:10:19.510 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.507+0000 7f5ed72ba700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ed015ed70 con 0x7f5ed00c9960 2023-10-08T06:10:19.510 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.507+0000 7f5ed5ab7700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f5ed00719e0 0x7f5ed00c9420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:19.510 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.507+0000 7f5ed5ab7700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f5ed00719e0 0x7f5ed00c9420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:46990/0 (socket says 172.21.15.32:46990) 2023-10-08T06:10:19.510 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.507+0000 7f5ed6ab9700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5ed00c9960 0x7f5ed015bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:19.511 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.507+0000 7f5ed5ab7700 1 -- 172.21.15.32:0/2948607524 learned_addr learned my addr 172.21.15.32:0/2948607524 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:10:19.511 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.507+0000 7f5ed62b8700 1 --2- 172.21.15.32:0/2948607524 >> v2:172.21.15.40:3300/0 conn(0x7f5ed015b980 0x7f5ed015f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:19.512 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.507+0000 7f5ed5ab7700 1 -- 172.21.15.32:0/2948607524 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5ed00c9960 msgr2=0x7f5ed015bd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:10:19.512 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.507+0000 7f5ed5ab7700 1 --2- 172.21.15.32:0/2948607524 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5ed00c9960 0x7f5ed015bd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:19.512 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.507+0000 7f5ed5ab7700 1 -- 172.21.15.32:0/2948607524 >> v2:172.21.15.40:3300/0 conn(0x7f5ed015b980 msgr2=0x7f5ed015f780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:10:19.512 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.507+0000 7f5ed5ab7700 1 --2- 172.21.15.32:0/2948607524 >> v2:172.21.15.40:3300/0 conn(0x7f5ed015b980 0x7f5ed015f780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:19.513 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.507+0000 7f5ed5ab7700 1 -- 172.21.15.32:0/2948607524 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ed006fc20 con 0x7f5ed00719e0 2023-10-08T06:10:19.513 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.507+0000 7f5ed5ab7700 1 --2- 172.21.15.32:0/2948607524 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5ed00719e0 0x7f5ed00c9420 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f5ed00cec90 tx=0x7f5ec4009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6af39fbd152b9995 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:19.513 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.507+0000 7f5ed52b6700 1 -- 172.21.15.32:0/2948607524 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ec4011830 con 0x7f5ed00719e0 2023-10-08T06:10:19.513 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.507+0000 7f5ed52b6700 1 -- 172.21.15.32:0/2948607524 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ec4011990 con 0x7f5ed00719e0 2023-10-08T06:10:19.513 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.507+0000 7f5ed52b6700 1 -- 172.21.15.32:0/2948607524 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ec4011d20 con 0x7f5ed00719e0 2023-10-08T06:10:19.513 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.511+0000 7f5ed72ba700 1 -- 172.21.15.32:0/2948607524 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5ed00719e0 msgr2=0x7f5ed00c9420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:19.513 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.511+0000 7f5ed72ba700 1 --2- 172.21.15.32:0/2948607524 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5ed00719e0 0x7f5ed00c9420 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f5ed00cec90 tx=0x7f5ec4009bf0 comp rx=0 tx=0).stop 2023-10-08T06:10:19.513 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.511+0000 7f5ed72ba700 1 -- 172.21.15.32:0/2948607524 shutdown_connections 2023-10-08T06:10:19.513 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.511+0000 7f5ed72ba700 1 --2- 172.21.15.32:0/2948607524 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5ed00719e0 0x7f5ed00c9420 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:19.513 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.511+0000 7f5ed72ba700 1 --2- 172.21.15.32:0/2948607524 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5ed00c9960 0x7f5ed015bd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:19.514 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.511+0000 7f5ed72ba700 1 --2- 172.21.15.32:0/2948607524 >> v2:172.21.15.40:3300/0 conn(0x7f5ed015b980 0x7f5ed015f780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:19.514 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.511+0000 7f5ed72ba700 1 -- 172.21.15.32:0/2948607524 >> 172.21.15.32:0/2948607524 conn(0x7f5ed00b0900 msgr2=0x7f5ed00b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:10:19.514 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.511+0000 7f5ed72ba700 1 -- 172.21.15.32:0/2948607524 shutdown_connections 2023-10-08T06:10:19.514 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.511+0000 7f5ed72ba700 1 -- 172.21.15.32:0/2948607524 wait complete. 2023-10-08T06:10:19.514 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.511+0000 7f5ed72ba700 1 Processor -- start 2023-10-08T06:10:19.514 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.511+0000 7f5ed72ba700 1 -- start start 2023-10-08T06:10:19.516 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.511+0000 7f5ed72ba700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5ed00719e0 0x7f5ed00b4540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:19.516 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.511+0000 7f5ed72ba700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5ed00c9960 0x7f5ed01565b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:19.516 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.511+0000 7f5ed72ba700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5ed015b980 0x7f5ed00b2550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:19.516 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.511+0000 7f5ed72ba700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ed00c3260 con 0x7f5ed00719e0 2023-10-08T06:10:19.516 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.511+0000 7f5ed72ba700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ed00b4a80 con 0x7f5ed00c9960 2023-10-08T06:10:19.516 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.511+0000 7f5ed72ba700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ed00c25e0 con 0x7f5ed015b980 2023-10-08T06:10:19.516 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.515+0000 7f5ed62b8700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5ed00719e0 0x7f5ed00b4540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:19.517 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.515+0000 7f5ed5ab7700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5ed00c9960 0x7f5ed01565b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:19.517 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.515+0000 7f5ed62b8700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5ed00719e0 0x7f5ed00b4540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:46994/0 (socket says 172.21.15.32:46994) 2023-10-08T06:10:19.517 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.515+0000 7f5ed62b8700 1 -- 172.21.15.32:0/2429781762 learned_addr learned my addr 172.21.15.32:0/2429781762 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:10:19.517 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.515+0000 7f5ed6ab9700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5ed015b980 0x7f5ed00b2550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:19.518 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.515+0000 7f5ed62b8700 1 -- 172.21.15.32:0/2429781762 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5ed015b980 msgr2=0x7f5ed00b2550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:19.518 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.515+0000 7f5ed62b8700 1 --2- 172.21.15.32:0/2429781762 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5ed015b980 0x7f5ed00b2550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:19.518 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.515+0000 7f5ed62b8700 1 -- 172.21.15.32:0/2429781762 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5ed00c9960 msgr2=0x7f5ed01565b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:19.519 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.515+0000 7f5ed62b8700 1 --2- 172.21.15.32:0/2429781762 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5ed00c9960 0x7f5ed01565b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:19.519 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.515+0000 7f5ed62b8700 1 -- 172.21.15.32:0/2429781762 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ec4009570 con 0x7f5ed00719e0 2023-10-08T06:10:19.519 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.515+0000 7f5ed5ab7700 1 --2- 172.21.15.32:0/2429781762 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5ed00c9960 0x7f5ed01565b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T06:10:19.519 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.515+0000 7f5ed62b8700 1 --2- 172.21.15.32:0/2429781762 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5ed00719e0 0x7f5ed00b4540 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f5ec000e840 tx=0x7f5ec000eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:19.519 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.515+0000 7f5eceffd700 1 -- 172.21.15.32:0/2429781762 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ec00095a0 con 0x7f5ed00719e0 2023-10-08T06:10:19.519 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.515+0000 7f5eceffd700 1 -- 172.21.15.32:0/2429781762 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ec0013680 con 0x7f5ed00719e0 2023-10-08T06:10:19.519 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.515+0000 7f5ed72ba700 1 -- 172.21.15.32:0/2429781762 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ed00c28c0 con 0x7f5ed00719e0 2023-10-08T06:10:19.519 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.515+0000 7f5eceffd700 1 -- 172.21.15.32:0/2429781762 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ec00139f0 con 0x7f5ed00719e0 2023-10-08T06:10:19.519 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.515+0000 7f5ed72ba700 1 -- 172.21.15.32:0/2429781762 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ed00c2e80 con 0x7f5ed00719e0 2023-10-08T06:10:19.520 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.515+0000 7f5ed72ba700 1 -- 172.21.15.32:0/2429781762 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ed00c5ca0 con 0x7f5ed00719e0 2023-10-08T06:10:19.520 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.519+0000 7f5eceffd700 1 -- 172.21.15.32:0/2429781762 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f5ec0013b50 con 0x7f5ed00719e0 2023-10-08T06:10:19.521 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.519+0000 7f5eceffd700 1 --2- 172.21.15.32:0/2429781762 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f5ebc066510 0x7f5ebc0689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:19.522 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.519+0000 7f5ed5ab7700 1 --2- 172.21.15.32:0/2429781762 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f5ebc066510 0x7f5ebc0689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:19.522 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.519+0000 7f5eceffd700 1 -- 172.21.15.32:0/2429781762 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f5ec0083d30 con 0x7f5ed00719e0 2023-10-08T06:10:19.522 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.519+0000 7f5ed5ab7700 1 --2- 172.21.15.32:0/2429781762 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f5ebc066510 0x7f5ebc0689d0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f5ec4000c00 tx=0x7f5ec4008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:19.531 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.527+0000 7f5eceffd700 1 -- 172.21.15.32:0/2429781762 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f5ec0051140 con 0x7f5ed00719e0 2023-10-08T06:10:19.701 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.699+0000 7f5ed72ba700 1 -- 172.21.15.32:0/2429781762 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f5ed0073f00 con 0x7f5ed00719e0 2023-10-08T06:10:19.701 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.699+0000 7f5eceffd700 1 -- 172.21.15.32:0/2429781762 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f5ec0054760 con 0x7f5ed00719e0 2023-10-08T06:10:19.702 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 32 2023-10-08T06:10:19.704 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.703+0000 7f5ed72ba700 1 -- 172.21.15.32:0/2429781762 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f5ebc066510 msgr2=0x7f5ebc0689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:19.704 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.703+0000 7f5ed72ba700 1 --2- 172.21.15.32:0/2429781762 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f5ebc066510 0x7f5ebc0689d0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f5ec4000c00 tx=0x7f5ec4008030 comp rx=0 tx=0).stop 2023-10-08T06:10:19.704 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.703+0000 7f5ed72ba700 1 -- 172.21.15.32:0/2429781762 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5ed00719e0 msgr2=0x7f5ed00b4540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:19.704 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.703+0000 7f5ed72ba700 1 --2- 172.21.15.32:0/2429781762 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5ed00719e0 0x7f5ed00b4540 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f5ec000e840 tx=0x7f5ec000eb50 comp rx=0 tx=0).stop 2023-10-08T06:10:19.704 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.703+0000 7f5ed72ba700 1 -- 172.21.15.32:0/2429781762 shutdown_connections 2023-10-08T06:10:19.705 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.703+0000 7f5ed72ba700 1 --2- 172.21.15.32:0/2429781762 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f5ebc066510 0x7f5ebc0689d0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:19.705 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.703+0000 7f5ed72ba700 1 --2- 172.21.15.32:0/2429781762 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5ed015b980 0x7f5ed00b2550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:19.705 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.703+0000 7f5ed72ba700 1 --2- 172.21.15.32:0/2429781762 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5ed00c9960 0x7f5ed01565b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:19.705 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.703+0000 7f5ed72ba700 1 --2- 172.21.15.32:0/2429781762 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5ed00719e0 0x7f5ed00b4540 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:19.705 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.703+0000 7f5ed72ba700 1 -- 172.21.15.32:0/2429781762 >> 172.21.15.32:0/2429781762 conn(0x7f5ed00b0900 msgr2=0x7f5ed015a530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:10:19.705 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.703+0000 7f5ed72ba700 1 -- 172.21.15.32:0/2429781762 shutdown_connections 2023-10-08T06:10:19.705 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.703+0000 7f5ed72ba700 1 -- 172.21.15.32:0/2429781762 wait complete. 2023-10-08T06:10:19.717 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-08T06:10:19.841 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.839+0000 7fda2d4ef700 1 Processor -- start 2023-10-08T06:10:19.841 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.839+0000 7fda2d4ef700 1 -- start start 2023-10-08T06:10:19.843 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.839+0000 7fda2d4ef700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fda2815d980 0x7fda280d1930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:19.844 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.839+0000 7fda2d4ef700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fda280d0230 0x7fda280d1e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:19.844 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.839+0000 7fda2d4ef700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda281621b0 con 0x7fda2815d5a0 2023-10-08T06:10:19.844 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.839+0000 7fda2d4ef700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda28161630 con 0x7fda2815d980 2023-10-08T06:10:19.844 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.839+0000 7fda2d4ef700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda28161910 con 0x7fda280d0230 2023-10-08T06:10:19.844 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.839+0000 7fda277fe700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fda2815d980 0x7fda280d1930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:19.844 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.839+0000 7fda27fff700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fda2815d5a0 0x7fda280cfb20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:45980/0 (socket says 172.21.15.32:45980) 2023-10-08T06:10:19.844 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.839+0000 7fda27fff700 1 -- 172.21.15.32:0/1909907430 learned_addr learned my addr 172.21.15.32:0/1909907430 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-08T06:10:19.845 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.839+0000 7fda2ccee700 1 --2- 172.21.15.32:0/1909907430 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fda280d0230 0x7fda280d1e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:19.845 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.843+0000 7fda277fe700 1 -- 172.21.15.32:0/1909907430 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fda280d0230 msgr2=0x7fda280d1e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:10:19.845 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.843+0000 7fda277fe700 1 --2- 172.21.15.32:0/1909907430 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fda280d0230 0x7fda280d1e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:19.845 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.843+0000 7fda277fe700 1 -- 172.21.15.32:0/1909907430 >> v1:172.21.15.32:6789/0 conn(0x7fda2815d5a0 legacy=0x7fda280cfb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:19.845 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.843+0000 7fda277fe700 1 -- 172.21.15.32:0/1909907430 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda28161bf0 con 0x7fda2815d980 2023-10-08T06:10:19.846 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.843+0000 7fda26ffd700 1 -- 172.21.15.32:0/1909907430 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1727794274 0 0) 0x7fda281621b0 con 0x7fda2815d5a0 2023-10-08T06:10:19.847 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.843+0000 7fda277fe700 1 --2- 172.21.15.32:0/1909907430 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fda2815d980 0x7fda280d1930 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fda1c009850 tx=0x7fda1c009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85f3b6e6ef0d68b8 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:19.847 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.843+0000 7fda26ffd700 1 -- 172.21.15.32:0/1909907430 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda1c011830 con 0x7fda2815d980 2023-10-08T06:10:19.847 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.843+0000 7fda26ffd700 1 -- 172.21.15.32:0/1909907430 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda1c011990 con 0x7fda2815d980 2023-10-08T06:10:19.847 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.843+0000 7fda26ffd700 1 -- 172.21.15.32:0/1909907430 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda1c011d40 con 0x7fda2815d980 2023-10-08T06:10:19.847 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.843+0000 7fda2d4ef700 1 -- 172.21.15.32:0/1909907430 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fda2815d980 msgr2=0x7fda280d1930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:19.848 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.843+0000 7fda2d4ef700 1 --2- 172.21.15.32:0/1909907430 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fda2815d980 0x7fda280d1930 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fda1c009850 tx=0x7fda1c009b60 comp rx=0 tx=0).stop 2023-10-08T06:10:19.848 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.843+0000 7fda2d4ef700 1 -- 172.21.15.32:0/1909907430 shutdown_connections 2023-10-08T06:10:19.848 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.843+0000 7fda2d4ef700 1 --2- 172.21.15.32:0/1909907430 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fda280d0230 0x7fda280d1e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:19.848 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.843+0000 7fda2d4ef700 1 --2- 172.21.15.32:0/1909907430 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fda2815d980 0x7fda280d1930 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:19.848 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.843+0000 7fda2d4ef700 1 -- 172.21.15.32:0/1909907430 >> 172.21.15.32:0/1909907430 conn(0x7fda2806aca0 msgr2=0x7fda2806b0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:10:19.848 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.843+0000 7fda2d4ef700 1 -- 172.21.15.32:0/1909907430 shutdown_connections 2023-10-08T06:10:19.849 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.843+0000 7fda2d4ef700 1 -- 172.21.15.32:0/1909907430 wait complete. 2023-10-08T06:10:19.849 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.843+0000 7fda2d4ef700 1 Processor -- start 2023-10-08T06:10:19.849 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.843+0000 7fda2d4ef700 1 -- start start 2023-10-08T06:10:19.851 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.847+0000 7fda2d4ef700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fda280d0230 0x7fda2815b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:19.851 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.847+0000 7fda2d4ef700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fda2815d5a0 0x7fda280b2600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:19.851 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.847+0000 7fda2d4ef700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fda280b2b40 0x7fda280c8e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:19.852 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.847+0000 7fda2d4ef700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda2815b930 con 0x7fda2815d5a0 2023-10-08T06:10:19.852 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.847+0000 7fda2d4ef700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda281f3ef0 con 0x7fda280d0230 2023-10-08T06:10:19.852 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.847+0000 7fda2d4ef700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda280b35a0 con 0x7fda280b2b40 2023-10-08T06:10:19.852 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.847+0000 7fda277fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fda2815d5a0 0x7fda280b2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:19.852 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.847+0000 7fda27fff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fda280d0230 0x7fda2815b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:19.852 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.847+0000 7fda277fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fda2815d5a0 0x7fda280b2600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:47012/0 (socket says 172.21.15.32:47012) 2023-10-08T06:10:19.852 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.847+0000 7fda277fe700 1 -- 172.21.15.32:0/3426899119 learned_addr learned my addr 172.21.15.32:0/3426899119 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:10:19.852 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.847+0000 7fda2ccee700 1 --2- 172.21.15.32:0/3426899119 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fda280b2b40 0x7fda280c8e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:19.853 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.847+0000 7fda277fe700 1 -- 172.21.15.32:0/3426899119 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fda280b2b40 msgr2=0x7fda280c8e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:19.853 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.847+0000 7fda277fe700 1 --2- 172.21.15.32:0/3426899119 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fda280b2b40 0x7fda280c8e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:19.853 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.847+0000 7fda277fe700 1 -- 172.21.15.32:0/3426899119 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fda280d0230 msgr2=0x7fda2815b3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:19.853 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.847+0000 7fda277fe700 1 --2- 172.21.15.32:0/3426899119 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fda280d0230 0x7fda2815b3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:19.853 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.847+0000 7fda277fe700 1 -- 172.21.15.32:0/3426899119 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda1c0094b0 con 0x7fda2815d5a0 2023-10-08T06:10:19.853 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.847+0000 7fda277fe700 1 --2- 172.21.15.32:0/3426899119 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fda2815d5a0 0x7fda280b2600 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fda1c014040 tx=0x7fda1c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:19.853 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.847+0000 7fda24ff9700 1 -- 172.21.15.32:0/3426899119 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda1c019980 con 0x7fda2815d5a0 2023-10-08T06:10:19.853 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.847+0000 7fda24ff9700 1 -- 172.21.15.32:0/3426899119 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda1c01e070 con 0x7fda2815d5a0 2023-10-08T06:10:19.853 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.847+0000 7fda2d4ef700 1 -- 172.21.15.32:0/3426899119 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda280b2fe0 con 0x7fda2815d5a0 2023-10-08T06:10:19.853 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.847+0000 7fda24ff9700 1 -- 172.21.15.32:0/3426899119 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda1c019d40 con 0x7fda2815d5a0 2023-10-08T06:10:19.853 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.847+0000 7fda2d4ef700 1 -- 172.21.15.32:0/3426899119 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda280b3d10 con 0x7fda2815d5a0 2023-10-08T06:10:19.853 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.851+0000 7fda2d4ef700 1 -- 172.21.15.32:0/3426899119 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda280686a0 con 0x7fda2815d5a0 2023-10-08T06:10:19.854 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.851+0000 7fda24ff9700 1 -- 172.21.15.32:0/3426899119 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fda1c01a420 con 0x7fda2815d5a0 2023-10-08T06:10:19.854 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.851+0000 7fda24ff9700 1 --2- 172.21.15.32:0/3426899119 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fda14066510 0x7fda140689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:19.855 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.851+0000 7fda24ff9700 1 -- 172.21.15.32:0/3426899119 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fda1c084e00 con 0x7fda2815d5a0 2023-10-08T06:10:19.855 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.851+0000 7fda27fff700 1 --2- 172.21.15.32:0/3426899119 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fda14066510 0x7fda140689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:19.855 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.851+0000 7fda27fff700 1 --2- 172.21.15.32:0/3426899119 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fda14066510 0x7fda140689d0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fda18000f60 tx=0x7fda18007e00 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:19.861 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:19.859+0000 7fda24ff9700 1 -- 172.21.15.32:0/3426899119 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fda1c052290 con 0x7fda2815d5a0 2023-10-08T06:10:20.024 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:20.023+0000 7fda2d4ef700 1 -- 172.21.15.32:0/3426899119 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fda280d0e90 con 0x7fda2815d5a0 2023-10-08T06:10:20.025 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:20.023+0000 7fda24ff9700 1 -- 172.21.15.32:0/3426899119 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7fda1c015020 con 0x7fda2815d5a0 2023-10-08T06:10:20.025 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 64 2023-10-08T06:10:20.028 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:20.023+0000 7fda2d4ef700 1 -- 172.21.15.32:0/3426899119 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fda14066510 msgr2=0x7fda140689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:20.028 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:20.023+0000 7fda2d4ef700 1 --2- 172.21.15.32:0/3426899119 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fda14066510 0x7fda140689d0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fda18000f60 tx=0x7fda18007e00 comp rx=0 tx=0).stop 2023-10-08T06:10:20.028 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:20.023+0000 7fda2d4ef700 1 -- 172.21.15.32:0/3426899119 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fda2815d5a0 msgr2=0x7fda280b2600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:20.028 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:20.023+0000 7fda2d4ef700 1 --2- 172.21.15.32:0/3426899119 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fda2815d5a0 0x7fda280b2600 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fda1c014040 tx=0x7fda1c004770 comp rx=0 tx=0).stop 2023-10-08T06:10:20.028 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:20.023+0000 7fda2d4ef700 1 -- 172.21.15.32:0/3426899119 shutdown_connections 2023-10-08T06:10:20.028 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:20.023+0000 7fda2d4ef700 1 --2- 172.21.15.32:0/3426899119 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fda14066510 0x7fda140689d0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:20.028 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:20.023+0000 7fda2d4ef700 1 --2- 172.21.15.32:0/3426899119 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fda2815d5a0 0x7fda280b2600 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:20.028 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:20.023+0000 7fda2d4ef700 1 --2- 172.21.15.32:0/3426899119 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fda280b2b40 0x7fda280c8e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:20.029 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:20.023+0000 7fda2d4ef700 1 --2- 172.21.15.32:0/3426899119 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fda280d0230 0x7fda2815b3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:20.029 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:20.027+0000 7fda2d4ef700 1 -- 172.21.15.32:0/3426899119 >> 172.21.15.32:0/3426899119 conn(0x7fda2806aca0 msgr2=0x7fda280b7840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:10:20.029 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:20.027+0000 7fda2d4ef700 1 -- 172.21.15.32:0/3426899119 shutdown_connections 2023-10-08T06:10:20.029 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:20.027+0000 7fda2d4ef700 1 -- 172.21.15.32:0/3426899119 wait complete. 2023-10-08T06:10:20.040 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-08T06:10:20.158 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:20.155+0000 7f0de95a6700 1 Processor -- start 2023-10-08T06:10:20.159 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:20.155+0000 7f0de95a6700 1 -- start start 2023-10-08T06:10:20.159 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:20.155+0000 7f0de95a6700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f0de40b02c0 0x7f0de406bd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:20.160 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:20.159+0000 7f0de95a6700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0de40b0730 con 0x7f0de40cc970 2023-10-08T06:10:20.160 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:20.159+0000 7f0de95a6700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0de406c290 con 0x7f0de40ccd50 2023-10-08T06:10:20.160 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:20.159+0000 7f0de95a6700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0de41614f0 con 0x7f0de40b02c0 2023-10-08T06:10:20.160 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:20.159+0000 7f0de3fff700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f0de40cc970 0x7f0de4160de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:45990/0 (socket says 172.21.15.32:45990) 2023-10-08T06:10:20.161 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:20.159+0000 7f0de8da5700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f0de40b02c0 0x7f0de406bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:20.161 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:20.159+0000 7f0de3fff700 1 -- 172.21.15.32:0/2185194554 learned_addr learned my addr 172.21.15.32:0/2185194554 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-08T06:10:20.161 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:20.159+0000 7f0de8da5700 1 -- 172.21.15.32:0/2185194554 >> v1:172.21.15.40:6789/0 conn(0x7f0de40ccd50 legacy=0x7f0de40d0450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:20.161 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:20.159+0000 7f0de8da5700 1 -- 172.21.15.32:0/2185194554 >> v1:172.21.15.32:6789/0 conn(0x7f0de40cc970 legacy=0x7f0de4160de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:20.161 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:20.159+0000 7f0de8da5700 1 -- 172.21.15.32:0/2185194554 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0de406c700 con 0x7f0de40b02c0 2023-10-08T06:10:20.161 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:20.159+0000 7f0de8da5700 1 --2- 172.21.15.32:0/2185194554 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0de40b02c0 0x7f0de406bd50 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f0ddc009d90 tx=0x7f0ddc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f5c1e4c94233f9d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:20.162 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:20.159+0000 7f0de2ffd700 1 -- 172.21.15.32:0/2185194554 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ddc00e070 con 0x7f0de40b02c0 2023-10-08T06:10:20.162 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:20.159+0000 7f0de2ffd700 1 -- 172.21.15.32:0/2185194554 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ddc00bbd0 con 0x7f0de40b02c0 2023-10-08T06:10:20.162 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:20.159+0000 7f0de2ffd700 1 -- 172.21.15.32:0/2185194554 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ddc012430 con 0x7f0de40b02c0 2023-10-08T06:10:20.163 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:20.159+0000 7f0de95a6700 1 -- 172.21.15.32:0/2185194554 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0de40b02c0 msgr2=0x7f0de406bd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:20.163 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:20.159+0000 7f0de95a6700 1 --2- 172.21.15.32:0/2185194554 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0de40b02c0 0x7f0de406bd50 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f0ddc009d90 tx=0x7f0ddc00b330 comp rx=0 tx=0).stop 2023-10-08T06:10:20.163 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:20.159+0000 7f0de95a6700 1 -- 172.21.15.32:0/2185194554 shutdown_connections 2023-10-08T06:10:20.163 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:20.159+0000 7f0de95a6700 1 --2- 172.21.15.32:0/2185194554 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0de40b02c0 0x7f0de406bd50 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:20.163 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:20.159+0000 7f0de95a6700 1 -- 172.21.15.32:0/2185194554 >> 172.21.15.32:0/2185194554 conn(0x7f0de406df60 msgr2=0x7f0de406e340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:10:20.163 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:20.159+0000 7f0de95a6700 1 -- 172.21.15.32:0/2185194554 shutdown_connections 2023-10-08T06:10:20.163 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:20.159+0000 7f0de95a6700 1 -- 172.21.15.32:0/2185194554 wait complete. 2023-10-08T06:10:20.164 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:20.163+0000 7f0de95a6700 1 Processor -- start 2023-10-08T06:10:20.164 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:20.163+0000 7f0de95a6700 1 -- start start 2023-10-08T06:10:20.166 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:20.163+0000 7f0de95a6700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0de40b02c0 0x7f0de40b59c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:20.166 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:20.163+0000 7f0de95a6700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0de40cc970 0x7f0de4154a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:20.166 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:20.163+0000 7f0de95a6700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0de40ccd50 0x7f0de40c8600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:20.167 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:20.163+0000 7f0de95a6700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0de41f2960 con 0x7f0de40ccd50 2023-10-08T06:10:20.167 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:20.163+0000 7f0de95a6700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0de40b1850 con 0x7f0de40b02c0 2023-10-08T06:10:20.167 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:20.163+0000 7f0de95a6700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0de40b1b30 con 0x7f0de40cc970 2023-10-08T06:10:20.167 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:20.163+0000 7f0de8da5700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0de40ccd50 0x7f0de40c8600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:20.167 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:20.163+0000 7f0de8da5700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0de40ccd50 0x7f0de40c8600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:47036/0 (socket says 172.21.15.32:47036) 2023-10-08T06:10:20.167 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:20.163+0000 7f0de8da5700 1 -- 172.21.15.32:0/3270169404 learned_addr learned my addr 172.21.15.32:0/3270169404 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:10:20.167 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:20.163+0000 7f0de37fe700 1 --2- 172.21.15.32:0/3270169404 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0de40cc970 0x7f0de4154a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:20.167 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:20.163+0000 7f0de3fff700 1 --2- 172.21.15.32:0/3270169404 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0de40b02c0 0x7f0de40b59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:20.169 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:20.163+0000 7f0de8da5700 1 -- 172.21.15.32:0/3270169404 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0de40cc970 msgr2=0x7f0de4154a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:20.169 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:20.163+0000 7f0de8da5700 1 --2- 172.21.15.32:0/3270169404 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0de40cc970 0x7f0de4154a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:20.169 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:20.163+0000 7f0de8da5700 1 -- 172.21.15.32:0/3270169404 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0de40b02c0 msgr2=0x7f0de40b59c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:20.169 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:20.163+0000 7f0de8da5700 1 --2- 172.21.15.32:0/3270169404 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0de40b02c0 0x7f0de40b59c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:20.169 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:20.163+0000 7f0de8da5700 1 -- 172.21.15.32:0/3270169404 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ddc009a70 con 0x7f0de40ccd50 2023-10-08T06:10:20.169 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:20.163+0000 7f0de8da5700 1 --2- 172.21.15.32:0/3270169404 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0de40ccd50 0x7f0de40c8600 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f0ddc014040 tx=0x7f0ddc004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:20.170 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:20.167+0000 7f0de0ff9700 1 -- 172.21.15.32:0/3270169404 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ddc012d20 con 0x7f0de40ccd50 2023-10-08T06:10:20.170 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:20.167+0000 7f0de0ff9700 1 -- 172.21.15.32:0/3270169404 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ddc020070 con 0x7f0de40ccd50 2023-10-08T06:10:20.170 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:20.167+0000 7f0de0ff9700 1 -- 172.21.15.32:0/3270169404 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ddc012ea0 con 0x7f0de40ccd50 2023-10-08T06:10:20.170 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:20.167+0000 7f0de95a6700 1 -- 172.21.15.32:0/3270169404 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0de40b1e10 con 0x7f0de40ccd50 2023-10-08T06:10:20.170 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:20.167+0000 7f0de95a6700 1 -- 172.21.15.32:0/3270169404 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0de40b21a0 con 0x7f0de40ccd50 2023-10-08T06:10:20.170 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:20.167+0000 7f0de95a6700 1 -- 172.21.15.32:0/3270169404 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0de40b2610 con 0x7f0de40ccd50 2023-10-08T06:10:20.171 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:20.167+0000 7f0de0ff9700 1 -- 172.21.15.32:0/3270169404 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f0ddc004280 con 0x7f0de40ccd50 2023-10-08T06:10:20.171 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:20.167+0000 7f0de0ff9700 1 --2- 172.21.15.32:0/3270169404 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f0dc8066510 0x7f0dc80689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:20.172 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:20.171+0000 7f0de0ff9700 1 -- 172.21.15.32:0/3270169404 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f0ddc022070 con 0x7f0de40ccd50 2023-10-08T06:10:20.172 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:20.171+0000 7f0de3fff700 1 --2- 172.21.15.32:0/3270169404 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f0dc8066510 0x7f0dc80689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:20.172 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:20.171+0000 7f0de3fff700 1 --2- 172.21.15.32:0/3270169404 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f0dc8066510 0x7f0dc80689d0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f0dd4005930 tx=0x7f0dd4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:20.176 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:20.175+0000 7f0de0ff9700 1 -- 172.21.15.32:0/3270169404 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f0ddc053080 con 0x7f0de40ccd50 2023-10-08T06:10:20.355 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:20.351+0000 7f0de95a6700 1 -- 172.21.15.32:0/3270169404 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f0de40686a0 con 0x7f0de40ccd50 2023-10-08T06:10:20.355 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:20.351+0000 7f0de0ff9700 1 -- 172.21.15.32:0/3270169404 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) v1 ==== 80+0+0 (secure 0 0 0) 0x7f0ddc0566a0 con 0x7f0de40ccd50 2023-10-08T06:10:20.358 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:20.355+0000 7f0de95a6700 1 -- 172.21.15.32:0/3270169404 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f0dc8066510 msgr2=0x7f0dc80689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:20.358 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:20.355+0000 7f0de95a6700 1 --2- 172.21.15.32:0/3270169404 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f0dc8066510 0x7f0dc80689d0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f0dd4005930 tx=0x7f0dd4009040 comp rx=0 tx=0).stop 2023-10-08T06:10:20.358 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:20.355+0000 7f0de95a6700 1 -- 172.21.15.32:0/3270169404 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0de40ccd50 msgr2=0x7f0de40c8600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:20.359 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:20.355+0000 7f0de95a6700 1 --2- 172.21.15.32:0/3270169404 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0de40ccd50 0x7f0de40c8600 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f0ddc014040 tx=0x7f0ddc004af0 comp rx=0 tx=0).stop 2023-10-08T06:10:20.359 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:20.355+0000 7f0de95a6700 1 -- 172.21.15.32:0/3270169404 shutdown_connections 2023-10-08T06:10:20.359 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:20.355+0000 7f0de95a6700 1 --2- 172.21.15.32:0/3270169404 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f0dc8066510 0x7f0dc80689d0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:20.359 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:20.355+0000 7f0de95a6700 1 --2- 172.21.15.32:0/3270169404 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0de40ccd50 0x7f0de40c8600 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:20.359 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:20.355+0000 7f0de95a6700 1 --2- 172.21.15.32:0/3270169404 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0de40cc970 0x7f0de4154a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:20.359 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:20.355+0000 7f0de95a6700 1 --2- 172.21.15.32:0/3270169404 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0de40b02c0 0x7f0de40b59c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:20.360 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:20.355+0000 7f0de95a6700 1 -- 172.21.15.32:0/3270169404 >> 172.21.15.32:0/3270169404 conn(0x7f0de406df60 msgr2=0x7f0de40cb480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:10:20.360 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:20.355+0000 7f0de95a6700 1 -- 172.21.15.32:0/3270169404 shutdown_connections 2023-10-08T06:10:20.360 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:20.355+0000 7f0de95a6700 1 -- 172.21.15.32:0/3270169404 wait complete. 2023-10-08T06:10:20.361 INFO:teuthology.orchestra.run.smithi032.stderr:listed 0 entries 2023-10-08T06:10:20.370 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-10-08T06:10:20.371 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-08T06:10:20.379 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T06:10:20.498 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:20.495+0000 7fefeafe9700 1 Processor -- start 2023-10-08T06:10:20.498 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:20.495+0000 7fefeafe9700 1 -- start start 2023-10-08T06:10:20.499 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:20.495+0000 7fefeafe9700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fefe4159ed0 0x7fefe40ca9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:20.499 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:20.495+0000 7fefeafe9700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fefe40c98c0 0x7fefe40cb510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:20.499 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:20.495+0000 7fefeafe9700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefe40cca40 con 0x7fefe415a2b0 2023-10-08T06:10:20.499 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:20.495+0000 7fefeafe9700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fefe40ccdb0 con 0x7fefe4159ed0 2023-10-08T06:10:20.499 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:20.495+0000 7fefeafe9700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefe40caef0 con 0x7fefe40c98c0 2023-10-08T06:10:20.500 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:20.495+0000 7fefea7e8700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fefe40c98c0 0x7fefe40cb510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:20.500 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:20.495+0000 7fefe9fe7700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fefe4159ed0 0x7fefe40ca9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:20.500 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:20.495+0000 7fefe97e6700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fefe415a2b0 0x7fefe40706f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.32:37478/0 (socket says 172.21.15.32:37478) 2023-10-08T06:10:20.500 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:20.495+0000 7fefe97e6700 1 -- 172.21.15.32:0/32412918 learned_addr learned my addr 172.21.15.32:0/32412918 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-08T06:10:20.501 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:20.499+0000 7fefea7e8700 1 -- 172.21.15.32:0/32412918 >> v2:172.21.15.40:3300/0 conn(0x7fefe4159ed0 msgr2=0x7fefe40ca9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:10:20.501 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:20.499+0000 7fefea7e8700 1 --2- 172.21.15.32:0/32412918 >> v2:172.21.15.40:3300/0 conn(0x7fefe4159ed0 0x7fefe40ca9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:20.501 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:20.499+0000 7fefea7e8700 1 -- 172.21.15.32:0/32412918 >> v1:172.21.15.40:6789/0 conn(0x7fefe415a2b0 legacy=0x7fefe40706f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:20.501 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:20.499+0000 7fefea7e8700 1 -- 172.21.15.32:0/32412918 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefe40cdf60 con 0x7fefe40c98c0 2023-10-08T06:10:20.501 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:20.499+0000 7fefe8fe5700 1 -- 172.21.15.32:0/32412918 <== mon.1 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1487538159 0 0) 0x7fefe40cca40 con 0x7fefe415a2b0 2023-10-08T06:10:20.501 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:20.499+0000 7fefea7e8700 1 --2- 172.21.15.32:0/32412918 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fefe40c98c0 0x7fefe40cb510 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fefdc00bfa0 tx=0x7fefdc00d330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e5a89638a79e138a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:20.501 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:20.499+0000 7fefe8fe5700 1 -- 172.21.15.32:0/32412918 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefdc010070 con 0x7fefe40c98c0 2023-10-08T06:10:20.501 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:20.499+0000 7fefe8fe5700 1 -- 172.21.15.32:0/32412918 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefdc00b2e0 con 0x7fefe40c98c0 2023-10-08T06:10:20.501 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:20.499+0000 7fefe8fe5700 1 -- 172.21.15.32:0/32412918 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefdc00dc40 con 0x7fefe40c98c0 2023-10-08T06:10:20.502 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:20.499+0000 7fefeafe9700 1 -- 172.21.15.32:0/32412918 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fefe40c98c0 msgr2=0x7fefe40cb510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:20.502 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:20.499+0000 7fefeafe9700 1 --2- 172.21.15.32:0/32412918 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fefe40c98c0 0x7fefe40cb510 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fefdc00bfa0 tx=0x7fefdc00d330 comp rx=0 tx=0).stop 2023-10-08T06:10:20.502 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:20.499+0000 7fefeafe9700 1 -- 172.21.15.32:0/32412918 shutdown_connections 2023-10-08T06:10:20.502 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:20.499+0000 7fefeafe9700 1 --2- 172.21.15.32:0/32412918 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fefe40c98c0 0x7fefe40cb510 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:20.502 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:20.499+0000 7fefeafe9700 1 --2- 172.21.15.32:0/32412918 >> v2:172.21.15.40:3300/0 conn(0x7fefe4159ed0 0x7fefe40ca9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:20.503 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:20.499+0000 7fefeafe9700 1 -- 172.21.15.32:0/32412918 >> 172.21.15.32:0/32412918 conn(0x7fefe40b0900 msgr2=0x7fefe40b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:10:20.503 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:20.499+0000 7fefeafe9700 1 -- 172.21.15.32:0/32412918 shutdown_connections 2023-10-08T06:10:20.503 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:20.499+0000 7fefeafe9700 1 -- 172.21.15.32:0/32412918 wait complete. 2023-10-08T06:10:20.503 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:20.499+0000 7fefeafe9700 1 Processor -- start 2023-10-08T06:10:20.503 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:20.499+0000 7fefeafe9700 1 -- start start 2023-10-08T06:10:20.505 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:20.503+0000 7fefeafe9700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fefe40c98c0 0x7fefe414b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:20.505 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:20.503+0000 7fefeafe9700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fefe4159ed0 0x7fefe40ce730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:20.505 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:20.503+0000 7fefeafe9700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fefe415a2b0 0x7fefe40cec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:20.505 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:20.503+0000 7fefeafe9700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefe40c6d70 con 0x7fefe40c98c0 2023-10-08T06:10:20.505 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:20.503+0000 7fefeafe9700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefe40c5ea0 con 0x7fefe415a2b0 2023-10-08T06:10:20.505 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:20.503+0000 7fefeafe9700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefe414b700 con 0x7fefe4159ed0 2023-10-08T06:10:20.505 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:20.503+0000 7fefe9fe7700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fefe40c98c0 0x7fefe414b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:20.505 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:20.503+0000 7fefe9fe7700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fefe40c98c0 0x7fefe414b1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:55874/0 (socket says 172.21.15.32:55874) 2023-10-08T06:10:20.505 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:20.503+0000 7fefe9fe7700 1 -- 172.21.15.32:0/1750283495 learned_addr learned my addr 172.21.15.32:0/1750283495 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:10:20.506 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:20.503+0000 7fefe97e6700 1 --2- 172.21.15.32:0/1750283495 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fefe4159ed0 0x7fefe40ce730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:20.506 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:20.503+0000 7fefea7e8700 1 --2- 172.21.15.32:0/1750283495 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fefe415a2b0 0x7fefe40cec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:20.507 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:20.503+0000 7fefe9fe7700 1 -- 172.21.15.32:0/1750283495 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fefe4159ed0 msgr2=0x7fefe40ce730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:20.507 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:20.503+0000 7fefe9fe7700 1 --2- 172.21.15.32:0/1750283495 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fefe4159ed0 0x7fefe40ce730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:20.507 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:20.503+0000 7fefe9fe7700 1 -- 172.21.15.32:0/1750283495 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fefe415a2b0 msgr2=0x7fefe40cec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:20.507 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:20.503+0000 7fefe9fe7700 1 --2- 172.21.15.32:0/1750283495 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fefe415a2b0 0x7fefe40cec70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:20.507 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:20.503+0000 7fefe9fe7700 1 -- 172.21.15.32:0/1750283495 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefdc00bc80 con 0x7fefe40c98c0 2023-10-08T06:10:20.508 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:20.503+0000 7fefe9fe7700 1 --2- 172.21.15.32:0/1750283495 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fefe40c98c0 0x7fefe414b1c0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fefe000e840 tx=0x7fefe000eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:20.508 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:20.503+0000 7fefda7fc700 1 -- 172.21.15.32:0/1750283495 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefe00095a0 con 0x7fefe40c98c0 2023-10-08T06:10:20.508 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:20.503+0000 7fefda7fc700 1 -- 172.21.15.32:0/1750283495 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefe0013680 con 0x7fefe40c98c0 2023-10-08T06:10:20.508 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:20.503+0000 7fefeafe9700 1 -- 172.21.15.32:0/1750283495 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefe40c60f0 con 0x7fefe40c98c0 2023-10-08T06:10:20.508 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:20.503+0000 7fefda7fc700 1 -- 172.21.15.32:0/1750283495 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefe00139f0 con 0x7fefe40c98c0 2023-10-08T06:10:20.508 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:20.503+0000 7fefeafe9700 1 -- 172.21.15.32:0/1750283495 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefe40c66b0 con 0x7fefe40c98c0 2023-10-08T06:10:20.509 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:20.507+0000 7fefeafe9700 1 -- 172.21.15.32:0/1750283495 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fefe40c2f90 con 0x7fefe40c98c0 2023-10-08T06:10:20.509 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:20.507+0000 7fefda7fc700 1 -- 172.21.15.32:0/1750283495 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fefe0013b50 con 0x7fefe40c98c0 2023-10-08T06:10:20.509 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:20.507+0000 7fefda7fc700 1 --2- 172.21.15.32:0/1750283495 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fefc8066510 0x7fefc80689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:20.510 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:20.507+0000 7fefda7fc700 1 -- 172.21.15.32:0/1750283495 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fefe0083d00 con 0x7fefe40c98c0 2023-10-08T06:10:20.510 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:20.507+0000 7fefe97e6700 1 --2- 172.21.15.32:0/1750283495 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fefc8066510 0x7fefc80689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:20.510 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:20.507+0000 7fefe97e6700 1 --2- 172.21.15.32:0/1750283495 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fefc8066510 0x7fefc80689d0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fefe41f6150 tx=0x7fefd4007e00 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:20.516 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:20.515+0000 7fefda7fc700 1 -- 172.21.15.32:0/1750283495 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fefe0051100 con 0x7fefe40c98c0 2023-10-08T06:10:20.685 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:20.683+0000 7fefeafe9700 1 -- 172.21.15.32:0/1750283495 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fefe4073f00 con 0x7fefe40c98c0 2023-10-08T06:10:20.688 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:20.683+0000 7fefda7fc700 1 -- 172.21.15.32:0/1750283495 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+16694 (secure 0 0 0) 0x7fefe0054720 con 0x7fefe40c98c0 2023-10-08T06:10:20.688 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:10:20.688 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":24,"fsid":"ac672d87-96ae-41e0-9314-623ba2cdbbba","created":"2023-10-08T06:09:11.175626+0000","modified":"2023-10-08T06:10:19.263068+0000","last_up_change":"2023-10-08T06:09:22.744643+0000","last_in_change":"2023-10-08T06:09:14.131580+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T06:09:23.307843+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T06:09:34.295012+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T06:09:35.515590+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"43433f0c-9592-4874-92d7-10f8f4acf07f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":587888964},{"type":"v1","addr":"172.21.15.32:6801","nonce":587888964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":587888964},{"type":"v1","addr":"172.21.15.32:6803","nonce":587888964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":587888964},{"type":"v1","addr":"172.21.15.32:6810","nonce":587888964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6805","nonce":587888964},{"type":"v1","addr":"172.21.15.32:6807","nonce":587888964}]},"public_addr":"172.21.15.32:6801/587888964","cluster_addr":"172.21.15.32:6803/587888964","heartbeat_back_addr":"172.21.15.32:6810/587888964","heartbeat_front_addr":"172.21.15.32:6807/587888964","state":["exists","up"]},{"osd":1,"uuid":"2ecb1008-b987-4ce7-b646-6cded55fc8d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":990576767},{"type":"v1","addr":"172.21.15.32:6817","nonce":990576767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":990576767},{"type":"v1","addr":"172.21.15.32:6819","nonce":990576767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":990576767},{"type":"v1","addr":"172.21.15.32:6823","nonce":990576767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":990576767},{"type":"v1","addr":"172.21.15.32:6821","nonce":990576767}]},"public_addr":"172.21.15.32:6817/990576767","cluster_addr":"172.21.15.32:6819/990576767","heartbeat_back_addr":"172.21.15.32:6823/990576767","heartbeat_front_addr":"172.21.15.32:6821/990576767","state":["exists","up"]},{"osd":2,"uuid":"1b131c94-c09b-4e80-8746-bf1b7bac362d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6824","nonce":1566874440},{"type":"v1","addr":"172.21.15.32:6825","nonce":1566874440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":1566874440},{"type":"v1","addr":"172.21.15.32:6827","nonce":1566874440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":1566874440},{"type":"v1","addr":"172.21.15.32:6831","nonce":1566874440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":1566874440},{"type":"v1","addr":"172.21.15.32:6829","nonce":1566874440}]},"public_addr":"172.21.15.32:6825/1566874440","cluster_addr":"172.21.15.32:6827/1566874440","heartbeat_back_addr":"172.21.15.32:6831/1566874440","heartbeat_front_addr":"172.21.15.32:6829/1566874440","state":["exists","up"]},{"osd":3,"uuid":"ad655af2-1f6f-4689-b21d-b07bbaeb68b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":3672614802},{"type":"v1","addr":"172.21.15.32:6806","nonce":3672614802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6809","nonce":3672614802},{"type":"v1","addr":"172.21.15.32:6811","nonce":3672614802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":3672614802},{"type":"v1","addr":"172.21.15.32:6815","nonce":3672614802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":3672614802},{"type":"v1","addr":"172.21.15.32:6813","nonce":3672614802}]},"public_addr":"172.21.15.32:6806/3672614802","cluster_addr":"172.21.15.32:6811/3672614802","heartbeat_back_addr":"172.21.15.32:6815/3672614802","heartbeat_front_addr":"172.21.15.32:6813/3672614802","state":["exists","up"]},{"osd":4,"uuid":"64a543a1-8c4f-458e-9aba-b35c1cd7dd03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":3369928244},{"type":"v1","addr":"172.21.15.40:6801","nonce":3369928244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":3369928244},{"type":"v1","addr":"172.21.15.40:6803","nonce":3369928244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":3369928244},{"type":"v1","addr":"172.21.15.40:6807","nonce":3369928244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":3369928244},{"type":"v1","addr":"172.21.15.40:6805","nonce":3369928244}]},"public_addr":"172.21.15.40:6801/3369928244","cluster_addr":"172.21.15.40:6803/3369928244","heartbeat_back_addr":"172.21.15.40:6807/3369928244","heartbeat_front_addr":"172.21.15.40:6805/3369928244","state":["exists","up"]},{"osd":5,"uuid":"0fef3e54-edb4-4678-878e-944663c51638","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":2395850297},{"type":"v1","addr":"172.21.15.40:6825","nonce":2395850297}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":2395850297},{"type":"v1","addr":"172.21.15.40:6827","nonce":2395850297}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":2395850297},{"type":"v1","addr":"172.21.15.40:6831","nonce":2395850297}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":2395850297},{"type":"v1","addr":"172.21.15.40:6829","nonce":2395850297}]},"public_addr":"172.21.15.40:6825/2395850297","cluster_addr":"172.21.15.40:6827/2395850297","heartbeat_back_addr":"172.21.15.40:6831/2395850297","heartbeat_front_addr":"172.21.15.40:6829/2395850297","state":["exists","up"]},{"osd":6,"uuid":"2eeb0472-6096-469d-9b2c-cab4bf41c31a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":4145283410},{"type":"v1","addr":"172.21.15.40:6809","nonce":4145283410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":4145283410},{"type":"v1","addr":"172.21.15.40:6811","nonce":4145283410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":4145283410},{"type":"v1","addr":"172.21.15.40:6815","nonce":4145283410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":4145283410},{"type":"v1","addr":"172.21.15.40:6813","nonce":4145283410}]},"public_addr":"172.21.15.40:6809/4145283410","cluster_addr":"172.21.15.40:6811/4145283410","heartbeat_back_addr":"172.21.15.40:6815/4145283410","heartbeat_front_addr":"172.21.15.40:6813/4145283410","state":["exists","up"]},{"osd":7,"uuid":"cf76e4c7-96a6-401f-a280-91aad4641940","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":2943297416},{"type":"v1","addr":"172.21.15.40:6817","nonce":2943297416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":2943297416},{"type":"v1","addr":"172.21.15.40:6819","nonce":2943297416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":2943297416},{"type":"v1","addr":"172.21.15.40:6823","nonce":2943297416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":2943297416},{"type":"v1","addr":"172.21.15.40:6821","nonce":2943297416}]},"public_addr":"172.21.15.40:6817/2943297416","cluster_addr":"172.21.15.40:6819/2943297416","heartbeat_back_addr":"172.21.15.40:6823/2943297416","heartbeat_front_addr":"172.21.15.40:6821/2943297416","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.411475+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.628841+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.599055+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.166100+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.384135+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.488403+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.307648+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.363541+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":3,"to":2}]},{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"3.39","mappings":[{"from":7,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T06:10:20.690 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:20.687+0000 7fefeafe9700 1 -- 172.21.15.32:0/1750283495 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fefc8066510 msgr2=0x7fefc80689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:20.690 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:20.687+0000 7fefeafe9700 1 --2- 172.21.15.32:0/1750283495 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fefc8066510 0x7fefc80689d0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fefe41f6150 tx=0x7fefd4007e00 comp rx=0 tx=0).stop 2023-10-08T06:10:20.690 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:20.687+0000 7fefeafe9700 1 -- 172.21.15.32:0/1750283495 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fefe40c98c0 msgr2=0x7fefe414b1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:20.690 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:20.687+0000 7fefeafe9700 1 --2- 172.21.15.32:0/1750283495 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fefe40c98c0 0x7fefe414b1c0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fefe000e840 tx=0x7fefe000eb50 comp rx=0 tx=0).stop 2023-10-08T06:10:20.691 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:20.687+0000 7fefeafe9700 1 -- 172.21.15.32:0/1750283495 shutdown_connections 2023-10-08T06:10:20.691 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:20.687+0000 7fefeafe9700 1 --2- 172.21.15.32:0/1750283495 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fefc8066510 0x7fefc80689d0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:20.691 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:20.687+0000 7fefeafe9700 1 --2- 172.21.15.32:0/1750283495 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fefe415a2b0 0x7fefe40cec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:20.691 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:20.687+0000 7fefeafe9700 1 --2- 172.21.15.32:0/1750283495 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fefe4159ed0 0x7fefe40ce730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:20.691 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:20.687+0000 7fefeafe9700 1 --2- 172.21.15.32:0/1750283495 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fefe40c98c0 0x7fefe414b1c0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:20.691 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:20.687+0000 7fefeafe9700 1 -- 172.21.15.32:0/1750283495 >> 172.21.15.32:0/1750283495 conn(0x7fefe40b0900 msgr2=0x7fefe40ad0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:10:20.691 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:20.687+0000 7fefeafe9700 1 -- 172.21.15.32:0/1750283495 shutdown_connections 2023-10-08T06:10:20.691 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:20.687+0000 7fefeafe9700 1 -- 172.21.15.32:0/1750283495 wait complete. 2023-10-08T06:10:20.703 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T06:09:23.307843+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-08T06:09:34.295012+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-08T06:09:35.515590+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-08T06:10:20.703 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T06:10:20.828 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:20.827+0000 7f7b1a43b700 1 Processor -- start 2023-10-08T06:10:20.828 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:20.827+0000 7f7b1a43b700 1 -- start start 2023-10-08T06:10:20.830 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:20.827+0000 7f7b1a43b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7b1415d490 0x7f7b140b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:20.830 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:20.827+0000 7f7b1a43b700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f7b140ce4e0 0x7f7b140b6130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:20.831 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:20.827+0000 7f7b1a43b700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b140d1bb0 con 0x7f7b140d13d0 2023-10-08T06:10:20.831 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:20.827+0000 7f7b1a43b700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b140d1e90 con 0x7f7b140ce4e0 2023-10-08T06:10:20.831 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:20.827+0000 7f7b1a43b700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b140d2170 con 0x7f7b1415d490 2023-10-08T06:10:20.831 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:20.827+0000 7f7b19c3a700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f7b140ce4e0 0x7f7b140b6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:20.831 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:20.827+0000 7f7b19c3a700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f7b140ce4e0 0x7f7b140b6130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:55878/0 (socket says 172.21.15.32:55878) 2023-10-08T06:10:20.831 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:20.827+0000 7f7b19c3a700 1 -- 172.21.15.32:0/3905953909 learned_addr learned my addr 172.21.15.32:0/3905953909 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:10:20.831 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:20.827+0000 7f7b19439700 1 --2- 172.21.15.32:0/3905953909 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7b1415d490 0x7f7b140b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:20.831 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:20.827+0000 7f7b19c3a700 1 -- 172.21.15.32:0/3905953909 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7b1415d490 msgr2=0x7f7b140b8bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:10:20.831 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:20.827+0000 7f7b19c3a700 1 --2- 172.21.15.32:0/3905953909 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7b1415d490 0x7f7b140b8bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:20.831 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:20.827+0000 7f7b19c3a700 1 -- 172.21.15.32:0/3905953909 >> v1:172.21.15.40:6789/0 conn(0x7f7b140d13d0 legacy=0x7f7b140cddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:20.831 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:20.827+0000 7f7b19c3a700 1 -- 172.21.15.32:0/3905953909 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b140d2450 con 0x7f7b140ce4e0 2023-10-08T06:10:20.832 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:20.827+0000 7f7b19c3a700 1 --2- 172.21.15.32:0/3905953909 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7b140ce4e0 0x7f7b140b6130 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f7b0c009e50 tx=0x7f7b0c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5b90203b38568c0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:20.833 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:20.827+0000 7f7b0bfff700 1 -- 172.21.15.32:0/3905953909 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b0c00e070 con 0x7f7b140ce4e0 2023-10-08T06:10:20.833 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:20.827+0000 7f7b0bfff700 1 -- 172.21.15.32:0/3905953909 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b0c00b910 con 0x7f7b140ce4e0 2023-10-08T06:10:20.833 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:20.827+0000 7f7b0bfff700 1 -- 172.21.15.32:0/3905953909 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b0c00bcc0 con 0x7f7b140ce4e0 2023-10-08T06:10:20.833 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:20.831+0000 7f7b1a43b700 1 -- 172.21.15.32:0/3905953909 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7b140ce4e0 msgr2=0x7f7b140b6130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:20.833 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:20.831+0000 7f7b1a43b700 1 --2- 172.21.15.32:0/3905953909 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7b140ce4e0 0x7f7b140b6130 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f7b0c009e50 tx=0x7f7b0c00b330 comp rx=0 tx=0).stop 2023-10-08T06:10:20.833 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:20.831+0000 7f7b1a43b700 1 -- 172.21.15.32:0/3905953909 shutdown_connections 2023-10-08T06:10:20.833 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:20.831+0000 7f7b1a43b700 1 --2- 172.21.15.32:0/3905953909 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7b140ce4e0 0x7f7b140b6130 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:20.833 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:20.831+0000 7f7b1a43b700 1 --2- 172.21.15.32:0/3905953909 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7b1415d490 0x7f7b140b8bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:20.833 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:20.831+0000 7f7b1a43b700 1 -- 172.21.15.32:0/3905953909 >> 172.21.15.32:0/3905953909 conn(0x7f7b1406ab40 msgr2=0x7f7b1406af20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:10:20.834 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:20.831+0000 7f7b1a43b700 1 -- 172.21.15.32:0/3905953909 shutdown_connections 2023-10-08T06:10:20.834 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:20.831+0000 7f7b1a43b700 1 -- 172.21.15.32:0/3905953909 wait complete. 2023-10-08T06:10:20.835 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:20.831+0000 7f7b1a43b700 1 Processor -- start 2023-10-08T06:10:20.835 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:20.831+0000 7f7b1a43b700 1 -- start start 2023-10-08T06:10:20.837 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:20.835+0000 7f7b1a43b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7b140ce4e0 0x7f7b140cb790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:20.837 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:20.835+0000 7f7b1a43b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7b140d13d0 0x7f7b140c74d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:20.838 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:20.835+0000 7f7b1a43b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7b1415d490 0x7f7b140c7a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:20.838 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:20.835+0000 7f7b1a43b700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b140ccd40 con 0x7f7b1415d490 2023-10-08T06:10:20.838 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:20.835+0000 7f7b1a43b700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b140c5d70 con 0x7f7b140ce4e0 2023-10-08T06:10:20.838 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:20.835+0000 7f7b1a43b700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b140cc0c0 con 0x7f7b140d13d0 2023-10-08T06:10:20.838 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:20.835+0000 7f7b19c3a700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7b1415d490 0x7f7b140c7a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:20.838 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:20.835+0000 7f7b19c3a700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7b1415d490 0x7f7b140c7a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:55880/0 (socket says 172.21.15.32:55880) 2023-10-08T06:10:20.838 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:20.835+0000 7f7b19c3a700 1 -- 172.21.15.32:0/3863772637 learned_addr learned my addr 172.21.15.32:0/3863772637 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:10:20.838 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:20.835+0000 7f7b18c38700 1 --2- 172.21.15.32:0/3863772637 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7b140d13d0 0x7f7b140c74d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:20.838 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:20.835+0000 7f7b19439700 1 --2- 172.21.15.32:0/3863772637 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7b140ce4e0 0x7f7b140cb790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:20.838 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:20.835+0000 7f7b19c3a700 1 -- 172.21.15.32:0/3863772637 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7b140d13d0 msgr2=0x7f7b140c74d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:20.838 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:20.835+0000 7f7b19c3a700 1 --2- 172.21.15.32:0/3863772637 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7b140d13d0 0x7f7b140c74d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:20.839 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:20.835+0000 7f7b19c3a700 1 -- 172.21.15.32:0/3863772637 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7b140ce4e0 msgr2=0x7f7b140cb790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:20.839 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:20.835+0000 7f7b19c3a700 1 --2- 172.21.15.32:0/3863772637 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7b140ce4e0 0x7f7b140cb790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:20.839 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:20.835+0000 7f7b19c3a700 1 -- 172.21.15.32:0/3863772637 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b0c009b30 con 0x7f7b1415d490 2023-10-08T06:10:20.839 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:20.835+0000 7f7b19c3a700 1 --2- 172.21.15.32:0/3863772637 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7b1415d490 0x7f7b140c7a10 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f7b14066f10 tx=0x7f7b0c004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:20.840 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:20.835+0000 7f7b09ffb700 1 -- 172.21.15.32:0/3863772637 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b0c004800 con 0x7f7b1415d490 2023-10-08T06:10:20.840 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:20.835+0000 7f7b09ffb700 1 -- 172.21.15.32:0/3863772637 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b0c0099b0 con 0x7f7b1415d490 2023-10-08T06:10:20.840 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:20.835+0000 7f7b09ffb700 1 -- 172.21.15.32:0/3863772637 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b0c01c680 con 0x7f7b1415d490 2023-10-08T06:10:20.840 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:20.835+0000 7f7b1a43b700 1 -- 172.21.15.32:0/3863772637 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b140cc3a0 con 0x7f7b1415d490 2023-10-08T06:10:20.840 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:20.835+0000 7f7b1a43b700 1 -- 172.21.15.32:0/3863772637 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b140cc960 con 0x7f7b1415d490 2023-10-08T06:10:20.841 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:20.839+0000 7f7b1a43b700 1 -- 172.21.15.32:0/3863772637 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b140cce80 con 0x7f7b1415d490 2023-10-08T06:10:20.841 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:20.839+0000 7f7b09ffb700 1 -- 172.21.15.32:0/3863772637 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f7b0c01c7e0 con 0x7f7b1415d490 2023-10-08T06:10:20.842 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:20.839+0000 7f7b09ffb700 1 --2- 172.21.15.32:0/3863772637 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f7af8066510 0x7f7af80689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:20.842 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:20.839+0000 7f7b09ffb700 1 -- 172.21.15.32:0/3863772637 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f7b0c085a90 con 0x7f7b1415d490 2023-10-08T06:10:20.842 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:20.839+0000 7f7b19439700 1 --2- 172.21.15.32:0/3863772637 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f7af8066510 0x7f7af80689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:20.843 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:20.839+0000 7f7b19439700 1 --2- 172.21.15.32:0/3863772637 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f7af8066510 0x7f7af80689d0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f7b10009b50 tx=0x7f7b10009240 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:20.851 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:20.847+0000 7f7b09ffb700 1 -- 172.21.15.32:0/3863772637 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f7b140cce80 con 0x7f7b1415d490 2023-10-08T06:10:21.017 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.015+0000 7f7b1a43b700 1 -- 172.21.15.32:0/3863772637 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7b140cce80 con 0x7f7b1415d490 2023-10-08T06:10:21.018 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.015+0000 7f7b09ffb700 1 -- 172.21.15.32:0/3863772637 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7b140cce80 con 0x7f7b1415d490 2023-10-08T06:10:21.018 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 1 2023-10-08T06:10:21.021 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.019+0000 7f7b1a43b700 1 -- 172.21.15.32:0/3863772637 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f7af8066510 msgr2=0x7f7af80689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:21.021 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.019+0000 7f7b1a43b700 1 --2- 172.21.15.32:0/3863772637 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f7af8066510 0x7f7af80689d0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f7b10009b50 tx=0x7f7b10009240 comp rx=0 tx=0).stop 2023-10-08T06:10:21.021 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.019+0000 7f7b1a43b700 1 -- 172.21.15.32:0/3863772637 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7b1415d490 msgr2=0x7f7b140c7a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:21.021 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.019+0000 7f7b1a43b700 1 --2- 172.21.15.32:0/3863772637 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7b1415d490 0x7f7b140c7a10 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f7b14066f10 tx=0x7f7b0c004af0 comp rx=0 tx=0).stop 2023-10-08T06:10:21.021 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.019+0000 7f7b1a43b700 1 -- 172.21.15.32:0/3863772637 shutdown_connections 2023-10-08T06:10:21.021 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.019+0000 7f7b1a43b700 1 --2- 172.21.15.32:0/3863772637 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f7af8066510 0x7f7af80689d0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:21.021 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.019+0000 7f7b1a43b700 1 --2- 172.21.15.32:0/3863772637 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7b1415d490 0x7f7b140c7a10 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:21.021 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.019+0000 7f7b1a43b700 1 --2- 172.21.15.32:0/3863772637 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7b140d13d0 0x7f7b140c74d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:21.021 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.019+0000 7f7b1a43b700 1 --2- 172.21.15.32:0/3863772637 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7b140ce4e0 0x7f7b140cb790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:21.022 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.019+0000 7f7b1a43b700 1 -- 172.21.15.32:0/3863772637 >> 172.21.15.32:0/3863772637 conn(0x7f7b1406ab40 msgr2=0x7f7b141534c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:10:21.022 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.019+0000 7f7b1a43b700 1 -- 172.21.15.32:0/3863772637 shutdown_connections 2023-10-08T06:10:21.022 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.019+0000 7f7b1a43b700 1 -- 172.21.15.32:0/3863772637 wait complete. 2023-10-08T06:10:21.034 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-08T06:10:21.153 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.151+0000 7f09ebfff700 1 Processor -- start 2023-10-08T06:10:21.153 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.151+0000 7f09ebfff700 1 -- start start 2023-10-08T06:10:21.154 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.151+0000 7f09ebfff700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f09ec0ce280 0x7f09ec15aca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:21.155 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.151+0000 7f09ebfff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f09ec0cef20 0x7f09ec0cf390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:21.155 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.151+0000 7f09ebfff700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09ec15b1e0 con 0x7f09ec06bef0 2023-10-08T06:10:21.155 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.151+0000 7f09ebfff700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09ec0cf8d0 con 0x7f09ec0ce280 2023-10-08T06:10:21.155 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.151+0000 7f09ebfff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09ec071640 con 0x7f09ec0cef20 2023-10-08T06:10:21.155 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.151+0000 7f09ea7fc700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f09ec0ce280 0x7f09ec15aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:21.155 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.151+0000 7f09eaffd700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f09ec06bef0 0x7f09ec06c2d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:38104/0 (socket says 172.21.15.32:38104) 2023-10-08T06:10:21.155 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.151+0000 7f09eaffd700 1 -- 172.21.15.32:0/4145230611 learned_addr learned my addr 172.21.15.32:0/4145230611 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-08T06:10:21.155 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.151+0000 7f09eb7fe700 1 --2- 172.21.15.32:0/4145230611 >> v2:172.21.15.40:3300/0 conn(0x7f09ec0cef20 0x7f09ec0cf390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:21.157 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.151+0000 7f09ea7fc700 1 -- 172.21.15.32:0/4145230611 >> v2:172.21.15.40:3300/0 conn(0x7f09ec0cef20 msgr2=0x7f09ec0cf390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:10:21.157 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.151+0000 7f09ea7fc700 1 --2- 172.21.15.32:0/4145230611 >> v2:172.21.15.40:3300/0 conn(0x7f09ec0cef20 0x7f09ec0cf390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:21.157 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.151+0000 7f09ea7fc700 1 -- 172.21.15.32:0/4145230611 >> v1:172.21.15.32:6789/0 conn(0x7f09ec06bef0 legacy=0x7f09ec06c2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:21.157 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.151+0000 7f09ea7fc700 1 -- 172.21.15.32:0/4145230611 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09ec15b410 con 0x7f09ec0ce280 2023-10-08T06:10:21.157 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.151+0000 7f09ea7fc700 1 --2- 172.21.15.32:0/4145230611 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f09ec0ce280 0x7f09ec15aca0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f09ec070170 tx=0x7f09d4009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6be841610a993ff8 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:21.157 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.151+0000 7f09e9ffb700 1 -- 172.21.15.32:0/4145230611 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09d4011830 con 0x7f09ec0ce280 2023-10-08T06:10:21.157 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.155+0000 7f09e9ffb700 1 -- 172.21.15.32:0/4145230611 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09d4011990 con 0x7f09ec0ce280 2023-10-08T06:10:21.157 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.155+0000 7f09e9ffb700 1 -- 172.21.15.32:0/4145230611 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09d4011d20 con 0x7f09ec0ce280 2023-10-08T06:10:21.157 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.155+0000 7f09ebfff700 1 -- 172.21.15.32:0/4145230611 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f09ec0ce280 msgr2=0x7f09ec15aca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:21.157 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.155+0000 7f09ebfff700 1 --2- 172.21.15.32:0/4145230611 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f09ec0ce280 0x7f09ec15aca0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f09ec070170 tx=0x7f09d4009b60 comp rx=0 tx=0).stop 2023-10-08T06:10:21.158 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.155+0000 7f09ebfff700 1 -- 172.21.15.32:0/4145230611 shutdown_connections 2023-10-08T06:10:21.158 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.155+0000 7f09ebfff700 1 --2- 172.21.15.32:0/4145230611 >> v2:172.21.15.40:3300/0 conn(0x7f09ec0cef20 0x7f09ec0cf390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:21.158 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.155+0000 7f09ebfff700 1 --2- 172.21.15.32:0/4145230611 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f09ec0ce280 0x7f09ec15aca0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:21.158 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.155+0000 7f09ebfff700 1 -- 172.21.15.32:0/4145230611 >> 172.21.15.32:0/4145230611 conn(0x7f09ec06a480 msgr2=0x7f09ec06a890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:10:21.158 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.155+0000 7f09ebfff700 1 -- 172.21.15.32:0/4145230611 shutdown_connections 2023-10-08T06:10:21.158 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.155+0000 7f09ebfff700 1 -- 172.21.15.32:0/4145230611 wait complete. 2023-10-08T06:10:21.159 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.155+0000 7f09ebfff700 1 Processor -- start 2023-10-08T06:10:21.159 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.155+0000 7f09ebfff700 1 -- start start 2023-10-08T06:10:21.159 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.155+0000 7f09ebfff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f09ec06bef0 0x7f09ec154790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:21.160 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.155+0000 7f09ebfff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f09ec0ce280 0x7f09ec1f19f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:21.161 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.155+0000 7f09ebfff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f09ec0cef20 0x7f09ec0a94e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:21.161 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.155+0000 7f09ebfff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09ec0c93e0 con 0x7f09ec06bef0 2023-10-08T06:10:21.161 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.155+0000 7f09ebfff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09ec0a9ea0 con 0x7f09ec0ce280 2023-10-08T06:10:21.161 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.155+0000 7f09ebfff700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09ec0c9630 con 0x7f09ec0cef20 2023-10-08T06:10:21.161 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.159+0000 7f09eaffd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f09ec06bef0 0x7f09ec154790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:21.161 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.159+0000 7f09eaffd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f09ec06bef0 0x7f09ec154790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:55898/0 (socket says 172.21.15.32:55898) 2023-10-08T06:10:21.161 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.159+0000 7f09eb7fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f09ec0cef20 0x7f09ec0a94e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:21.161 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.159+0000 7f09eaffd700 1 -- 172.21.15.32:0/660746987 learned_addr learned my addr 172.21.15.32:0/660746987 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:10:21.161 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.159+0000 7f09ea7fc700 1 --2- 172.21.15.32:0/660746987 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f09ec0ce280 0x7f09ec1f19f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:21.163 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.159+0000 7f09eaffd700 1 -- 172.21.15.32:0/660746987 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f09ec0cef20 msgr2=0x7f09ec0a94e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:21.163 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.159+0000 7f09eaffd700 1 --2- 172.21.15.32:0/660746987 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f09ec0cef20 0x7f09ec0a94e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:21.163 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.159+0000 7f09eaffd700 1 -- 172.21.15.32:0/660746987 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f09ec0ce280 msgr2=0x7f09ec1f19f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:21.163 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.159+0000 7f09eaffd700 1 --2- 172.21.15.32:0/660746987 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f09ec0ce280 0x7f09ec1f19f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:21.163 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.159+0000 7f09eaffd700 1 -- 172.21.15.32:0/660746987 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09d40094b0 con 0x7f09ec06bef0 2023-10-08T06:10:21.163 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.159+0000 7f09eaffd700 1 --2- 172.21.15.32:0/660746987 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f09ec06bef0 0x7f09ec154790 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f09dc00c480 tx=0x7f09dc00c790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:21.163 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.159+0000 7f09e37fe700 1 -- 172.21.15.32:0/660746987 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09dc005d90 con 0x7f09ec06bef0 2023-10-08T06:10:21.164 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.159+0000 7f09e37fe700 1 -- 172.21.15.32:0/660746987 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09dc00ce90 con 0x7f09ec06bef0 2023-10-08T06:10:21.164 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.159+0000 7f09ebfff700 1 -- 172.21.15.32:0/660746987 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09ec0c9910 con 0x7f09ec06bef0 2023-10-08T06:10:21.164 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.159+0000 7f09e37fe700 1 -- 172.21.15.32:0/660746987 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09dc0072f0 con 0x7f09ec06bef0 2023-10-08T06:10:21.164 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.159+0000 7f09ebfff700 1 -- 172.21.15.32:0/660746987 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09ec1f1f30 con 0x7f09ec06bef0 2023-10-08T06:10:21.164 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.159+0000 7f09ebfff700 1 -- 172.21.15.32:0/660746987 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09ec0c2680 con 0x7f09ec06bef0 2023-10-08T06:10:21.165 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.163+0000 7f09e37fe700 1 -- 172.21.15.32:0/660746987 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f09dc007450 con 0x7f09ec06bef0 2023-10-08T06:10:21.165 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.163+0000 7f09e37fe700 1 --2- 172.21.15.32:0/660746987 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f09cc066510 0x7f09cc0689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:21.165 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.163+0000 7f09e37fe700 1 -- 172.21.15.32:0/660746987 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f09dc083210 con 0x7f09ec06bef0 2023-10-08T06:10:21.165 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.163+0000 7f09ea7fc700 1 --2- 172.21.15.32:0/660746987 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f09cc066510 0x7f09cc0689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:21.165 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.163+0000 7f09ea7fc700 1 --2- 172.21.15.32:0/660746987 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f09cc066510 0x7f09cc0689d0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f09ec06fb60 tx=0x7f09d4008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:21.174 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.171+0000 7f09e37fe700 1 -- 172.21.15.32:0/660746987 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f09dc050600 con 0x7f09ec06bef0 2023-10-08T06:10:21.340 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.339+0000 7f09ebfff700 1 -- 172.21.15.32:0/660746987 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f09ec0c9e30 con 0x7f09ec06bef0 2023-10-08T06:10:21.341 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.339+0000 7f09e37fe700 1 -- 172.21.15.32:0/660746987 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f09dc053c20 con 0x7f09ec06bef0 2023-10-08T06:10:21.341 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 32 2023-10-08T06:10:21.343 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.339+0000 7f09ebfff700 1 -- 172.21.15.32:0/660746987 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f09cc066510 msgr2=0x7f09cc0689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:21.343 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.339+0000 7f09ebfff700 1 --2- 172.21.15.32:0/660746987 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f09cc066510 0x7f09cc0689d0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f09ec06fb60 tx=0x7f09d4008030 comp rx=0 tx=0).stop 2023-10-08T06:10:21.343 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.339+0000 7f09ebfff700 1 -- 172.21.15.32:0/660746987 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f09ec06bef0 msgr2=0x7f09ec154790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:21.343 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.339+0000 7f09ebfff700 1 --2- 172.21.15.32:0/660746987 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f09ec06bef0 0x7f09ec154790 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f09dc00c480 tx=0x7f09dc00c790 comp rx=0 tx=0).stop 2023-10-08T06:10:21.344 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.339+0000 7f09ebfff700 1 -- 172.21.15.32:0/660746987 shutdown_connections 2023-10-08T06:10:21.344 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.339+0000 7f09ebfff700 1 --2- 172.21.15.32:0/660746987 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f09cc066510 0x7f09cc0689d0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:21.344 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.339+0000 7f09ebfff700 1 --2- 172.21.15.32:0/660746987 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f09ec0cef20 0x7f09ec0a94e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:21.344 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.339+0000 7f09ebfff700 1 --2- 172.21.15.32:0/660746987 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f09ec0ce280 0x7f09ec1f19f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:21.344 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.339+0000 7f09ebfff700 1 --2- 172.21.15.32:0/660746987 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f09ec06bef0 0x7f09ec154790 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:21.344 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.339+0000 7f09ebfff700 1 -- 172.21.15.32:0/660746987 >> 172.21.15.32:0/660746987 conn(0x7f09ec06a480 msgr2=0x7f09ec15e010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:10:21.344 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.339+0000 7f09ebfff700 1 -- 172.21.15.32:0/660746987 shutdown_connections 2023-10-08T06:10:21.344 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.339+0000 7f09ebfff700 1 -- 172.21.15.32:0/660746987 wait complete. 2023-10-08T06:10:21.356 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-08T06:10:21.472 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.471+0000 7fc8c5a54700 1 Processor -- start 2023-10-08T06:10:21.472 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.471+0000 7fc8c5a54700 1 -- start start 2023-10-08T06:10:21.474 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.471+0000 7fc8c5a54700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fc8c015b980 0x7fc8c015f780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:21.474 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.471+0000 7fc8c5a54700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc8c00719e0 0x7fc8c00c9420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:21.474 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.471+0000 7fc8c5a54700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8c006fc20 con 0x7fc8c00c9960 2023-10-08T06:10:21.474 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.471+0000 7fc8c5a54700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8c00c9e10 con 0x7fc8c015b980 2023-10-08T06:10:21.474 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.471+0000 7fc8c5a54700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8c0070430 con 0x7fc8c00719e0 2023-10-08T06:10:21.474 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.471+0000 7fc8c4a52700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fc8c015b980 0x7fc8c015f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:21.474 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.471+0000 7fc8c4a52700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fc8c015b980 0x7fc8c015f780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:55910/0 (socket says 172.21.15.32:55910) 2023-10-08T06:10:21.474 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.471+0000 7fc8c4a52700 1 -- 172.21.15.32:0/1965927928 learned_addr learned my addr 172.21.15.32:0/1965927928 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:10:21.475 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.471+0000 7fc8bffff700 1 --2- 172.21.15.32:0/1965927928 >> v2:172.21.15.40:3300/0 conn(0x7fc8c00719e0 0x7fc8c00c9420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:21.475 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.471+0000 7fc8c4a52700 1 -- 172.21.15.32:0/1965927928 >> v2:172.21.15.40:3300/0 conn(0x7fc8c00719e0 msgr2=0x7fc8c00c9420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:10:21.475 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.471+0000 7fc8c4a52700 1 --2- 172.21.15.32:0/1965927928 >> v2:172.21.15.40:3300/0 conn(0x7fc8c00719e0 0x7fc8c00c9420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:21.475 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.471+0000 7fc8c4a52700 1 -- 172.21.15.32:0/1965927928 >> v1:172.21.15.40:6789/0 conn(0x7fc8c00c9960 legacy=0x7fc8c015bd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:21.475 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.471+0000 7fc8c4a52700 1 -- 172.21.15.32:0/1965927928 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8c015fcc0 con 0x7fc8c015b980 2023-10-08T06:10:21.476 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.471+0000 7fc8c4a52700 1 --2- 172.21.15.32:0/1965927928 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc8c015b980 0x7fc8c015f780 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fc8c00685e0 tx=0x7fc8a8009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=760d2c1bdd62d56e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:21.476 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.471+0000 7fc8bf7fe700 1 -- 172.21.15.32:0/1965927928 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8a8011830 con 0x7fc8c015b980 2023-10-08T06:10:21.476 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.471+0000 7fc8bf7fe700 1 -- 172.21.15.32:0/1965927928 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8a8011990 con 0x7fc8c015b980 2023-10-08T06:10:21.476 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.471+0000 7fc8bf7fe700 1 -- 172.21.15.32:0/1965927928 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8a8011d20 con 0x7fc8c015b980 2023-10-08T06:10:21.477 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.471+0000 7fc8c5a54700 1 -- 172.21.15.32:0/1965927928 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc8c015b980 msgr2=0x7fc8c015f780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:21.477 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.471+0000 7fc8c5a54700 1 --2- 172.21.15.32:0/1965927928 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc8c015b980 0x7fc8c015f780 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fc8c00685e0 tx=0x7fc8a8009bf0 comp rx=0 tx=0).stop 2023-10-08T06:10:21.477 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.471+0000 7fc8c5a54700 1 -- 172.21.15.32:0/1965927928 shutdown_connections 2023-10-08T06:10:21.477 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.471+0000 7fc8c5a54700 1 --2- 172.21.15.32:0/1965927928 >> v2:172.21.15.40:3300/0 conn(0x7fc8c00719e0 0x7fc8c00c9420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:21.477 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.471+0000 7fc8c5a54700 1 --2- 172.21.15.32:0/1965927928 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc8c015b980 0x7fc8c015f780 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:21.477 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.471+0000 7fc8c5a54700 1 -- 172.21.15.32:0/1965927928 >> 172.21.15.32:0/1965927928 conn(0x7fc8c00b0900 msgr2=0x7fc8c00b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:10:21.477 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.471+0000 7fc8c5a54700 1 -- 172.21.15.32:0/1965927928 shutdown_connections 2023-10-08T06:10:21.477 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.471+0000 7fc8c5a54700 1 -- 172.21.15.32:0/1965927928 wait complete. 2023-10-08T06:10:21.478 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.475+0000 7fc8c5a54700 1 Processor -- start 2023-10-08T06:10:21.478 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.475+0000 7fc8c5a54700 1 -- start start 2023-10-08T06:10:21.479 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.475+0000 7fc8c5a54700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc8c00719e0 0x7fc8c00cdb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:21.479 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.475+0000 7fc8c5a54700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc8c00c9960 0x7fc8c0151390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:21.479 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.475+0000 7fc8c5a54700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc8c015ce70 0x7fc8c0156de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:21.479 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.475+0000 7fc8c5a54700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8c0158d20 con 0x7fc8c015ce70 2023-10-08T06:10:21.479 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.475+0000 7fc8c5a54700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8c0158760 con 0x7fc8c00719e0 2023-10-08T06:10:21.479 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.475+0000 7fc8c5a54700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8c0158a40 con 0x7fc8c00c9960 2023-10-08T06:10:21.480 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.475+0000 7fc8c5253700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc8c015ce70 0x7fc8c0156de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:21.480 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.475+0000 7fc8c4a52700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc8c00719e0 0x7fc8c00cdb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:21.480 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.475+0000 7fc8c5253700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc8c015ce70 0x7fc8c0156de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:55918/0 (socket says 172.21.15.32:55918) 2023-10-08T06:10:21.480 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.475+0000 7fc8c5253700 1 -- 172.21.15.32:0/2441679343 learned_addr learned my addr 172.21.15.32:0/2441679343 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:10:21.480 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.475+0000 7fc8bffff700 1 --2- 172.21.15.32:0/2441679343 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc8c00c9960 0x7fc8c0151390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:21.480 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.475+0000 7fc8c5253700 1 -- 172.21.15.32:0/2441679343 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc8c00c9960 msgr2=0x7fc8c0151390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:21.480 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.475+0000 7fc8c5253700 1 --2- 172.21.15.32:0/2441679343 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc8c00c9960 0x7fc8c0151390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:21.480 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.475+0000 7fc8c5253700 1 -- 172.21.15.32:0/2441679343 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc8c00719e0 msgr2=0x7fc8c00cdb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:21.480 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.475+0000 7fc8c5253700 1 --2- 172.21.15.32:0/2441679343 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc8c00719e0 0x7fc8c00cdb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:21.480 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.475+0000 7fc8c5253700 1 -- 172.21.15.32:0/2441679343 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8a8009570 con 0x7fc8c015ce70 2023-10-08T06:10:21.481 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.475+0000 7fc8c5253700 1 --2- 172.21.15.32:0/2441679343 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc8c015ce70 0x7fc8c0156de0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fc8b800c430 tx=0x7fc8b800c740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:21.481 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.479+0000 7fc8bd7fa700 1 -- 172.21.15.32:0/2441679343 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8b80052d0 con 0x7fc8c015ce70 2023-10-08T06:10:21.481 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.479+0000 7fc8bd7fa700 1 -- 172.21.15.32:0/2441679343 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8b8005430 con 0x7fc8c015ce70 2023-10-08T06:10:21.482 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.479+0000 7fc8c5a54700 1 -- 172.21.15.32:0/2441679343 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8c0157b40 con 0x7fc8c015ce70 2023-10-08T06:10:21.482 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.479+0000 7fc8bd7fa700 1 -- 172.21.15.32:0/2441679343 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8b80055a0 con 0x7fc8c015ce70 2023-10-08T06:10:21.482 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.479+0000 7fc8c5a54700 1 -- 172.21.15.32:0/2441679343 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8c00ce0d0 con 0x7fc8c015ce70 2023-10-08T06:10:21.482 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.479+0000 7fc8c5a54700 1 -- 172.21.15.32:0/2441679343 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8c0158060 con 0x7fc8c015ce70 2023-10-08T06:10:21.482 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.479+0000 7fc8bd7fa700 1 -- 172.21.15.32:0/2441679343 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fc8b80038e0 con 0x7fc8c015ce70 2023-10-08T06:10:21.483 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.479+0000 7fc8bd7fa700 1 --2- 172.21.15.32:0/2441679343 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fc8a0066510 0x7fc8a00689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:21.483 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.479+0000 7fc8bd7fa700 1 -- 172.21.15.32:0/2441679343 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fc8b8083490 con 0x7fc8c015ce70 2023-10-08T06:10:21.483 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.483+0000 7fc8c4a52700 1 --2- 172.21.15.32:0/2441679343 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fc8a0066510 0x7fc8a00689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:21.484 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.483+0000 7fc8c4a52700 1 --2- 172.21.15.32:0/2441679343 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fc8a0066510 0x7fc8a00689d0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fc8c00cfed0 tx=0x7fc8a8008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:21.490 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.487+0000 7fc8bd7fa700 1 -- 172.21.15.32:0/2441679343 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fc8b8050870 con 0x7fc8c015ce70 2023-10-08T06:10:21.655 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.651+0000 7fc8c5a54700 1 -- 172.21.15.32:0/2441679343 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc8c0158060 con 0x7fc8c015ce70 2023-10-08T06:10:21.656 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.655+0000 7fc8bd7fa700 1 -- 172.21.15.32:0/2441679343 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc8b8017020 con 0x7fc8c015ce70 2023-10-08T06:10:21.656 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 64 2023-10-08T06:10:21.659 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.655+0000 7fc8c5a54700 1 -- 172.21.15.32:0/2441679343 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fc8a0066510 msgr2=0x7fc8a00689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:21.659 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.655+0000 7fc8c5a54700 1 --2- 172.21.15.32:0/2441679343 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fc8a0066510 0x7fc8a00689d0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fc8c00cfed0 tx=0x7fc8a8008030 comp rx=0 tx=0).stop 2023-10-08T06:10:21.659 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.655+0000 7fc8c5a54700 1 -- 172.21.15.32:0/2441679343 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc8c015ce70 msgr2=0x7fc8c0156de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:21.659 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.655+0000 7fc8c5a54700 1 --2- 172.21.15.32:0/2441679343 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc8c015ce70 0x7fc8c0156de0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fc8b800c430 tx=0x7fc8b800c740 comp rx=0 tx=0).stop 2023-10-08T06:10:21.659 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.655+0000 7fc8c5a54700 1 -- 172.21.15.32:0/2441679343 shutdown_connections 2023-10-08T06:10:21.660 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.655+0000 7fc8c5a54700 1 --2- 172.21.15.32:0/2441679343 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fc8a0066510 0x7fc8a00689d0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:21.660 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.655+0000 7fc8c5a54700 1 --2- 172.21.15.32:0/2441679343 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc8c015ce70 0x7fc8c0156de0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:21.660 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.655+0000 7fc8c5a54700 1 --2- 172.21.15.32:0/2441679343 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc8c00c9960 0x7fc8c0151390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:21.660 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.655+0000 7fc8c5a54700 1 --2- 172.21.15.32:0/2441679343 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc8c00719e0 0x7fc8c00cdb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:21.660 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.655+0000 7fc8c5a54700 1 -- 172.21.15.32:0/2441679343 >> 172.21.15.32:0/2441679343 conn(0x7fc8c00b0900 msgr2=0x7fc8c0159ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:10:21.660 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.655+0000 7fc8c5a54700 1 -- 172.21.15.32:0/2441679343 shutdown_connections 2023-10-08T06:10:21.660 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.655+0000 7fc8c5a54700 1 -- 172.21.15.32:0/2441679343 wait complete. 2023-10-08T06:10:21.671 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-08T06:10:21.789 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.787+0000 7f4cd6759700 1 Processor -- start 2023-10-08T06:10:21.789 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.787+0000 7f4cd6759700 1 -- start start 2023-10-08T06:10:21.790 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.787+0000 7f4cd6759700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f4cd015b980 0x7f4cd015f780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:21.790 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.787+0000 7f4cd6759700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4cd00719e0 0x7f4cd00c9420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:21.790 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.787+0000 7f4cd6759700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4cd006fc20 con 0x7f4cd00c9960 2023-10-08T06:10:21.790 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.787+0000 7f4cd6759700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4cd0070430 con 0x7f4cd015b980 2023-10-08T06:10:21.790 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.787+0000 7f4cd6759700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4cd015ed70 con 0x7f4cd00719e0 2023-10-08T06:10:21.790 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.787+0000 7f4cd5f58700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f4cd00c9960 0x7f4cd015bd60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:38118/0 (socket says 172.21.15.32:38118) 2023-10-08T06:10:21.791 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.787+0000 7f4cd5f58700 1 -- 172.21.15.32:0/1537245010 learned_addr learned my addr 172.21.15.32:0/1537245010 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-08T06:10:21.791 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.787+0000 7f4cd5757700 1 --2- 172.21.15.32:0/1537245010 >> v2:172.21.15.32:3300/0 conn(0x7f4cd015b980 0x7f4cd015f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:21.791 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.787+0000 7f4cd4f56700 1 --2- 172.21.15.32:0/1537245010 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4cd00719e0 0x7f4cd00c9420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:21.792 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.787+0000 7f4cc7fff700 1 -- 172.21.15.32:0/1537245010 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4164174404 0 0) 0x7f4cd006fc20 con 0x7f4cd00c9960 2023-10-08T06:10:21.792 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.787+0000 7f4cc7fff700 1 -- 172.21.15.32:0/1537245010 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4cbc0035d0 con 0x7f4cd00c9960 2023-10-08T06:10:21.792 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.787+0000 7f4cd5757700 1 -- 172.21.15.32:0/1537245010 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4cd00719e0 msgr2=0x7f4cd00c9420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:10:21.792 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.787+0000 7f4cd5757700 1 --2- 172.21.15.32:0/1537245010 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4cd00719e0 0x7f4cd00c9420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:21.793 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.787+0000 7f4cd5757700 1 -- 172.21.15.32:0/1537245010 >> v1:172.21.15.32:6789/0 conn(0x7f4cd00c9960 legacy=0x7f4cd015bd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:21.793 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.787+0000 7f4cd5757700 1 -- 172.21.15.32:0/1537245010 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cd015fcc0 con 0x7f4cd015b980 2023-10-08T06:10:21.793 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.787+0000 7f4cd4f56700 1 --2- 172.21.15.32:0/1537245010 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4cd00719e0 0x7f4cd00c9420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T06:10:21.793 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.787+0000 7f4cd5757700 1 --2- 172.21.15.32:0/1537245010 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4cd015b980 0x7f4cd015f780 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f4cc0009850 tx=0x7f4cc0009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1f73c61b560c08b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:21.793 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.787+0000 7f4cc7fff700 1 -- 172.21.15.32:0/1537245010 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cc0011830 con 0x7f4cd015b980 2023-10-08T06:10:21.793 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.787+0000 7f4cc7fff700 1 -- 172.21.15.32:0/1537245010 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cc0011990 con 0x7f4cd015b980 2023-10-08T06:10:21.793 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.787+0000 7f4cc7fff700 1 -- 172.21.15.32:0/1537245010 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cc0011d40 con 0x7f4cd015b980 2023-10-08T06:10:21.793 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.791+0000 7f4cd6759700 1 -- 172.21.15.32:0/1537245010 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4cd015b980 msgr2=0x7f4cd015f780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:21.793 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.791+0000 7f4cd6759700 1 --2- 172.21.15.32:0/1537245010 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4cd015b980 0x7f4cd015f780 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f4cc0009850 tx=0x7f4cc0009b60 comp rx=0 tx=0).stop 2023-10-08T06:10:21.793 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.791+0000 7f4cd6759700 1 -- 172.21.15.32:0/1537245010 shutdown_connections 2023-10-08T06:10:21.793 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.791+0000 7f4cd6759700 1 --2- 172.21.15.32:0/1537245010 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4cd00719e0 0x7f4cd00c9420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:21.793 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.791+0000 7f4cd6759700 1 --2- 172.21.15.32:0/1537245010 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4cd015b980 0x7f4cd015f780 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:21.794 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.791+0000 7f4cd6759700 1 -- 172.21.15.32:0/1537245010 >> 172.21.15.32:0/1537245010 conn(0x7f4cd00b0900 msgr2=0x7f4cd00b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:10:21.794 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.791+0000 7f4cd6759700 1 -- 172.21.15.32:0/1537245010 shutdown_connections 2023-10-08T06:10:21.794 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.791+0000 7f4cd6759700 1 -- 172.21.15.32:0/1537245010 wait complete. 2023-10-08T06:10:21.795 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.791+0000 7f4cd6759700 1 Processor -- start 2023-10-08T06:10:21.795 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.795+0000 7f4cd6759700 1 -- start start 2023-10-08T06:10:21.798 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.795+0000 7f4cd6759700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4cd00719e0 0x7f4cd0152ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:21.798 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.795+0000 7f4cd6759700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4cd00c9960 0x7f4cd006bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:21.798 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.795+0000 7f4cd6759700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4cd015b980 0x7f4cd006c230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:21.798 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.795+0000 7f4cd6759700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cd0153430 con 0x7f4cd015b980 2023-10-08T06:10:21.798 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.795+0000 7f4cd6759700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cd01f4720 con 0x7f4cd00719e0 2023-10-08T06:10:21.798 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.795+0000 7f4cd6759700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4cd01f3960 con 0x7f4cd00c9960 2023-10-08T06:10:21.798 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.795+0000 7f4cd5f58700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4cd015b980 0x7f4cd006c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:21.798 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.795+0000 7f4cd5f58700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4cd015b980 0x7f4cd006c230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:55940/0 (socket says 172.21.15.32:55940) 2023-10-08T06:10:21.799 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.795+0000 7f4cd5f58700 1 -- 172.21.15.32:0/3784077795 learned_addr learned my addr 172.21.15.32:0/3784077795 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:10:21.799 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.795+0000 7f4cd5757700 1 --2- 172.21.15.32:0/3784077795 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4cd00719e0 0x7f4cd0152ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:21.799 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.795+0000 7f4cd4f56700 1 --2- 172.21.15.32:0/3784077795 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4cd00c9960 0x7f4cd006bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:21.799 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.795+0000 7f4cd5f58700 1 -- 172.21.15.32:0/3784077795 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4cd00c9960 msgr2=0x7f4cd006bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:21.799 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.795+0000 7f4cd5f58700 1 --2- 172.21.15.32:0/3784077795 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4cd00c9960 0x7f4cd006bcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:21.799 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.795+0000 7f4cd5f58700 1 -- 172.21.15.32:0/3784077795 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4cd00719e0 msgr2=0x7f4cd0152ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:21.799 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.795+0000 7f4cd5f58700 1 --2- 172.21.15.32:0/3784077795 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4cd00719e0 0x7f4cd0152ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:21.799 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.795+0000 7f4cd5f58700 1 -- 172.21.15.32:0/3784077795 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cc00094b0 con 0x7f4cd015b980 2023-10-08T06:10:21.799 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.795+0000 7f4cd5f58700 1 --2- 172.21.15.32:0/3784077795 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4cd015b980 0x7f4cd006c230 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f4cc800cb40 tx=0x7f4cc800cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:21.800 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.795+0000 7f4cc5ffb700 1 -- 172.21.15.32:0/3784077795 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cc8007500 con 0x7f4cd015b980 2023-10-08T06:10:21.800 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.795+0000 7f4cc5ffb700 1 -- 172.21.15.32:0/3784077795 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cc8007660 con 0x7f4cd015b980 2023-10-08T06:10:21.800 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.795+0000 7f4cd6759700 1 -- 172.21.15.32:0/3784077795 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4cd01f3c40 con 0x7f4cd015b980 2023-10-08T06:10:21.800 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.795+0000 7f4cc5ffb700 1 -- 172.21.15.32:0/3784077795 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cc80079f0 con 0x7f4cd015b980 2023-10-08T06:10:21.801 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.795+0000 7f4cd6759700 1 -- 172.21.15.32:0/3784077795 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4cd01f4200 con 0x7f4cd015b980 2023-10-08T06:10:21.801 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.799+0000 7f4cd6759700 1 -- 172.21.15.32:0/3784077795 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4cd01f43f0 con 0x7f4cd015b980 2023-10-08T06:10:21.801 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.799+0000 7f4cc5ffb700 1 -- 172.21.15.32:0/3784077795 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f4cc801b3b0 con 0x7f4cd015b980 2023-10-08T06:10:21.802 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.799+0000 7f4cc5ffb700 1 --2- 172.21.15.32:0/3784077795 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f4cb4066510 0x7f4cb40689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:21.802 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.799+0000 7f4cc5ffb700 1 -- 172.21.15.32:0/3784077795 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f4cc8083850 con 0x7f4cd015b980 2023-10-08T06:10:21.802 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.799+0000 7f4cd5757700 1 --2- 172.21.15.32:0/3784077795 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f4cb4066510 0x7f4cb40689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:21.802 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.799+0000 7f4cd5757700 1 --2- 172.21.15.32:0/3784077795 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f4cb4066510 0x7f4cb40689d0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f4cc00090b0 tx=0x7f4cc001c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:21.809 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.807+0000 7f4cc5ffb700 1 -- 172.21.15.32:0/3784077795 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f4cc8050ce0 con 0x7f4cd015b980 2023-10-08T06:10:21.985 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.983+0000 7f4cd6759700 1 -- 172.21.15.32:0/3784077795 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f4cd0073f00 con 0x7f4cd015b980 2023-10-08T06:10:21.985 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.983+0000 7f4cc5ffb700 1 -- 172.21.15.32:0/3784077795 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) v1 ==== 80+0+0 (secure 0 0 0) 0x7f4cc8017020 con 0x7f4cd015b980 2023-10-08T06:10:21.988 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.987+0000 7f4cd6759700 1 -- 172.21.15.32:0/3784077795 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f4cb4066510 msgr2=0x7f4cb40689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:21.988 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.987+0000 7f4cd6759700 1 --2- 172.21.15.32:0/3784077795 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f4cb4066510 0x7f4cb40689d0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f4cc00090b0 tx=0x7f4cc001c040 comp rx=0 tx=0).stop 2023-10-08T06:10:21.988 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.987+0000 7f4cd6759700 1 -- 172.21.15.32:0/3784077795 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4cd015b980 msgr2=0x7f4cd006c230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:21.988 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.987+0000 7f4cd6759700 1 --2- 172.21.15.32:0/3784077795 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4cd015b980 0x7f4cd006c230 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f4cc800cb40 tx=0x7f4cc800cb70 comp rx=0 tx=0).stop 2023-10-08T06:10:21.988 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.987+0000 7f4cd6759700 1 -- 172.21.15.32:0/3784077795 shutdown_connections 2023-10-08T06:10:21.989 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.987+0000 7f4cd6759700 1 --2- 172.21.15.32:0/3784077795 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f4cb4066510 0x7f4cb40689d0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:21.989 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.987+0000 7f4cd6759700 1 --2- 172.21.15.32:0/3784077795 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4cd015b980 0x7f4cd006c230 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:21.989 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.987+0000 7f4cd6759700 1 --2- 172.21.15.32:0/3784077795 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4cd00c9960 0x7f4cd006bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:21.989 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.987+0000 7f4cd6759700 1 --2- 172.21.15.32:0/3784077795 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4cd00719e0 0x7f4cd0152ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:21.989 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.987+0000 7f4cd6759700 1 -- 172.21.15.32:0/3784077795 >> 172.21.15.32:0/3784077795 conn(0x7f4cd00b0900 msgr2=0x7f4cd00b00b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:10:21.989 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.987+0000 7f4cd6759700 1 -- 172.21.15.32:0/3784077795 shutdown_connections 2023-10-08T06:10:21.989 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:21.987+0000 7f4cd6759700 1 -- 172.21.15.32:0/3784077795 wait complete. 2023-10-08T06:10:21.989 INFO:teuthology.orchestra.run.smithi032.stderr:listed 0 entries 2023-10-08T06:10:22.001 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi040.front.sepia.ceph.com... 2023-10-08T06:10:22.001 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T06:10:22.001 DEBUG:teuthology.orchestra.run.smithi040:> sudo fusermount -u /home/ubuntu/cephtest/mnt.3 2023-10-08T06:10:22.017 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T06:10:22.017 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi040.front.sepia.ceph.com 2023-10-08T06:10:22.018 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T06:10:22.018 DEBUG:teuthology.orchestra.run.smithi040:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-10-08T06:10:22.023 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-08T06:10:22.023 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T06:10:22.137 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.135+0000 7fd0c5e62700 1 Processor -- start 2023-10-08T06:10:22.137 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.135+0000 7fd0c5e62700 1 -- start start 2023-10-08T06:10:22.139 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.135+0000 7fd0c5e62700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd0c015b980 0x7fd0c015f780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:22.139 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.135+0000 7fd0c5e62700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd0c00719e0 0x7fd0c00c9420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:22.139 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.135+0000 7fd0c5e62700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fd0c00c9960 0x7fd0c015bd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:22.139 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.135+0000 7fd0c5e62700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0c0070430 con 0x7fd0c00c9960 2023-10-08T06:10:22.140 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.135+0000 7fd0c5e62700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0c015ed70 con 0x7fd0c015b980 2023-10-08T06:10:22.140 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.135+0000 7fd0c5e62700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0c00c9dd0 con 0x7fd0c00719e0 2023-10-08T06:10:22.140 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.135+0000 7fd0c5661700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fd0c00c9960 0x7fd0c015bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:22.140 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.135+0000 7fd0c5661700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fd0c00c9960 0x7fd0c015bd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:55956/0 (socket says 172.21.15.32:55956) 2023-10-08T06:10:22.140 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.135+0000 7fd0c5661700 1 -- 172.21.15.32:0/2569928096 learned_addr learned my addr 172.21.15.32:0/2569928096 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:10:22.140 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.135+0000 7fd0c4e60700 1 --2- 172.21.15.32:0/2569928096 >> v2:172.21.15.40:3300/0 conn(0x7fd0c015b980 0x7fd0c015f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:22.140 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.135+0000 7fd0bffff700 1 --2- 172.21.15.32:0/2569928096 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd0c00719e0 0x7fd0c00c9420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:22.140 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.135+0000 7fd0c5661700 1 -- 172.21.15.32:0/2569928096 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd0c00719e0 msgr2=0x7fd0c00c9420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:10:22.140 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.135+0000 7fd0c5661700 1 --2- 172.21.15.32:0/2569928096 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd0c00719e0 0x7fd0c00c9420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:22.140 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.135+0000 7fd0c5661700 1 -- 172.21.15.32:0/2569928096 >> v2:172.21.15.40:3300/0 conn(0x7fd0c015b980 msgr2=0x7fd0c015f780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:10:22.140 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.135+0000 7fd0c5661700 1 --2- 172.21.15.32:0/2569928096 >> v2:172.21.15.40:3300/0 conn(0x7fd0c015b980 0x7fd0c015f780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:22.141 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.135+0000 7fd0c5661700 1 -- 172.21.15.32:0/2569928096 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0c006fc20 con 0x7fd0c00c9960 2023-10-08T06:10:22.141 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.135+0000 7fd0c5661700 1 --2- 172.21.15.32:0/2569928096 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd0c00c9960 0x7fd0c015bd60 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fd0c00cec90 tx=0x7fd0b800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb903d6d2723e9cd server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:22.141 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.135+0000 7fd0bf7fe700 1 -- 172.21.15.32:0/2569928096 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0b800e070 con 0x7fd0c00c9960 2023-10-08T06:10:22.141 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.135+0000 7fd0bf7fe700 1 -- 172.21.15.32:0/2569928096 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0b800b980 con 0x7fd0c00c9960 2023-10-08T06:10:22.141 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.135+0000 7fd0bf7fe700 1 -- 172.21.15.32:0/2569928096 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0b800bd30 con 0x7fd0c00c9960 2023-10-08T06:10:22.142 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.139+0000 7fd0c5e62700 1 -- 172.21.15.32:0/2569928096 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd0c00c9960 msgr2=0x7fd0c015bd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:22.142 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.139+0000 7fd0c5e62700 1 --2- 172.21.15.32:0/2569928096 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd0c00c9960 0x7fd0c015bd60 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fd0c00cec90 tx=0x7fd0b800b330 comp rx=0 tx=0).stop 2023-10-08T06:10:22.142 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.139+0000 7fd0c5e62700 1 -- 172.21.15.32:0/2569928096 shutdown_connections 2023-10-08T06:10:22.142 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.139+0000 7fd0c5e62700 1 --2- 172.21.15.32:0/2569928096 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd0c00c9960 0x7fd0c015bd60 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:22.142 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.139+0000 7fd0c5e62700 1 --2- 172.21.15.32:0/2569928096 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd0c00719e0 0x7fd0c00c9420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:22.142 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.139+0000 7fd0c5e62700 1 --2- 172.21.15.32:0/2569928096 >> v2:172.21.15.40:3300/0 conn(0x7fd0c015b980 0x7fd0c015f780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:22.142 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.139+0000 7fd0c5e62700 1 -- 172.21.15.32:0/2569928096 >> 172.21.15.32:0/2569928096 conn(0x7fd0c00b0900 msgr2=0x7fd0c00b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:10:22.143 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.139+0000 7fd0c5e62700 1 -- 172.21.15.32:0/2569928096 shutdown_connections 2023-10-08T06:10:22.143 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.139+0000 7fd0c5e62700 1 -- 172.21.15.32:0/2569928096 wait complete. 2023-10-08T06:10:22.143 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.139+0000 7fd0c5e62700 1 Processor -- start 2023-10-08T06:10:22.143 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.139+0000 7fd0c5e62700 1 -- start start 2023-10-08T06:10:22.145 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.139+0000 7fd0c5e62700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd0c00719e0 0x7fd0c00cd3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:22.145 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.139+0000 7fd0c5e62700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd0c00c9960 0x7fd0c01596d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:22.145 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.139+0000 7fd0c5e62700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd0c015b980 0x7fd0c01539d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:22.145 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.139+0000 7fd0c5e62700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0c00ce8c0 con 0x7fd0c00719e0 2023-10-08T06:10:22.145 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.139+0000 7fd0c5e62700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0c00cdcb0 con 0x7fd0c015b980 2023-10-08T06:10:22.145 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.139+0000 7fd0c5e62700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0c00cdf90 con 0x7fd0c00c9960 2023-10-08T06:10:22.145 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.139+0000 7fd0c4e60700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd0c00719e0 0x7fd0c00cd3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:22.145 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.139+0000 7fd0c4e60700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd0c00719e0 0x7fd0c00cd3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:55970/0 (socket says 172.21.15.32:55970) 2023-10-08T06:10:22.145 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.139+0000 7fd0c4e60700 1 -- 172.21.15.32:0/1518079880 learned_addr learned my addr 172.21.15.32:0/1518079880 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:10:22.145 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.139+0000 7fd0bffff700 1 --2- 172.21.15.32:0/1518079880 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd0c00c9960 0x7fd0c01596d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:22.146 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.139+0000 7fd0c5661700 1 --2- 172.21.15.32:0/1518079880 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd0c015b980 0x7fd0c01539d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:22.146 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.143+0000 7fd0c4e60700 1 -- 172.21.15.32:0/1518079880 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd0c00c9960 msgr2=0x7fd0c01596d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:22.146 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.143+0000 7fd0c4e60700 1 --2- 172.21.15.32:0/1518079880 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd0c00c9960 0x7fd0c01596d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:22.146 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.143+0000 7fd0c4e60700 1 -- 172.21.15.32:0/1518079880 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd0c015b980 msgr2=0x7fd0c01539d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:22.146 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.143+0000 7fd0c4e60700 1 --2- 172.21.15.32:0/1518079880 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd0c015b980 0x7fd0c01539d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:22.146 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.143+0000 7fd0c4e60700 1 -- 172.21.15.32:0/1518079880 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0b8009b30 con 0x7fd0c00719e0 2023-10-08T06:10:22.146 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.143+0000 7fd0c4e60700 1 --2- 172.21.15.32:0/1518079880 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd0c00719e0 0x7fd0c00cd3b0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fd0ac00e760 tx=0x7fd0ac00ea70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:22.146 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.143+0000 7fd0bd7fa700 1 -- 172.21.15.32:0/1518079880 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0ac00c070 con 0x7fd0c00719e0 2023-10-08T06:10:22.146 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.143+0000 7fd0bd7fa700 1 -- 172.21.15.32:0/1518079880 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0ac013610 con 0x7fd0c00719e0 2023-10-08T06:10:22.146 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.143+0000 7fd0c5e62700 1 -- 172.21.15.32:0/1518079880 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0c00ce270 con 0x7fd0c00719e0 2023-10-08T06:10:22.146 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.143+0000 7fd0bd7fa700 1 -- 172.21.15.32:0/1518079880 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0ac013980 con 0x7fd0c00719e0 2023-10-08T06:10:22.147 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.143+0000 7fd0c5e62700 1 -- 172.21.15.32:0/1518079880 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0c00cd8f0 con 0x7fd0c00719e0 2023-10-08T06:10:22.147 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.143+0000 7fd0c5e62700 1 -- 172.21.15.32:0/1518079880 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0c0073f00 con 0x7fd0c00719e0 2023-10-08T06:10:22.147 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.143+0000 7fd0bd7fa700 1 -- 172.21.15.32:0/1518079880 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fd0ac013ae0 con 0x7fd0c00719e0 2023-10-08T06:10:22.148 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.147+0000 7fd0bd7fa700 1 --2- 172.21.15.32:0/1518079880 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fd0a4066510 0x7fd0a40689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:22.148 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.147+0000 7fd0bffff700 1 --2- 172.21.15.32:0/1518079880 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fd0a4066510 0x7fd0a40689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:22.148 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.147+0000 7fd0bd7fa700 1 -- 172.21.15.32:0/1518079880 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fd0ac0838e0 con 0x7fd0c00719e0 2023-10-08T06:10:22.148 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.147+0000 7fd0bffff700 1 --2- 172.21.15.32:0/1518079880 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fd0a4066510 0x7fd0a40689d0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fd0c015a280 tx=0x7fd0b4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:22.153 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.151+0000 7fd0bd7fa700 1 -- 172.21.15.32:0/1518079880 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fd0ac050cc0 con 0x7fd0c00719e0 2023-10-08T06:10:22.353 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.351+0000 7fd0c5e62700 1 -- 172.21.15.32:0/1518079880 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd0c00afaa0 con 0x7fd0c00719e0 2023-10-08T06:10:22.354 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.351+0000 7fd0bd7fa700 1 -- 172.21.15.32:0/1518079880 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4907 (secure 0 0 0) 0x7fd0ac0542e0 con 0x7fd0c00719e0 2023-10-08T06:10:22.355 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:10:22.355 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6833/2405386193","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":2405386193},{"type":"v1","addr":"172.21.15.40:6833","nonce":2405386193}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4254,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6835/1810658720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6834","nonce":1810658720},{"type":"v1","addr":"172.21.15.32:6835","nonce":1810658720}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4257,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6837/2286934165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6836","nonce":2286934165},{"type":"v1","addr":"172.21.15.32:6837","nonce":2286934165}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T06:09:36.528026+0000","modified":"2023-10-08T06:09:38.533661+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4318},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4318":{"gid":4318,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.40:6835/3325966535","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":3325966535},{"type":"v1","addr":"172.21.15.40:6835","nonce":3325966535}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-08T06:10:22.357 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.355+0000 7fd0c5e62700 1 -- 172.21.15.32:0/1518079880 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fd0a4066510 msgr2=0x7fd0a40689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:22.357 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.355+0000 7fd0c5e62700 1 --2- 172.21.15.32:0/1518079880 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fd0a4066510 0x7fd0a40689d0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fd0c015a280 tx=0x7fd0b4008040 comp rx=0 tx=0).stop 2023-10-08T06:10:22.357 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.355+0000 7fd0c5e62700 1 -- 172.21.15.32:0/1518079880 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd0c00719e0 msgr2=0x7fd0c00cd3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:22.357 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.355+0000 7fd0c5e62700 1 --2- 172.21.15.32:0/1518079880 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd0c00719e0 0x7fd0c00cd3b0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fd0ac00e760 tx=0x7fd0ac00ea70 comp rx=0 tx=0).stop 2023-10-08T06:10:22.357 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.355+0000 7fd0c5e62700 1 -- 172.21.15.32:0/1518079880 shutdown_connections 2023-10-08T06:10:22.357 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.355+0000 7fd0c5e62700 1 --2- 172.21.15.32:0/1518079880 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fd0a4066510 0x7fd0a40689d0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:22.357 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.355+0000 7fd0c5e62700 1 --2- 172.21.15.32:0/1518079880 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd0c015b980 0x7fd0c01539d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:22.358 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.355+0000 7fd0c5e62700 1 --2- 172.21.15.32:0/1518079880 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd0c00c9960 0x7fd0c01596d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:22.358 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.355+0000 7fd0c5e62700 1 --2- 172.21.15.32:0/1518079880 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd0c00719e0 0x7fd0c00cd3b0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:22.358 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.355+0000 7fd0c5e62700 1 -- 172.21.15.32:0/1518079880 >> 172.21.15.32:0/1518079880 conn(0x7fd0c00b0900 msgr2=0x7fd0c006c090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:10:22.358 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.355+0000 7fd0c5e62700 1 -- 172.21.15.32:0/1518079880 shutdown_connections 2023-10-08T06:10:22.358 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.355+0000 7fd0c5e62700 1 -- 172.21.15.32:0/1518079880 wait complete. 2023-10-08T06:10:22.358 INFO:teuthology.orchestra.run.smithi032.stderr:dumped fsmap epoch 6 2023-10-08T06:10:22.370 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T06:10:22.479 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.475+0000 7f43c5b56700 1 Processor -- start 2023-10-08T06:10:22.479 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.475+0000 7f43c5b56700 1 -- start start 2023-10-08T06:10:22.481 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.479+0000 7f43c5b56700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f43c015b980 0x7f43c015f780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:22.481 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.479+0000 7f43c5b56700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f43c00c9b30 0x7f43c015bd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:22.481 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.479+0000 7f43c5b56700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43c006fc20 con 0x7f43c00719e0 2023-10-08T06:10:22.481 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.479+0000 7f43c5b56700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43c0070430 con 0x7f43c015b980 2023-10-08T06:10:22.481 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.479+0000 7f43c5b56700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43c015ed70 con 0x7f43c00c9b30 2023-10-08T06:10:22.481 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.479+0000 7f43c4b54700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f43c015b980 0x7f43c015f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:22.481 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.479+0000 7f43bffff700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f43c00719e0 0x7f43c00c9420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:38132/0 (socket says 172.21.15.32:38132) 2023-10-08T06:10:22.481 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.479+0000 7f43bffff700 1 -- 172.21.15.32:0/2246727870 learned_addr learned my addr 172.21.15.32:0/2246727870 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-08T06:10:22.481 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.479+0000 7f43c5355700 1 --2- 172.21.15.32:0/2246727870 >> v2:172.21.15.40:3300/0 conn(0x7f43c00c9b30 0x7f43c015bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:22.481 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.479+0000 7f43bf7fe700 1 -- 172.21.15.32:0/2246727870 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3042086695 0 0) 0x7f43c006fc20 con 0x7f43c00719e0 2023-10-08T06:10:22.482 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.479+0000 7f43bf7fe700 1 -- 172.21.15.32:0/2246727870 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f43a80035d0 con 0x7f43c00719e0 2023-10-08T06:10:22.482 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.479+0000 7f43c4b54700 1 -- 172.21.15.32:0/2246727870 >> v2:172.21.15.40:3300/0 conn(0x7f43c00c9b30 msgr2=0x7f43c015bd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:10:22.482 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.479+0000 7f43c4b54700 1 --2- 172.21.15.32:0/2246727870 >> v2:172.21.15.40:3300/0 conn(0x7f43c00c9b30 0x7f43c015bd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:22.482 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.479+0000 7f43c4b54700 1 -- 172.21.15.32:0/2246727870 >> v1:172.21.15.32:6789/0 conn(0x7f43c00719e0 legacy=0x7f43c00c9420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:22.482 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.479+0000 7f43c4b54700 1 -- 172.21.15.32:0/2246727870 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43c015fcc0 con 0x7f43c015b980 2023-10-08T06:10:22.483 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.479+0000 7f43c4b54700 1 --2- 172.21.15.32:0/2246727870 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f43c015b980 0x7f43c015f780 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f43c00686d0 tx=0x7f43b4009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba6341c1ab5a1475 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:22.483 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.479+0000 7f43bf7fe700 1 -- 172.21.15.32:0/2246727870 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43b4011830 con 0x7f43c015b980 2023-10-08T06:10:22.483 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.479+0000 7f43bf7fe700 1 -- 172.21.15.32:0/2246727870 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43b4011990 con 0x7f43c015b980 2023-10-08T06:10:22.483 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.479+0000 7f43bf7fe700 1 -- 172.21.15.32:0/2246727870 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43b4011d00 con 0x7f43c015b980 2023-10-08T06:10:22.483 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.479+0000 7f43c5b56700 1 -- 172.21.15.32:0/2246727870 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f43c015b980 msgr2=0x7f43c015f780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:22.484 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.479+0000 7f43c5b56700 1 --2- 172.21.15.32:0/2246727870 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f43c015b980 0x7f43c015f780 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f43c00686d0 tx=0x7f43b4009b30 comp rx=0 tx=0).stop 2023-10-08T06:10:22.484 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.479+0000 7f43c5b56700 1 -- 172.21.15.32:0/2246727870 shutdown_connections 2023-10-08T06:10:22.484 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.479+0000 7f43c5b56700 1 --2- 172.21.15.32:0/2246727870 >> v2:172.21.15.40:3300/0 conn(0x7f43c00c9b30 0x7f43c015bd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:22.484 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.479+0000 7f43c5b56700 1 --2- 172.21.15.32:0/2246727870 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f43c015b980 0x7f43c015f780 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:22.484 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.479+0000 7f43c5b56700 1 -- 172.21.15.32:0/2246727870 >> 172.21.15.32:0/2246727870 conn(0x7f43c00b0900 msgr2=0x7f43c00b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:10:22.484 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.479+0000 7f43c5b56700 1 -- 172.21.15.32:0/2246727870 shutdown_connections 2023-10-08T06:10:22.484 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.479+0000 7f43c5b56700 1 -- 172.21.15.32:0/2246727870 wait complete. 2023-10-08T06:10:22.486 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.483+0000 7f43c5b56700 1 Processor -- start 2023-10-08T06:10:22.487 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.483+0000 7f43c5b56700 1 -- start start 2023-10-08T06:10:22.487 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.483+0000 7f43c5b56700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f43c00719e0 0x7f43c0150f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:22.487 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.483+0000 7f43c5b56700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f43c00c9b30 0x7f43c00c4350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:22.487 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.483+0000 7f43c5b56700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f43c015b980 0x7f43c00b3540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:22.487 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.483+0000 7f43c5b56700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43c00b3120 con 0x7f43c00719e0 2023-10-08T06:10:22.487 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.483+0000 7f43c5b56700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43c00b27c0 con 0x7f43c00c9b30 2023-10-08T06:10:22.487 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.483+0000 7f43c5b56700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43c00c4f30 con 0x7f43c015b980 2023-10-08T06:10:22.487 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.483+0000 7f43c4b54700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f43c00719e0 0x7f43c0150f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:22.487 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.483+0000 7f43c4b54700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f43c00719e0 0x7f43c0150f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:55984/0 (socket says 172.21.15.32:55984) 2023-10-08T06:10:22.487 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.483+0000 7f43c4b54700 1 -- 172.21.15.32:0/1128113340 learned_addr learned my addr 172.21.15.32:0/1128113340 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:10:22.488 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.483+0000 7f43c5355700 1 --2- 172.21.15.32:0/1128113340 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f43c015b980 0x7f43c00b3540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:22.488 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.483+0000 7f43bffff700 1 --2- 172.21.15.32:0/1128113340 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f43c00c9b30 0x7f43c00c4350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:22.488 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.483+0000 7f43c4b54700 1 -- 172.21.15.32:0/1128113340 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f43c015b980 msgr2=0x7f43c00b3540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:22.488 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.483+0000 7f43c4b54700 1 --2- 172.21.15.32:0/1128113340 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f43c015b980 0x7f43c00b3540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:22.488 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.483+0000 7f43c4b54700 1 -- 172.21.15.32:0/1128113340 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f43c00c9b30 msgr2=0x7f43c00c4350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:22.488 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.483+0000 7f43c4b54700 1 --2- 172.21.15.32:0/1128113340 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f43c00c9b30 0x7f43c00c4350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:22.488 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.483+0000 7f43c4b54700 1 -- 172.21.15.32:0/1128113340 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43b40094b0 con 0x7f43c00719e0 2023-10-08T06:10:22.488 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.483+0000 7f43c5355700 1 --2- 172.21.15.32:0/1128113340 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f43c015b980 0x7f43c00b3540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T06:10:22.488 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.483+0000 7f43c4b54700 1 --2- 172.21.15.32:0/1128113340 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f43c00719e0 0x7f43c0150f60 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f43b40090b0 tx=0x7f43b4004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:22.488 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.483+0000 7f43bd7fa700 1 -- 172.21.15.32:0/1128113340 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43b40036c0 con 0x7f43c00719e0 2023-10-08T06:10:22.488 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.483+0000 7f43bd7fa700 1 -- 172.21.15.32:0/1128113340 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43b401e070 con 0x7f43c00719e0 2023-10-08T06:10:22.489 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.483+0000 7f43c5b56700 1 -- 172.21.15.32:0/1128113340 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43c00c4c50 con 0x7f43c00719e0 2023-10-08T06:10:22.489 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.483+0000 7f43bd7fa700 1 -- 172.21.15.32:0/1128113340 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43b4003a80 con 0x7f43c00719e0 2023-10-08T06:10:22.489 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.483+0000 7f43c5b56700 1 -- 172.21.15.32:0/1128113340 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43c00b2d40 con 0x7f43c00719e0 2023-10-08T06:10:22.489 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.487+0000 7f43c5b56700 1 -- 172.21.15.32:0/1128113340 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43c0066aa0 con 0x7f43c00719e0 2023-10-08T06:10:22.490 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.487+0000 7f43bd7fa700 1 -- 172.21.15.32:0/1128113340 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f43b4003be0 con 0x7f43c00719e0 2023-10-08T06:10:22.490 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.487+0000 7f43bd7fa700 1 --2- 172.21.15.32:0/1128113340 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f43ac066560 0x7f43ac068a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:22.490 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.487+0000 7f43bffff700 1 --2- 172.21.15.32:0/1128113340 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f43ac066560 0x7f43ac068a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:22.490 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.487+0000 7f43bd7fa700 1 -- 172.21.15.32:0/1128113340 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f43b4084d80 con 0x7f43c00719e0 2023-10-08T06:10:22.490 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.487+0000 7f43bffff700 1 --2- 172.21.15.32:0/1128113340 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f43ac066560 0x7f43ac068a20 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f43c00c9ad0 tx=0x7f43b0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:22.496 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.495+0000 7f43bd7fa700 1 -- 172.21.15.32:0/1128113340 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f43b4088030 con 0x7f43c00719e0 2023-10-08T06:10:22.661 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.659+0000 7f43c5b56700 1 -- 172.21.15.32:0/1128113340 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f43c00b3260 con 0x7f43c00719e0 2023-10-08T06:10:22.664 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.663+0000 7f43bd7fa700 1 -- 172.21.15.32:0/1128113340 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+16694 (secure 0 0 0) 0x7f43c00b3260 con 0x7f43c00719e0 2023-10-08T06:10:22.665 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:10:22.665 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":24,"fsid":"ac672d87-96ae-41e0-9314-623ba2cdbbba","created":"2023-10-08T06:09:11.175626+0000","modified":"2023-10-08T06:10:19.263068+0000","last_up_change":"2023-10-08T06:09:22.744643+0000","last_in_change":"2023-10-08T06:09:14.131580+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T06:09:23.307843+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T06:09:34.295012+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T06:09:35.515590+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"43433f0c-9592-4874-92d7-10f8f4acf07f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":587888964},{"type":"v1","addr":"172.21.15.32:6801","nonce":587888964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":587888964},{"type":"v1","addr":"172.21.15.32:6803","nonce":587888964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":587888964},{"type":"v1","addr":"172.21.15.32:6810","nonce":587888964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6805","nonce":587888964},{"type":"v1","addr":"172.21.15.32:6807","nonce":587888964}]},"public_addr":"172.21.15.32:6801/587888964","cluster_addr":"172.21.15.32:6803/587888964","heartbeat_back_addr":"172.21.15.32:6810/587888964","heartbeat_front_addr":"172.21.15.32:6807/587888964","state":["exists","up"]},{"osd":1,"uuid":"2ecb1008-b987-4ce7-b646-6cded55fc8d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":990576767},{"type":"v1","addr":"172.21.15.32:6817","nonce":990576767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":990576767},{"type":"v1","addr":"172.21.15.32:6819","nonce":990576767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":990576767},{"type":"v1","addr":"172.21.15.32:6823","nonce":990576767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":990576767},{"type":"v1","addr":"172.21.15.32:6821","nonce":990576767}]},"public_addr":"172.21.15.32:6817/990576767","cluster_addr":"172.21.15.32:6819/990576767","heartbeat_back_addr":"172.21.15.32:6823/990576767","heartbeat_front_addr":"172.21.15.32:6821/990576767","state":["exists","up"]},{"osd":2,"uuid":"1b131c94-c09b-4e80-8746-bf1b7bac362d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6824","nonce":1566874440},{"type":"v1","addr":"172.21.15.32:6825","nonce":1566874440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":1566874440},{"type":"v1","addr":"172.21.15.32:6827","nonce":1566874440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":1566874440},{"type":"v1","addr":"172.21.15.32:6831","nonce":1566874440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":1566874440},{"type":"v1","addr":"172.21.15.32:6829","nonce":1566874440}]},"public_addr":"172.21.15.32:6825/1566874440","cluster_addr":"172.21.15.32:6827/1566874440","heartbeat_back_addr":"172.21.15.32:6831/1566874440","heartbeat_front_addr":"172.21.15.32:6829/1566874440","state":["exists","up"]},{"osd":3,"uuid":"ad655af2-1f6f-4689-b21d-b07bbaeb68b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":3672614802},{"type":"v1","addr":"172.21.15.32:6806","nonce":3672614802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6809","nonce":3672614802},{"type":"v1","addr":"172.21.15.32:6811","nonce":3672614802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":3672614802},{"type":"v1","addr":"172.21.15.32:6815","nonce":3672614802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":3672614802},{"type":"v1","addr":"172.21.15.32:6813","nonce":3672614802}]},"public_addr":"172.21.15.32:6806/3672614802","cluster_addr":"172.21.15.32:6811/3672614802","heartbeat_back_addr":"172.21.15.32:6815/3672614802","heartbeat_front_addr":"172.21.15.32:6813/3672614802","state":["exists","up"]},{"osd":4,"uuid":"64a543a1-8c4f-458e-9aba-b35c1cd7dd03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":3369928244},{"type":"v1","addr":"172.21.15.40:6801","nonce":3369928244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":3369928244},{"type":"v1","addr":"172.21.15.40:6803","nonce":3369928244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":3369928244},{"type":"v1","addr":"172.21.15.40:6807","nonce":3369928244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":3369928244},{"type":"v1","addr":"172.21.15.40:6805","nonce":3369928244}]},"public_addr":"172.21.15.40:6801/3369928244","cluster_addr":"172.21.15.40:6803/3369928244","heartbeat_back_addr":"172.21.15.40:6807/3369928244","heartbeat_front_addr":"172.21.15.40:6805/3369928244","state":["exists","up"]},{"osd":5,"uuid":"0fef3e54-edb4-4678-878e-944663c51638","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":2395850297},{"type":"v1","addr":"172.21.15.40:6825","nonce":2395850297}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":2395850297},{"type":"v1","addr":"172.21.15.40:6827","nonce":2395850297}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":2395850297},{"type":"v1","addr":"172.21.15.40:6831","nonce":2395850297}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":2395850297},{"type":"v1","addr":"172.21.15.40:6829","nonce":2395850297}]},"public_addr":"172.21.15.40:6825/2395850297","cluster_addr":"172.21.15.40:6827/2395850297","heartbeat_back_addr":"172.21.15.40:6831/2395850297","heartbeat_front_addr":"172.21.15.40:6829/2395850297","state":["exists","up"]},{"osd":6,"uuid":"2eeb0472-6096-469d-9b2c-cab4bf41c31a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":4145283410},{"type":"v1","addr":"172.21.15.40:6809","nonce":4145283410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":4145283410},{"type":"v1","addr":"172.21.15.40:6811","nonce":4145283410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":4145283410},{"type":"v1","addr":"172.21.15.40:6815","nonce":4145283410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":4145283410},{"type":"v1","addr":"172.21.15.40:6813","nonce":4145283410}]},"public_addr":"172.21.15.40:6809/4145283410","cluster_addr":"172.21.15.40:6811/4145283410","heartbeat_back_addr":"172.21.15.40:6815/4145283410","heartbeat_front_addr":"172.21.15.40:6813/4145283410","state":["exists","up"]},{"osd":7,"uuid":"cf76e4c7-96a6-401f-a280-91aad4641940","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":2943297416},{"type":"v1","addr":"172.21.15.40:6817","nonce":2943297416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":2943297416},{"type":"v1","addr":"172.21.15.40:6819","nonce":2943297416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":2943297416},{"type":"v1","addr":"172.21.15.40:6823","nonce":2943297416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":2943297416},{"type":"v1","addr":"172.21.15.40:6821","nonce":2943297416}]},"public_addr":"172.21.15.40:6817/2943297416","cluster_addr":"172.21.15.40:6819/2943297416","heartbeat_back_addr":"172.21.15.40:6823/2943297416","heartbeat_front_addr":"172.21.15.40:6821/2943297416","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.411475+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.628841+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.599055+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.166100+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.384135+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.488403+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.307648+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.363541+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":3,"to":2}]},{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"3.39","mappings":[{"from":7,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T06:10:22.667 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.663+0000 7f43c5b56700 1 -- 172.21.15.32:0/1128113340 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f43ac066560 msgr2=0x7f43ac068a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:22.667 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.663+0000 7f43c5b56700 1 --2- 172.21.15.32:0/1128113340 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f43ac066560 0x7f43ac068a20 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f43c00c9ad0 tx=0x7f43b0009040 comp rx=0 tx=0).stop 2023-10-08T06:10:22.667 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.663+0000 7f43c5b56700 1 -- 172.21.15.32:0/1128113340 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f43c00719e0 msgr2=0x7f43c0150f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:22.667 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.663+0000 7f43c5b56700 1 --2- 172.21.15.32:0/1128113340 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f43c00719e0 0x7f43c0150f60 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f43b40090b0 tx=0x7f43b4004770 comp rx=0 tx=0).stop 2023-10-08T06:10:22.667 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.663+0000 7f43c5b56700 1 -- 172.21.15.32:0/1128113340 shutdown_connections 2023-10-08T06:10:22.667 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.663+0000 7f43c5b56700 1 --2- 172.21.15.32:0/1128113340 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f43ac066560 0x7f43ac068a20 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:22.667 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.663+0000 7f43c5b56700 1 --2- 172.21.15.32:0/1128113340 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f43c015b980 0x7f43c00b3540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:22.667 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.663+0000 7f43c5b56700 1 --2- 172.21.15.32:0/1128113340 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f43c00c9b30 0x7f43c00c4350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:22.667 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.663+0000 7f43c5b56700 1 --2- 172.21.15.32:0/1128113340 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f43c00719e0 0x7f43c0150f60 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:22.667 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.663+0000 7f43c5b56700 1 -- 172.21.15.32:0/1128113340 >> 172.21.15.32:0/1128113340 conn(0x7f43c00b0900 msgr2=0x7f43c0159310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:10:22.668 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.663+0000 7f43c5b56700 1 -- 172.21.15.32:0/1128113340 shutdown_connections 2023-10-08T06:10:22.668 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.663+0000 7f43c5b56700 1 -- 172.21.15.32:0/1128113340 wait complete. 2023-10-08T06:10:22.680 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T06:09:23.307843+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-08T06:09:34.295012+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-08T06:09:35.515590+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-08T06:10:22.681 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T06:10:22.804 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.803+0000 7f280b59e700 1 Processor -- start 2023-10-08T06:10:22.805 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.803+0000 7f280b59e700 1 -- start start 2023-10-08T06:10:22.807 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.803+0000 7f280b59e700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f280c15d490 0x7f280c0b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:22.807 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.803+0000 7f280b59e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f280c0d13d0 0x7f280c0cddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:22.807 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.803+0000 7f280b59e700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f280c0ce770 con 0x7f280c0ce310 2023-10-08T06:10:22.807 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.803+0000 7f280b59e700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f280c0d1bb0 con 0x7f280c15d490 2023-10-08T06:10:22.807 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.803+0000 7f280b59e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f280c0d1e90 con 0x7f280c0d13d0 2023-10-08T06:10:22.807 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.803+0000 7f280ad9d700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f280c0ce310 0x7f280c0b4a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:38142/0 (socket says 172.21.15.32:38142) 2023-10-08T06:10:22.807 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.803+0000 7f280ad9d700 1 -- 172.21.15.32:0/3117953807 learned_addr learned my addr 172.21.15.32:0/3117953807 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-08T06:10:22.807 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.803+0000 7f280a59c700 1 --2- 172.21.15.32:0/3117953807 >> v2:172.21.15.40:3300/0 conn(0x7f280c15d490 0x7f280c0b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:22.807 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.803+0000 7f2809d9b700 1 --2- 172.21.15.32:0/3117953807 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f280c0d13d0 0x7f280c0cddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:22.807 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.803+0000 7f280959a700 1 -- 172.21.15.32:0/3117953807 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 724879005 0 0) 0x7f280c0ce770 con 0x7f280c0ce310 2023-10-08T06:10:22.807 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.803+0000 7f280959a700 1 -- 172.21.15.32:0/3117953807 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f27f40035d0 con 0x7f280c0ce310 2023-10-08T06:10:22.809 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.803+0000 7f2809d9b700 1 -- 172.21.15.32:0/3117953807 >> v2:172.21.15.40:3300/0 conn(0x7f280c15d490 msgr2=0x7f280c0b8bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:10:22.809 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.803+0000 7f2809d9b700 1 --2- 172.21.15.32:0/3117953807 >> v2:172.21.15.40:3300/0 conn(0x7f280c15d490 0x7f280c0b8bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:22.809 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.803+0000 7f2809d9b700 1 -- 172.21.15.32:0/3117953807 >> v1:172.21.15.32:6789/0 conn(0x7f280c0ce310 legacy=0x7f280c0b4a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:22.809 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.803+0000 7f2809d9b700 1 -- 172.21.15.32:0/3117953807 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f280c0d2170 con 0x7f280c0d13d0 2023-10-08T06:10:22.809 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.803+0000 7f280a59c700 1 --2- 172.21.15.32:0/3117953807 >> v2:172.21.15.40:3300/0 conn(0x7f280c15d490 0x7f280c0b8bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T06:10:22.810 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.807+0000 7f2809d9b700 1 --2- 172.21.15.32:0/3117953807 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f280c0d13d0 0x7f280c0cddd0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f2800009850 tx=0x7f2800009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fd09d36c2c0b788e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:22.810 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.807+0000 7f280959a700 1 -- 172.21.15.32:0/3117953807 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2800011830 con 0x7f280c0d13d0 2023-10-08T06:10:22.810 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.807+0000 7f280959a700 1 -- 172.21.15.32:0/3117953807 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2800011990 con 0x7f280c0d13d0 2023-10-08T06:10:22.810 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.807+0000 7f280959a700 1 -- 172.21.15.32:0/3117953807 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2800011d00 con 0x7f280c0d13d0 2023-10-08T06:10:22.810 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.807+0000 7f280b59e700 1 -- 172.21.15.32:0/3117953807 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f280c0d13d0 msgr2=0x7f280c0cddd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:22.810 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.807+0000 7f280b59e700 1 --2- 172.21.15.32:0/3117953807 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f280c0d13d0 0x7f280c0cddd0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f2800009850 tx=0x7f2800009b60 comp rx=0 tx=0).stop 2023-10-08T06:10:22.810 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.807+0000 7f280b59e700 1 -- 172.21.15.32:0/3117953807 shutdown_connections 2023-10-08T06:10:22.810 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.807+0000 7f280b59e700 1 --2- 172.21.15.32:0/3117953807 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f280c0d13d0 0x7f280c0cddd0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:22.810 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.807+0000 7f280b59e700 1 --2- 172.21.15.32:0/3117953807 >> v2:172.21.15.40:3300/0 conn(0x7f280c15d490 0x7f280c0b8bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:22.810 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.807+0000 7f280b59e700 1 -- 172.21.15.32:0/3117953807 >> 172.21.15.32:0/3117953807 conn(0x7f280c06ab40 msgr2=0x7f280c06af20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:10:22.810 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.807+0000 7f280b59e700 1 -- 172.21.15.32:0/3117953807 shutdown_connections 2023-10-08T06:10:22.811 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.807+0000 7f280b59e700 1 -- 172.21.15.32:0/3117953807 wait complete. 2023-10-08T06:10:22.811 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.807+0000 7f280b59e700 1 Processor -- start 2023-10-08T06:10:22.811 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.807+0000 7f280b59e700 1 -- start start 2023-10-08T06:10:22.813 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.811+0000 7f280b59e700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f280c0ce310 0x7f280c153830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:22.813 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.811+0000 7f280b59e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f280c0d13d0 0x7f280c15d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:22.813 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.811+0000 7f280b59e700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f280c15d490 0x7f280c15fe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:22.813 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.811+0000 7f280b59e700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f280c153d70 con 0x7f280c15d490 2023-10-08T06:10:22.813 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.811+0000 7f280b59e700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f280c15e2c0 con 0x7f280c0ce310 2023-10-08T06:10:22.813 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.811+0000 7f280b59e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f280c15e5a0 con 0x7f280c0d13d0 2023-10-08T06:10:22.813 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.811+0000 7f280ad9d700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f280c15d490 0x7f280c15fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:22.813 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.811+0000 7f280ad9d700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f280c15d490 0x7f280c15fe10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:55992/0 (socket says 172.21.15.32:55992) 2023-10-08T06:10:22.813 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.811+0000 7f280ad9d700 1 -- 172.21.15.32:0/1591154390 learned_addr learned my addr 172.21.15.32:0/1591154390 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:10:22.813 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.811+0000 7f2809d9b700 1 --2- 172.21.15.32:0/1591154390 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f280c0d13d0 0x7f280c15d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:22.814 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.811+0000 7f280a59c700 1 --2- 172.21.15.32:0/1591154390 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f280c0ce310 0x7f280c153830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:22.815 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.811+0000 7f280ad9d700 1 -- 172.21.15.32:0/1591154390 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f280c0d13d0 msgr2=0x7f280c15d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:22.815 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.811+0000 7f280ad9d700 1 --2- 172.21.15.32:0/1591154390 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f280c0d13d0 0x7f280c15d870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:22.815 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.811+0000 7f280ad9d700 1 -- 172.21.15.32:0/1591154390 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f280c0ce310 msgr2=0x7f280c153830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:22.815 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.811+0000 7f280ad9d700 1 --2- 172.21.15.32:0/1591154390 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f280c0ce310 0x7f280c153830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:22.815 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.811+0000 7f280ad9d700 1 -- 172.21.15.32:0/1591154390 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27fc009a70 con 0x7f280c15d490 2023-10-08T06:10:22.815 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.811+0000 7f280ad9d700 1 --2- 172.21.15.32:0/1591154390 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f280c15d490 0x7f280c15fe10 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f280400c4f0 tx=0x7f280400c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:22.815 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.811+0000 7f27faffd700 1 -- 172.21.15.32:0/1591154390 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2804005d90 con 0x7f280c15d490 2023-10-08T06:10:22.815 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.811+0000 7f27faffd700 1 -- 172.21.15.32:0/1591154390 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28040070d0 con 0x7f280c15d490 2023-10-08T06:10:22.816 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.811+0000 7f280b59e700 1 -- 172.21.15.32:0/1591154390 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28000094b0 con 0x7f280c15d490 2023-10-08T06:10:22.816 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.811+0000 7f27faffd700 1 -- 172.21.15.32:0/1591154390 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2804007460 con 0x7f280c15d490 2023-10-08T06:10:22.816 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.811+0000 7f280b59e700 1 -- 172.21.15.32:0/1591154390 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f280c15eb60 con 0x7f280c15d490 2023-10-08T06:10:22.816 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.811+0000 7f280b59e700 1 -- 172.21.15.32:0/1591154390 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f280c073f00 con 0x7f280c15d490 2023-10-08T06:10:22.816 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.815+0000 7f27faffd700 1 -- 172.21.15.32:0/1591154390 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f28040075c0 con 0x7f280c15d490 2023-10-08T06:10:22.817 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.815+0000 7f27faffd700 1 --2- 172.21.15.32:0/1591154390 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f27ec066510 0x7f27ec0689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:22.817 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.815+0000 7f27faffd700 1 -- 172.21.15.32:0/1591154390 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f2804083370 con 0x7f280c15d490 2023-10-08T06:10:22.817 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.815+0000 7f280a59c700 1 --2- 172.21.15.32:0/1591154390 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f27ec066510 0x7f27ec0689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:22.817 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.815+0000 7f280a59c700 1 --2- 172.21.15.32:0/1591154390 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f27ec066510 0x7f27ec0689d0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f27fc0114e0 tx=0x7f27fc00b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:22.828 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.827+0000 7f27faffd700 1 -- 172.21.15.32:0/1591154390 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f28040506f0 con 0x7f280c15d490 2023-10-08T06:10:22.996 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.995+0000 7f280b59e700 1 -- 172.21.15.32:0/1591154390 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f280c159240 con 0x7f280c15d490 2023-10-08T06:10:22.997 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.995+0000 7f27faffd700 1 -- 172.21.15.32:0/1591154390 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2804053d10 con 0x7f280c15d490 2023-10-08T06:10:22.997 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 1 2023-10-08T06:10:23.001 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.999+0000 7f280b59e700 1 -- 172.21.15.32:0/1591154390 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f27ec066510 msgr2=0x7f27ec0689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:23.001 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.999+0000 7f280b59e700 1 --2- 172.21.15.32:0/1591154390 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f27ec066510 0x7f27ec0689d0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f27fc0114e0 tx=0x7f27fc00b040 comp rx=0 tx=0).stop 2023-10-08T06:10:23.001 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.999+0000 7f280b59e700 1 -- 172.21.15.32:0/1591154390 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f280c15d490 msgr2=0x7f280c15fe10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:23.001 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.999+0000 7f280b59e700 1 --2- 172.21.15.32:0/1591154390 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f280c15d490 0x7f280c15fe10 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f280400c4f0 tx=0x7f280400c800 comp rx=0 tx=0).stop 2023-10-08T06:10:23.001 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.999+0000 7f280b59e700 1 -- 172.21.15.32:0/1591154390 shutdown_connections 2023-10-08T06:10:23.001 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.999+0000 7f280b59e700 1 --2- 172.21.15.32:0/1591154390 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f27ec066510 0x7f27ec0689d0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:23.002 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.999+0000 7f280b59e700 1 --2- 172.21.15.32:0/1591154390 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f280c15d490 0x7f280c15fe10 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:23.002 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.999+0000 7f280b59e700 1 --2- 172.21.15.32:0/1591154390 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f280c0d13d0 0x7f280c15d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:23.002 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.999+0000 7f280b59e700 1 --2- 172.21.15.32:0/1591154390 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f280c0ce310 0x7f280c153830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:23.002 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.999+0000 7f280b59e700 1 -- 172.21.15.32:0/1591154390 >> 172.21.15.32:0/1591154390 conn(0x7f280c06ab40 msgr2=0x7f280c154770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:10:23.002 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.999+0000 7f280b59e700 1 -- 172.21.15.32:0/1591154390 shutdown_connections 2023-10-08T06:10:23.002 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:22.999+0000 7f280b59e700 1 -- 172.21.15.32:0/1591154390 wait complete. 2023-10-08T06:10:23.016 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-08T06:10:23.139 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:23.135+0000 7ff9b98d2700 1 Processor -- start 2023-10-08T06:10:23.139 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:23.135+0000 7ff9b98d2700 1 -- start start 2023-10-08T06:10:23.141 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:23.139+0000 7ff9b98d2700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7ff9b40b8bc0 0x7ff9b40cddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:23.141 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:23.139+0000 7ff9b98d2700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff9b40ce310 0x7ff9b40b6130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:23.141 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:23.139+0000 7ff9b98d2700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9b40b9000 con 0x7ff9b415d490 2023-10-08T06:10:23.141 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:23.139+0000 7ff9b98d2700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9b40ce7c0 con 0x7ff9b40b8bc0 2023-10-08T06:10:23.141 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:23.139+0000 7ff9b98d2700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9b40d1bb0 con 0x7ff9b40ce310 2023-10-08T06:10:23.141 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:23.139+0000 7ff9b3fff700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7ff9b40b8bc0 0x7ff9b40cddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:23.141 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:23.139+0000 7ff9b88d0700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7ff9b415d490 0x7ff9b40d13d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:38154/0 (socket says 172.21.15.32:38154) 2023-10-08T06:10:23.141 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:23.139+0000 7ff9b88d0700 1 -- 172.21.15.32:0/41306080 learned_addr learned my addr 172.21.15.32:0/41306080 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-08T06:10:23.141 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:23.139+0000 7ff9b90d1700 1 --2- 172.21.15.32:0/41306080 >> v2:172.21.15.40:3300/0 conn(0x7ff9b40ce310 0x7ff9b40b6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:23.143 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:23.139+0000 7ff9b3fff700 1 -- 172.21.15.32:0/41306080 >> v2:172.21.15.40:3300/0 conn(0x7ff9b40ce310 msgr2=0x7ff9b40b6130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:10:23.143 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:23.139+0000 7ff9b3fff700 1 --2- 172.21.15.32:0/41306080 >> v2:172.21.15.40:3300/0 conn(0x7ff9b40ce310 0x7ff9b40b6130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:23.143 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:23.139+0000 7ff9b3fff700 1 -- 172.21.15.32:0/41306080 >> v1:172.21.15.32:6789/0 conn(0x7ff9b415d490 legacy=0x7ff9b40d13d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:23.143 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:23.139+0000 7ff9b3fff700 1 -- 172.21.15.32:0/41306080 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9b40d1e90 con 0x7ff9b40b8bc0 2023-10-08T06:10:23.143 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:23.139+0000 7ff9b37fe700 1 -- 172.21.15.32:0/41306080 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3556433801 0 0) 0x7ff9a0001110 con 0x7ff9b415d490 2023-10-08T06:10:23.143 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:23.139+0000 7ff9b3fff700 1 --2- 172.21.15.32:0/41306080 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff9b40b8bc0 0x7ff9b40cddd0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7ff9b40b5ee0 tx=0x7ff9a8009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d9dd8319543dd8d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:23.143 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:23.139+0000 7ff9b37fe700 1 -- 172.21.15.32:0/41306080 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9a8011830 con 0x7ff9b40b8bc0 2023-10-08T06:10:23.143 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:23.139+0000 7ff9b37fe700 1 -- 172.21.15.32:0/41306080 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9a8011990 con 0x7ff9b40b8bc0 2023-10-08T06:10:23.144 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:23.139+0000 7ff9b37fe700 1 -- 172.21.15.32:0/41306080 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9a8011d20 con 0x7ff9b40b8bc0 2023-10-08T06:10:23.144 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:23.139+0000 7ff9b98d2700 1 -- 172.21.15.32:0/41306080 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff9b40b8bc0 msgr2=0x7ff9b40cddd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:23.144 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:23.139+0000 7ff9b98d2700 1 --2- 172.21.15.32:0/41306080 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff9b40b8bc0 0x7ff9b40cddd0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7ff9b40b5ee0 tx=0x7ff9a8009b30 comp rx=0 tx=0).stop 2023-10-08T06:10:23.144 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:23.139+0000 7ff9b98d2700 1 -- 172.21.15.32:0/41306080 shutdown_connections 2023-10-08T06:10:23.144 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:23.139+0000 7ff9b98d2700 1 --2- 172.21.15.32:0/41306080 >> v2:172.21.15.40:3300/0 conn(0x7ff9b40ce310 0x7ff9b40b6130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:23.144 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:23.139+0000 7ff9b98d2700 1 --2- 172.21.15.32:0/41306080 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff9b40b8bc0 0x7ff9b40cddd0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:23.144 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:23.139+0000 7ff9b98d2700 1 -- 172.21.15.32:0/41306080 >> 172.21.15.32:0/41306080 conn(0x7ff9b406ab40 msgr2=0x7ff9b406af20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:10:23.144 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:23.139+0000 7ff9b98d2700 1 -- 172.21.15.32:0/41306080 shutdown_connections 2023-10-08T06:10:23.144 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:23.139+0000 7ff9b98d2700 1 -- 172.21.15.32:0/41306080 wait complete. 2023-10-08T06:10:23.146 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:23.143+0000 7ff9b98d2700 1 Processor -- start 2023-10-08T06:10:23.146 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:23.143+0000 7ff9b98d2700 1 -- start start 2023-10-08T06:10:23.146 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:23.143+0000 7ff9b98d2700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff9b40b8bc0 0x7ff9b40c62c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:23.146 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:23.143+0000 7ff9b98d2700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff9b40ce310 0x7ff9b41f34d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:23.147 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:23.143+0000 7ff9b98d2700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff9b415d490 0x7ff9b415fb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:23.147 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:23.143+0000 7ff9b98d2700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9b40c6800 con 0x7ff9b40ce310 2023-10-08T06:10:23.147 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:23.143+0000 7ff9b98d2700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9b415ea60 con 0x7ff9b40b8bc0 2023-10-08T06:10:23.147 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:23.143+0000 7ff9b98d2700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9b415ed40 con 0x7ff9b415d490 2023-10-08T06:10:23.147 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:23.143+0000 7ff9b3fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff9b40ce310 0x7ff9b41f34d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:23.147 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:23.143+0000 7ff9b3fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff9b40ce310 0x7ff9b41f34d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:56000/0 (socket says 172.21.15.32:56000) 2023-10-08T06:10:23.147 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:23.143+0000 7ff9b3fff700 1 -- 172.21.15.32:0/2429681250 learned_addr learned my addr 172.21.15.32:0/2429681250 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:10:23.147 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:23.143+0000 7ff9b90d1700 1 --2- 172.21.15.32:0/2429681250 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff9b415d490 0x7ff9b415fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:23.147 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:23.143+0000 7ff9b88d0700 1 --2- 172.21.15.32:0/2429681250 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff9b40b8bc0 0x7ff9b40c62c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:23.147 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:23.143+0000 7ff9b3fff700 1 -- 172.21.15.32:0/2429681250 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff9b415d490 msgr2=0x7ff9b415fb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:23.147 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:23.143+0000 7ff9b3fff700 1 --2- 172.21.15.32:0/2429681250 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff9b415d490 0x7ff9b415fb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:23.148 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:23.143+0000 7ff9b3fff700 1 -- 172.21.15.32:0/2429681250 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff9b40b8bc0 msgr2=0x7ff9b40c62c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:23.148 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:23.143+0000 7ff9b3fff700 1 --2- 172.21.15.32:0/2429681250 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff9b40b8bc0 0x7ff9b40c62c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:23.148 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:23.143+0000 7ff9b3fff700 1 -- 172.21.15.32:0/2429681250 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9a80094b0 con 0x7ff9b40ce310 2023-10-08T06:10:23.148 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:23.143+0000 7ff9b88d0700 1 --2- 172.21.15.32:0/2429681250 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff9b40b8bc0 0x7ff9b40c62c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T06:10:23.148 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:23.143+0000 7ff9b3fff700 1 --2- 172.21.15.32:0/2429681250 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff9b40ce310 0x7ff9b41f34d0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7ff9a80090b0 tx=0x7ff9a8004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:23.148 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:23.143+0000 7ff9b17fa700 1 -- 172.21.15.32:0/2429681250 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9a80045b0 con 0x7ff9b40ce310 2023-10-08T06:10:23.148 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:23.143+0000 7ff9b17fa700 1 -- 172.21.15.32:0/2429681250 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9a801f070 con 0x7ff9b40ce310 2023-10-08T06:10:23.148 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:23.143+0000 7ff9b98d2700 1 -- 172.21.15.32:0/2429681250 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9b415f020 con 0x7ff9b40ce310 2023-10-08T06:10:23.148 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:23.143+0000 7ff9b17fa700 1 -- 172.21.15.32:0/2429681250 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9a80038e0 con 0x7ff9b40ce310 2023-10-08T06:10:23.148 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:23.143+0000 7ff9b98d2700 1 -- 172.21.15.32:0/2429681250 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9b415f5e0 con 0x7ff9b40ce310 2023-10-08T06:10:23.149 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:23.147+0000 7ff9b98d2700 1 -- 172.21.15.32:0/2429681250 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9b4073f00 con 0x7ff9b40ce310 2023-10-08T06:10:23.149 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:23.147+0000 7ff9b17fa700 1 -- 172.21.15.32:0/2429681250 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7ff9a8021030 con 0x7ff9b40ce310 2023-10-08T06:10:23.149 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:23.147+0000 7ff9b17fa700 1 --2- 172.21.15.32:0/2429681250 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7ff998066510 0x7ff9980689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:23.149 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:23.147+0000 7ff9b17fa700 1 -- 172.21.15.32:0/2429681250 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7ff9a8085280 con 0x7ff9b40ce310 2023-10-08T06:10:23.149 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:23.147+0000 7ff9b88d0700 1 --2- 172.21.15.32:0/2429681250 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7ff998066510 0x7ff9980689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:23.150 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:23.147+0000 7ff9b88d0700 1 --2- 172.21.15.32:0/2429681250 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7ff998066510 0x7ff9980689d0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7ff9a0000f60 tx=0x7ff9a0007d70 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:23.156 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:23.155+0000 7ff9b17fa700 1 -- 172.21.15.32:0/2429681250 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7ff9a8052680 con 0x7ff9b40ce310 2023-10-08T06:10:23.323 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:23.319+0000 7ff9b98d2700 1 -- 172.21.15.32:0/2429681250 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff9b40c6940 con 0x7ff9b40ce310 2023-10-08T06:10:23.324 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:23.323+0000 7ff9b17fa700 1 -- 172.21.15.32:0/2429681250 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff9a8055ca0 con 0x7ff9b40ce310 2023-10-08T06:10:23.324 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 32 2023-10-08T06:10:23.327 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:23.323+0000 7ff9b98d2700 1 -- 172.21.15.32:0/2429681250 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7ff998066510 msgr2=0x7ff9980689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:23.327 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:23.323+0000 7ff9b98d2700 1 --2- 172.21.15.32:0/2429681250 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7ff998066510 0x7ff9980689d0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7ff9a0000f60 tx=0x7ff9a0007d70 comp rx=0 tx=0).stop 2023-10-08T06:10:23.327 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:23.323+0000 7ff9b98d2700 1 -- 172.21.15.32:0/2429681250 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff9b40ce310 msgr2=0x7ff9b41f34d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:23.327 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:23.323+0000 7ff9b98d2700 1 --2- 172.21.15.32:0/2429681250 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff9b40ce310 0x7ff9b41f34d0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7ff9a80090b0 tx=0x7ff9a8004770 comp rx=0 tx=0).stop 2023-10-08T06:10:23.327 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:23.323+0000 7ff9b98d2700 1 -- 172.21.15.32:0/2429681250 shutdown_connections 2023-10-08T06:10:23.327 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:23.323+0000 7ff9b98d2700 1 --2- 172.21.15.32:0/2429681250 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7ff998066510 0x7ff9980689d0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:23.328 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:23.323+0000 7ff9b98d2700 1 --2- 172.21.15.32:0/2429681250 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff9b40ce310 0x7ff9b41f34d0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:23.328 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:23.323+0000 7ff9b98d2700 1 --2- 172.21.15.32:0/2429681250 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff9b415d490 0x7ff9b415fb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:23.328 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:23.323+0000 7ff9b98d2700 1 --2- 172.21.15.32:0/2429681250 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff9b40b8bc0 0x7ff9b40c62c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:23.328 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:23.323+0000 7ff9b98d2700 1 -- 172.21.15.32:0/2429681250 >> 172.21.15.32:0/2429681250 conn(0x7ff9b406ab40 msgr2=0x7ff9b415ba90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:10:23.328 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:23.323+0000 7ff9b98d2700 1 -- 172.21.15.32:0/2429681250 shutdown_connections 2023-10-08T06:10:23.328 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:23.323+0000 7ff9b98d2700 1 -- 172.21.15.32:0/2429681250 wait complete. 2023-10-08T06:10:23.340 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-08T06:10:23.458 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:23.455+0000 7f2897fff700 1 Processor -- start 2023-10-08T06:10:23.458 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:23.455+0000 7f2897fff700 1 -- start start 2023-10-08T06:10:23.460 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:23.459+0000 7f2897fff700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f2898071950 0x7f289815a780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:23.460 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:23.459+0000 7f2897fff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f289815acc0 0x7f28980b1800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:23.460 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:23.459+0000 7f2897fff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f289815b1b0 con 0x7f2898071570 2023-10-08T06:10:23.460 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:23.459+0000 7f2897fff700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f289815b770 con 0x7f2898071950 2023-10-08T06:10:23.460 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:23.459+0000 7f2897fff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f289815b490 con 0x7f289815acc0 2023-10-08T06:10:23.461 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:23.459+0000 7f288e7fc700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f2898071950 0x7f289815a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:23.461 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:23.459+0000 7f288e7fc700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f2898071950 0x7f289815a780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:56006/0 (socket says 172.21.15.32:56006) 2023-10-08T06:10:23.461 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:23.459+0000 7f288e7fc700 1 -- 172.21.15.32:0/2970035185 learned_addr learned my addr 172.21.15.32:0/2970035185 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:10:23.461 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:23.459+0000 7f28977fe700 1 --2- 172.21.15.32:0/2970035185 >> v2:172.21.15.40:3300/0 conn(0x7f289815acc0 0x7f28980b1800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:23.462 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:23.459+0000 7f288e7fc700 1 -- 172.21.15.32:0/2970035185 >> v2:172.21.15.40:3300/0 conn(0x7f289815acc0 msgr2=0x7f28980b1800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:10:23.462 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:23.459+0000 7f288e7fc700 1 --2- 172.21.15.32:0/2970035185 >> v2:172.21.15.40:3300/0 conn(0x7f289815acc0 0x7f28980b1800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:23.462 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:23.459+0000 7f288e7fc700 1 -- 172.21.15.32:0/2970035185 >> v1:172.21.15.40:6789/0 conn(0x7f2898071570 legacy=0x7f289815e6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:23.462 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:23.459+0000 7f288e7fc700 1 -- 172.21.15.32:0/2970035185 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f289815def0 con 0x7f2898071950 2023-10-08T06:10:23.462 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:23.459+0000 7f288e7fc700 1 --2- 172.21.15.32:0/2970035185 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2898071950 0x7f289815a780 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f28980ca770 tx=0x7f288000be90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f8d830ce8f9e78d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:23.463 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:23.459+0000 7f28967fc700 1 -- 172.21.15.32:0/2970035185 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f288000dd30 con 0x7f2898071950 2023-10-08T06:10:23.463 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:23.459+0000 7f28967fc700 1 -- 172.21.15.32:0/2970035185 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f288000de90 con 0x7f2898071950 2023-10-08T06:10:23.463 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:23.459+0000 7f28967fc700 1 -- 172.21.15.32:0/2970035185 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2880010690 con 0x7f2898071950 2023-10-08T06:10:23.463 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:23.459+0000 7f2897fff700 1 -- 172.21.15.32:0/2970035185 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2898071950 msgr2=0x7f289815a780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:23.463 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:23.459+0000 7f2897fff700 1 --2- 172.21.15.32:0/2970035185 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2898071950 0x7f289815a780 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f28980ca770 tx=0x7f288000be90 comp rx=0 tx=0).stop 2023-10-08T06:10:23.463 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:23.459+0000 7f2897fff700 1 -- 172.21.15.32:0/2970035185 shutdown_connections 2023-10-08T06:10:23.463 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:23.459+0000 7f2897fff700 1 --2- 172.21.15.32:0/2970035185 >> v2:172.21.15.40:3300/0 conn(0x7f289815acc0 0x7f28980b1800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:23.463 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:23.459+0000 7f2897fff700 1 --2- 172.21.15.32:0/2970035185 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2898071950 0x7f289815a780 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:23.463 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:23.459+0000 7f2897fff700 1 -- 172.21.15.32:0/2970035185 >> 172.21.15.32:0/2970035185 conn(0x7f28980cc800 msgr2=0x7f28980ccbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:10:23.463 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:23.459+0000 7f2897fff700 1 -- 172.21.15.32:0/2970035185 shutdown_connections 2023-10-08T06:10:23.463 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:23.459+0000 7f2897fff700 1 -- 172.21.15.32:0/2970035185 wait complete. 2023-10-08T06:10:23.464 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:23.459+0000 7f2897fff700 1 Processor -- start 2023-10-08T06:10:23.464 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:23.459+0000 7f2897fff700 1 -- start start 2023-10-08T06:10:23.465 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:23.463+0000 7f2897fff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2898071570 0x7f28980b4590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:23.465 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:23.463+0000 7f2897fff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2898071950 0x7f28981513b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:23.465 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:23.463+0000 7f2897fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f289815acc0 0x7f28980b29a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:23.465 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:23.463+0000 7f2897fff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28980b4ad0 con 0x7f289815acc0 2023-10-08T06:10:23.465 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:23.463+0000 7f2897fff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28980b4100 con 0x7f2898071570 2023-10-08T06:10:23.465 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:23.463+0000 7f2897fff700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28980b34f0 con 0x7f2898071950 2023-10-08T06:10:23.465 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:23.463+0000 7f28977fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f289815acc0 0x7f28980b29a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:23.465 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:23.463+0000 7f288e7fc700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2898071950 0x7f28981513b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:23.465 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:23.463+0000 7f2896ffd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2898071570 0x7f28980b4590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:23.465 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:23.463+0000 7f288e7fc700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2898071950 0x7f28981513b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.32:54456/0 (socket says 172.21.15.32:54456) 2023-10-08T06:10:23.465 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:23.463+0000 7f288e7fc700 1 -- 172.21.15.32:0/1199219917 learned_addr learned my addr 172.21.15.32:0/1199219917 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:10:23.466 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:23.463+0000 7f288e7fc700 1 -- 172.21.15.32:0/1199219917 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2898071570 msgr2=0x7f28980b4590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:23.466 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:23.463+0000 7f288e7fc700 1 --2- 172.21.15.32:0/1199219917 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2898071570 0x7f28980b4590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:23.467 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:23.463+0000 7f288e7fc700 1 -- 172.21.15.32:0/1199219917 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f289815acc0 msgr2=0x7f28980b29a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:23.467 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:23.463+0000 7f288e7fc700 1 --2- 172.21.15.32:0/1199219917 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f289815acc0 0x7f28980b29a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:23.467 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:23.463+0000 7f288e7fc700 1 -- 172.21.15.32:0/1199219917 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f288000b810 con 0x7f2898071950 2023-10-08T06:10:23.467 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:23.463+0000 7f288e7fc700 1 --2- 172.21.15.32:0/1199219917 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2898071950 0x7f28981513b0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f2898071e10 tx=0x7f2880004770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:23.467 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:23.463+0000 7f288ffff700 1 -- 172.21.15.32:0/1199219917 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2880003c10 con 0x7f2898071950 2023-10-08T06:10:23.467 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:23.463+0000 7f288ffff700 1 -- 172.21.15.32:0/1199219917 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2880003d90 con 0x7f2898071950 2023-10-08T06:10:23.467 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:23.463+0000 7f2897fff700 1 -- 172.21.15.32:0/1199219917 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28980b37d0 con 0x7f2898071950 2023-10-08T06:10:23.467 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:23.463+0000 7f288ffff700 1 -- 172.21.15.32:0/1199219917 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28800106b0 con 0x7f2898071950 2023-10-08T06:10:23.467 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:23.463+0000 7f2897fff700 1 -- 172.21.15.32:0/1199219917 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28980b3d90 con 0x7f2898071950 2023-10-08T06:10:23.468 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:23.463+0000 7f2897fff700 1 -- 172.21.15.32:0/1199219917 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28980686a0 con 0x7f2898071950 2023-10-08T06:10:23.469 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:23.467+0000 7f288ffff700 1 -- 172.21.15.32:0/1199219917 <== mon.2 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f2880010810 con 0x7f2898071950 2023-10-08T06:10:23.470 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:23.467+0000 7f288ffff700 1 --2- 172.21.15.32:0/1199219917 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f2878066510 0x7f28780689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:23.470 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:23.467+0000 7f2896ffd700 1 --2- 172.21.15.32:0/1199219917 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f2878066510 0x7f28780689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:23.470 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:23.467+0000 7f288ffff700 1 -- 172.21.15.32:0/1199219917 <== mon.2 v2:172.21.15.40:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f2880085250 con 0x7f2898071950 2023-10-08T06:10:23.470 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:23.467+0000 7f2896ffd700 1 --2- 172.21.15.32:0/1199219917 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f2878066510 0x7f28780689d0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f2888000f60 tx=0x7f2888009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:23.479 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:23.475+0000 7f288ffff700 1 -- 172.21.15.32:0/1199219917 <== mon.2 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f28800526c0 con 0x7f2898071950 2023-10-08T06:10:23.646 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:23.643+0000 7f2897fff700 1 -- 172.21.15.32:0/1199219917 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f28980b5d00 con 0x7f2898071950 2023-10-08T06:10:23.647 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:23.643+0000 7f288ffff700 1 -- 172.21.15.32:0/1199219917 <== mon.2 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f28800260a0 con 0x7f2898071950 2023-10-08T06:10:23.647 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 64 2023-10-08T06:10:23.649 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:23.647+0000 7f2897fff700 1 -- 172.21.15.32:0/1199219917 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f2878066510 msgr2=0x7f28780689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:23.650 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:23.647+0000 7f2897fff700 1 --2- 172.21.15.32:0/1199219917 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f2878066510 0x7f28780689d0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f2888000f60 tx=0x7f2888009040 comp rx=0 tx=0).stop 2023-10-08T06:10:23.650 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:23.647+0000 7f2897fff700 1 -- 172.21.15.32:0/1199219917 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2898071950 msgr2=0x7f28981513b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:23.650 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:23.647+0000 7f2897fff700 1 --2- 172.21.15.32:0/1199219917 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2898071950 0x7f28981513b0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f2898071e10 tx=0x7f2880004770 comp rx=0 tx=0).stop 2023-10-08T06:10:23.650 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:23.647+0000 7f2897fff700 1 -- 172.21.15.32:0/1199219917 shutdown_connections 2023-10-08T06:10:23.650 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:23.647+0000 7f2897fff700 1 --2- 172.21.15.32:0/1199219917 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f2878066510 0x7f28780689d0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:23.650 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:23.647+0000 7f2897fff700 1 --2- 172.21.15.32:0/1199219917 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f289815acc0 0x7f28980b29a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:23.650 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:23.647+0000 7f2897fff700 1 --2- 172.21.15.32:0/1199219917 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2898071950 0x7f28981513b0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:23.650 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:23.647+0000 7f2897fff700 1 --2- 172.21.15.32:0/1199219917 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2898071570 0x7f28980b4590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:23.650 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:23.647+0000 7f2897fff700 1 -- 172.21.15.32:0/1199219917 >> 172.21.15.32:0/1199219917 conn(0x7f28980cc800 msgr2=0x7f289815b8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:10:23.650 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:23.647+0000 7f2897fff700 1 -- 172.21.15.32:0/1199219917 shutdown_connections 2023-10-08T06:10:23.651 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:23.647+0000 7f2897fff700 1 -- 172.21.15.32:0/1199219917 wait complete. 2023-10-08T06:10:23.662 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T06:10:23.777 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:23.775+0000 7feeabfff700 1 Processor -- start 2023-10-08T06:10:23.777 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:23.775+0000 7feeabfff700 1 -- start start 2023-10-08T06:10:23.779 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:23.775+0000 7feeabfff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7feeac151020 0x7feeac0c9650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:23.779 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:23.775+0000 7feeabfff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7feeac0cbbb0 0x7feeac070d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:23.779 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:23.775+0000 7feeabfff700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feeac0cc7a0 con 0x7feeac0c9b90 2023-10-08T06:10:23.779 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:23.775+0000 7feeabfff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feeac151400 con 0x7feeac0cbbb0 2023-10-08T06:10:23.779 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:23.775+0000 7feeabfff700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feeac15a8f0 con 0x7feeac151020 2023-10-08T06:10:23.779 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:23.775+0000 7feea3fff700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7feeac0c9b90 0x7feeac0cb4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:38166/0 (socket says 172.21.15.32:38166) 2023-10-08T06:10:23.779 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:23.775+0000 7feea3fff700 1 -- 172.21.15.32:0/1448246735 learned_addr learned my addr 172.21.15.32:0/1448246735 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-08T06:10:23.779 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:23.775+0000 7feeaaffd700 1 --2- 172.21.15.32:0/1448246735 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7feeac151020 0x7feeac0c9650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:23.779 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:23.775+0000 7feeab7fe700 1 --2- 172.21.15.32:0/1448246735 >> v2:172.21.15.40:3300/0 conn(0x7feeac0cbbb0 0x7feeac070d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:23.780 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:23.775+0000 7feeaa7fc700 1 -- 172.21.15.32:0/1448246735 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1128426144 0 0) 0x7feeac0cc7a0 con 0x7feeac0c9b90 2023-10-08T06:10:23.780 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:23.775+0000 7feeaa7fc700 1 -- 172.21.15.32:0/1448246735 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fee8c0035d0 con 0x7feeac0c9b90 2023-10-08T06:10:23.781 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:23.775+0000 7feeaa7fc700 1 -- 172.21.15.32:0/1448246735 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2355056839 0 0) 0x7fee8c0035d0 con 0x7feeac0c9b90 2023-10-08T06:10:23.781 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:23.775+0000 7feeaaffd700 1 -- 172.21.15.32:0/1448246735 >> v2:172.21.15.40:3300/0 conn(0x7feeac0cbbb0 msgr2=0x7feeac070d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:10:23.781 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:23.775+0000 7feeaaffd700 1 --2- 172.21.15.32:0/1448246735 >> v2:172.21.15.40:3300/0 conn(0x7feeac0cbbb0 0x7feeac070d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:23.782 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:23.775+0000 7feeaaffd700 1 -- 172.21.15.32:0/1448246735 >> v1:172.21.15.32:6789/0 conn(0x7feeac0c9b90 legacy=0x7feeac0cb4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:23.782 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:23.775+0000 7feeaaffd700 1 -- 172.21.15.32:0/1448246735 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feeac0ca2d0 con 0x7feeac151020 2023-10-08T06:10:23.782 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:23.779+0000 7feeaaffd700 1 --2- 172.21.15.32:0/1448246735 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7feeac151020 0x7feeac0c9650 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fee9c009850 tx=0x7fee9c009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=97efc8df1f1c94da server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:23.782 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:23.779+0000 7feeaa7fc700 1 -- 172.21.15.32:0/1448246735 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee94001670 con 0x7feeac151020 2023-10-08T06:10:23.782 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:23.779+0000 7feeaa7fc700 1 -- 172.21.15.32:0/1448246735 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee9c004030 con 0x7feeac151020 2023-10-08T06:10:23.782 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:23.779+0000 7feeaa7fc700 1 -- 172.21.15.32:0/1448246735 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee9c0043e0 con 0x7feeac151020 2023-10-08T06:10:23.782 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:23.779+0000 7feeabfff700 1 -- 172.21.15.32:0/1448246735 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7feeac151020 msgr2=0x7feeac0c9650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:23.782 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:23.779+0000 7feeabfff700 1 --2- 172.21.15.32:0/1448246735 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7feeac151020 0x7feeac0c9650 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fee9c009850 tx=0x7fee9c009b60 comp rx=0 tx=0).stop 2023-10-08T06:10:23.782 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:23.779+0000 7feeabfff700 1 -- 172.21.15.32:0/1448246735 shutdown_connections 2023-10-08T06:10:23.782 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:23.779+0000 7feeabfff700 1 --2- 172.21.15.32:0/1448246735 >> v2:172.21.15.40:3300/0 conn(0x7feeac0cbbb0 0x7feeac070d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:23.782 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:23.779+0000 7feeabfff700 1 --2- 172.21.15.32:0/1448246735 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7feeac151020 0x7feeac0c9650 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:23.783 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:23.779+0000 7feeabfff700 1 -- 172.21.15.32:0/1448246735 >> 172.21.15.32:0/1448246735 conn(0x7feeac0b0720 msgr2=0x7feeac0b0b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:10:23.783 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:23.779+0000 7feeabfff700 1 -- 172.21.15.32:0/1448246735 shutdown_connections 2023-10-08T06:10:23.783 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:23.779+0000 7feeabfff700 1 -- 172.21.15.32:0/1448246735 wait complete. 2023-10-08T06:10:23.785 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:23.779+0000 7feeabfff700 1 Processor -- start 2023-10-08T06:10:23.785 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:23.779+0000 7feeabfff700 1 -- start start 2023-10-08T06:10:23.785 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:23.779+0000 7feeabfff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7feeac0c9b90 0x7feeac0c8400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:23.785 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:23.779+0000 7feeabfff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7feeac0cbbb0 0x7feeac159b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:23.785 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:23.779+0000 7feeabfff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feeac0c2280 0x7feeac0b1db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:23.785 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:23.779+0000 7feeabfff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feeac0c3670 con 0x7feeac0cbbb0 2023-10-08T06:10:23.785 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:23.779+0000 7feeabfff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feeac15a0b0 con 0x7feeac0c2280 2023-10-08T06:10:23.785 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:23.779+0000 7feeabfff700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feeac0c29f0 con 0x7feeac0c9b90 2023-10-08T06:10:23.786 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:23.779+0000 7feea3fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7feeac0cbbb0 0x7feeac159b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:23.786 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:23.783+0000 7feea3fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7feeac0cbbb0 0x7feeac159b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:56026/0 (socket says 172.21.15.32:56026) 2023-10-08T06:10:23.786 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:23.783+0000 7feea3fff700 1 -- 172.21.15.32:0/2805406630 learned_addr learned my addr 172.21.15.32:0/2805406630 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:10:23.786 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:23.783+0000 7feeaaffd700 1 --2- 172.21.15.32:0/2805406630 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7feeac0c9b90 0x7feeac0c8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:23.786 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:23.783+0000 7feeab7fe700 1 --2- 172.21.15.32:0/2805406630 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feeac0c2280 0x7feeac0b1db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:23.786 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:23.783+0000 7feea3fff700 1 -- 172.21.15.32:0/2805406630 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7feeac0c9b90 msgr2=0x7feeac0c8400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:23.786 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:23.783+0000 7feea3fff700 1 --2- 172.21.15.32:0/2805406630 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7feeac0c9b90 0x7feeac0c8400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:23.786 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:23.783+0000 7feea3fff700 1 -- 172.21.15.32:0/2805406630 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feeac0c2280 msgr2=0x7feeac0b1db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:23.786 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:23.783+0000 7feea3fff700 1 --2- 172.21.15.32:0/2805406630 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feeac0c2280 0x7feeac0b1db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:23.786 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:23.783+0000 7feea3fff700 1 -- 172.21.15.32:0/2805406630 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee9c0094b0 con 0x7feeac0cbbb0 2023-10-08T06:10:23.787 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:23.783+0000 7feea3fff700 1 --2- 172.21.15.32:0/2805406630 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7feeac0cbbb0 0x7feeac159b70 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fee9400c760 tx=0x7fee9400ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:23.787 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:23.783+0000 7feea37fe700 1 -- 172.21.15.32:0/2805406630 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee94004ca0 con 0x7feeac0cbbb0 2023-10-08T06:10:23.787 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:23.783+0000 7feea37fe700 1 -- 172.21.15.32:0/2805406630 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee94004e00 con 0x7feeac0cbbb0 2023-10-08T06:10:23.787 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:23.783+0000 7feeabfff700 1 -- 172.21.15.32:0/2805406630 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feeac0c2cd0 con 0x7feeac0cbbb0 2023-10-08T06:10:23.787 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:23.783+0000 7feea37fe700 1 -- 172.21.15.32:0/2805406630 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee94007310 con 0x7feeac0cbbb0 2023-10-08T06:10:23.787 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:23.783+0000 7feeabfff700 1 -- 172.21.15.32:0/2805406630 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feeac0c3290 con 0x7feeac0cbbb0 2023-10-08T06:10:23.787 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:23.783+0000 7feeabfff700 1 -- 172.21.15.32:0/2805406630 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feeac0c37b0 con 0x7feeac0cbbb0 2023-10-08T06:10:23.788 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:23.787+0000 7feea37fe700 1 -- 172.21.15.32:0/2805406630 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fee94007470 con 0x7feeac0cbbb0 2023-10-08T06:10:23.789 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:23.787+0000 7feea37fe700 1 --2- 172.21.15.32:0/2805406630 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fee90066510 0x7fee900689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:23.789 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:23.787+0000 7feeaaffd700 1 --2- 172.21.15.32:0/2805406630 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fee90066510 0x7fee900689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:23.789 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:23.787+0000 7feea37fe700 1 -- 172.21.15.32:0/2805406630 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fee94083ce0 con 0x7feeac0cbbb0 2023-10-08T06:10:23.790 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:23.787+0000 7feeaaffd700 1 --2- 172.21.15.32:0/2805406630 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fee90066510 0x7fee900689d0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7feeac0cfc10 tx=0x7fee9c008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:23.794 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:23.791+0000 7feea37fe700 1 -- 172.21.15.32:0/2805406630 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7feeac0c37b0 con 0x7feeac0cbbb0 2023-10-08T06:10:24.006 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.003+0000 7feeabfff700 1 -- 172.21.15.32:0/2805406630 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7feeac0c37b0 con 0x7feeac0cbbb0 2023-10-08T06:10:24.007 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.003+0000 7feea37fe700 1 -- 172.21.15.32:0/2805406630 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4907 (secure 0 0 0) 0x7feeac0c37b0 con 0x7feeac0cbbb0 2023-10-08T06:10:24.007 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:10:24.008 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6833/2405386193","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":2405386193},{"type":"v1","addr":"172.21.15.40:6833","nonce":2405386193}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4254,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6835/1810658720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6834","nonce":1810658720},{"type":"v1","addr":"172.21.15.32:6835","nonce":1810658720}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4257,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6837/2286934165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6836","nonce":2286934165},{"type":"v1","addr":"172.21.15.32:6837","nonce":2286934165}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T06:09:36.528026+0000","modified":"2023-10-08T06:09:38.533661+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4318},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4318":{"gid":4318,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.40:6835/3325966535","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":3325966535},{"type":"v1","addr":"172.21.15.40:6835","nonce":3325966535}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-08T06:10:24.011 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.007+0000 7feeabfff700 1 -- 172.21.15.32:0/2805406630 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fee90066510 msgr2=0x7fee900689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:24.012 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.007+0000 7feeabfff700 1 --2- 172.21.15.32:0/2805406630 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fee90066510 0x7fee900689d0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7feeac0cfc10 tx=0x7fee9c008030 comp rx=0 tx=0).stop 2023-10-08T06:10:24.012 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.007+0000 7feeabfff700 1 -- 172.21.15.32:0/2805406630 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7feeac0cbbb0 msgr2=0x7feeac159b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:24.012 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.007+0000 7feeabfff700 1 --2- 172.21.15.32:0/2805406630 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7feeac0cbbb0 0x7feeac159b70 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fee9400c760 tx=0x7fee9400ca70 comp rx=0 tx=0).stop 2023-10-08T06:10:24.012 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.007+0000 7feeabfff700 1 -- 172.21.15.32:0/2805406630 shutdown_connections 2023-10-08T06:10:24.012 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.007+0000 7feeabfff700 1 --2- 172.21.15.32:0/2805406630 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fee90066510 0x7fee900689d0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:24.012 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.007+0000 7feeabfff700 1 --2- 172.21.15.32:0/2805406630 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7feeac0cbbb0 0x7feeac159b70 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:24.012 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.007+0000 7feeabfff700 1 --2- 172.21.15.32:0/2805406630 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feeac0c2280 0x7feeac0b1db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:24.012 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.007+0000 7feeabfff700 1 --2- 172.21.15.32:0/2805406630 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7feeac0c9b90 0x7feeac0c8400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:24.012 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.007+0000 7feeabfff700 1 -- 172.21.15.32:0/2805406630 >> 172.21.15.32:0/2805406630 conn(0x7feeac0b0720 msgr2=0x7feeac0af940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:10:24.012 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.007+0000 7feeabfff700 1 -- 172.21.15.32:0/2805406630 shutdown_connections 2023-10-08T06:10:24.013 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.007+0000 7feeabfff700 1 -- 172.21.15.32:0/2805406630 wait complete. 2023-10-08T06:10:24.013 INFO:teuthology.orchestra.run.smithi032.stderr:dumped fsmap epoch 6 2023-10-08T06:10:24.027 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T06:10:24.137 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.135+0000 7f7131047700 1 Processor -- start 2023-10-08T06:10:24.138 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.135+0000 7f7131047700 1 -- start start 2023-10-08T06:10:24.139 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.135+0000 7f7131047700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f712c15d490 0x7f712c0b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:24.139 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.135+0000 7f7131047700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f712c0d13d0 0x7f712c0cddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:24.139 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.135+0000 7f7131047700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f712c0ce770 con 0x7f712c0ce310 2023-10-08T06:10:24.139 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.135+0000 7f7131047700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f712c0d1bb0 con 0x7f712c15d490 2023-10-08T06:10:24.139 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.135+0000 7f7131047700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f712c0d1e90 con 0x7f712c0d13d0 2023-10-08T06:10:24.139 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.135+0000 7f712bfff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f712c15d490 0x7f712c0b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:24.139 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.135+0000 7f712b7fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f712c0d13d0 0x7f712c0cddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:24.139 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.135+0000 7f712bfff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f712c15d490 0x7f712c0b8bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.32:50786/0 (socket says 172.21.15.32:50786) 2023-10-08T06:10:24.140 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.135+0000 7f712b7fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f712c0d13d0 0x7f712c0cddd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.32:54466/0 (socket says 172.21.15.32:54466) 2023-10-08T06:10:24.140 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.135+0000 7f712bfff700 1 -- 172.21.15.32:0/2471628816 learned_addr learned my addr 172.21.15.32:0/2471628816 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:10:24.141 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.135+0000 7f712bfff700 1 -- 172.21.15.32:0/2471628816 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f712c0d13d0 msgr2=0x7f712c0cddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:10:24.141 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.135+0000 7f712bfff700 1 --2- 172.21.15.32:0/2471628816 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f712c0d13d0 0x7f712c0cddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:24.141 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.139+0000 7f712bfff700 1 -- 172.21.15.32:0/2471628816 >> v1:172.21.15.40:6789/0 conn(0x7f712c0ce310 legacy=0x7f712c0b4a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:24.141 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.139+0000 7f712bfff700 1 -- 172.21.15.32:0/2471628816 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f712c0d2170 con 0x7f712c15d490 2023-10-08T06:10:24.141 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.139+0000 7f712bfff700 1 --2- 172.21.15.32:0/2471628816 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f712c15d490 0x7f712c0b8bc0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f711c009910 tx=0x7f711c009c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6ae67f2d59b6c18d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:24.141 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.139+0000 7f712affd700 1 -- 172.21.15.32:0/2471628816 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f711c011830 con 0x7f712c15d490 2023-10-08T06:10:24.142 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.139+0000 7f712affd700 1 -- 172.21.15.32:0/2471628816 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f711c011990 con 0x7f712c15d490 2023-10-08T06:10:24.142 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.139+0000 7f712affd700 1 -- 172.21.15.32:0/2471628816 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f711c011d40 con 0x7f712c15d490 2023-10-08T06:10:24.142 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.139+0000 7f7131047700 1 -- 172.21.15.32:0/2471628816 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f712c15d490 msgr2=0x7f712c0b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:24.142 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.139+0000 7f7131047700 1 --2- 172.21.15.32:0/2471628816 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f712c15d490 0x7f712c0b8bc0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f711c009910 tx=0x7f711c009c20 comp rx=0 tx=0).stop 2023-10-08T06:10:24.142 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.139+0000 7f7131047700 1 -- 172.21.15.32:0/2471628816 shutdown_connections 2023-10-08T06:10:24.142 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.139+0000 7f7131047700 1 --2- 172.21.15.32:0/2471628816 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f712c0d13d0 0x7f712c0cddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:24.142 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.139+0000 7f7131047700 1 --2- 172.21.15.32:0/2471628816 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f712c15d490 0x7f712c0b8bc0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:24.142 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.139+0000 7f7131047700 1 -- 172.21.15.32:0/2471628816 >> 172.21.15.32:0/2471628816 conn(0x7f712c06ab40 msgr2=0x7f712c06af20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:10:24.142 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.139+0000 7f7131047700 1 -- 172.21.15.32:0/2471628816 shutdown_connections 2023-10-08T06:10:24.142 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.139+0000 7f7131047700 1 -- 172.21.15.32:0/2471628816 wait complete. 2023-10-08T06:10:24.143 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.139+0000 7f7131047700 1 Processor -- start 2023-10-08T06:10:24.143 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.139+0000 7f7131047700 1 -- start start 2023-10-08T06:10:24.145 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.143+0000 7f7131047700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f712c0ce310 0x7f712c160030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:24.145 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.143+0000 7f7131047700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f712c0d13d0 0x7f712c1f6720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:24.145 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.143+0000 7f7131047700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f712c15d490 0x7f712c151030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:24.145 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.143+0000 7f7131047700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f712c1f2670 con 0x7f712c0d13d0 2023-10-08T06:10:24.145 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.143+0000 7f7131047700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f712c0ca0d0 con 0x7f712c0ce310 2023-10-08T06:10:24.145 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.143+0000 7f7131047700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f712c1f6c60 con 0x7f712c15d490 2023-10-08T06:10:24.145 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.143+0000 7f712b7fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f712c0d13d0 0x7f712c1f6720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:24.145 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.143+0000 7f712b7fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f712c0d13d0 0x7f712c1f6720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:56028/0 (socket says 172.21.15.32:56028) 2023-10-08T06:10:24.146 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.143+0000 7f712b7fe700 1 -- 172.21.15.32:0/1129852706 learned_addr learned my addr 172.21.15.32:0/1129852706 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:10:24.146 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.143+0000 7f712bfff700 1 --2- 172.21.15.32:0/1129852706 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f712c0ce310 0x7f712c160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:24.146 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.143+0000 7f7130846700 1 --2- 172.21.15.32:0/1129852706 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f712c15d490 0x7f712c151030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:24.146 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.143+0000 7f712b7fe700 1 -- 172.21.15.32:0/1129852706 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f712c15d490 msgr2=0x7f712c151030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:24.146 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.143+0000 7f712b7fe700 1 --2- 172.21.15.32:0/1129852706 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f712c15d490 0x7f712c151030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:24.146 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.143+0000 7f712b7fe700 1 -- 172.21.15.32:0/1129852706 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f712c0ce310 msgr2=0x7f712c160030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:24.146 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.143+0000 7f712b7fe700 1 --2- 172.21.15.32:0/1129852706 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f712c0ce310 0x7f712c160030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:24.146 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.143+0000 7f712b7fe700 1 -- 172.21.15.32:0/1129852706 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f711c009570 con 0x7f712c0d13d0 2023-10-08T06:10:24.146 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.143+0000 7f712b7fe700 1 --2- 172.21.15.32:0/1129852706 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f712c0d13d0 0x7f712c1f6720 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f711400e9d0 tx=0x7f711400ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:24.147 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.143+0000 7f7128ff9700 1 -- 172.21.15.32:0/1129852706 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7114009720 con 0x7f712c0d13d0 2023-10-08T06:10:24.147 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.143+0000 7f7128ff9700 1 -- 172.21.15.32:0/1129852706 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f711400ee70 con 0x7f712c0d13d0 2023-10-08T06:10:24.147 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.143+0000 7f7131047700 1 -- 172.21.15.32:0/1129852706 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f712c160610 con 0x7f712c0d13d0 2023-10-08T06:10:24.148 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.143+0000 7f7128ff9700 1 -- 172.21.15.32:0/1129852706 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f711400c9f0 con 0x7f712c0d13d0 2023-10-08T06:10:24.148 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.143+0000 7f7131047700 1 -- 172.21.15.32:0/1129852706 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f712c0ca5c0 con 0x7f712c0d13d0 2023-10-08T06:10:24.148 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.143+0000 7f7131047700 1 -- 172.21.15.32:0/1129852706 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f712c073f00 con 0x7f712c0d13d0 2023-10-08T06:10:24.148 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.143+0000 7f7128ff9700 1 -- 172.21.15.32:0/1129852706 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f711400cb50 con 0x7f712c0d13d0 2023-10-08T06:10:24.148 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.147+0000 7f7128ff9700 1 --2- 172.21.15.32:0/1129852706 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f710c066510 0x7f710c0689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:24.148 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.147+0000 7f712bfff700 1 --2- 172.21.15.32:0/1129852706 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f710c066510 0x7f710c0689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:24.149 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.147+0000 7f7128ff9700 1 -- 172.21.15.32:0/1129852706 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f7114083e60 con 0x7f712c0d13d0 2023-10-08T06:10:24.149 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.147+0000 7f712bfff700 1 --2- 172.21.15.32:0/1129852706 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f710c066510 0x7f710c0689d0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f711c000c00 tx=0x7f711c008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:24.153 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.151+0000 7f7128ff9700 1 -- 172.21.15.32:0/1129852706 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f7114051260 con 0x7f712c0d13d0 2023-10-08T06:10:24.321 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.319+0000 7f7131047700 1 -- 172.21.15.32:0/1129852706 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f712c0d0650 con 0x7f712c0d13d0 2023-10-08T06:10:24.323 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.319+0000 7f7128ff9700 1 -- 172.21.15.32:0/1129852706 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+16694 (secure 0 0 0) 0x7f7114054880 con 0x7f712c0d13d0 2023-10-08T06:10:24.323 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:10:24.323 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":24,"fsid":"ac672d87-96ae-41e0-9314-623ba2cdbbba","created":"2023-10-08T06:09:11.175626+0000","modified":"2023-10-08T06:10:19.263068+0000","last_up_change":"2023-10-08T06:09:22.744643+0000","last_in_change":"2023-10-08T06:09:14.131580+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T06:09:23.307843+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T06:09:34.295012+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T06:09:35.515590+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"43433f0c-9592-4874-92d7-10f8f4acf07f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":587888964},{"type":"v1","addr":"172.21.15.32:6801","nonce":587888964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":587888964},{"type":"v1","addr":"172.21.15.32:6803","nonce":587888964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":587888964},{"type":"v1","addr":"172.21.15.32:6810","nonce":587888964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6805","nonce":587888964},{"type":"v1","addr":"172.21.15.32:6807","nonce":587888964}]},"public_addr":"172.21.15.32:6801/587888964","cluster_addr":"172.21.15.32:6803/587888964","heartbeat_back_addr":"172.21.15.32:6810/587888964","heartbeat_front_addr":"172.21.15.32:6807/587888964","state":["exists","up"]},{"osd":1,"uuid":"2ecb1008-b987-4ce7-b646-6cded55fc8d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":990576767},{"type":"v1","addr":"172.21.15.32:6817","nonce":990576767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":990576767},{"type":"v1","addr":"172.21.15.32:6819","nonce":990576767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":990576767},{"type":"v1","addr":"172.21.15.32:6823","nonce":990576767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":990576767},{"type":"v1","addr":"172.21.15.32:6821","nonce":990576767}]},"public_addr":"172.21.15.32:6817/990576767","cluster_addr":"172.21.15.32:6819/990576767","heartbeat_back_addr":"172.21.15.32:6823/990576767","heartbeat_front_addr":"172.21.15.32:6821/990576767","state":["exists","up"]},{"osd":2,"uuid":"1b131c94-c09b-4e80-8746-bf1b7bac362d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6824","nonce":1566874440},{"type":"v1","addr":"172.21.15.32:6825","nonce":1566874440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":1566874440},{"type":"v1","addr":"172.21.15.32:6827","nonce":1566874440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":1566874440},{"type":"v1","addr":"172.21.15.32:6831","nonce":1566874440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":1566874440},{"type":"v1","addr":"172.21.15.32:6829","nonce":1566874440}]},"public_addr":"172.21.15.32:6825/1566874440","cluster_addr":"172.21.15.32:6827/1566874440","heartbeat_back_addr":"172.21.15.32:6831/1566874440","heartbeat_front_addr":"172.21.15.32:6829/1566874440","state":["exists","up"]},{"osd":3,"uuid":"ad655af2-1f6f-4689-b21d-b07bbaeb68b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":3672614802},{"type":"v1","addr":"172.21.15.32:6806","nonce":3672614802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6809","nonce":3672614802},{"type":"v1","addr":"172.21.15.32:6811","nonce":3672614802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":3672614802},{"type":"v1","addr":"172.21.15.32:6815","nonce":3672614802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":3672614802},{"type":"v1","addr":"172.21.15.32:6813","nonce":3672614802}]},"public_addr":"172.21.15.32:6806/3672614802","cluster_addr":"172.21.15.32:6811/3672614802","heartbeat_back_addr":"172.21.15.32:6815/3672614802","heartbeat_front_addr":"172.21.15.32:6813/3672614802","state":["exists","up"]},{"osd":4,"uuid":"64a543a1-8c4f-458e-9aba-b35c1cd7dd03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":3369928244},{"type":"v1","addr":"172.21.15.40:6801","nonce":3369928244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":3369928244},{"type":"v1","addr":"172.21.15.40:6803","nonce":3369928244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":3369928244},{"type":"v1","addr":"172.21.15.40:6807","nonce":3369928244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":3369928244},{"type":"v1","addr":"172.21.15.40:6805","nonce":3369928244}]},"public_addr":"172.21.15.40:6801/3369928244","cluster_addr":"172.21.15.40:6803/3369928244","heartbeat_back_addr":"172.21.15.40:6807/3369928244","heartbeat_front_addr":"172.21.15.40:6805/3369928244","state":["exists","up"]},{"osd":5,"uuid":"0fef3e54-edb4-4678-878e-944663c51638","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":2395850297},{"type":"v1","addr":"172.21.15.40:6825","nonce":2395850297}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":2395850297},{"type":"v1","addr":"172.21.15.40:6827","nonce":2395850297}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":2395850297},{"type":"v1","addr":"172.21.15.40:6831","nonce":2395850297}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":2395850297},{"type":"v1","addr":"172.21.15.40:6829","nonce":2395850297}]},"public_addr":"172.21.15.40:6825/2395850297","cluster_addr":"172.21.15.40:6827/2395850297","heartbeat_back_addr":"172.21.15.40:6831/2395850297","heartbeat_front_addr":"172.21.15.40:6829/2395850297","state":["exists","up"]},{"osd":6,"uuid":"2eeb0472-6096-469d-9b2c-cab4bf41c31a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":4145283410},{"type":"v1","addr":"172.21.15.40:6809","nonce":4145283410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":4145283410},{"type":"v1","addr":"172.21.15.40:6811","nonce":4145283410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":4145283410},{"type":"v1","addr":"172.21.15.40:6815","nonce":4145283410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":4145283410},{"type":"v1","addr":"172.21.15.40:6813","nonce":4145283410}]},"public_addr":"172.21.15.40:6809/4145283410","cluster_addr":"172.21.15.40:6811/4145283410","heartbeat_back_addr":"172.21.15.40:6815/4145283410","heartbeat_front_addr":"172.21.15.40:6813/4145283410","state":["exists","up"]},{"osd":7,"uuid":"cf76e4c7-96a6-401f-a280-91aad4641940","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":2943297416},{"type":"v1","addr":"172.21.15.40:6817","nonce":2943297416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":2943297416},{"type":"v1","addr":"172.21.15.40:6819","nonce":2943297416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":2943297416},{"type":"v1","addr":"172.21.15.40:6823","nonce":2943297416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":2943297416},{"type":"v1","addr":"172.21.15.40:6821","nonce":2943297416}]},"public_addr":"172.21.15.40:6817/2943297416","cluster_addr":"172.21.15.40:6819/2943297416","heartbeat_back_addr":"172.21.15.40:6823/2943297416","heartbeat_front_addr":"172.21.15.40:6821/2943297416","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.411475+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.628841+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.599055+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.166100+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.384135+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.488403+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.307648+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.363541+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":3,"to":2}]},{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"3.39","mappings":[{"from":7,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T06:10:24.325 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.323+0000 7f7131047700 1 -- 172.21.15.32:0/1129852706 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f710c066510 msgr2=0x7f710c0689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:24.326 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.323+0000 7f7131047700 1 --2- 172.21.15.32:0/1129852706 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f710c066510 0x7f710c0689d0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f711c000c00 tx=0x7f711c008030 comp rx=0 tx=0).stop 2023-10-08T06:10:24.326 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.323+0000 7f7131047700 1 -- 172.21.15.32:0/1129852706 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f712c0d13d0 msgr2=0x7f712c1f6720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:24.326 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.323+0000 7f7131047700 1 --2- 172.21.15.32:0/1129852706 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f712c0d13d0 0x7f712c1f6720 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f711400e9d0 tx=0x7f711400ece0 comp rx=0 tx=0).stop 2023-10-08T06:10:24.326 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.323+0000 7f7131047700 1 -- 172.21.15.32:0/1129852706 shutdown_connections 2023-10-08T06:10:24.326 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.323+0000 7f7131047700 1 --2- 172.21.15.32:0/1129852706 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f710c066510 0x7f710c0689d0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:24.326 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.323+0000 7f7131047700 1 --2- 172.21.15.32:0/1129852706 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f712c0d13d0 0x7f712c1f6720 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:24.326 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.323+0000 7f7131047700 1 --2- 172.21.15.32:0/1129852706 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f712c15d490 0x7f712c151030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:24.326 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.323+0000 7f7131047700 1 --2- 172.21.15.32:0/1129852706 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f712c0ce310 0x7f712c160030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:24.326 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.323+0000 7f7131047700 1 -- 172.21.15.32:0/1129852706 >> 172.21.15.32:0/1129852706 conn(0x7f712c06ab40 msgr2=0x7f712c15c530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:10:24.326 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.323+0000 7f7131047700 1 -- 172.21.15.32:0/1129852706 shutdown_connections 2023-10-08T06:10:24.327 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.323+0000 7f7131047700 1 -- 172.21.15.32:0/1129852706 wait complete. 2023-10-08T06:10:24.339 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-08T06:10:24.340 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T06:10:24.456 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.451+0000 7f3214d42700 1 Processor -- start 2023-10-08T06:10:24.456 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.451+0000 7f3214d42700 1 -- start start 2023-10-08T06:10:24.458 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.455+0000 7f3214d42700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f32100ccd50 0x7f32100b02c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:24.458 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.455+0000 7f3214d42700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f321006bd50 0x7f32100d0450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:24.458 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.455+0000 7f3214d42700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f321006c700 con 0x7f32100cc970 2023-10-08T06:10:24.458 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.455+0000 7f3214d42700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32101614f0 con 0x7f321006bd50 2023-10-08T06:10:24.458 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.455+0000 7f3214d42700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f321006c9e0 con 0x7f32100ccd50 2023-10-08T06:10:24.458 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.455+0000 7f320ffff700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f321006bd50 0x7f32100d0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:24.458 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.455+0000 7f320effd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f32100ccd50 0x7f32100b02c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:24.459 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.455+0000 7f320ffff700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f321006bd50 0x7f32100d0450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:56042/0 (socket says 172.21.15.32:56042) 2023-10-08T06:10:24.459 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.455+0000 7f320ffff700 1 -- 172.21.15.32:0/1636687783 learned_addr learned my addr 172.21.15.32:0/1636687783 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:10:24.459 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.455+0000 7f320effd700 1 -- 172.21.15.32:0/1636687783 >> v2:172.21.15.32:3300/0 conn(0x7f321006bd50 msgr2=0x7f32100d0450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:10:24.459 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.455+0000 7f320effd700 1 --2- 172.21.15.32:0/1636687783 >> v2:172.21.15.32:3300/0 conn(0x7f321006bd50 0x7f32100d0450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:24.459 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.455+0000 7f320effd700 1 -- 172.21.15.32:0/1636687783 >> v1:172.21.15.40:6789/0 conn(0x7f32100cc970 legacy=0x7f3210160de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:24.459 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.455+0000 7f320effd700 1 -- 172.21.15.32:0/1636687783 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32100cea40 con 0x7f32100ccd50 2023-10-08T06:10:24.459 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.455+0000 7f320effd700 1 --2- 172.21.15.32:0/1636687783 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f32100ccd50 0x7f32100b02c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f3200009850 tx=0x7f3200009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=de99e7d71a23bf9e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:24.459 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.455+0000 7f320e7fc700 1 -- 172.21.15.32:0/1636687783 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3200011830 con 0x7f32100ccd50 2023-10-08T06:10:24.459 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.455+0000 7f320e7fc700 1 -- 172.21.15.32:0/1636687783 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3200011990 con 0x7f32100ccd50 2023-10-08T06:10:24.459 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.455+0000 7f320e7fc700 1 -- 172.21.15.32:0/1636687783 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3200011d40 con 0x7f32100ccd50 2023-10-08T06:10:24.460 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.455+0000 7f3214d42700 1 -- 172.21.15.32:0/1636687783 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f32100ccd50 msgr2=0x7f32100b02c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:24.460 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.455+0000 7f3214d42700 1 --2- 172.21.15.32:0/1636687783 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f32100ccd50 0x7f32100b02c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f3200009850 tx=0x7f3200009b60 comp rx=0 tx=0).stop 2023-10-08T06:10:24.460 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.455+0000 7f3214d42700 1 -- 172.21.15.32:0/1636687783 shutdown_connections 2023-10-08T06:10:24.460 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.455+0000 7f3214d42700 1 --2- 172.21.15.32:0/1636687783 >> v2:172.21.15.32:3300/0 conn(0x7f321006bd50 0x7f32100d0450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:24.461 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.455+0000 7f3214d42700 1 --2- 172.21.15.32:0/1636687783 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f32100ccd50 0x7f32100b02c0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:24.461 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.455+0000 7f3214d42700 1 -- 172.21.15.32:0/1636687783 >> 172.21.15.32:0/1636687783 conn(0x7f321006df60 msgr2=0x7f321006e340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:10:24.461 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.455+0000 7f3214d42700 1 -- 172.21.15.32:0/1636687783 shutdown_connections 2023-10-08T06:10:24.461 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.455+0000 7f3214d42700 1 -- 172.21.15.32:0/1636687783 wait complete. 2023-10-08T06:10:24.462 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.459+0000 7f3214d42700 1 Processor -- start 2023-10-08T06:10:24.462 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.459+0000 7f3214d42700 1 -- start start 2023-10-08T06:10:24.465 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.463+0000 7f3214d42700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f321006bd50 0x7f32100b1cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:24.466 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.463+0000 7f3214d42700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f32100cc970 0x7f32100b2210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:24.466 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.463+0000 7f3214d42700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f32100ccd50 0x7f321014fe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:24.466 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.463+0000 7f3214d42700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f321014e100 con 0x7f321006bd50 2023-10-08T06:10:24.466 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.463+0000 7f3214d42700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32100b2750 con 0x7f32100cc970 2023-10-08T06:10:24.466 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.463+0000 7f3214d42700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32101f3200 con 0x7f32100ccd50 2023-10-08T06:10:24.466 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.463+0000 7f320f7fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f321006bd50 0x7f32100b1cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:24.466 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.463+0000 7f320f7fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f321006bd50 0x7f32100b1cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:56056/0 (socket says 172.21.15.32:56056) 2023-10-08T06:10:24.466 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.463+0000 7f320f7fe700 1 -- 172.21.15.32:0/681079536 learned_addr learned my addr 172.21.15.32:0/681079536 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:10:24.466 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.463+0000 7f320ffff700 1 --2- 172.21.15.32:0/681079536 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f32100ccd50 0x7f321014fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:24.467 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.463+0000 7f320effd700 1 --2- 172.21.15.32:0/681079536 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f32100cc970 0x7f32100b2210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:24.467 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.463+0000 7f320f7fe700 1 -- 172.21.15.32:0/681079536 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f32100ccd50 msgr2=0x7f321014fe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:24.467 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.463+0000 7f320f7fe700 1 --2- 172.21.15.32:0/681079536 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f32100ccd50 0x7f321014fe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:24.467 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.463+0000 7f320f7fe700 1 -- 172.21.15.32:0/681079536 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f32100cc970 msgr2=0x7f32100b2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:24.467 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.463+0000 7f320f7fe700 1 --2- 172.21.15.32:0/681079536 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f32100cc970 0x7f32100b2210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:24.467 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.463+0000 7f320f7fe700 1 -- 172.21.15.32:0/681079536 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32000094b0 con 0x7f321006bd50 2023-10-08T06:10:24.467 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.463+0000 7f320f7fe700 1 --2- 172.21.15.32:0/681079536 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f321006bd50 0x7f32100b1cd0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f320400c500 tx=0x7f320400c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:24.468 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.463+0000 7f31f7fff700 1 -- 172.21.15.32:0/681079536 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32040052d0 con 0x7f321006bd50 2023-10-08T06:10:24.468 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.463+0000 7f31f7fff700 1 -- 172.21.15.32:0/681079536 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3204005430 con 0x7f321006bd50 2023-10-08T06:10:24.468 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.463+0000 7f3214d42700 1 -- 172.21.15.32:0/681079536 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f321014ddb0 con 0x7f321006bd50 2023-10-08T06:10:24.468 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.463+0000 7f31f7fff700 1 -- 172.21.15.32:0/681079536 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32040055a0 con 0x7f321006bd50 2023-10-08T06:10:24.468 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.463+0000 7f3214d42700 1 -- 172.21.15.32:0/681079536 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32100b2c10 con 0x7f321006bd50 2023-10-08T06:10:24.468 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.467+0000 7f3214d42700 1 -- 172.21.15.32:0/681079536 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32100686a0 con 0x7f321006bd50 2023-10-08T06:10:24.469 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.467+0000 7f31f7fff700 1 -- 172.21.15.32:0/681079536 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f32040038e0 con 0x7f321006bd50 2023-10-08T06:10:24.469 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.467+0000 7f31f7fff700 1 --2- 172.21.15.32:0/681079536 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f31fc066510 0x7f31fc0689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:24.469 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.467+0000 7f31f7fff700 1 -- 172.21.15.32:0/681079536 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f3204083120 con 0x7f321006bd50 2023-10-08T06:10:24.469 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.467+0000 7f320effd700 1 --2- 172.21.15.32:0/681079536 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f31fc066510 0x7f31fc0689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:24.470 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.467+0000 7f320effd700 1 --2- 172.21.15.32:0/681079536 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f31fc066510 0x7f31fc0689d0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f32000090b0 tx=0x7f320001c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:24.476 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.475+0000 7f31f7fff700 1 -- 172.21.15.32:0/681079536 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f32040505b0 con 0x7f321006bd50 2023-10-08T06:10:24.676 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.675+0000 7f3214d42700 1 -- 172.21.15.32:0/681079536 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3210073150 con 0x7f321006bd50 2023-10-08T06:10:24.677 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.675+0000 7f31f7fff700 1 -- 172.21.15.32:0/681079536 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4907 (secure 0 0 0) 0x7f3204053bd0 con 0x7f321006bd50 2023-10-08T06:10:24.677 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:10:24.677 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6833/2405386193","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":2405386193},{"type":"v1","addr":"172.21.15.40:6833","nonce":2405386193}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4254,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6835/1810658720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6834","nonce":1810658720},{"type":"v1","addr":"172.21.15.32:6835","nonce":1810658720}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4257,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6837/2286934165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6836","nonce":2286934165},{"type":"v1","addr":"172.21.15.32:6837","nonce":2286934165}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T06:09:36.528026+0000","modified":"2023-10-08T06:09:38.533661+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4318},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4318":{"gid":4318,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.40:6835/3325966535","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":3325966535},{"type":"v1","addr":"172.21.15.40:6835","nonce":3325966535}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-08T06:10:24.679 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.675+0000 7f3214d42700 1 -- 172.21.15.32:0/681079536 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f31fc066510 msgr2=0x7f31fc0689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:24.679 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.675+0000 7f3214d42700 1 --2- 172.21.15.32:0/681079536 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f31fc066510 0x7f31fc0689d0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f32000090b0 tx=0x7f320001c040 comp rx=0 tx=0).stop 2023-10-08T06:10:24.679 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.675+0000 7f3214d42700 1 -- 172.21.15.32:0/681079536 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f321006bd50 msgr2=0x7f32100b1cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:24.680 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.675+0000 7f3214d42700 1 --2- 172.21.15.32:0/681079536 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f321006bd50 0x7f32100b1cd0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f320400c500 tx=0x7f320400c810 comp rx=0 tx=0).stop 2023-10-08T06:10:24.680 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.675+0000 7f3214d42700 1 -- 172.21.15.32:0/681079536 shutdown_connections 2023-10-08T06:10:24.680 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.675+0000 7f3214d42700 1 --2- 172.21.15.32:0/681079536 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f31fc066510 0x7f31fc0689d0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:24.680 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.675+0000 7f3214d42700 1 --2- 172.21.15.32:0/681079536 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f32100ccd50 0x7f321014fe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:24.680 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.675+0000 7f3214d42700 1 --2- 172.21.15.32:0/681079536 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f32100cc970 0x7f32100b2210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:24.680 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.675+0000 7f3214d42700 1 --2- 172.21.15.32:0/681079536 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f321006bd50 0x7f32100b1cd0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:24.680 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.675+0000 7f3214d42700 1 -- 172.21.15.32:0/681079536 >> 172.21.15.32:0/681079536 conn(0x7f321006df60 msgr2=0x7f32100d0410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:10:24.680 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.675+0000 7f3214d42700 1 -- 172.21.15.32:0/681079536 shutdown_connections 2023-10-08T06:10:24.680 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.675+0000 7f3214d42700 1 -- 172.21.15.32:0/681079536 wait complete. 2023-10-08T06:10:24.681 INFO:teuthology.orchestra.run.smithi032.stderr:dumped fsmap epoch 6 2023-10-08T06:10:24.692 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T06:10:24.811 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.807+0000 7f4d1ffff700 1 Processor -- start 2023-10-08T06:10:24.812 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.807+0000 7f4d1ffff700 1 -- start start 2023-10-08T06:10:24.815 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.811+0000 7f4d1ffff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4d2015b980 0x7f4d2015f780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:24.815 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.811+0000 7f4d1ffff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f4d200c9b30 0x7f4d2015bd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:24.815 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.811+0000 7f4d1ffff700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d2006fc20 con 0x7f4d200719e0 2023-10-08T06:10:24.815 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.811+0000 7f4d1ffff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d20070430 con 0x7f4d200c9b30 2023-10-08T06:10:24.815 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.811+0000 7f4d1ffff700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d2015ed70 con 0x7f4d2015b980 2023-10-08T06:10:24.815 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.811+0000 7f4d17fff700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f4d200719e0 0x7f4d200c9420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:38174/0 (socket says 172.21.15.32:38174) 2023-10-08T06:10:24.815 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.811+0000 7f4d17fff700 1 -- 172.21.15.32:0/2501019460 learned_addr learned my addr 172.21.15.32:0/2501019460 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-08T06:10:24.816 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.811+0000 7f4d1f7fe700 1 --2- 172.21.15.32:0/2501019460 >> v2:172.21.15.40:3300/0 conn(0x7f4d200c9b30 0x7f4d2015bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:24.816 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.811+0000 7f4d1effd700 1 --2- 172.21.15.32:0/2501019460 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4d2015b980 0x7f4d2015f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:24.816 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.811+0000 7f4d1e7fc700 1 -- 172.21.15.32:0/2501019460 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 701253141 0 0) 0x7f4d2006fc20 con 0x7f4d200719e0 2023-10-08T06:10:24.816 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.811+0000 7f4d1e7fc700 1 -- 172.21.15.32:0/2501019460 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4d0c0035d0 con 0x7f4d200719e0 2023-10-08T06:10:24.816 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.811+0000 7f4d1e7fc700 1 -- 172.21.15.32:0/2501019460 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1547698388 0 0) 0x7f4d0c0035d0 con 0x7f4d200719e0 2023-10-08T06:10:24.816 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.811+0000 7f4d1e7fc700 1 -- 172.21.15.32:0/2501019460 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4d2015b980 msgr2=0x7f4d2015f780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:10:24.816 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.811+0000 7f4d1e7fc700 1 --2- 172.21.15.32:0/2501019460 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4d2015b980 0x7f4d2015f780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:24.816 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.811+0000 7f4d1e7fc700 1 -- 172.21.15.32:0/2501019460 >> v2:172.21.15.40:3300/0 conn(0x7f4d200c9b30 msgr2=0x7f4d2015bd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:10:24.816 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.811+0000 7f4d1e7fc700 1 --2- 172.21.15.32:0/2501019460 >> v2:172.21.15.40:3300/0 conn(0x7f4d200c9b30 0x7f4d2015bd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:24.816 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.811+0000 7f4d1e7fc700 1 -- 172.21.15.32:0/2501019460 --> v1:172.21.15.32:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d2015fcc0 con 0x7f4d200719e0 2023-10-08T06:10:24.816 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.811+0000 7f4d1e7fc700 1 -- 172.21.15.32:0/2501019460 <== mon.0 v1:172.21.15.32:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2364763317 0 0) 0x7f4d08001670 con 0x7f4d200719e0 2023-10-08T06:10:24.816 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.811+0000 7f4d1e7fc700 1 -- 172.21.15.32:0/2501019460 >> v1:172.21.15.32:6789/0 conn(0x7f4d200719e0 legacy=0x7f4d200c9420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:24.817 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.811+0000 7f4d1e7fc700 1 --2- 172.21.15.32:0/2501019460 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4d0c003a20 0x7f4d0c003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:24.817 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.811+0000 7f4d1e7fc700 1 --2- 172.21.15.32:0/2501019460 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4d0c004870 0x7f4d0c004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:24.817 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.811+0000 7f4d1e7fc700 1 --2- 172.21.15.32:0/2501019460 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4d0c005230 0x7f4d0c00ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:24.817 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.811+0000 7f4d1e7fc700 1 -- 172.21.15.32:0/2501019460 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d2015ed70 con 0x7f4d0c004870 2023-10-08T06:10:24.817 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.811+0000 7f4d1e7fc700 1 -- 172.21.15.32:0/2501019460 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d0c00bf70 con 0x7f4d0c005230 2023-10-08T06:10:24.817 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.811+0000 7f4d1e7fc700 1 -- 172.21.15.32:0/2501019460 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d0c00c130 con 0x7f4d0c003a20 2023-10-08T06:10:24.817 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.811+0000 7f4d17fff700 1 --2- 172.21.15.32:0/2501019460 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4d0c004870 0x7f4d0c004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:24.817 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.811+0000 7f4d1effd700 1 --2- 172.21.15.32:0/2501019460 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4d2015b980 0x7f4d2015f780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T06:10:24.817 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.811+0000 7f4d1f7fe700 1 --2- 172.21.15.32:0/2501019460 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4d0c005230 0x7f4d0c00ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:24.817 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.811+0000 7f4d17fff700 1 -- 172.21.15.32:0/2501019460 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4d0c003a20 msgr2=0x7f4d0c003e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:10:24.817 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.811+0000 7f4d17fff700 1 --2- 172.21.15.32:0/2501019460 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4d0c003a20 0x7f4d0c003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:24.817 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.811+0000 7f4d17fff700 1 -- 172.21.15.32:0/2501019460 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4d0c005230 msgr2=0x7f4d0c00ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:10:24.818 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.811+0000 7f4d17fff700 1 --2- 172.21.15.32:0/2501019460 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4d0c005230 0x7f4d0c00ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:24.818 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.811+0000 7f4d17fff700 1 -- 172.21.15.32:0/2501019460 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d0c0035d0 con 0x7f4d0c004870 2023-10-08T06:10:24.818 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.811+0000 7f4d17fff700 1 --2- 172.21.15.32:0/2501019460 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4d0c004870 0x7f4d0c004cf0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f4d0800c2c0 tx=0x7f4d0c0058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4225f7e90cd72ecd server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:24.818 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.811+0000 7f4d1e7fc700 1 -- 172.21.15.32:0/2501019460 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d08007b90 con 0x7f4d0c004870 2023-10-08T06:10:24.818 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.811+0000 7f4d1e7fc700 1 -- 172.21.15.32:0/2501019460 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d0800ce40 con 0x7f4d0c004870 2023-10-08T06:10:24.818 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.811+0000 7f4d1e7fc700 1 -- 172.21.15.32:0/2501019460 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d08005bc0 con 0x7f4d0c004870 2023-10-08T06:10:24.818 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.811+0000 7f4d1ffff700 1 -- 172.21.15.32:0/2501019460 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4d0c004870 msgr2=0x7f4d0c004cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:24.818 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.811+0000 7f4d1ffff700 1 --2- 172.21.15.32:0/2501019460 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4d0c004870 0x7f4d0c004cf0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f4d0800c2c0 tx=0x7f4d0c0058a0 comp rx=0 tx=0).stop 2023-10-08T06:10:24.818 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.811+0000 7f4d1f7fe700 1 -- 172.21.15.32:0/2501019460 reap_dead start 2023-10-08T06:10:24.818 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.811+0000 7f4d1ffff700 1 -- 172.21.15.32:0/2501019460 shutdown_connections 2023-10-08T06:10:24.818 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.811+0000 7f4d1ffff700 1 -- 172.21.15.32:0/2501019460 >> 172.21.15.32:0/2501019460 conn(0x7f4d200b0900 msgr2=0x7f4d200b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:10:24.819 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.811+0000 7f4d1ffff700 1 -- 172.21.15.32:0/2501019460 shutdown_connections 2023-10-08T06:10:24.819 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.811+0000 7f4d1ffff700 1 -- 172.21.15.32:0/2501019460 wait complete. 2023-10-08T06:10:24.819 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.815+0000 7f4d1ffff700 1 Processor -- start 2023-10-08T06:10:24.819 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.815+0000 7f4d1ffff700 1 -- start start 2023-10-08T06:10:24.821 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.819+0000 7f4d1ffff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4d0c004870 0x7f4d200ce440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:24.822 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.819+0000 7f4d1ffff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4d20151850 0x7f4d200cd380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:24.822 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.819+0000 7f4d1ffff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4d200c8040 0x7f4d2015a210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:24.822 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.819+0000 7f4d1ffff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d200c7bb0 con 0x7f4d200c8040 2023-10-08T06:10:24.822 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.819+0000 7f4d1ffff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d200cd8c0 con 0x7f4d0c004870 2023-10-08T06:10:24.822 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.819+0000 7f4d1ffff700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d200c7280 con 0x7f4d20151850 2023-10-08T06:10:24.822 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.819+0000 7f4d1f7fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4d200c8040 0x7f4d2015a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:24.822 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.819+0000 7f4d1effd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4d0c004870 0x7f4d200ce440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:24.822 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.819+0000 7f4d1f7fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4d200c8040 0x7f4d2015a210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:56068/0 (socket says 172.21.15.32:56068) 2023-10-08T06:10:24.822 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.819+0000 7f4d1f7fe700 1 -- 172.21.15.32:0/3436211695 learned_addr learned my addr 172.21.15.32:0/3436211695 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:10:24.822 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.819+0000 7f4d17fff700 1 --2- 172.21.15.32:0/3436211695 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4d20151850 0x7f4d200cd380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:24.823 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.819+0000 7f4d1f7fe700 1 -- 172.21.15.32:0/3436211695 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4d20151850 msgr2=0x7f4d200cd380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:24.823 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.819+0000 7f4d1f7fe700 1 --2- 172.21.15.32:0/3436211695 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4d20151850 0x7f4d200cd380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:24.823 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.819+0000 7f4d1f7fe700 1 -- 172.21.15.32:0/3436211695 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4d0c004870 msgr2=0x7f4d200ce440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:24.823 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.819+0000 7f4d1f7fe700 1 --2- 172.21.15.32:0/3436211695 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4d0c004870 0x7f4d200ce440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:24.823 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.819+0000 7f4d1f7fe700 1 -- 172.21.15.32:0/3436211695 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d200c7560 con 0x7f4d200c8040 2023-10-08T06:10:24.823 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.819+0000 7f4d1f7fe700 1 --2- 172.21.15.32:0/3436211695 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4d200c8040 0x7f4d2015a210 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f4d200c25c0 tx=0x7f4d18007f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:24.823 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.819+0000 7f4d177fe700 1 -- 172.21.15.32:0/3436211695 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d1800e070 con 0x7f4d200c8040 2023-10-08T06:10:24.824 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.819+0000 7f4d177fe700 1 -- 172.21.15.32:0/3436211695 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d18003d10 con 0x7f4d200c8040 2023-10-08T06:10:24.824 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.819+0000 7f4d1ffff700 1 -- 172.21.15.32:0/3436211695 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d200c7840 con 0x7f4d200c8040 2023-10-08T06:10:24.824 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.819+0000 7f4d177fe700 1 -- 172.21.15.32:0/3436211695 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d18011760 con 0x7f4d200c8040 2023-10-08T06:10:24.824 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.819+0000 7f4d1ffff700 1 -- 172.21.15.32:0/3436211695 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d2015a930 con 0x7f4d200c8040 2023-10-08T06:10:24.824 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.823+0000 7f4d1ffff700 1 -- 172.21.15.32:0/3436211695 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d20073f00 con 0x7f4d200c8040 2023-10-08T06:10:24.825 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.823+0000 7f4d177fe700 1 -- 172.21.15.32:0/3436211695 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f4d180118c0 con 0x7f4d200c8040 2023-10-08T06:10:24.825 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.823+0000 7f4d177fe700 1 --2- 172.21.15.32:0/3436211695 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f4d00066540 0x7f4d00068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:24.825 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.823+0000 7f4d177fe700 1 -- 172.21.15.32:0/3436211695 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f4d180840d0 con 0x7f4d200c8040 2023-10-08T06:10:24.825 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.823+0000 7f4d1effd700 1 --2- 172.21.15.32:0/3436211695 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f4d00066540 0x7f4d00068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:24.826 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.823+0000 7f4d1effd700 1 --2- 172.21.15.32:0/3436211695 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f4d00066540 0x7f4d00068a00 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f4d10004860 tx=0x7f4d10008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:24.833 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:24.831+0000 7f4d177fe700 1 -- 172.21.15.32:0/3436211695 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f4d18051560 con 0x7f4d200c8040 2023-10-08T06:10:25.033 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:25.031+0000 7f4d1ffff700 1 -- 172.21.15.32:0/3436211695 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4d2015ab20 con 0x7f4d200c8040 2023-10-08T06:10:25.034 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:25.031+0000 7f4d177fe700 1 -- 172.21.15.32:0/3436211695 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4907 (secure 0 0 0) 0x7f4d18054b80 con 0x7f4d200c8040 2023-10-08T06:10:25.034 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:10:25.034 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6833/2405386193","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":2405386193},{"type":"v1","addr":"172.21.15.40:6833","nonce":2405386193}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4254,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6835/1810658720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6834","nonce":1810658720},{"type":"v1","addr":"172.21.15.32:6835","nonce":1810658720}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4257,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6837/2286934165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6836","nonce":2286934165},{"type":"v1","addr":"172.21.15.32:6837","nonce":2286934165}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T06:09:36.528026+0000","modified":"2023-10-08T06:09:38.533661+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4318},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4318":{"gid":4318,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.40:6835/3325966535","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":3325966535},{"type":"v1","addr":"172.21.15.40:6835","nonce":3325966535}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-08T06:10:25.037 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:25.035+0000 7f4d1ffff700 1 -- 172.21.15.32:0/3436211695 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f4d00066540 msgr2=0x7f4d00068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:25.037 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:25.035+0000 7f4d1ffff700 1 --2- 172.21.15.32:0/3436211695 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f4d00066540 0x7f4d00068a00 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f4d10004860 tx=0x7f4d10008040 comp rx=0 tx=0).stop 2023-10-08T06:10:25.037 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:25.035+0000 7f4d1ffff700 1 -- 172.21.15.32:0/3436211695 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4d200c8040 msgr2=0x7f4d2015a210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:25.037 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:25.035+0000 7f4d1ffff700 1 --2- 172.21.15.32:0/3436211695 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4d200c8040 0x7f4d2015a210 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f4d200c25c0 tx=0x7f4d18007f80 comp rx=0 tx=0).stop 2023-10-08T06:10:25.037 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:25.035+0000 7f4d1ffff700 1 -- 172.21.15.32:0/3436211695 shutdown_connections 2023-10-08T06:10:25.037 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:25.035+0000 7f4d1ffff700 1 --2- 172.21.15.32:0/3436211695 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f4d00066540 0x7f4d00068a00 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:25.037 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:25.035+0000 7f4d1ffff700 1 --2- 172.21.15.32:0/3436211695 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4d200c8040 0x7f4d2015a210 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:25.037 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:25.035+0000 7f4d1ffff700 1 --2- 172.21.15.32:0/3436211695 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4d20151850 0x7f4d200cd380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:25.038 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:25.035+0000 7f4d1ffff700 1 --2- 172.21.15.32:0/3436211695 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4d0c004870 0x7f4d200ce440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:25.038 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:25.035+0000 7f4d1ffff700 1 -- 172.21.15.32:0/3436211695 >> 172.21.15.32:0/3436211695 conn(0x7f4d200b0900 msgr2=0x7f4d2015bd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:10:25.038 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:25.035+0000 7f4d1ffff700 1 -- 172.21.15.32:0/3436211695 shutdown_connections 2023-10-08T06:10:25.038 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:25.035+0000 7f4d1ffff700 1 -- 172.21.15.32:0/3436211695 wait complete. 2023-10-08T06:10:25.038 INFO:teuthology.orchestra.run.smithi032.stderr:dumped fsmap epoch 6 2023-10-08T06:10:25.049 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T06:10:25.168 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:25.167+0000 7f332e882700 1 Processor -- start 2023-10-08T06:10:25.168 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:25.167+0000 7f332e882700 1 -- start start 2023-10-08T06:10:25.169 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:25.167+0000 7f332e882700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f33280b4b80 0x7f33280704d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:25.169 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:25.167+0000 7f332e882700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3328072510 con 0x7f33281580b0 2023-10-08T06:10:25.169 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:25.167+0000 7f332e882700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33280b4f60 con 0x7f3328158c30 2023-10-08T06:10:25.169 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:25.167+0000 7f332e882700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f332806bc90 con 0x7f33280b4b80 2023-10-08T06:10:25.169 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:25.167+0000 7f332d880700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f33280b4b80 0x7f33280704d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:25.169 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:25.167+0000 7f332d880700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f33280b4b80 0x7f33280704d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:56078/0 (socket says 172.21.15.32:56078) 2023-10-08T06:10:25.169 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:25.167+0000 7f332d07f700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f33281580b0 0x7f3328158520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:38182/0 (socket says 172.21.15.32:38182) 2023-10-08T06:10:25.169 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:25.167+0000 7f332d880700 1 -- 172.21.15.32:0/1906591682 learned_addr learned my addr 172.21.15.32:0/1906591682 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:10:25.170 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:25.167+0000 7f332d880700 1 -- 172.21.15.32:0/1906591682 >> v1:172.21.15.40:6789/0 conn(0x7f3328158c30 legacy=0x7f332815eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:10:25.171 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:25.167+0000 7f332d880700 1 -- 172.21.15.32:0/1906591682 >> v1:172.21.15.32:6789/0 conn(0x7f33281580b0 legacy=0x7f3328158520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:25.171 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:25.167+0000 7f332d880700 1 -- 172.21.15.32:0/1906591682 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3328071ee0 con 0x7f33280b4b80 2023-10-08T06:10:25.171 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:25.167+0000 7f332d880700 1 --2- 172.21.15.32:0/1906591682 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f33280b4b80 0x7f33280704d0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f3324009910 tx=0x7f3324009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24a628819ec2a2d3 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:25.171 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:25.167+0000 7f332c87e700 1 -- 172.21.15.32:0/1906591682 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f332400ba60 con 0x7f33280b4b80 2023-10-08T06:10:25.171 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:25.167+0000 7f332c87e700 1 -- 172.21.15.32:0/1906591682 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f332400bbc0 con 0x7f33280b4b80 2023-10-08T06:10:25.171 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:25.167+0000 7f332c87e700 1 -- 172.21.15.32:0/1906591682 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3324009e60 con 0x7f33280b4b80 2023-10-08T06:10:25.172 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:25.167+0000 7f332e882700 1 -- 172.21.15.32:0/1906591682 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f33280b4b80 msgr2=0x7f33280704d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:25.172 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:25.167+0000 7f332e882700 1 --2- 172.21.15.32:0/1906591682 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f33280b4b80 0x7f33280704d0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f3324009910 tx=0x7f3324009c20 comp rx=0 tx=0).stop 2023-10-08T06:10:25.172 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:25.167+0000 7f332e882700 1 -- 172.21.15.32:0/1906591682 shutdown_connections 2023-10-08T06:10:25.173 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:25.167+0000 7f332e882700 1 --2- 172.21.15.32:0/1906591682 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f33280b4b80 0x7f33280704d0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:25.173 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:25.167+0000 7f332e882700 1 -- 172.21.15.32:0/1906591682 >> 172.21.15.32:0/1906591682 conn(0x7f33280cf470 msgr2=0x7f33280cf880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:10:25.173 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:25.167+0000 7f332e882700 1 -- 172.21.15.32:0/1906591682 shutdown_connections 2023-10-08T06:10:25.173 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:25.167+0000 7f332e882700 1 -- 172.21.15.32:0/1906591682 wait complete. 2023-10-08T06:10:25.175 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:25.171+0000 7f332e882700 1 Processor -- start 2023-10-08T06:10:25.175 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:25.171+0000 7f332e882700 1 -- start start 2023-10-08T06:10:25.175 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:25.171+0000 7f332e882700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f33280b4b80 0x7f33280b3f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:25.176 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:25.171+0000 7f332e882700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f33281580b0 0x7f332815a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:25.176 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:25.171+0000 7f332e882700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3328158c30 0x7f33280ac8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:25.176 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:25.171+0000 7f332e882700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3328141b70 con 0x7f33281580b0 2023-10-08T06:10:25.176 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:25.171+0000 7f332e882700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33281440e0 con 0x7f33280b4b80 2023-10-08T06:10:25.176 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:25.171+0000 7f332e882700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33281443c0 con 0x7f3328158c30 2023-10-08T06:10:25.176 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:25.171+0000 7f332d07f700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f33281580b0 0x7f332815a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:25.176 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:25.171+0000 7f332d07f700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f33281580b0 0x7f332815a970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:56084/0 (socket says 172.21.15.32:56084) 2023-10-08T06:10:25.176 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:25.171+0000 7f332d07f700 1 -- 172.21.15.32:0/3074598361 learned_addr learned my addr 172.21.15.32:0/3074598361 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:10:25.176 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:25.171+0000 7f332e081700 1 --2- 172.21.15.32:0/3074598361 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3328158c30 0x7f33280ac8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:25.177 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:25.171+0000 7f332d880700 1 --2- 172.21.15.32:0/3074598361 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f33280b4b80 0x7f33280b3f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:25.177 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:25.171+0000 7f332d07f700 1 -- 172.21.15.32:0/3074598361 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3328158c30 msgr2=0x7f33280ac8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:25.177 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:25.171+0000 7f332d07f700 1 --2- 172.21.15.32:0/3074598361 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3328158c30 0x7f33280ac8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:25.177 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:25.171+0000 7f332d07f700 1 -- 172.21.15.32:0/3074598361 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f33280b4b80 msgr2=0x7f33280b3f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:25.177 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:25.171+0000 7f332d07f700 1 --2- 172.21.15.32:0/3074598361 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f33280b4b80 0x7f33280b3f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:25.177 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:25.171+0000 7f332d07f700 1 -- 172.21.15.32:0/3074598361 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3324009570 con 0x7f33281580b0 2023-10-08T06:10:25.177 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:25.171+0000 7f332d07f700 1 --2- 172.21.15.32:0/3074598361 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f33281580b0 0x7f332815a970 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f331800c700 tx=0x7f331800ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:25.177 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:25.171+0000 7f331e7fc700 1 -- 172.21.15.32:0/3074598361 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3318005cd0 con 0x7f33281580b0 2023-10-08T06:10:25.177 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:25.171+0000 7f331e7fc700 1 -- 172.21.15.32:0/3074598361 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3318005e30 con 0x7f33281580b0 2023-10-08T06:10:25.177 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:25.171+0000 7f331e7fc700 1 -- 172.21.15.32:0/3074598361 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33180072d0 con 0x7f33281580b0 2023-10-08T06:10:25.178 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:25.171+0000 7f332e882700 1 -- 172.21.15.32:0/3074598361 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33281446a0 con 0x7f33281580b0 2023-10-08T06:10:25.178 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:25.171+0000 7f332e882700 1 -- 172.21.15.32:0/3074598361 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3328154e90 con 0x7f33281580b0 2023-10-08T06:10:25.178 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:25.175+0000 7f332e882700 1 -- 172.21.15.32:0/3074598361 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3328141ce0 con 0x7f33281580b0 2023-10-08T06:10:25.179 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:25.175+0000 7f331e7fc700 1 -- 172.21.15.32:0/3074598361 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f3318007430 con 0x7f33281580b0 2023-10-08T06:10:25.179 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:25.175+0000 7f331e7fc700 1 --2- 172.21.15.32:0/3074598361 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f330c066510 0x7f330c0689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:25.179 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:25.175+0000 7f331e7fc700 1 -- 172.21.15.32:0/3074598361 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f3318083160 con 0x7f33281580b0 2023-10-08T06:10:25.182 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:25.179+0000 7f332d880700 1 --2- 172.21.15.32:0/3074598361 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f330c066510 0x7f330c0689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:25.183 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:25.179+0000 7f332d880700 1 --2- 172.21.15.32:0/3074598361 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f330c066510 0x7f330c0689d0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f3324006f80 tx=0x7f3324008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:25.184 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:25.183+0000 7f331e7fc700 1 -- 172.21.15.32:0/3074598361 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f3328141ce0 con 0x7f33281580b0 2023-10-08T06:10:25.350 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:25.347+0000 7f332e882700 1 -- 172.21.15.32:0/3074598361 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3328141cb0 con 0x7f33281580b0 2023-10-08T06:10:25.351 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:25.347+0000 7f331e7fc700 1 -- 172.21.15.32:0/3074598361 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+16694 (secure 0 0 0) 0x7f3318017090 con 0x7f33281580b0 2023-10-08T06:10:25.351 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:10:25.351 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":24,"fsid":"ac672d87-96ae-41e0-9314-623ba2cdbbba","created":"2023-10-08T06:09:11.175626+0000","modified":"2023-10-08T06:10:19.263068+0000","last_up_change":"2023-10-08T06:09:22.744643+0000","last_in_change":"2023-10-08T06:09:14.131580+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T06:09:23.307843+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T06:09:34.295012+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T06:09:35.515590+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"43433f0c-9592-4874-92d7-10f8f4acf07f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":587888964},{"type":"v1","addr":"172.21.15.32:6801","nonce":587888964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":587888964},{"type":"v1","addr":"172.21.15.32:6803","nonce":587888964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":587888964},{"type":"v1","addr":"172.21.15.32:6810","nonce":587888964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6805","nonce":587888964},{"type":"v1","addr":"172.21.15.32:6807","nonce":587888964}]},"public_addr":"172.21.15.32:6801/587888964","cluster_addr":"172.21.15.32:6803/587888964","heartbeat_back_addr":"172.21.15.32:6810/587888964","heartbeat_front_addr":"172.21.15.32:6807/587888964","state":["exists","up"]},{"osd":1,"uuid":"2ecb1008-b987-4ce7-b646-6cded55fc8d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":990576767},{"type":"v1","addr":"172.21.15.32:6817","nonce":990576767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":990576767},{"type":"v1","addr":"172.21.15.32:6819","nonce":990576767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":990576767},{"type":"v1","addr":"172.21.15.32:6823","nonce":990576767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":990576767},{"type":"v1","addr":"172.21.15.32:6821","nonce":990576767}]},"public_addr":"172.21.15.32:6817/990576767","cluster_addr":"172.21.15.32:6819/990576767","heartbeat_back_addr":"172.21.15.32:6823/990576767","heartbeat_front_addr":"172.21.15.32:6821/990576767","state":["exists","up"]},{"osd":2,"uuid":"1b131c94-c09b-4e80-8746-bf1b7bac362d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6824","nonce":1566874440},{"type":"v1","addr":"172.21.15.32:6825","nonce":1566874440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":1566874440},{"type":"v1","addr":"172.21.15.32:6827","nonce":1566874440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":1566874440},{"type":"v1","addr":"172.21.15.32:6831","nonce":1566874440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":1566874440},{"type":"v1","addr":"172.21.15.32:6829","nonce":1566874440}]},"public_addr":"172.21.15.32:6825/1566874440","cluster_addr":"172.21.15.32:6827/1566874440","heartbeat_back_addr":"172.21.15.32:6831/1566874440","heartbeat_front_addr":"172.21.15.32:6829/1566874440","state":["exists","up"]},{"osd":3,"uuid":"ad655af2-1f6f-4689-b21d-b07bbaeb68b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":3672614802},{"type":"v1","addr":"172.21.15.32:6806","nonce":3672614802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6809","nonce":3672614802},{"type":"v1","addr":"172.21.15.32:6811","nonce":3672614802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":3672614802},{"type":"v1","addr":"172.21.15.32:6815","nonce":3672614802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":3672614802},{"type":"v1","addr":"172.21.15.32:6813","nonce":3672614802}]},"public_addr":"172.21.15.32:6806/3672614802","cluster_addr":"172.21.15.32:6811/3672614802","heartbeat_back_addr":"172.21.15.32:6815/3672614802","heartbeat_front_addr":"172.21.15.32:6813/3672614802","state":["exists","up"]},{"osd":4,"uuid":"64a543a1-8c4f-458e-9aba-b35c1cd7dd03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":3369928244},{"type":"v1","addr":"172.21.15.40:6801","nonce":3369928244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":3369928244},{"type":"v1","addr":"172.21.15.40:6803","nonce":3369928244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":3369928244},{"type":"v1","addr":"172.21.15.40:6807","nonce":3369928244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":3369928244},{"type":"v1","addr":"172.21.15.40:6805","nonce":3369928244}]},"public_addr":"172.21.15.40:6801/3369928244","cluster_addr":"172.21.15.40:6803/3369928244","heartbeat_back_addr":"172.21.15.40:6807/3369928244","heartbeat_front_addr":"172.21.15.40:6805/3369928244","state":["exists","up"]},{"osd":5,"uuid":"0fef3e54-edb4-4678-878e-944663c51638","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":2395850297},{"type":"v1","addr":"172.21.15.40:6825","nonce":2395850297}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":2395850297},{"type":"v1","addr":"172.21.15.40:6827","nonce":2395850297}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":2395850297},{"type":"v1","addr":"172.21.15.40:6831","nonce":2395850297}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":2395850297},{"type":"v1","addr":"172.21.15.40:6829","nonce":2395850297}]},"public_addr":"172.21.15.40:6825/2395850297","cluster_addr":"172.21.15.40:6827/2395850297","heartbeat_back_addr":"172.21.15.40:6831/2395850297","heartbeat_front_addr":"172.21.15.40:6829/2395850297","state":["exists","up"]},{"osd":6,"uuid":"2eeb0472-6096-469d-9b2c-cab4bf41c31a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":4145283410},{"type":"v1","addr":"172.21.15.40:6809","nonce":4145283410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":4145283410},{"type":"v1","addr":"172.21.15.40:6811","nonce":4145283410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":4145283410},{"type":"v1","addr":"172.21.15.40:6815","nonce":4145283410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":4145283410},{"type":"v1","addr":"172.21.15.40:6813","nonce":4145283410}]},"public_addr":"172.21.15.40:6809/4145283410","cluster_addr":"172.21.15.40:6811/4145283410","heartbeat_back_addr":"172.21.15.40:6815/4145283410","heartbeat_front_addr":"172.21.15.40:6813/4145283410","state":["exists","up"]},{"osd":7,"uuid":"cf76e4c7-96a6-401f-a280-91aad4641940","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":2943297416},{"type":"v1","addr":"172.21.15.40:6817","nonce":2943297416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":2943297416},{"type":"v1","addr":"172.21.15.40:6819","nonce":2943297416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":2943297416},{"type":"v1","addr":"172.21.15.40:6823","nonce":2943297416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":2943297416},{"type":"v1","addr":"172.21.15.40:6821","nonce":2943297416}]},"public_addr":"172.21.15.40:6817/2943297416","cluster_addr":"172.21.15.40:6819/2943297416","heartbeat_back_addr":"172.21.15.40:6823/2943297416","heartbeat_front_addr":"172.21.15.40:6821/2943297416","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.411475+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.628841+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.599055+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.166100+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.384135+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.488403+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.307648+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.363541+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":3,"to":2}]},{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"3.39","mappings":[{"from":7,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T06:10:25.353 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:25.351+0000 7f332e882700 1 -- 172.21.15.32:0/3074598361 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f330c066510 msgr2=0x7f330c0689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:25.354 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:25.351+0000 7f332e882700 1 --2- 172.21.15.32:0/3074598361 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f330c066510 0x7f330c0689d0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f3324006f80 tx=0x7f3324008030 comp rx=0 tx=0).stop 2023-10-08T06:10:25.354 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:25.351+0000 7f332e882700 1 -- 172.21.15.32:0/3074598361 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f33281580b0 msgr2=0x7f332815a970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:25.354 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:25.351+0000 7f332e882700 1 --2- 172.21.15.32:0/3074598361 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f33281580b0 0x7f332815a970 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f331800c700 tx=0x7f331800ca10 comp rx=0 tx=0).stop 2023-10-08T06:10:25.354 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:25.351+0000 7f332e882700 1 -- 172.21.15.32:0/3074598361 shutdown_connections 2023-10-08T06:10:25.354 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:25.351+0000 7f332e882700 1 --2- 172.21.15.32:0/3074598361 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f330c066510 0x7f330c0689d0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:25.354 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:25.351+0000 7f332e882700 1 --2- 172.21.15.32:0/3074598361 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f33281580b0 0x7f332815a970 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:25.354 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:25.351+0000 7f332e882700 1 --2- 172.21.15.32:0/3074598361 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3328158c30 0x7f33280ac8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:25.354 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:25.351+0000 7f332e882700 1 --2- 172.21.15.32:0/3074598361 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f33280b4b80 0x7f33280b3f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:25.354 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:25.351+0000 7f332e882700 1 -- 172.21.15.32:0/3074598361 >> 172.21.15.32:0/3074598361 conn(0x7f33280cf470 msgr2=0x7f33280c9ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:10:25.354 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:25.351+0000 7f332e882700 1 -- 172.21.15.32:0/3074598361 shutdown_connections 2023-10-08T06:10:25.355 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:25.351+0000 7f332e882700 1 -- 172.21.15.32:0/3074598361 wait complete. 2023-10-08T06:10:25.367 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-08T06:10:25.478 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:25.475+0000 7f1abaa3e700 1 Processor -- start 2023-10-08T06:10:25.478 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:25.475+0000 7f1abaa3e700 1 -- start start 2023-10-08T06:10:25.480 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:25.475+0000 7f1abaa3e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1ab415d490 0x7f1ab40b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:25.480 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:25.475+0000 7f1abaa3e700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f1ab40d13d0 0x7f1ab40cddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:25.480 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:25.475+0000 7f1abaa3e700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ab40ce770 con 0x7f1ab40ce310 2023-10-08T06:10:25.480 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:25.475+0000 7f1abaa3e700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ab40d1bb0 con 0x7f1ab40d13d0 2023-10-08T06:10:25.480 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:25.475+0000 7f1abaa3e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ab40d1e90 con 0x7f1ab415d490 2023-10-08T06:10:25.480 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:25.479+0000 7f1aba23d700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f1ab40ce310 0x7f1ab40b4a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:38190/0 (socket says 172.21.15.32:38190) 2023-10-08T06:10:25.481 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:25.479+0000 7f1aba23d700 1 -- 172.21.15.32:0/1495286061 learned_addr learned my addr 172.21.15.32:0/1495286061 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-08T06:10:25.481 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:25.479+0000 7f1ab9a3c700 1 --2- 172.21.15.32:0/1495286061 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1ab415d490 0x7f1ab40b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:25.481 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:25.479+0000 7f1ab923b700 1 --2- 172.21.15.32:0/1495286061 >> v2:172.21.15.40:3300/0 conn(0x7f1ab40d13d0 0x7f1ab40cddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:25.481 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:25.479+0000 7f1ab8a3a700 1 -- 172.21.15.32:0/1495286061 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 208486078 0 0) 0x7f1ab40ce770 con 0x7f1ab40ce310 2023-10-08T06:10:25.481 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:25.479+0000 7f1ab8a3a700 1 -- 172.21.15.32:0/1495286061 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1aa00035d0 con 0x7f1ab40ce310 2023-10-08T06:10:25.482 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:25.479+0000 7f1ab9a3c700 1 -- 172.21.15.32:0/1495286061 >> v2:172.21.15.40:3300/0 conn(0x7f1ab40d13d0 msgr2=0x7f1ab40cddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:10:25.482 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:25.479+0000 7f1ab9a3c700 1 --2- 172.21.15.32:0/1495286061 >> v2:172.21.15.40:3300/0 conn(0x7f1ab40d13d0 0x7f1ab40cddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:25.482 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:25.479+0000 7f1ab9a3c700 1 -- 172.21.15.32:0/1495286061 >> v1:172.21.15.32:6789/0 conn(0x7f1ab40ce310 legacy=0x7f1ab40b4a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:25.482 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:25.479+0000 7f1ab9a3c700 1 -- 172.21.15.32:0/1495286061 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ab40d2170 con 0x7f1ab415d490 2023-10-08T06:10:25.482 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:25.479+0000 7f1ab9a3c700 1 --2- 172.21.15.32:0/1495286061 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1ab415d490 0x7f1ab40b8bc0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f1ab0009850 tx=0x7f1ab0009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a0f50028e5e9777f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:25.482 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:25.479+0000 7f1ab8a3a700 1 -- 172.21.15.32:0/1495286061 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ab0011830 con 0x7f1ab415d490 2023-10-08T06:10:25.482 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:25.479+0000 7f1ab8a3a700 1 -- 172.21.15.32:0/1495286061 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ab0011990 con 0x7f1ab415d490 2023-10-08T06:10:25.483 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:25.479+0000 7f1ab8a3a700 1 -- 172.21.15.32:0/1495286061 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ab0011d40 con 0x7f1ab415d490 2023-10-08T06:10:25.483 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:25.479+0000 7f1abaa3e700 1 -- 172.21.15.32:0/1495286061 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1ab415d490 msgr2=0x7f1ab40b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:25.483 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:25.479+0000 7f1abaa3e700 1 --2- 172.21.15.32:0/1495286061 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1ab415d490 0x7f1ab40b8bc0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f1ab0009850 tx=0x7f1ab0009b60 comp rx=0 tx=0).stop 2023-10-08T06:10:25.484 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:25.479+0000 7f1abaa3e700 1 -- 172.21.15.32:0/1495286061 shutdown_connections 2023-10-08T06:10:25.484 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:25.479+0000 7f1abaa3e700 1 --2- 172.21.15.32:0/1495286061 >> v2:172.21.15.40:3300/0 conn(0x7f1ab40d13d0 0x7f1ab40cddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:25.484 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:25.479+0000 7f1abaa3e700 1 --2- 172.21.15.32:0/1495286061 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1ab415d490 0x7f1ab40b8bc0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:25.484 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:25.479+0000 7f1abaa3e700 1 -- 172.21.15.32:0/1495286061 >> 172.21.15.32:0/1495286061 conn(0x7f1ab406ab40 msgr2=0x7f1ab406af20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:10:25.484 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:25.479+0000 7f1abaa3e700 1 -- 172.21.15.32:0/1495286061 shutdown_connections 2023-10-08T06:10:25.484 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:25.479+0000 7f1abaa3e700 1 -- 172.21.15.32:0/1495286061 wait complete. 2023-10-08T06:10:25.485 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:25.483+0000 7f1abaa3e700 1 Processor -- start 2023-10-08T06:10:25.485 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:25.483+0000 7f1abaa3e700 1 -- start start 2023-10-08T06:10:25.486 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:25.483+0000 7f1abaa3e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1ab40ce310 0x7f1ab41f24f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:25.487 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:25.483+0000 7f1abaa3e700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1ab40d13d0 0x7f1ab40b6460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:25.487 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:25.483+0000 7f1abaa3e700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1ab415d490 0x7f1ab415bef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:25.487 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:25.483+0000 7f1abaa3e700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ab415dda0 con 0x7f1ab40d13d0 2023-10-08T06:10:25.487 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:25.483+0000 7f1abaa3e700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ab415e080 con 0x7f1ab415d490 2023-10-08T06:10:25.487 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:25.483+0000 7f1abaa3e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ab415e360 con 0x7f1ab40ce310 2023-10-08T06:10:25.487 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:25.483+0000 7f1ab923b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1ab40d13d0 0x7f1ab40b6460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:25.487 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:25.483+0000 7f1ab9a3c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1ab40ce310 0x7f1ab41f24f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:25.487 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:25.483+0000 7f1ab923b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1ab40d13d0 0x7f1ab40b6460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:56096/0 (socket says 172.21.15.32:56096) 2023-10-08T06:10:25.487 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:25.483+0000 7f1aba23d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1ab415d490 0x7f1ab415bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:25.488 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:25.483+0000 7f1ab923b700 1 -- 172.21.15.32:0/1864844290 learned_addr learned my addr 172.21.15.32:0/1864844290 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:10:25.489 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:25.483+0000 7f1ab923b700 1 -- 172.21.15.32:0/1864844290 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1ab40ce310 msgr2=0x7f1ab41f24f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:25.489 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:25.483+0000 7f1ab923b700 1 --2- 172.21.15.32:0/1864844290 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1ab40ce310 0x7f1ab41f24f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:25.489 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:25.483+0000 7f1ab923b700 1 -- 172.21.15.32:0/1864844290 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1ab415d490 msgr2=0x7f1ab415bef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:25.489 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:25.483+0000 7f1ab923b700 1 --2- 172.21.15.32:0/1864844290 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1ab415d490 0x7f1ab415bef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:25.489 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:25.483+0000 7f1ab923b700 1 -- 172.21.15.32:0/1864844290 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ab00094b0 con 0x7f1ab40d13d0 2023-10-08T06:10:25.489 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:25.487+0000 7f1ab923b700 1 --2- 172.21.15.32:0/1864844290 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1ab40d13d0 0x7f1ab40b6460 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f1aa400e9d0 tx=0x7f1aa400ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:25.489 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:25.487+0000 7f1aaa7fc700 1 -- 172.21.15.32:0/1864844290 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aa4009720 con 0x7f1ab40d13d0 2023-10-08T06:10:25.489 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:25.487+0000 7f1aaa7fc700 1 -- 172.21.15.32:0/1864844290 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1aa400ee70 con 0x7f1ab40d13d0 2023-10-08T06:10:25.489 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:25.487+0000 7f1abaa3e700 1 -- 172.21.15.32:0/1864844290 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ab415e640 con 0x7f1ab40d13d0 2023-10-08T06:10:25.490 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:25.487+0000 7f1aaa7fc700 1 -- 172.21.15.32:0/1864844290 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aa400ca50 con 0x7f1ab40d13d0 2023-10-08T06:10:25.490 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:25.487+0000 7f1abaa3e700 1 -- 172.21.15.32:0/1864844290 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ab41f2a30 con 0x7f1ab40d13d0 2023-10-08T06:10:25.490 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:25.487+0000 7f1abaa3e700 1 -- 172.21.15.32:0/1864844290 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ab40b5d00 con 0x7f1ab40d13d0 2023-10-08T06:10:25.490 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:25.487+0000 7f1aaa7fc700 1 -- 172.21.15.32:0/1864844290 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f1aa400cbb0 con 0x7f1ab40d13d0 2023-10-08T06:10:25.491 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:25.487+0000 7f1aaa7fc700 1 --2- 172.21.15.32:0/1864844290 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f1a98066510 0x7f1a980689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:25.491 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:25.487+0000 7f1aaa7fc700 1 -- 172.21.15.32:0/1864844290 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f1aa4083ea0 con 0x7f1ab40d13d0 2023-10-08T06:10:25.491 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:25.487+0000 7f1ab9a3c700 1 --2- 172.21.15.32:0/1864844290 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f1a98066510 0x7f1a980689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:25.492 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:25.491+0000 7f1ab9a3c700 1 --2- 172.21.15.32:0/1864844290 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f1a98066510 0x7f1a980689d0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f1ab00090b0 tx=0x7f1ab001c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:25.501 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:25.499+0000 7f1aaa7fc700 1 -- 172.21.15.32:0/1864844290 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f1aa40512b0 con 0x7f1ab40d13d0 2023-10-08T06:10:25.702 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:25.699+0000 7f1abaa3e700 1 -- 172.21.15.32:0/1864844290 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f1ab4073f00 con 0x7f1ab40d13d0 2023-10-08T06:10:25.704 INFO:tasks.ceph.mon.a.smithi032.stderr:2023-10-08T06:10:25.703+0000 7ff282a67700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-08T06:10:25.707 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:25.703+0000 7f1aaa7fc700 1 -- 172.21.15.32:0/1864844290 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v7) v1 ==== 161+0+0 (secure 0 0 0) 0x7f1aa400ce60 con 0x7f1ab40d13d0 2023-10-08T06:10:25.710 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:25.707+0000 7f1abaa3e700 1 -- 172.21.15.32:0/1864844290 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f1a98066510 msgr2=0x7f1a980689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:25.710 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:25.707+0000 7f1abaa3e700 1 --2- 172.21.15.32:0/1864844290 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f1a98066510 0x7f1a980689d0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f1ab00090b0 tx=0x7f1ab001c040 comp rx=0 tx=0).stop 2023-10-08T06:10:25.711 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:25.707+0000 7f1abaa3e700 1 -- 172.21.15.32:0/1864844290 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1ab40d13d0 msgr2=0x7f1ab40b6460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:25.711 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:25.707+0000 7f1abaa3e700 1 --2- 172.21.15.32:0/1864844290 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1ab40d13d0 0x7f1ab40b6460 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f1aa400e9d0 tx=0x7f1aa400ece0 comp rx=0 tx=0).stop 2023-10-08T06:10:25.711 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:25.707+0000 7f1abaa3e700 1 -- 172.21.15.32:0/1864844290 shutdown_connections 2023-10-08T06:10:25.711 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:25.707+0000 7f1abaa3e700 1 --2- 172.21.15.32:0/1864844290 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f1a98066510 0x7f1a980689d0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:25.711 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:25.707+0000 7f1abaa3e700 1 --2- 172.21.15.32:0/1864844290 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1ab40d13d0 0x7f1ab40b6460 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:25.711 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:25.707+0000 7f1abaa3e700 1 --2- 172.21.15.32:0/1864844290 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1ab415d490 0x7f1ab415bef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:25.711 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:25.707+0000 7f1abaa3e700 1 --2- 172.21.15.32:0/1864844290 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1ab40ce310 0x7f1ab41f24f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:25.711 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:25.707+0000 7f1abaa3e700 1 -- 172.21.15.32:0/1864844290 >> 172.21.15.32:0/1864844290 conn(0x7f1ab406ab40 msgr2=0x7f1ab415b300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:10:25.711 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:25.707+0000 7f1abaa3e700 1 -- 172.21.15.32:0/1864844290 shutdown_connections 2023-10-08T06:10:25.711 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:25.707+0000 7f1abaa3e700 1 -- 172.21.15.32:0/1864844290 wait complete. 2023-10-08T06:10:25.712 INFO:teuthology.orchestra.run.smithi032.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-08T06:10:25.718 INFO:tasks.ceph.mds.b.smithi040.stderr: -2857> 2023-10-08T06:09:40.711+0000 7f8059b9e700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-08T06:10:25.724 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-08T06:10:25.752 INFO:tasks.ceph.mds.b.smithi040.stdout:starting mds.b at 2023-10-08T06:10:25.846 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:25.843+0000 7feae4f11700 1 Processor -- start 2023-10-08T06:10:25.846 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:25.843+0000 7feae4f11700 1 -- start start 2023-10-08T06:10:25.848 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:25.843+0000 7feae4f11700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7feae00ce4e0 0x7feae0167e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:25.848 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:25.843+0000 7feae4f11700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feae00b9000 con 0x7feae015d490 2023-10-08T06:10:25.848 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:25.843+0000 7feae4f11700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feae00d1bb0 con 0x7feae00b8bc0 2023-10-08T06:10:25.848 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:25.843+0000 7feae4f11700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feae00d1e90 con 0x7feae00ce4e0 2023-10-08T06:10:25.848 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:25.843+0000 7feadf7fe700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7feae015d490 0x7feae00d13d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:38200/0 (socket says 172.21.15.32:38200) 2023-10-08T06:10:25.848 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:25.843+0000 7feadf7fe700 1 -- 172.21.15.32:0/3075056069 learned_addr learned my addr 172.21.15.32:0/3075056069 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-08T06:10:25.848 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:25.847+0000 7feadffff700 1 --2- 172.21.15.32:0/3075056069 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7feae00ce4e0 0x7feae0167e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:25.849 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:25.847+0000 7feadeffd700 1 -- 172.21.15.32:0/3075056069 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2291339638 0 0) 0x7fead0001110 con 0x7feae015d490 2023-10-08T06:10:25.849 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:25.847+0000 7feadeffd700 1 -- 172.21.15.32:0/3075056069 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feacc0035d0 con 0x7feae015d490 2023-10-08T06:10:25.850 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:25.847+0000 7feadffff700 1 -- 172.21.15.32:0/3075056069 >> v1:172.21.15.40:6789/0 conn(0x7feae00b8bc0 legacy=0x7feae00cddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:25.850 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:25.847+0000 7feadeffd700 1 -- 172.21.15.32:0/3075056069 <== mon.1 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1198243214 0 0) 0x7feae00d1bb0 con 0x7feae00b8bc0 2023-10-08T06:10:25.850 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:25.847+0000 7feadffff700 1 -- 172.21.15.32:0/3075056069 >> v1:172.21.15.32:6789/0 conn(0x7feae015d490 legacy=0x7feae00d13d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:25.851 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:25.847+0000 7feadffff700 1 -- 172.21.15.32:0/3075056069 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feae00d2170 con 0x7feae00ce4e0 2023-10-08T06:10:25.851 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:25.847+0000 7feadffff700 1 --2- 172.21.15.32:0/3075056069 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7feae00ce4e0 0x7feae0167e20 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fead8009dc0 tx=0x7fead800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ea6f58383e57eacb server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:25.851 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:25.847+0000 7feadeffd700 1 -- 172.21.15.32:0/3075056069 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fead800e070 con 0x7feae00ce4e0 2023-10-08T06:10:25.851 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:25.847+0000 7feadeffd700 1 -- 172.21.15.32:0/3075056069 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fead800bb20 con 0x7feae00ce4e0 2023-10-08T06:10:25.851 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:25.847+0000 7feadeffd700 1 -- 172.21.15.32:0/3075056069 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fead800bed0 con 0x7feae00ce4e0 2023-10-08T06:10:25.851 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:25.847+0000 7feae4f11700 1 -- 172.21.15.32:0/3075056069 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7feae00ce4e0 msgr2=0x7feae0167e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:25.851 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:25.847+0000 7feae4f11700 1 --2- 172.21.15.32:0/3075056069 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7feae00ce4e0 0x7feae0167e20 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fead8009dc0 tx=0x7fead800b330 comp rx=0 tx=0).stop 2023-10-08T06:10:25.851 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:25.847+0000 7feae4f11700 1 -- 172.21.15.32:0/3075056069 shutdown_connections 2023-10-08T06:10:25.851 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:25.847+0000 7feae4f11700 1 --2- 172.21.15.32:0/3075056069 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7feae00ce4e0 0x7feae0167e20 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:25.851 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:25.847+0000 7feae4f11700 1 -- 172.21.15.32:0/3075056069 >> 172.21.15.32:0/3075056069 conn(0x7feae006ab40 msgr2=0x7feae006af20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:10:25.852 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:25.847+0000 7feae4f11700 1 -- 172.21.15.32:0/3075056069 shutdown_connections 2023-10-08T06:10:25.852 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:25.847+0000 7feae4f11700 1 -- 172.21.15.32:0/3075056069 wait complete. 2023-10-08T06:10:25.852 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:25.851+0000 7feae4f11700 1 Processor -- start 2023-10-08T06:10:25.852 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:25.851+0000 7feae4f11700 1 -- start start 2023-10-08T06:10:25.854 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:25.851+0000 7feae4f11700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7feae00b8bc0 0x7feae00cc350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:25.855 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:25.851+0000 7feae4f11700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7feae00ce4e0 0x7feae014e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:25.855 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:25.851+0000 7feae4f11700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feae015d490 0x7feae01601f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:25.855 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:25.851+0000 7feae4f11700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feae00cb360 con 0x7feae00ce4e0 2023-10-08T06:10:25.855 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:25.851+0000 7feae4f11700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feae015dca0 con 0x7feae015d490 2023-10-08T06:10:25.855 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:25.851+0000 7feae4f11700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feae014ec20 con 0x7feae00b8bc0 2023-10-08T06:10:25.855 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:25.851+0000 7fead6ffd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7feae00ce4e0 0x7feae014e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:25.855 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:25.851+0000 7fead6ffd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7feae00ce4e0 0x7feae014e6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:56110/0 (socket says 172.21.15.32:56110) 2023-10-08T06:10:25.855 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:25.851+0000 7feadf7fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7feae00b8bc0 0x7feae00cc350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:25.855 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:25.851+0000 7fead6ffd700 1 -- 172.21.15.32:0/3784115387 learned_addr learned my addr 172.21.15.32:0/3784115387 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:10:25.855 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:25.851+0000 7feadffff700 1 --2- 172.21.15.32:0/3784115387 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feae015d490 0x7feae01601f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:25.856 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:25.851+0000 7fead6ffd700 1 -- 172.21.15.32:0/3784115387 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7feae00b8bc0 msgr2=0x7feae00cc350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:25.856 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:25.851+0000 7fead6ffd700 1 --2- 172.21.15.32:0/3784115387 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7feae00b8bc0 0x7feae00cc350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:25.856 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:25.851+0000 7fead6ffd700 1 -- 172.21.15.32:0/3784115387 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feae015d490 msgr2=0x7feae01601f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:25.856 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:25.851+0000 7fead6ffd700 1 --2- 172.21.15.32:0/3784115387 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feae015d490 0x7feae01601f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:25.856 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:25.851+0000 7fead6ffd700 1 -- 172.21.15.32:0/3784115387 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fead8009a70 con 0x7feae00ce4e0 2023-10-08T06:10:25.856 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:25.851+0000 7fead6ffd700 1 --2- 172.21.15.32:0/3784115387 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7feae00ce4e0 0x7feae014e6e0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7feac800c540 tx=0x7feac800c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:25.857 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:25.851+0000 7feadcff9700 1 -- 172.21.15.32:0/3784115387 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feac80054e0 con 0x7feae00ce4e0 2023-10-08T06:10:25.857 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:25.851+0000 7feadcff9700 1 -- 172.21.15.32:0/3784115387 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feac80036a0 con 0x7feae00ce4e0 2023-10-08T06:10:25.857 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:25.851+0000 7feae4f11700 1 -- 172.21.15.32:0/3784115387 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feae015d8e0 con 0x7feae00ce4e0 2023-10-08T06:10:25.857 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:25.851+0000 7feadcff9700 1 -- 172.21.15.32:0/3784115387 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feac8003a50 con 0x7feae00ce4e0 2023-10-08T06:10:25.858 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:25.851+0000 7feae4f11700 1 -- 172.21.15.32:0/3784115387 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feae00ccc40 con 0x7feae00ce4e0 2023-10-08T06:10:25.858 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:25.855+0000 7feae4f11700 1 -- 172.21.15.32:0/3784115387 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feae0073f00 con 0x7feae00ce4e0 2023-10-08T06:10:25.858 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:25.855+0000 7feadcff9700 1 -- 172.21.15.32:0/3784115387 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7feac8003bb0 con 0x7feae00ce4e0 2023-10-08T06:10:25.859 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:25.855+0000 7feadcff9700 1 --2- 172.21.15.32:0/3784115387 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7feac0066510 0x7feac00689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:25.859 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:25.855+0000 7feadcff9700 1 -- 172.21.15.32:0/3784115387 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5911+0+0 (secure 0 0 0) 0x7feac8083310 con 0x7feae00ce4e0 2023-10-08T06:10:25.859 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:25.855+0000 7feadf7fe700 1 --2- 172.21.15.32:0/3784115387 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7feac0066510 0x7feac00689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:25.859 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:25.855+0000 7feadf7fe700 1 --2- 172.21.15.32:0/3784115387 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7feac0066510 0x7feac00689d0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fead0005930 tx=0x7fead0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:25.866 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:25.863+0000 7feadcff9700 1 -- 172.21.15.32:0/3784115387 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7feac80506d0 con 0x7feae00ce4e0 2023-10-08T06:10:26.064 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:26.063+0000 7feae4f11700 1 -- 172.21.15.32:0/3784115387 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7feae00d0050 con 0x7feae00ce4e0 2023-10-08T06:10:26.710 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:26.707+0000 7feadcff9700 1 -- 172.21.15.32:0/3784115387 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v8) v1 ==== 104+0+0 (secure 0 0 0) 0x7feac8070e60 con 0x7feae00ce4e0 2023-10-08T06:10:26.715 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:26.711+0000 7feae4f11700 1 -- 172.21.15.32:0/3784115387 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7feac0066510 msgr2=0x7feac00689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:26.715 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:26.711+0000 7feae4f11700 1 --2- 172.21.15.32:0/3784115387 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7feac0066510 0x7feac00689d0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fead0005930 tx=0x7fead0009040 comp rx=0 tx=0).stop 2023-10-08T06:10:26.715 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:26.711+0000 7feae4f11700 1 -- 172.21.15.32:0/3784115387 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7feae00ce4e0 msgr2=0x7feae014e6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:26.715 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:26.711+0000 7feae4f11700 1 --2- 172.21.15.32:0/3784115387 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7feae00ce4e0 0x7feae014e6e0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7feac800c540 tx=0x7feac800c850 comp rx=0 tx=0).stop 2023-10-08T06:10:26.716 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:26.711+0000 7feae4f11700 1 -- 172.21.15.32:0/3784115387 shutdown_connections 2023-10-08T06:10:26.716 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:26.711+0000 7feae4f11700 1 --2- 172.21.15.32:0/3784115387 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7feac0066510 0x7feac00689d0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:26.716 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:26.711+0000 7feae4f11700 1 --2- 172.21.15.32:0/3784115387 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7feae00ce4e0 0x7feae014e6e0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:26.716 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:26.711+0000 7feae4f11700 1 --2- 172.21.15.32:0/3784115387 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feae015d490 0x7feae01601f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:26.716 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:26.711+0000 7feae4f11700 1 --2- 172.21.15.32:0/3784115387 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7feae00b8bc0 0x7feae00cc350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:26.716 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:26.711+0000 7feae4f11700 1 -- 172.21.15.32:0/3784115387 >> 172.21.15.32:0/3784115387 conn(0x7feae006ab40 msgr2=0x7feae015b180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:10:26.717 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:26.711+0000 7feae4f11700 1 -- 172.21.15.32:0/3784115387 shutdown_connections 2023-10-08T06:10:26.717 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:26.715+0000 7feae4f11700 1 -- 172.21.15.32:0/3784115387 wait complete. 2023-10-08T06:10:26.734 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-08T06:10:26.860 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:26.859+0000 7fa4d723c700 1 Processor -- start 2023-10-08T06:10:26.860 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:26.859+0000 7fa4d723c700 1 -- start start 2023-10-08T06:10:26.862 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:26.859+0000 7fa4d723c700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fa4d015f660 0x7fa4d00cb4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:26.862 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:26.859+0000 7fa4d723c700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4d015fb90 con 0x7fa4d00d0490 2023-10-08T06:10:26.862 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:26.859+0000 7fa4d723c700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4d00ceb70 con 0x7fa4d00b64b0 2023-10-08T06:10:26.862 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:26.859+0000 7fa4d723c700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4d00cf8f0 con 0x7fa4d015f660 2023-10-08T06:10:26.862 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:26.859+0000 7fa4d5a39700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fa4d00d0490 0x7fa4d015b600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:38206/0 (socket says 172.21.15.32:38206) 2023-10-08T06:10:26.862 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:26.859+0000 7fa4d5a39700 1 -- 172.21.15.32:0/1506605350 learned_addr learned my addr 172.21.15.32:0/1506605350 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-08T06:10:26.862 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:26.859+0000 7fa4d6a3b700 1 --2- 172.21.15.32:0/1506605350 >> v2:172.21.15.32:3300/0 conn(0x7fa4d015f660 0x7fa4d00cb4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:26.863 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:26.859+0000 7fa4d5238700 1 -- 172.21.15.32:0/1506605350 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3768173653 0 0) 0x7fa4d015fb90 con 0x7fa4d00d0490 2023-10-08T06:10:26.864 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:26.859+0000 7fa4d5238700 1 -- 172.21.15.32:0/1506605350 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa4bc0035d0 con 0x7fa4d00d0490 2023-10-08T06:10:26.864 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:26.859+0000 7fa4d6a3b700 1 -- 172.21.15.32:0/1506605350 >> v1:172.21.15.40:6789/0 conn(0x7fa4d00b64b0 legacy=0x7fa4d00cfd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:26.864 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:26.859+0000 7fa4d6a3b700 1 -- 172.21.15.32:0/1506605350 >> v1:172.21.15.32:6789/0 conn(0x7fa4d00d0490 legacy=0x7fa4d015b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:26.864 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:26.859+0000 7fa4d6a3b700 1 -- 172.21.15.32:0/1506605350 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4d00cee10 con 0x7fa4d015f660 2023-10-08T06:10:26.864 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:26.859+0000 7fa4d6a3b700 1 --2- 172.21.15.32:0/1506605350 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa4d015f660 0x7fa4d00cb4c0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fa4c8009d90 tx=0x7fa4c800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b837382381b8919 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:26.864 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:26.859+0000 7fa4d5238700 1 -- 172.21.15.32:0/1506605350 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4c800e070 con 0x7fa4d015f660 2023-10-08T06:10:26.864 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:26.859+0000 7fa4d5238700 1 -- 172.21.15.32:0/1506605350 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4c800bb20 con 0x7fa4d015f660 2023-10-08T06:10:26.864 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:26.859+0000 7fa4d5238700 1 -- 172.21.15.32:0/1506605350 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4c8012430 con 0x7fa4d015f660 2023-10-08T06:10:26.865 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:26.863+0000 7fa4d723c700 1 -- 172.21.15.32:0/1506605350 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa4d015f660 msgr2=0x7fa4d00cb4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:26.865 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:26.863+0000 7fa4d723c700 1 --2- 172.21.15.32:0/1506605350 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa4d015f660 0x7fa4d00cb4c0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fa4c8009d90 tx=0x7fa4c800b330 comp rx=0 tx=0).stop 2023-10-08T06:10:26.865 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:26.863+0000 7fa4d723c700 1 -- 172.21.15.32:0/1506605350 shutdown_connections 2023-10-08T06:10:26.865 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:26.863+0000 7fa4d723c700 1 --2- 172.21.15.32:0/1506605350 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa4d015f660 0x7fa4d00cb4c0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:26.866 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:26.863+0000 7fa4d723c700 1 -- 172.21.15.32:0/1506605350 >> 172.21.15.32:0/1506605350 conn(0x7fa4d006df60 msgr2=0x7fa4d006e370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:10:26.866 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:26.863+0000 7fa4d723c700 1 -- 172.21.15.32:0/1506605350 shutdown_connections 2023-10-08T06:10:26.866 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:26.863+0000 7fa4d723c700 1 -- 172.21.15.32:0/1506605350 wait complete. 2023-10-08T06:10:26.866 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:26.863+0000 7fa4d723c700 1 Processor -- start 2023-10-08T06:10:26.866 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:26.863+0000 7fa4d723c700 1 -- start start 2023-10-08T06:10:26.869 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:26.867+0000 7fa4d723c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa4d00b64b0 0x7fa4d01493a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:26.869 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:26.867+0000 7fa4d723c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa4d00d0490 0x7fa4d0148510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:26.869 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:26.867+0000 7fa4d723c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa4d015f660 0x7fa4d00ca110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:26.869 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:26.867+0000 7fa4d723c700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4d01498e0 con 0x7fa4d00b64b0 2023-10-08T06:10:26.869 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:26.867+0000 7fa4d723c700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4d0148a50 con 0x7fa4d015f660 2023-10-08T06:10:26.869 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:26.867+0000 7fa4d723c700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4d01f5120 con 0x7fa4d00d0490 2023-10-08T06:10:26.869 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:26.867+0000 7fa4d623a700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa4d00b64b0 0x7fa4d01493a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:26.869 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:26.867+0000 7fa4d623a700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa4d00b64b0 0x7fa4d01493a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:56128/0 (socket says 172.21.15.32:56128) 2023-10-08T06:10:26.870 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:26.867+0000 7fa4d623a700 1 -- 172.21.15.32:0/3475215984 learned_addr learned my addr 172.21.15.32:0/3475215984 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:10:26.870 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:26.867+0000 7fa4d5a39700 1 --2- 172.21.15.32:0/3475215984 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa4d00d0490 0x7fa4d0148510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:26.870 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:26.867+0000 7fa4d6a3b700 1 --2- 172.21.15.32:0/3475215984 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa4d015f660 0x7fa4d00ca110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:26.870 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:26.867+0000 7fa4d623a700 1 -- 172.21.15.32:0/3475215984 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa4d00d0490 msgr2=0x7fa4d0148510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:26.870 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:26.867+0000 7fa4d623a700 1 --2- 172.21.15.32:0/3475215984 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa4d00d0490 0x7fa4d0148510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:26.870 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:26.867+0000 7fa4d623a700 1 -- 172.21.15.32:0/3475215984 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa4d015f660 msgr2=0x7fa4d00ca110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:26.870 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:26.867+0000 7fa4d623a700 1 --2- 172.21.15.32:0/3475215984 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa4d015f660 0x7fa4d00ca110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:26.870 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:26.867+0000 7fa4d623a700 1 -- 172.21.15.32:0/3475215984 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4c8009a70 con 0x7fa4d00b64b0 2023-10-08T06:10:26.870 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:26.867+0000 7fa4d6a3b700 1 --2- 172.21.15.32:0/3475215984 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa4d015f660 0x7fa4d00ca110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T06:10:26.871 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:26.867+0000 7fa4d623a700 1 --2- 172.21.15.32:0/3475215984 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa4d00b64b0 0x7fa4d01493a0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fa4cc00c500 tx=0x7fa4cc00c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:26.871 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:26.867+0000 7fa4c6ffd700 1 -- 172.21.15.32:0/3475215984 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4cc0052d0 con 0x7fa4d00b64b0 2023-10-08T06:10:26.871 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:26.867+0000 7fa4d723c700 1 -- 172.21.15.32:0/3475215984 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4d01f45a0 con 0x7fa4d00b64b0 2023-10-08T06:10:26.872 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:26.867+0000 7fa4d723c700 1 -- 172.21.15.32:0/3475215984 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4d01f4b60 con 0x7fa4d00b64b0 2023-10-08T06:10:26.872 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:26.867+0000 7fa4c6ffd700 1 -- 172.21.15.32:0/3475215984 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4cc005430 con 0x7fa4d00b64b0 2023-10-08T06:10:26.872 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:26.867+0000 7fa4c6ffd700 1 -- 172.21.15.32:0/3475215984 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4cc0055a0 con 0x7fa4d00b64b0 2023-10-08T06:10:26.872 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:26.867+0000 7fa4d723c700 1 -- 172.21.15.32:0/3475215984 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4b8005310 con 0x7fa4d00b64b0 2023-10-08T06:10:26.873 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:26.871+0000 7fa4c6ffd700 1 -- 172.21.15.32:0/3475215984 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fa4cc0038e0 con 0x7fa4d00b64b0 2023-10-08T06:10:26.873 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:26.871+0000 7fa4c6ffd700 1 --2- 172.21.15.32:0/3475215984 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fa4b4066510 0x7fa4b40689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:26.873 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:26.871+0000 7fa4c6ffd700 1 -- 172.21.15.32:0/3475215984 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5911+0+0 (secure 0 0 0) 0x7fa4cc0833d0 con 0x7fa4d00b64b0 2023-10-08T06:10:26.874 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:26.871+0000 7fa4d5a39700 1 --2- 172.21.15.32:0/3475215984 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fa4b4066510 0x7fa4b40689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:26.874 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:26.871+0000 7fa4d5a39700 1 --2- 172.21.15.32:0/3475215984 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fa4b4066510 0x7fa4b40689d0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fa4d00b30c0 tx=0x7fa4c0007de0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:26.881 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:26.879+0000 7fa4c6ffd700 1 -- 172.21.15.32:0/3475215984 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fa4cc050700 con 0x7fa4d00b64b0 2023-10-08T06:10:27.048 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:27.047+0000 7fa4d723c700 1 -- 172.21.15.32:0/3475215984 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fa4b80055c0 con 0x7fa4d00b64b0 2023-10-08T06:10:27.721 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:27.719+0000 7fa4c6ffd700 1 -- 172.21.15.32:0/3475215984 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v26) v1 ==== 181+0+0 (secure 0 0 0) 0x7fa4cc053d20 con 0x7fa4d00b64b0 2023-10-08T06:10:27.724 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:27.723+0000 7fa4d723c700 1 -- 172.21.15.32:0/3475215984 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fa4b4066510 msgr2=0x7fa4b40689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:27.724 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:27.723+0000 7fa4d723c700 1 --2- 172.21.15.32:0/3475215984 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fa4b4066510 0x7fa4b40689d0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fa4d00b30c0 tx=0x7fa4c0007de0 comp rx=0 tx=0).stop 2023-10-08T06:10:27.725 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:27.723+0000 7fa4d723c700 1 -- 172.21.15.32:0/3475215984 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa4d00b64b0 msgr2=0x7fa4d01493a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:27.725 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:27.723+0000 7fa4d723c700 1 --2- 172.21.15.32:0/3475215984 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa4d00b64b0 0x7fa4d01493a0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fa4cc00c500 tx=0x7fa4cc00c810 comp rx=0 tx=0).stop 2023-10-08T06:10:27.725 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:27.723+0000 7fa4d723c700 1 -- 172.21.15.32:0/3475215984 shutdown_connections 2023-10-08T06:10:27.726 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:27.723+0000 7fa4d723c700 1 --2- 172.21.15.32:0/3475215984 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fa4b4066510 0x7fa4b40689d0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:27.726 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:27.723+0000 7fa4d723c700 1 --2- 172.21.15.32:0/3475215984 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa4d015f660 0x7fa4d00ca110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:27.726 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:27.723+0000 7fa4d723c700 1 --2- 172.21.15.32:0/3475215984 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa4d00d0490 0x7fa4d0148510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:27.726 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:27.723+0000 7fa4d723c700 1 --2- 172.21.15.32:0/3475215984 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa4d00b64b0 0x7fa4d01493a0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:27.726 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:27.723+0000 7fa4d723c700 1 -- 172.21.15.32:0/3475215984 >> 172.21.15.32:0/3475215984 conn(0x7fa4d006df60 msgr2=0x7fa4d00b0e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:10:27.726 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:27.723+0000 7fa4d723c700 1 -- 172.21.15.32:0/3475215984 shutdown_connections 2023-10-08T06:10:27.726 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:27.723+0000 7fa4d723c700 1 -- 172.21.15.32:0/3475215984 wait complete. 2023-10-08T06:10:27.730 INFO:teuthology.orchestra.run.smithi032.stderr:pool 'cephfs_metadata' removed 2023-10-08T06:10:27.746 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-08T06:10:27.867 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:27.863+0000 7f708099d700 1 Processor -- start 2023-10-08T06:10:27.867 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:27.863+0000 7f708099d700 1 -- start start 2023-10-08T06:10:27.869 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:27.867+0000 7f708099d700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f707c15b0e0 0x7f707c06acb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:27.869 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:27.867+0000 7f708099d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f707c0ca3a0 0x7f707c06cd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:27.869 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:27.867+0000 7f708099d700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f707c0cc530 con 0x7f707c06d2c0 2023-10-08T06:10:27.869 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:27.867+0000 7f708099d700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f707c06b290 con 0x7f707c15b0e0 2023-10-08T06:10:27.870 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:27.867+0000 7f708099d700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f707c15fb70 con 0x7f707c0ca3a0 2023-10-08T06:10:27.870 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:27.867+0000 7f707b59e700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f707c06d2c0 0x7f707c070d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:38218/0 (socket says 172.21.15.32:38218) 2023-10-08T06:10:27.870 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:27.867+0000 7f707b59e700 1 -- 172.21.15.32:0/1885983450 learned_addr learned my addr 172.21.15.32:0/1885983450 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-08T06:10:27.870 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:27.867+0000 7f707ad9d700 1 --2- 172.21.15.32:0/1885983450 >> v2:172.21.15.40:3300/0 conn(0x7f707c15b0e0 0x7f707c06acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:27.870 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:27.867+0000 7f707259c700 1 --2- 172.21.15.32:0/1885983450 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f707c0ca3a0 0x7f707c06cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:27.871 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:27.867+0000 7f707a59c700 1 -- 172.21.15.32:0/1885983450 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3314367595 0 0) 0x7f707c0cc530 con 0x7f707c06d2c0 2023-10-08T06:10:27.871 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:27.867+0000 7f707a59c700 1 -- 172.21.15.32:0/1885983450 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f70680035d0 con 0x7f707c06d2c0 2023-10-08T06:10:27.871 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:27.867+0000 7f707ad9d700 1 -- 172.21.15.32:0/1885983450 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f707c0ca3a0 msgr2=0x7f707c06cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:10:27.871 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:27.867+0000 7f707ad9d700 1 --2- 172.21.15.32:0/1885983450 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f707c0ca3a0 0x7f707c06cd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:27.871 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:27.867+0000 7f707ad9d700 1 -- 172.21.15.32:0/1885983450 >> v1:172.21.15.32:6789/0 conn(0x7f707c06d2c0 legacy=0x7f707c070d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:27.871 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:27.867+0000 7f707ad9d700 1 -- 172.21.15.32:0/1885983450 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f707c06be50 con 0x7f707c15b0e0 2023-10-08T06:10:27.872 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:27.867+0000 7f707ad9d700 1 --2- 172.21.15.32:0/1885983450 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f707c15b0e0 0x7f707c06acb0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f706c009850 tx=0x7f706c009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e4c4238dfee7add7 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:27.872 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:27.867+0000 7f707a59c700 1 -- 172.21.15.32:0/1885983450 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f706c011830 con 0x7f707c15b0e0 2023-10-08T06:10:27.872 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:27.867+0000 7f707a59c700 1 -- 172.21.15.32:0/1885983450 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f706c011990 con 0x7f707c15b0e0 2023-10-08T06:10:27.872 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:27.867+0000 7f707a59c700 1 -- 172.21.15.32:0/1885983450 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f706c011d00 con 0x7f707c15b0e0 2023-10-08T06:10:27.873 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:27.871+0000 7f708099d700 1 -- 172.21.15.32:0/1885983450 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f707c15b0e0 msgr2=0x7f707c06acb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:27.873 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:27.871+0000 7f708099d700 1 --2- 172.21.15.32:0/1885983450 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f707c15b0e0 0x7f707c06acb0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f706c009850 tx=0x7f706c009b60 comp rx=0 tx=0).stop 2023-10-08T06:10:27.873 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:27.871+0000 7f708099d700 1 -- 172.21.15.32:0/1885983450 shutdown_connections 2023-10-08T06:10:27.873 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:27.871+0000 7f708099d700 1 --2- 172.21.15.32:0/1885983450 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f707c0ca3a0 0x7f707c06cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:27.873 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:27.871+0000 7f708099d700 1 --2- 172.21.15.32:0/1885983450 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f707c15b0e0 0x7f707c06acb0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:27.873 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:27.871+0000 7f708099d700 1 -- 172.21.15.32:0/1885983450 >> 172.21.15.32:0/1885983450 conn(0x7f707c0cc7d0 msgr2=0x7f707c0ccbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:10:27.873 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:27.871+0000 7f708099d700 1 -- 172.21.15.32:0/1885983450 shutdown_connections 2023-10-08T06:10:27.873 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:27.871+0000 7f708099d700 1 -- 172.21.15.32:0/1885983450 wait complete. 2023-10-08T06:10:27.874 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:27.871+0000 7f708099d700 1 Processor -- start 2023-10-08T06:10:27.874 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:27.871+0000 7f708099d700 1 -- start start 2023-10-08T06:10:27.875 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:27.871+0000 7f708099d700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f707c06d2c0 0x7f707c150200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:27.876 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:27.871+0000 7f708099d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f707c0ca3a0 0x7f707c15d960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:27.876 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:27.871+0000 7f708099d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f707c15b0e0 0x7f707c15dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:27.876 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:27.871+0000 7f708099d700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f707c0c65a0 con 0x7f707c06d2c0 2023-10-08T06:10:27.876 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:27.871+0000 7f708099d700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f707c0c4290 con 0x7f707c0ca3a0 2023-10-08T06:10:27.876 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:27.871+0000 7f708099d700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f707c0c5920 con 0x7f707c15b0e0 2023-10-08T06:10:27.876 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:27.871+0000 7f707ad9d700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f707c06d2c0 0x7f707c150200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:27.876 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:27.871+0000 7f707ad9d700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f707c06d2c0 0x7f707c150200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:56136/0 (socket says 172.21.15.32:56136) 2023-10-08T06:10:27.876 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:27.871+0000 7f707ad9d700 1 -- 172.21.15.32:0/2319479480 learned_addr learned my addr 172.21.15.32:0/2319479480 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:10:27.876 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:27.875+0000 7f707259c700 1 --2- 172.21.15.32:0/2319479480 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f707c0ca3a0 0x7f707c15d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:27.877 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:27.875+0000 7f707b59e700 1 --2- 172.21.15.32:0/2319479480 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f707c15b0e0 0x7f707c15dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:27.878 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:27.875+0000 7f707ad9d700 1 -- 172.21.15.32:0/2319479480 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f707c15b0e0 msgr2=0x7f707c15dea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:27.878 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:27.875+0000 7f707ad9d700 1 --2- 172.21.15.32:0/2319479480 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f707c15b0e0 0x7f707c15dea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:27.878 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:27.875+0000 7f707ad9d700 1 -- 172.21.15.32:0/2319479480 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f707c0ca3a0 msgr2=0x7f707c15d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:27.878 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:27.875+0000 7f707ad9d700 1 --2- 172.21.15.32:0/2319479480 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f707c0ca3a0 0x7f707c15d960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:27.878 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:27.875+0000 7f707ad9d700 1 -- 172.21.15.32:0/2319479480 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f706c0094b0 con 0x7f707c06d2c0 2023-10-08T06:10:27.878 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:27.875+0000 7f707ad9d700 1 --2- 172.21.15.32:0/2319479480 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f707c06d2c0 0x7f707c150200 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f706c0090b0 tx=0x7f706c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:27.878 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:27.875+0000 7f7073fff700 1 -- 172.21.15.32:0/2319479480 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f706c0044d0 con 0x7f707c06d2c0 2023-10-08T06:10:27.878 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:27.875+0000 7f7073fff700 1 -- 172.21.15.32:0/2319479480 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f706c01f070 con 0x7f707c06d2c0 2023-10-08T06:10:27.878 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:27.875+0000 7f708099d700 1 -- 172.21.15.32:0/2319479480 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f707c0c5c00 con 0x7f707c06d2c0 2023-10-08T06:10:27.879 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:27.875+0000 7f7073fff700 1 -- 172.21.15.32:0/2319479480 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f706c003900 con 0x7f707c06d2c0 2023-10-08T06:10:27.879 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:27.875+0000 7f708099d700 1 -- 172.21.15.32:0/2319479480 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f707c0c61c0 con 0x7f707c06d2c0 2023-10-08T06:10:27.879 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:27.875+0000 7f708099d700 1 -- 172.21.15.32:0/2319479480 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f707c0c66e0 con 0x7f707c06d2c0 2023-10-08T06:10:27.880 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:27.879+0000 7f7073fff700 1 -- 172.21.15.32:0/2319479480 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f706c003a60 con 0x7f707c06d2c0 2023-10-08T06:10:27.880 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:27.879+0000 7f7073fff700 1 --2- 172.21.15.32:0/2319479480 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f705c066510 0x7f705c0689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:27.881 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:27.879+0000 7f7073fff700 1 -- 172.21.15.32:0/2319479480 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 5473+0+0 (secure 0 0 0) 0x7f706c021070 con 0x7f707c06d2c0 2023-10-08T06:10:27.881 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:27.879+0000 7f707259c700 1 --2- 172.21.15.32:0/2319479480 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f705c066510 0x7f705c0689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:27.881 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:27.879+0000 7f707259c700 1 --2- 172.21.15.32:0/2319479480 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f705c066510 0x7f705c0689d0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f707c0c5410 tx=0x7f7064009240 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:27.892 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:27.891+0000 7f7073fff700 1 -- 172.21.15.32:0/2319479480 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f707c0c66e0 con 0x7f707c06d2c0 2023-10-08T06:10:28.078 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:28.075+0000 7f708099d700 1 -- 172.21.15.32:0/2319479480 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f707c0c66e0 con 0x7f707c06d2c0 2023-10-08T06:10:28.723 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:28.719+0000 7f7073fff700 1 -- 172.21.15.32:0/2319479480 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v27) v1 ==== 169+0+0 (secure 0 0 0) 0x7f707c0c66e0 con 0x7f707c06d2c0 2023-10-08T06:10:28.728 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:28.727+0000 7f708099d700 1 -- 172.21.15.32:0/2319479480 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f705c066510 msgr2=0x7f705c0689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:28.728 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:28.727+0000 7f708099d700 1 --2- 172.21.15.32:0/2319479480 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f705c066510 0x7f705c0689d0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f707c0c5410 tx=0x7f7064009240 comp rx=0 tx=0).stop 2023-10-08T06:10:28.728 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:28.727+0000 7f708099d700 1 -- 172.21.15.32:0/2319479480 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f707c06d2c0 msgr2=0x7f707c150200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:28.728 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:28.727+0000 7f708099d700 1 --2- 172.21.15.32:0/2319479480 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f707c06d2c0 0x7f707c150200 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f706c0090b0 tx=0x7f706c004770 comp rx=0 tx=0).stop 2023-10-08T06:10:28.728 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:28.727+0000 7f708099d700 1 -- 172.21.15.32:0/2319479480 shutdown_connections 2023-10-08T06:10:28.729 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:28.727+0000 7f708099d700 1 --2- 172.21.15.32:0/2319479480 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f705c066510 0x7f705c0689d0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:28.729 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:28.727+0000 7f708099d700 1 --2- 172.21.15.32:0/2319479480 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f707c15b0e0 0x7f707c15dea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:28.729 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:28.727+0000 7f708099d700 1 --2- 172.21.15.32:0/2319479480 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f707c0ca3a0 0x7f707c15d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:28.729 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:28.727+0000 7f708099d700 1 --2- 172.21.15.32:0/2319479480 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f707c06d2c0 0x7f707c150200 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:28.729 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:28.727+0000 7f708099d700 1 -- 172.21.15.32:0/2319479480 >> 172.21.15.32:0/2319479480 conn(0x7f707c0cc7d0 msgr2=0x7f707c0b0f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:10:28.731 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:28.727+0000 7f708099d700 1 -- 172.21.15.32:0/2319479480 shutdown_connections 2023-10-08T06:10:28.731 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:28.727+0000 7f708099d700 1 -- 172.21.15.32:0/2319479480 wait complete. 2023-10-08T06:10:28.733 INFO:teuthology.orchestra.run.smithi032.stderr:pool 'cephfs_data' removed 2023-10-08T06:10:28.748 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-08T06:10:28.748 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-08T06:10:28.748 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-08T06:10:28.748 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T06:10:28.748 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-08T06:10:28.749 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-08T06:10:28.749 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-08T06:10:28.749 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T06:10:28.749 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-08T06:10:28.749 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-08T06:10:28.750 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-08T06:10:28.750 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T06:10:28.750 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-08T06:10:28.750 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-08T06:10:28.750 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-08T06:10:28.750 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T06:10:28.760 INFO:tasks.ceph.mds.a:Stopped 2023-10-08T06:10:28.760 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-08T06:10:28.761 INFO:tasks.ceph.mds.c:Stopped 2023-10-08T06:10:28.761 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-08T06:10:28.768 INFO:tasks.ceph.mds.d:Stopped 2023-10-08T06:10:28.768 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-08T06:10:28.771 INFO:tasks.ceph.mds.b:Stopped 2023-10-08T06:10:28.771 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-08T06:10:28.809 INFO:tasks.ceph.mds.a:Started 2023-10-08T06:10:28.809 DEBUG:teuthology.parallel:result is None 2023-10-08T06:10:28.810 INFO:tasks.ceph.mds.c:Started 2023-10-08T06:10:28.810 DEBUG:teuthology.parallel:result is None 2023-10-08T06:10:28.814 INFO:tasks.ceph.mds.d:Started 2023-10-08T06:10:28.815 DEBUG:teuthology.parallel:result is None 2023-10-08T06:10:28.815 INFO:tasks.ceph.mds.b:Started 2023-10-08T06:10:28.816 DEBUG:teuthology.parallel:result is None 2023-10-08T06:10:28.816 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-08T06:10:28.905 INFO:tasks.ceph.mds.d.smithi040.stdout:starting mds.d at 2023-10-08T06:10:28.907 INFO:tasks.ceph.mds.b.smithi040.stdout:starting mds.b at 2023-10-08T06:10:28.908 INFO:tasks.ceph.mds.c.smithi032.stdout:starting mds.c at 2023-10-08T06:10:28.932 INFO:tasks.ceph.mds.a.smithi032.stdout:starting mds.a at 2023-10-08T06:10:28.972 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~0s 2023-10-08T06:10:28.972 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~0s 2023-10-08T06:10:28.972 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~0s 2023-10-08T06:10:28.973 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:28.971+0000 7f2c4f4a4700 1 Processor -- start 2023-10-08T06:10:28.973 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:28.971+0000 7f2c4f4a4700 1 -- start start 2023-10-08T06:10:28.974 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:28.971+0000 7f2c4f4a4700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2c4815cee0 0x7f2c4806b840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:28.975 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:28.971+0000 7f2c4f4a4700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2c4815d2c0 0x7f2c4815d770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:28.975 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:28.971+0000 7f2c4f4a4700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c4806bd80 con 0x7f2c4806a2a0 2023-10-08T06:10:28.975 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:28.971+0000 7f2c4f4a4700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c4806a7a0 con 0x7f2c4815d2c0 2023-10-08T06:10:28.975 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:28.971+0000 7f2c4f4a4700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c4806aa80 con 0x7f2c4815cee0 2023-10-08T06:10:28.975 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:28.971+0000 7f2c4ca3f700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f2c4806a2a0 0x7f2c480cecd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:38238/0 (socket says 172.21.15.32:38238) 2023-10-08T06:10:28.975 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:28.971+0000 7f2c4ca3f700 1 -- 172.21.15.32:0/340138345 learned_addr learned my addr 172.21.15.32:0/340138345 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-08T06:10:28.975 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:28.971+0000 7f2c4d240700 1 --2- 172.21.15.32:0/340138345 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2c4815cee0 0x7f2c4806b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:28.975 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:28.971+0000 7f2c4da41700 1 --2- 172.21.15.32:0/340138345 >> v2:172.21.15.40:3300/0 conn(0x7f2c4815d2c0 0x7f2c4815d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:28.976 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:28.971+0000 7f2c3ffff700 1 -- 172.21.15.32:0/340138345 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4097648140 0 0) 0x7f2c4806bd80 con 0x7f2c4806a2a0 2023-10-08T06:10:28.976 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:28.971+0000 7f2c3ffff700 1 -- 172.21.15.32:0/340138345 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2c340035d0 con 0x7f2c4806a2a0 2023-10-08T06:10:28.977 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:28.971+0000 7f2c4da41700 1 -- 172.21.15.32:0/340138345 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2c4815cee0 msgr2=0x7f2c4806b840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:10:28.977 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:28.971+0000 7f2c4da41700 1 --2- 172.21.15.32:0/340138345 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2c4815cee0 0x7f2c4806b840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:28.977 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:28.971+0000 7f2c4da41700 1 -- 172.21.15.32:0/340138345 >> v1:172.21.15.32:6789/0 conn(0x7f2c4806a2a0 legacy=0x7f2c480cecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:28.977 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:28.971+0000 7f2c4da41700 1 -- 172.21.15.32:0/340138345 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c4806ad60 con 0x7f2c4815d2c0 2023-10-08T06:10:28.977 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:28.975+0000 7f2c4da41700 1 --2- 172.21.15.32:0/340138345 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2c4815d2c0 0x7f2c4815d770 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f2c40009d90 tx=0x7f2c4000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=99dda4f2e57c709d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:28.977 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:28.975+0000 7f2c3ffff700 1 -- 172.21.15.32:0/340138345 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c4000e070 con 0x7f2c4815d2c0 2023-10-08T06:10:28.977 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:28.975+0000 7f2c3ffff700 1 -- 172.21.15.32:0/340138345 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c4000bb20 con 0x7f2c4815d2c0 2023-10-08T06:10:28.977 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:28.975+0000 7f2c3ffff700 1 -- 172.21.15.32:0/340138345 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c40012430 con 0x7f2c4815d2c0 2023-10-08T06:10:28.978 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:28.975+0000 7f2c4f4a4700 1 -- 172.21.15.32:0/340138345 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2c4815d2c0 msgr2=0x7f2c4815d770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:28.978 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:28.975+0000 7f2c4f4a4700 1 --2- 172.21.15.32:0/340138345 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2c4815d2c0 0x7f2c4815d770 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f2c40009d90 tx=0x7f2c4000b330 comp rx=0 tx=0).stop 2023-10-08T06:10:28.978 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:28.975+0000 7f2c4f4a4700 1 -- 172.21.15.32:0/340138345 shutdown_connections 2023-10-08T06:10:28.978 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:28.975+0000 7f2c4f4a4700 1 --2- 172.21.15.32:0/340138345 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2c4815d2c0 0x7f2c4815d770 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:28.978 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:28.975+0000 7f2c4f4a4700 1 --2- 172.21.15.32:0/340138345 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2c4815cee0 0x7f2c4806b840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:28.979 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:28.975+0000 7f2c4f4a4700 1 -- 172.21.15.32:0/340138345 >> 172.21.15.32:0/340138345 conn(0x7f2c480cc0d0 msgr2=0x7f2c480cc4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:10:28.979 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:28.975+0000 7f2c4f4a4700 1 -- 172.21.15.32:0/340138345 shutdown_connections 2023-10-08T06:10:28.979 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:28.975+0000 7f2c4f4a4700 1 -- 172.21.15.32:0/340138345 wait complete. 2023-10-08T06:10:28.979 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:28.975+0000 7f2c4f4a4700 1 Processor -- start 2023-10-08T06:10:28.979 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:28.975+0000 7f2c4f4a4700 1 -- start start 2023-10-08T06:10:28.981 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:28.979+0000 7f2c4f4a4700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2c4806a2a0 0x7f2c480b1fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:28.981 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:28.979+0000 7f2c4f4a4700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2c4815cee0 0x7f2c4814cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:28.981 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:28.979+0000 7f2c4f4a4700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2c4815d2c0 0x7f2c48159db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:28.981 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:28.979+0000 7f2c4f4a4700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c480c44c0 con 0x7f2c4815d2c0 2023-10-08T06:10:28.981 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:28.979+0000 7f2c4f4a4700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c480c5320 con 0x7f2c4815cee0 2023-10-08T06:10:28.981 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:28.979+0000 7f2c4f4a4700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c480c4710 con 0x7f2c4806a2a0 2023-10-08T06:10:28.982 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:28.979+0000 7f2c4da41700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2c4815d2c0 0x7f2c48159db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:28.982 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:28.979+0000 7f2c4da41700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2c4815d2c0 0x7f2c48159db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:56158/0 (socket says 172.21.15.32:56158) 2023-10-08T06:10:28.982 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:28.979+0000 7f2c4da41700 1 -- 172.21.15.32:0/2431050179 learned_addr learned my addr 172.21.15.32:0/2431050179 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:10:28.982 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:28.979+0000 7f2c4d240700 1 --2- 172.21.15.32:0/2431050179 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2c4806a2a0 0x7f2c480b1fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:28.982 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:28.979+0000 7f2c4ca3f700 1 --2- 172.21.15.32:0/2431050179 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2c4815cee0 0x7f2c4814cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:28.982 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:28.979+0000 7f2c4da41700 1 -- 172.21.15.32:0/2431050179 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2c4806a2a0 msgr2=0x7f2c480b1fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:28.982 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:28.979+0000 7f2c4da41700 1 --2- 172.21.15.32:0/2431050179 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2c4806a2a0 0x7f2c480b1fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:28.982 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:28.979+0000 7f2c4da41700 1 -- 172.21.15.32:0/2431050179 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2c4815cee0 msgr2=0x7f2c4814cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:28.982 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:28.979+0000 7f2c4da41700 1 --2- 172.21.15.32:0/2431050179 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2c4815cee0 0x7f2c4814cc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:28.982 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:28.979+0000 7f2c4da41700 1 -- 172.21.15.32:0/2431050179 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c40009a70 con 0x7f2c4815d2c0 2023-10-08T06:10:28.983 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:28.979+0000 7f2c4da41700 1 --2- 172.21.15.32:0/2431050179 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2c4815d2c0 0x7f2c48159db0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f2c4806f260 tx=0x7f2c40004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:28.983 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:28.979+0000 7f2c3dffb700 1 -- 172.21.15.32:0/2431050179 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c40012430 con 0x7f2c4815d2c0 2023-10-08T06:10:28.983 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:28.979+0000 7f2c3dffb700 1 -- 172.21.15.32:0/2431050179 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c40020070 con 0x7f2c4815d2c0 2023-10-08T06:10:28.983 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:28.979+0000 7f2c4f4a4700 1 -- 172.21.15.32:0/2431050179 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c480c49f0 con 0x7f2c4815d2c0 2023-10-08T06:10:28.984 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:28.979+0000 7f2c3dffb700 1 -- 172.21.15.32:0/2431050179 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c40004280 con 0x7f2c4815d2c0 2023-10-08T06:10:28.984 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:28.979+0000 7f2c4f4a4700 1 -- 172.21.15.32:0/2431050179 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c480c4fb0 con 0x7f2c4815d2c0 2023-10-08T06:10:28.984 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:28.983+0000 7f2c4f4a4700 1 -- 172.21.15.32:0/2431050179 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c480686a0 con 0x7f2c4815d2c0 2023-10-08T06:10:28.984 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:28.983+0000 7f2c3dffb700 1 -- 172.21.15.32:0/2431050179 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f2c400043e0 con 0x7f2c4815d2c0 2023-10-08T06:10:28.986 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:28.983+0000 7f2c3dffb700 1 --2- 172.21.15.32:0/2431050179 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f2c2c066540 0x7f2c2c068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:28.986 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:28.983+0000 7f2c3dffb700 1 -- 172.21.15.32:0/2431050179 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f2c40022070 con 0x7f2c4815d2c0 2023-10-08T06:10:28.986 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:28.983+0000 7f2c4d240700 1 --2- 172.21.15.32:0/2431050179 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f2c2c066540 0x7f2c2c068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:28.986 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:28.983+0000 7f2c4d240700 1 --2- 172.21.15.32:0/2431050179 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f2c2c066540 0x7f2c2c068a00 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f2c480c4450 tx=0x7f2c38008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:28.991 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:28.987+0000 7f2c3dffb700 1 -- 172.21.15.32:0/2431050179 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f2c40053350 con 0x7f2c4815d2c0 2023-10-08T06:10:29.169 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:29.167+0000 7f2c4f4a4700 1 -- 172.21.15.32:0/2431050179 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f2c480b06e0 con 0x7f2c4815d2c0 2023-10-08T06:10:29.760 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:29.759+0000 7f2c3dffb700 1 -- 172.21.15.32:0/2431050179 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v29) v1 ==== 97+0+0 (secure 0 0 0) 0x7f2c40056970 con 0x7f2c4815d2c0 2023-10-08T06:10:29.765 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:29.763+0000 7f2c4f4a4700 1 -- 172.21.15.32:0/2431050179 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f2c2c066540 msgr2=0x7f2c2c068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:29.765 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:29.763+0000 7f2c4f4a4700 1 --2- 172.21.15.32:0/2431050179 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f2c2c066540 0x7f2c2c068a00 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f2c480c4450 tx=0x7f2c38008040 comp rx=0 tx=0).stop 2023-10-08T06:10:29.765 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:29.763+0000 7f2c4f4a4700 1 -- 172.21.15.32:0/2431050179 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2c4815d2c0 msgr2=0x7f2c48159db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:29.765 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:29.763+0000 7f2c4f4a4700 1 --2- 172.21.15.32:0/2431050179 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2c4815d2c0 0x7f2c48159db0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f2c4806f260 tx=0x7f2c40004af0 comp rx=0 tx=0).stop 2023-10-08T06:10:29.765 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:29.763+0000 7f2c4f4a4700 1 -- 172.21.15.32:0/2431050179 shutdown_connections 2023-10-08T06:10:29.765 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:29.763+0000 7f2c4f4a4700 1 --2- 172.21.15.32:0/2431050179 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f2c2c066540 0x7f2c2c068a00 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:29.765 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:29.763+0000 7f2c4f4a4700 1 --2- 172.21.15.32:0/2431050179 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2c4815d2c0 0x7f2c48159db0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:29.765 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:29.763+0000 7f2c4f4a4700 1 --2- 172.21.15.32:0/2431050179 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2c4815cee0 0x7f2c4814cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:29.765 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:29.763+0000 7f2c4f4a4700 1 --2- 172.21.15.32:0/2431050179 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2c4806a2a0 0x7f2c480b1fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:29.765 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:29.763+0000 7f2c4f4a4700 1 -- 172.21.15.32:0/2431050179 >> 172.21.15.32:0/2431050179 conn(0x7f2c480cc0d0 msgr2=0x7f2c480cb8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:10:29.766 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:29.763+0000 7f2c4f4a4700 1 -- 172.21.15.32:0/2431050179 shutdown_connections 2023-10-08T06:10:29.766 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:29.763+0000 7f2c4f4a4700 1 -- 172.21.15.32:0/2431050179 wait complete. 2023-10-08T06:10:29.766 INFO:teuthology.orchestra.run.smithi032.stderr: removed all blocklist entries 2023-10-08T06:10:29.782 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-08T06:10:29.895 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:29.891+0000 7fdc18a67700 1 Processor -- start 2023-10-08T06:10:29.896 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:29.891+0000 7fdc18a67700 1 -- start start 2023-10-08T06:10:29.896 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:29.895+0000 7fdc18a67700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fdc1415b980 0x7fdc1415f780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:29.897 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:29.895+0000 7fdc18a67700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdc140719e0 0x7fdc140c9420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:29.897 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:29.895+0000 7fdc18a67700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc1406fc20 con 0x7fdc140c9960 2023-10-08T06:10:29.897 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:29.895+0000 7fdc18a67700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc14070430 con 0x7fdc1415b980 2023-10-08T06:10:29.897 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:29.895+0000 7fdc18a67700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc1415ed70 con 0x7fdc140719e0 2023-10-08T06:10:29.897 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:29.895+0000 7fdc137fe700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fdc1415b980 0x7fdc1415f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:29.897 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:29.895+0000 7fdc12ffd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdc140719e0 0x7fdc140c9420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:29.897 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:29.895+0000 7fdc12ffd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdc140719e0 0x7fdc140c9420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.32:54684/0 (socket says 172.21.15.32:54684) 2023-10-08T06:10:29.897 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:29.895+0000 7fdc12ffd700 1 -- 172.21.15.32:0/3132928839 learned_addr learned my addr 172.21.15.32:0/3132928839 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:10:29.899 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:29.895+0000 7fdc12ffd700 1 -- 172.21.15.32:0/3132928839 >> v2:172.21.15.32:3300/0 conn(0x7fdc1415b980 msgr2=0x7fdc1415f780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:10:29.899 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:29.895+0000 7fdc12ffd700 1 --2- 172.21.15.32:0/3132928839 >> v2:172.21.15.32:3300/0 conn(0x7fdc1415b980 0x7fdc1415f780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:29.899 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:29.895+0000 7fdc12ffd700 1 -- 172.21.15.32:0/3132928839 >> v1:172.21.15.40:6789/0 conn(0x7fdc140c9960 legacy=0x7fdc1415bd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:29.899 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:29.895+0000 7fdc12ffd700 1 -- 172.21.15.32:0/3132928839 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc1415fcc0 con 0x7fdc140719e0 2023-10-08T06:10:29.899 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:29.895+0000 7fdc137fe700 1 --2- 172.21.15.32:0/3132928839 >> v2:172.21.15.32:3300/0 conn(0x7fdc1415b980 0x7fdc1415f780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T06:10:29.899 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:29.895+0000 7fdc12ffd700 1 --2- 172.21.15.32:0/3132928839 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdc140719e0 0x7fdc140c9420 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fdc04009910 tx=0x7fdc04009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ca02ebfa639cc59d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:29.899 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:29.895+0000 7fdc127fc700 1 -- 172.21.15.32:0/3132928839 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc04011830 con 0x7fdc140719e0 2023-10-08T06:10:29.900 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:29.895+0000 7fdc127fc700 1 -- 172.21.15.32:0/3132928839 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc04011990 con 0x7fdc140719e0 2023-10-08T06:10:29.900 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:29.895+0000 7fdc127fc700 1 -- 172.21.15.32:0/3132928839 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc04011d40 con 0x7fdc140719e0 2023-10-08T06:10:29.900 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:29.895+0000 7fdc18a67700 1 -- 172.21.15.32:0/3132928839 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdc140719e0 msgr2=0x7fdc140c9420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:29.900 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:29.895+0000 7fdc18a67700 1 --2- 172.21.15.32:0/3132928839 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdc140719e0 0x7fdc140c9420 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fdc04009910 tx=0x7fdc04009c20 comp rx=0 tx=0).stop 2023-10-08T06:10:29.900 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:29.895+0000 7fdc18a67700 1 -- 172.21.15.32:0/3132928839 shutdown_connections 2023-10-08T06:10:29.900 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:29.895+0000 7fdc18a67700 1 --2- 172.21.15.32:0/3132928839 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdc140719e0 0x7fdc140c9420 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:29.900 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:29.895+0000 7fdc18a67700 1 --2- 172.21.15.32:0/3132928839 >> v2:172.21.15.32:3300/0 conn(0x7fdc1415b980 0x7fdc1415f780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:29.900 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:29.895+0000 7fdc18a67700 1 -- 172.21.15.32:0/3132928839 >> 172.21.15.32:0/3132928839 conn(0x7fdc140b0900 msgr2=0x7fdc140b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:10:29.900 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:29.895+0000 7fdc18a67700 1 -- 172.21.15.32:0/3132928839 shutdown_connections 2023-10-08T06:10:29.900 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:29.895+0000 7fdc18a67700 1 -- 172.21.15.32:0/3132928839 wait complete. 2023-10-08T06:10:29.901 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:29.899+0000 7fdc18a67700 1 Processor -- start 2023-10-08T06:10:29.901 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:29.899+0000 7fdc18a67700 1 -- start start 2023-10-08T06:10:29.903 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:29.899+0000 7fdc18a67700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdc140719e0 0x7fdc140b3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:29.903 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:29.899+0000 7fdc18a67700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdc140c9960 0x7fdc140c4520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:29.903 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:29.899+0000 7fdc18a67700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdc1415b980 0x7fdc140b4040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:29.903 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:29.899+0000 7fdc18a67700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc141f0520 con 0x7fdc1415b980 2023-10-08T06:10:29.903 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:29.899+0000 7fdc18a67700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc140c4f70 con 0x7fdc140c9960 2023-10-08T06:10:29.903 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:29.899+0000 7fdc18a67700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc140c5250 con 0x7fdc140719e0 2023-10-08T06:10:29.903 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:29.899+0000 7fdc13fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdc1415b980 0x7fdc140b4040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:29.903 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:29.899+0000 7fdc12ffd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdc140c9960 0x7fdc140c4520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:29.903 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:29.899+0000 7fdc13fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdc1415b980 0x7fdc140b4040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:56166/0 (socket says 172.21.15.32:56166) 2023-10-08T06:10:29.903 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:29.899+0000 7fdc13fff700 1 -- 172.21.15.32:0/786711862 learned_addr learned my addr 172.21.15.32:0/786711862 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:10:29.904 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:29.899+0000 7fdc137fe700 1 --2- 172.21.15.32:0/786711862 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdc140719e0 0x7fdc140b3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:29.904 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:29.899+0000 7fdc13fff700 1 -- 172.21.15.32:0/786711862 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdc140719e0 msgr2=0x7fdc140b3a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:29.904 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:29.899+0000 7fdc13fff700 1 --2- 172.21.15.32:0/786711862 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdc140719e0 0x7fdc140b3a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:29.904 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:29.899+0000 7fdc13fff700 1 -- 172.21.15.32:0/786711862 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdc140c9960 msgr2=0x7fdc140c4520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:29.904 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:29.899+0000 7fdc13fff700 1 --2- 172.21.15.32:0/786711862 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdc140c9960 0x7fdc140c4520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:29.904 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:29.899+0000 7fdc13fff700 1 -- 172.21.15.32:0/786711862 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc080094b0 con 0x7fdc1415b980 2023-10-08T06:10:29.904 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:29.899+0000 7fdc137fe700 1 --2- 172.21.15.32:0/786711862 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdc140719e0 0x7fdc140b3a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T06:10:29.904 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:29.899+0000 7fdc13fff700 1 --2- 172.21.15.32:0/786711862 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdc1415b980 0x7fdc140b4040 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fdc0c00cc50 tx=0x7fdc0c00cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:29.904 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:29.899+0000 7fdbfbfff700 1 -- 172.21.15.32:0/786711862 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc0c003c20 con 0x7fdc1415b980 2023-10-08T06:10:29.904 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:29.899+0000 7fdbfbfff700 1 -- 172.21.15.32:0/786711862 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc0c003d80 con 0x7fdc1415b980 2023-10-08T06:10:29.904 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:29.899+0000 7fdc18a67700 1 -- 172.21.15.32:0/786711862 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc04009570 con 0x7fdc1415b980 2023-10-08T06:10:29.904 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:29.899+0000 7fdbfbfff700 1 -- 172.21.15.32:0/786711862 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc0c00ab60 con 0x7fdc1415b980 2023-10-08T06:10:29.905 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:29.899+0000 7fdc18a67700 1 -- 172.21.15.32:0/786711862 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc140b1b90 con 0x7fdc1415b980 2023-10-08T06:10:29.905 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:29.903+0000 7fdc18a67700 1 -- 172.21.15.32:0/786711862 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc140c5770 con 0x7fdc1415b980 2023-10-08T06:10:29.905 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:29.903+0000 7fdbfbfff700 1 -- 172.21.15.32:0/786711862 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fdc0c00acc0 con 0x7fdc1415b980 2023-10-08T06:10:29.906 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:29.903+0000 7fdbfbfff700 1 --2- 172.21.15.32:0/786711862 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fdc00066510 0x7fdc000689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:29.906 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:29.903+0000 7fdbfbfff700 1 -- 172.21.15.32:0/786711862 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fdc0c083b70 con 0x7fdc1415b980 2023-10-08T06:10:29.906 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:29.903+0000 7fdc137fe700 1 --2- 172.21.15.32:0/786711862 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fdc00066510 0x7fdc000689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:29.906 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:29.903+0000 7fdc137fe700 1 --2- 172.21.15.32:0/786711862 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fdc00066510 0x7fdc000689d0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fdc08009d30 tx=0x7fdc08008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:29.912 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:29.911+0000 7fdbfbfff700 1 -- 172.21.15.32:0/786711862 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fdc140c5770 con 0x7fdc1415b980 2023-10-08T06:10:30.135 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:30.131+0000 7fdc18a67700 1 -- 172.21.15.32:0/786711862 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fdc140b19f0 con 0x7fdc1415b980 2023-10-08T06:10:30.137 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:30.135+0000 7fdbfbfff700 1 -- 172.21.15.32:0/786711862 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v2) v1 ==== 80+0+6645 (secure 0 0 0) 0x7fdc140b19f0 con 0x7fdc1415b980 2023-10-08T06:10:30.137 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:10:30.137 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2023-10-08T06:10:30.137 INFO:teuthology.orchestra.run.smithi032.stdout: "auth_dump": [ 2023-10-08T06:10:30.137 INFO:teuthology.orchestra.run.smithi032.stdout: { 2023-10-08T06:10:30.137 INFO:teuthology.orchestra.run.smithi032.stdout: "entity": "mds.a", 2023-10-08T06:10:30.137 INFO:teuthology.orchestra.run.smithi032.stdout: "key": "AQBjRyJlvORRFhAAZ9COCXQ86hsbHEr9NkFHmg==", 2023-10-08T06:10:30.137 INFO:teuthology.orchestra.run.smithi032.stdout: "caps": { 2023-10-08T06:10:30.138 INFO:teuthology.orchestra.run.smithi032.stdout: "mds": "allow", 2023-10-08T06:10:30.138 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr": "allow *", 2023-10-08T06:10:30.138 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": "allow *", 2023-10-08T06:10:30.138 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": "allow *" 2023-10-08T06:10:30.138 INFO:teuthology.orchestra.run.smithi032.stdout: } 2023-10-08T06:10:30.138 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-10-08T06:10:30.138 INFO:teuthology.orchestra.run.smithi032.stdout: { 2023-10-08T06:10:30.138 INFO:teuthology.orchestra.run.smithi032.stdout: "entity": "mds.b", 2023-10-08T06:10:30.138 INFO:teuthology.orchestra.run.smithi032.stdout: "key": "AQBjRyJl++THIBAA98IgS2NszGlo8TGhVMAWvA==", 2023-10-08T06:10:30.138 INFO:teuthology.orchestra.run.smithi032.stdout: "caps": { 2023-10-08T06:10:30.138 INFO:teuthology.orchestra.run.smithi032.stdout: "mds": "allow", 2023-10-08T06:10:30.139 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr": "allow *", 2023-10-08T06:10:30.139 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": "allow *", 2023-10-08T06:10:30.139 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": "allow *" 2023-10-08T06:10:30.139 INFO:teuthology.orchestra.run.smithi032.stdout: } 2023-10-08T06:10:30.139 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-10-08T06:10:30.139 INFO:teuthology.orchestra.run.smithi032.stdout: { 2023-10-08T06:10:30.139 INFO:teuthology.orchestra.run.smithi032.stdout: "entity": "mds.c", 2023-10-08T06:10:30.139 INFO:teuthology.orchestra.run.smithi032.stdout: "key": "AQBjRyJlgt6nHBAAzHtV4VfFFM+6ShUPMlFf+w==", 2023-10-08T06:10:30.139 INFO:teuthology.orchestra.run.smithi032.stdout: "caps": { 2023-10-08T06:10:30.139 INFO:teuthology.orchestra.run.smithi032.stdout: "mds": "allow", 2023-10-08T06:10:30.139 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr": "allow *", 2023-10-08T06:10:30.139 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": "allow *", 2023-10-08T06:10:30.140 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": "allow *" 2023-10-08T06:10:30.140 INFO:teuthology.orchestra.run.smithi032.stdout: } 2023-10-08T06:10:30.140 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-10-08T06:10:30.140 INFO:teuthology.orchestra.run.smithi032.stdout: { 2023-10-08T06:10:30.140 INFO:teuthology.orchestra.run.smithi032.stdout: "entity": "mds.d", 2023-10-08T06:10:30.140 INFO:teuthology.orchestra.run.smithi032.stdout: "key": "AQBjRyJlXXOdJBAAWB1DeSxEUItTLqe/RfrecA==", 2023-10-08T06:10:30.140 INFO:teuthology.orchestra.run.smithi032.stdout: "caps": { 2023-10-08T06:10:30.140 INFO:teuthology.orchestra.run.smithi032.stdout: "mds": "allow", 2023-10-08T06:10:30.140 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr": "allow *", 2023-10-08T06:10:30.140 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": "allow *", 2023-10-08T06:10:30.140 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": "allow *" 2023-10-08T06:10:30.141 INFO:teuthology.orchestra.run.smithi032.stdout: } 2023-10-08T06:10:30.141 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-10-08T06:10:30.141 INFO:teuthology.orchestra.run.smithi032.stdout: { 2023-10-08T06:10:30.141 INFO:teuthology.orchestra.run.smithi032.stdout: "entity": "osd.0", 2023-10-08T06:10:30.141 INFO:teuthology.orchestra.run.smithi032.stdout: "key": "AQBkRyJl0rgbHRAApabneNsWCIlgs8WhUzMtlg==", 2023-10-08T06:10:30.141 INFO:teuthology.orchestra.run.smithi032.stdout: "caps": { 2023-10-08T06:10:30.141 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr": "allow profile osd", 2023-10-08T06:10:30.141 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": "allow profile osd", 2023-10-08T06:10:30.141 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": "allow *" 2023-10-08T06:10:30.141 INFO:teuthology.orchestra.run.smithi032.stdout: } 2023-10-08T06:10:30.141 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-10-08T06:10:30.142 INFO:teuthology.orchestra.run.smithi032.stdout: { 2023-10-08T06:10:30.142 INFO:teuthology.orchestra.run.smithi032.stdout: "entity": "osd.1", 2023-10-08T06:10:30.142 INFO:teuthology.orchestra.run.smithi032.stdout: "key": "AQBnRyJlnurPIRAA9cpYTYzj73O5yoBViRJmhw==", 2023-10-08T06:10:30.142 INFO:teuthology.orchestra.run.smithi032.stdout: "caps": { 2023-10-08T06:10:30.142 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr": "allow profile osd", 2023-10-08T06:10:30.142 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": "allow profile osd", 2023-10-08T06:10:30.142 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": "allow *" 2023-10-08T06:10:30.142 INFO:teuthology.orchestra.run.smithi032.stdout: } 2023-10-08T06:10:30.142 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-10-08T06:10:30.142 INFO:teuthology.orchestra.run.smithi032.stdout: { 2023-10-08T06:10:30.142 INFO:teuthology.orchestra.run.smithi032.stdout: "entity": "osd.2", 2023-10-08T06:10:30.143 INFO:teuthology.orchestra.run.smithi032.stdout: "key": "AQBqRyJl9rwGJhAAUtE0vcl7UmetgoSKHg+1NQ==", 2023-10-08T06:10:30.143 INFO:teuthology.orchestra.run.smithi032.stdout: "caps": { 2023-10-08T06:10:30.143 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr": "allow profile osd", 2023-10-08T06:10:30.143 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": "allow profile osd", 2023-10-08T06:10:30.143 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": "allow *" 2023-10-08T06:10:30.143 INFO:teuthology.orchestra.run.smithi032.stdout: } 2023-10-08T06:10:30.143 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-10-08T06:10:30.143 INFO:teuthology.orchestra.run.smithi032.stdout: { 2023-10-08T06:10:30.143 INFO:teuthology.orchestra.run.smithi032.stdout: "entity": "osd.3", 2023-10-08T06:10:30.143 INFO:teuthology.orchestra.run.smithi032.stdout: "key": "AQBtRyJlpsN2LRAAOvOV5J1kRzHSMNurHWWuHA==", 2023-10-08T06:10:30.143 INFO:teuthology.orchestra.run.smithi032.stdout: "caps": { 2023-10-08T06:10:30.143 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr": "allow profile osd", 2023-10-08T06:10:30.144 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": "allow profile osd", 2023-10-08T06:10:30.144 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": "allow *" 2023-10-08T06:10:30.144 INFO:teuthology.orchestra.run.smithi032.stdout: } 2023-10-08T06:10:30.144 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-10-08T06:10:30.144 INFO:teuthology.orchestra.run.smithi032.stdout: { 2023-10-08T06:10:30.144 INFO:teuthology.orchestra.run.smithi032.stdout: "entity": "osd.4", 2023-10-08T06:10:30.144 INFO:teuthology.orchestra.run.smithi032.stdout: "key": "AQBzRyJlO/XgFBAAMhZTH+xTiAubxzvwebdApw==", 2023-10-08T06:10:30.144 INFO:teuthology.orchestra.run.smithi032.stdout: "caps": { 2023-10-08T06:10:30.144 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr": "allow profile osd", 2023-10-08T06:10:30.144 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": "allow profile osd", 2023-10-08T06:10:30.144 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": "allow *" 2023-10-08T06:10:30.144 INFO:teuthology.orchestra.run.smithi032.stdout: } 2023-10-08T06:10:30.145 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-10-08T06:10:30.145 INFO:teuthology.orchestra.run.smithi032.stdout: { 2023-10-08T06:10:30.145 INFO:teuthology.orchestra.run.smithi032.stdout: "entity": "osd.5", 2023-10-08T06:10:30.145 INFO:teuthology.orchestra.run.smithi032.stdout: "key": "AQB2RyJlHqCjKBAA9rhMXCwhv1kz+IzmceNMoA==", 2023-10-08T06:10:30.145 INFO:teuthology.orchestra.run.smithi032.stdout: "caps": { 2023-10-08T06:10:30.145 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr": "allow profile osd", 2023-10-08T06:10:30.145 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": "allow profile osd", 2023-10-08T06:10:30.145 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": "allow *" 2023-10-08T06:10:30.145 INFO:teuthology.orchestra.run.smithi032.stdout: } 2023-10-08T06:10:30.145 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-10-08T06:10:30.145 INFO:teuthology.orchestra.run.smithi032.stdout: { 2023-10-08T06:10:30.145 INFO:teuthology.orchestra.run.smithi032.stdout: "entity": "osd.6", 2023-10-08T06:10:30.146 INFO:teuthology.orchestra.run.smithi032.stdout: "key": "AQB5RyJlTG1fOhAAe1TfJMpOEl0SSfVFcQR80g==", 2023-10-08T06:10:30.146 INFO:teuthology.orchestra.run.smithi032.stdout: "caps": { 2023-10-08T06:10:30.146 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr": "allow profile osd", 2023-10-08T06:10:30.146 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": "allow profile osd", 2023-10-08T06:10:30.146 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": "allow *" 2023-10-08T06:10:30.146 INFO:teuthology.orchestra.run.smithi032.stdout: } 2023-10-08T06:10:30.146 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-10-08T06:10:30.146 INFO:teuthology.orchestra.run.smithi032.stdout: { 2023-10-08T06:10:30.146 INFO:teuthology.orchestra.run.smithi032.stdout: "entity": "osd.7", 2023-10-08T06:10:30.146 INFO:teuthology.orchestra.run.smithi032.stdout: "key": "AQB9RyJlLy3SAhAABRysNqQaO9Paow3CdfG/Cg==", 2023-10-08T06:10:30.146 INFO:teuthology.orchestra.run.smithi032.stdout: "caps": { 2023-10-08T06:10:30.146 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr": "allow profile osd", 2023-10-08T06:10:30.147 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": "allow profile osd", 2023-10-08T06:10:30.147 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": "allow *" 2023-10-08T06:10:30.147 INFO:teuthology.orchestra.run.smithi032.stdout: } 2023-10-08T06:10:30.147 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-10-08T06:10:30.147 INFO:teuthology.orchestra.run.smithi032.stdout: { 2023-10-08T06:10:30.147 INFO:teuthology.orchestra.run.smithi032.stdout: "entity": "client.0", 2023-10-08T06:10:30.147 INFO:teuthology.orchestra.run.smithi032.stdout: "key": "AQBjRyJljskKKBAALCz7TUBic1qBcdHhz2xJFQ==", 2023-10-08T06:10:30.147 INFO:teuthology.orchestra.run.smithi032.stdout: "caps": { 2023-10-08T06:10:30.147 INFO:teuthology.orchestra.run.smithi032.stdout: "mds": "allow", 2023-10-08T06:10:30.147 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr": "allow r", 2023-10-08T06:10:30.147 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": "allow rw", 2023-10-08T06:10:30.147 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": "allow rwx" 2023-10-08T06:10:30.148 INFO:teuthology.orchestra.run.smithi032.stdout: } 2023-10-08T06:10:30.148 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-10-08T06:10:30.148 INFO:teuthology.orchestra.run.smithi032.stdout: { 2023-10-08T06:10:30.148 INFO:teuthology.orchestra.run.smithi032.stdout: "entity": "client.1", 2023-10-08T06:10:30.148 INFO:teuthology.orchestra.run.smithi032.stdout: "key": "AQBjRyJljexTMRAAtP/qnlz76ImthOacAp5G8g==", 2023-10-08T06:10:30.148 INFO:teuthology.orchestra.run.smithi032.stdout: "caps": { 2023-10-08T06:10:30.148 INFO:teuthology.orchestra.run.smithi032.stdout: "mds": "allow", 2023-10-08T06:10:30.148 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr": "allow r", 2023-10-08T06:10:30.148 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": "allow rw", 2023-10-08T06:10:30.148 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": "allow rwx" 2023-10-08T06:10:30.148 INFO:teuthology.orchestra.run.smithi032.stdout: } 2023-10-08T06:10:30.148 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-10-08T06:10:30.148 INFO:teuthology.orchestra.run.smithi032.stdout: { 2023-10-08T06:10:30.149 INFO:teuthology.orchestra.run.smithi032.stdout: "entity": "client.2", 2023-10-08T06:10:30.149 INFO:teuthology.orchestra.run.smithi032.stdout: "key": "AQBjRyJlF039LRAA6b24sU4JB/lqjdqDl2bWXg==", 2023-10-08T06:10:30.149 INFO:teuthology.orchestra.run.smithi032.stdout: "caps": { 2023-10-08T06:10:30.149 INFO:teuthology.orchestra.run.smithi032.stdout: "mds": "allow", 2023-10-08T06:10:30.149 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr": "allow r", 2023-10-08T06:10:30.149 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": "allow rw", 2023-10-08T06:10:30.149 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": "allow rwx" 2023-10-08T06:10:30.149 INFO:teuthology.orchestra.run.smithi032.stdout: } 2023-10-08T06:10:30.149 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-10-08T06:10:30.149 INFO:teuthology.orchestra.run.smithi032.stdout: { 2023-10-08T06:10:30.149 INFO:teuthology.orchestra.run.smithi032.stdout: "entity": "client.3", 2023-10-08T06:10:30.149 INFO:teuthology.orchestra.run.smithi032.stdout: "key": "AQBjRyJlZ9hENBAAHx6cqN4InNUPTGKdNn41ZA==", 2023-10-08T06:10:30.150 INFO:teuthology.orchestra.run.smithi032.stdout: "caps": { 2023-10-08T06:10:30.150 INFO:teuthology.orchestra.run.smithi032.stdout: "mds": "allow", 2023-10-08T06:10:30.150 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr": "allow r", 2023-10-08T06:10:30.150 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": "allow rw", 2023-10-08T06:10:30.150 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": "allow rwx" 2023-10-08T06:10:30.150 INFO:teuthology.orchestra.run.smithi032.stdout: } 2023-10-08T06:10:30.150 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-10-08T06:10:30.150 INFO:teuthology.orchestra.run.smithi032.stdout: { 2023-10-08T06:10:30.150 INFO:teuthology.orchestra.run.smithi032.stdout: "entity": "client.admin", 2023-10-08T06:10:30.150 INFO:teuthology.orchestra.run.smithi032.stdout: "key": "AQBjRyJlxMCOBhAAgv1F3ImMj063o4hyhAc0Yg==", 2023-10-08T06:10:30.150 INFO:teuthology.orchestra.run.smithi032.stdout: "caps": { 2023-10-08T06:10:30.150 INFO:teuthology.orchestra.run.smithi032.stdout: "mds": "allow *", 2023-10-08T06:10:30.150 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr": "allow *", 2023-10-08T06:10:30.151 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": "allow *", 2023-10-08T06:10:30.151 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": "allow *" 2023-10-08T06:10:30.151 INFO:teuthology.orchestra.run.smithi032.stdout: } 2023-10-08T06:10:30.151 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-10-08T06:10:30.151 INFO:teuthology.orchestra.run.smithi032.stdout: { 2023-10-08T06:10:30.151 INFO:teuthology.orchestra.run.smithi032.stdout: "entity": "client.bootstrap-mds", 2023-10-08T06:10:30.151 INFO:teuthology.orchestra.run.smithi032.stdout: "key": "AQCHRyJlGd+XChAA53g1tgk35p/TGbmwMvbnfQ==", 2023-10-08T06:10:30.151 INFO:teuthology.orchestra.run.smithi032.stdout: "caps": { 2023-10-08T06:10:30.151 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": "allow profile bootstrap-mds" 2023-10-08T06:10:30.151 INFO:teuthology.orchestra.run.smithi032.stdout: } 2023-10-08T06:10:30.151 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-10-08T06:10:30.151 INFO:teuthology.orchestra.run.smithi032.stdout: { 2023-10-08T06:10:30.151 INFO:teuthology.orchestra.run.smithi032.stdout: "entity": "client.bootstrap-mgr", 2023-10-08T06:10:30.152 INFO:teuthology.orchestra.run.smithi032.stdout: "key": "AQCHRyJlfPyXChAAR6uhFJu/yUnf1V31sElmyg==", 2023-10-08T06:10:30.152 INFO:teuthology.orchestra.run.smithi032.stdout: "caps": { 2023-10-08T06:10:30.152 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": "allow profile bootstrap-mgr" 2023-10-08T06:10:30.152 INFO:teuthology.orchestra.run.smithi032.stdout: } 2023-10-08T06:10:30.152 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-10-08T06:10:30.152 INFO:teuthology.orchestra.run.smithi032.stdout: { 2023-10-08T06:10:30.152 INFO:teuthology.orchestra.run.smithi032.stdout: "entity": "client.bootstrap-osd", 2023-10-08T06:10:30.152 INFO:teuthology.orchestra.run.smithi032.stdout: "key": "AQCHRyJl3hKYChAACJJwAw+Xh+ZH1QXJh9azhw==", 2023-10-08T06:10:30.152 INFO:teuthology.orchestra.run.smithi032.stdout: "caps": { 2023-10-08T06:10:30.152 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": "allow profile bootstrap-osd" 2023-10-08T06:10:30.152 INFO:teuthology.orchestra.run.smithi032.stdout: } 2023-10-08T06:10:30.152 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-10-08T06:10:30.153 INFO:teuthology.orchestra.run.smithi032.stdout: { 2023-10-08T06:10:30.153 INFO:teuthology.orchestra.run.smithi032.stdout: "entity": "client.bootstrap-rbd", 2023-10-08T06:10:30.153 INFO:teuthology.orchestra.run.smithi032.stdout: "key": "AQCHRyJlTimYChAAhfabC0PXapfwfxgSq1WOFA==", 2023-10-08T06:10:30.153 INFO:teuthology.orchestra.run.smithi032.stdout: "caps": { 2023-10-08T06:10:30.153 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": "allow profile bootstrap-rbd" 2023-10-08T06:10:30.153 INFO:teuthology.orchestra.run.smithi032.stdout: } 2023-10-08T06:10:30.153 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-10-08T06:10:30.153 INFO:teuthology.orchestra.run.smithi032.stdout: { 2023-10-08T06:10:30.153 INFO:teuthology.orchestra.run.smithi032.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-10-08T06:10:30.153 INFO:teuthology.orchestra.run.smithi032.stdout: "key": "AQCHRyJlnkKYChAA6+wvu7j18Pb4yK7WwRJJEw==", 2023-10-08T06:10:30.153 INFO:teuthology.orchestra.run.smithi032.stdout: "caps": { 2023-10-08T06:10:30.154 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-10-08T06:10:30.154 INFO:teuthology.orchestra.run.smithi032.stdout: } 2023-10-08T06:10:30.154 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-10-08T06:10:30.154 INFO:teuthology.orchestra.run.smithi032.stdout: { 2023-10-08T06:10:30.154 INFO:teuthology.orchestra.run.smithi032.stdout: "entity": "client.bootstrap-rgw", 2023-10-08T06:10:30.154 INFO:teuthology.orchestra.run.smithi032.stdout: "key": "AQCHRyJl7FiYChAAnKw3RV3rV/aQejUjjePJaQ==", 2023-10-08T06:10:30.154 INFO:teuthology.orchestra.run.smithi032.stdout: "caps": { 2023-10-08T06:10:30.154 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": "allow profile bootstrap-rgw" 2023-10-08T06:10:30.154 INFO:teuthology.orchestra.run.smithi032.stdout: } 2023-10-08T06:10:30.154 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-10-08T06:10:30.154 INFO:teuthology.orchestra.run.smithi032.stdout: { 2023-10-08T06:10:30.154 INFO:teuthology.orchestra.run.smithi032.stdout: "entity": "mgr.x", 2023-10-08T06:10:30.155 INFO:teuthology.orchestra.run.smithi032.stdout: "key": "AQBjRyJlfXcZEhAAjRoxbj//YUe7PWPJexMYCQ==", 2023-10-08T06:10:30.155 INFO:teuthology.orchestra.run.smithi032.stdout: "caps": { 2023-10-08T06:10:30.155 INFO:teuthology.orchestra.run.smithi032.stdout: "mds": "allow *", 2023-10-08T06:10:30.155 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": "allow profile mgr", 2023-10-08T06:10:30.155 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": "allow *" 2023-10-08T06:10:30.155 INFO:teuthology.orchestra.run.smithi032.stdout: } 2023-10-08T06:10:30.155 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-10-08T06:10:30.155 INFO:teuthology.orchestra.run.smithi032.stdout: { 2023-10-08T06:10:30.155 INFO:teuthology.orchestra.run.smithi032.stdout: "entity": "mgr.y", 2023-10-08T06:10:30.155 INFO:teuthology.orchestra.run.smithi032.stdout: "key": "AQBjRyJlowrCDhAA7uyEy/ddM9ADWWblpjpDoQ==", 2023-10-08T06:10:30.155 INFO:teuthology.orchestra.run.smithi032.stdout: "caps": { 2023-10-08T06:10:30.155 INFO:teuthology.orchestra.run.smithi032.stdout: "mds": "allow *", 2023-10-08T06:10:30.156 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": "allow profile mgr", 2023-10-08T06:10:30.156 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": "allow *" 2023-10-08T06:10:30.156 INFO:teuthology.orchestra.run.smithi032.stdout: } 2023-10-08T06:10:30.156 INFO:teuthology.orchestra.run.smithi032.stdout: } 2023-10-08T06:10:30.156 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2023-10-08T06:10:30.156 INFO:teuthology.orchestra.run.smithi032.stdout:} 2023-10-08T06:10:30.157 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:30.139+0000 7fdc18a67700 1 -- 172.21.15.32:0/786711862 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fdc00066510 msgr2=0x7fdc000689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:30.158 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:30.139+0000 7fdc18a67700 1 --2- 172.21.15.32:0/786711862 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fdc00066510 0x7fdc000689d0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fdc08009d30 tx=0x7fdc08008040 comp rx=0 tx=0).stop 2023-10-08T06:10:30.158 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:30.139+0000 7fdc18a67700 1 -- 172.21.15.32:0/786711862 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdc1415b980 msgr2=0x7fdc140b4040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:30.158 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:30.139+0000 7fdc18a67700 1 --2- 172.21.15.32:0/786711862 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdc1415b980 0x7fdc140b4040 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fdc0c00cc50 tx=0x7fdc0c00cf60 comp rx=0 tx=0).stop 2023-10-08T06:10:30.158 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:30.139+0000 7fdc18a67700 1 -- 172.21.15.32:0/786711862 shutdown_connections 2023-10-08T06:10:30.158 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:30.139+0000 7fdc18a67700 1 --2- 172.21.15.32:0/786711862 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fdc00066510 0x7fdc000689d0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:30.158 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:30.139+0000 7fdc18a67700 1 --2- 172.21.15.32:0/786711862 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdc1415b980 0x7fdc140b4040 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:30.158 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:30.139+0000 7fdc18a67700 1 --2- 172.21.15.32:0/786711862 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdc140c9960 0x7fdc140c4520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:30.158 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:30.139+0000 7fdc18a67700 1 --2- 172.21.15.32:0/786711862 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdc140719e0 0x7fdc140b3a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:30.158 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:30.139+0000 7fdc18a67700 1 -- 172.21.15.32:0/786711862 >> 172.21.15.32:0/786711862 conn(0x7fdc140b0900 msgr2=0x7fdc14159310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:10:30.158 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:30.139+0000 7fdc18a67700 1 -- 172.21.15.32:0/786711862 shutdown_connections 2023-10-08T06:10:30.158 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:30.139+0000 7fdc18a67700 1 -- 172.21.15.32:0/786711862 wait complete. 2023-10-08T06:10:30.159 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-10-08T06:10:30.280 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:30.279+0000 7fb4bd784700 1 Processor -- start 2023-10-08T06:10:30.280 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:30.279+0000 7fb4bd784700 1 -- start start 2023-10-08T06:10:30.281 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:30.279+0000 7fb4bd784700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fb4b815d4f0 0x7fb4b80c9c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:30.281 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:30.279+0000 7fb4bd784700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb4b80ca180 0x7fb4b80b1070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:30.281 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:30.279+0000 7fb4bd784700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4b80cf360 con 0x7fb4b8070620 2023-10-08T06:10:30.281 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:30.279+0000 7fb4bd784700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4b8160ff0 con 0x7fb4b815d4f0 2023-10-08T06:10:30.281 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:30.279+0000 7fb4bd784700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4b81612d0 con 0x7fb4b80ca180 2023-10-08T06:10:30.282 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:30.279+0000 7fb4b6ffd700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fb4b815d4f0 0x7fb4b80c9c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:30.282 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:30.279+0000 7fb4b6ffd700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fb4b815d4f0 0x7fb4b80c9c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:33686/0 (socket says 172.21.15.32:33686) 2023-10-08T06:10:30.282 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:30.279+0000 7fb4b6ffd700 1 -- 172.21.15.32:0/965142257 learned_addr learned my addr 172.21.15.32:0/965142257 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:10:30.282 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:30.279+0000 7fb4b67fc700 1 --2- 172.21.15.32:0/965142257 >> v2:172.21.15.40:3300/0 conn(0x7fb4b80ca180 0x7fb4b80b1070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:30.283 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:30.279+0000 7fb4b6ffd700 1 -- 172.21.15.32:0/965142257 >> v2:172.21.15.40:3300/0 conn(0x7fb4b80ca180 msgr2=0x7fb4b80b1070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:10:30.283 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:30.279+0000 7fb4b6ffd700 1 --2- 172.21.15.32:0/965142257 >> v2:172.21.15.40:3300/0 conn(0x7fb4b80ca180 0x7fb4b80b1070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:30.283 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:30.279+0000 7fb4b6ffd700 1 -- 172.21.15.32:0/965142257 >> v1:172.21.15.40:6789/0 conn(0x7fb4b8070620 legacy=0x7fb4b806a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:30.283 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:30.279+0000 7fb4b6ffd700 1 -- 172.21.15.32:0/965142257 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4b81615b0 con 0x7fb4b815d4f0 2023-10-08T06:10:30.283 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:30.279+0000 7fb4b6ffd700 1 --2- 172.21.15.32:0/965142257 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb4b815d4f0 0x7fb4b80c9c40 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fb4b8072a50 tx=0x7fb4a8009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef4566642d788c79 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:30.283 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:30.279+0000 7fb4b5ffb700 1 -- 172.21.15.32:0/965142257 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4a8011830 con 0x7fb4b815d4f0 2023-10-08T06:10:30.283 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:30.279+0000 7fb4b5ffb700 1 -- 172.21.15.32:0/965142257 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4a8011990 con 0x7fb4b815d4f0 2023-10-08T06:10:30.283 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:30.279+0000 7fb4b5ffb700 1 -- 172.21.15.32:0/965142257 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4a8011d20 con 0x7fb4b815d4f0 2023-10-08T06:10:30.284 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:30.283+0000 7fb4bd784700 1 -- 172.21.15.32:0/965142257 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb4b815d4f0 msgr2=0x7fb4b80c9c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:30.284 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:30.283+0000 7fb4bd784700 1 --2- 172.21.15.32:0/965142257 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb4b815d4f0 0x7fb4b80c9c40 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fb4b8072a50 tx=0x7fb4a8009bf0 comp rx=0 tx=0).stop 2023-10-08T06:10:30.284 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:30.283+0000 7fb4bd784700 1 -- 172.21.15.32:0/965142257 shutdown_connections 2023-10-08T06:10:30.284 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:30.283+0000 7fb4bd784700 1 --2- 172.21.15.32:0/965142257 >> v2:172.21.15.40:3300/0 conn(0x7fb4b80ca180 0x7fb4b80b1070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:30.285 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:30.283+0000 7fb4bd784700 1 --2- 172.21.15.32:0/965142257 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb4b815d4f0 0x7fb4b80c9c40 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:30.285 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:30.283+0000 7fb4bd784700 1 -- 172.21.15.32:0/965142257 >> 172.21.15.32:0/965142257 conn(0x7fb4b80cc070 msgr2=0x7fb4b80cc450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:10:30.285 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:30.283+0000 7fb4bd784700 1 -- 172.21.15.32:0/965142257 shutdown_connections 2023-10-08T06:10:30.285 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:30.283+0000 7fb4bd784700 1 -- 172.21.15.32:0/965142257 wait complete. 2023-10-08T06:10:30.286 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:30.283+0000 7fb4bd784700 1 Processor -- start 2023-10-08T06:10:30.286 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:30.283+0000 7fb4bd784700 1 -- start start 2023-10-08T06:10:30.288 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:30.283+0000 7fb4bd784700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb4b8070620 0x7fb4b815d960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:30.288 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:30.283+0000 7fb4bd784700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb4b80ca180 0x7fb4b815b550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:30.288 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:30.283+0000 7fb4bd784700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb4b815d4f0 0x7fb4b806a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:30.288 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:30.287+0000 7fb4bd784700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4b80b38f0 con 0x7fb4b80ca180 2023-10-08T06:10:30.289 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:30.287+0000 7fb4bd784700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4b815e8a0 con 0x7fb4b8070620 2023-10-08T06:10:30.289 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:30.287+0000 7fb4bd784700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4b815eb80 con 0x7fb4b815d4f0 2023-10-08T06:10:30.289 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:30.287+0000 7fb4b67fc700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb4b80ca180 0x7fb4b815b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:30.289 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:30.287+0000 7fb4b67fc700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb4b80ca180 0x7fb4b815b550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:33700/0 (socket says 172.21.15.32:33700) 2023-10-08T06:10:30.289 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:30.287+0000 7fb4b67fc700 1 -- 172.21.15.32:0/1091938199 learned_addr learned my addr 172.21.15.32:0/1091938199 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:10:30.289 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:30.287+0000 7fb4b6ffd700 1 --2- 172.21.15.32:0/1091938199 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb4b8070620 0x7fb4b815d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:30.289 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:30.287+0000 7fb4b77fe700 1 --2- 172.21.15.32:0/1091938199 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb4b815d4f0 0x7fb4b806a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:30.289 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:30.287+0000 7fb4b67fc700 1 -- 172.21.15.32:0/1091938199 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb4b815d4f0 msgr2=0x7fb4b806a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:30.289 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:30.287+0000 7fb4b67fc700 1 --2- 172.21.15.32:0/1091938199 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb4b815d4f0 0x7fb4b806a2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:30.289 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:30.287+0000 7fb4b67fc700 1 -- 172.21.15.32:0/1091938199 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb4b8070620 msgr2=0x7fb4b815d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:30.289 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:30.287+0000 7fb4b67fc700 1 --2- 172.21.15.32:0/1091938199 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb4b8070620 0x7fb4b815d960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:30.290 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:30.287+0000 7fb4b67fc700 1 -- 172.21.15.32:0/1091938199 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4a8009570 con 0x7fb4b80ca180 2023-10-08T06:10:30.290 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:30.287+0000 7fb4b67fc700 1 --2- 172.21.15.32:0/1091938199 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb4b80ca180 0x7fb4b815b550 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fb4ac00e9a0 tx=0x7fb4ac00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:30.291 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:30.287+0000 7fb49f7fe700 1 -- 172.21.15.32:0/1091938199 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4ac009720 con 0x7fb4b80ca180 2023-10-08T06:10:30.291 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:30.287+0000 7fb49f7fe700 1 -- 172.21.15.32:0/1091938199 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4ac00c850 con 0x7fb4b80ca180 2023-10-08T06:10:30.291 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:30.287+0000 7fb4bd784700 1 -- 172.21.15.32:0/1091938199 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4b815ee60 con 0x7fb4b80ca180 2023-10-08T06:10:30.291 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:30.287+0000 7fb49f7fe700 1 -- 172.21.15.32:0/1091938199 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4ac00cc00 con 0x7fb4b80ca180 2023-10-08T06:10:30.291 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:30.287+0000 7fb4bd784700 1 -- 172.21.15.32:0/1091938199 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4b815f140 con 0x7fb4b80ca180 2023-10-08T06:10:30.291 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:30.287+0000 7fb4bd784700 1 -- 172.21.15.32:0/1091938199 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4b80b3a60 con 0x7fb4b80ca180 2023-10-08T06:10:30.291 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:30.287+0000 7fb49f7fe700 1 -- 172.21.15.32:0/1091938199 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fb4ac013470 con 0x7fb4b80ca180 2023-10-08T06:10:30.292 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:30.291+0000 7fb49f7fe700 1 --2- 172.21.15.32:0/1091938199 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fb4a4066510 0x7fb4a40689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:30.292 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:30.291+0000 7fb4b6ffd700 1 --2- 172.21.15.32:0/1091938199 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fb4a4066510 0x7fb4a40689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:30.292 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:30.291+0000 7fb49f7fe700 1 -- 172.21.15.32:0/1091938199 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fb4ac084290 con 0x7fb4b80ca180 2023-10-08T06:10:30.293 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:30.291+0000 7fb4b6ffd700 1 --2- 172.21.15.32:0/1091938199 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fb4a4066510 0x7fb4a40689d0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fb4a8000c00 tx=0x7fb4a8008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:30.297 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:30.295+0000 7fb49f7fe700 1 -- 172.21.15.32:0/1091938199 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fb4ac051a40 con 0x7fb4b80ca180 2023-10-08T06:10:30.518 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:30.515+0000 7fb4bd784700 1 -- 172.21.15.32:0/1091938199 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7fb4b80b3a30 con 0x7fb4b80ca180 2023-10-08T06:10:30.523 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:30.519+0000 7fb49f7fe700 1 -- 172.21.15.32:0/1091938199 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v3) v1 ==== 90+0+0 (secure 0 0 0) 0x7fb4ac0170a0 con 0x7fb4b80ca180 2023-10-08T06:10:30.527 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:30.523+0000 7fb4bd784700 1 -- 172.21.15.32:0/1091938199 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fb4a4066510 msgr2=0x7fb4a40689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:30.528 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:30.523+0000 7fb4bd784700 1 --2- 172.21.15.32:0/1091938199 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fb4a4066510 0x7fb4a40689d0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fb4a8000c00 tx=0x7fb4a8008030 comp rx=0 tx=0).stop 2023-10-08T06:10:30.528 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:30.523+0000 7fb4bd784700 1 -- 172.21.15.32:0/1091938199 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb4b80ca180 msgr2=0x7fb4b815b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:30.528 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:30.523+0000 7fb4bd784700 1 --2- 172.21.15.32:0/1091938199 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb4b80ca180 0x7fb4b815b550 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fb4ac00e9a0 tx=0x7fb4ac00ecb0 comp rx=0 tx=0).stop 2023-10-08T06:10:30.528 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:30.523+0000 7fb4bd784700 1 -- 172.21.15.32:0/1091938199 shutdown_connections 2023-10-08T06:10:30.528 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:30.523+0000 7fb4bd784700 1 --2- 172.21.15.32:0/1091938199 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fb4a4066510 0x7fb4a40689d0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:30.529 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:30.523+0000 7fb4bd784700 1 --2- 172.21.15.32:0/1091938199 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb4b80ca180 0x7fb4b815b550 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:30.529 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:30.523+0000 7fb4bd784700 1 --2- 172.21.15.32:0/1091938199 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb4b815d4f0 0x7fb4b806a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:30.529 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:30.523+0000 7fb4bd784700 1 --2- 172.21.15.32:0/1091938199 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb4b8070620 0x7fb4b815d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:30.529 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:30.523+0000 7fb4bd784700 1 -- 172.21.15.32:0/1091938199 >> 172.21.15.32:0/1091938199 conn(0x7fb4b80cc070 msgr2=0x7fb4b80acd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:10:30.529 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:30.523+0000 7fb4bd784700 1 -- 172.21.15.32:0/1091938199 shutdown_connections 2023-10-08T06:10:30.529 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:30.523+0000 7fb4bd784700 1 -- 172.21.15.32:0/1091938199 wait complete. 2023-10-08T06:10:30.542 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-10-08T06:10:30.655 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:30.651+0000 7f1db933b700 1 Processor -- start 2023-10-08T06:10:30.655 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:30.651+0000 7f1db933b700 1 -- start start 2023-10-08T06:10:30.662 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:30.655+0000 7f1db933b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1db41617a0 0x7f1db40cba80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:30.662 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:30.655+0000 7f1db933b700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f1db40ce7a0 0x7f1db40cc990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:30.662 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:30.655+0000 7f1db933b700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1db4166040 con 0x7f1db40cbfc0 2023-10-08T06:10:30.662 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:30.655+0000 7f1db933b700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1db40cec10 con 0x7f1db40ce7a0 2023-10-08T06:10:30.662 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:30.655+0000 7f1db933b700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1db4165430 con 0x7f1db41617a0 2023-10-08T06:10:30.663 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:30.655+0000 7f1db37fe700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f1db40ce7a0 0x7f1db40cc990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:30.663 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:30.655+0000 7f1daa7fc700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f1db40cbfc0 0x7f1db40ce090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:54050/0 (socket says 172.21.15.32:54050) 2023-10-08T06:10:30.663 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:30.655+0000 7f1daa7fc700 1 -- 172.21.15.32:0/4074167655 learned_addr learned my addr 172.21.15.32:0/4074167655 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-08T06:10:30.663 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:30.655+0000 7f1db2ffd700 1 --2- 172.21.15.32:0/4074167655 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1db41617a0 0x7f1db40cba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:30.663 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:30.655+0000 7f1db27fc700 1 -- 172.21.15.32:0/4074167655 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1812315479 0 0) 0x7f1db4166040 con 0x7f1db40cbfc0 2023-10-08T06:10:30.663 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:30.655+0000 7f1db37fe700 1 -- 172.21.15.32:0/4074167655 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1db41617a0 msgr2=0x7f1db40cba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:10:30.664 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:30.655+0000 7f1db37fe700 1 --2- 172.21.15.32:0/4074167655 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1db41617a0 0x7f1db40cba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:30.664 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:30.655+0000 7f1db37fe700 1 -- 172.21.15.32:0/4074167655 >> v1:172.21.15.32:6789/0 conn(0x7f1db40cbfc0 legacy=0x7f1db40ce090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:30.664 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:30.655+0000 7f1db37fe700 1 -- 172.21.15.32:0/4074167655 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1db40cc420 con 0x7f1db40ce7a0 2023-10-08T06:10:30.664 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:30.655+0000 7f1db37fe700 1 --2- 172.21.15.32:0/4074167655 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1db40ce7a0 0x7f1db40cc990 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f1dac009d90 tx=0x7f1dac00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fbc94604c70f9a9 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:30.664 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:30.655+0000 7f1db27fc700 1 -- 172.21.15.32:0/4074167655 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dac00e070 con 0x7f1db40ce7a0 2023-10-08T06:10:30.664 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:30.655+0000 7f1db27fc700 1 -- 172.21.15.32:0/4074167655 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dac00bb20 con 0x7f1db40ce7a0 2023-10-08T06:10:30.664 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:30.655+0000 7f1db27fc700 1 -- 172.21.15.32:0/4074167655 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dac012430 con 0x7f1db40ce7a0 2023-10-08T06:10:30.664 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:30.655+0000 7f1db933b700 1 -- 172.21.15.32:0/4074167655 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1db40ce7a0 msgr2=0x7f1db40cc990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:30.664 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:30.655+0000 7f1db933b700 1 --2- 172.21.15.32:0/4074167655 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1db40ce7a0 0x7f1db40cc990 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f1dac009d90 tx=0x7f1dac00b330 comp rx=0 tx=0).stop 2023-10-08T06:10:30.665 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:30.655+0000 7f1db933b700 1 -- 172.21.15.32:0/4074167655 shutdown_connections 2023-10-08T06:10:30.665 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:30.655+0000 7f1db933b700 1 --2- 172.21.15.32:0/4074167655 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1db40ce7a0 0x7f1db40cc990 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:30.665 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:30.655+0000 7f1db933b700 1 --2- 172.21.15.32:0/4074167655 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1db41617a0 0x7f1db40cba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:30.665 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:30.655+0000 7f1db933b700 1 -- 172.21.15.32:0/4074167655 >> 172.21.15.32:0/4074167655 conn(0x7f1db406a480 msgr2=0x7f1db406a890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:10:30.665 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:30.655+0000 7f1db933b700 1 -- 172.21.15.32:0/4074167655 shutdown_connections 2023-10-08T06:10:30.665 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:30.655+0000 7f1db933b700 1 -- 172.21.15.32:0/4074167655 wait complete. 2023-10-08T06:10:30.665 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:30.659+0000 7f1db933b700 1 Processor -- start 2023-10-08T06:10:30.665 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:30.659+0000 7f1db933b700 1 -- start start 2023-10-08T06:10:30.668 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:30.663+0000 7f1db933b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1db40cbfc0 0x7f1db40af920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:30.668 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:30.663+0000 7f1db933b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1db40ce7a0 0x7f1db414b440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:30.668 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:30.663+0000 7f1db933b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1db41617a0 0x7f1db414b980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:30.668 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:30.663+0000 7f1db933b700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1db40b0370 con 0x7f1db40cbfc0 2023-10-08T06:10:30.668 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:30.663+0000 7f1db933b700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1db40b0650 con 0x7f1db40ce7a0 2023-10-08T06:10:30.668 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:30.663+0000 7f1db933b700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1db40b0930 con 0x7f1db41617a0 2023-10-08T06:10:30.668 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:30.663+0000 7f1db2ffd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1db40cbfc0 0x7f1db40af920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:30.668 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:30.663+0000 7f1db2ffd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1db40cbfc0 0x7f1db40af920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:33724/0 (socket says 172.21.15.32:33724) 2023-10-08T06:10:30.668 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:30.663+0000 7f1db2ffd700 1 -- 172.21.15.32:0/3313938401 learned_addr learned my addr 172.21.15.32:0/3313938401 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:10:30.668 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:30.663+0000 7f1daa7fc700 1 --2- 172.21.15.32:0/3313938401 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1db40ce7a0 0x7f1db414b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:30.669 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:30.663+0000 7f1db37fe700 1 --2- 172.21.15.32:0/3313938401 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1db41617a0 0x7f1db414b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:30.669 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:30.663+0000 7f1db2ffd700 1 -- 172.21.15.32:0/3313938401 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1db41617a0 msgr2=0x7f1db414b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:30.669 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:30.663+0000 7f1db2ffd700 1 --2- 172.21.15.32:0/3313938401 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1db41617a0 0x7f1db414b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:30.669 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:30.663+0000 7f1db2ffd700 1 -- 172.21.15.32:0/3313938401 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1db40ce7a0 msgr2=0x7f1db414b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:30.669 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:30.663+0000 7f1db2ffd700 1 --2- 172.21.15.32:0/3313938401 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1db40ce7a0 0x7f1db414b440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:30.669 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:30.663+0000 7f1db2ffd700 1 -- 172.21.15.32:0/3313938401 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dac009a70 con 0x7f1db40cbfc0 2023-10-08T06:10:30.669 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:30.663+0000 7f1db37fe700 1 --2- 172.21.15.32:0/3313938401 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1db41617a0 0x7f1db414b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T06:10:30.669 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:30.663+0000 7f1db2ffd700 1 --2- 172.21.15.32:0/3313938401 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1db40cbfc0 0x7f1db40af920 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f1da400e840 tx=0x7f1da400eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:30.669 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:30.663+0000 7f1dabfff700 1 -- 172.21.15.32:0/3313938401 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1da40095a0 con 0x7f1db40cbfc0 2023-10-08T06:10:30.670 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:30.663+0000 7f1dabfff700 1 -- 172.21.15.32:0/3313938401 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1da4013680 con 0x7f1db40cbfc0 2023-10-08T06:10:30.670 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:30.663+0000 7f1db933b700 1 -- 172.21.15.32:0/3313938401 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1db40b0c10 con 0x7f1db40cbfc0 2023-10-08T06:10:30.670 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:30.663+0000 7f1dabfff700 1 -- 172.21.15.32:0/3313938401 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1da40139f0 con 0x7f1db40cbfc0 2023-10-08T06:10:30.670 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:30.663+0000 7f1db933b700 1 -- 172.21.15.32:0/3313938401 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1db40afe60 con 0x7f1db40cbfc0 2023-10-08T06:10:30.670 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:30.663+0000 7f1db933b700 1 -- 172.21.15.32:0/3313938401 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1db4073f00 con 0x7f1db40cbfc0 2023-10-08T06:10:30.670 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:30.663+0000 7f1dabfff700 1 -- 172.21.15.32:0/3313938401 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f1da4013b50 con 0x7f1db40cbfc0 2023-10-08T06:10:30.670 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:30.667+0000 7f1dabfff700 1 --2- 172.21.15.32:0/3313938401 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f1d94066510 0x7f1d940689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:30.671 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:30.667+0000 7f1dabfff700 1 -- 172.21.15.32:0/3313938401 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f1da4083a30 con 0x7f1db40cbfc0 2023-10-08T06:10:30.671 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:30.667+0000 7f1daa7fc700 1 --2- 172.21.15.32:0/3313938401 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f1d94066510 0x7f1d940689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:30.671 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:30.667+0000 7f1daa7fc700 1 --2- 172.21.15.32:0/3313938401 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f1d94066510 0x7f1d940689d0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f1db40b2240 tx=0x7f1d9c007e00 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:30.675 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:30.671+0000 7f1dabfff700 1 -- 172.21.15.32:0/3313938401 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f1da4051200 con 0x7f1db40cbfc0 2023-10-08T06:10:30.909 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:30.907+0000 7f1db933b700 1 -- 172.21.15.32:0/3313938401 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7f1db4165ca0 con 0x7f1db40cbfc0 2023-10-08T06:10:30.913 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:30.911+0000 7f1dabfff700 1 -- 172.21.15.32:0/3313938401 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v4) v1 ==== 90+0+0 (secure 0 0 0) 0x7f1da4054820 con 0x7f1db40cbfc0 2023-10-08T06:10:30.916 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:30.915+0000 7f1db933b700 1 -- 172.21.15.32:0/3313938401 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f1d94066510 msgr2=0x7f1d940689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:30.916 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:30.915+0000 7f1db933b700 1 --2- 172.21.15.32:0/3313938401 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f1d94066510 0x7f1d940689d0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f1db40b2240 tx=0x7f1d9c007e00 comp rx=0 tx=0).stop 2023-10-08T06:10:30.916 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:30.915+0000 7f1db933b700 1 -- 172.21.15.32:0/3313938401 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1db40cbfc0 msgr2=0x7f1db40af920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:30.916 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:30.915+0000 7f1db933b700 1 --2- 172.21.15.32:0/3313938401 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1db40cbfc0 0x7f1db40af920 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f1da400e840 tx=0x7f1da400eb50 comp rx=0 tx=0).stop 2023-10-08T06:10:30.916 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:30.915+0000 7f1db933b700 1 -- 172.21.15.32:0/3313938401 shutdown_connections 2023-10-08T06:10:30.917 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:30.915+0000 7f1db933b700 1 --2- 172.21.15.32:0/3313938401 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f1d94066510 0x7f1d940689d0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:30.917 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:30.915+0000 7f1db933b700 1 --2- 172.21.15.32:0/3313938401 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1db41617a0 0x7f1db414b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:30.917 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:30.915+0000 7f1db933b700 1 --2- 172.21.15.32:0/3313938401 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1db40ce7a0 0x7f1db414b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:30.917 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:30.915+0000 7f1db933b700 1 --2- 172.21.15.32:0/3313938401 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1db40cbfc0 0x7f1db40af920 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:30.917 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:30.915+0000 7f1db933b700 1 -- 172.21.15.32:0/3313938401 >> 172.21.15.32:0/3313938401 conn(0x7f1db406a480 msgr2=0x7f1db40aeac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:10:30.917 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:30.915+0000 7f1db933b700 1 -- 172.21.15.32:0/3313938401 shutdown_connections 2023-10-08T06:10:30.917 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:30.915+0000 7f1db933b700 1 -- 172.21.15.32:0/3313938401 wait complete. 2023-10-08T06:10:30.929 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-10-08T06:10:31.041 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:31.039+0000 7f834bfff700 1 Processor -- start 2023-10-08T06:10:31.042 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:31.039+0000 7f834bfff700 1 -- start start 2023-10-08T06:10:31.044 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:31.039+0000 7f834bfff700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f834c06b3b0 0x7f834c0c9ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:31.044 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:31.043+0000 7f834bfff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f834c15aed0 0x7f834c06b790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:31.044 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:31.043+0000 7f834bfff700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f834c0ca000 con 0x7f834c15da90 2023-10-08T06:10:31.044 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:31.043+0000 7f834bfff700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f834c0cb300 con 0x7f834c06b3b0 2023-10-08T06:10:31.044 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:31.043+0000 7f834bfff700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f834c06bcd0 con 0x7f834c15aed0 2023-10-08T06:10:31.044 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:31.043+0000 7f834affd700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f834c06b3b0 0x7f834c0c9ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:31.044 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:31.043+0000 7f834affd700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f834c06b3b0 0x7f834c0c9ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:33726/0 (socket says 172.21.15.32:33726) 2023-10-08T06:10:31.045 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:31.043+0000 7f834affd700 1 -- 172.21.15.32:0/2452981476 learned_addr learned my addr 172.21.15.32:0/2452981476 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:10:31.045 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:31.043+0000 7f834a7fc700 1 --2- 172.21.15.32:0/2452981476 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f834c15aed0 0x7f834c06b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:31.046 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:31.043+0000 7f8349ffb700 1 -- 172.21.15.32:0/2452981476 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3906298382 0 0) 0x7f834c0ca000 con 0x7f834c15da90 2023-10-08T06:10:31.046 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:31.043+0000 7f8349ffb700 1 -- 172.21.15.32:0/2452981476 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f83340035d0 con 0x7f834c15da90 2023-10-08T06:10:31.046 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:31.043+0000 7f834affd700 1 -- 172.21.15.32:0/2452981476 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f834c15aed0 msgr2=0x7f834c06b790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:10:31.046 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:31.043+0000 7f834affd700 1 --2- 172.21.15.32:0/2452981476 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f834c15aed0 0x7f834c06b790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:31.046 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:31.043+0000 7f834affd700 1 -- 172.21.15.32:0/2452981476 >> v1:172.21.15.32:6789/0 conn(0x7f834c15da90 legacy=0x7f834c15df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:31.046 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:31.043+0000 7f834affd700 1 -- 172.21.15.32:0/2452981476 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f834c0ca260 con 0x7f834c06b3b0 2023-10-08T06:10:31.046 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:31.043+0000 7f834affd700 1 --2- 172.21.15.32:0/2452981476 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f834c06b3b0 0x7f834c0c9ac0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f833c009910 tx=0x7f833c009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4dce52c5920053ff server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:31.046 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:31.043+0000 7f8349ffb700 1 -- 172.21.15.32:0/2452981476 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f833c011830 con 0x7f834c06b3b0 2023-10-08T06:10:31.047 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:31.043+0000 7f8349ffb700 1 -- 172.21.15.32:0/2452981476 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f833c011990 con 0x7f834c06b3b0 2023-10-08T06:10:31.047 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:31.043+0000 7f8349ffb700 1 -- 172.21.15.32:0/2452981476 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f833c011d40 con 0x7f834c06b3b0 2023-10-08T06:10:31.047 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:31.043+0000 7f834bfff700 1 -- 172.21.15.32:0/2452981476 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f834c06b3b0 msgr2=0x7f834c0c9ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:31.047 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:31.043+0000 7f834bfff700 1 --2- 172.21.15.32:0/2452981476 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f834c06b3b0 0x7f834c0c9ac0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f833c009910 tx=0x7f833c009c20 comp rx=0 tx=0).stop 2023-10-08T06:10:31.048 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:31.043+0000 7f834bfff700 1 -- 172.21.15.32:0/2452981476 shutdown_connections 2023-10-08T06:10:31.048 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:31.043+0000 7f834bfff700 1 --2- 172.21.15.32:0/2452981476 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f834c15aed0 0x7f834c06b790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:31.048 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:31.043+0000 7f834bfff700 1 --2- 172.21.15.32:0/2452981476 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f834c06b3b0 0x7f834c0c9ac0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:31.048 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:31.043+0000 7f834bfff700 1 -- 172.21.15.32:0/2452981476 >> 172.21.15.32:0/2452981476 conn(0x7f834c0cf470 msgr2=0x7f834c0cf880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:10:31.048 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:31.043+0000 7f834bfff700 1 -- 172.21.15.32:0/2452981476 shutdown_connections 2023-10-08T06:10:31.048 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:31.043+0000 7f834bfff700 1 -- 172.21.15.32:0/2452981476 wait complete. 2023-10-08T06:10:31.049 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:31.047+0000 7f834bfff700 1 Processor -- start 2023-10-08T06:10:31.049 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:31.047+0000 7f834bfff700 1 -- start start 2023-10-08T06:10:31.053 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:31.047+0000 7f834bfff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f834c06b3b0 0x7f834c0cdad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:31.053 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:31.047+0000 7f834bfff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f834c15aed0 0x7f834c0cc4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:31.054 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:31.047+0000 7f834bfff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f834c15da90 0x7f834c146920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:31.054 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:31.047+0000 7f834bfff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f834c0c4a80 con 0x7f834c15aed0 2023-10-08T06:10:31.054 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:31.047+0000 7f834bfff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f834c0c4170 con 0x7f834c15da90 2023-10-08T06:10:31.054 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:31.047+0000 7f834bfff700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f834c0c4430 con 0x7f834c06b3b0 2023-10-08T06:10:31.054 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:31.047+0000 7f834a7fc700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f834c15aed0 0x7f834c0cc4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:31.054 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:31.047+0000 7f834a7fc700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f834c15aed0 0x7f834c0cc4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:33738/0 (socket says 172.21.15.32:33738) 2023-10-08T06:10:31.054 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:31.047+0000 7f834a7fc700 1 -- 172.21.15.32:0/477151359 learned_addr learned my addr 172.21.15.32:0/477151359 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:10:31.054 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:31.047+0000 7f834b7fe700 1 --2- 172.21.15.32:0/477151359 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f834c15da90 0x7f834c146920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:31.054 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:31.047+0000 7f834affd700 1 --2- 172.21.15.32:0/477151359 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f834c06b3b0 0x7f834c0cdad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:31.054 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:31.047+0000 7f834a7fc700 1 -- 172.21.15.32:0/477151359 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f834c06b3b0 msgr2=0x7f834c0cdad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:31.054 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:31.047+0000 7f834a7fc700 1 --2- 172.21.15.32:0/477151359 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f834c06b3b0 0x7f834c0cdad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:31.055 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:31.047+0000 7f834a7fc700 1 -- 172.21.15.32:0/477151359 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f834c15da90 msgr2=0x7f834c146920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:31.055 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:31.047+0000 7f834a7fc700 1 --2- 172.21.15.32:0/477151359 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f834c15da90 0x7f834c146920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:31.055 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:31.047+0000 7f834a7fc700 1 -- 172.21.15.32:0/477151359 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f833c009570 con 0x7f834c15aed0 2023-10-08T06:10:31.055 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:31.047+0000 7f834b7fe700 1 --2- 172.21.15.32:0/477151359 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f834c15da90 0x7f834c146920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T06:10:31.055 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:31.051+0000 7f834a7fc700 1 --2- 172.21.15.32:0/477151359 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f834c15aed0 0x7f834c0cc4e0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f834000e9d0 tx=0x7f834000ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:31.055 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:31.051+0000 7f83337fe700 1 -- 172.21.15.32:0/477151359 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8340009720 con 0x7f834c15aed0 2023-10-08T06:10:31.055 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:31.051+0000 7f83337fe700 1 -- 172.21.15.32:0/477151359 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f834000ee70 con 0x7f834c15aed0 2023-10-08T06:10:31.055 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:31.051+0000 7f834bfff700 1 -- 172.21.15.32:0/477151359 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f834c0c4710 con 0x7f834c15aed0 2023-10-08T06:10:31.055 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:31.051+0000 7f83337fe700 1 -- 172.21.15.32:0/477151359 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f834000ca50 con 0x7f834c15aed0 2023-10-08T06:10:31.056 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:31.051+0000 7f834bfff700 1 -- 172.21.15.32:0/477151359 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f834c146e60 con 0x7f834c15aed0 2023-10-08T06:10:31.056 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:31.051+0000 7f834bfff700 1 -- 172.21.15.32:0/477151359 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f834c0c4bf0 con 0x7f834c15aed0 2023-10-08T06:10:31.056 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:31.051+0000 7f83337fe700 1 -- 172.21.15.32:0/477151359 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f834000cbb0 con 0x7f834c15aed0 2023-10-08T06:10:31.057 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:31.051+0000 7f83337fe700 1 --2- 172.21.15.32:0/477151359 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f8338066510 0x7f83380689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:31.057 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:31.051+0000 7f83337fe700 1 -- 172.21.15.32:0/477151359 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f8340083bd0 con 0x7f834c15aed0 2023-10-08T06:10:31.057 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:31.051+0000 7f834affd700 1 --2- 172.21.15.32:0/477151359 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f8338066510 0x7f83380689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:31.057 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:31.055+0000 7f834affd700 1 --2- 172.21.15.32:0/477151359 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f8338066510 0x7f83380689d0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f833c000c00 tx=0x7f833c008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:31.062 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:31.059+0000 7f83337fe700 1 -- 172.21.15.32:0/477151359 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f8340051300 con 0x7f834c15aed0 2023-10-08T06:10:31.282 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:31.279+0000 7f834bfff700 1 -- 172.21.15.32:0/477151359 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7f834c0686a0 con 0x7f834c15aed0 2023-10-08T06:10:31.287 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:31.283+0000 7f83337fe700 1 -- 172.21.15.32:0/477151359 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v5) v1 ==== 90+0+0 (secure 0 0 0) 0x7f834000ce60 con 0x7f834c15aed0 2023-10-08T06:10:31.290 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:31.287+0000 7f834bfff700 1 -- 172.21.15.32:0/477151359 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f8338066510 msgr2=0x7f83380689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:31.290 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:31.287+0000 7f834bfff700 1 --2- 172.21.15.32:0/477151359 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f8338066510 0x7f83380689d0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f833c000c00 tx=0x7f833c008030 comp rx=0 tx=0).stop 2023-10-08T06:10:31.290 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:31.287+0000 7f834bfff700 1 -- 172.21.15.32:0/477151359 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f834c15aed0 msgr2=0x7f834c0cc4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:31.290 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:31.287+0000 7f834bfff700 1 --2- 172.21.15.32:0/477151359 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f834c15aed0 0x7f834c0cc4e0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f834000e9d0 tx=0x7f834000ece0 comp rx=0 tx=0).stop 2023-10-08T06:10:31.291 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:31.287+0000 7f834bfff700 1 -- 172.21.15.32:0/477151359 shutdown_connections 2023-10-08T06:10:31.291 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:31.287+0000 7f834bfff700 1 --2- 172.21.15.32:0/477151359 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f8338066510 0x7f83380689d0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:31.291 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:31.287+0000 7f834bfff700 1 --2- 172.21.15.32:0/477151359 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f834c15aed0 0x7f834c0cc4e0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:31.291 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:31.287+0000 7f834bfff700 1 --2- 172.21.15.32:0/477151359 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f834c15da90 0x7f834c146920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:31.291 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:31.287+0000 7f834bfff700 1 --2- 172.21.15.32:0/477151359 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f834c06b3b0 0x7f834c0cdad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:31.291 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:31.287+0000 7f834bfff700 1 -- 172.21.15.32:0/477151359 >> 172.21.15.32:0/477151359 conn(0x7f834c0cf470 msgr2=0x7f834c0c8550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:10:31.291 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:31.287+0000 7f834bfff700 1 -- 172.21.15.32:0/477151359 shutdown_connections 2023-10-08T06:10:31.292 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:31.287+0000 7f834bfff700 1 -- 172.21.15.32:0/477151359 wait complete. 2023-10-08T06:10:31.303 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-10-08T06:10:31.425 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:31.423+0000 7fbb89fc6700 1 Processor -- start 2023-10-08T06:10:31.425 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:31.423+0000 7fbb89fc6700 1 -- start start 2023-10-08T06:10:31.426 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:31.423+0000 7fbb89fc6700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbb840719e0 0x7fbb840c9420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:31.427 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:31.423+0000 7fbb89fc6700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb8406fc20 con 0x7fbb840c9960 2023-10-08T06:10:31.427 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:31.423+0000 7fbb89fc6700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb840c9da0 con 0x7fbb8415b980 2023-10-08T06:10:31.427 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:31.423+0000 7fbb89fc6700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb84070430 con 0x7fbb840719e0 2023-10-08T06:10:31.427 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:31.423+0000 7fbb897c5700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fbb840c9960 0x7fbb8415bd60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:54062/0 (socket says 172.21.15.32:54062) 2023-10-08T06:10:31.427 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:31.423+0000 7fbb897c5700 1 -- 172.21.15.32:0/2871441670 learned_addr learned my addr 172.21.15.32:0/2871441670 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-08T06:10:31.427 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:31.423+0000 7fbb83fff700 1 --2- 172.21.15.32:0/2871441670 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbb840719e0 0x7fbb840c9420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:31.428 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:31.423+0000 7fbb837fe700 1 -- 172.21.15.32:0/2871441670 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1801611581 0 0) 0x7fbb8406fc20 con 0x7fbb840c9960 2023-10-08T06:10:31.428 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:31.423+0000 7fbb837fe700 1 -- 172.21.15.32:0/2871441670 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbb700035d0 con 0x7fbb840c9960 2023-10-08T06:10:31.428 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:31.423+0000 7fbb83fff700 1 -- 172.21.15.32:0/2871441670 >> v1:172.21.15.40:6789/0 conn(0x7fbb8415b980 legacy=0x7fbb8415f780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:31.428 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:31.423+0000 7fbb83fff700 1 -- 172.21.15.32:0/2871441670 >> v1:172.21.15.32:6789/0 conn(0x7fbb840c9960 legacy=0x7fbb8415bd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:31.428 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:31.423+0000 7fbb83fff700 1 -- 172.21.15.32:0/2871441670 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb8406fe70 con 0x7fbb840719e0 2023-10-08T06:10:31.428 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:31.427+0000 7fbb83fff700 1 --2- 172.21.15.32:0/2871441670 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbb840719e0 0x7fbb840c9420 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fbb74009dc0 tx=0x7fbb7400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8b0454d966ae2d83 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:31.428 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:31.427+0000 7fbb837fe700 1 -- 172.21.15.32:0/2871441670 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb7400e070 con 0x7fbb840719e0 2023-10-08T06:10:31.429 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:31.427+0000 7fbb837fe700 1 -- 172.21.15.32:0/2871441670 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb7400bb20 con 0x7fbb840719e0 2023-10-08T06:10:31.429 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:31.427+0000 7fbb837fe700 1 -- 172.21.15.32:0/2871441670 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb74012430 con 0x7fbb840719e0 2023-10-08T06:10:31.429 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:31.427+0000 7fbb89fc6700 1 -- 172.21.15.32:0/2871441670 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbb840719e0 msgr2=0x7fbb840c9420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:31.429 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:31.427+0000 7fbb89fc6700 1 --2- 172.21.15.32:0/2871441670 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbb840719e0 0x7fbb840c9420 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fbb74009dc0 tx=0x7fbb7400b330 comp rx=0 tx=0).stop 2023-10-08T06:10:31.430 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:31.427+0000 7fbb89fc6700 1 -- 172.21.15.32:0/2871441670 shutdown_connections 2023-10-08T06:10:31.430 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:31.427+0000 7fbb89fc6700 1 --2- 172.21.15.32:0/2871441670 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbb840719e0 0x7fbb840c9420 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:31.430 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:31.427+0000 7fbb89fc6700 1 -- 172.21.15.32:0/2871441670 >> 172.21.15.32:0/2871441670 conn(0x7fbb840b0900 msgr2=0x7fbb840b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:10:31.430 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:31.427+0000 7fbb89fc6700 1 -- 172.21.15.32:0/2871441670 shutdown_connections 2023-10-08T06:10:31.430 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:31.427+0000 7fbb89fc6700 1 -- 172.21.15.32:0/2871441670 wait complete. 2023-10-08T06:10:31.430 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:31.427+0000 7fbb89fc6700 1 Processor -- start 2023-10-08T06:10:31.431 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:31.427+0000 7fbb89fc6700 1 -- start start 2023-10-08T06:10:31.432 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:31.431+0000 7fbb89fc6700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbb840719e0 0x7fbb841e4400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:31.432 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:31.431+0000 7fbb89fc6700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbb840c9960 0x7fbb8406bda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:31.432 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:31.431+0000 7fbb89fc6700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbb8415b980 0x7fbb84151300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:31.432 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:31.431+0000 7fbb89fc6700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb8406c2e0 con 0x7fbb840c9960 2023-10-08T06:10:31.432 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:31.431+0000 7fbb89fc6700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb841f0480 con 0x7fbb8415b980 2023-10-08T06:10:31.432 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:31.431+0000 7fbb89fc6700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb841f0710 con 0x7fbb840719e0 2023-10-08T06:10:31.433 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:31.431+0000 7fbb83fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbb840c9960 0x7fbb8406bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:31.433 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:31.431+0000 7fbb88fc4700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbb840719e0 0x7fbb841e4400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:31.433 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:31.431+0000 7fbb83fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbb840c9960 0x7fbb8406bda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:33740/0 (socket says 172.21.15.32:33740) 2023-10-08T06:10:31.434 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:31.431+0000 7fbb88fc4700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbb840719e0 0x7fbb841e4400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.32:37292/0 (socket says 172.21.15.32:37292) 2023-10-08T06:10:31.434 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:31.431+0000 7fbb897c5700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbb8415b980 0x7fbb84151300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:31.434 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:31.431+0000 7fbb88fc4700 1 -- 172.21.15.32:0/2008663907 learned_addr learned my addr 172.21.15.32:0/2008663907 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:10:31.434 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:31.431+0000 7fbb83fff700 1 -- 172.21.15.32:0/2008663907 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbb840719e0 msgr2=0x7fbb841e4400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:31.434 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:31.431+0000 7fbb83fff700 1 --2- 172.21.15.32:0/2008663907 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbb840719e0 0x7fbb841e4400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:31.434 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:31.431+0000 7fbb83fff700 1 -- 172.21.15.32:0/2008663907 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbb8415b980 msgr2=0x7fbb84151300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:31.434 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:31.431+0000 7fbb83fff700 1 --2- 172.21.15.32:0/2008663907 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbb8415b980 0x7fbb84151300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:31.434 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:31.431+0000 7fbb83fff700 1 -- 172.21.15.32:0/2008663907 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb74009a70 con 0x7fbb840c9960 2023-10-08T06:10:31.434 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:31.431+0000 7fbb897c5700 1 --2- 172.21.15.32:0/2008663907 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbb8415b980 0x7fbb84151300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T06:10:31.434 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:31.431+0000 7fbb88fc4700 1 --2- 172.21.15.32:0/2008663907 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbb840719e0 0x7fbb841e4400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T06:10:31.434 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:31.431+0000 7fbb83fff700 1 --2- 172.21.15.32:0/2008663907 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbb840c9960 0x7fbb8406bda0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fbb74016000 tx=0x7fbb74004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:31.435 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:31.431+0000 7fbb817fa700 1 -- 172.21.15.32:0/2008663907 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb74012430 con 0x7fbb840c9960 2023-10-08T06:10:31.435 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:31.431+0000 7fbb817fa700 1 -- 172.21.15.32:0/2008663907 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb74020070 con 0x7fbb840c9960 2023-10-08T06:10:31.435 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:31.431+0000 7fbb89fc6700 1 -- 172.21.15.32:0/2008663907 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb841f09f0 con 0x7fbb840c9960 2023-10-08T06:10:31.435 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:31.431+0000 7fbb817fa700 1 -- 172.21.15.32:0/2008663907 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb74004280 con 0x7fbb840c9960 2023-10-08T06:10:31.435 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:31.431+0000 7fbb89fc6700 1 -- 172.21.15.32:0/2008663907 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb841f0fb0 con 0x7fbb840c9960 2023-10-08T06:10:31.436 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:31.435+0000 7fbb89fc6700 1 -- 172.21.15.32:0/2008663907 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb84073f00 con 0x7fbb840c9960 2023-10-08T06:10:31.437 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:31.435+0000 7fbb817fa700 1 -- 172.21.15.32:0/2008663907 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fbb740043e0 con 0x7fbb840c9960 2023-10-08T06:10:31.438 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:31.435+0000 7fbb817fa700 1 --2- 172.21.15.32:0/2008663907 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fbb64066510 0x7fbb640689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:31.438 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:31.435+0000 7fbb817fa700 1 -- 172.21.15.32:0/2008663907 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fbb74022070 con 0x7fbb840c9960 2023-10-08T06:10:31.438 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:31.435+0000 7fbb88fc4700 1 --2- 172.21.15.32:0/2008663907 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fbb64066510 0x7fbb640689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:31.439 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:31.435+0000 7fbb88fc4700 1 --2- 172.21.15.32:0/2008663907 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fbb64066510 0x7fbb640689d0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fbb6c001c90 tx=0x7fbb6c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:31.443 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:31.443+0000 7fbb817fa700 1 -- 172.21.15.32:0/2008663907 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fbb740536f0 con 0x7fbb840c9960 2023-10-08T06:10:31.669 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:31.667+0000 7fbb89fc6700 1 -- 172.21.15.32:0/2008663907 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7fbb84154d70 con 0x7fbb840c9960 2023-10-08T06:10:31.673 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:31.671+0000 7fbb817fa700 1 -- 172.21.15.32:0/2008663907 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v6) v1 ==== 90+0+0 (secure 0 0 0) 0x7fbb74056d10 con 0x7fbb840c9960 2023-10-08T06:10:31.678 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:31.675+0000 7fbb89fc6700 1 -- 172.21.15.32:0/2008663907 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fbb64066510 msgr2=0x7fbb640689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:31.678 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:31.675+0000 7fbb89fc6700 1 --2- 172.21.15.32:0/2008663907 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fbb64066510 0x7fbb640689d0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fbb6c001c90 tx=0x7fbb6c009040 comp rx=0 tx=0).stop 2023-10-08T06:10:31.678 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:31.675+0000 7fbb89fc6700 1 -- 172.21.15.32:0/2008663907 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbb840c9960 msgr2=0x7fbb8406bda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:31.678 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:31.675+0000 7fbb89fc6700 1 --2- 172.21.15.32:0/2008663907 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbb840c9960 0x7fbb8406bda0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fbb74016000 tx=0x7fbb74004af0 comp rx=0 tx=0).stop 2023-10-08T06:10:31.678 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:31.675+0000 7fbb89fc6700 1 -- 172.21.15.32:0/2008663907 shutdown_connections 2023-10-08T06:10:31.678 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:31.675+0000 7fbb89fc6700 1 --2- 172.21.15.32:0/2008663907 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fbb64066510 0x7fbb640689d0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:31.678 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:31.675+0000 7fbb89fc6700 1 --2- 172.21.15.32:0/2008663907 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbb840c9960 0x7fbb8406bda0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:31.679 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:31.675+0000 7fbb89fc6700 1 --2- 172.21.15.32:0/2008663907 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbb8415b980 0x7fbb84151300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:31.679 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:31.675+0000 7fbb89fc6700 1 --2- 172.21.15.32:0/2008663907 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbb840719e0 0x7fbb841e4400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:31.679 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:31.675+0000 7fbb89fc6700 1 -- 172.21.15.32:0/2008663907 >> 172.21.15.32:0/2008663907 conn(0x7fbb840b0900 msgr2=0x7fbb841541c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:10:31.681 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:31.675+0000 7fbb89fc6700 1 -- 172.21.15.32:0/2008663907 shutdown_connections 2023-10-08T06:10:31.681 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:31.675+0000 7fbb89fc6700 1 -- 172.21.15.32:0/2008663907 wait complete. 2023-10-08T06:10:31.692 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-10-08T06:10:31.808 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:31.807+0000 7f489e0a0700 1 Processor -- start 2023-10-08T06:10:31.808 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:31.807+0000 7f489e0a0700 1 -- start start 2023-10-08T06:10:31.810 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:31.807+0000 7f489e0a0700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f48980c4340 0x7f48981651b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:31.810 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:31.807+0000 7f489e0a0700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f48980cddb0 0x7f48980b3300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:31.810 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:31.807+0000 7f489e0a0700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f489806cff0 con 0x7f48980cea40 2023-10-08T06:10:31.810 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:31.807+0000 7f489e0a0700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f489806d2d0 con 0x7f48980cddb0 2023-10-08T06:10:31.810 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:31.807+0000 7f489e0a0700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48980d0830 con 0x7f48980c4340 2023-10-08T06:10:31.810 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:31.807+0000 7f489d89f700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f48980cddb0 0x7f48980b3300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:31.810 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:31.807+0000 7f489d09e700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f48980c4340 0x7f48981651b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:31.810 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:31.807+0000 7f489d89f700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f48980cddb0 0x7f48980b3300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:33744/0 (socket says 172.21.15.32:33744) 2023-10-08T06:10:31.810 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:31.807+0000 7f489c89d700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f48980cea40 0x7f48980cd6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.32:35048/0 (socket says 172.21.15.32:35048) 2023-10-08T06:10:31.811 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:31.807+0000 7f489d89f700 1 -- 172.21.15.32:0/3230083840 learned_addr learned my addr 172.21.15.32:0/3230083840 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:10:31.812 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:31.807+0000 7f489d89f700 1 -- 172.21.15.32:0/3230083840 >> v2:172.21.15.40:3300/0 conn(0x7f48980c4340 msgr2=0x7f48981651b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:10:31.812 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:31.807+0000 7f489d89f700 1 --2- 172.21.15.32:0/3230083840 >> v2:172.21.15.40:3300/0 conn(0x7f48980c4340 0x7f48981651b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:31.812 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:31.807+0000 7f489d89f700 1 -- 172.21.15.32:0/3230083840 >> v1:172.21.15.40:6789/0 conn(0x7f48980cea40 legacy=0x7f48980cd6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:31.812 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:31.807+0000 7f489d89f700 1 -- 172.21.15.32:0/3230083840 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48980c4720 con 0x7f48980cddb0 2023-10-08T06:10:31.812 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:31.807+0000 7f489d89f700 1 --2- 172.21.15.32:0/3230083840 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f48980cddb0 0x7f48980b3300 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f48980ce9f0 tx=0x7f4890009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bae796be091799d4 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:31.812 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:31.807+0000 7f488bfff700 1 -- 172.21.15.32:0/3230083840 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4890011830 con 0x7f48980cddb0 2023-10-08T06:10:31.813 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:31.807+0000 7f488bfff700 1 -- 172.21.15.32:0/3230083840 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4890011990 con 0x7f48980cddb0 2023-10-08T06:10:31.813 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:31.807+0000 7f488bfff700 1 -- 172.21.15.32:0/3230083840 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4890011d20 con 0x7f48980cddb0 2023-10-08T06:10:31.813 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:31.807+0000 7f489e0a0700 1 -- 172.21.15.32:0/3230083840 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f48980cddb0 msgr2=0x7f48980b3300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:31.813 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:31.807+0000 7f489e0a0700 1 --2- 172.21.15.32:0/3230083840 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f48980cddb0 0x7f48980b3300 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f48980ce9f0 tx=0x7f4890009bf0 comp rx=0 tx=0).stop 2023-10-08T06:10:31.813 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:31.811+0000 7f489e0a0700 1 -- 172.21.15.32:0/3230083840 shutdown_connections 2023-10-08T06:10:31.813 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:31.811+0000 7f489e0a0700 1 --2- 172.21.15.32:0/3230083840 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f48980cddb0 0x7f48980b3300 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:31.813 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:31.811+0000 7f489e0a0700 1 --2- 172.21.15.32:0/3230083840 >> v2:172.21.15.40:3300/0 conn(0x7f48980c4340 0x7f48981651b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:31.813 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:31.811+0000 7f489e0a0700 1 -- 172.21.15.32:0/3230083840 >> 172.21.15.32:0/3230083840 conn(0x7f489806df60 msgr2=0x7f489806e340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:10:31.813 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:31.811+0000 7f489e0a0700 1 -- 172.21.15.32:0/3230083840 shutdown_connections 2023-10-08T06:10:31.813 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:31.811+0000 7f489e0a0700 1 -- 172.21.15.32:0/3230083840 wait complete. 2023-10-08T06:10:31.814 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:31.811+0000 7f489e0a0700 1 Processor -- start 2023-10-08T06:10:31.814 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:31.811+0000 7f489e0a0700 1 -- start start 2023-10-08T06:10:31.816 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:31.815+0000 7f489e0a0700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f48980c4340 0x7f48981eb870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:31.816 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:31.815+0000 7f489e0a0700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f48980cddb0 0x7f48980c9eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:31.817 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:31.815+0000 7f489e0a0700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f48980cea40 0x7f4898155cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:31.817 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:31.815+0000 7f489e0a0700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48980ca3f0 con 0x7f48980cea40 2023-10-08T06:10:31.817 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:31.815+0000 7f489e0a0700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48981ebee0 con 0x7f48980c4340 2023-10-08T06:10:31.817 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:31.815+0000 7f489e0a0700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48981ec1c0 con 0x7f48980cddb0 2023-10-08T06:10:31.817 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:31.815+0000 7f489d89f700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f48980cea40 0x7f4898155cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:31.817 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:31.815+0000 7f489d89f700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f48980cea40 0x7f4898155cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:33758/0 (socket says 172.21.15.32:33758) 2023-10-08T06:10:31.817 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:31.815+0000 7f489d89f700 1 -- 172.21.15.32:0/3972603801 learned_addr learned my addr 172.21.15.32:0/3972603801 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:10:31.817 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:31.815+0000 7f489d09e700 1 --2- 172.21.15.32:0/3972603801 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f48980c4340 0x7f48981eb870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:31.817 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:31.815+0000 7f489c89d700 1 --2- 172.21.15.32:0/3972603801 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f48980cddb0 0x7f48980c9eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:31.817 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:31.815+0000 7f489d89f700 1 -- 172.21.15.32:0/3972603801 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f48980cddb0 msgr2=0x7f48980c9eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:31.817 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:31.815+0000 7f489d89f700 1 --2- 172.21.15.32:0/3972603801 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f48980cddb0 0x7f48980c9eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:31.818 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:31.815+0000 7f489d89f700 1 -- 172.21.15.32:0/3972603801 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f48980c4340 msgr2=0x7f48981eb870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:31.818 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:31.815+0000 7f489d89f700 1 --2- 172.21.15.32:0/3972603801 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f48980c4340 0x7f48981eb870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:31.818 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:31.815+0000 7f489d89f700 1 -- 172.21.15.32:0/3972603801 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4890009570 con 0x7f48980cea40 2023-10-08T06:10:31.818 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:31.815+0000 7f489c89d700 1 --2- 172.21.15.32:0/3972603801 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f48980cddb0 0x7f48980c9eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T06:10:31.818 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:31.815+0000 7f489d89f700 1 --2- 172.21.15.32:0/3972603801 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f48980cea40 0x7f4898155cc0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f4890013000 tx=0x7f4890004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:31.819 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:31.815+0000 7f4889ffb700 1 -- 172.21.15.32:0/3972603801 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4890004380 con 0x7f48980cea40 2023-10-08T06:10:31.819 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:31.815+0000 7f4889ffb700 1 -- 172.21.15.32:0/3972603801 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f489001f070 con 0x7f48980cea40 2023-10-08T06:10:31.819 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:31.815+0000 7f489e0a0700 1 -- 172.21.15.32:0/3972603801 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48981ec4a0 con 0x7f48980cea40 2023-10-08T06:10:31.819 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:31.815+0000 7f489e0a0700 1 -- 172.21.15.32:0/3972603801 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48980b3b30 con 0x7f48980cea40 2023-10-08T06:10:31.819 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:31.815+0000 7f4889ffb700 1 -- 172.21.15.32:0/3972603801 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48900036c0 con 0x7f48980cea40 2023-10-08T06:10:31.819 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:31.815+0000 7f4889ffb700 1 -- 172.21.15.32:0/3972603801 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f4890021030 con 0x7f48980cea40 2023-10-08T06:10:31.820 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:31.819+0000 7f489e0a0700 1 -- 172.21.15.32:0/3972603801 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4898070480 con 0x7f48980cea40 2023-10-08T06:10:31.820 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:31.819+0000 7f4889ffb700 1 --2- 172.21.15.32:0/3972603801 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f487c066540 0x7f487c068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:31.820 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:31.819+0000 7f489d09e700 1 --2- 172.21.15.32:0/3972603801 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f487c066540 0x7f487c068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:31.820 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:31.819+0000 7f4889ffb700 1 -- 172.21.15.32:0/3972603801 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f4890084e10 con 0x7f48980cea40 2023-10-08T06:10:31.820 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:31.819+0000 7f489d09e700 1 --2- 172.21.15.32:0/3972603801 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f487c066540 0x7f487c068a00 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f489806fe00 tx=0x7f4894009240 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:31.830 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:31.827+0000 7f4889ffb700 1 -- 172.21.15.32:0/3972603801 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f48900525f0 con 0x7f48980cea40 2023-10-08T06:10:32.048 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.047+0000 7f489e0a0700 1 -- 172.21.15.32:0/3972603801 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7f48980b3d70 con 0x7f48980cea40 2023-10-08T06:10:32.053 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.051+0000 7f4889ffb700 1 -- 172.21.15.32:0/3972603801 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v7) v1 ==== 97+0+0 (secure 0 0 0) 0x7f48980b3d70 con 0x7f48980cea40 2023-10-08T06:10:32.056 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.051+0000 7f489e0a0700 1 -- 172.21.15.32:0/3972603801 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f487c066540 msgr2=0x7f487c068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:32.056 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.051+0000 7f489e0a0700 1 --2- 172.21.15.32:0/3972603801 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f487c066540 0x7f487c068a00 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f489806fe00 tx=0x7f4894009240 comp rx=0 tx=0).stop 2023-10-08T06:10:32.056 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.051+0000 7f489e0a0700 1 -- 172.21.15.32:0/3972603801 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f48980cea40 msgr2=0x7f4898155cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:32.056 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.051+0000 7f489e0a0700 1 --2- 172.21.15.32:0/3972603801 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f48980cea40 0x7f4898155cc0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f4890013000 tx=0x7f4890004770 comp rx=0 tx=0).stop 2023-10-08T06:10:32.056 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.051+0000 7f489e0a0700 1 -- 172.21.15.32:0/3972603801 shutdown_connections 2023-10-08T06:10:32.056 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.051+0000 7f489e0a0700 1 --2- 172.21.15.32:0/3972603801 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f487c066540 0x7f487c068a00 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:32.057 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.051+0000 7f489e0a0700 1 --2- 172.21.15.32:0/3972603801 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f48980cea40 0x7f4898155cc0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:32.057 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.051+0000 7f489e0a0700 1 --2- 172.21.15.32:0/3972603801 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f48980cddb0 0x7f48980c9eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:32.057 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.051+0000 7f489e0a0700 1 --2- 172.21.15.32:0/3972603801 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f48980c4340 0x7f48981eb870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:32.057 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.051+0000 7f489e0a0700 1 -- 172.21.15.32:0/3972603801 >> 172.21.15.32:0/3972603801 conn(0x7f489806df60 msgr2=0x7f48980cb480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:10:32.057 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.055+0000 7f489e0a0700 1 -- 172.21.15.32:0/3972603801 shutdown_connections 2023-10-08T06:10:32.057 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.055+0000 7f489e0a0700 1 -- 172.21.15.32:0/3972603801 wait complete. 2023-10-08T06:10:32.072 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-10-08T06:10:32.193 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.191+0000 7fd146465700 1 Processor -- start 2023-10-08T06:10:32.193 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.191+0000 7fd146465700 1 -- start start 2023-10-08T06:10:32.195 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.191+0000 7fd146465700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fd140159ed0 0x7fd1400ca9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:32.195 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.191+0000 7fd146465700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd14015a2b0 0x7fd1400c98c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:32.195 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.191+0000 7fd146465700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1400cca40 con 0x7fd1400706f0 2023-10-08T06:10:32.196 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.191+0000 7fd146465700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1400ccdb0 con 0x7fd140159ed0 2023-10-08T06:10:32.196 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.191+0000 7fd146465700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1400caef0 con 0x7fd14015a2b0 2023-10-08T06:10:32.196 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.191+0000 7fd145463700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fd140159ed0 0x7fd1400ca9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:32.196 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.191+0000 7fd145463700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fd140159ed0 0x7fd1400ca9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:33760/0 (socket says 172.21.15.32:33760) 2023-10-08T06:10:32.196 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.191+0000 7fd145463700 1 -- 172.21.15.32:0/1892478387 learned_addr learned my addr 172.21.15.32:0/1892478387 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:10:32.196 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.191+0000 7fd144c62700 1 --2- 172.21.15.32:0/1892478387 >> v2:172.21.15.40:3300/0 conn(0x7fd14015a2b0 0x7fd1400c98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:32.196 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.191+0000 7fd145463700 1 -- 172.21.15.32:0/1892478387 >> v2:172.21.15.40:3300/0 conn(0x7fd14015a2b0 msgr2=0x7fd1400c98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:10:32.197 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.191+0000 7fd145463700 1 --2- 172.21.15.32:0/1892478387 >> v2:172.21.15.40:3300/0 conn(0x7fd14015a2b0 0x7fd1400c98c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:32.197 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.191+0000 7fd145463700 1 -- 172.21.15.32:0/1892478387 >> v1:172.21.15.40:6789/0 conn(0x7fd1400706f0 legacy=0x7fd1400cb510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:32.197 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.191+0000 7fd145463700 1 -- 172.21.15.32:0/1892478387 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1400cdf60 con 0x7fd140159ed0 2023-10-08T06:10:32.197 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.191+0000 7fd145463700 1 --2- 172.21.15.32:0/1892478387 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd140159ed0 0x7fd1400ca9b0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fd140071e40 tx=0x7fd130009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22c94e7b115a4789 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:32.197 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.191+0000 7fd13ffff700 1 -- 172.21.15.32:0/1892478387 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd13000b8a0 con 0x7fd140159ed0 2023-10-08T06:10:32.197 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.191+0000 7fd13ffff700 1 -- 172.21.15.32:0/1892478387 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd13000ba00 con 0x7fd140159ed0 2023-10-08T06:10:32.197 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.191+0000 7fd13ffff700 1 -- 172.21.15.32:0/1892478387 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd13000bd90 con 0x7fd140159ed0 2023-10-08T06:10:32.198 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.195+0000 7fd146465700 1 -- 172.21.15.32:0/1892478387 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd140159ed0 msgr2=0x7fd1400ca9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:32.198 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.195+0000 7fd146465700 1 --2- 172.21.15.32:0/1892478387 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd140159ed0 0x7fd1400ca9b0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fd140071e40 tx=0x7fd130009bf0 comp rx=0 tx=0).stop 2023-10-08T06:10:32.198 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.195+0000 7fd146465700 1 -- 172.21.15.32:0/1892478387 shutdown_connections 2023-10-08T06:10:32.198 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.195+0000 7fd146465700 1 --2- 172.21.15.32:0/1892478387 >> v2:172.21.15.40:3300/0 conn(0x7fd14015a2b0 0x7fd1400c98c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:32.199 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.195+0000 7fd146465700 1 --2- 172.21.15.32:0/1892478387 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd140159ed0 0x7fd1400ca9b0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:32.199 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.195+0000 7fd146465700 1 -- 172.21.15.32:0/1892478387 >> 172.21.15.32:0/1892478387 conn(0x7fd1400b0900 msgr2=0x7fd1400b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:10:32.199 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.195+0000 7fd146465700 1 -- 172.21.15.32:0/1892478387 shutdown_connections 2023-10-08T06:10:32.199 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.195+0000 7fd146465700 1 -- 172.21.15.32:0/1892478387 wait complete. 2023-10-08T06:10:32.199 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.195+0000 7fd146465700 1 Processor -- start 2023-10-08T06:10:32.199 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.195+0000 7fd146465700 1 -- start start 2023-10-08T06:10:32.200 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.195+0000 7fd146465700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd1400706f0 0x7fd1400c3810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:32.200 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.195+0000 7fd146465700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd140159ed0 0x7fd1400c5010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:32.200 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.199+0000 7fd146465700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd14015a2b0 0x7fd14014b070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:32.200 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.199+0000 7fd146465700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1400b44e0 con 0x7fd140159ed0 2023-10-08T06:10:32.200 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.199+0000 7fd146465700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1400b4200 con 0x7fd1400706f0 2023-10-08T06:10:32.200 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.199+0000 7fd146465700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1400b2850 con 0x7fd14015a2b0 2023-10-08T06:10:32.200 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.199+0000 7fd144c62700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd140159ed0 0x7fd1400c5010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:32.201 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.199+0000 7fd144c62700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd140159ed0 0x7fd1400c5010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:33774/0 (socket says 172.21.15.32:33774) 2023-10-08T06:10:32.201 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.199+0000 7fd144c62700 1 -- 172.21.15.32:0/2952483795 learned_addr learned my addr 172.21.15.32:0/2952483795 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:10:32.201 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.199+0000 7fd145c64700 1 --2- 172.21.15.32:0/2952483795 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd14015a2b0 0x7fd14014b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:32.201 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.199+0000 7fd145463700 1 --2- 172.21.15.32:0/2952483795 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd1400706f0 0x7fd1400c3810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:32.202 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.199+0000 7fd144c62700 1 -- 172.21.15.32:0/2952483795 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd14015a2b0 msgr2=0x7fd14014b070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:32.202 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.199+0000 7fd144c62700 1 --2- 172.21.15.32:0/2952483795 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd14015a2b0 0x7fd14014b070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:32.202 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.199+0000 7fd144c62700 1 -- 172.21.15.32:0/2952483795 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd1400706f0 msgr2=0x7fd1400c3810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:32.202 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.199+0000 7fd144c62700 1 --2- 172.21.15.32:0/2952483795 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd1400706f0 0x7fd1400c3810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:32.202 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.199+0000 7fd144c62700 1 -- 172.21.15.32:0/2952483795 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd130009570 con 0x7fd140159ed0 2023-10-08T06:10:32.202 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.199+0000 7fd144c62700 1 --2- 172.21.15.32:0/2952483795 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd140159ed0 0x7fd1400c5010 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fd13400d800 tx=0x7fd13400db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:32.203 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.199+0000 7fd13dffb700 1 -- 172.21.15.32:0/2952483795 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1340125f0 con 0x7fd140159ed0 2023-10-08T06:10:32.203 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.199+0000 7fd13dffb700 1 -- 172.21.15.32:0/2952483795 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd134012750 con 0x7fd140159ed0 2023-10-08T06:10:32.203 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.199+0000 7fd146465700 1 -- 172.21.15.32:0/2952483795 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1400b2b30 con 0x7fd140159ed0 2023-10-08T06:10:32.203 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.199+0000 7fd13dffb700 1 -- 172.21.15.32:0/2952483795 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd134012ac0 con 0x7fd140159ed0 2023-10-08T06:10:32.203 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.199+0000 7fd146465700 1 -- 172.21.15.32:0/2952483795 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd14014b5b0 con 0x7fd140159ed0 2023-10-08T06:10:32.203 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.199+0000 7fd146465700 1 -- 172.21.15.32:0/2952483795 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1400b26b0 con 0x7fd140159ed0 2023-10-08T06:10:32.204 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.203+0000 7fd13dffb700 1 -- 172.21.15.32:0/2952483795 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fd134012c20 con 0x7fd140159ed0 2023-10-08T06:10:32.204 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.203+0000 7fd13dffb700 1 --2- 172.21.15.32:0/2952483795 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fd12c066510 0x7fd12c0689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:32.204 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.203+0000 7fd13dffb700 1 -- 172.21.15.32:0/2952483795 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fd134083c00 con 0x7fd140159ed0 2023-10-08T06:10:32.205 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.203+0000 7fd145463700 1 --2- 172.21.15.32:0/2952483795 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fd12c066510 0x7fd12c0689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:32.205 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.203+0000 7fd145463700 1 --2- 172.21.15.32:0/2952483795 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fd12c066510 0x7fd12c0689d0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fd130000c00 tx=0x7fd130008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:32.214 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.211+0000 7fd13dffb700 1 -- 172.21.15.32:0/2952483795 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fd1400b26b0 con 0x7fd140159ed0 2023-10-08T06:10:32.442 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.439+0000 7fd146465700 1 -- 172.21.15.32:0/2952483795 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7fd1400b26b0 con 0x7fd140159ed0 2023-10-08T06:10:32.447 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.443+0000 7fd13dffb700 1 -- 172.21.15.32:0/2952483795 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7fd1400b26b0 con 0x7fd140159ed0 2023-10-08T06:10:32.453 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.447+0000 7fd146465700 1 -- 172.21.15.32:0/2952483795 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fd12c066510 msgr2=0x7fd12c0689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:32.453 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.447+0000 7fd146465700 1 --2- 172.21.15.32:0/2952483795 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fd12c066510 0x7fd12c0689d0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fd130000c00 tx=0x7fd130008030 comp rx=0 tx=0).stop 2023-10-08T06:10:32.453 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.447+0000 7fd146465700 1 -- 172.21.15.32:0/2952483795 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd140159ed0 msgr2=0x7fd1400c5010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:32.453 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.447+0000 7fd146465700 1 --2- 172.21.15.32:0/2952483795 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd140159ed0 0x7fd1400c5010 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fd13400d800 tx=0x7fd13400db10 comp rx=0 tx=0).stop 2023-10-08T06:10:32.453 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.447+0000 7fd146465700 1 -- 172.21.15.32:0/2952483795 shutdown_connections 2023-10-08T06:10:32.453 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.447+0000 7fd146465700 1 --2- 172.21.15.32:0/2952483795 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fd12c066510 0x7fd12c0689d0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:32.453 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.447+0000 7fd146465700 1 --2- 172.21.15.32:0/2952483795 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd140159ed0 0x7fd1400c5010 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:32.453 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.447+0000 7fd146465700 1 --2- 172.21.15.32:0/2952483795 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd14015a2b0 0x7fd14014b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:32.454 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.447+0000 7fd146465700 1 --2- 172.21.15.32:0/2952483795 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd1400706f0 0x7fd1400c3810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:32.454 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.447+0000 7fd146465700 1 -- 172.21.15.32:0/2952483795 >> 172.21.15.32:0/2952483795 conn(0x7fd1400b0900 msgr2=0x7fd140152e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:10:32.454 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.447+0000 7fd146465700 1 -- 172.21.15.32:0/2952483795 shutdown_connections 2023-10-08T06:10:32.454 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.447+0000 7fd146465700 1 -- 172.21.15.32:0/2952483795 wait complete. 2023-10-08T06:10:32.467 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T06:10:32.577 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.575+0000 7f8dbb59e700 1 Processor -- start 2023-10-08T06:10:32.577 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.575+0000 7f8dbb59e700 1 -- start start 2023-10-08T06:10:32.578 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.575+0000 7f8dbb59e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8dbc15b980 0x7f8dbc15f780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:32.578 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.575+0000 7f8dbb59e700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8dbc06fc20 con 0x7f8dbc0c9b30 2023-10-08T06:10:32.578 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.575+0000 7f8dbb59e700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8dbc15fcc0 con 0x7f8dbc0719e0 2023-10-08T06:10:32.578 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.575+0000 7f8dbb59e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8dbc070430 con 0x7f8dbc15b980 2023-10-08T06:10:32.578 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.575+0000 7f8dbad9d700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f8dbc0c9b30 0x7f8dbc15bd60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:54078/0 (socket says 172.21.15.32:54078) 2023-10-08T06:10:32.578 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.575+0000 7f8dbad9d700 1 -- 172.21.15.32:0/1915686646 learned_addr learned my addr 172.21.15.32:0/1915686646 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-08T06:10:32.580 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.575+0000 7f8dba59c700 1 --2- 172.21.15.32:0/1915686646 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8dbc15b980 0x7f8dbc15f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:32.580 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.575+0000 7f8db959a700 1 -- 172.21.15.32:0/1915686646 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1045723949 0 0) 0x7f8dbc06fc20 con 0x7f8dbc0c9b30 2023-10-08T06:10:32.580 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.575+0000 7f8db959a700 1 -- 172.21.15.32:0/1915686646 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8da40035d0 con 0x7f8dbc0c9b30 2023-10-08T06:10:32.580 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.575+0000 7f8db959a700 1 -- 172.21.15.32:0/1915686646 <== mon.1 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 407689363 0 0) 0x7f8dbc15fcc0 con 0x7f8dbc0719e0 2023-10-08T06:10:32.580 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.575+0000 7f8db959a700 1 -- 172.21.15.32:0/1915686646 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8dbc06fc20 con 0x7f8dbc0719e0 2023-10-08T06:10:32.580 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.575+0000 7f8dba59c700 1 -- 172.21.15.32:0/1915686646 >> v1:172.21.15.40:6789/0 conn(0x7f8dbc0719e0 legacy=0x7f8dbc0c9420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:32.580 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.575+0000 7f8dba59c700 1 -- 172.21.15.32:0/1915686646 >> v1:172.21.15.32:6789/0 conn(0x7f8dbc0c9b30 legacy=0x7f8dbc15bd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:32.581 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.575+0000 7f8db959a700 1 -- 172.21.15.32:0/1915686646 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3505088835 0 0) 0x7f8da40035d0 con 0x7f8dbc0c9b30 2023-10-08T06:10:32.581 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.575+0000 7f8dba59c700 1 -- 172.21.15.32:0/1915686646 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dbc06fe70 con 0x7f8dbc15b980 2023-10-08T06:10:32.581 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.579+0000 7f8dba59c700 1 --2- 172.21.15.32:0/1915686646 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8dbc15b980 0x7f8dbc15f780 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f8db0009880 tx=0x7f8db0009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f8d287fca8759780 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:32.581 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.579+0000 7f8db959a700 1 -- 172.21.15.32:0/1915686646 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8db4001670 con 0x7f8dbc15b980 2023-10-08T06:10:32.581 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.579+0000 7f8db959a700 1 -- 172.21.15.32:0/1915686646 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8db0004030 con 0x7f8dbc15b980 2023-10-08T06:10:32.581 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.579+0000 7f8db959a700 1 -- 172.21.15.32:0/1915686646 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8db00043c0 con 0x7f8dbc15b980 2023-10-08T06:10:32.582 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.579+0000 7f8dbb59e700 1 -- 172.21.15.32:0/1915686646 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8dbc15b980 msgr2=0x7f8dbc15f780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:32.582 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.579+0000 7f8dbb59e700 1 --2- 172.21.15.32:0/1915686646 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8dbc15b980 0x7f8dbc15f780 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f8db0009880 tx=0x7f8db0009b90 comp rx=0 tx=0).stop 2023-10-08T06:10:32.582 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.579+0000 7f8dbb59e700 1 -- 172.21.15.32:0/1915686646 shutdown_connections 2023-10-08T06:10:32.582 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.579+0000 7f8dbb59e700 1 --2- 172.21.15.32:0/1915686646 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8dbc15b980 0x7f8dbc15f780 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:32.582 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.579+0000 7f8dbb59e700 1 -- 172.21.15.32:0/1915686646 >> 172.21.15.32:0/1915686646 conn(0x7f8dbc0b0900 msgr2=0x7f8dbc0b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:10:32.582 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.579+0000 7f8dbb59e700 1 -- 172.21.15.32:0/1915686646 shutdown_connections 2023-10-08T06:10:32.582 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.579+0000 7f8dbb59e700 1 -- 172.21.15.32:0/1915686646 wait complete. 2023-10-08T06:10:32.583 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.579+0000 7f8dbb59e700 1 Processor -- start 2023-10-08T06:10:32.583 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.579+0000 7f8dbb59e700 1 -- start start 2023-10-08T06:10:32.584 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.579+0000 7f8dbb59e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8dbc0719e0 0x7f8dbc15bd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:32.584 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.579+0000 7f8dbb59e700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8dbc0c9b30 0x7f8dbc15ca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:32.584 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.579+0000 7f8dbb59e700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8dbc15b980 0x7f8dbc1f1c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:32.584 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.579+0000 7f8dbb59e700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dbc15c2a0 con 0x7f8dbc15b980 2023-10-08T06:10:32.584 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.579+0000 7f8dbb59e700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dbc15cf60 con 0x7f8dbc0c9b30 2023-10-08T06:10:32.584 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.579+0000 7f8dbb59e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8dbc0ac990 con 0x7f8dbc0719e0 2023-10-08T06:10:32.585 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.579+0000 7f8dbad9d700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8dbc15b980 0x7f8dbc1f1c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:32.585 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.579+0000 7f8dbad9d700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8dbc15b980 0x7f8dbc1f1c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:33790/0 (socket says 172.21.15.32:33790) 2023-10-08T06:10:32.585 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.579+0000 7f8dbad9d700 1 -- 172.21.15.32:0/4003643793 learned_addr learned my addr 172.21.15.32:0/4003643793 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:10:32.585 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.579+0000 7f8db9d9b700 1 --2- 172.21.15.32:0/4003643793 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8dbc0c9b30 0x7f8dbc15ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:32.585 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.583+0000 7f8dba59c700 1 --2- 172.21.15.32:0/4003643793 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8dbc0719e0 0x7f8dbc15bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:32.585 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.583+0000 7f8dbad9d700 1 -- 172.21.15.32:0/4003643793 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8dbc0719e0 msgr2=0x7f8dbc15bd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:32.585 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.583+0000 7f8dbad9d700 1 --2- 172.21.15.32:0/4003643793 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8dbc0719e0 0x7f8dbc15bd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:32.585 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.583+0000 7f8dbad9d700 1 -- 172.21.15.32:0/4003643793 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8dbc0c9b30 msgr2=0x7f8dbc15ca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:32.585 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.583+0000 7f8dbad9d700 1 --2- 172.21.15.32:0/4003643793 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8dbc0c9b30 0x7f8dbc15ca20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:32.585 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.583+0000 7f8dbad9d700 1 -- 172.21.15.32:0/4003643793 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8db00094b0 con 0x7f8dbc15b980 2023-10-08T06:10:32.586 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.583+0000 7f8dbad9d700 1 --2- 172.21.15.32:0/4003643793 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8dbc15b980 0x7f8dbc1f1c50 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f8db40017a0 tx=0x7f8db400ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:32.587 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.583+0000 7f8daaffd700 1 -- 172.21.15.32:0/4003643793 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8db4004ca0 con 0x7f8dbc15b980 2023-10-08T06:10:32.587 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.583+0000 7f8daaffd700 1 -- 172.21.15.32:0/4003643793 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8db4004e00 con 0x7f8dbc15b980 2023-10-08T06:10:32.587 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.583+0000 7f8dbb59e700 1 -- 172.21.15.32:0/4003643793 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8dbc0acc70 con 0x7f8dbc15b980 2023-10-08T06:10:32.587 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.583+0000 7f8daaffd700 1 -- 172.21.15.32:0/4003643793 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8db40072f0 con 0x7f8dbc15b980 2023-10-08T06:10:32.587 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.583+0000 7f8dbb59e700 1 -- 172.21.15.32:0/4003643793 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8dbc0ad230 con 0x7f8dbc15b980 2023-10-08T06:10:32.587 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.583+0000 7f8dbb59e700 1 -- 172.21.15.32:0/4003643793 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8dbc15ef10 con 0x7f8dbc15b980 2023-10-08T06:10:32.587 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.583+0000 7f8daaffd700 1 -- 172.21.15.32:0/4003643793 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f8db4007450 con 0x7f8dbc15b980 2023-10-08T06:10:32.588 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.587+0000 7f8daaffd700 1 --2- 172.21.15.32:0/4003643793 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f8d9c066510 0x7f8d9c0689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:32.588 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.587+0000 7f8dba59c700 1 --2- 172.21.15.32:0/4003643793 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f8d9c066510 0x7f8d9c0689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:32.588 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.587+0000 7f8daaffd700 1 -- 172.21.15.32:0/4003643793 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f8db4083700 con 0x7f8dbc15b980 2023-10-08T06:10:32.589 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.587+0000 7f8dba59c700 1 --2- 172.21.15.32:0/4003643793 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f8d9c066510 0x7f8d9c0689d0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f8db00090b0 tx=0x7f8db0010000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:32.593 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.591+0000 7f8daaffd700 1 -- 172.21.15.32:0/4003643793 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f8db4050f60 con 0x7f8dbc15b980 2023-10-08T06:10:32.760 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.759+0000 7f8dbb59e700 1 -- 172.21.15.32:0/4003643793 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8dbc073f00 con 0x7f8dbc15b980 2023-10-08T06:10:32.762 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.759+0000 7f8daaffd700 1 -- 172.21.15.32:0/4003643793 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+12797 (secure 0 0 0) 0x7f8db4054580 con 0x7f8dbc15b980 2023-10-08T06:10:32.762 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:10:32.762 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":31,"fsid":"ac672d87-96ae-41e0-9314-623ba2cdbbba","created":"2023-10-08T06:09:11.175626+0000","modified":"2023-10-08T06:10:29.773926+0000","last_up_change":"2023-10-08T06:09:22.744643+0000","last_in_change":"2023-10-08T06:09:14.131580+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T06:09:23.307843+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"43433f0c-9592-4874-92d7-10f8f4acf07f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":587888964},{"type":"v1","addr":"172.21.15.32:6801","nonce":587888964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":587888964},{"type":"v1","addr":"172.21.15.32:6803","nonce":587888964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":587888964},{"type":"v1","addr":"172.21.15.32:6810","nonce":587888964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6805","nonce":587888964},{"type":"v1","addr":"172.21.15.32:6807","nonce":587888964}]},"public_addr":"172.21.15.32:6801/587888964","cluster_addr":"172.21.15.32:6803/587888964","heartbeat_back_addr":"172.21.15.32:6810/587888964","heartbeat_front_addr":"172.21.15.32:6807/587888964","state":["exists","up"]},{"osd":1,"uuid":"2ecb1008-b987-4ce7-b646-6cded55fc8d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":990576767},{"type":"v1","addr":"172.21.15.32:6817","nonce":990576767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":990576767},{"type":"v1","addr":"172.21.15.32:6819","nonce":990576767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":990576767},{"type":"v1","addr":"172.21.15.32:6823","nonce":990576767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":990576767},{"type":"v1","addr":"172.21.15.32:6821","nonce":990576767}]},"public_addr":"172.21.15.32:6817/990576767","cluster_addr":"172.21.15.32:6819/990576767","heartbeat_back_addr":"172.21.15.32:6823/990576767","heartbeat_front_addr":"172.21.15.32:6821/990576767","state":["exists","up"]},{"osd":2,"uuid":"1b131c94-c09b-4e80-8746-bf1b7bac362d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6824","nonce":1566874440},{"type":"v1","addr":"172.21.15.32:6825","nonce":1566874440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":1566874440},{"type":"v1","addr":"172.21.15.32:6827","nonce":1566874440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":1566874440},{"type":"v1","addr":"172.21.15.32:6831","nonce":1566874440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":1566874440},{"type":"v1","addr":"172.21.15.32:6829","nonce":1566874440}]},"public_addr":"172.21.15.32:6825/1566874440","cluster_addr":"172.21.15.32:6827/1566874440","heartbeat_back_addr":"172.21.15.32:6831/1566874440","heartbeat_front_addr":"172.21.15.32:6829/1566874440","state":["exists","up"]},{"osd":3,"uuid":"ad655af2-1f6f-4689-b21d-b07bbaeb68b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":3672614802},{"type":"v1","addr":"172.21.15.32:6806","nonce":3672614802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6809","nonce":3672614802},{"type":"v1","addr":"172.21.15.32:6811","nonce":3672614802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":3672614802},{"type":"v1","addr":"172.21.15.32:6815","nonce":3672614802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":3672614802},{"type":"v1","addr":"172.21.15.32:6813","nonce":3672614802}]},"public_addr":"172.21.15.32:6806/3672614802","cluster_addr":"172.21.15.32:6811/3672614802","heartbeat_back_addr":"172.21.15.32:6815/3672614802","heartbeat_front_addr":"172.21.15.32:6813/3672614802","state":["exists","up"]},{"osd":4,"uuid":"64a543a1-8c4f-458e-9aba-b35c1cd7dd03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":3369928244},{"type":"v1","addr":"172.21.15.40:6801","nonce":3369928244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":3369928244},{"type":"v1","addr":"172.21.15.40:6803","nonce":3369928244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":3369928244},{"type":"v1","addr":"172.21.15.40:6807","nonce":3369928244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":3369928244},{"type":"v1","addr":"172.21.15.40:6805","nonce":3369928244}]},"public_addr":"172.21.15.40:6801/3369928244","cluster_addr":"172.21.15.40:6803/3369928244","heartbeat_back_addr":"172.21.15.40:6807/3369928244","heartbeat_front_addr":"172.21.15.40:6805/3369928244","state":["exists","up"]},{"osd":5,"uuid":"0fef3e54-edb4-4678-878e-944663c51638","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":2395850297},{"type":"v1","addr":"172.21.15.40:6825","nonce":2395850297}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":2395850297},{"type":"v1","addr":"172.21.15.40:6827","nonce":2395850297}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":2395850297},{"type":"v1","addr":"172.21.15.40:6831","nonce":2395850297}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":2395850297},{"type":"v1","addr":"172.21.15.40:6829","nonce":2395850297}]},"public_addr":"172.21.15.40:6825/2395850297","cluster_addr":"172.21.15.40:6827/2395850297","heartbeat_back_addr":"172.21.15.40:6831/2395850297","heartbeat_front_addr":"172.21.15.40:6829/2395850297","state":["exists","up"]},{"osd":6,"uuid":"2eeb0472-6096-469d-9b2c-cab4bf41c31a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":4145283410},{"type":"v1","addr":"172.21.15.40:6809","nonce":4145283410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":4145283410},{"type":"v1","addr":"172.21.15.40:6811","nonce":4145283410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":4145283410},{"type":"v1","addr":"172.21.15.40:6815","nonce":4145283410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":4145283410},{"type":"v1","addr":"172.21.15.40:6813","nonce":4145283410}]},"public_addr":"172.21.15.40:6809/4145283410","cluster_addr":"172.21.15.40:6811/4145283410","heartbeat_back_addr":"172.21.15.40:6815/4145283410","heartbeat_front_addr":"172.21.15.40:6813/4145283410","state":["exists","up"]},{"osd":7,"uuid":"cf76e4c7-96a6-401f-a280-91aad4641940","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":2943297416},{"type":"v1","addr":"172.21.15.40:6817","nonce":2943297416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":2943297416},{"type":"v1","addr":"172.21.15.40:6819","nonce":2943297416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":2943297416},{"type":"v1","addr":"172.21.15.40:6823","nonce":2943297416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":2943297416},{"type":"v1","addr":"172.21.15.40:6821","nonce":2943297416}]},"public_addr":"172.21.15.40:6817/2943297416","cluster_addr":"172.21.15.40:6819/2943297416","heartbeat_back_addr":"172.21.15.40:6823/2943297416","heartbeat_front_addr":"172.21.15.40:6821/2943297416","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.411475+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.628841+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.599055+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.166100+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.384135+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.488403+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.307648+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.363541+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T06:10:32.764 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.763+0000 7f8dbb59e700 1 -- 172.21.15.32:0/4003643793 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f8d9c066510 msgr2=0x7f8d9c0689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:32.765 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.763+0000 7f8dbb59e700 1 --2- 172.21.15.32:0/4003643793 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f8d9c066510 0x7f8d9c0689d0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f8db00090b0 tx=0x7f8db0010000 comp rx=0 tx=0).stop 2023-10-08T06:10:32.765 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.763+0000 7f8dbb59e700 1 -- 172.21.15.32:0/4003643793 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8dbc15b980 msgr2=0x7f8dbc1f1c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:32.765 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.763+0000 7f8dbb59e700 1 --2- 172.21.15.32:0/4003643793 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8dbc15b980 0x7f8dbc1f1c50 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f8db40017a0 tx=0x7f8db400ca30 comp rx=0 tx=0).stop 2023-10-08T06:10:32.765 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.763+0000 7f8dbb59e700 1 -- 172.21.15.32:0/4003643793 shutdown_connections 2023-10-08T06:10:32.765 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.763+0000 7f8dbb59e700 1 --2- 172.21.15.32:0/4003643793 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f8d9c066510 0x7f8d9c0689d0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:32.765 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.763+0000 7f8dbb59e700 1 --2- 172.21.15.32:0/4003643793 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8dbc15b980 0x7f8dbc1f1c50 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:32.765 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.763+0000 7f8dbb59e700 1 --2- 172.21.15.32:0/4003643793 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8dbc0c9b30 0x7f8dbc15ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:32.765 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.763+0000 7f8dbb59e700 1 --2- 172.21.15.32:0/4003643793 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8dbc0719e0 0x7f8dbc15bd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:32.765 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.763+0000 7f8dbb59e700 1 -- 172.21.15.32:0/4003643793 >> 172.21.15.32:0/4003643793 conn(0x7f8dbc0b0900 msgr2=0x7f8dbc154280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:10:32.765 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.763+0000 7f8dbb59e700 1 -- 172.21.15.32:0/4003643793 shutdown_connections 2023-10-08T06:10:32.765 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.763+0000 7f8dbb59e700 1 -- 172.21.15.32:0/4003643793 wait complete. 2023-10-08T06:10:32.780 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T06:09:23.307843+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-08T06:10:32.780 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T06:10:32.899 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.895+0000 7fca318ef700 1 Processor -- start 2023-10-08T06:10:32.899 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.895+0000 7fca318ef700 1 -- start start 2023-10-08T06:10:32.900 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.895+0000 7fca318ef700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fca2c0c9420 0x7fca2c0cb520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:32.900 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.895+0000 7fca318ef700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fca2c0cba60 0x7fca2c0ad0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:32.900 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.895+0000 7fca318ef700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca2c06c060 con 0x7fca2c15d3e0 2023-10-08T06:10:32.900 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.895+0000 7fca318ef700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca2c0cbef0 con 0x7fca2c0cba60 2023-10-08T06:10:32.900 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.895+0000 7fca318ef700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca2c06c340 con 0x7fca2c0c9420 2023-10-08T06:10:32.900 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.899+0000 7fca310ee700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fca2c0cba60 0x7fca2c0ad0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:32.900 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.899+0000 7fca310ee700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fca2c0cba60 0x7fca2c0ad0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:33798/0 (socket says 172.21.15.32:33798) 2023-10-08T06:10:32.900 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.899+0000 7fca310ee700 1 -- 172.21.15.32:0/3519515737 learned_addr learned my addr 172.21.15.32:0/3519515737 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:10:32.900 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.899+0000 7fca2bfff700 1 --2- 172.21.15.32:0/3519515737 >> v2:172.21.15.40:3300/0 conn(0x7fca2c0c9420 0x7fca2c0cb520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:32.902 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.899+0000 7fca310ee700 1 -- 172.21.15.32:0/3519515737 >> v2:172.21.15.40:3300/0 conn(0x7fca2c0c9420 msgr2=0x7fca2c0cb520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:10:32.902 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.899+0000 7fca310ee700 1 --2- 172.21.15.32:0/3519515737 >> v2:172.21.15.40:3300/0 conn(0x7fca2c0c9420 0x7fca2c0cb520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:32.902 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.899+0000 7fca310ee700 1 -- 172.21.15.32:0/3519515737 >> v1:172.21.15.40:6789/0 conn(0x7fca2c15d3e0 legacy=0x7fca2c161950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:10:32.902 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.899+0000 7fca310ee700 1 -- 172.21.15.32:0/3519515737 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca2c06c620 con 0x7fca2c0cba60 2023-10-08T06:10:32.902 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.899+0000 7fca310ee700 1 --2- 172.21.15.32:0/3519515737 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fca2c0cba60 0x7fca2c0ad0e0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fca2c068600 tx=0x7fca2400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a05cdb825f2dab42 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:32.902 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.899+0000 7fca2b7fe700 1 -- 172.21.15.32:0/3519515737 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca2400e070 con 0x7fca2c0cba60 2023-10-08T06:10:32.902 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.899+0000 7fca2b7fe700 1 -- 172.21.15.32:0/3519515737 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca24003a40 con 0x7fca2c0cba60 2023-10-08T06:10:32.902 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.899+0000 7fca2b7fe700 1 -- 172.21.15.32:0/3519515737 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca24003df0 con 0x7fca2c0cba60 2023-10-08T06:10:32.902 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.899+0000 7fca318ef700 1 -- 172.21.15.32:0/3519515737 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fca2c0cba60 msgr2=0x7fca2c0ad0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:32.903 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.899+0000 7fca318ef700 1 --2- 172.21.15.32:0/3519515737 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fca2c0cba60 0x7fca2c0ad0e0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fca2c068600 tx=0x7fca2400b330 comp rx=0 tx=0).stop 2023-10-08T06:10:32.903 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.899+0000 7fca318ef700 1 -- 172.21.15.32:0/3519515737 shutdown_connections 2023-10-08T06:10:32.903 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.899+0000 7fca318ef700 1 --2- 172.21.15.32:0/3519515737 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fca2c0cba60 0x7fca2c0ad0e0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:32.903 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.899+0000 7fca318ef700 1 --2- 172.21.15.32:0/3519515737 >> v2:172.21.15.40:3300/0 conn(0x7fca2c0c9420 0x7fca2c0cb520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:32.903 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.899+0000 7fca318ef700 1 -- 172.21.15.32:0/3519515737 >> 172.21.15.32:0/3519515737 conn(0x7fca2c0b0900 msgr2=0x7fca2c0b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:10:32.903 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.899+0000 7fca318ef700 1 -- 172.21.15.32:0/3519515737 shutdown_connections 2023-10-08T06:10:32.903 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.899+0000 7fca318ef700 1 -- 172.21.15.32:0/3519515737 wait complete. 2023-10-08T06:10:32.904 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.899+0000 7fca318ef700 1 Processor -- start 2023-10-08T06:10:32.904 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.899+0000 7fca318ef700 1 -- start start 2023-10-08T06:10:32.906 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.903+0000 7fca318ef700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fca2c0c9420 0x7fca2c0c89c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:32.906 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.903+0000 7fca318ef700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fca2c0cba60 0x7fca2c0ad170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:32.906 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.903+0000 7fca318ef700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fca2c15d3e0 0x7fca2c0ad9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:32.907 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.903+0000 7fca318ef700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca2c0aeef0 con 0x7fca2c0c9420 2023-10-08T06:10:32.907 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.903+0000 7fca308ed700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fca2c0c9420 0x7fca2c0c89c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:32.907 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.903+0000 7fca318ef700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca2c0c8f00 con 0x7fca2c15d3e0 2023-10-08T06:10:32.907 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.903+0000 7fca318ef700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca2c15ff60 con 0x7fca2c0cba60 2023-10-08T06:10:32.907 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.903+0000 7fca308ed700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fca2c0c9420 0x7fca2c0c89c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:33808/0 (socket says 172.21.15.32:33808) 2023-10-08T06:10:32.907 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.903+0000 7fca2bfff700 1 --2- 172.21.15.32:0/246351350 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fca2c0cba60 0x7fca2c0ad170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:32.907 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.903+0000 7fca308ed700 1 -- 172.21.15.32:0/246351350 learned_addr learned my addr 172.21.15.32:0/246351350 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:10:32.907 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.903+0000 7fca310ee700 1 --2- 172.21.15.32:0/246351350 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fca2c15d3e0 0x7fca2c0ad9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:32.907 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.903+0000 7fca308ed700 1 -- 172.21.15.32:0/246351350 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fca2c0cba60 msgr2=0x7fca2c0ad170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:32.907 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.903+0000 7fca308ed700 1 --2- 172.21.15.32:0/246351350 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fca2c0cba60 0x7fca2c0ad170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:32.907 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.903+0000 7fca308ed700 1 -- 172.21.15.32:0/246351350 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fca2c15d3e0 msgr2=0x7fca2c0ad9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:32.908 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.903+0000 7fca308ed700 1 --2- 172.21.15.32:0/246351350 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fca2c15d3e0 0x7fca2c0ad9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:32.908 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.903+0000 7fca308ed700 1 -- 172.21.15.32:0/246351350 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca24009b30 con 0x7fca2c0c9420 2023-10-08T06:10:32.908 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.903+0000 7fca308ed700 1 --2- 172.21.15.32:0/246351350 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fca2c0c9420 0x7fca2c0c89c0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fca2000b4a0 tx=0x7fca2000b7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:32.909 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.903+0000 7fca297fa700 1 -- 172.21.15.32:0/246351350 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca20011830 con 0x7fca2c0c9420 2023-10-08T06:10:32.909 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.903+0000 7fca318ef700 1 -- 172.21.15.32:0/246351350 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca2c160240 con 0x7fca2c0c9420 2023-10-08T06:10:32.909 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.903+0000 7fca297fa700 1 -- 172.21.15.32:0/246351350 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca20011990 con 0x7fca2c0c9420 2023-10-08T06:10:32.909 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.903+0000 7fca318ef700 1 -- 172.21.15.32:0/246351350 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca2c0ae9d0 con 0x7fca2c0c9420 2023-10-08T06:10:32.909 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.903+0000 7fca297fa700 1 -- 172.21.15.32:0/246351350 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca20011d40 con 0x7fca2c0c9420 2023-10-08T06:10:32.909 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.907+0000 7fca318ef700 1 -- 172.21.15.32:0/246351350 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca2c073f00 con 0x7fca2c0c9420 2023-10-08T06:10:32.910 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.907+0000 7fca297fa700 1 -- 172.21.15.32:0/246351350 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fca2001a400 con 0x7fca2c0c9420 2023-10-08T06:10:32.910 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.907+0000 7fca297fa700 1 --2- 172.21.15.32:0/246351350 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fca18066510 0x7fca180689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:32.913 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.907+0000 7fca297fa700 1 -- 172.21.15.32:0/246351350 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fca20083990 con 0x7fca2c0c9420 2023-10-08T06:10:32.913 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.907+0000 7fca2bfff700 1 --2- 172.21.15.32:0/246351350 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fca18066510 0x7fca180689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:32.913 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.911+0000 7fca2bfff700 1 --2- 172.21.15.32:0/246351350 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fca18066510 0x7fca180689d0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fca2c071b80 tx=0x7fca1c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:32.917 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:32.915+0000 7fca297fa700 1 -- 172.21.15.32:0/246351350 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fca20051170 con 0x7fca2c0c9420 2023-10-08T06:10:33.086 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.083+0000 7fca318ef700 1 -- 172.21.15.32:0/246351350 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fca2c0c9070 con 0x7fca2c0c9420 2023-10-08T06:10:33.087 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.083+0000 7fca297fa700 1 -- 172.21.15.32:0/246351350 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v31) v1 ==== 93+0+10 (secure 0 0 0) 0x7fca2c0c9070 con 0x7fca2c0c9420 2023-10-08T06:10:33.087 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 1 2023-10-08T06:10:33.090 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.087+0000 7fca318ef700 1 -- 172.21.15.32:0/246351350 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fca18066510 msgr2=0x7fca180689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:33.090 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.087+0000 7fca318ef700 1 --2- 172.21.15.32:0/246351350 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fca18066510 0x7fca180689d0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fca2c071b80 tx=0x7fca1c008040 comp rx=0 tx=0).stop 2023-10-08T06:10:33.090 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.087+0000 7fca318ef700 1 -- 172.21.15.32:0/246351350 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fca2c0c9420 msgr2=0x7fca2c0c89c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:33.090 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.087+0000 7fca318ef700 1 --2- 172.21.15.32:0/246351350 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fca2c0c9420 0x7fca2c0c89c0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fca2000b4a0 tx=0x7fca2000b7b0 comp rx=0 tx=0).stop 2023-10-08T06:10:33.090 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.087+0000 7fca318ef700 1 -- 172.21.15.32:0/246351350 shutdown_connections 2023-10-08T06:10:33.090 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.087+0000 7fca318ef700 1 --2- 172.21.15.32:0/246351350 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fca18066510 0x7fca180689d0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:33.091 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.087+0000 7fca318ef700 1 --2- 172.21.15.32:0/246351350 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fca2c15d3e0 0x7fca2c0ad9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:33.091 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.087+0000 7fca318ef700 1 --2- 172.21.15.32:0/246351350 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fca2c0cba60 0x7fca2c0ad170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:33.091 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.087+0000 7fca318ef700 1 --2- 172.21.15.32:0/246351350 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fca2c0c9420 0x7fca2c0c89c0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:33.091 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.087+0000 7fca318ef700 1 -- 172.21.15.32:0/246351350 >> 172.21.15.32:0/246351350 conn(0x7fca2c0b0900 msgr2=0x7fca2c0ceb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:10:33.091 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.087+0000 7fca318ef700 1 -- 172.21.15.32:0/246351350 shutdown_connections 2023-10-08T06:10:33.091 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.087+0000 7fca318ef700 1 -- 172.21.15.32:0/246351350 wait complete. 2023-10-08T06:10:33.103 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-08T06:10:33.220 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.219+0000 7fe7f5623700 1 Processor -- start 2023-10-08T06:10:33.221 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.219+0000 7fe7f5623700 1 -- start start 2023-10-08T06:10:33.222 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.219+0000 7fe7f5623700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe7f0161670 0x7fe7f00cda70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:33.222 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.219+0000 7fe7f5623700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fe7f0161a50 0x7fe7f0070f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:33.222 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.219+0000 7fe7f5623700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7f006ee40 con 0x7fe7f00cdfb0 2023-10-08T06:10:33.222 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.219+0000 7fe7f5623700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7f006ea20 con 0x7fe7f0161a50 2023-10-08T06:10:33.222 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.219+0000 7fe7f5623700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7f0166160 con 0x7fe7f0161670 2023-10-08T06:10:33.222 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.219+0000 7fe7ee7fc700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fe7f0161a50 0x7fe7f0070f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:33.222 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.219+0000 7fe7ee7fc700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fe7f0161a50 0x7fe7f0070f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:33824/0 (socket says 172.21.15.32:33824) 2023-10-08T06:10:33.222 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.219+0000 7fe7ee7fc700 1 -- 172.21.15.32:0/3909416081 learned_addr learned my addr 172.21.15.32:0/3909416081 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:10:33.223 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.219+0000 7fe7eeffd700 1 --2- 172.21.15.32:0/3909416081 >> v2:172.21.15.40:3300/0 conn(0x7fe7f0161670 0x7fe7f00cda70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:33.223 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.219+0000 7fe7ee7fc700 1 -- 172.21.15.32:0/3909416081 >> v2:172.21.15.40:3300/0 conn(0x7fe7f0161670 msgr2=0x7fe7f00cda70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:10:33.223 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.219+0000 7fe7ee7fc700 1 --2- 172.21.15.32:0/3909416081 >> v2:172.21.15.40:3300/0 conn(0x7fe7f0161670 0x7fe7f00cda70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:33.223 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.219+0000 7fe7ee7fc700 1 -- 172.21.15.32:0/3909416081 >> v1:172.21.15.32:6789/0 conn(0x7fe7f00cdfb0 legacy=0x7fe7f006a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:33.223 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.219+0000 7fe7ee7fc700 1 -- 172.21.15.32:0/3909416081 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7f00cf980 con 0x7fe7f0161a50 2023-10-08T06:10:33.224 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.219+0000 7fe7ee7fc700 1 --2- 172.21.15.32:0/3909416081 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe7f0161a50 0x7fe7f0070f90 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fe7f006c280 tx=0x7fe7e800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf0ca2e4b105165b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:33.224 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.219+0000 7fe7edffb700 1 -- 172.21.15.32:0/3909416081 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7e800e070 con 0x7fe7f0161a50 2023-10-08T06:10:33.224 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.219+0000 7fe7edffb700 1 -- 172.21.15.32:0/3909416081 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7e800b9c0 con 0x7fe7f0161a50 2023-10-08T06:10:33.224 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.219+0000 7fe7edffb700 1 -- 172.21.15.32:0/3909416081 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7e800bd70 con 0x7fe7f0161a50 2023-10-08T06:10:33.225 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.223+0000 7fe7f5623700 1 -- 172.21.15.32:0/3909416081 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe7f0161a50 msgr2=0x7fe7f0070f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:33.225 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.223+0000 7fe7f5623700 1 --2- 172.21.15.32:0/3909416081 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe7f0161a50 0x7fe7f0070f90 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fe7f006c280 tx=0x7fe7e800b330 comp rx=0 tx=0).stop 2023-10-08T06:10:33.225 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.223+0000 7fe7f5623700 1 -- 172.21.15.32:0/3909416081 shutdown_connections 2023-10-08T06:10:33.225 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.223+0000 7fe7f5623700 1 --2- 172.21.15.32:0/3909416081 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe7f0161a50 0x7fe7f0070f90 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:33.225 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.223+0000 7fe7f5623700 1 --2- 172.21.15.32:0/3909416081 >> v2:172.21.15.40:3300/0 conn(0x7fe7f0161670 0x7fe7f00cda70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:33.225 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.223+0000 7fe7f5623700 1 -- 172.21.15.32:0/3909416081 >> 172.21.15.32:0/3909416081 conn(0x7fe7f00cfea0 msgr2=0x7fe7f00d02b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:10:33.225 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.223+0000 7fe7f5623700 1 -- 172.21.15.32:0/3909416081 shutdown_connections 2023-10-08T06:10:33.225 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.223+0000 7fe7f5623700 1 -- 172.21.15.32:0/3909416081 wait complete. 2023-10-08T06:10:33.227 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.223+0000 7fe7f5623700 1 Processor -- start 2023-10-08T06:10:33.227 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.223+0000 7fe7f5623700 1 -- start start 2023-10-08T06:10:33.229 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.227+0000 7fe7f5623700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe7f00cdfb0 0x7fe7f01594d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:33.229 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.227+0000 7fe7f5623700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe7f0161670 0x7fe7f00b4e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:33.229 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.227+0000 7fe7f5623700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe7f0161a50 0x7fe7f00c5a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:33.230 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.227+0000 7fe7f5623700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7f00b53a0 con 0x7fe7f00cdfb0 2023-10-08T06:10:33.230 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.227+0000 7fe7f5623700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7f00b3470 con 0x7fe7f0161670 2023-10-08T06:10:33.230 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.227+0000 7fe7f5623700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7f00c4680 con 0x7fe7f0161a50 2023-10-08T06:10:33.230 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.227+0000 7fe7eeffd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe7f00cdfb0 0x7fe7f01594d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:33.230 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.227+0000 7fe7eeffd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe7f00cdfb0 0x7fe7f01594d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:33834/0 (socket says 172.21.15.32:33834) 2023-10-08T06:10:33.230 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.227+0000 7fe7eeffd700 1 -- 172.21.15.32:0/2982347907 learned_addr learned my addr 172.21.15.32:0/2982347907 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:10:33.230 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.227+0000 7fe7ef7fe700 1 --2- 172.21.15.32:0/2982347907 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe7f0161a50 0x7fe7f00c5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:33.230 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.227+0000 7fe7ee7fc700 1 --2- 172.21.15.32:0/2982347907 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe7f0161670 0x7fe7f00b4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:33.231 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.227+0000 7fe7eeffd700 1 -- 172.21.15.32:0/2982347907 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe7f0161a50 msgr2=0x7fe7f00c5a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:33.232 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.227+0000 7fe7eeffd700 1 --2- 172.21.15.32:0/2982347907 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe7f0161a50 0x7fe7f00c5a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:33.232 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.227+0000 7fe7eeffd700 1 -- 172.21.15.32:0/2982347907 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe7f0161670 msgr2=0x7fe7f00b4e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:33.232 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.227+0000 7fe7eeffd700 1 --2- 172.21.15.32:0/2982347907 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe7f0161670 0x7fe7f00b4e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:33.232 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.227+0000 7fe7eeffd700 1 -- 172.21.15.32:0/2982347907 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7e8009b30 con 0x7fe7f00cdfb0 2023-10-08T06:10:33.232 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.227+0000 7fe7eeffd700 1 --2- 172.21.15.32:0/2982347907 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe7f00cdfb0 0x7fe7f01594d0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fe7d800e760 tx=0x7fe7d800ea70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:33.232 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.227+0000 7fe7e77fe700 1 -- 172.21.15.32:0/2982347907 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7d800c070 con 0x7fe7f00cdfb0 2023-10-08T06:10:33.232 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.227+0000 7fe7e77fe700 1 -- 172.21.15.32:0/2982347907 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7d8013610 con 0x7fe7f00cdfb0 2023-10-08T06:10:33.232 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.227+0000 7fe7f5623700 1 -- 172.21.15.32:0/2982347907 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7f00b4420 con 0x7fe7f00cdfb0 2023-10-08T06:10:33.232 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.227+0000 7fe7e77fe700 1 -- 172.21.15.32:0/2982347907 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7d8013980 con 0x7fe7f00cdfb0 2023-10-08T06:10:33.232 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.227+0000 7fe7f5623700 1 -- 172.21.15.32:0/2982347907 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7f00b4660 con 0x7fe7f00cdfb0 2023-10-08T06:10:33.233 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.231+0000 7fe7f5623700 1 -- 172.21.15.32:0/2982347907 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7f00686a0 con 0x7fe7f00cdfb0 2023-10-08T06:10:33.234 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.231+0000 7fe7e77fe700 1 -- 172.21.15.32:0/2982347907 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fe7d8013ae0 con 0x7fe7f00cdfb0 2023-10-08T06:10:33.234 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.231+0000 7fe7e77fe700 1 --2- 172.21.15.32:0/2982347907 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fe7d0066510 0x7fe7d00689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:33.235 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.231+0000 7fe7e77fe700 1 -- 172.21.15.32:0/2982347907 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fe7d8083730 con 0x7fe7f00cdfb0 2023-10-08T06:10:33.235 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.231+0000 7fe7ee7fc700 1 --2- 172.21.15.32:0/2982347907 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fe7d0066510 0x7fe7d00689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:33.236 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.235+0000 7fe7ee7fc700 1 --2- 172.21.15.32:0/2982347907 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fe7d0066510 0x7fe7d00689d0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fe7e8000f80 tx=0x7fe7e8009000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:33.245 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.243+0000 7fe7e77fe700 1 -- 172.21.15.32:0/2982347907 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fe7d8050e80 con 0x7fe7f00cdfb0 2023-10-08T06:10:33.411 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.407+0000 7fe7f5623700 1 -- 172.21.15.32:0/2982347907 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fe7f00b4420 con 0x7fe7f00cdfb0 2023-10-08T06:10:33.411 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.407+0000 7fe7e77fe700 1 -- 172.21.15.32:0/2982347907 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v31) v1 ==== 84+0+65 (secure 0 0 0) 0x7fe7f00b4420 con 0x7fe7f00cdfb0 2023-10-08T06:10:33.411 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:10:33.411 INFO:teuthology.orchestra.run.smithi032.stdout:[ 2023-10-08T06:10:33.412 INFO:teuthology.orchestra.run.smithi032.stdout: { 2023-10-08T06:10:33.412 INFO:teuthology.orchestra.run.smithi032.stdout: "poolnum": 1, 2023-10-08T06:10:33.412 INFO:teuthology.orchestra.run.smithi032.stdout: "poolname": ".mgr" 2023-10-08T06:10:33.412 INFO:teuthology.orchestra.run.smithi032.stdout: } 2023-10-08T06:10:33.412 INFO:teuthology.orchestra.run.smithi032.stdout:] 2023-10-08T06:10:33.414 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.411+0000 7fe7f5623700 1 -- 172.21.15.32:0/2982347907 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fe7d0066510 msgr2=0x7fe7d00689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:33.414 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.411+0000 7fe7f5623700 1 --2- 172.21.15.32:0/2982347907 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fe7d0066510 0x7fe7d00689d0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fe7e8000f80 tx=0x7fe7e8009000 comp rx=0 tx=0).stop 2023-10-08T06:10:33.414 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.411+0000 7fe7f5623700 1 -- 172.21.15.32:0/2982347907 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe7f00cdfb0 msgr2=0x7fe7f01594d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:33.414 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.411+0000 7fe7f5623700 1 --2- 172.21.15.32:0/2982347907 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe7f00cdfb0 0x7fe7f01594d0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fe7d800e760 tx=0x7fe7d800ea70 comp rx=0 tx=0).stop 2023-10-08T06:10:33.414 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.411+0000 7fe7f5623700 1 -- 172.21.15.32:0/2982347907 shutdown_connections 2023-10-08T06:10:33.414 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.411+0000 7fe7f5623700 1 --2- 172.21.15.32:0/2982347907 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fe7d0066510 0x7fe7d00689d0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:33.414 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.411+0000 7fe7f5623700 1 --2- 172.21.15.32:0/2982347907 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe7f0161a50 0x7fe7f00c5a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:33.415 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.411+0000 7fe7f5623700 1 --2- 172.21.15.32:0/2982347907 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe7f0161670 0x7fe7f00b4e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:33.415 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.411+0000 7fe7f5623700 1 --2- 172.21.15.32:0/2982347907 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe7f00cdfb0 0x7fe7f01594d0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:33.415 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.411+0000 7fe7f5623700 1 -- 172.21.15.32:0/2982347907 >> 172.21.15.32:0/2982347907 conn(0x7fe7f00cfea0 msgr2=0x7fe7f00d0280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:10:33.415 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.411+0000 7fe7f5623700 1 -- 172.21.15.32:0/2982347907 shutdown_connections 2023-10-08T06:10:33.415 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.411+0000 7fe7f5623700 1 -- 172.21.15.32:0/2982347907 wait complete. 2023-10-08T06:10:33.426 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-08T06:10:33.426 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-08T06:10:33.546 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.543+0000 7f767b59e700 1 Processor -- start 2023-10-08T06:10:33.546 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.543+0000 7f767b59e700 1 -- start start 2023-10-08T06:10:33.548 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.543+0000 7f767b59e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f767c0d0490 0x7f767c0cb4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:33.548 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.543+0000 7f767b59e700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f767c15f660 0x7f767c15b600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:33.548 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.543+0000 7f767b59e700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f767c15fb90 con 0x7f767c0b64b0 2023-10-08T06:10:33.548 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.543+0000 7f767b59e700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f767c0ceb70 con 0x7f767c15f660 2023-10-08T06:10:33.548 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.543+0000 7f767b59e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f767c0cf8f0 con 0x7f767c0d0490 2023-10-08T06:10:33.548 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.547+0000 7f767ad9d700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f767c15f660 0x7f767c15b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:33.548 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.547+0000 7f767ad9d700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f767c15f660 0x7f767c15b600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:33838/0 (socket says 172.21.15.32:33838) 2023-10-08T06:10:33.549 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.547+0000 7f767ad9d700 1 -- 172.21.15.32:0/29745107 learned_addr learned my addr 172.21.15.32:0/29745107 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:10:33.549 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.547+0000 7f7679d9b700 1 --2- 172.21.15.32:0/29745107 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f767c0d0490 0x7f767c0cb4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:33.551 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.547+0000 7f767ad9d700 1 -- 172.21.15.32:0/29745107 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f767c0d0490 msgr2=0x7f767c0cb4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:10:33.551 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.547+0000 7f767ad9d700 1 --2- 172.21.15.32:0/29745107 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f767c0d0490 0x7f767c0cb4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:33.552 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.547+0000 7f767ad9d700 1 -- 172.21.15.32:0/29745107 >> v1:172.21.15.40:6789/0 conn(0x7f767c0b64b0 legacy=0x7f767c0cfd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:33.552 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.547+0000 7f767ad9d700 1 -- 172.21.15.32:0/29745107 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f767c0cee10 con 0x7f767c15f660 2023-10-08T06:10:33.552 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.547+0000 7f767ad9d700 1 --2- 172.21.15.32:0/29745107 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f767c15f660 0x7f767c15b600 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f7674009e50 tx=0x7f767400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3d238910dba5926 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:33.552 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.547+0000 7f767959a700 1 -- 172.21.15.32:0/29745107 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f767400e070 con 0x7f767c15f660 2023-10-08T06:10:33.552 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.547+0000 7f767959a700 1 -- 172.21.15.32:0/29745107 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f767400b910 con 0x7f767c15f660 2023-10-08T06:10:33.552 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.547+0000 7f767959a700 1 -- 172.21.15.32:0/29745107 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f767400bcc0 con 0x7f767c15f660 2023-10-08T06:10:33.553 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.547+0000 7f767b59e700 1 -- 172.21.15.32:0/29745107 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f767c15f660 msgr2=0x7f767c15b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:33.553 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.547+0000 7f767b59e700 1 --2- 172.21.15.32:0/29745107 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f767c15f660 0x7f767c15b600 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f7674009e50 tx=0x7f767400b330 comp rx=0 tx=0).stop 2023-10-08T06:10:33.553 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.547+0000 7f767b59e700 1 -- 172.21.15.32:0/29745107 shutdown_connections 2023-10-08T06:10:33.553 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.547+0000 7f767b59e700 1 --2- 172.21.15.32:0/29745107 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f767c15f660 0x7f767c15b600 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:33.553 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.547+0000 7f767b59e700 1 --2- 172.21.15.32:0/29745107 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f767c0d0490 0x7f767c0cb4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:33.553 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.547+0000 7f767b59e700 1 -- 172.21.15.32:0/29745107 >> 172.21.15.32:0/29745107 conn(0x7f767c06df60 msgr2=0x7f767c06e370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:10:33.554 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.547+0000 7f767b59e700 1 -- 172.21.15.32:0/29745107 shutdown_connections 2023-10-08T06:10:33.554 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.547+0000 7f767b59e700 1 -- 172.21.15.32:0/29745107 wait complete. 2023-10-08T06:10:33.559 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.551+0000 7f767b59e700 1 Processor -- start 2023-10-08T06:10:33.559 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.551+0000 7f767b59e700 1 -- start start 2023-10-08T06:10:33.559 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.551+0000 7f767b59e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f767c0b64b0 0x7f767c154340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:33.559 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.551+0000 7f767b59e700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f767c0d0490 0x7f767c0ac8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:33.560 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.551+0000 7f767b59e700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f767c15f660 0x7f767c0cb4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:33.560 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.551+0000 7f767b59e700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f767c0ae290 con 0x7f767c15f660 2023-10-08T06:10:33.560 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.551+0000 7f767b59e700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f767c154880 con 0x7f767c0d0490 2023-10-08T06:10:33.560 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.551+0000 7f767b59e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f767c0ad390 con 0x7f767c0b64b0 2023-10-08T06:10:33.560 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.551+0000 7f767ad9d700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f767c15f660 0x7f767c0cb4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:33.561 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.551+0000 7f767ad9d700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f767c15f660 0x7f767c0cb4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:33844/0 (socket says 172.21.15.32:33844) 2023-10-08T06:10:33.561 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.551+0000 7f767ad9d700 1 -- 172.21.15.32:0/2964459721 learned_addr learned my addr 172.21.15.32:0/2964459721 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:10:33.561 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.551+0000 7f767a59c700 1 --2- 172.21.15.32:0/2964459721 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f767c0b64b0 0x7f767c154340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:33.561 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.551+0000 7f7679d9b700 1 --2- 172.21.15.32:0/2964459721 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f767c0d0490 0x7f767c0ac8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:33.561 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.551+0000 7f767ad9d700 1 -- 172.21.15.32:0/2964459721 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f767c0b64b0 msgr2=0x7f767c154340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:33.561 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.551+0000 7f767ad9d700 1 --2- 172.21.15.32:0/2964459721 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f767c0b64b0 0x7f767c154340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:33.562 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.551+0000 7f767ad9d700 1 -- 172.21.15.32:0/2964459721 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f767c0d0490 msgr2=0x7f767c0ac8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:33.562 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.551+0000 7f767ad9d700 1 --2- 172.21.15.32:0/2964459721 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f767c0d0490 0x7f767c0ac8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:33.562 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.551+0000 7f767ad9d700 1 -- 172.21.15.32:0/2964459721 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7674009b30 con 0x7f767c15f660 2023-10-08T06:10:33.562 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.551+0000 7f767ad9d700 1 --2- 172.21.15.32:0/2964459721 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f767c15f660 0x7f767c0cb4a0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f767400b680 tx=0x7f7674004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:33.562 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.551+0000 7f766affd700 1 -- 172.21.15.32:0/2964459721 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7674004830 con 0x7f767c15f660 2023-10-08T06:10:33.563 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.551+0000 7f766affd700 1 -- 172.21.15.32:0/2964459721 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76740099b0 con 0x7f767c15f660 2023-10-08T06:10:33.563 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.551+0000 7f767b59e700 1 -- 172.21.15.32:0/2964459721 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f767c0ace30 con 0x7f767c15f660 2023-10-08T06:10:33.563 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.551+0000 7f766affd700 1 -- 172.21.15.32:0/2964459721 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7674004990 con 0x7f767c15f660 2023-10-08T06:10:33.563 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.551+0000 7f767b59e700 1 -- 172.21.15.32:0/2964459721 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f767c0ad7b0 con 0x7f767c15f660 2023-10-08T06:10:33.563 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.555+0000 7f767b59e700 1 -- 172.21.15.32:0/2964459721 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f767c0686a0 con 0x7f767c15f660 2023-10-08T06:10:33.563 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.555+0000 7f766affd700 1 -- 172.21.15.32:0/2964459721 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f767401c680 con 0x7f767c15f660 2023-10-08T06:10:33.564 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.555+0000 7f766affd700 1 --2- 172.21.15.32:0/2964459721 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f765c066510 0x7f765c0689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:33.564 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.555+0000 7f766affd700 1 -- 172.21.15.32:0/2964459721 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f76740855d0 con 0x7f767c15f660 2023-10-08T06:10:33.564 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.555+0000 7f767a59c700 1 --2- 172.21.15.32:0/2964459721 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f765c066510 0x7f765c0689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:33.564 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.555+0000 7f767a59c700 1 --2- 172.21.15.32:0/2964459721 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f765c066510 0x7f765c0689d0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f766c000f60 tx=0x7f766c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:33.567 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.563+0000 7f766affd700 1 -- 172.21.15.32:0/2964459721 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f7674052ed0 con 0x7f767c15f660 2023-10-08T06:10:33.734 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.731+0000 7f767b59e700 1 -- 172.21.15.32:0/2964459721 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f767c06ff10 con 0x7f767c15f660 2023-10-08T06:10:33.831 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.827+0000 7f766affd700 1 -- 172.21.15.32:0/2964459721 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v32) v1 ==== 138+0+0 (secure 0 0 0) 0x7f76740564f0 con 0x7f767c15f660 2023-10-08T06:10:33.837 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.835+0000 7f767b59e700 1 -- 172.21.15.32:0/2964459721 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f765c066510 msgr2=0x7f765c0689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:33.837 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.835+0000 7f767b59e700 1 --2- 172.21.15.32:0/2964459721 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f765c066510 0x7f765c0689d0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f766c000f60 tx=0x7f766c009040 comp rx=0 tx=0).stop 2023-10-08T06:10:33.837 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.835+0000 7f767b59e700 1 -- 172.21.15.32:0/2964459721 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f767c15f660 msgr2=0x7f767c0cb4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:33.837 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.835+0000 7f767b59e700 1 --2- 172.21.15.32:0/2964459721 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f767c15f660 0x7f767c0cb4a0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f767400b680 tx=0x7f7674004af0 comp rx=0 tx=0).stop 2023-10-08T06:10:33.837 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.835+0000 7f767b59e700 1 -- 172.21.15.32:0/2964459721 shutdown_connections 2023-10-08T06:10:33.838 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.835+0000 7f767b59e700 1 --2- 172.21.15.32:0/2964459721 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f765c066510 0x7f765c0689d0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:33.838 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.835+0000 7f767b59e700 1 --2- 172.21.15.32:0/2964459721 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f767c15f660 0x7f767c0cb4a0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:33.838 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.835+0000 7f767b59e700 1 --2- 172.21.15.32:0/2964459721 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f767c0d0490 0x7f767c0ac8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:33.838 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.835+0000 7f767b59e700 1 --2- 172.21.15.32:0/2964459721 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f767c0b64b0 0x7f767c154340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:33.838 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.835+0000 7f767b59e700 1 -- 172.21.15.32:0/2964459721 >> 172.21.15.32:0/2964459721 conn(0x7f767c06df60 msgr2=0x7f767c0b5b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:10:33.839 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.835+0000 7f767b59e700 1 -- 172.21.15.32:0/2964459721 shutdown_connections 2023-10-08T06:10:33.840 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.839+0000 7f767b59e700 1 -- 172.21.15.32:0/2964459721 wait complete. 2023-10-08T06:10:33.843 INFO:teuthology.orchestra.run.smithi032.stderr:pool 'cephfs_metadata' created 2023-10-08T06:10:33.857 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-08T06:10:33.974 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.971+0000 7f89c8809700 1 Processor -- start 2023-10-08T06:10:33.974 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.971+0000 7f89c8809700 1 -- start start 2023-10-08T06:10:33.977 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.971+0000 7f89c8809700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f89c415d7b0 0x7f89c40d1480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:33.977 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.971+0000 7f89c8809700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f89c40b8de0 0x7f89c40d19c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:33.977 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.971+0000 7f89c8809700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89c40cdde0 con 0x7f89c40b4b60 2023-10-08T06:10:33.977 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.975+0000 7f89c8809700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89c40d2060 con 0x7f89c40b8de0 2023-10-08T06:10:33.977 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.975+0000 7f89c8809700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89c40d2340 con 0x7f89c415d7b0 2023-10-08T06:10:33.977 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.975+0000 7f89c359e700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f89c40b8de0 0x7f89c40d19c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:33.978 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.975+0000 7f89c359e700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f89c40b8de0 0x7f89c40d19c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:33848/0 (socket says 172.21.15.32:33848) 2023-10-08T06:10:33.978 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.975+0000 7f89c359e700 1 -- 172.21.15.32:0/567530239 learned_addr learned my addr 172.21.15.32:0/567530239 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:10:33.978 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.975+0000 7f89c259c700 1 --2- 172.21.15.32:0/567530239 >> v2:172.21.15.40:3300/0 conn(0x7f89c415d7b0 0x7f89c40d1480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:33.978 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.975+0000 7f89c359e700 1 -- 172.21.15.32:0/567530239 >> v2:172.21.15.40:3300/0 conn(0x7f89c415d7b0 msgr2=0x7f89c40d1480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:10:33.978 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.975+0000 7f89c359e700 1 --2- 172.21.15.32:0/567530239 >> v2:172.21.15.40:3300/0 conn(0x7f89c415d7b0 0x7f89c40d1480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:33.978 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.975+0000 7f89c359e700 1 -- 172.21.15.32:0/567530239 >> v1:172.21.15.32:6789/0 conn(0x7f89c40b4b60 legacy=0x7f89c40b4f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:33.978 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.975+0000 7f89c1d9b700 1 -- 172.21.15.32:0/567530239 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3956515106 0 0) 0x7f89c40cdde0 con 0x7f89c40b4b60 2023-10-08T06:10:33.978 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.975+0000 7f89c359e700 1 -- 172.21.15.32:0/567530239 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89c40d2620 con 0x7f89c40b8de0 2023-10-08T06:10:33.978 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.975+0000 7f89c359e700 1 --2- 172.21.15.32:0/567530239 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f89c40b8de0 0x7f89c40d19c0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f89c40d41e0 tx=0x7f89bc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=409c524eab4f3f10 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:33.979 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.975+0000 7f89c1d9b700 1 -- 172.21.15.32:0/567530239 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89bc00e070 con 0x7f89c40b8de0 2023-10-08T06:10:33.979 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.975+0000 7f89c1d9b700 1 -- 172.21.15.32:0/567530239 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89bc00b9c0 con 0x7f89c40b8de0 2023-10-08T06:10:33.979 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.975+0000 7f89c1d9b700 1 -- 172.21.15.32:0/567530239 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89bc00bd70 con 0x7f89c40b8de0 2023-10-08T06:10:33.979 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.975+0000 7f89c8809700 1 -- 172.21.15.32:0/567530239 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f89c40b8de0 msgr2=0x7f89c40d19c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:33.980 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.975+0000 7f89c8809700 1 --2- 172.21.15.32:0/567530239 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f89c40b8de0 0x7f89c40d19c0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f89c40d41e0 tx=0x7f89bc00b330 comp rx=0 tx=0).stop 2023-10-08T06:10:33.980 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.975+0000 7f89c8809700 1 -- 172.21.15.32:0/567530239 shutdown_connections 2023-10-08T06:10:33.980 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.975+0000 7f89c8809700 1 --2- 172.21.15.32:0/567530239 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f89c40b8de0 0x7f89c40d19c0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:33.980 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.975+0000 7f89c8809700 1 --2- 172.21.15.32:0/567530239 >> v2:172.21.15.40:3300/0 conn(0x7f89c415d7b0 0x7f89c40d1480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:33.980 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.975+0000 7f89c8809700 1 -- 172.21.15.32:0/567530239 >> 172.21.15.32:0/567530239 conn(0x7f89c40cfb60 msgr2=0x7f89c40cff40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:10:33.980 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.975+0000 7f89c8809700 1 -- 172.21.15.32:0/567530239 shutdown_connections 2023-10-08T06:10:33.980 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.975+0000 7f89c8809700 1 -- 172.21.15.32:0/567530239 wait complete. 2023-10-08T06:10:33.981 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.979+0000 7f89c8809700 1 Processor -- start 2023-10-08T06:10:33.981 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.979+0000 7f89c8809700 1 -- start start 2023-10-08T06:10:33.982 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.979+0000 7f89c8809700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f89c40b4b60 0x7f89c414f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:33.983 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.979+0000 7f89c8809700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f89c40b8de0 0x7f89c40d3580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:33.983 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.979+0000 7f89c8809700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f89c4158a20 0x7f89c415aed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:33.983 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.979+0000 7f89c8809700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89c415a130 con 0x7f89c40b4b60 2023-10-08T06:10:33.983 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.979+0000 7f89c8809700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89c415bec0 con 0x7f89c40b8de0 2023-10-08T06:10:33.983 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.979+0000 7f89c8809700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89c415a3f0 con 0x7f89c4158a20 2023-10-08T06:10:33.983 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.979+0000 7f89c2d9d700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f89c40b4b60 0x7f89c414f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:33.983 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.979+0000 7f89c2d9d700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f89c40b4b60 0x7f89c414f010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:33864/0 (socket says 172.21.15.32:33864) 2023-10-08T06:10:33.983 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.979+0000 7f89c2d9d700 1 -- 172.21.15.32:0/584437730 learned_addr learned my addr 172.21.15.32:0/584437730 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:10:33.983 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.979+0000 7f89c359e700 1 --2- 172.21.15.32:0/584437730 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f89c4158a20 0x7f89c415aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:33.983 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.979+0000 7f89c259c700 1 --2- 172.21.15.32:0/584437730 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f89c40b8de0 0x7f89c40d3580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:33.983 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.979+0000 7f89c2d9d700 1 -- 172.21.15.32:0/584437730 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f89c4158a20 msgr2=0x7f89c415aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:33.984 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.979+0000 7f89c2d9d700 1 --2- 172.21.15.32:0/584437730 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f89c4158a20 0x7f89c415aed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:33.984 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.979+0000 7f89c2d9d700 1 -- 172.21.15.32:0/584437730 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f89c40b8de0 msgr2=0x7f89c40d3580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:33.984 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.979+0000 7f89c2d9d700 1 --2- 172.21.15.32:0/584437730 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f89c40b8de0 0x7f89c40d3580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:33.984 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.979+0000 7f89c2d9d700 1 -- 172.21.15.32:0/584437730 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89bc009b30 con 0x7f89c40b4b60 2023-10-08T06:10:33.985 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.979+0000 7f89c2d9d700 1 --2- 172.21.15.32:0/584437730 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f89c40b4b60 0x7f89c414f010 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f89ac0011e0 tx=0x7f89ac00ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:33.985 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.979+0000 7f89bb7fe700 1 -- 172.21.15.32:0/584437730 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89ac0054e0 con 0x7f89c40b4b60 2023-10-08T06:10:33.985 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.979+0000 7f89bb7fe700 1 -- 172.21.15.32:0/584437730 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89ac0036a0 con 0x7f89c40b4b60 2023-10-08T06:10:33.985 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.979+0000 7f89c8809700 1 -- 172.21.15.32:0/584437730 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89c415a6d0 con 0x7f89c40b4b60 2023-10-08T06:10:33.985 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.979+0000 7f89bb7fe700 1 -- 172.21.15.32:0/584437730 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89ac003a50 con 0x7f89c40b4b60 2023-10-08T06:10:33.985 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.979+0000 7f89c8809700 1 -- 172.21.15.32:0/584437730 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89c40d3ac0 con 0x7f89c40b4b60 2023-10-08T06:10:33.985 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.983+0000 7f89c8809700 1 -- 172.21.15.32:0/584437730 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89c415abf0 con 0x7f89c40b4b60 2023-10-08T06:10:33.986 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.983+0000 7f89bb7fe700 1 -- 172.21.15.32:0/584437730 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f89ac003bb0 con 0x7f89c40b4b60 2023-10-08T06:10:33.988 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.983+0000 7f89bb7fe700 1 --2- 172.21.15.32:0/584437730 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f89a4066510 0x7f89a40689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:33.988 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.987+0000 7f89c259c700 1 --2- 172.21.15.32:0/584437730 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f89a4066510 0x7f89a40689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:33.988 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.987+0000 7f89bb7fe700 1 -- 172.21.15.32:0/584437730 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f89ac083560 con 0x7f89c40b4b60 2023-10-08T06:10:33.988 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.987+0000 7f89c259c700 1 --2- 172.21.15.32:0/584437730 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f89a4066510 0x7f89a40689d0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f89c40c6530 tx=0x7f89b4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:33.990 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:33.987+0000 7f89bb7fe700 1 -- 172.21.15.32:0/584437730 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f89ac050ba0 con 0x7f89c40b4b60 2023-10-08T06:10:34.161 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:34.159+0000 7f89c8809700 1 -- 172.21.15.32:0/584437730 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f89c40d3c50 con 0x7f89c40b4b60 2023-10-08T06:10:34.309 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T06:10:34.312 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T06:10:34.836 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:34.831+0000 7f89bb7fe700 1 -- 172.21.15.32:0/584437730 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v33) v1 ==== 170+0+0 (secure 0 0 0) 0x7f89ac0170d0 con 0x7f89c40b4b60 2023-10-08T06:10:34.842 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:34.839+0000 7f89c8809700 1 -- 172.21.15.32:0/584437730 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f89a4066510 msgr2=0x7f89a40689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:34.842 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:34.839+0000 7f89c8809700 1 --2- 172.21.15.32:0/584437730 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f89a4066510 0x7f89a40689d0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f89c40c6530 tx=0x7f89b4008040 comp rx=0 tx=0).stop 2023-10-08T06:10:34.842 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:34.839+0000 7f89c8809700 1 -- 172.21.15.32:0/584437730 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f89c40b4b60 msgr2=0x7f89c414f010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:34.842 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:34.839+0000 7f89c8809700 1 --2- 172.21.15.32:0/584437730 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f89c40b4b60 0x7f89c414f010 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f89ac0011e0 tx=0x7f89ac00ca30 comp rx=0 tx=0).stop 2023-10-08T06:10:34.844 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:34.843+0000 7f89c8809700 1 -- 172.21.15.32:0/584437730 shutdown_connections 2023-10-08T06:10:34.844 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:34.843+0000 7f89c8809700 1 --2- 172.21.15.32:0/584437730 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f89a4066510 0x7f89a40689d0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:34.844 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:34.843+0000 7f89c8809700 1 --2- 172.21.15.32:0/584437730 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f89c4158a20 0x7f89c415aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:34.845 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:34.843+0000 7f89c8809700 1 --2- 172.21.15.32:0/584437730 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f89c40b8de0 0x7f89c40d3580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:34.845 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:34.843+0000 7f89c8809700 1 --2- 172.21.15.32:0/584437730 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f89c40b4b60 0x7f89c414f010 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:34.845 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:34.843+0000 7f89c8809700 1 -- 172.21.15.32:0/584437730 >> 172.21.15.32:0/584437730 conn(0x7f89c40cfb60 msgr2=0x7f89c4159670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:10:34.856 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:34.855+0000 7f89c8809700 1 -- 172.21.15.32:0/584437730 shutdown_connections 2023-10-08T06:10:34.856 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:34.855+0000 7f89c8809700 1 -- 172.21.15.32:0/584437730 wait complete. 2023-10-08T06:10:34.864 INFO:teuthology.orchestra.run.smithi032.stderr:pool 'cephfs_data' created 2023-10-08T06:10:34.875 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-08T06:10:34.994 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:34.991+0000 7fc14bfff700 1 Processor -- start 2023-10-08T06:10:34.994 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:34.991+0000 7fc14bfff700 1 -- start start 2023-10-08T06:10:34.996 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:34.995+0000 7fc14bfff700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fc14c0b6280 0x7fc14c0cb4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:34.996 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:34.995+0000 7fc14bfff700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc14c0d0cd0 con 0x7fc14c0b3000 2023-10-08T06:10:34.997 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:34.995+0000 7fc14bfff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc14c0d0560 con 0x7fc14c15c0c0 2023-10-08T06:10:34.997 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:34.995+0000 7fc14bfff700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc14c15c610 con 0x7fc14c0b6280 2023-10-08T06:10:34.997 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:34.995+0000 7fc14affd700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fc14c0b6280 0x7fc14c0cb4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:34.997 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:34.995+0000 7fc14b7fe700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fc14c0b3000 0x7fc14c0cea40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:54100/0 (socket says 172.21.15.32:54100) 2023-10-08T06:10:34.997 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:34.995+0000 7fc14b7fe700 1 -- 172.21.15.32:0/2552478827 learned_addr learned my addr 172.21.15.32:0/2552478827 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-08T06:10:34.998 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:34.995+0000 7fc14affd700 1 -- 172.21.15.32:0/2552478827 >> v1:172.21.15.40:6789/0 conn(0x7fc14c15c0c0 legacy=0x7fc14c0b28f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:34.998 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:34.995+0000 7fc14affd700 1 -- 172.21.15.32:0/2552478827 >> v1:172.21.15.32:6789/0 conn(0x7fc14c0b3000 legacy=0x7fc14c0cea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:34.998 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:34.995+0000 7fc14affd700 1 -- 172.21.15.32:0/2552478827 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc14c0cff00 con 0x7fc14c0b6280 2023-10-08T06:10:34.998 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:34.995+0000 7fc14affd700 1 --2- 172.21.15.32:0/2552478827 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc14c0b6280 0x7fc14c0cb4c0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fc13c009850 tx=0x7fc13c009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2da83ba0c9251006 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:34.998 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:34.995+0000 7fc14a7fc700 1 -- 172.21.15.32:0/2552478827 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc13c004230 con 0x7fc14c0b6280 2023-10-08T06:10:34.998 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:34.995+0000 7fc14a7fc700 1 -- 172.21.15.32:0/2552478827 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc13c004390 con 0x7fc14c0b6280 2023-10-08T06:10:34.998 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:34.995+0000 7fc14a7fc700 1 -- 172.21.15.32:0/2552478827 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc13c0036c0 con 0x7fc14c0b6280 2023-10-08T06:10:34.999 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:34.995+0000 7fc14bfff700 1 -- 172.21.15.32:0/2552478827 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc14c0b6280 msgr2=0x7fc14c0cb4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:34.999 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:34.995+0000 7fc14bfff700 1 --2- 172.21.15.32:0/2552478827 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc14c0b6280 0x7fc14c0cb4c0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fc13c009850 tx=0x7fc13c009b60 comp rx=0 tx=0).stop 2023-10-08T06:10:34.999 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:34.995+0000 7fc14bfff700 1 -- 172.21.15.32:0/2552478827 shutdown_connections 2023-10-08T06:10:35.000 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:34.995+0000 7fc14bfff700 1 --2- 172.21.15.32:0/2552478827 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc14c0b6280 0x7fc14c0cb4c0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:35.000 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:34.995+0000 7fc14bfff700 1 -- 172.21.15.32:0/2552478827 >> 172.21.15.32:0/2552478827 conn(0x7fc14c06dfa0 msgr2=0x7fc14c06e380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:10:35.000 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:34.995+0000 7fc14bfff700 1 -- 172.21.15.32:0/2552478827 shutdown_connections 2023-10-08T06:10:35.000 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:34.995+0000 7fc14bfff700 1 -- 172.21.15.32:0/2552478827 wait complete. 2023-10-08T06:10:35.001 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:34.999+0000 7fc14bfff700 1 Processor -- start 2023-10-08T06:10:35.002 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:34.999+0000 7fc14bfff700 1 -- start start 2023-10-08T06:10:35.004 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:34.999+0000 7fc14bfff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc14c0b3000 0x7fc14c154990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:35.004 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:34.999+0000 7fc14bfff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc14c0b6280 0x7fc14c06b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:35.004 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:34.999+0000 7fc14bfff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc14c15c0c0 0x7fc14c06cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:35.004 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:34.999+0000 7fc14bfff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc14c06b8f0 con 0x7fc14c0b6280 2023-10-08T06:10:35.005 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:34.999+0000 7fc14bfff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc14c06bb20 con 0x7fc14c0b3000 2023-10-08T06:10:35.005 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:34.999+0000 7fc14bfff700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc14c06be00 con 0x7fc14c15c0c0 2023-10-08T06:10:35.005 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:34.999+0000 7fc1427fc700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc14c0b6280 0x7fc14c06b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:35.005 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:34.999+0000 7fc1427fc700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc14c0b6280 0x7fc14c06b3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:33894/0 (socket says 172.21.15.32:33894) 2023-10-08T06:10:35.005 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:34.999+0000 7fc1427fc700 1 -- 172.21.15.32:0/4113037329 learned_addr learned my addr 172.21.15.32:0/4113037329 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:10:35.005 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:34.999+0000 7fc14affd700 1 --2- 172.21.15.32:0/4113037329 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc14c0b3000 0x7fc14c154990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:35.005 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:34.999+0000 7fc14b7fe700 1 --2- 172.21.15.32:0/4113037329 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc14c15c0c0 0x7fc14c06cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:35.005 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:35.003+0000 7fc1427fc700 1 -- 172.21.15.32:0/4113037329 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc14c15c0c0 msgr2=0x7fc14c06cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:35.005 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:35.003+0000 7fc1427fc700 1 --2- 172.21.15.32:0/4113037329 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc14c15c0c0 0x7fc14c06cbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:35.005 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:35.003+0000 7fc1427fc700 1 -- 172.21.15.32:0/4113037329 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc14c0b3000 msgr2=0x7fc14c154990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:35.005 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:35.003+0000 7fc1427fc700 1 --2- 172.21.15.32:0/4113037329 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc14c0b3000 0x7fc14c154990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:35.006 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:35.003+0000 7fc1427fc700 1 -- 172.21.15.32:0/4113037329 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc13c0094b0 con 0x7fc14c0b6280 2023-10-08T06:10:35.006 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:35.003+0000 7fc14b7fe700 1 --2- 172.21.15.32:0/4113037329 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc14c15c0c0 0x7fc14c06cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T06:10:35.006 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:35.003+0000 7fc1427fc700 1 --2- 172.21.15.32:0/4113037329 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc14c0b6280 0x7fc14c06b3b0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fc13400c500 tx=0x7fc13400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:35.006 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:35.003+0000 7fc143fff700 1 -- 172.21.15.32:0/4113037329 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1340052d0 con 0x7fc14c0b6280 2023-10-08T06:10:35.006 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:35.003+0000 7fc143fff700 1 -- 172.21.15.32:0/4113037329 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc134005430 con 0x7fc14c0b6280 2023-10-08T06:10:35.006 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:35.003+0000 7fc14bfff700 1 -- 172.21.15.32:0/4113037329 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc14c06c0e0 con 0x7fc14c0b6280 2023-10-08T06:10:35.006 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:35.003+0000 7fc143fff700 1 -- 172.21.15.32:0/4113037329 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1340055a0 con 0x7fc14c0b6280 2023-10-08T06:10:35.006 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:35.003+0000 7fc14bfff700 1 -- 172.21.15.32:0/4113037329 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc14c06c6a0 con 0x7fc14c0b6280 2023-10-08T06:10:35.007 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:35.003+0000 7fc14bfff700 1 -- 172.21.15.32:0/4113037329 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc14c0686a0 con 0x7fc14c0b6280 2023-10-08T06:10:35.007 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:35.003+0000 7fc143fff700 1 -- 172.21.15.32:0/4113037329 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fc1340038e0 con 0x7fc14c0b6280 2023-10-08T06:10:35.007 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:35.003+0000 7fc143fff700 1 --2- 172.21.15.32:0/4113037329 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fc12c066510 0x7fc12c0689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:35.007 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:35.003+0000 7fc143fff700 1 -- 172.21.15.32:0/4113037329 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5609+0+0 (secure 0 0 0) 0x7fc134083670 con 0x7fc14c0b6280 2023-10-08T06:10:35.007 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:35.003+0000 7fc14affd700 1 --2- 172.21.15.32:0/4113037329 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fc12c066510 0x7fc12c0689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:35.008 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:35.007+0000 7fc14affd700 1 --2- 172.21.15.32:0/4113037329 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fc12c066510 0x7fc12c0689d0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fc13c009850 tx=0x7fc13c010000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:35.017 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:35.015+0000 7fc143fff700 1 -- 172.21.15.32:0/4113037329 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fc134050be0 con 0x7fc14c0b6280 2023-10-08T06:10:35.215 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:35.211+0000 7fc14bfff700 1 -- 172.21.15.32:0/4113037329 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fc14c15ba30 con 0x7fc14c0b6280 2023-10-08T06:10:35.682 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a has been restored 2023-10-08T06:10:35.683 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c has been restored 2023-10-08T06:10:35.683 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b has been restored 2023-10-08T06:10:35.869 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:35.867+0000 7fc143fff700 1 -- 172.21.15.32:0/4113037329 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 4 and data pool 5 v11) v1 ==== 172+0+0 (secure 0 0 0) 0x7fc134054200 con 0x7fc14c0b6280 2023-10-08T06:10:35.874 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:35.871+0000 7fc14bfff700 1 -- 172.21.15.32:0/4113037329 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fc12c066510 msgr2=0x7fc12c0689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:35.874 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:35.871+0000 7fc14bfff700 1 --2- 172.21.15.32:0/4113037329 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fc12c066510 0x7fc12c0689d0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fc13c009850 tx=0x7fc13c010000 comp rx=0 tx=0).stop 2023-10-08T06:10:35.874 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:35.871+0000 7fc14bfff700 1 -- 172.21.15.32:0/4113037329 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc14c0b6280 msgr2=0x7fc14c06b3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:35.874 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:35.871+0000 7fc14bfff700 1 --2- 172.21.15.32:0/4113037329 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc14c0b6280 0x7fc14c06b3b0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fc13400c500 tx=0x7fc13400c8c0 comp rx=0 tx=0).stop 2023-10-08T06:10:35.875 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:35.871+0000 7fc14bfff700 1 -- 172.21.15.32:0/4113037329 shutdown_connections 2023-10-08T06:10:35.875 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:35.871+0000 7fc14bfff700 1 --2- 172.21.15.32:0/4113037329 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fc12c066510 0x7fc12c0689d0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:35.875 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:35.871+0000 7fc14bfff700 1 --2- 172.21.15.32:0/4113037329 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc14c0b6280 0x7fc14c06b3b0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:35.875 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:35.871+0000 7fc14bfff700 1 --2- 172.21.15.32:0/4113037329 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc14c15c0c0 0x7fc14c06cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:35.876 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:35.871+0000 7fc14bfff700 1 --2- 172.21.15.32:0/4113037329 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc14c0b3000 0x7fc14c154990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:35.876 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:35.871+0000 7fc14bfff700 1 -- 172.21.15.32:0/4113037329 >> 172.21.15.32:0/4113037329 conn(0x7fc14c06dfa0 msgr2=0x7fc14c0ce7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:10:35.876 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:35.871+0000 7fc14bfff700 1 -- 172.21.15.32:0/4113037329 shutdown_connections 2023-10-08T06:10:35.876 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:35.871+0000 7fc14bfff700 1 -- 172.21.15.32:0/4113037329 wait complete. 2023-10-08T06:10:35.879 INFO:teuthology.orchestra.run.smithi032.stderr:new fs with metadata pool 4 and data pool 5 2023-10-08T06:10:35.892 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T06:10:36.002 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:35.999+0000 7f97ea4c1700 1 Processor -- start 2023-10-08T06:10:36.003 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:35.999+0000 7f97ea4c1700 1 -- start start 2023-10-08T06:10:36.003 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:35.999+0000 7f97ea4c1700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f97e415b980 0x7f97e415f780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:36.004 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:35.999+0000 7f97ea4c1700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f97e40719e0 0x7f97e40c9420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:36.004 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:35.999+0000 7f97ea4c1700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97e406fc20 con 0x7f97e40c9960 2023-10-08T06:10:36.004 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:35.999+0000 7f97ea4c1700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97e40c9e10 con 0x7f97e40719e0 2023-10-08T06:10:36.004 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:35.999+0000 7f97ea4c1700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97e4070430 con 0x7f97e415b980 2023-10-08T06:10:36.004 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:35.999+0000 7f97e8cbe700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f97e40719e0 0x7f97e40c9420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:36.004 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:35.999+0000 7f97e8cbe700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f97e40719e0 0x7f97e40c9420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:33900/0 (socket says 172.21.15.32:33900) 2023-10-08T06:10:36.004 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:35.999+0000 7f97e8cbe700 1 -- 172.21.15.32:0/705489513 learned_addr learned my addr 172.21.15.32:0/705489513 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:10:36.004 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:35.999+0000 7f97e9cc0700 1 --1- 172.21.15.32:0/705489513 >> v1:172.21.15.32:6789/0 conn(0x7f97e40c9960 0x7f97e415bd60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:54114/0 (socket says 172.21.15.32:54114) 2023-10-08T06:10:36.004 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.003+0000 7f97e94bf700 1 --2- 172.21.15.32:0/705489513 >> v2:172.21.15.40:3300/0 conn(0x7f97e415b980 0x7f97e415f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:36.005 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.003+0000 7f97dbfff700 1 -- 172.21.15.32:0/705489513 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 952663964 0 0) 0x7f97e406fc20 con 0x7f97e40c9960 2023-10-08T06:10:36.005 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.003+0000 7f97e8cbe700 1 -- 172.21.15.32:0/705489513 >> v2:172.21.15.40:3300/0 conn(0x7f97e415b980 msgr2=0x7f97e415f780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:10:36.005 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.003+0000 7f97e8cbe700 1 --2- 172.21.15.32:0/705489513 >> v2:172.21.15.40:3300/0 conn(0x7f97e415b980 0x7f97e415f780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:36.005 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.003+0000 7f97e8cbe700 1 -- 172.21.15.32:0/705489513 >> v1:172.21.15.32:6789/0 conn(0x7f97e40c9960 legacy=0x7f97e415bd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:36.006 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.003+0000 7f97e8cbe700 1 -- 172.21.15.32:0/705489513 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97e415fcc0 con 0x7f97e40719e0 2023-10-08T06:10:36.006 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.003+0000 7f97e8cbe700 1 --2- 172.21.15.32:0/705489513 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f97e40719e0 0x7f97e40c9420 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f97e40cec90 tx=0x7f97d4009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f85896371ea106f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:36.006 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.003+0000 7f97dbfff700 1 -- 172.21.15.32:0/705489513 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97d4011830 con 0x7f97e40719e0 2023-10-08T06:10:36.006 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.003+0000 7f97dbfff700 1 -- 172.21.15.32:0/705489513 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97d4011990 con 0x7f97e40719e0 2023-10-08T06:10:36.006 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.003+0000 7f97dbfff700 1 -- 172.21.15.32:0/705489513 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97d4011d20 con 0x7f97e40719e0 2023-10-08T06:10:36.007 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.003+0000 7f97ea4c1700 1 -- 172.21.15.32:0/705489513 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f97e40719e0 msgr2=0x7f97e40c9420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:36.007 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.003+0000 7f97ea4c1700 1 --2- 172.21.15.32:0/705489513 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f97e40719e0 0x7f97e40c9420 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f97e40cec90 tx=0x7f97d4009bf0 comp rx=0 tx=0).stop 2023-10-08T06:10:36.007 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.003+0000 7f97ea4c1700 1 -- 172.21.15.32:0/705489513 shutdown_connections 2023-10-08T06:10:36.007 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.003+0000 7f97ea4c1700 1 --2- 172.21.15.32:0/705489513 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f97e40719e0 0x7f97e40c9420 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:36.007 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.003+0000 7f97ea4c1700 1 --2- 172.21.15.32:0/705489513 >> v2:172.21.15.40:3300/0 conn(0x7f97e415b980 0x7f97e415f780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:36.007 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.003+0000 7f97ea4c1700 1 -- 172.21.15.32:0/705489513 >> 172.21.15.32:0/705489513 conn(0x7f97e40b0900 msgr2=0x7f97e40b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:10:36.007 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.003+0000 7f97ea4c1700 1 -- 172.21.15.32:0/705489513 shutdown_connections 2023-10-08T06:10:36.007 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.003+0000 7f97ea4c1700 1 -- 172.21.15.32:0/705489513 wait complete. 2023-10-08T06:10:36.008 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.007+0000 7f97ea4c1700 1 Processor -- start 2023-10-08T06:10:36.008 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.007+0000 7f97ea4c1700 1 -- start start 2023-10-08T06:10:36.009 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.007+0000 7f97ea4c1700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f97e40719e0 0x7f97e40b23b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:36.010 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.007+0000 7f97ea4c1700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f97e40c9960 0x7f97e40c86b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:36.010 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.007+0000 7f97ea4c1700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f97e415b980 0x7f97e4151390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:36.010 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.007+0000 7f97ea4c1700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97e40c8bf0 con 0x7f97e415b980 2023-10-08T06:10:36.010 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.007+0000 7f97ea4c1700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97e40b36b0 con 0x7f97e40719e0 2023-10-08T06:10:36.010 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.007+0000 7f97ea4c1700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97e41518d0 con 0x7f97e40c9960 2023-10-08T06:10:36.010 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.007+0000 7f97e9cc0700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f97e415b980 0x7f97e4151390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:36.010 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.007+0000 7f97e9cc0700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f97e415b980 0x7f97e4151390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:33906/0 (socket says 172.21.15.32:33906) 2023-10-08T06:10:36.010 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.007+0000 7f97e9cc0700 1 -- 172.21.15.32:0/3095602523 learned_addr learned my addr 172.21.15.32:0/3095602523 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:10:36.011 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.007+0000 7f97e8cbe700 1 --2- 172.21.15.32:0/3095602523 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f97e40c9960 0x7f97e40c86b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:36.011 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.007+0000 7f97e94bf700 1 --2- 172.21.15.32:0/3095602523 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f97e40719e0 0x7f97e40b23b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:36.011 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.007+0000 7f97e9cc0700 1 -- 172.21.15.32:0/3095602523 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f97e40c9960 msgr2=0x7f97e40c86b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:36.011 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.007+0000 7f97e9cc0700 1 --2- 172.21.15.32:0/3095602523 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f97e40c9960 0x7f97e40c86b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:36.011 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.007+0000 7f97e9cc0700 1 -- 172.21.15.32:0/3095602523 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f97e40719e0 msgr2=0x7f97e40b23b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:36.011 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.007+0000 7f97e9cc0700 1 --2- 172.21.15.32:0/3095602523 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f97e40719e0 0x7f97e40b23b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:36.011 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.007+0000 7f97e9cc0700 1 -- 172.21.15.32:0/3095602523 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97d4009570 con 0x7f97e415b980 2023-10-08T06:10:36.011 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.007+0000 7f97e9cc0700 1 --2- 172.21.15.32:0/3095602523 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f97e415b980 0x7f97e4151390 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f97dc00cca0 tx=0x7f97dc00a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:36.012 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.007+0000 7f97d9ffb700 1 -- 172.21.15.32:0/3095602523 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97dc00cea0 con 0x7f97e415b980 2023-10-08T06:10:36.013 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.007+0000 7f97d9ffb700 1 -- 172.21.15.32:0/3095602523 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97dc00ade0 con 0x7f97e415b980 2023-10-08T06:10:36.013 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.007+0000 7f97d9ffb700 1 -- 172.21.15.32:0/3095602523 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97dc007310 con 0x7f97e415b980 2023-10-08T06:10:36.013 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.007+0000 7f97ea4c1700 1 -- 172.21.15.32:0/3095602523 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97e40b2aa0 con 0x7f97e415b980 2023-10-08T06:10:36.013 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.007+0000 7f97ea4c1700 1 -- 172.21.15.32:0/3095602523 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97e40b3060 con 0x7f97e415b980 2023-10-08T06:10:36.013 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.007+0000 7f97ea4c1700 1 -- 172.21.15.32:0/3095602523 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97e4073f00 con 0x7f97e415b980 2023-10-08T06:10:36.013 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.011+0000 7f97d9ffb700 1 -- 172.21.15.32:0/3095602523 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f97dc007470 con 0x7f97e415b980 2023-10-08T06:10:36.014 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.011+0000 7f97d9ffb700 1 --2- 172.21.15.32:0/3095602523 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f97c8066510 0x7f97c80689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:36.014 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.011+0000 7f97e94bf700 1 --2- 172.21.15.32:0/3095602523 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f97c8066510 0x7f97c80689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:36.014 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.011+0000 7f97d9ffb700 1 -- 172.21.15.32:0/3095602523 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f97dc083b70 con 0x7f97e415b980 2023-10-08T06:10:36.014 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.011+0000 7f97e94bf700 1 --2- 172.21.15.32:0/3095602523 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f97c8066510 0x7f97c80689d0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f97e0009ae0 tx=0x7f97e0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:36.018 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.015+0000 7f97d9ffb700 1 -- 172.21.15.32:0/3095602523 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f97dc050f50 con 0x7f97e415b980 2023-10-08T06:10:36.185 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.183+0000 7f97ea4c1700 1 -- 172.21.15.32:0/3095602523 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f97e40b37f0 con 0x7f97e415b980 2023-10-08T06:10:36.188 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.187+0000 7f97d9ffb700 1 -- 172.21.15.32:0/3095602523 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+16522 (secure 0 0 0) 0x7f97dc018070 con 0x7f97e415b980 2023-10-08T06:10:36.189 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:10:36.189 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":34,"fsid":"ac672d87-96ae-41e0-9314-623ba2cdbbba","created":"2023-10-08T06:09:11.175626+0000","modified":"2023-10-08T06:10:35.216211+0000","last_up_change":"2023-10-08T06:09:22.744643+0000","last_in_change":"2023-10-08T06:09:14.131580+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T06:09:23.307843+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-10-08T06:10:33.777525+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-10-08T06:10:34.202152+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"43433f0c-9592-4874-92d7-10f8f4acf07f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":587888964},{"type":"v1","addr":"172.21.15.32:6801","nonce":587888964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":587888964},{"type":"v1","addr":"172.21.15.32:6803","nonce":587888964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":587888964},{"type":"v1","addr":"172.21.15.32:6810","nonce":587888964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6805","nonce":587888964},{"type":"v1","addr":"172.21.15.32:6807","nonce":587888964}]},"public_addr":"172.21.15.32:6801/587888964","cluster_addr":"172.21.15.32:6803/587888964","heartbeat_back_addr":"172.21.15.32:6810/587888964","heartbeat_front_addr":"172.21.15.32:6807/587888964","state":["exists","up"]},{"osd":1,"uuid":"2ecb1008-b987-4ce7-b646-6cded55fc8d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":990576767},{"type":"v1","addr":"172.21.15.32:6817","nonce":990576767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":990576767},{"type":"v1","addr":"172.21.15.32:6819","nonce":990576767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":990576767},{"type":"v1","addr":"172.21.15.32:6823","nonce":990576767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":990576767},{"type":"v1","addr":"172.21.15.32:6821","nonce":990576767}]},"public_addr":"172.21.15.32:6817/990576767","cluster_addr":"172.21.15.32:6819/990576767","heartbeat_back_addr":"172.21.15.32:6823/990576767","heartbeat_front_addr":"172.21.15.32:6821/990576767","state":["exists","up"]},{"osd":2,"uuid":"1b131c94-c09b-4e80-8746-bf1b7bac362d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6824","nonce":1566874440},{"type":"v1","addr":"172.21.15.32:6825","nonce":1566874440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":1566874440},{"type":"v1","addr":"172.21.15.32:6827","nonce":1566874440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":1566874440},{"type":"v1","addr":"172.21.15.32:6831","nonce":1566874440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":1566874440},{"type":"v1","addr":"172.21.15.32:6829","nonce":1566874440}]},"public_addr":"172.21.15.32:6825/1566874440","cluster_addr":"172.21.15.32:6827/1566874440","heartbeat_back_addr":"172.21.15.32:6831/1566874440","heartbeat_front_addr":"172.21.15.32:6829/1566874440","state":["exists","up"]},{"osd":3,"uuid":"ad655af2-1f6f-4689-b21d-b07bbaeb68b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":3672614802},{"type":"v1","addr":"172.21.15.32:6806","nonce":3672614802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6809","nonce":3672614802},{"type":"v1","addr":"172.21.15.32:6811","nonce":3672614802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":3672614802},{"type":"v1","addr":"172.21.15.32:6815","nonce":3672614802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":3672614802},{"type":"v1","addr":"172.21.15.32:6813","nonce":3672614802}]},"public_addr":"172.21.15.32:6806/3672614802","cluster_addr":"172.21.15.32:6811/3672614802","heartbeat_back_addr":"172.21.15.32:6815/3672614802","heartbeat_front_addr":"172.21.15.32:6813/3672614802","state":["exists","up"]},{"osd":4,"uuid":"64a543a1-8c4f-458e-9aba-b35c1cd7dd03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":3369928244},{"type":"v1","addr":"172.21.15.40:6801","nonce":3369928244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":3369928244},{"type":"v1","addr":"172.21.15.40:6803","nonce":3369928244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":3369928244},{"type":"v1","addr":"172.21.15.40:6807","nonce":3369928244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":3369928244},{"type":"v1","addr":"172.21.15.40:6805","nonce":3369928244}]},"public_addr":"172.21.15.40:6801/3369928244","cluster_addr":"172.21.15.40:6803/3369928244","heartbeat_back_addr":"172.21.15.40:6807/3369928244","heartbeat_front_addr":"172.21.15.40:6805/3369928244","state":["exists","up"]},{"osd":5,"uuid":"0fef3e54-edb4-4678-878e-944663c51638","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":2395850297},{"type":"v1","addr":"172.21.15.40:6825","nonce":2395850297}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":2395850297},{"type":"v1","addr":"172.21.15.40:6827","nonce":2395850297}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":2395850297},{"type":"v1","addr":"172.21.15.40:6831","nonce":2395850297}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":2395850297},{"type":"v1","addr":"172.21.15.40:6829","nonce":2395850297}]},"public_addr":"172.21.15.40:6825/2395850297","cluster_addr":"172.21.15.40:6827/2395850297","heartbeat_back_addr":"172.21.15.40:6831/2395850297","heartbeat_front_addr":"172.21.15.40:6829/2395850297","state":["exists","up"]},{"osd":6,"uuid":"2eeb0472-6096-469d-9b2c-cab4bf41c31a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":4145283410},{"type":"v1","addr":"172.21.15.40:6809","nonce":4145283410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":4145283410},{"type":"v1","addr":"172.21.15.40:6811","nonce":4145283410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":4145283410},{"type":"v1","addr":"172.21.15.40:6815","nonce":4145283410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":4145283410},{"type":"v1","addr":"172.21.15.40:6813","nonce":4145283410}]},"public_addr":"172.21.15.40:6809/4145283410","cluster_addr":"172.21.15.40:6811/4145283410","heartbeat_back_addr":"172.21.15.40:6815/4145283410","heartbeat_front_addr":"172.21.15.40:6813/4145283410","state":["exists","up"]},{"osd":7,"uuid":"cf76e4c7-96a6-401f-a280-91aad4641940","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":2943297416},{"type":"v1","addr":"172.21.15.40:6817","nonce":2943297416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":2943297416},{"type":"v1","addr":"172.21.15.40:6819","nonce":2943297416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":2943297416},{"type":"v1","addr":"172.21.15.40:6823","nonce":2943297416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":2943297416},{"type":"v1","addr":"172.21.15.40:6821","nonce":2943297416}]},"public_addr":"172.21.15.40:6817/2943297416","cluster_addr":"172.21.15.40:6819/2943297416","heartbeat_back_addr":"172.21.15.40:6823/2943297416","heartbeat_front_addr":"172.21.15.40:6821/2943297416","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.411475+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.628841+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.599055+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.166100+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.384135+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.488403+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.307648+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.363541+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T06:10:36.191 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.187+0000 7f97ea4c1700 1 -- 172.21.15.32:0/3095602523 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f97c8066510 msgr2=0x7f97c80689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:36.191 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.187+0000 7f97ea4c1700 1 --2- 172.21.15.32:0/3095602523 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f97c8066510 0x7f97c80689d0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f97e0009ae0 tx=0x7f97e0008040 comp rx=0 tx=0).stop 2023-10-08T06:10:36.191 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.187+0000 7f97ea4c1700 1 -- 172.21.15.32:0/3095602523 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f97e415b980 msgr2=0x7f97e4151390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:36.191 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.187+0000 7f97ea4c1700 1 --2- 172.21.15.32:0/3095602523 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f97e415b980 0x7f97e4151390 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f97dc00cca0 tx=0x7f97dc00a340 comp rx=0 tx=0).stop 2023-10-08T06:10:36.191 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.187+0000 7f97ea4c1700 1 -- 172.21.15.32:0/3095602523 shutdown_connections 2023-10-08T06:10:36.192 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.187+0000 7f97ea4c1700 1 --2- 172.21.15.32:0/3095602523 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f97c8066510 0x7f97c80689d0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:36.192 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.187+0000 7f97ea4c1700 1 --2- 172.21.15.32:0/3095602523 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f97e415b980 0x7f97e4151390 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:36.192 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.187+0000 7f97ea4c1700 1 --2- 172.21.15.32:0/3095602523 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f97e40c9960 0x7f97e40c86b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:36.192 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.187+0000 7f97ea4c1700 1 --2- 172.21.15.32:0/3095602523 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f97e40719e0 0x7f97e40b23b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:36.192 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.187+0000 7f97ea4c1700 1 -- 172.21.15.32:0/3095602523 >> 172.21.15.32:0/3095602523 conn(0x7f97e40b0900 msgr2=0x7f97e415e0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:10:36.192 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.187+0000 7f97ea4c1700 1 -- 172.21.15.32:0/3095602523 shutdown_connections 2023-10-08T06:10:36.192 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.187+0000 7f97ea4c1700 1 -- 172.21.15.32:0/3095602523 wait complete. 2023-10-08T06:10:36.207 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T06:10:36.321 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.319+0000 7fc4fa40e700 1 Processor -- start 2023-10-08T06:10:36.321 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.319+0000 7fc4fa40e700 1 -- start start 2023-10-08T06:10:36.323 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.319+0000 7fc4fa40e700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc4f40b4b80 0x7fc4f40704d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:36.323 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.319+0000 7fc4fa40e700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fc4f41580b0 0x7fc4f4158520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:36.323 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.319+0000 7fc4fa40e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc4f4158a60 0x7fc4f415b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:36.323 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.319+0000 7fc4fa40e700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4f4158ed0 con 0x7fc4f41580b0 2023-10-08T06:10:36.324 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.319+0000 7fc4fa40e700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4f4072510 con 0x7fc4f40b4b80 2023-10-08T06:10:36.324 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.319+0000 7fc4fa40e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4f40b4f60 con 0x7fc4f4158a60 2023-10-08T06:10:36.324 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.319+0000 7fc4f8c0b700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fc4f41580b0 0x7fc4f4158520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:36.324 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.319+0000 7fc4f8c0b700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fc4f41580b0 0x7fc4f4158520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:33918/0 (socket says 172.21.15.32:33918) 2023-10-08T06:10:36.324 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.319+0000 7fc4f8c0b700 1 -- 172.21.15.32:0/2776329831 learned_addr learned my addr 172.21.15.32:0/2776329831 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:10:36.324 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.319+0000 7fc4f9c0d700 1 --2- 172.21.15.32:0/2776329831 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc4f4158a60 0x7fc4f415b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:36.324 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.319+0000 7fc4f8c0b700 1 -- 172.21.15.32:0/2776329831 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc4f4158a60 msgr2=0x7fc4f415b4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:10:36.324 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.319+0000 7fc4f8c0b700 1 --2- 172.21.15.32:0/2776329831 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc4f4158a60 0x7fc4f415b4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:36.324 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.319+0000 7fc4f940c700 1 --2- 172.21.15.32:0/2776329831 >> v2:172.21.15.40:3300/0 conn(0x7fc4f40b4b80 0x7fc4f40704d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:36.324 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.319+0000 7fc4f8c0b700 1 -- 172.21.15.32:0/2776329831 >> v2:172.21.15.40:3300/0 conn(0x7fc4f40b4b80 msgr2=0x7fc4f40704d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:10:36.324 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.319+0000 7fc4f8c0b700 1 --2- 172.21.15.32:0/2776329831 >> v2:172.21.15.40:3300/0 conn(0x7fc4f40b4b80 0x7fc4f40704d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:36.324 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.319+0000 7fc4f8c0b700 1 -- 172.21.15.32:0/2776329831 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4f4071ee0 con 0x7fc4f41580b0 2023-10-08T06:10:36.325 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.319+0000 7fc4f940c700 1 --2- 172.21.15.32:0/2776329831 >> v2:172.21.15.40:3300/0 conn(0x7fc4f40b4b80 0x7fc4f40704d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T06:10:36.325 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.319+0000 7fc4f8c0b700 1 --2- 172.21.15.32:0/2776329831 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc4f41580b0 0x7fc4f4158520 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fc4f406e110 tx=0x7fc4e8009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6198c5df63a1946 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:36.325 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.319+0000 7fc4e7fff700 1 -- 172.21.15.32:0/2776329831 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4e800b8a0 con 0x7fc4f41580b0 2023-10-08T06:10:36.325 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.319+0000 7fc4e7fff700 1 -- 172.21.15.32:0/2776329831 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4e800ba00 con 0x7fc4f41580b0 2023-10-08T06:10:36.325 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.319+0000 7fc4e7fff700 1 -- 172.21.15.32:0/2776329831 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4e800bd90 con 0x7fc4f41580b0 2023-10-08T06:10:36.326 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.323+0000 7fc4fa40e700 1 -- 172.21.15.32:0/2776329831 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc4f41580b0 msgr2=0x7fc4f4158520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:36.326 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.323+0000 7fc4fa40e700 1 --2- 172.21.15.32:0/2776329831 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc4f41580b0 0x7fc4f4158520 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fc4f406e110 tx=0x7fc4e8009bf0 comp rx=0 tx=0).stop 2023-10-08T06:10:36.326 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.323+0000 7fc4fa40e700 1 -- 172.21.15.32:0/2776329831 shutdown_connections 2023-10-08T06:10:36.326 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.323+0000 7fc4fa40e700 1 --2- 172.21.15.32:0/2776329831 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc4f41580b0 0x7fc4f4158520 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:36.326 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.323+0000 7fc4fa40e700 1 --2- 172.21.15.32:0/2776329831 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc4f4158a60 0x7fc4f415b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:36.326 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.323+0000 7fc4fa40e700 1 --2- 172.21.15.32:0/2776329831 >> v2:172.21.15.40:3300/0 conn(0x7fc4f40b4b80 0x7fc4f40704d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:36.326 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.323+0000 7fc4fa40e700 1 -- 172.21.15.32:0/2776329831 >> 172.21.15.32:0/2776329831 conn(0x7fc4f40cf470 msgr2=0x7fc4f40cf880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:10:36.327 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.323+0000 7fc4fa40e700 1 -- 172.21.15.32:0/2776329831 shutdown_connections 2023-10-08T06:10:36.327 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.323+0000 7fc4fa40e700 1 -- 172.21.15.32:0/2776329831 wait complete. 2023-10-08T06:10:36.327 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.323+0000 7fc4fa40e700 1 Processor -- start 2023-10-08T06:10:36.327 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.323+0000 7fc4fa40e700 1 -- start start 2023-10-08T06:10:36.329 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.323+0000 7fc4fa40e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc4f40b4b80 0x7fc4f40c6f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:36.329 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.323+0000 7fc4fa40e700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc4f4158a60 0x7fc4f4156c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:36.329 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.323+0000 7fc4fa40e700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc4f40b3e10 0x7fc4f40c8880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:36.329 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.323+0000 7fc4fa40e700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4f4157170 con 0x7fc4f4158a60 2023-10-08T06:10:36.329 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.323+0000 7fc4fa40e700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4f40c7880 con 0x7fc4f40b3e10 2023-10-08T06:10:36.329 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.323+0000 7fc4fa40e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4f40c75a0 con 0x7fc4f40b4b80 2023-10-08T06:10:36.329 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.323+0000 7fc4f8c0b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc4f4158a60 0x7fc4f4156c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:36.329 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.323+0000 7fc4f8c0b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc4f4158a60 0x7fc4f4156c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:33920/0 (socket says 172.21.15.32:33920) 2023-10-08T06:10:36.329 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.323+0000 7fc4f940c700 1 --2- 172.21.15.32:0/2444603730 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc4f40b4b80 0x7fc4f40c6f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:36.330 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.323+0000 7fc4f8c0b700 1 -- 172.21.15.32:0/2444603730 learned_addr learned my addr 172.21.15.32:0/2444603730 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:10:36.330 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.323+0000 7fc4f9c0d700 1 --2- 172.21.15.32:0/2444603730 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc4f40b3e10 0x7fc4f40c8880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:36.330 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.323+0000 7fc4f8c0b700 1 -- 172.21.15.32:0/2444603730 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc4f40b4b80 msgr2=0x7fc4f40c6f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:36.330 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.323+0000 7fc4f8c0b700 1 --2- 172.21.15.32:0/2444603730 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc4f40b4b80 0x7fc4f40c6f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:36.330 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.323+0000 7fc4f8c0b700 1 -- 172.21.15.32:0/2444603730 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc4f40b3e10 msgr2=0x7fc4f40c8880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:36.330 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.323+0000 7fc4f8c0b700 1 --2- 172.21.15.32:0/2444603730 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc4f40b3e10 0x7fc4f40c8880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:36.330 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.323+0000 7fc4f8c0b700 1 -- 172.21.15.32:0/2444603730 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4e8009570 con 0x7fc4f4158a60 2023-10-08T06:10:36.330 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.327+0000 7fc4f8c0b700 1 --2- 172.21.15.32:0/2444603730 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc4f4158a60 0x7fc4f4156c30 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fc4f40677d0 tx=0x7fc4e8004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:36.330 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.327+0000 7fc4e5ffb700 1 -- 172.21.15.32:0/2444603730 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4e80036c0 con 0x7fc4f4158a60 2023-10-08T06:10:36.330 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.327+0000 7fc4e5ffb700 1 -- 172.21.15.32:0/2444603730 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4e801f070 con 0x7fc4f4158a60 2023-10-08T06:10:36.330 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.327+0000 7fc4fa40e700 1 -- 172.21.15.32:0/2444603730 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4f40c7da0 con 0x7fc4f4158a60 2023-10-08T06:10:36.331 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.327+0000 7fc4e5ffb700 1 -- 172.21.15.32:0/2444603730 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4e8003a40 con 0x7fc4f4158a60 2023-10-08T06:10:36.331 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.327+0000 7fc4fa40e700 1 -- 172.21.15.32:0/2444603730 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4f40c8360 con 0x7fc4f4158a60 2023-10-08T06:10:36.331 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.327+0000 7fc4fa40e700 1 -- 172.21.15.32:0/2444603730 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4f4070f40 con 0x7fc4f4158a60 2023-10-08T06:10:36.331 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.327+0000 7fc4e5ffb700 1 -- 172.21.15.32:0/2444603730 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fc4e801a430 con 0x7fc4f4158a60 2023-10-08T06:10:36.332 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.331+0000 7fc4e5ffb700 1 --2- 172.21.15.32:0/2444603730 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fc4d8066540 0x7fc4d8068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:36.332 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.331+0000 7fc4e5ffb700 1 -- 172.21.15.32:0/2444603730 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc4e8021070 con 0x7fc4f4158a60 2023-10-08T06:10:36.332 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.331+0000 7fc4f940c700 1 --2- 172.21.15.32:0/2444603730 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fc4d8066540 0x7fc4d8068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:36.333 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.331+0000 7fc4f940c700 1 --2- 172.21.15.32:0/2444603730 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fc4d8066540 0x7fc4d8068a00 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fc4f000ab60 tx=0x7fc4f0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:36.341 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.339+0000 7fc4e5ffb700 1 -- 172.21.15.32:0/2444603730 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fc4e8052de0 con 0x7fc4f4158a60 2023-10-08T06:10:36.505 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.503+0000 7fc4fa40e700 1 -- 172.21.15.32:0/2444603730 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc4f40686a0 con 0x7fc4f4158a60 2023-10-08T06:10:36.507 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.503+0000 7fc4e5ffb700 1 -- 172.21.15.32:0/2444603730 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+16522 (secure 0 0 0) 0x7fc4e8056400 con 0x7fc4f4158a60 2023-10-08T06:10:36.508 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:10:36.508 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":34,"fsid":"ac672d87-96ae-41e0-9314-623ba2cdbbba","created":"2023-10-08T06:09:11.175626+0000","modified":"2023-10-08T06:10:35.216211+0000","last_up_change":"2023-10-08T06:09:22.744643+0000","last_in_change":"2023-10-08T06:09:14.131580+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T06:09:23.307843+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-10-08T06:10:33.777525+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-10-08T06:10:34.202152+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"43433f0c-9592-4874-92d7-10f8f4acf07f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":587888964},{"type":"v1","addr":"172.21.15.32:6801","nonce":587888964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":587888964},{"type":"v1","addr":"172.21.15.32:6803","nonce":587888964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":587888964},{"type":"v1","addr":"172.21.15.32:6810","nonce":587888964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6805","nonce":587888964},{"type":"v1","addr":"172.21.15.32:6807","nonce":587888964}]},"public_addr":"172.21.15.32:6801/587888964","cluster_addr":"172.21.15.32:6803/587888964","heartbeat_back_addr":"172.21.15.32:6810/587888964","heartbeat_front_addr":"172.21.15.32:6807/587888964","state":["exists","up"]},{"osd":1,"uuid":"2ecb1008-b987-4ce7-b646-6cded55fc8d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":990576767},{"type":"v1","addr":"172.21.15.32:6817","nonce":990576767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":990576767},{"type":"v1","addr":"172.21.15.32:6819","nonce":990576767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":990576767},{"type":"v1","addr":"172.21.15.32:6823","nonce":990576767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":990576767},{"type":"v1","addr":"172.21.15.32:6821","nonce":990576767}]},"public_addr":"172.21.15.32:6817/990576767","cluster_addr":"172.21.15.32:6819/990576767","heartbeat_back_addr":"172.21.15.32:6823/990576767","heartbeat_front_addr":"172.21.15.32:6821/990576767","state":["exists","up"]},{"osd":2,"uuid":"1b131c94-c09b-4e80-8746-bf1b7bac362d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6824","nonce":1566874440},{"type":"v1","addr":"172.21.15.32:6825","nonce":1566874440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":1566874440},{"type":"v1","addr":"172.21.15.32:6827","nonce":1566874440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":1566874440},{"type":"v1","addr":"172.21.15.32:6831","nonce":1566874440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":1566874440},{"type":"v1","addr":"172.21.15.32:6829","nonce":1566874440}]},"public_addr":"172.21.15.32:6825/1566874440","cluster_addr":"172.21.15.32:6827/1566874440","heartbeat_back_addr":"172.21.15.32:6831/1566874440","heartbeat_front_addr":"172.21.15.32:6829/1566874440","state":["exists","up"]},{"osd":3,"uuid":"ad655af2-1f6f-4689-b21d-b07bbaeb68b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":3672614802},{"type":"v1","addr":"172.21.15.32:6806","nonce":3672614802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6809","nonce":3672614802},{"type":"v1","addr":"172.21.15.32:6811","nonce":3672614802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":3672614802},{"type":"v1","addr":"172.21.15.32:6815","nonce":3672614802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":3672614802},{"type":"v1","addr":"172.21.15.32:6813","nonce":3672614802}]},"public_addr":"172.21.15.32:6806/3672614802","cluster_addr":"172.21.15.32:6811/3672614802","heartbeat_back_addr":"172.21.15.32:6815/3672614802","heartbeat_front_addr":"172.21.15.32:6813/3672614802","state":["exists","up"]},{"osd":4,"uuid":"64a543a1-8c4f-458e-9aba-b35c1cd7dd03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":3369928244},{"type":"v1","addr":"172.21.15.40:6801","nonce":3369928244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":3369928244},{"type":"v1","addr":"172.21.15.40:6803","nonce":3369928244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":3369928244},{"type":"v1","addr":"172.21.15.40:6807","nonce":3369928244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":3369928244},{"type":"v1","addr":"172.21.15.40:6805","nonce":3369928244}]},"public_addr":"172.21.15.40:6801/3369928244","cluster_addr":"172.21.15.40:6803/3369928244","heartbeat_back_addr":"172.21.15.40:6807/3369928244","heartbeat_front_addr":"172.21.15.40:6805/3369928244","state":["exists","up"]},{"osd":5,"uuid":"0fef3e54-edb4-4678-878e-944663c51638","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":2395850297},{"type":"v1","addr":"172.21.15.40:6825","nonce":2395850297}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":2395850297},{"type":"v1","addr":"172.21.15.40:6827","nonce":2395850297}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":2395850297},{"type":"v1","addr":"172.21.15.40:6831","nonce":2395850297}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":2395850297},{"type":"v1","addr":"172.21.15.40:6829","nonce":2395850297}]},"public_addr":"172.21.15.40:6825/2395850297","cluster_addr":"172.21.15.40:6827/2395850297","heartbeat_back_addr":"172.21.15.40:6831/2395850297","heartbeat_front_addr":"172.21.15.40:6829/2395850297","state":["exists","up"]},{"osd":6,"uuid":"2eeb0472-6096-469d-9b2c-cab4bf41c31a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":4145283410},{"type":"v1","addr":"172.21.15.40:6809","nonce":4145283410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":4145283410},{"type":"v1","addr":"172.21.15.40:6811","nonce":4145283410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":4145283410},{"type":"v1","addr":"172.21.15.40:6815","nonce":4145283410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":4145283410},{"type":"v1","addr":"172.21.15.40:6813","nonce":4145283410}]},"public_addr":"172.21.15.40:6809/4145283410","cluster_addr":"172.21.15.40:6811/4145283410","heartbeat_back_addr":"172.21.15.40:6815/4145283410","heartbeat_front_addr":"172.21.15.40:6813/4145283410","state":["exists","up"]},{"osd":7,"uuid":"cf76e4c7-96a6-401f-a280-91aad4641940","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":2943297416},{"type":"v1","addr":"172.21.15.40:6817","nonce":2943297416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":2943297416},{"type":"v1","addr":"172.21.15.40:6819","nonce":2943297416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":2943297416},{"type":"v1","addr":"172.21.15.40:6823","nonce":2943297416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":2943297416},{"type":"v1","addr":"172.21.15.40:6821","nonce":2943297416}]},"public_addr":"172.21.15.40:6817/2943297416","cluster_addr":"172.21.15.40:6819/2943297416","heartbeat_back_addr":"172.21.15.40:6823/2943297416","heartbeat_front_addr":"172.21.15.40:6821/2943297416","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.411475+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.628841+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.599055+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.166100+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.384135+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.488403+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.307648+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.363541+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T06:10:36.510 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.507+0000 7fc4fa40e700 1 -- 172.21.15.32:0/2444603730 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fc4d8066540 msgr2=0x7fc4d8068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:36.510 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.507+0000 7fc4fa40e700 1 --2- 172.21.15.32:0/2444603730 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fc4d8066540 0x7fc4d8068a00 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fc4f000ab60 tx=0x7fc4f0008040 comp rx=0 tx=0).stop 2023-10-08T06:10:36.510 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.507+0000 7fc4fa40e700 1 -- 172.21.15.32:0/2444603730 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc4f4158a60 msgr2=0x7fc4f4156c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:36.510 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.507+0000 7fc4fa40e700 1 --2- 172.21.15.32:0/2444603730 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc4f4158a60 0x7fc4f4156c30 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fc4f40677d0 tx=0x7fc4e8004770 comp rx=0 tx=0).stop 2023-10-08T06:10:36.510 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.507+0000 7fc4fa40e700 1 -- 172.21.15.32:0/2444603730 shutdown_connections 2023-10-08T06:10:36.510 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.507+0000 7fc4fa40e700 1 --2- 172.21.15.32:0/2444603730 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fc4d8066540 0x7fc4d8068a00 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:36.511 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.507+0000 7fc4fa40e700 1 --2- 172.21.15.32:0/2444603730 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc4f4158a60 0x7fc4f4156c30 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:36.511 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.507+0000 7fc4fa40e700 1 --2- 172.21.15.32:0/2444603730 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc4f40b3e10 0x7fc4f40c8880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:36.511 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.507+0000 7fc4fa40e700 1 --2- 172.21.15.32:0/2444603730 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc4f40b4b80 0x7fc4f40c6f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:36.511 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.507+0000 7fc4fa40e700 1 -- 172.21.15.32:0/2444603730 >> 172.21.15.32:0/2444603730 conn(0x7fc4f40cf470 msgr2=0x7fc4f406b3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:10:36.511 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.507+0000 7fc4fa40e700 1 -- 172.21.15.32:0/2444603730 shutdown_connections 2023-10-08T06:10:36.511 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.507+0000 7fc4fa40e700 1 -- 172.21.15.32:0/2444603730 wait complete. 2023-10-08T06:10:36.523 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-08T06:10:36.643 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.639+0000 7f88805fc700 1 Processor -- start 2023-10-08T06:10:36.643 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.639+0000 7f88805fc700 1 -- start start 2023-10-08T06:10:36.646 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.643+0000 7f88805fc700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f887806cff0 0x7f887806e930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:36.646 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.643+0000 7f88805fc700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f887806def0 con 0x7f887806dae0 2023-10-08T06:10:36.646 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.643+0000 7f88805fc700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f887806ee70 con 0x7f88780cc450 2023-10-08T06:10:36.646 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.643+0000 7f88805fc700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88780cbf70 con 0x7f887806cff0 2023-10-08T06:10:36.646 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.643+0000 7f887eb99700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f887806dae0 0x7f887815b4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:54128/0 (socket says 172.21.15.32:54128) 2023-10-08T06:10:36.646 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.643+0000 7f887eb99700 1 -- 172.21.15.32:0/1736968237 learned_addr learned my addr 172.21.15.32:0/1736968237 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-08T06:10:36.646 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.643+0000 7f887e398700 1 --2- 172.21.15.32:0/1736968237 >> v2:172.21.15.40:3300/0 conn(0x7f887806cff0 0x7f887806e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:36.648 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.643+0000 7f887d396700 1 -- 172.21.15.32:0/1736968237 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 16856331 0 0) 0x7f8870001490 con 0x7f887806dae0 2023-10-08T06:10:36.649 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.643+0000 7f887d396700 1 -- 172.21.15.32:0/1736968237 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f88640035d0 con 0x7f887806dae0 2023-10-08T06:10:36.649 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.643+0000 7f887d396700 1 -- 172.21.15.32:0/1736968237 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3616047089 0 0) 0x7f88640035d0 con 0x7f887806dae0 2023-10-08T06:10:36.649 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.643+0000 7f887d396700 1 -- 172.21.15.32:0/1736968237 >> v2:172.21.15.40:3300/0 conn(0x7f887806cff0 msgr2=0x7f887806e930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:10:36.649 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.643+0000 7f887d396700 1 --2- 172.21.15.32:0/1736968237 >> v2:172.21.15.40:3300/0 conn(0x7f887806cff0 0x7f887806e930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:36.649 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.643+0000 7f887d396700 1 -- 172.21.15.32:0/1736968237 >> v1:172.21.15.40:6789/0 conn(0x7f88780cc450 legacy=0x7f887806d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:36.649 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.643+0000 7f887d396700 1 -- 172.21.15.32:0/1736968237 --> v1:172.21.15.32:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f887815f8e0 con 0x7f887806dae0 2023-10-08T06:10:36.649 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.643+0000 7f887d396700 1 -- 172.21.15.32:0/1736968237 <== mon.0 v1:172.21.15.32:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2364763317 0 0) 0x7f8870001ba0 con 0x7f887806dae0 2023-10-08T06:10:36.649 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.643+0000 7f887d396700 1 -- 172.21.15.32:0/1736968237 >> v1:172.21.15.32:6789/0 conn(0x7f887806dae0 legacy=0x7f887815b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:36.649 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.643+0000 7f887d396700 1 --2- 172.21.15.32:0/1736968237 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8864003a20 0x7f8864003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:36.649 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.643+0000 7f887d396700 1 --2- 172.21.15.32:0/1736968237 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8864004420 0x7f88640048f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:36.649 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.643+0000 7f887d396700 1 --2- 172.21.15.32:0/1736968237 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8864005190 0x7f886400ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:36.650 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.643+0000 7f887d396700 1 -- 172.21.15.32:0/1736968237 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88780cbf70 con 0x7f8864004420 2023-10-08T06:10:36.650 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.643+0000 7f887d396700 1 -- 172.21.15.32:0/1736968237 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f886400c0d0 con 0x7f8864005190 2023-10-08T06:10:36.650 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.643+0000 7f887d396700 1 -- 172.21.15.32:0/1736968237 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f886400c290 con 0x7f8864003a20 2023-10-08T06:10:36.650 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.643+0000 7f887db97700 1 --2- 172.21.15.32:0/1736968237 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8864004420 0x7f88640048f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:36.650 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.643+0000 7f887eb99700 1 --2- 172.21.15.32:0/1736968237 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8864005190 0x7f886400ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:36.650 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.643+0000 7f887db97700 1 -- 172.21.15.32:0/1736968237 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8864003a20 msgr2=0x7f8864003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:10:36.650 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.643+0000 7f887e398700 1 --2- 172.21.15.32:0/1736968237 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8864003a20 0x7f8864003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:36.650 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.647+0000 7f887db97700 1 --2- 172.21.15.32:0/1736968237 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8864003a20 0x7f8864003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:36.650 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.647+0000 7f887db97700 1 -- 172.21.15.32:0/1736968237 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8864005190 msgr2=0x7f886400ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:10:36.650 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.647+0000 7f887db97700 1 --2- 172.21.15.32:0/1736968237 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8864005190 0x7f886400ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:36.650 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.647+0000 7f887db97700 1 -- 172.21.15.32:0/1736968237 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88640035d0 con 0x7f8864004420 2023-10-08T06:10:36.650 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.647+0000 7f887eb99700 1 -- 172.21.15.32:0/1736968237 reap_dead start 2023-10-08T06:10:36.651 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.647+0000 7f887e398700 1 --2- 172.21.15.32:0/1736968237 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8864003a20 0x7f8864003e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T06:10:36.651 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.647+0000 7f887db97700 1 --2- 172.21.15.32:0/1736968237 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8864004420 0x7f88640048f0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f88780cc880 tx=0x7f88640058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa9b32f5dbf6bf3 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:36.651 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.647+0000 7f887d396700 1 -- 172.21.15.32:0/1736968237 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88680104f0 con 0x7f8864004420 2023-10-08T06:10:36.651 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.647+0000 7f887d396700 1 -- 172.21.15.32:0/1736968237 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8868001b20 con 0x7f8864004420 2023-10-08T06:10:36.651 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.647+0000 7f887d396700 1 -- 172.21.15.32:0/1736968237 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8868010e50 con 0x7f8864004420 2023-10-08T06:10:36.652 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.647+0000 7f88805fc700 1 -- 172.21.15.32:0/1736968237 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8864004420 msgr2=0x7f88640048f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:36.652 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.647+0000 7f88805fc700 1 --2- 172.21.15.32:0/1736968237 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8864004420 0x7f88640048f0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f88780cc880 tx=0x7f88640058a0 comp rx=0 tx=0).stop 2023-10-08T06:10:36.652 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.647+0000 7f88805fc700 1 -- 172.21.15.32:0/1736968237 shutdown_connections 2023-10-08T06:10:36.652 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.647+0000 7f88805fc700 1 --2- 172.21.15.32:0/1736968237 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8864004420 0x7f88640048f0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:36.652 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.647+0000 7f88805fc700 1 -- 172.21.15.32:0/1736968237 >> 172.21.15.32:0/1736968237 conn(0x7f88780cfea0 msgr2=0x7f88780d02b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:10:36.652 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.647+0000 7f88805fc700 1 -- 172.21.15.32:0/1736968237 shutdown_connections 2023-10-08T06:10:36.652 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.647+0000 7f88805fc700 1 -- 172.21.15.32:0/1736968237 wait complete. 2023-10-08T06:10:36.653 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.651+0000 7f88805fc700 1 Processor -- start 2023-10-08T06:10:36.653 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.651+0000 7f88805fc700 1 -- start start 2023-10-08T06:10:36.654 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.651+0000 7f88805fc700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8864004420 0x7f88780c9870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:36.654 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.651+0000 7f88805fc700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f88781571c0 0x7f88780c4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:36.654 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.651+0000 7f88805fc700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f88780c5ba0 0x7f8878140fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:36.654 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.651+0000 7f88805fc700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88780c5780 con 0x7f8864004420 2023-10-08T06:10:36.654 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.651+0000 7f88805fc700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88780c9e90 con 0x7f88781571c0 2023-10-08T06:10:36.654 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.651+0000 7f88805fc700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88780c5400 con 0x7f88780c5ba0 2023-10-08T06:10:36.654 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.651+0000 7f887e398700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8864004420 0x7f88780c9870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:36.654 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.651+0000 7f887e398700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8864004420 0x7f88780c9870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:33948/0 (socket says 172.21.15.32:33948) 2023-10-08T06:10:36.654 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.651+0000 7f887e398700 1 -- 172.21.15.32:0/1680297138 learned_addr learned my addr 172.21.15.32:0/1680297138 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:10:36.654 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.651+0000 7f887eb99700 1 --2- 172.21.15.32:0/1680297138 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f88780c5ba0 0x7f8878140fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:36.655 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.651+0000 7f887db97700 1 --2- 172.21.15.32:0/1680297138 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f88781571c0 0x7f88780c4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:36.656 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.651+0000 7f887e398700 1 -- 172.21.15.32:0/1680297138 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f88780c5ba0 msgr2=0x7f8878140fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:36.656 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.651+0000 7f887e398700 1 --2- 172.21.15.32:0/1680297138 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f88780c5ba0 0x7f8878140fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:36.656 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.651+0000 7f887e398700 1 -- 172.21.15.32:0/1680297138 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f88781571c0 msgr2=0x7f88780c4ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:36.656 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.651+0000 7f887e398700 1 --2- 172.21.15.32:0/1680297138 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f88781571c0 0x7f88780c4ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:36.656 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.651+0000 7f887e398700 1 -- 172.21.15.32:0/1680297138 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8878157640 con 0x7f8864004420 2023-10-08T06:10:36.656 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.651+0000 7f887e398700 1 --2- 172.21.15.32:0/1680297138 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8864004420 0x7f88780c9870 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f8874010820 tx=0x7f8874010b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:36.656 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.651+0000 7f886effd700 1 -- 172.21.15.32:0/1680297138 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8874004220 con 0x7f8864004420 2023-10-08T06:10:36.656 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.651+0000 7f886effd700 1 -- 172.21.15.32:0/1680297138 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8874004380 con 0x7f8864004420 2023-10-08T06:10:36.656 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.651+0000 7f886effd700 1 -- 172.21.15.32:0/1680297138 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88740036c0 con 0x7f8864004420 2023-10-08T06:10:36.656 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.651+0000 7f88805fc700 1 -- 172.21.15.32:0/1680297138 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8878159d20 con 0x7f8864004420 2023-10-08T06:10:36.656 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.651+0000 7f88805fc700 1 -- 172.21.15.32:0/1680297138 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88781532e0 con 0x7f8864004420 2023-10-08T06:10:36.657 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.655+0000 7f88805fc700 1 -- 172.21.15.32:0/1680297138 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88780686a0 con 0x7f8864004420 2023-10-08T06:10:36.657 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.655+0000 7f886effd700 1 -- 172.21.15.32:0/1680297138 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f8874003820 con 0x7f8864004420 2023-10-08T06:10:36.658 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.655+0000 7f886effd700 1 --2- 172.21.15.32:0/1680297138 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f885c066510 0x7f885c0689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:36.659 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.655+0000 7f887db97700 1 --2- 172.21.15.32:0/1680297138 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f885c066510 0x7f885c0689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:36.659 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.655+0000 7f886effd700 1 -- 172.21.15.32:0/1680297138 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8874083d50 con 0x7f8864004420 2023-10-08T06:10:36.659 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.655+0000 7f887db97700 1 --2- 172.21.15.32:0/1680297138 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f885c066510 0x7f885c0689d0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f88780cc880 tx=0x7f886800a000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:36.665 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.663+0000 7f886effd700 1 -- 172.21.15.32:0/1680297138 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f8874051130 con 0x7f8864004420 2023-10-08T06:10:36.871 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:36.867+0000 7f88805fc700 1 -- 172.21.15.32:0/1680297138 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f8878067c00 con 0x7f8864004420 2023-10-08T06:10:37.868 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:37.867+0000 7f886effd700 1 -- 172.21.15.32:0/1680297138 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v13) v1 ==== 118+0+0 (secure 0 0 0) 0x7f88740210b0 con 0x7f8864004420 2023-10-08T06:10:37.872 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:37.871+0000 7f88805fc700 1 -- 172.21.15.32:0/1680297138 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f885c066510 msgr2=0x7f885c0689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:37.873 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:37.871+0000 7f88805fc700 1 --2- 172.21.15.32:0/1680297138 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f885c066510 0x7f885c0689d0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f88780cc880 tx=0x7f886800a000 comp rx=0 tx=0).stop 2023-10-08T06:10:37.873 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:37.871+0000 7f88805fc700 1 -- 172.21.15.32:0/1680297138 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8864004420 msgr2=0x7f88780c9870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:37.873 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:37.871+0000 7f88805fc700 1 --2- 172.21.15.32:0/1680297138 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8864004420 0x7f88780c9870 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f8874010820 tx=0x7f8874010b30 comp rx=0 tx=0).stop 2023-10-08T06:10:37.873 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:37.871+0000 7f88805fc700 1 -- 172.21.15.32:0/1680297138 shutdown_connections 2023-10-08T06:10:37.873 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:37.871+0000 7f88805fc700 1 --2- 172.21.15.32:0/1680297138 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f885c066510 0x7f885c0689d0 secure :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f88780cc880 tx=0x7f886800a000 comp rx=0 tx=0).stop 2023-10-08T06:10:37.873 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:37.871+0000 7f88805fc700 1 --2- 172.21.15.32:0/1680297138 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f88780c5ba0 0x7f8878140fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:37.873 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:37.871+0000 7f88805fc700 1 --2- 172.21.15.32:0/1680297138 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f88781571c0 0x7f88780c4ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:37.873 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:37.871+0000 7f88805fc700 1 --2- 172.21.15.32:0/1680297138 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8864004420 0x7f88780c9870 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:37.873 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:37.871+0000 7f88805fc700 1 -- 172.21.15.32:0/1680297138 >> 172.21.15.32:0/1680297138 conn(0x7f88780cfea0 msgr2=0x7f88780ce510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:10:37.874 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:37.871+0000 7f88805fc700 1 -- 172.21.15.32:0/1680297138 shutdown_connections 2023-10-08T06:10:37.874 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:37.871+0000 7f88805fc700 1 -- 172.21.15.32:0/1680297138 wait complete. 2023-10-08T06:10:37.891 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-10-08T06:10:37.891 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-08T06:10:38.016 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:38.011+0000 7fb781804700 1 Processor -- start 2023-10-08T06:10:38.016 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:38.015+0000 7fb781804700 1 -- start start 2023-10-08T06:10:38.017 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:38.015+0000 7fb781804700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fb77c15d490 0x7fb77c0b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:38.017 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:38.015+0000 7fb781804700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb77c0d1bb0 con 0x7fb77c0d13d0 2023-10-08T06:10:38.017 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:38.015+0000 7fb781804700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb77c0d1e90 con 0x7fb77c0ce4e0 2023-10-08T06:10:38.017 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:38.015+0000 7fb781804700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb77c0d2170 con 0x7fb77c15d490 2023-10-08T06:10:38.018 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:38.015+0000 7fb780802700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fb77c15d490 0x7fb77c0b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:38.018 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:38.015+0000 7fb77bfff700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fb77c0d13d0 0x7fb77c0cddd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:54134/0 (socket says 172.21.15.32:54134) 2023-10-08T06:10:38.018 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:38.015+0000 7fb77bfff700 1 -- 172.21.15.32:0/2739694931 learned_addr learned my addr 172.21.15.32:0/2739694931 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-08T06:10:38.019 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:38.015+0000 7fb780802700 1 -- 172.21.15.32:0/2739694931 >> v1:172.21.15.40:6789/0 conn(0x7fb77c0ce4e0 legacy=0x7fb77c0b6130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:38.019 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:38.015+0000 7fb780802700 1 -- 172.21.15.32:0/2739694931 >> v1:172.21.15.32:6789/0 conn(0x7fb77c0d13d0 legacy=0x7fb77c0cddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:38.019 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:38.015+0000 7fb780802700 1 -- 172.21.15.32:0/2739694931 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb77c0d2450 con 0x7fb77c15d490 2023-10-08T06:10:38.019 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:38.015+0000 7fb77b7fe700 1 -- 172.21.15.32:0/2739694931 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1884161468 0 0) 0x7fb77c0d1bb0 con 0x7fb77c0d13d0 2023-10-08T06:10:38.019 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:38.015+0000 7fb780802700 1 --2- 172.21.15.32:0/2739694931 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb77c15d490 0x7fb77c0b8bc0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fb764009850 tx=0x7fb764009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48416b365cc6f06 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:38.019 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:38.015+0000 7fb77b7fe700 1 -- 172.21.15.32:0/2739694931 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb764011830 con 0x7fb77c15d490 2023-10-08T06:10:38.019 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:38.015+0000 7fb77b7fe700 1 -- 172.21.15.32:0/2739694931 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb764011990 con 0x7fb77c15d490 2023-10-08T06:10:38.019 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:38.015+0000 7fb77b7fe700 1 -- 172.21.15.32:0/2739694931 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb764011d20 con 0x7fb77c15d490 2023-10-08T06:10:38.020 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:38.015+0000 7fb781804700 1 -- 172.21.15.32:0/2739694931 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb77c15d490 msgr2=0x7fb77c0b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:38.020 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:38.015+0000 7fb781804700 1 --2- 172.21.15.32:0/2739694931 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb77c15d490 0x7fb77c0b8bc0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fb764009850 tx=0x7fb764009b60 comp rx=0 tx=0).stop 2023-10-08T06:10:38.020 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:38.015+0000 7fb781804700 1 -- 172.21.15.32:0/2739694931 shutdown_connections 2023-10-08T06:10:38.020 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:38.015+0000 7fb781804700 1 --2- 172.21.15.32:0/2739694931 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb77c15d490 0x7fb77c0b8bc0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:38.020 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:38.015+0000 7fb781804700 1 -- 172.21.15.32:0/2739694931 >> 172.21.15.32:0/2739694931 conn(0x7fb77c06ab40 msgr2=0x7fb77c06af20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:10:38.020 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:38.015+0000 7fb781804700 1 -- 172.21.15.32:0/2739694931 shutdown_connections 2023-10-08T06:10:38.021 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:38.019+0000 7fb781804700 1 -- 172.21.15.32:0/2739694931 wait complete. 2023-10-08T06:10:38.021 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:38.019+0000 7fb781804700 1 Processor -- start 2023-10-08T06:10:38.021 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:38.019+0000 7fb781804700 1 -- start start 2023-10-08T06:10:38.023 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:38.019+0000 7fb781804700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb77c0ce4e0 0x7fb77c1f3070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:38.023 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:38.019+0000 7fb781804700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb77c0d13d0 0x7fb77c15a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:38.024 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:38.019+0000 7fb781804700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb77c15d490 0x7fb77c15ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:38.024 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:38.019+0000 7fb781804700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb77c1f6b20 con 0x7fb77c15d490 2023-10-08T06:10:38.024 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:38.019+0000 7fb781804700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb77c1f5f10 con 0x7fb77c0ce4e0 2023-10-08T06:10:38.024 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:38.019+0000 7fb781804700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb77c1f61f0 con 0x7fb77c0d13d0 2023-10-08T06:10:38.024 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:38.019+0000 7fb781003700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb77c15d490 0x7fb77c15ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:38.024 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:38.019+0000 7fb781003700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb77c15d490 0x7fb77c15ae30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:33964/0 (socket says 172.21.15.32:33964) 2023-10-08T06:10:38.024 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:38.019+0000 7fb781003700 1 -- 172.21.15.32:0/1864013245 learned_addr learned my addr 172.21.15.32:0/1864013245 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:10:38.024 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:38.019+0000 7fb77bfff700 1 --2- 172.21.15.32:0/1864013245 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb77c0d13d0 0x7fb77c15a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:38.024 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:38.019+0000 7fb780802700 1 --2- 172.21.15.32:0/1864013245 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb77c0ce4e0 0x7fb77c1f3070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:38.024 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:38.019+0000 7fb781003700 1 -- 172.21.15.32:0/1864013245 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb77c0d13d0 msgr2=0x7fb77c15a8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:38.024 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:38.019+0000 7fb781003700 1 --2- 172.21.15.32:0/1864013245 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb77c0d13d0 0x7fb77c15a8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:38.025 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:38.019+0000 7fb781003700 1 -- 172.21.15.32:0/1864013245 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb77c0ce4e0 msgr2=0x7fb77c1f3070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:38.025 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:38.019+0000 7fb781003700 1 --2- 172.21.15.32:0/1864013245 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb77c0ce4e0 0x7fb77c1f3070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:38.025 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:38.019+0000 7fb781003700 1 -- 172.21.15.32:0/1864013245 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7640094b0 con 0x7fb77c15d490 2023-10-08T06:10:38.025 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:38.023+0000 7fb781003700 1 --2- 172.21.15.32:0/1864013245 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb77c15d490 0x7fb77c15ae30 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fb77400cbc0 tx=0x7fb77400ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:38.025 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:38.023+0000 7fb7797fa700 1 -- 172.21.15.32:0/1864013245 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb774003c20 con 0x7fb77c15d490 2023-10-08T06:10:38.026 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:38.023+0000 7fb7797fa700 1 -- 172.21.15.32:0/1864013245 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb774003d80 con 0x7fb77c15d490 2023-10-08T06:10:38.026 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:38.023+0000 7fb7797fa700 1 -- 172.21.15.32:0/1864013245 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb77400aa20 con 0x7fb77c15d490 2023-10-08T06:10:38.026 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:38.023+0000 7fb781804700 1 -- 172.21.15.32:0/1864013245 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb77c1f64d0 con 0x7fb77c15d490 2023-10-08T06:10:38.026 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:38.023+0000 7fb781804700 1 -- 172.21.15.32:0/1864013245 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb77c1f35b0 con 0x7fb77c15d490 2023-10-08T06:10:38.026 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:38.023+0000 7fb781804700 1 -- 172.21.15.32:0/1864013245 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb77c1f6cd0 con 0x7fb77c15d490 2023-10-08T06:10:38.027 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:38.023+0000 7fb7797fa700 1 -- 172.21.15.32:0/1864013245 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fb77400ab80 con 0x7fb77c15d490 2023-10-08T06:10:38.028 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:38.027+0000 7fb7797fa700 1 --2- 172.21.15.32:0/1864013245 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fb75c066510 0x7fb75c0689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:38.028 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:38.027+0000 7fb7797fa700 1 -- 172.21.15.32:0/1864013245 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb774083d10 con 0x7fb77c15d490 2023-10-08T06:10:38.028 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:38.027+0000 7fb780802700 1 --2- 172.21.15.32:0/1864013245 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fb75c066510 0x7fb75c0689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:38.028 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:38.027+0000 7fb780802700 1 --2- 172.21.15.32:0/1864013245 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fb75c066510 0x7fb75c0689d0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fb7640090b0 tx=0x7fb764008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:38.036 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:38.035+0000 7fb7797fa700 1 -- 172.21.15.32:0/1864013245 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fb77c1f6cd0 con 0x7fb77c15d490 2023-10-08T06:10:38.238 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:38.235+0000 7fb781804700 1 -- 172.21.15.32:0/1864013245 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fb77c0d0920 con 0x7fb77c15d490 2023-10-08T06:10:38.888 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:38.883+0000 7fb7797fa700 1 -- 172.21.15.32:0/1864013245 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v14) v1 ==== 122+0+0 (secure 0 0 0) 0x7fb7740511a0 con 0x7fb77c15d490 2023-10-08T06:10:38.892 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:38.891+0000 7fb781804700 1 -- 172.21.15.32:0/1864013245 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fb75c066510 msgr2=0x7fb75c0689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:38.892 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:38.891+0000 7fb781804700 1 --2- 172.21.15.32:0/1864013245 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fb75c066510 0x7fb75c0689d0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fb7640090b0 tx=0x7fb764008030 comp rx=0 tx=0).stop 2023-10-08T06:10:38.892 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:38.891+0000 7fb781804700 1 -- 172.21.15.32:0/1864013245 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb77c15d490 msgr2=0x7fb77c15ae30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:38.893 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:38.891+0000 7fb781804700 1 --2- 172.21.15.32:0/1864013245 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb77c15d490 0x7fb77c15ae30 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fb77400cbc0 tx=0x7fb77400ced0 comp rx=0 tx=0).stop 2023-10-08T06:10:38.893 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:38.891+0000 7fb781804700 1 -- 172.21.15.32:0/1864013245 shutdown_connections 2023-10-08T06:10:38.893 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:38.891+0000 7fb781804700 1 --2- 172.21.15.32:0/1864013245 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fb75c066510 0x7fb75c0689d0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:38.893 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:38.891+0000 7fb781804700 1 --2- 172.21.15.32:0/1864013245 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb77c15d490 0x7fb77c15ae30 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:38.893 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:38.891+0000 7fb781804700 1 --2- 172.21.15.32:0/1864013245 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb77c0d13d0 0x7fb77c15a8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:38.893 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:38.891+0000 7fb781804700 1 --2- 172.21.15.32:0/1864013245 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb77c0ce4e0 0x7fb77c1f3070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:38.893 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:38.891+0000 7fb781804700 1 -- 172.21.15.32:0/1864013245 >> 172.21.15.32:0/1864013245 conn(0x7fb77c06ab40 msgr2=0x7fb77c15b9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:10:38.893 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:38.891+0000 7fb781804700 1 -- 172.21.15.32:0/1864013245 shutdown_connections 2023-10-08T06:10:38.893 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:38.891+0000 7fb781804700 1 -- 172.21.15.32:0/1864013245 wait complete. 2023-10-08T06:10:38.910 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-10-08T06:10:38.910 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T06:10:39.031 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.027+0000 7fbe8dec2700 1 Processor -- start 2023-10-08T06:10:39.032 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.027+0000 7fbe8dec2700 1 -- start start 2023-10-08T06:10:39.033 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.031+0000 7fbe8dec2700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbe88159ed0 0x7fbe880ca9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:39.033 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.031+0000 7fbe8dec2700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fbe880c98c0 0x7fbe880cb510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:39.033 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.031+0000 7fbe8dec2700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe880cca40 con 0x7fbe8815a2b0 2023-10-08T06:10:39.033 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.031+0000 7fbe8dec2700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe880ccdb0 con 0x7fbe880c98c0 2023-10-08T06:10:39.033 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.031+0000 7fbe8dec2700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe880caef0 con 0x7fbe88159ed0 2023-10-08T06:10:39.033 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.031+0000 7fbe8d6c1700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fbe880c98c0 0x7fbe880cb510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:39.033 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.031+0000 7fbe8d6c1700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fbe880c98c0 0x7fbe880cb510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:33972/0 (socket says 172.21.15.32:33972) 2023-10-08T06:10:39.033 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.031+0000 7fbe8d6c1700 1 -- 172.21.15.32:0/2348443495 learned_addr learned my addr 172.21.15.32:0/2348443495 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:10:39.033 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.031+0000 7fbe8cec0700 1 --2- 172.21.15.32:0/2348443495 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbe88159ed0 0x7fbe880ca9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:39.035 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.031+0000 7fbe8d6c1700 1 -- 172.21.15.32:0/2348443495 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbe88159ed0 msgr2=0x7fbe880ca9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:10:39.035 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.031+0000 7fbe8d6c1700 1 --2- 172.21.15.32:0/2348443495 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbe88159ed0 0x7fbe880ca9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:39.035 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.031+0000 7fbe8d6c1700 1 -- 172.21.15.32:0/2348443495 >> v1:172.21.15.40:6789/0 conn(0x7fbe8815a2b0 legacy=0x7fbe880706f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:39.035 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.031+0000 7fbe8d6c1700 1 -- 172.21.15.32:0/2348443495 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe880cdf60 con 0x7fbe880c98c0 2023-10-08T06:10:39.035 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.031+0000 7fbe8d6c1700 1 --2- 172.21.15.32:0/2348443495 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbe880c98c0 0x7fbe880cb510 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fbe80009e50 tx=0x7fbe8000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=676708011ce28599 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:39.035 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.031+0000 7fbe877fe700 1 -- 172.21.15.32:0/2348443495 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe8000e070 con 0x7fbe880c98c0 2023-10-08T06:10:39.036 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.031+0000 7fbe877fe700 1 -- 172.21.15.32:0/2348443495 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe8000b910 con 0x7fbe880c98c0 2023-10-08T06:10:39.036 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.031+0000 7fbe877fe700 1 -- 172.21.15.32:0/2348443495 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe8000bcc0 con 0x7fbe880c98c0 2023-10-08T06:10:39.036 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.031+0000 7fbe8dec2700 1 -- 172.21.15.32:0/2348443495 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbe880c98c0 msgr2=0x7fbe880cb510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:39.036 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.031+0000 7fbe8dec2700 1 --2- 172.21.15.32:0/2348443495 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbe880c98c0 0x7fbe880cb510 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fbe80009e50 tx=0x7fbe8000b330 comp rx=0 tx=0).stop 2023-10-08T06:10:39.036 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.031+0000 7fbe8dec2700 1 -- 172.21.15.32:0/2348443495 shutdown_connections 2023-10-08T06:10:39.036 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.031+0000 7fbe8dec2700 1 --2- 172.21.15.32:0/2348443495 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbe880c98c0 0x7fbe880cb510 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:39.036 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.031+0000 7fbe8dec2700 1 --2- 172.21.15.32:0/2348443495 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbe88159ed0 0x7fbe880ca9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:39.036 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.031+0000 7fbe8dec2700 1 -- 172.21.15.32:0/2348443495 >> 172.21.15.32:0/2348443495 conn(0x7fbe880b0900 msgr2=0x7fbe880b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:10:39.036 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.031+0000 7fbe8dec2700 1 -- 172.21.15.32:0/2348443495 shutdown_connections 2023-10-08T06:10:39.037 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.031+0000 7fbe8dec2700 1 -- 172.21.15.32:0/2348443495 wait complete. 2023-10-08T06:10:39.037 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.035+0000 7fbe8dec2700 1 Processor -- start 2023-10-08T06:10:39.037 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.035+0000 7fbe8dec2700 1 -- start start 2023-10-08T06:10:39.039 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.035+0000 7fbe8dec2700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbe880c98c0 0x7fbe88151bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:39.039 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.035+0000 7fbe8dec2700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbe88159ed0 0x7fbe88156340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:39.039 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.035+0000 7fbe8dec2700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbe8815a2b0 0x7fbe8815a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:39.039 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.035+0000 7fbe8dec2700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe88157890 con 0x7fbe880c98c0 2023-10-08T06:10:39.039 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.035+0000 7fbe8dec2700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe88152fa0 con 0x7fbe88159ed0 2023-10-08T06:10:39.039 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.035+0000 7fbe8dec2700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe88153280 con 0x7fbe8815a2b0 2023-10-08T06:10:39.039 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.035+0000 7fbe8cec0700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbe880c98c0 0x7fbe88151bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:39.039 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.035+0000 7fbe8cec0700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbe880c98c0 0x7fbe88151bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:33974/0 (socket says 172.21.15.32:33974) 2023-10-08T06:10:39.039 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.035+0000 7fbe8cec0700 1 -- 172.21.15.32:0/1128403112 learned_addr learned my addr 172.21.15.32:0/1128403112 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:10:39.040 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.035+0000 7fbe87fff700 1 --2- 172.21.15.32:0/1128403112 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbe88159ed0 0x7fbe88156340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:39.040 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.035+0000 7fbe8d6c1700 1 --2- 172.21.15.32:0/1128403112 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbe8815a2b0 0x7fbe8815a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:39.040 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.035+0000 7fbe8cec0700 1 -- 172.21.15.32:0/1128403112 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbe8815a2b0 msgr2=0x7fbe8815a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:39.040 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.035+0000 7fbe8cec0700 1 --2- 172.21.15.32:0/1128403112 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbe8815a2b0 0x7fbe8815a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:39.040 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.035+0000 7fbe8cec0700 1 -- 172.21.15.32:0/1128403112 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbe88159ed0 msgr2=0x7fbe88156340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:39.040 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.035+0000 7fbe8cec0700 1 --2- 172.21.15.32:0/1128403112 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbe88159ed0 0x7fbe88156340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:39.040 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.035+0000 7fbe8cec0700 1 -- 172.21.15.32:0/1128403112 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe80009b30 con 0x7fbe880c98c0 2023-10-08T06:10:39.040 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.035+0000 7fbe8d6c1700 1 --2- 172.21.15.32:0/1128403112 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbe8815a2b0 0x7fbe8815a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T06:10:39.040 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.035+0000 7fbe8cec0700 1 --2- 172.21.15.32:0/1128403112 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbe880c98c0 0x7fbe88151bd0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fbe7000e9d0 tx=0x7fbe7000ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:39.041 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.035+0000 7fbe857fa700 1 -- 172.21.15.32:0/1128403112 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe70009720 con 0x7fbe880c98c0 2023-10-08T06:10:39.041 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.035+0000 7fbe857fa700 1 -- 172.21.15.32:0/1128403112 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe7000c850 con 0x7fbe880c98c0 2023-10-08T06:10:39.041 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.035+0000 7fbe8dec2700 1 -- 172.21.15.32:0/1128403112 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe88153560 con 0x7fbe880c98c0 2023-10-08T06:10:39.041 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.035+0000 7fbe857fa700 1 -- 172.21.15.32:0/1128403112 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe7000cbc0 con 0x7fbe880c98c0 2023-10-08T06:10:39.042 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.039+0000 7fbe8dec2700 1 -- 172.21.15.32:0/1128403112 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe88156880 con 0x7fbe880c98c0 2023-10-08T06:10:39.042 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.039+0000 7fbe8dec2700 1 -- 172.21.15.32:0/1128403112 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe88153a80 con 0x7fbe880c98c0 2023-10-08T06:10:39.042 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.039+0000 7fbe857fa700 1 -- 172.21.15.32:0/1128403112 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fbe7000cd20 con 0x7fbe880c98c0 2023-10-08T06:10:39.043 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.039+0000 7fbe857fa700 1 --2- 172.21.15.32:0/1128403112 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fbe68066510 0x7fbe680689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:39.043 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.039+0000 7fbe857fa700 1 -- 172.21.15.32:0/1128403112 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbe70083e90 con 0x7fbe880c98c0 2023-10-08T06:10:39.043 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.039+0000 7fbe87fff700 1 --2- 172.21.15.32:0/1128403112 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fbe68066510 0x7fbe680689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:39.044 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.043+0000 7fbe87fff700 1 --2- 172.21.15.32:0/1128403112 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fbe68066510 0x7fbe680689d0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fbe88070d60 tx=0x7fbe78009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:39.050 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.047+0000 7fbe857fa700 1 -- 172.21.15.32:0/1128403112 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fbe700513a0 con 0x7fbe880c98c0 2023-10-08T06:10:39.251 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.247+0000 7fbe8dec2700 1 -- 172.21.15.32:0/1128403112 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbe88073f00 con 0x7fbe880c98c0 2023-10-08T06:10:39.252 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.251+0000 7fbe857fa700 1 -- 172.21.15.32:0/1128403112 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+4909 (secure 0 0 0) 0x7fbe700549c0 con 0x7fbe880c98c0 2023-10-08T06:10:39.252 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:10:39.253 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":14,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5232,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6835/1178250724","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6834","nonce":1178250724},{"type":"v1","addr":"172.21.15.32:6835","nonce":1178250724}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10},{"gid":5238,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6837/2723596589","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6836","nonce":2723596589},{"type":"v1","addr":"172.21.15.32:6837","nonce":2723596589}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10},{"gid":5323,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6833/3107673350","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":3107673350},{"type":"v1","addr":"172.21.15.40:6833","nonce":3107673350}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T06:10:35.216976+0000","modified":"2023-10-08T06:10:38.240290+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5326},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5326":{"gid":5326,"name":"b","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.40:6835/500201668","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":500201668},{"type":"v1","addr":"172.21.15.40:6835","nonce":500201668}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-10-08T06:10:39.255 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.251+0000 7fbe8dec2700 1 -- 172.21.15.32:0/1128403112 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fbe68066510 msgr2=0x7fbe680689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:39.255 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.251+0000 7fbe8dec2700 1 --2- 172.21.15.32:0/1128403112 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fbe68066510 0x7fbe680689d0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fbe88070d60 tx=0x7fbe78009040 comp rx=0 tx=0).stop 2023-10-08T06:10:39.255 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.251+0000 7fbe8dec2700 1 -- 172.21.15.32:0/1128403112 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbe880c98c0 msgr2=0x7fbe88151bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:39.255 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.251+0000 7fbe8dec2700 1 --2- 172.21.15.32:0/1128403112 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbe880c98c0 0x7fbe88151bd0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fbe7000e9d0 tx=0x7fbe7000ece0 comp rx=0 tx=0).stop 2023-10-08T06:10:39.255 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.251+0000 7fbe8dec2700 1 -- 172.21.15.32:0/1128403112 shutdown_connections 2023-10-08T06:10:39.255 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.251+0000 7fbe8dec2700 1 --2- 172.21.15.32:0/1128403112 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fbe68066510 0x7fbe680689d0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:39.255 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.251+0000 7fbe8dec2700 1 --2- 172.21.15.32:0/1128403112 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbe8815a2b0 0x7fbe8815a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:39.255 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.251+0000 7fbe8dec2700 1 --2- 172.21.15.32:0/1128403112 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbe88159ed0 0x7fbe88156340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:39.255 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.251+0000 7fbe8dec2700 1 --2- 172.21.15.32:0/1128403112 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbe880c98c0 0x7fbe88151bd0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:39.256 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.251+0000 7fbe8dec2700 1 -- 172.21.15.32:0/1128403112 >> 172.21.15.32:0/1128403112 conn(0x7fbe880b0900 msgr2=0x7fbe880cd090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:10:39.256 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.251+0000 7fbe8dec2700 1 -- 172.21.15.32:0/1128403112 shutdown_connections 2023-10-08T06:10:39.256 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.251+0000 7fbe8dec2700 1 -- 172.21.15.32:0/1128403112 wait complete. 2023-10-08T06:10:39.256 INFO:teuthology.orchestra.run.smithi032.stderr:dumped fsmap epoch 14 2023-10-08T06:10:39.267 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T06:10:39.379 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.375+0000 7f9c19c49700 1 Processor -- start 2023-10-08T06:10:39.379 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.375+0000 7f9c19c49700 1 -- start start 2023-10-08T06:10:39.381 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.379+0000 7f9c19c49700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9c140c9ac0 0x7f9c1415aed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:39.382 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.379+0000 7f9c19c49700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f9c14070e50 0x7f9c140712e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:39.382 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.379+0000 7f9c19c49700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c1415b410 con 0x7f9c1406b3b0 2023-10-08T06:10:39.382 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.379+0000 7f9c19c49700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c140cb300 con 0x7f9c14070e50 2023-10-08T06:10:39.382 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.379+0000 7f9c19c49700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c140ca260 con 0x7f9c140c9ac0 2023-10-08T06:10:39.382 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.379+0000 7f9c19448700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f9c14070e50 0x7f9c140712e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:39.382 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.379+0000 7f9c19448700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f9c14070e50 0x7f9c140712e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:33976/0 (socket says 172.21.15.32:33976) 2023-10-08T06:10:39.382 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.379+0000 7f9c19448700 1 -- 172.21.15.32:0/1776159287 learned_addr learned my addr 172.21.15.32:0/1776159287 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:10:39.382 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.379+0000 7f9c13fff700 1 --2- 172.21.15.32:0/1776159287 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9c140c9ac0 0x7f9c1415aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:39.382 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.379+0000 7f9c19448700 1 -- 172.21.15.32:0/1776159287 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9c140c9ac0 msgr2=0x7f9c1415aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:10:39.382 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.379+0000 7f9c19448700 1 --2- 172.21.15.32:0/1776159287 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9c140c9ac0 0x7f9c1415aed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:39.382 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.379+0000 7f9c19448700 1 -- 172.21.15.32:0/1776159287 >> v1:172.21.15.40:6789/0 conn(0x7f9c1406b3b0 legacy=0x7f9c1406b790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:39.383 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.379+0000 7f9c19448700 1 -- 172.21.15.32:0/1776159287 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c140ca540 con 0x7f9c14070e50 2023-10-08T06:10:39.383 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.379+0000 7f9c19448700 1 --2- 172.21.15.32:0/1776159287 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9c14070e50 0x7f9c140712e0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f9c0c009e50 tx=0x7f9c0c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d54e53e6bdaa5e6 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:39.384 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.379+0000 7f9c137fe700 1 -- 172.21.15.32:0/1776159287 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c0c00e070 con 0x7f9c14070e50 2023-10-08T06:10:39.384 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.379+0000 7f9c137fe700 1 -- 172.21.15.32:0/1776159287 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c0c00b9c0 con 0x7f9c14070e50 2023-10-08T06:10:39.384 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.379+0000 7f9c137fe700 1 -- 172.21.15.32:0/1776159287 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c0c00bd70 con 0x7f9c14070e50 2023-10-08T06:10:39.384 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.379+0000 7f9c19c49700 1 -- 172.21.15.32:0/1776159287 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9c14070e50 msgr2=0x7f9c140712e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:39.384 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.379+0000 7f9c19c49700 1 --2- 172.21.15.32:0/1776159287 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9c14070e50 0x7f9c140712e0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f9c0c009e50 tx=0x7f9c0c00b330 comp rx=0 tx=0).stop 2023-10-08T06:10:39.384 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.379+0000 7f9c19c49700 1 -- 172.21.15.32:0/1776159287 shutdown_connections 2023-10-08T06:10:39.384 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.379+0000 7f9c19c49700 1 --2- 172.21.15.32:0/1776159287 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9c14070e50 0x7f9c140712e0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:39.384 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.379+0000 7f9c19c49700 1 --2- 172.21.15.32:0/1776159287 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9c140c9ac0 0x7f9c1415aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:39.384 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.379+0000 7f9c19c49700 1 -- 172.21.15.32:0/1776159287 >> 172.21.15.32:0/1776159287 conn(0x7f9c140cf470 msgr2=0x7f9c140cf880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:10:39.384 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.379+0000 7f9c19c49700 1 -- 172.21.15.32:0/1776159287 shutdown_connections 2023-10-08T06:10:39.385 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.379+0000 7f9c19c49700 1 -- 172.21.15.32:0/1776159287 wait complete. 2023-10-08T06:10:39.385 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.383+0000 7f9c19c49700 1 Processor -- start 2023-10-08T06:10:39.385 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.383+0000 7f9c19c49700 1 -- start start 2023-10-08T06:10:39.386 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.383+0000 7f9c19c49700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9c1406b3b0 0x7f9c14156fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:39.387 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.383+0000 7f9c19c49700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9c14070e50 0x7f9c140c2fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:39.387 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.383+0000 7f9c19c49700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9c140c9ac0 0x7f9c140c34e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:39.387 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.383+0000 7f9c19c49700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c141f1f40 con 0x7f9c1406b3b0 2023-10-08T06:10:39.387 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.383+0000 7f9c19c49700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c141f2220 con 0x7f9c140c9ac0 2023-10-08T06:10:39.387 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.383+0000 7f9c19c49700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c141f2500 con 0x7f9c14070e50 2023-10-08T06:10:39.387 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.383+0000 7f9c18c47700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9c1406b3b0 0x7f9c14156fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:39.387 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.383+0000 7f9c18c47700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9c1406b3b0 0x7f9c14156fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:33990/0 (socket says 172.21.15.32:33990) 2023-10-08T06:10:39.387 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.383+0000 7f9c18c47700 1 -- 172.21.15.32:0/3747060439 learned_addr learned my addr 172.21.15.32:0/3747060439 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:10:39.387 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.383+0000 7f9c13fff700 1 --2- 172.21.15.32:0/3747060439 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9c14070e50 0x7f9c140c2fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:39.387 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.383+0000 7f9c19448700 1 --2- 172.21.15.32:0/3747060439 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9c140c9ac0 0x7f9c140c34e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:39.388 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.383+0000 7f9c18c47700 1 -- 172.21.15.32:0/3747060439 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9c14070e50 msgr2=0x7f9c140c2fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:39.388 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.383+0000 7f9c18c47700 1 --2- 172.21.15.32:0/3747060439 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9c14070e50 0x7f9c140c2fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:39.388 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.383+0000 7f9c18c47700 1 -- 172.21.15.32:0/3747060439 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9c140c9ac0 msgr2=0x7f9c140c34e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:39.388 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.383+0000 7f9c18c47700 1 --2- 172.21.15.32:0/3747060439 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9c140c9ac0 0x7f9c140c34e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:39.388 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.383+0000 7f9c18c47700 1 -- 172.21.15.32:0/3747060439 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c0c009b30 con 0x7f9c1406b3b0 2023-10-08T06:10:39.389 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.383+0000 7f9c18c47700 1 --2- 172.21.15.32:0/3747060439 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9c1406b3b0 0x7f9c14156fa0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f9c0800c500 tx=0x7f9c0800c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:39.389 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.383+0000 7f9c117fa700 1 -- 172.21.15.32:0/3747060439 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c080052d0 con 0x7f9c1406b3b0 2023-10-08T06:10:39.389 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.383+0000 7f9c117fa700 1 -- 172.21.15.32:0/3747060439 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c08005430 con 0x7f9c1406b3b0 2023-10-08T06:10:39.389 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.383+0000 7f9c19c49700 1 -- 172.21.15.32:0/3747060439 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c141f27e0 con 0x7f9c1406b3b0 2023-10-08T06:10:39.389 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.383+0000 7f9c117fa700 1 -- 172.21.15.32:0/3747060439 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c080055a0 con 0x7f9c1406b3b0 2023-10-08T06:10:39.389 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.387+0000 7f9c19c49700 1 -- 172.21.15.32:0/3747060439 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c141574e0 con 0x7f9c1406b3b0 2023-10-08T06:10:39.389 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.387+0000 7f9c19c49700 1 -- 172.21.15.32:0/3747060439 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c141f2d00 con 0x7f9c1406b3b0 2023-10-08T06:10:39.390 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.387+0000 7f9c117fa700 1 -- 172.21.15.32:0/3747060439 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f9c080038e0 con 0x7f9c1406b3b0 2023-10-08T06:10:39.391 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.387+0000 7f9c117fa700 1 --2- 172.21.15.32:0/3747060439 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f9bf8066510 0x7f9bf80689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:39.391 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.387+0000 7f9c13fff700 1 --2- 172.21.15.32:0/3747060439 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f9bf8066510 0x7f9bf80689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:39.391 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.387+0000 7f9c117fa700 1 -- 172.21.15.32:0/3747060439 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9c080835b0 con 0x7f9c1406b3b0 2023-10-08T06:10:39.391 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.391+0000 7f9c13fff700 1 --2- 172.21.15.32:0/3747060439 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f9bf8066510 0x7f9bf80689d0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f9c1414ef30 tx=0x7f9c00008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:39.397 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.395+0000 7f9c117fa700 1 -- 172.21.15.32:0/3747060439 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f9c08050b20 con 0x7f9c1406b3b0 2023-10-08T06:10:39.560 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.559+0000 7f9c19c49700 1 -- 172.21.15.32:0/3747060439 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9c14157670 con 0x7f9c1406b3b0 2023-10-08T06:10:39.563 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.559+0000 7f9c117fa700 1 -- 172.21.15.32:0/3747060439 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) v1 ==== 74+0+16509 (secure 0 0 0) 0x7f9c08054140 con 0x7f9c1406b3b0 2023-10-08T06:10:39.564 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:10:39.564 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":35,"fsid":"ac672d87-96ae-41e0-9314-623ba2cdbbba","created":"2023-10-08T06:09:11.175626+0000","modified":"2023-10-08T06:10:36.862351+0000","last_up_change":"2023-10-08T06:09:22.744643+0000","last_in_change":"2023-10-08T06:09:14.131580+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T06:09:23.307843+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-10-08T06:10:33.777525+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-10-08T06:10:34.202152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"43433f0c-9592-4874-92d7-10f8f4acf07f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":587888964},{"type":"v1","addr":"172.21.15.32:6801","nonce":587888964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":587888964},{"type":"v1","addr":"172.21.15.32:6803","nonce":587888964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":587888964},{"type":"v1","addr":"172.21.15.32:6810","nonce":587888964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6805","nonce":587888964},{"type":"v1","addr":"172.21.15.32:6807","nonce":587888964}]},"public_addr":"172.21.15.32:6801/587888964","cluster_addr":"172.21.15.32:6803/587888964","heartbeat_back_addr":"172.21.15.32:6810/587888964","heartbeat_front_addr":"172.21.15.32:6807/587888964","state":["exists","up"]},{"osd":1,"uuid":"2ecb1008-b987-4ce7-b646-6cded55fc8d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":990576767},{"type":"v1","addr":"172.21.15.32:6817","nonce":990576767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":990576767},{"type":"v1","addr":"172.21.15.32:6819","nonce":990576767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":990576767},{"type":"v1","addr":"172.21.15.32:6823","nonce":990576767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":990576767},{"type":"v1","addr":"172.21.15.32:6821","nonce":990576767}]},"public_addr":"172.21.15.32:6817/990576767","cluster_addr":"172.21.15.32:6819/990576767","heartbeat_back_addr":"172.21.15.32:6823/990576767","heartbeat_front_addr":"172.21.15.32:6821/990576767","state":["exists","up"]},{"osd":2,"uuid":"1b131c94-c09b-4e80-8746-bf1b7bac362d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6824","nonce":1566874440},{"type":"v1","addr":"172.21.15.32:6825","nonce":1566874440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":1566874440},{"type":"v1","addr":"172.21.15.32:6827","nonce":1566874440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":1566874440},{"type":"v1","addr":"172.21.15.32:6831","nonce":1566874440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":1566874440},{"type":"v1","addr":"172.21.15.32:6829","nonce":1566874440}]},"public_addr":"172.21.15.32:6825/1566874440","cluster_addr":"172.21.15.32:6827/1566874440","heartbeat_back_addr":"172.21.15.32:6831/1566874440","heartbeat_front_addr":"172.21.15.32:6829/1566874440","state":["exists","up"]},{"osd":3,"uuid":"ad655af2-1f6f-4689-b21d-b07bbaeb68b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":3672614802},{"type":"v1","addr":"172.21.15.32:6806","nonce":3672614802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6809","nonce":3672614802},{"type":"v1","addr":"172.21.15.32:6811","nonce":3672614802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":3672614802},{"type":"v1","addr":"172.21.15.32:6815","nonce":3672614802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":3672614802},{"type":"v1","addr":"172.21.15.32:6813","nonce":3672614802}]},"public_addr":"172.21.15.32:6806/3672614802","cluster_addr":"172.21.15.32:6811/3672614802","heartbeat_back_addr":"172.21.15.32:6815/3672614802","heartbeat_front_addr":"172.21.15.32:6813/3672614802","state":["exists","up"]},{"osd":4,"uuid":"64a543a1-8c4f-458e-9aba-b35c1cd7dd03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":3369928244},{"type":"v1","addr":"172.21.15.40:6801","nonce":3369928244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":3369928244},{"type":"v1","addr":"172.21.15.40:6803","nonce":3369928244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":3369928244},{"type":"v1","addr":"172.21.15.40:6807","nonce":3369928244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":3369928244},{"type":"v1","addr":"172.21.15.40:6805","nonce":3369928244}]},"public_addr":"172.21.15.40:6801/3369928244","cluster_addr":"172.21.15.40:6803/3369928244","heartbeat_back_addr":"172.21.15.40:6807/3369928244","heartbeat_front_addr":"172.21.15.40:6805/3369928244","state":["exists","up"]},{"osd":5,"uuid":"0fef3e54-edb4-4678-878e-944663c51638","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":2395850297},{"type":"v1","addr":"172.21.15.40:6825","nonce":2395850297}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":2395850297},{"type":"v1","addr":"172.21.15.40:6827","nonce":2395850297}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":2395850297},{"type":"v1","addr":"172.21.15.40:6831","nonce":2395850297}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":2395850297},{"type":"v1","addr":"172.21.15.40:6829","nonce":2395850297}]},"public_addr":"172.21.15.40:6825/2395850297","cluster_addr":"172.21.15.40:6827/2395850297","heartbeat_back_addr":"172.21.15.40:6831/2395850297","heartbeat_front_addr":"172.21.15.40:6829/2395850297","state":["exists","up"]},{"osd":6,"uuid":"2eeb0472-6096-469d-9b2c-cab4bf41c31a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":4145283410},{"type":"v1","addr":"172.21.15.40:6809","nonce":4145283410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":4145283410},{"type":"v1","addr":"172.21.15.40:6811","nonce":4145283410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":4145283410},{"type":"v1","addr":"172.21.15.40:6815","nonce":4145283410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":4145283410},{"type":"v1","addr":"172.21.15.40:6813","nonce":4145283410}]},"public_addr":"172.21.15.40:6809/4145283410","cluster_addr":"172.21.15.40:6811/4145283410","heartbeat_back_addr":"172.21.15.40:6815/4145283410","heartbeat_front_addr":"172.21.15.40:6813/4145283410","state":["exists","up"]},{"osd":7,"uuid":"cf76e4c7-96a6-401f-a280-91aad4641940","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":2943297416},{"type":"v1","addr":"172.21.15.40:6817","nonce":2943297416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":2943297416},{"type":"v1","addr":"172.21.15.40:6819","nonce":2943297416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":2943297416},{"type":"v1","addr":"172.21.15.40:6823","nonce":2943297416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":2943297416},{"type":"v1","addr":"172.21.15.40:6821","nonce":2943297416}]},"public_addr":"172.21.15.40:6817/2943297416","cluster_addr":"172.21.15.40:6819/2943297416","heartbeat_back_addr":"172.21.15.40:6823/2943297416","heartbeat_front_addr":"172.21.15.40:6821/2943297416","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.411475+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.628841+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.599055+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.166100+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.384135+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.488403+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.307648+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.363541+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T06:10:39.566 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.563+0000 7f9c19c49700 1 -- 172.21.15.32:0/3747060439 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f9bf8066510 msgr2=0x7f9bf80689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:39.566 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.563+0000 7f9c19c49700 1 --2- 172.21.15.32:0/3747060439 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f9bf8066510 0x7f9bf80689d0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f9c1414ef30 tx=0x7f9c00008040 comp rx=0 tx=0).stop 2023-10-08T06:10:39.566 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.563+0000 7f9c19c49700 1 -- 172.21.15.32:0/3747060439 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9c1406b3b0 msgr2=0x7f9c14156fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:39.566 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.563+0000 7f9c19c49700 1 --2- 172.21.15.32:0/3747060439 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9c1406b3b0 0x7f9c14156fa0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f9c0800c500 tx=0x7f9c0800c810 comp rx=0 tx=0).stop 2023-10-08T06:10:39.567 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.563+0000 7f9c19c49700 1 -- 172.21.15.32:0/3747060439 shutdown_connections 2023-10-08T06:10:39.567 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.563+0000 7f9c19c49700 1 --2- 172.21.15.32:0/3747060439 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f9bf8066510 0x7f9bf80689d0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:39.567 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.563+0000 7f9c19c49700 1 --2- 172.21.15.32:0/3747060439 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9c140c9ac0 0x7f9c140c34e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:39.567 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.563+0000 7f9c19c49700 1 --2- 172.21.15.32:0/3747060439 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9c14070e50 0x7f9c140c2fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:39.567 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.563+0000 7f9c19c49700 1 --2- 172.21.15.32:0/3747060439 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9c1406b3b0 0x7f9c14156fa0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:39.567 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.563+0000 7f9c19c49700 1 -- 172.21.15.32:0/3747060439 >> 172.21.15.32:0/3747060439 conn(0x7f9c140cf470 msgr2=0x7f9c14150830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:10:39.567 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.563+0000 7f9c19c49700 1 -- 172.21.15.32:0/3747060439 shutdown_connections 2023-10-08T06:10:39.567 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.563+0000 7f9c19c49700 1 -- 172.21.15.32:0/3747060439 wait complete. 2023-10-08T06:10:39.579 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-08T06:10:39.579 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T06:10:39.695 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.691+0000 7fdc0b22c700 1 Processor -- start 2023-10-08T06:10:39.695 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.691+0000 7fdc0b22c700 1 -- start start 2023-10-08T06:10:39.700 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.691+0000 7fdc0b22c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdc0415d490 0x7fdc040b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:39.700 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.691+0000 7fdc0b22c700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc040d1bb0 con 0x7fdc040d13d0 2023-10-08T06:10:39.700 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.691+0000 7fdc0b22c700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc040d1e90 con 0x7fdc040ce4e0 2023-10-08T06:10:39.701 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.691+0000 7fdc0b22c700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc040d2170 con 0x7fdc0415d490 2023-10-08T06:10:39.701 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.695+0000 7fdc09a29700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fdc040d13d0 0x7fdc040cddd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:54136/0 (socket says 172.21.15.32:54136) 2023-10-08T06:10:39.701 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.695+0000 7fdc09a29700 1 -- 172.21.15.32:0/161827822 learned_addr learned my addr 172.21.15.32:0/161827822 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-08T06:10:39.701 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.695+0000 7fdc0a22a700 1 --2- 172.21.15.32:0/161827822 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdc0415d490 0x7fdc040b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:39.701 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.695+0000 7fdc09228700 1 -- 172.21.15.32:0/161827822 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1938808405 0 0) 0x7fdc040d1bb0 con 0x7fdc040d13d0 2023-10-08T06:10:39.701 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.695+0000 7fdc09228700 1 -- 172.21.15.32:0/161827822 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdbec0035d0 con 0x7fdc040d13d0 2023-10-08T06:10:39.701 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.695+0000 7fdc09228700 1 -- 172.21.15.32:0/161827822 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 328198111 0 0) 0x7fdbec0035d0 con 0x7fdc040d13d0 2023-10-08T06:10:39.702 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.695+0000 7fdc09228700 1 -- 172.21.15.32:0/161827822 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdc0415d490 msgr2=0x7fdc040b8bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:10:39.702 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.695+0000 7fdc09228700 1 --2- 172.21.15.32:0/161827822 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdc0415d490 0x7fdc040b8bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:39.702 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.695+0000 7fdc09228700 1 -- 172.21.15.32:0/161827822 >> v1:172.21.15.40:6789/0 conn(0x7fdc040ce4e0 legacy=0x7fdc040b6130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:39.702 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.695+0000 7fdc09228700 1 -- 172.21.15.32:0/161827822 --> v1:172.21.15.32:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc040d2450 con 0x7fdc040d13d0 2023-10-08T06:10:39.702 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.695+0000 7fdc09228700 1 -- 172.21.15.32:0/161827822 <== mon.0 v1:172.21.15.32:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2364763317 0 0) 0x7fdbf40019f0 con 0x7fdc040d13d0 2023-10-08T06:10:39.702 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.695+0000 7fdc09228700 1 -- 172.21.15.32:0/161827822 >> v1:172.21.15.32:6789/0 conn(0x7fdc040d13d0 legacy=0x7fdc040cddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:39.702 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.695+0000 7fdc09228700 1 --2- 172.21.15.32:0/161827822 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdc0415d490 0x7fdbec003a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:39.702 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.695+0000 7fdc09228700 1 --2- 172.21.15.32:0/161827822 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdbec003fd0 0x7fdbec004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:39.702 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.695+0000 7fdc09228700 1 --2- 172.21.15.32:0/161827822 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdbec004db0 0x7fdbec005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:39.702 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.695+0000 7fdc09228700 1 -- 172.21.15.32:0/161827822 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc040d2170 con 0x7fdbec004db0 2023-10-08T06:10:39.702 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.695+0000 7fdc09228700 1 -- 172.21.15.32:0/161827822 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbec00bba0 con 0x7fdbec003fd0 2023-10-08T06:10:39.703 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.695+0000 7fdc09228700 1 -- 172.21.15.32:0/161827822 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbec00bd60 con 0x7fdc0415d490 2023-10-08T06:10:39.703 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.695+0000 7fdc0a22a700 1 --2- 172.21.15.32:0/161827822 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdc0415d490 0x7fdbec003a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:39.703 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.695+0000 7fdc09a29700 1 --2- 172.21.15.32:0/161827822 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdbec003fd0 0x7fdbec004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:39.703 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.695+0000 7fdc0aa2b700 1 --2- 172.21.15.32:0/161827822 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdbec004db0 0x7fdbec005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:39.703 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.695+0000 7fdc0a22a700 1 -- 172.21.15.32:0/161827822 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdbec003fd0 msgr2=0x7fdbec004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:10:39.703 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.695+0000 7fdc0a22a700 1 --2- 172.21.15.32:0/161827822 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdbec003fd0 0x7fdbec004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:39.703 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.695+0000 7fdc0a22a700 1 -- 172.21.15.32:0/161827822 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdbec004db0 msgr2=0x7fdbec005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:10:39.703 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.695+0000 7fdc0a22a700 1 --2- 172.21.15.32:0/161827822 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdbec004db0 0x7fdbec005230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:39.703 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.695+0000 7fdc0a22a700 1 -- 172.21.15.32:0/161827822 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbec0035d0 con 0x7fdc0415d490 2023-10-08T06:10:39.703 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.695+0000 7fdc0a22a700 1 --2- 172.21.15.32:0/161827822 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdc0415d490 0x7fdbec003a50 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fdbf8009b70 tx=0x7fdbec0058a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2a70c1aaf7b32b43 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:39.703 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.695+0000 7fdc09228700 1 -- 172.21.15.32:0/161827822 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbf800e6c0 con 0x7fdc0415d490 2023-10-08T06:10:39.703 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.695+0000 7fdc09228700 1 -- 172.21.15.32:0/161827822 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbf800e820 con 0x7fdc0415d490 2023-10-08T06:10:39.704 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.695+0000 7fdc09228700 1 -- 172.21.15.32:0/161827822 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbf800eb90 con 0x7fdc0415d490 2023-10-08T06:10:39.704 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.695+0000 7fdc0b22c700 1 -- 172.21.15.32:0/161827822 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdc0415d490 msgr2=0x7fdbec003a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:39.704 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.695+0000 7fdc0b22c700 1 --2- 172.21.15.32:0/161827822 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdc0415d490 0x7fdbec003a50 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fdbf8009b70 tx=0x7fdbec0058a0 comp rx=0 tx=0).stop 2023-10-08T06:10:39.704 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.695+0000 7fdc0aa2b700 1 -- 172.21.15.32:0/161827822 reap_dead start 2023-10-08T06:10:39.704 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.695+0000 7fdc0b22c700 1 -- 172.21.15.32:0/161827822 shutdown_connections 2023-10-08T06:10:39.704 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.695+0000 7fdc0b22c700 1 -- 172.21.15.32:0/161827822 >> 172.21.15.32:0/161827822 conn(0x7fdc0406ab40 msgr2=0x7fdc0406af20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:10:39.704 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.695+0000 7fdc0b22c700 1 -- 172.21.15.32:0/161827822 shutdown_connections 2023-10-08T06:10:39.704 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.695+0000 7fdc0b22c700 1 -- 172.21.15.32:0/161827822 wait complete. 2023-10-08T06:10:39.706 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.699+0000 7fdc0b22c700 1 Processor -- start 2023-10-08T06:10:39.706 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.699+0000 7fdc0b22c700 1 -- start start 2023-10-08T06:10:39.706 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.699+0000 7fdc0b22c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdc0415d490 0x7fdc040cd250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:39.707 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.699+0000 7fdc0b22c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdc041546e0 0x7fdc041f6aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:39.707 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.699+0000 7fdc0b22c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdc041512e0 0x7fdc040cfa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:39.707 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.699+0000 7fdc0b22c700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc041f6fe0 con 0x7fdc041546e0 2023-10-08T06:10:39.707 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.699+0000 7fdc0b22c700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc041f6000 con 0x7fdc0415d490 2023-10-08T06:10:39.707 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.699+0000 7fdc0b22c700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc04154b60 con 0x7fdc041512e0 2023-10-08T06:10:39.707 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.699+0000 7fdc09a29700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdc041546e0 0x7fdc041f6aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:39.707 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.699+0000 7fdc09a29700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdc041546e0 0x7fdc041f6aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:34004/0 (socket says 172.21.15.32:34004) 2023-10-08T06:10:39.707 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.699+0000 7fdc09a29700 1 -- 172.21.15.32:0/1679294820 learned_addr learned my addr 172.21.15.32:0/1679294820 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:10:39.707 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.699+0000 7fdc0a22a700 1 --2- 172.21.15.32:0/1679294820 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdc0415d490 0x7fdc040cd250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:39.707 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.699+0000 7fdc0aa2b700 1 --2- 172.21.15.32:0/1679294820 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdc041512e0 0x7fdc040cfa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:39.707 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.699+0000 7fdc09a29700 1 -- 172.21.15.32:0/1679294820 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdc041512e0 msgr2=0x7fdc040cfa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:39.708 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.699+0000 7fdc09a29700 1 --2- 172.21.15.32:0/1679294820 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdc041512e0 0x7fdc040cfa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:39.708 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.699+0000 7fdc09a29700 1 -- 172.21.15.32:0/1679294820 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdc0415d490 msgr2=0x7fdc040cd250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:39.708 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.699+0000 7fdc09a29700 1 --2- 172.21.15.32:0/1679294820 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdc0415d490 0x7fdc040cd250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:39.708 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.699+0000 7fdc09a29700 1 -- 172.21.15.32:0/1679294820 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc04154e10 con 0x7fdc041546e0 2023-10-08T06:10:39.708 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.703+0000 7fdc09a29700 1 --2- 172.21.15.32:0/1679294820 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdc041546e0 0x7fdc041f6aa0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fdbf4001b00 tx=0x7fdbf4007ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:39.708 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.703+0000 7fdc02ffd700 1 -- 172.21.15.32:0/1679294820 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbf400ab30 con 0x7fdc041546e0 2023-10-08T06:10:39.708 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.703+0000 7fdc02ffd700 1 -- 172.21.15.32:0/1679294820 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbf400ac90 con 0x7fdc041546e0 2023-10-08T06:10:39.708 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.703+0000 7fdc0b22c700 1 -- 172.21.15.32:0/1679294820 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc041550f0 con 0x7fdc041546e0 2023-10-08T06:10:39.708 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.703+0000 7fdc02ffd700 1 -- 172.21.15.32:0/1679294820 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbf40133f0 con 0x7fdc041546e0 2023-10-08T06:10:39.708 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.703+0000 7fdc0b22c700 1 -- 172.21.15.32:0/1679294820 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc041f6580 con 0x7fdc041546e0 2023-10-08T06:10:39.708 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.703+0000 7fdc0b22c700 1 -- 172.21.15.32:0/1679294820 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc041552e0 con 0x7fdc041546e0 2023-10-08T06:10:39.709 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.703+0000 7fdc02ffd700 1 -- 172.21.15.32:0/1679294820 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fdbf4013550 con 0x7fdc041546e0 2023-10-08T06:10:39.709 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.703+0000 7fdc02ffd700 1 --2- 172.21.15.32:0/1679294820 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fdbf0066510 0x7fdbf00689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:39.709 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.707+0000 7fdc02ffd700 1 -- 172.21.15.32:0/1679294820 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdbf4084990 con 0x7fdc041546e0 2023-10-08T06:10:39.709 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.707+0000 7fdc0a22a700 1 --2- 172.21.15.32:0/1679294820 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fdbf0066510 0x7fdbf00689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:39.709 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.707+0000 7fdc0a22a700 1 --2- 172.21.15.32:0/1679294820 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fdbf0066510 0x7fdbf00689d0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fdbf80090b0 tx=0x7fdbf801e040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:39.713 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.711+0000 7fdc02ffd700 1 -- 172.21.15.32:0/1679294820 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fdbf4051da0 con 0x7fdc041546e0 2023-10-08T06:10:39.879 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.875+0000 7fdc0b22c700 1 -- 172.21.15.32:0/1679294820 --> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fdc040d2c50 con 0x7fdbf0066510 2023-10-08T06:10:39.888 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.887+0000 7fdc02ffd700 1 -- 172.21.15.32:0/1679294820 <== mgr.4107 v2:172.21.15.32:6832/2601628338 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286971 (secure 0 0 0) 0x7fdbf800ea90 con 0x7fdbf0066510 2023-10-08T06:10:39.892 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:10:39.895 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.891+0000 7fdc0b22c700 1 -- 172.21.15.32:0/1679294820 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fdbf0066510 msgr2=0x7fdbf00689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:39.895 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.891+0000 7fdc0b22c700 1 --2- 172.21.15.32:0/1679294820 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fdbf0066510 0x7fdbf00689d0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fdbf80090b0 tx=0x7fdbf801e040 comp rx=0 tx=0).stop 2023-10-08T06:10:39.895 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.891+0000 7fdc0b22c700 1 -- 172.21.15.32:0/1679294820 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdc041546e0 msgr2=0x7fdc041f6aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:39.895 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.891+0000 7fdc0b22c700 1 --2- 172.21.15.32:0/1679294820 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdc041546e0 0x7fdc041f6aa0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fdbf4001b00 tx=0x7fdbf4007ca0 comp rx=0 tx=0).stop 2023-10-08T06:10:39.895 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.891+0000 7fdc0b22c700 1 -- 172.21.15.32:0/1679294820 shutdown_connections 2023-10-08T06:10:39.896 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.891+0000 7fdc0b22c700 1 --2- 172.21.15.32:0/1679294820 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fdbf0066510 0x7fdbf00689d0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:39.896 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.891+0000 7fdc0b22c700 1 --2- 172.21.15.32:0/1679294820 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdc041546e0 0x7fdc041f6aa0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:39.896 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.891+0000 7fdc0b22c700 1 --2- 172.21.15.32:0/1679294820 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdc041512e0 0x7fdc040cfa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:39.896 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.891+0000 7fdc0b22c700 1 --2- 172.21.15.32:0/1679294820 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdc0415d490 0x7fdc040cd250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:39.896 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.891+0000 7fdc0b22c700 1 -- 172.21.15.32:0/1679294820 >> 172.21.15.32:0/1679294820 conn(0x7fdc0406ab40 msgr2=0x7fdc040731e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:10:39.896 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.891+0000 7fdc0b22c700 1 -- 172.21.15.32:0/1679294820 shutdown_connections 2023-10-08T06:10:39.897 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:39.891+0000 7fdc0b22c700 1 -- 172.21.15.32:0/1679294820 wait complete. 2023-10-08T06:10:39.897 INFO:teuthology.orchestra.run.smithi032.stderr:dumped all 2023-10-08T06:10:39.909 INFO:teuthology.orchestra.run.smithi032.stdout:{"pg_ready":true,"pg_map":{"version":67,"stamp":"2023-10-08T06:10:39.269727+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":135,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":237076,"kb_used_data":4264,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754737644,"statfs":{"total":773094113280,"available":772851347456,"internally_reserved":0,"allocated":4366336,"data_stored":2403716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":238276153},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.436915"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-08T06:10:37.371927+0000","last_change":"2023-10-08T06:10:35.863215+0000","last_active":"2023-10-08T06:10:37.371927+0000","last_peered":"2023-10-08T06:10:37.371927+0000","last_clean":"2023-10-08T06:10:37.371927+0000","last_became_active":"2023-10-08T06:10:35.862909+0000","last_became_peered":"2023-10-08T06:10:35.862909+0000","last_unstale":"2023-10-08T06:10:37.371927+0000","last_undegraded":"2023-10-08T06:10:37.371927+0000","last_fullsized":"2023-10-08T06:10:37.371927+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_clean_scrub_stamp":"2023-10-08T06:10:34.831061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:41:45.977745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-08T06:10:36.871569+0000","last_change":"2023-10-08T06:10:35.867329+0000","last_active":"2023-10-08T06:10:36.871569+0000","last_peered":"2023-10-08T06:10:36.871569+0000","last_clean":"2023-10-08T06:10:36.871569+0000","last_became_active":"2023-10-08T06:10:35.867071+0000","last_became_peered":"2023-10-08T06:10:35.867071+0000","last_unstale":"2023-10-08T06:10:36.871569+0000","last_undegraded":"2023-10-08T06:10:36.871569+0000","last_fullsized":"2023-10-08T06:10:36.871569+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_clean_scrub_stamp":"2023-10-08T06:10:34.831061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:00:52.862023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-08T06:10:36.874527+0000","last_change":"2023-10-08T06:10:35.860936+0000","last_active":"2023-10-08T06:10:36.874527+0000","last_peered":"2023-10-08T06:10:36.874527+0000","last_clean":"2023-10-08T06:10:36.874527+0000","last_became_active":"2023-10-08T06:10:35.860104+0000","last_became_peered":"2023-10-08T06:10:35.860104+0000","last_unstale":"2023-10-08T06:10:36.874527+0000","last_undegraded":"2023-10-08T06:10:36.874527+0000","last_fullsized":"2023-10-08T06:10:36.874527+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_clean_scrub_stamp":"2023-10-08T06:10:34.831061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:04:26.488430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-08T06:10:37.372945+0000","last_change":"2023-10-08T06:10:35.870363+0000","last_active":"2023-10-08T06:10:37.372945+0000","last_peered":"2023-10-08T06:10:37.372945+0000","last_clean":"2023-10-08T06:10:37.372945+0000","last_became_active":"2023-10-08T06:10:35.870008+0000","last_became_peered":"2023-10-08T06:10:35.870008+0000","last_unstale":"2023-10-08T06:10:37.372945+0000","last_undegraded":"2023-10-08T06:10:37.372945+0000","last_fullsized":"2023-10-08T06:10:37.372945+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_clean_scrub_stamp":"2023-10-08T06:10:34.831061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:34:04.392768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-08T06:10:37.372737+0000","last_change":"2023-10-08T06:10:35.863975+0000","last_active":"2023-10-08T06:10:37.372737+0000","last_peered":"2023-10-08T06:10:37.372737+0000","last_clean":"2023-10-08T06:10:37.372737+0000","last_became_active":"2023-10-08T06:10:35.863694+0000","last_became_peered":"2023-10-08T06:10:35.863694+0000","last_unstale":"2023-10-08T06:10:37.372737+0000","last_undegraded":"2023-10-08T06:10:37.372737+0000","last_fullsized":"2023-10-08T06:10:37.372737+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_clean_scrub_stamp":"2023-10-08T06:10:34.831061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:12:14.014454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-08T06:10:36.870166+0000","last_change":"2023-10-08T06:10:35.869351+0000","last_active":"2023-10-08T06:10:36.870166+0000","last_peered":"2023-10-08T06:10:36.870166+0000","last_clean":"2023-10-08T06:10:36.870166+0000","last_became_active":"2023-10-08T06:10:35.869069+0000","last_became_peered":"2023-10-08T06:10:35.869069+0000","last_unstale":"2023-10-08T06:10:36.870166+0000","last_undegraded":"2023-10-08T06:10:36.870166+0000","last_fullsized":"2023-10-08T06:10:36.870166+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_clean_scrub_stamp":"2023-10-08T06:10:34.831061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:26:44.371328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-08T06:10:36.872497+0000","last_change":"2023-10-08T06:10:35.865368+0000","last_active":"2023-10-08T06:10:36.872497+0000","last_peered":"2023-10-08T06:10:36.872497+0000","last_clean":"2023-10-08T06:10:36.872497+0000","last_became_active":"2023-10-08T06:10:35.865060+0000","last_became_peered":"2023-10-08T06:10:35.865060+0000","last_unstale":"2023-10-08T06:10:36.872497+0000","last_undegraded":"2023-10-08T06:10:36.872497+0000","last_fullsized":"2023-10-08T06:10:36.872497+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_clean_scrub_stamp":"2023-10-08T06:10:34.831061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:22:49.613418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-08T06:10:36.871541+0000","last_change":"2023-10-08T06:10:35.865248+0000","last_active":"2023-10-08T06:10:36.871541+0000","last_peered":"2023-10-08T06:10:36.871541+0000","last_clean":"2023-10-08T06:10:36.871541+0000","last_became_active":"2023-10-08T06:10:35.864941+0000","last_became_peered":"2023-10-08T06:10:35.864941+0000","last_unstale":"2023-10-08T06:10:36.871541+0000","last_undegraded":"2023-10-08T06:10:36.871541+0000","last_fullsized":"2023-10-08T06:10:36.871541+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_clean_scrub_stamp":"2023-10-08T06:10:34.831061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:58:27.184043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-08T06:10:37.373064+0000","last_change":"2023-10-08T06:10:35.862297+0000","last_active":"2023-10-08T06:10:37.373064+0000","last_peered":"2023-10-08T06:10:37.373064+0000","last_clean":"2023-10-08T06:10:37.373064+0000","last_became_active":"2023-10-08T06:10:35.861956+0000","last_became_peered":"2023-10-08T06:10:35.861956+0000","last_unstale":"2023-10-08T06:10:37.373064+0000","last_undegraded":"2023-10-08T06:10:37.373064+0000","last_fullsized":"2023-10-08T06:10:37.373064+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_clean_scrub_stamp":"2023-10-08T06:10:34.831061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:13:19.900307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-08T06:10:37.374678+0000","last_change":"2023-10-08T06:10:35.866832+0000","last_active":"2023-10-08T06:10:37.374678+0000","last_peered":"2023-10-08T06:10:37.374678+0000","last_clean":"2023-10-08T06:10:37.374678+0000","last_became_active":"2023-10-08T06:10:35.866128+0000","last_became_peered":"2023-10-08T06:10:35.866128+0000","last_unstale":"2023-10-08T06:10:37.374678+0000","last_undegraded":"2023-10-08T06:10:37.374678+0000","last_fullsized":"2023-10-08T06:10:37.374678+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_clean_scrub_stamp":"2023-10-08T06:10:34.831061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:36:41.906523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-08T06:10:36.873226+0000","last_change":"2023-10-08T06:10:35.872268+0000","last_active":"2023-10-08T06:10:36.873226+0000","last_peered":"2023-10-08T06:10:36.873226+0000","last_clean":"2023-10-08T06:10:36.873226+0000","last_became_active":"2023-10-08T06:10:35.872019+0000","last_became_peered":"2023-10-08T06:10:35.872019+0000","last_unstale":"2023-10-08T06:10:36.873226+0000","last_undegraded":"2023-10-08T06:10:36.873226+0000","last_fullsized":"2023-10-08T06:10:36.873226+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_clean_scrub_stamp":"2023-10-08T06:10:34.831061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:10:28.597054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-08T06:10:36.874626+0000","last_change":"2023-10-08T06:10:35.862999+0000","last_active":"2023-10-08T06:10:36.874626+0000","last_peered":"2023-10-08T06:10:36.874626+0000","last_clean":"2023-10-08T06:10:36.874626+0000","last_became_active":"2023-10-08T06:10:35.862526+0000","last_became_peered":"2023-10-08T06:10:35.862526+0000","last_unstale":"2023-10-08T06:10:36.874626+0000","last_undegraded":"2023-10-08T06:10:36.874626+0000","last_fullsized":"2023-10-08T06:10:36.874626+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_clean_scrub_stamp":"2023-10-08T06:10:34.831061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:19:11.190979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-08T06:10:37.373053+0000","last_change":"2023-10-08T06:10:35.858353+0000","last_active":"2023-10-08T06:10:37.373053+0000","last_peered":"2023-10-08T06:10:37.373053+0000","last_clean":"2023-10-08T06:10:37.373053+0000","last_became_active":"2023-10-08T06:10:35.858054+0000","last_became_peered":"2023-10-08T06:10:35.858054+0000","last_unstale":"2023-10-08T06:10:37.373053+0000","last_undegraded":"2023-10-08T06:10:37.373053+0000","last_fullsized":"2023-10-08T06:10:37.373053+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_clean_scrub_stamp":"2023-10-08T06:10:34.831061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:40:02.981787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-08T06:10:36.870510+0000","last_change":"2023-10-08T06:10:35.866081+0000","last_active":"2023-10-08T06:10:36.870510+0000","last_peered":"2023-10-08T06:10:36.870510+0000","last_clean":"2023-10-08T06:10:36.870510+0000","last_became_active":"2023-10-08T06:10:35.865651+0000","last_became_peered":"2023-10-08T06:10:35.865651+0000","last_unstale":"2023-10-08T06:10:36.870510+0000","last_undegraded":"2023-10-08T06:10:36.870510+0000","last_fullsized":"2023-10-08T06:10:36.870510+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_clean_scrub_stamp":"2023-10-08T06:10:34.831061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:43:12.760308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-08T06:10:36.874154+0000","last_change":"2023-10-08T06:10:35.859419+0000","last_active":"2023-10-08T06:10:36.874154+0000","last_peered":"2023-10-08T06:10:36.874154+0000","last_clean":"2023-10-08T06:10:36.874154+0000","last_became_active":"2023-10-08T06:10:35.859088+0000","last_became_peered":"2023-10-08T06:10:35.859088+0000","last_unstale":"2023-10-08T06:10:36.874154+0000","last_undegraded":"2023-10-08T06:10:36.874154+0000","last_fullsized":"2023-10-08T06:10:36.874154+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_clean_scrub_stamp":"2023-10-08T06:10:34.831061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:38:29.387527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-08T06:10:36.872063+0000","last_change":"2023-10-08T06:10:35.871098+0000","last_active":"2023-10-08T06:10:36.872063+0000","last_peered":"2023-10-08T06:10:36.872063+0000","last_clean":"2023-10-08T06:10:36.872063+0000","last_became_active":"2023-10-08T06:10:35.870657+0000","last_became_peered":"2023-10-08T06:10:35.870657+0000","last_unstale":"2023-10-08T06:10:36.872063+0000","last_undegraded":"2023-10-08T06:10:36.872063+0000","last_fullsized":"2023-10-08T06:10:36.872063+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_clean_scrub_stamp":"2023-10-08T06:10:34.831061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:38:29.387527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-08T06:10:36.874126+0000","last_change":"2023-10-08T06:10:35.868016+0000","last_active":"2023-10-08T06:10:36.874126+0000","last_peered":"2023-10-08T06:10:36.874126+0000","last_clean":"2023-10-08T06:10:36.874126+0000","last_became_active":"2023-10-08T06:10:35.867675+0000","last_became_peered":"2023-10-08T06:10:35.867675+0000","last_unstale":"2023-10-08T06:10:36.874126+0000","last_undegraded":"2023-10-08T06:10:36.874126+0000","last_fullsized":"2023-10-08T06:10:36.874126+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_clean_scrub_stamp":"2023-10-08T06:10:34.831061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:36:31.790465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-08T06:10:36.871614+0000","last_change":"2023-10-08T06:10:35.868383+0000","last_active":"2023-10-08T06:10:36.871614+0000","last_peered":"2023-10-08T06:10:36.871614+0000","last_clean":"2023-10-08T06:10:36.871614+0000","last_became_active":"2023-10-08T06:10:35.868085+0000","last_became_peered":"2023-10-08T06:10:35.868085+0000","last_unstale":"2023-10-08T06:10:36.871614+0000","last_undegraded":"2023-10-08T06:10:36.871614+0000","last_fullsized":"2023-10-08T06:10:36.871614+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_clean_scrub_stamp":"2023-10-08T06:10:34.831061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:20:02.778242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-08T06:10:36.871224+0000","last_change":"2023-10-08T06:10:35.866889+0000","last_active":"2023-10-08T06:10:36.871224+0000","last_peered":"2023-10-08T06:10:36.871224+0000","last_clean":"2023-10-08T06:10:36.871224+0000","last_became_active":"2023-10-08T06:10:35.866595+0000","last_became_peered":"2023-10-08T06:10:35.866595+0000","last_unstale":"2023-10-08T06:10:36.871224+0000","last_undegraded":"2023-10-08T06:10:36.871224+0000","last_fullsized":"2023-10-08T06:10:36.871224+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_clean_scrub_stamp":"2023-10-08T06:10:34.831061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:51:38.349833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-08T06:10:37.373733+0000","last_change":"2023-10-08T06:10:35.865812+0000","last_active":"2023-10-08T06:10:37.373733+0000","last_peered":"2023-10-08T06:10:37.373733+0000","last_clean":"2023-10-08T06:10:37.373733+0000","last_became_active":"2023-10-08T06:10:35.865524+0000","last_became_peered":"2023-10-08T06:10:35.865524+0000","last_unstale":"2023-10-08T06:10:37.373733+0000","last_undegraded":"2023-10-08T06:10:37.373733+0000","last_fullsized":"2023-10-08T06:10:37.373733+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_clean_scrub_stamp":"2023-10-08T06:10:34.831061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:06:34.629019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-08T06:10:37.372177+0000","last_change":"2023-10-08T06:10:35.863887+0000","last_active":"2023-10-08T06:10:37.372177+0000","last_peered":"2023-10-08T06:10:37.372177+0000","last_clean":"2023-10-08T06:10:37.372177+0000","last_became_active":"2023-10-08T06:10:35.863564+0000","last_became_peered":"2023-10-08T06:10:35.863564+0000","last_unstale":"2023-10-08T06:10:37.372177+0000","last_undegraded":"2023-10-08T06:10:37.372177+0000","last_fullsized":"2023-10-08T06:10:37.372177+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_clean_scrub_stamp":"2023-10-08T06:10:34.831061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:39:08.224167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-08T06:10:37.371818+0000","last_change":"2023-10-08T06:10:35.863972+0000","last_active":"2023-10-08T06:10:37.371818+0000","last_peered":"2023-10-08T06:10:37.371818+0000","last_clean":"2023-10-08T06:10:37.371818+0000","last_became_active":"2023-10-08T06:10:35.863638+0000","last_became_peered":"2023-10-08T06:10:35.863638+0000","last_unstale":"2023-10-08T06:10:37.371818+0000","last_undegraded":"2023-10-08T06:10:37.371818+0000","last_fullsized":"2023-10-08T06:10:37.371818+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_clean_scrub_stamp":"2023-10-08T06:10:34.831061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:46:58.432384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-08T06:10:37.372683+0000","last_change":"2023-10-08T06:10:35.859870+0000","last_active":"2023-10-08T06:10:37.372683+0000","last_peered":"2023-10-08T06:10:37.372683+0000","last_clean":"2023-10-08T06:10:37.372683+0000","last_became_active":"2023-10-08T06:10:35.859523+0000","last_became_peered":"2023-10-08T06:10:35.859523+0000","last_unstale":"2023-10-08T06:10:37.372683+0000","last_undegraded":"2023-10-08T06:10:37.372683+0000","last_fullsized":"2023-10-08T06:10:37.372683+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_clean_scrub_stamp":"2023-10-08T06:10:34.831061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:34:22.155924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-08T06:10:36.873696+0000","last_change":"2023-10-08T06:10:35.855095+0000","last_active":"2023-10-08T06:10:36.873696+0000","last_peered":"2023-10-08T06:10:36.873696+0000","last_clean":"2023-10-08T06:10:36.873696+0000","last_became_active":"2023-10-08T06:10:35.854794+0000","last_became_peered":"2023-10-08T06:10:35.854794+0000","last_unstale":"2023-10-08T06:10:36.873696+0000","last_undegraded":"2023-10-08T06:10:36.873696+0000","last_fullsized":"2023-10-08T06:10:36.873696+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_clean_scrub_stamp":"2023-10-08T06:10:34.831061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:13:19.900307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-08T06:10:37.373346+0000","last_change":"2023-10-08T06:10:35.864375+0000","last_active":"2023-10-08T06:10:37.373346+0000","last_peered":"2023-10-08T06:10:37.373346+0000","last_clean":"2023-10-08T06:10:37.373346+0000","last_became_active":"2023-10-08T06:10:35.863796+0000","last_became_peered":"2023-10-08T06:10:35.863796+0000","last_unstale":"2023-10-08T06:10:37.373346+0000","last_undegraded":"2023-10-08T06:10:37.373346+0000","last_fullsized":"2023-10-08T06:10:37.373346+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_clean_scrub_stamp":"2023-10-08T06:10:34.831061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:38:29.387527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-08T06:10:36.871759+0000","last_change":"2023-10-08T06:10:35.876158+0000","last_active":"2023-10-08T06:10:36.871759+0000","last_peered":"2023-10-08T06:10:36.871759+0000","last_clean":"2023-10-08T06:10:36.871759+0000","last_became_active":"2023-10-08T06:10:35.875816+0000","last_became_peered":"2023-10-08T06:10:35.875816+0000","last_unstale":"2023-10-08T06:10:36.871759+0000","last_undegraded":"2023-10-08T06:10:36.871759+0000","last_fullsized":"2023-10-08T06:10:36.871759+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_clean_scrub_stamp":"2023-10-08T06:10:34.831061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:40:53.836462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-08T06:10:37.374605+0000","last_change":"2023-10-08T06:10:35.865805+0000","last_active":"2023-10-08T06:10:37.374605+0000","last_peered":"2023-10-08T06:10:37.374605+0000","last_clean":"2023-10-08T06:10:37.374605+0000","last_became_active":"2023-10-08T06:10:35.865361+0000","last_became_peered":"2023-10-08T06:10:35.865361+0000","last_unstale":"2023-10-08T06:10:37.374605+0000","last_undegraded":"2023-10-08T06:10:37.374605+0000","last_fullsized":"2023-10-08T06:10:37.374605+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_clean_scrub_stamp":"2023-10-08T06:10:34.831061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:22:49.613418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-08T06:10:36.874866+0000","last_change":"2023-10-08T06:10:35.854632+0000","last_active":"2023-10-08T06:10:36.874866+0000","last_peered":"2023-10-08T06:10:36.874866+0000","last_clean":"2023-10-08T06:10:36.874866+0000","last_became_active":"2023-10-08T06:10:35.853237+0000","last_became_peered":"2023-10-08T06:10:35.853237+0000","last_unstale":"2023-10-08T06:10:36.874866+0000","last_undegraded":"2023-10-08T06:10:36.874866+0000","last_fullsized":"2023-10-08T06:10:36.874866+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_clean_scrub_stamp":"2023-10-08T06:10:34.831061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:10:28.597054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-08T06:10:37.372550+0000","last_change":"2023-10-08T06:10:35.864775+0000","last_active":"2023-10-08T06:10:37.372550+0000","last_peered":"2023-10-08T06:10:37.372550+0000","last_clean":"2023-10-08T06:10:37.372550+0000","last_became_active":"2023-10-08T06:10:35.863696+0000","last_became_peered":"2023-10-08T06:10:35.863696+0000","last_unstale":"2023-10-08T06:10:37.372550+0000","last_undegraded":"2023-10-08T06:10:37.372550+0000","last_fullsized":"2023-10-08T06:10:37.372550+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_clean_scrub_stamp":"2023-10-08T06:10:34.831061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:41:56.067091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-08T06:10:36.872565+0000","last_change":"2023-10-08T06:10:35.867902+0000","last_active":"2023-10-08T06:10:36.872565+0000","last_peered":"2023-10-08T06:10:36.872565+0000","last_clean":"2023-10-08T06:10:36.872565+0000","last_became_active":"2023-10-08T06:10:35.867581+0000","last_became_peered":"2023-10-08T06:10:35.867581+0000","last_unstale":"2023-10-08T06:10:36.872565+0000","last_undegraded":"2023-10-08T06:10:36.872565+0000","last_fullsized":"2023-10-08T06:10:36.872565+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_clean_scrub_stamp":"2023-10-08T06:10:34.831061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:36:41.906523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-08T06:10:37.370858+0000","last_change":"2023-10-08T06:10:35.858608+0000","last_active":"2023-10-08T06:10:37.370858+0000","last_peered":"2023-10-08T06:10:37.370858+0000","last_clean":"2023-10-08T06:10:37.370858+0000","last_became_active":"2023-10-08T06:10:35.858324+0000","last_became_peered":"2023-10-08T06:10:35.858324+0000","last_unstale":"2023-10-08T06:10:37.370858+0000","last_undegraded":"2023-10-08T06:10:37.370858+0000","last_fullsized":"2023-10-08T06:10:37.370858+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_clean_scrub_stamp":"2023-10-08T06:10:34.831061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:01:23.143779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-08T06:10:36.871641+0000","last_change":"2023-10-08T06:10:35.870914+0000","last_active":"2023-10-08T06:10:36.871641+0000","last_peered":"2023-10-08T06:10:36.871641+0000","last_clean":"2023-10-08T06:10:36.871641+0000","last_became_active":"2023-10-08T06:10:35.870305+0000","last_became_peered":"2023-10-08T06:10:35.870305+0000","last_unstale":"2023-10-08T06:10:36.871641+0000","last_undegraded":"2023-10-08T06:10:36.871641+0000","last_fullsized":"2023-10-08T06:10:36.871641+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_clean_scrub_stamp":"2023-10-08T06:10:34.831061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:41:56.067091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-08T06:10:37.374083+0000","last_change":"2023-10-08T06:10:35.863770+0000","last_active":"2023-10-08T06:10:37.374083+0000","last_peered":"2023-10-08T06:10:37.374083+0000","last_clean":"2023-10-08T06:10:37.374083+0000","last_became_active":"2023-10-08T06:10:35.863472+0000","last_became_peered":"2023-10-08T06:10:35.863472+0000","last_unstale":"2023-10-08T06:10:37.374083+0000","last_undegraded":"2023-10-08T06:10:37.374083+0000","last_fullsized":"2023-10-08T06:10:37.374083+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_clean_scrub_stamp":"2023-10-08T06:10:34.831061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:31:13.744612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"34'4","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-08T06:10:37.372154+0000","last_change":"2023-10-08T06:10:34.861884+0000","last_active":"2023-10-08T06:10:37.372154+0000","last_peered":"2023-10-08T06:10:37.372154+0000","last_clean":"2023-10-08T06:10:37.372154+0000","last_became_active":"2023-10-08T06:10:34.861630+0000","last_became_peered":"2023-10-08T06:10:34.861630+0000","last_unstale":"2023-10-08T06:10:37.372154+0000","last_undegraded":"2023-10-08T06:10:37.372154+0000","last_fullsized":"2023-10-08T06:10:37.372154+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:10:33.827732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:10:33.827732+0000","last_clean_scrub_stamp":"2023-10-08T06:10:33.827732+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:06:14.750979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-08T06:10:37.372032+0000","last_change":"2023-10-08T06:10:35.869022+0000","last_active":"2023-10-08T06:10:37.372032+0000","last_peered":"2023-10-08T06:10:37.372032+0000","last_clean":"2023-10-08T06:10:37.372032+0000","last_became_active":"2023-10-08T06:10:35.868735+0000","last_became_peered":"2023-10-08T06:10:35.868735+0000","last_unstale":"2023-10-08T06:10:37.372032+0000","last_undegraded":"2023-10-08T06:10:37.372032+0000","last_fullsized":"2023-10-08T06:10:37.372032+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_clean_scrub_stamp":"2023-10-08T06:10:34.831061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:31:13.744612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"34'1","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-08T06:10:37.374166+0000","last_change":"2023-10-08T06:10:34.861500+0000","last_active":"2023-10-08T06:10:37.374166+0000","last_peered":"2023-10-08T06:10:37.374166+0000","last_clean":"2023-10-08T06:10:37.374166+0000","last_became_active":"2023-10-08T06:10:34.861207+0000","last_became_peered":"2023-10-08T06:10:34.861207+0000","last_unstale":"2023-10-08T06:10:37.374166+0000","last_undegraded":"2023-10-08T06:10:37.374166+0000","last_fullsized":"2023-10-08T06:10:37.374166+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:10:33.827732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:10:33.827732+0000","last_clean_scrub_stamp":"2023-10-08T06:10:33.827732+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:06:14.750979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-08T06:10:37.372515+0000","last_change":"2023-10-08T06:10:35.870817+0000","last_active":"2023-10-08T06:10:37.372515+0000","last_peered":"2023-10-08T06:10:37.372515+0000","last_clean":"2023-10-08T06:10:37.372515+0000","last_became_active":"2023-10-08T06:10:35.870552+0000","last_became_peered":"2023-10-08T06:10:35.870552+0000","last_unstale":"2023-10-08T06:10:37.372515+0000","last_undegraded":"2023-10-08T06:10:37.372515+0000","last_fullsized":"2023-10-08T06:10:37.372515+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_clean_scrub_stamp":"2023-10-08T06:10:34.831061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:58:27.184043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"34'2","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-08T06:10:36.871229+0000","last_change":"2023-10-08T06:10:34.859559+0000","last_active":"2023-10-08T06:10:36.871229+0000","last_peered":"2023-10-08T06:10:36.871229+0000","last_clean":"2023-10-08T06:10:36.871229+0000","last_became_active":"2023-10-08T06:10:34.858928+0000","last_became_peered":"2023-10-08T06:10:34.858928+0000","last_unstale":"2023-10-08T06:10:36.871229+0000","last_undegraded":"2023-10-08T06:10:36.871229+0000","last_fullsized":"2023-10-08T06:10:36.871229+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:10:33.827732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:10:33.827732+0000","last_clean_scrub_stamp":"2023-10-08T06:10:33.827732+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:57:33.452960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-08T06:10:37.374701+0000","last_change":"2023-10-08T06:10:35.865626+0000","last_active":"2023-10-08T06:10:37.374701+0000","last_peered":"2023-10-08T06:10:37.374701+0000","last_clean":"2023-10-08T06:10:37.374701+0000","last_became_active":"2023-10-08T06:10:35.864968+0000","last_became_peered":"2023-10-08T06:10:35.864968+0000","last_unstale":"2023-10-08T06:10:37.374701+0000","last_undegraded":"2023-10-08T06:10:37.374701+0000","last_fullsized":"2023-10-08T06:10:37.374701+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_clean_scrub_stamp":"2023-10-08T06:10:34.831061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:04:26.488430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"34'2","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-08T06:10:37.373855+0000","last_change":"2023-10-08T06:10:34.854345+0000","last_active":"2023-10-08T06:10:37.373855+0000","last_peered":"2023-10-08T06:10:37.373855+0000","last_clean":"2023-10-08T06:10:37.373855+0000","last_became_active":"2023-10-08T06:10:34.853417+0000","last_became_peered":"2023-10-08T06:10:34.853417+0000","last_unstale":"2023-10-08T06:10:37.373855+0000","last_undegraded":"2023-10-08T06:10:37.373855+0000","last_fullsized":"2023-10-08T06:10:37.373855+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:10:33.827732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:10:33.827732+0000","last_clean_scrub_stamp":"2023-10-08T06:10:33.827732+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:42:39.129767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-08T06:10:36.872697+0000","last_change":"2023-10-08T06:10:35.867847+0000","last_active":"2023-10-08T06:10:36.872697+0000","last_peered":"2023-10-08T06:10:36.872697+0000","last_clean":"2023-10-08T06:10:36.872697+0000","last_became_active":"2023-10-08T06:10:35.867555+0000","last_became_peered":"2023-10-08T06:10:35.867555+0000","last_unstale":"2023-10-08T06:10:36.872697+0000","last_undegraded":"2023-10-08T06:10:36.872697+0000","last_fullsized":"2023-10-08T06:10:36.872697+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_clean_scrub_stamp":"2023-10-08T06:10:34.831061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:04:26.488430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"34'1","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-08T06:10:37.372506+0000","last_change":"2023-10-08T06:10:34.867715+0000","last_active":"2023-10-08T06:10:37.372506+0000","last_peered":"2023-10-08T06:10:37.372506+0000","last_clean":"2023-10-08T06:10:37.372506+0000","last_became_active":"2023-10-08T06:10:34.867414+0000","last_became_peered":"2023-10-08T06:10:34.867414+0000","last_unstale":"2023-10-08T06:10:37.372506+0000","last_undegraded":"2023-10-08T06:10:37.372506+0000","last_fullsized":"2023-10-08T06:10:37.372506+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:10:33.827732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:10:33.827732+0000","last_clean_scrub_stamp":"2023-10-08T06:10:33.827732+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:34:21.152595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-08T06:10:36.874229+0000","last_change":"2023-10-08T06:10:35.856204+0000","last_active":"2023-10-08T06:10:36.874229+0000","last_peered":"2023-10-08T06:10:36.874229+0000","last_clean":"2023-10-08T06:10:36.874229+0000","last_became_active":"2023-10-08T06:10:35.855838+0000","last_became_peered":"2023-10-08T06:10:35.855838+0000","last_unstale":"2023-10-08T06:10:36.874229+0000","last_undegraded":"2023-10-08T06:10:36.874229+0000","last_fullsized":"2023-10-08T06:10:36.874229+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_clean_scrub_stamp":"2023-10-08T06:10:34.831061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:22:49.613418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"34'1","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-08T06:10:37.371822+0000","last_change":"2023-10-08T06:10:34.867818+0000","last_active":"2023-10-08T06:10:37.371822+0000","last_peered":"2023-10-08T06:10:37.371822+0000","last_clean":"2023-10-08T06:10:37.371822+0000","last_became_active":"2023-10-08T06:10:34.867309+0000","last_became_peered":"2023-10-08T06:10:34.867309+0000","last_unstale":"2023-10-08T06:10:37.371822+0000","last_undegraded":"2023-10-08T06:10:37.371822+0000","last_fullsized":"2023-10-08T06:10:37.371822+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:10:33.827732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:10:33.827732+0000","last_clean_scrub_stamp":"2023-10-08T06:10:33.827732+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:11:44.986426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-08T06:10:37.371250+0000","last_change":"2023-10-08T06:10:35.868759+0000","last_active":"2023-10-08T06:10:37.371250+0000","last_peered":"2023-10-08T06:10:37.371250+0000","last_clean":"2023-10-08T06:10:37.371250+0000","last_became_active":"2023-10-08T06:10:35.868469+0000","last_became_peered":"2023-10-08T06:10:35.868469+0000","last_unstale":"2023-10-08T06:10:37.371250+0000","last_undegraded":"2023-10-08T06:10:37.371250+0000","last_fullsized":"2023-10-08T06:10:37.371250+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_clean_scrub_stamp":"2023-10-08T06:10:34.831061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:41:45.977745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-08T06:10:36.870044+0000","last_change":"2023-10-08T06:10:34.862110+0000","last_active":"2023-10-08T06:10:36.870044+0000","last_peered":"2023-10-08T06:10:36.870044+0000","last_clean":"2023-10-08T06:10:36.870044+0000","last_became_active":"2023-10-08T06:10:34.861805+0000","last_became_peered":"2023-10-08T06:10:34.861805+0000","last_unstale":"2023-10-08T06:10:36.870044+0000","last_undegraded":"2023-10-08T06:10:36.870044+0000","last_fullsized":"2023-10-08T06:10:36.870044+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:10:33.827732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:10:33.827732+0000","last_clean_scrub_stamp":"2023-10-08T06:10:33.827732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:24:44.838383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-08T06:10:37.372556+0000","last_change":"2023-10-08T06:10:35.860934+0000","last_active":"2023-10-08T06:10:37.372556+0000","last_peered":"2023-10-08T06:10:37.372556+0000","last_clean":"2023-10-08T06:10:37.372556+0000","last_became_active":"2023-10-08T06:10:35.860567+0000","last_became_peered":"2023-10-08T06:10:35.860567+0000","last_unstale":"2023-10-08T06:10:37.372556+0000","last_undegraded":"2023-10-08T06:10:37.372556+0000","last_fullsized":"2023-10-08T06:10:37.372556+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_clean_scrub_stamp":"2023-10-08T06:10:34.831061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:58:27.184043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-08T06:10:37.371175+0000","last_change":"2023-10-08T06:10:34.856062+0000","last_active":"2023-10-08T06:10:37.371175+0000","last_peered":"2023-10-08T06:10:37.371175+0000","last_clean":"2023-10-08T06:10:37.371175+0000","last_became_active":"2023-10-08T06:10:34.855753+0000","last_became_peered":"2023-10-08T06:10:34.855753+0000","last_unstale":"2023-10-08T06:10:37.371175+0000","last_undegraded":"2023-10-08T06:10:37.371175+0000","last_fullsized":"2023-10-08T06:10:37.371175+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:10:33.827732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:10:33.827732+0000","last_clean_scrub_stamp":"2023-10-08T06:10:33.827732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:06:33.625691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-08T06:10:36.874908+0000","last_change":"2023-10-08T06:10:35.864203+0000","last_active":"2023-10-08T06:10:36.874908+0000","last_peered":"2023-10-08T06:10:36.874908+0000","last_clean":"2023-10-08T06:10:36.874908+0000","last_became_active":"2023-10-08T06:10:35.863887+0000","last_became_peered":"2023-10-08T06:10:35.863887+0000","last_unstale":"2023-10-08T06:10:36.874908+0000","last_undegraded":"2023-10-08T06:10:36.874908+0000","last_fullsized":"2023-10-08T06:10:36.874908+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_clean_scrub_stamp":"2023-10-08T06:10:34.831061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:36:31.790465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-08T06:10:36.871489+0000","last_change":"2023-10-08T06:10:34.862293+0000","last_active":"2023-10-08T06:10:36.871489+0000","last_peered":"2023-10-08T06:10:36.871489+0000","last_clean":"2023-10-08T06:10:36.871489+0000","last_became_active":"2023-10-08T06:10:34.861470+0000","last_became_peered":"2023-10-08T06:10:34.861470+0000","last_unstale":"2023-10-08T06:10:36.871489+0000","last_undegraded":"2023-10-08T06:10:36.871489+0000","last_fullsized":"2023-10-08T06:10:36.871489+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:10:33.827732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:10:33.827732+0000","last_clean_scrub_stamp":"2023-10-08T06:10:33.827732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:16:16.913845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-08T06:10:36.871507+0000","last_change":"2023-10-08T06:10:35.868197+0000","last_active":"2023-10-08T06:10:36.871507+0000","last_peered":"2023-10-08T06:10:36.871507+0000","last_clean":"2023-10-08T06:10:36.871507+0000","last_became_active":"2023-10-08T06:10:35.867889+0000","last_became_peered":"2023-10-08T06:10:35.867889+0000","last_unstale":"2023-10-08T06:10:36.871507+0000","last_undegraded":"2023-10-08T06:10:36.871507+0000","last_fullsized":"2023-10-08T06:10:36.871507+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_clean_scrub_stamp":"2023-10-08T06:10:34.831061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:22:01.124448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-08T06:10:37.374294+0000","last_change":"2023-10-08T06:10:34.865616+0000","last_active":"2023-10-08T06:10:37.374294+0000","last_peered":"2023-10-08T06:10:37.374294+0000","last_clean":"2023-10-08T06:10:37.374294+0000","last_became_active":"2023-10-08T06:10:34.865319+0000","last_became_peered":"2023-10-08T06:10:34.865319+0000","last_unstale":"2023-10-08T06:10:37.374294+0000","last_undegraded":"2023-10-08T06:10:37.374294+0000","last_fullsized":"2023-10-08T06:10:37.374294+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:10:33.827732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:10:33.827732+0000","last_clean_scrub_stamp":"2023-10-08T06:10:33.827732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:01:22.140451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-08T06:10:36.871004+0000","last_change":"2023-10-08T06:10:35.878302+0000","last_active":"2023-10-08T06:10:36.871004+0000","last_peered":"2023-10-08T06:10:36.871004+0000","last_clean":"2023-10-08T06:10:36.871004+0000","last_became_active":"2023-10-08T06:10:35.876855+0000","last_became_peered":"2023-10-08T06:10:35.876855+0000","last_unstale":"2023-10-08T06:10:36.871004+0000","last_undegraded":"2023-10-08T06:10:36.871004+0000","last_fullsized":"2023-10-08T06:10:36.871004+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_clean_scrub_stamp":"2023-10-08T06:10:34.831061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:36:38.416131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"34'3","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-08T06:10:36.874693+0000","last_change":"2023-10-08T06:10:34.860580+0000","last_active":"2023-10-08T06:10:36.874693+0000","last_peered":"2023-10-08T06:10:36.874693+0000","last_clean":"2023-10-08T06:10:36.874693+0000","last_became_active":"2023-10-08T06:10:34.860240+0000","last_became_peered":"2023-10-08T06:10:34.860240+0000","last_unstale":"2023-10-08T06:10:36.874693+0000","last_undegraded":"2023-10-08T06:10:36.874693+0000","last_fullsized":"2023-10-08T06:10:36.874693+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:10:33.827732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:10:33.827732+0000","last_clean_scrub_stamp":"2023-10-08T06:10:33.827732+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:41:55.063762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-08T06:10:36.874290+0000","last_change":"2023-10-08T06:10:35.861195+0000","last_active":"2023-10-08T06:10:36.874290+0000","last_peered":"2023-10-08T06:10:36.874290+0000","last_clean":"2023-10-08T06:10:36.874290+0000","last_became_active":"2023-10-08T06:10:35.860573+0000","last_became_peered":"2023-10-08T06:10:35.860573+0000","last_unstale":"2023-10-08T06:10:36.874290+0000","last_undegraded":"2023-10-08T06:10:36.874290+0000","last_fullsized":"2023-10-08T06:10:36.874290+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_clean_scrub_stamp":"2023-10-08T06:10:34.831061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:36:41.906523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"34'6","reported_seq":18,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-08T06:10:36.871100+0000","last_change":"2023-10-08T06:10:34.860068+0000","last_active":"2023-10-08T06:10:36.871100+0000","last_peered":"2023-10-08T06:10:36.871100+0000","last_clean":"2023-10-08T06:10:36.871100+0000","last_became_active":"2023-10-08T06:10:34.859771+0000","last_became_peered":"2023-10-08T06:10:34.859771+0000","last_unstale":"2023-10-08T06:10:36.871100+0000","last_undegraded":"2023-10-08T06:10:36.871100+0000","last_fullsized":"2023-10-08T06:10:36.871100+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:10:33.827732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:10:33.827732+0000","last_clean_scrub_stamp":"2023-10-08T06:10:33.827732+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:48:28.572880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-08T06:10:37.372649+0000","last_change":"2023-10-08T06:10:35.861836+0000","last_active":"2023-10-08T06:10:37.372649+0000","last_peered":"2023-10-08T06:10:37.372649+0000","last_clean":"2023-10-08T06:10:37.372649+0000","last_became_active":"2023-10-08T06:10:35.861435+0000","last_became_peered":"2023-10-08T06:10:35.861435+0000","last_unstale":"2023-10-08T06:10:37.372649+0000","last_undegraded":"2023-10-08T06:10:37.372649+0000","last_fullsized":"2023-10-08T06:10:37.372649+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_clean_scrub_stamp":"2023-10-08T06:10:34.831061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:41:56.067091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"34'2","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-08T06:10:37.372797+0000","last_change":"2023-10-08T06:10:34.857327+0000","last_active":"2023-10-08T06:10:37.372797+0000","last_peered":"2023-10-08T06:10:37.372797+0000","last_clean":"2023-10-08T06:10:37.372797+0000","last_became_active":"2023-10-08T06:10:34.857031+0000","last_became_peered":"2023-10-08T06:10:34.857031+0000","last_unstale":"2023-10-08T06:10:37.372797+0000","last_undegraded":"2023-10-08T06:10:37.372797+0000","last_fullsized":"2023-10-08T06:10:37.372797+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:10:33.827732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:10:33.827732+0000","last_clean_scrub_stamp":"2023-10-08T06:10:33.827732+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:40:29.692727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-08T06:10:36.870987+0000","last_change":"2023-10-08T06:10:35.869194+0000","last_active":"2023-10-08T06:10:36.870987+0000","last_peered":"2023-10-08T06:10:36.870987+0000","last_clean":"2023-10-08T06:10:36.870987+0000","last_became_active":"2023-10-08T06:10:35.868926+0000","last_became_peered":"2023-10-08T06:10:35.868926+0000","last_unstale":"2023-10-08T06:10:36.870987+0000","last_undegraded":"2023-10-08T06:10:36.870987+0000","last_fullsized":"2023-10-08T06:10:36.870987+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_clean_scrub_stamp":"2023-10-08T06:10:34.831061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:21:04.710213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-08T06:10:37.372873+0000","last_change":"2023-10-08T06:10:34.865502+0000","last_active":"2023-10-08T06:10:37.372873+0000","last_peered":"2023-10-08T06:10:37.372873+0000","last_clean":"2023-10-08T06:10:37.372873+0000","last_became_active":"2023-10-08T06:10:34.865208+0000","last_became_peered":"2023-10-08T06:10:34.865208+0000","last_unstale":"2023-10-08T06:10:37.372873+0000","last_undegraded":"2023-10-08T06:10:37.372873+0000","last_fullsized":"2023-10-08T06:10:37.372873+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:10:33.827732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:10:33.827732+0000","last_clean_scrub_stamp":"2023-10-08T06:10:33.827732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:11:44.986426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-08T06:10:36.871814+0000","last_change":"2023-10-08T06:10:35.868553+0000","last_active":"2023-10-08T06:10:36.871814+0000","last_peered":"2023-10-08T06:10:36.871814+0000","last_clean":"2023-10-08T06:10:36.871814+0000","last_became_active":"2023-10-08T06:10:35.868290+0000","last_became_peered":"2023-10-08T06:10:35.868290+0000","last_unstale":"2023-10-08T06:10:36.871814+0000","last_undegraded":"2023-10-08T06:10:36.871814+0000","last_fullsized":"2023-10-08T06:10:36.871814+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_clean_scrub_stamp":"2023-10-08T06:10:34.831061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:34:04.392768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-08T06:10:36.869817+0000","last_change":"2023-10-08T06:10:34.864309+0000","last_active":"2023-10-08T06:10:36.869817+0000","last_peered":"2023-10-08T06:10:36.869817+0000","last_clean":"2023-10-08T06:10:36.869817+0000","last_became_active":"2023-10-08T06:10:34.864143+0000","last_became_peered":"2023-10-08T06:10:34.864143+0000","last_unstale":"2023-10-08T06:10:36.869817+0000","last_undegraded":"2023-10-08T06:10:36.869817+0000","last_fullsized":"2023-10-08T06:10:36.869817+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:10:33.827732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:10:33.827732+0000","last_clean_scrub_stamp":"2023-10-08T06:10:33.827732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:51:06.669416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-08T06:10:37.370904+0000","last_change":"2023-10-08T06:10:35.871977+0000","last_active":"2023-10-08T06:10:37.370904+0000","last_peered":"2023-10-08T06:10:37.370904+0000","last_clean":"2023-10-08T06:10:37.370904+0000","last_became_active":"2023-10-08T06:10:35.870810+0000","last_became_peered":"2023-10-08T06:10:35.870810+0000","last_unstale":"2023-10-08T06:10:37.370904+0000","last_undegraded":"2023-10-08T06:10:37.370904+0000","last_fullsized":"2023-10-08T06:10:37.370904+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_clean_scrub_stamp":"2023-10-08T06:10:34.831061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:40:30.696056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"34'8","reported_seq":20,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-08T06:10:36.869973+0000","last_change":"2023-10-08T06:10:34.859346+0000","last_active":"2023-10-08T06:10:36.869973+0000","last_peered":"2023-10-08T06:10:36.869973+0000","last_clean":"2023-10-08T06:10:36.869973+0000","last_became_active":"2023-10-08T06:10:34.859032+0000","last_became_peered":"2023-10-08T06:10:34.859032+0000","last_unstale":"2023-10-08T06:10:36.869973+0000","last_undegraded":"2023-10-08T06:10:36.869973+0000","last_fullsized":"2023-10-08T06:10:36.869973+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:10:33.827732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:10:33.827732+0000","last_clean_scrub_stamp":"2023-10-08T06:10:33.827732+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:29:35.128653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-08T06:10:37.372906+0000","last_change":"2023-10-08T06:10:35.867317+0000","last_active":"2023-10-08T06:10:37.372906+0000","last_peered":"2023-10-08T06:10:37.372906+0000","last_clean":"2023-10-08T06:10:37.372906+0000","last_became_active":"2023-10-08T06:10:35.867019+0000","last_became_peered":"2023-10-08T06:10:35.867019+0000","last_unstale":"2023-10-08T06:10:37.372906+0000","last_undegraded":"2023-10-08T06:10:37.372906+0000","last_fullsized":"2023-10-08T06:10:37.372906+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_clean_scrub_stamp":"2023-10-08T06:10:34.831061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:34:04.392768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"34'1","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-08T06:10:37.373800+0000","last_change":"2023-10-08T06:10:34.868103+0000","last_active":"2023-10-08T06:10:37.373800+0000","last_peered":"2023-10-08T06:10:37.373800+0000","last_clean":"2023-10-08T06:10:37.373800+0000","last_became_active":"2023-10-08T06:10:34.867773+0000","last_became_peered":"2023-10-08T06:10:34.867773+0000","last_unstale":"2023-10-08T06:10:37.373800+0000","last_undegraded":"2023-10-08T06:10:37.373800+0000","last_fullsized":"2023-10-08T06:10:37.373800+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:10:33.827732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:10:33.827732+0000","last_clean_scrub_stamp":"2023-10-08T06:10:33.827732+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:31:12.741284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-08T06:10:36.875065+0000","last_change":"2023-10-08T06:10:35.861950+0000","last_active":"2023-10-08T06:10:36.875065+0000","last_peered":"2023-10-08T06:10:36.875065+0000","last_clean":"2023-10-08T06:10:36.875065+0000","last_became_active":"2023-10-08T06:10:35.861663+0000","last_became_peered":"2023-10-08T06:10:35.861663+0000","last_unstale":"2023-10-08T06:10:36.875065+0000","last_undegraded":"2023-10-08T06:10:36.875065+0000","last_fullsized":"2023-10-08T06:10:36.875065+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_clean_scrub_stamp":"2023-10-08T06:10:34.831061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:24:35.767005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"34'2","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-08T06:10:37.372864+0000","last_change":"2023-10-08T06:10:34.856113+0000","last_active":"2023-10-08T06:10:37.372864+0000","last_peered":"2023-10-08T06:10:37.372864+0000","last_clean":"2023-10-08T06:10:37.372864+0000","last_became_active":"2023-10-08T06:10:34.855829+0000","last_became_peered":"2023-10-08T06:10:34.855829+0000","last_unstale":"2023-10-08T06:10:37.372864+0000","last_undegraded":"2023-10-08T06:10:37.372864+0000","last_fullsized":"2023-10-08T06:10:37.372864+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:10:33.827732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:10:33.827732+0000","last_clean_scrub_stamp":"2023-10-08T06:10:33.827732+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:31:50.344322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-08T06:10:37.373242+0000","last_change":"2023-10-08T06:10:35.870034+0000","last_active":"2023-10-08T06:10:37.373242+0000","last_peered":"2023-10-08T06:10:37.373242+0000","last_clean":"2023-10-08T06:10:37.373242+0000","last_became_active":"2023-10-08T06:10:35.869742+0000","last_became_peered":"2023-10-08T06:10:35.869742+0000","last_unstale":"2023-10-08T06:10:37.373242+0000","last_undegraded":"2023-10-08T06:10:37.373242+0000","last_fullsized":"2023-10-08T06:10:37.373242+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_clean_scrub_stamp":"2023-10-08T06:10:34.831061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:13:19.900307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"34'1","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-08T06:10:37.372943+0000","last_change":"2023-10-08T06:10:34.858634+0000","last_active":"2023-10-08T06:10:37.372943+0000","last_peered":"2023-10-08T06:10:37.372943+0000","last_clean":"2023-10-08T06:10:37.372943+0000","last_became_active":"2023-10-08T06:10:34.858170+0000","last_became_peered":"2023-10-08T06:10:34.858170+0000","last_unstale":"2023-10-08T06:10:37.372943+0000","last_undegraded":"2023-10-08T06:10:37.372943+0000","last_fullsized":"2023-10-08T06:10:37.372943+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:10:33.827732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:10:33.827732+0000","last_clean_scrub_stamp":"2023-10-08T06:10:33.827732+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:01:22.140451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-08T06:10:37.374698+0000","last_change":"2023-10-08T06:10:35.864620+0000","last_active":"2023-10-08T06:10:37.374698+0000","last_peered":"2023-10-08T06:10:37.374698+0000","last_clean":"2023-10-08T06:10:37.374698+0000","last_became_active":"2023-10-08T06:10:35.864370+0000","last_became_peered":"2023-10-08T06:10:35.864370+0000","last_unstale":"2023-10-08T06:10:37.374698+0000","last_undegraded":"2023-10-08T06:10:37.374698+0000","last_fullsized":"2023-10-08T06:10:37.374698+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_clean_scrub_stamp":"2023-10-08T06:10:34.831061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:11:45.989754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-08T06:10:37.372580+0000","last_change":"2023-10-08T06:10:34.866913+0000","last_active":"2023-10-08T06:10:37.372580+0000","last_peered":"2023-10-08T06:10:37.372580+0000","last_clean":"2023-10-08T06:10:37.372580+0000","last_became_active":"2023-10-08T06:10:34.866649+0000","last_became_peered":"2023-10-08T06:10:34.866649+0000","last_unstale":"2023-10-08T06:10:37.372580+0000","last_undegraded":"2023-10-08T06:10:37.372580+0000","last_fullsized":"2023-10-08T06:10:37.372580+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:10:33.827732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:10:33.827732+0000","last_clean_scrub_stamp":"2023-10-08T06:10:33.827732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:06:14.750979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-08T06:10:37.372571+0000","last_change":"2023-10-08T06:10:35.869917+0000","last_active":"2023-10-08T06:10:37.372571+0000","last_peered":"2023-10-08T06:10:37.372571+0000","last_clean":"2023-10-08T06:10:37.372571+0000","last_became_active":"2023-10-08T06:10:35.869592+0000","last_became_peered":"2023-10-08T06:10:35.869592+0000","last_unstale":"2023-10-08T06:10:37.372571+0000","last_undegraded":"2023-10-08T06:10:37.372571+0000","last_fullsized":"2023-10-08T06:10:37.372571+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_clean_scrub_stamp":"2023-10-08T06:10:34.831061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:26:04.389284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"34'2","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-08T06:10:37.372976+0000","last_change":"2023-10-08T06:10:34.857621+0000","last_active":"2023-10-08T06:10:37.372976+0000","last_peered":"2023-10-08T06:10:37.372976+0000","last_clean":"2023-10-08T06:10:37.372976+0000","last_became_active":"2023-10-08T06:10:34.857337+0000","last_became_peered":"2023-10-08T06:10:34.857337+0000","last_unstale":"2023-10-08T06:10:37.372976+0000","last_undegraded":"2023-10-08T06:10:37.372976+0000","last_fullsized":"2023-10-08T06:10:37.372976+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:10:33.827732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:10:33.827732+0000","last_clean_scrub_stamp":"2023-10-08T06:10:33.827732+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:19:48.131519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-08T06:10:37.373310+0000","last_change":"2023-10-08T06:10:35.868054+0000","last_active":"2023-10-08T06:10:37.373310+0000","last_peered":"2023-10-08T06:10:37.373310+0000","last_clean":"2023-10-08T06:10:37.373310+0000","last_became_active":"2023-10-08T06:10:35.867764+0000","last_became_peered":"2023-10-08T06:10:35.867764+0000","last_unstale":"2023-10-08T06:10:37.373310+0000","last_undegraded":"2023-10-08T06:10:37.373310+0000","last_fullsized":"2023-10-08T06:10:37.373310+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_clean_scrub_stamp":"2023-10-08T06:10:34.831061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:39:40.990894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-08T06:10:37.371071+0000","last_change":"2023-10-08T06:10:34.864090+0000","last_active":"2023-10-08T06:10:37.371071+0000","last_peered":"2023-10-08T06:10:37.371071+0000","last_clean":"2023-10-08T06:10:37.371071+0000","last_became_active":"2023-10-08T06:10:34.863640+0000","last_became_peered":"2023-10-08T06:10:34.863640+0000","last_unstale":"2023-10-08T06:10:37.371071+0000","last_undegraded":"2023-10-08T06:10:37.371071+0000","last_fullsized":"2023-10-08T06:10:37.371071+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:10:33.827732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:10:33.827732+0000","last_clean_scrub_stamp":"2023-10-08T06:10:33.827732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:36:33.065264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-08T06:10:37.372241+0000","last_change":"2023-10-08T06:10:35.859654+0000","last_active":"2023-10-08T06:10:37.372241+0000","last_peered":"2023-10-08T06:10:37.372241+0000","last_clean":"2023-10-08T06:10:37.372241+0000","last_became_active":"2023-10-08T06:10:35.859378+0000","last_became_peered":"2023-10-08T06:10:35.859378+0000","last_unstale":"2023-10-08T06:10:37.372241+0000","last_undegraded":"2023-10-08T06:10:37.372241+0000","last_fullsized":"2023-10-08T06:10:37.372241+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_clean_scrub_stamp":"2023-10-08T06:10:34.831061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:39:55.219855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-08T06:10:37.372408+0000","last_change":"2023-10-08T06:10:34.851238+0000","last_active":"2023-10-08T06:10:37.372408+0000","last_peered":"2023-10-08T06:10:37.372408+0000","last_clean":"2023-10-08T06:10:37.372408+0000","last_became_active":"2023-10-08T06:10:34.850889+0000","last_became_peered":"2023-10-08T06:10:34.850889+0000","last_unstale":"2023-10-08T06:10:37.372408+0000","last_undegraded":"2023-10-08T06:10:37.372408+0000","last_fullsized":"2023-10-08T06:10:37.372408+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:10:33.827732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:10:33.827732+0000","last_clean_scrub_stamp":"2023-10-08T06:10:33.827732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:39:39.987565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-08T06:10:36.871920+0000","last_change":"2023-10-08T06:10:35.869652+0000","last_active":"2023-10-08T06:10:36.871920+0000","last_peered":"2023-10-08T06:10:36.871920+0000","last_clean":"2023-10-08T06:10:36.871920+0000","last_became_active":"2023-10-08T06:10:35.869329+0000","last_became_peered":"2023-10-08T06:10:35.869329+0000","last_unstale":"2023-10-08T06:10:36.871920+0000","last_undegraded":"2023-10-08T06:10:36.871920+0000","last_fullsized":"2023-10-08T06:10:36.871920+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_clean_scrub_stamp":"2023-10-08T06:10:34.831061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:13:19.900307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-08T06:10:36.873695+0000","last_change":"2023-10-08T06:10:34.863142+0000","last_active":"2023-10-08T06:10:36.873695+0000","last_peered":"2023-10-08T06:10:36.873695+0000","last_clean":"2023-10-08T06:10:36.873695+0000","last_became_active":"2023-10-08T06:10:34.862782+0000","last_became_peered":"2023-10-08T06:10:34.862782+0000","last_unstale":"2023-10-08T06:10:36.873695+0000","last_undegraded":"2023-10-08T06:10:36.873695+0000","last_fullsized":"2023-10-08T06:10:36.873695+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:10:33.827732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:10:33.827732+0000","last_clean_scrub_stamp":"2023-10-08T06:10:33.827732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:41:44.974417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-08T06:10:37.374743+0000","last_change":"2023-10-08T06:10:35.866431+0000","last_active":"2023-10-08T06:10:37.374743+0000","last_peered":"2023-10-08T06:10:37.374743+0000","last_clean":"2023-10-08T06:10:37.374743+0000","last_became_active":"2023-10-08T06:10:35.865979+0000","last_became_peered":"2023-10-08T06:10:35.865979+0000","last_unstale":"2023-10-08T06:10:37.374743+0000","last_undegraded":"2023-10-08T06:10:37.374743+0000","last_fullsized":"2023-10-08T06:10:37.374743+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_clean_scrub_stamp":"2023-10-08T06:10:34.831061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:26:34.835131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"34'2","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-08T06:10:37.376541+0000","last_change":"2023-10-08T06:10:34.866541+0000","last_active":"2023-10-08T06:10:37.376541+0000","last_peered":"2023-10-08T06:10:37.376541+0000","last_clean":"2023-10-08T06:10:37.376541+0000","last_became_active":"2023-10-08T06:10:34.866047+0000","last_became_peered":"2023-10-08T06:10:34.866047+0000","last_unstale":"2023-10-08T06:10:37.376541+0000","last_undegraded":"2023-10-08T06:10:37.376541+0000","last_fullsized":"2023-10-08T06:10:37.376541+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:10:33.827732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:10:33.827732+0000","last_clean_scrub_stamp":"2023-10-08T06:10:33.827732+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:46:57.429056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-08T06:10:36.875129+0000","last_change":"2023-10-08T06:10:35.860384+0000","last_active":"2023-10-08T06:10:36.875129+0000","last_peered":"2023-10-08T06:10:36.875129+0000","last_clean":"2023-10-08T06:10:36.875129+0000","last_became_active":"2023-10-08T06:10:35.860135+0000","last_became_peered":"2023-10-08T06:10:35.860135+0000","last_unstale":"2023-10-08T06:10:36.875129+0000","last_undegraded":"2023-10-08T06:10:36.875129+0000","last_fullsized":"2023-10-08T06:10:36.875129+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_clean_scrub_stamp":"2023-10-08T06:10:34.831061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:39:48.985828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-08T06:10:37.374277+0000","last_change":"2023-10-08T06:10:34.857480+0000","last_active":"2023-10-08T06:10:37.374277+0000","last_peered":"2023-10-08T06:10:37.374277+0000","last_clean":"2023-10-08T06:10:37.374277+0000","last_became_active":"2023-10-08T06:10:34.857172+0000","last_became_peered":"2023-10-08T06:10:34.857172+0000","last_unstale":"2023-10-08T06:10:37.374277+0000","last_undegraded":"2023-10-08T06:10:37.374277+0000","last_fullsized":"2023-10-08T06:10:37.374277+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:10:33.827732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:10:33.827732+0000","last_clean_scrub_stamp":"2023-10-08T06:10:33.827732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:31:50.344322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-08T06:10:37.373728+0000","last_change":"2023-10-08T06:10:35.857858+0000","last_active":"2023-10-08T06:10:37.373728+0000","last_peered":"2023-10-08T06:10:37.373728+0000","last_clean":"2023-10-08T06:10:37.373728+0000","last_became_active":"2023-10-08T06:10:35.857525+0000","last_became_peered":"2023-10-08T06:10:35.857525+0000","last_unstale":"2023-10-08T06:10:37.373728+0000","last_undegraded":"2023-10-08T06:10:37.373728+0000","last_fullsized":"2023-10-08T06:10:37.373728+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_clean_scrub_stamp":"2023-10-08T06:10:34.831061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:41:45.977745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-08T06:10:37.373608+0000","last_change":"2023-10-08T06:10:34.860340+0000","last_active":"2023-10-08T06:10:37.373608+0000","last_peered":"2023-10-08T06:10:37.373608+0000","last_clean":"2023-10-08T06:10:37.373608+0000","last_became_active":"2023-10-08T06:10:34.859736+0000","last_became_peered":"2023-10-08T06:10:34.859736+0000","last_unstale":"2023-10-08T06:10:37.373608+0000","last_undegraded":"2023-10-08T06:10:37.373608+0000","last_fullsized":"2023-10-08T06:10:37.373608+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:10:33.827732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:10:33.827732+0000","last_clean_scrub_stamp":"2023-10-08T06:10:33.827732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:01:22.140451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-08T06:10:37.370861+0000","last_change":"2023-10-08T06:10:35.861029+0000","last_active":"2023-10-08T06:10:37.370861+0000","last_peered":"2023-10-08T06:10:37.370861+0000","last_clean":"2023-10-08T06:10:37.370861+0000","last_became_active":"2023-10-08T06:10:35.860588+0000","last_became_peered":"2023-10-08T06:10:35.860588+0000","last_unstale":"2023-10-08T06:10:37.370861+0000","last_undegraded":"2023-10-08T06:10:37.370861+0000","last_fullsized":"2023-10-08T06:10:37.370861+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_clean_scrub_stamp":"2023-10-08T06:10:34.831061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:34:22.155924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-08T06:10:37.373168+0000","last_change":"2023-10-08T06:10:34.856093+0000","last_active":"2023-10-08T06:10:37.373168+0000","last_peered":"2023-10-08T06:10:37.373168+0000","last_clean":"2023-10-08T06:10:37.373168+0000","last_became_active":"2023-10-08T06:10:34.855698+0000","last_became_peered":"2023-10-08T06:10:34.855698+0000","last_unstale":"2023-10-08T06:10:37.373168+0000","last_undegraded":"2023-10-08T06:10:37.373168+0000","last_fullsized":"2023-10-08T06:10:37.373168+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:10:33.827732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:10:33.827732+0000","last_clean_scrub_stamp":"2023-10-08T06:10:33.827732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:36:33.065264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-08T06:10:37.372775+0000","last_change":"2023-10-08T06:10:35.861394+0000","last_active":"2023-10-08T06:10:37.372775+0000","last_peered":"2023-10-08T06:10:37.372775+0000","last_clean":"2023-10-08T06:10:37.372775+0000","last_became_active":"2023-10-08T06:10:35.861103+0000","last_became_peered":"2023-10-08T06:10:35.861103+0000","last_unstale":"2023-10-08T06:10:37.372775+0000","last_undegraded":"2023-10-08T06:10:37.372775+0000","last_fullsized":"2023-10-08T06:10:37.372775+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_clean_scrub_stamp":"2023-10-08T06:10:34.831061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:40:30.696056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-08T06:10:37.372880+0000","last_change":"2023-10-08T06:10:34.866512+0000","last_active":"2023-10-08T06:10:37.372880+0000","last_peered":"2023-10-08T06:10:37.372880+0000","last_clean":"2023-10-08T06:10:37.372880+0000","last_became_active":"2023-10-08T06:10:34.866018+0000","last_became_peered":"2023-10-08T06:10:34.866018+0000","last_unstale":"2023-10-08T06:10:37.372880+0000","last_undegraded":"2023-10-08T06:10:37.372880+0000","last_fullsized":"2023-10-08T06:10:37.372880+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:10:33.827732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:10:33.827732+0000","last_clean_scrub_stamp":"2023-10-08T06:10:33.827732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:36:33.065264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-08T06:10:36.869890+0000","last_change":"2023-10-08T06:10:35.863353+0000","last_active":"2023-10-08T06:10:36.869890+0000","last_peered":"2023-10-08T06:10:36.869890+0000","last_clean":"2023-10-08T06:10:36.869890+0000","last_became_active":"2023-10-08T06:10:35.863086+0000","last_became_peered":"2023-10-08T06:10:35.863086+0000","last_unstale":"2023-10-08T06:10:36.869890+0000","last_undegraded":"2023-10-08T06:10:36.869890+0000","last_fullsized":"2023-10-08T06:10:36.869890+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_clean_scrub_stamp":"2023-10-08T06:10:34.831061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:48:06.056312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-08T06:10:37.371736+0000","last_change":"2023-10-08T06:10:34.856492+0000","last_active":"2023-10-08T06:10:37.371736+0000","last_peered":"2023-10-08T06:10:37.371736+0000","last_clean":"2023-10-08T06:10:37.371736+0000","last_became_active":"2023-10-08T06:10:34.856178+0000","last_became_peered":"2023-10-08T06:10:34.856178+0000","last_unstale":"2023-10-08T06:10:37.371736+0000","last_undegraded":"2023-10-08T06:10:37.371736+0000","last_fullsized":"2023-10-08T06:10:37.371736+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:10:33.827732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:10:33.827732+0000","last_clean_scrub_stamp":"2023-10-08T06:10:33.827732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:26:33.831803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-08T06:10:37.371512+0000","last_change":"2023-10-08T06:10:35.862111+0000","last_active":"2023-10-08T06:10:37.371512+0000","last_peered":"2023-10-08T06:10:37.371512+0000","last_clean":"2023-10-08T06:10:37.371512+0000","last_became_active":"2023-10-08T06:10:35.861801+0000","last_became_peered":"2023-10-08T06:10:35.861801+0000","last_unstale":"2023-10-08T06:10:37.371512+0000","last_undegraded":"2023-10-08T06:10:37.371512+0000","last_fullsized":"2023-10-08T06:10:37.371512+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_clean_scrub_stamp":"2023-10-08T06:10:34.831061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:31:13.744612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-08T06:10:36.869831+0000","last_change":"2023-10-08T06:10:34.864099+0000","last_active":"2023-10-08T06:10:36.869831+0000","last_peered":"2023-10-08T06:10:36.869831+0000","last_clean":"2023-10-08T06:10:36.869831+0000","last_became_active":"2023-10-08T06:10:34.863775+0000","last_became_peered":"2023-10-08T06:10:34.863775+0000","last_unstale":"2023-10-08T06:10:36.869831+0000","last_undegraded":"2023-10-08T06:10:36.869831+0000","last_fullsized":"2023-10-08T06:10:36.869831+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:10:33.827732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:10:33.827732+0000","last_clean_scrub_stamp":"2023-10-08T06:10:33.827732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:29:56.275726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-08T06:10:36.872927+0000","last_change":"2023-10-08T06:10:35.865971+0000","last_active":"2023-10-08T06:10:36.872927+0000","last_peered":"2023-10-08T06:10:36.872927+0000","last_clean":"2023-10-08T06:10:36.872927+0000","last_became_active":"2023-10-08T06:10:35.865643+0000","last_became_peered":"2023-10-08T06:10:35.865643+0000","last_unstale":"2023-10-08T06:10:36.872927+0000","last_undegraded":"2023-10-08T06:10:36.872927+0000","last_fullsized":"2023-10-08T06:10:36.872927+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_clean_scrub_stamp":"2023-10-08T06:10:34.831061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:19:11.190979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-08T06:10:37.371465+0000","last_change":"2023-10-08T06:10:34.857459+0000","last_active":"2023-10-08T06:10:37.371465+0000","last_peered":"2023-10-08T06:10:37.371465+0000","last_clean":"2023-10-08T06:10:37.371465+0000","last_became_active":"2023-10-08T06:10:34.857161+0000","last_became_peered":"2023-10-08T06:10:34.857161+0000","last_unstale":"2023-10-08T06:10:37.371465+0000","last_undegraded":"2023-10-08T06:10:37.371465+0000","last_fullsized":"2023-10-08T06:10:37.371465+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:10:33.827732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:10:33.827732+0000","last_clean_scrub_stamp":"2023-10-08T06:10:33.827732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:11:44.986426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":176,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-08T06:10:35.857217+0000","last_change":"2023-10-08T06:09:24.811692+0000","last_active":"2023-10-08T06:10:35.857217+0000","last_peered":"2023-10-08T06:10:35.857217+0000","last_clean":"2023-10-08T06:10:35.857217+0000","last_became_active":"2023-10-08T06:09:24.809788+0000","last_became_peered":"2023-10-08T06:09:24.809788+0000","last_unstale":"2023-10-08T06:10:35.857217+0000","last_undegraded":"2023-10-08T06:10:35.857217+0000","last_fullsized":"2023-10-08T06:10:35.857217+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:23.748736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:23.748736+0000","last_clean_scrub_stamp":"2023-10-08T06:09:23.748736+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:39:45.599458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509458,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27984,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343856,"statfs":{"total":96636764160,"available":96608108544,"internally_reserved":0,"allocated":987136,"data_stored":742728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 06:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.173,"5min":1.173,"15min":1.173},"last":0.877},{"interface":"front","average":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.389,"5min":1.389,"15min":1.389},"last":1.036}]},{"osd":1,"last update":"Sun Oct 8 06:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.4530000000000001,"5min":1.4530000000000001,"15min":1.4530000000000001},"last":0.72899999999999998},{"interface":"front","average":{"1min":1.091,"5min":1.091,"15min":1.091},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":2.3820000000000001,"5min":2.3820000000000001,"15min":2.3820000000000001},"last":0.98399999999999999}]},{"osd":2,"last update":"Sun Oct 8 06:10:25 2023","interfaces":[{"interface":"back","average":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.925,"5min":1.925,"15min":1.925},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.6930000000000001,"5min":1.6930000000000001,"15min":1.6930000000000001},"last":1.0089999999999999}]},{"osd":3,"last update":"Sun Oct 8 06:10:25 2023","interfaces":[{"interface":"back","average":{"1min":1.04,"5min":1.04,"15min":1.04},"min":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.8049999999999999,"5min":1.8049999999999999,"15min":1.8049999999999999},"last":1.1579999999999999},{"interface":"front","average":{"1min":1.101,"5min":1.101,"15min":1.101},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.746,"5min":1.746,"15min":1.746},"last":0.91600000000000004}]},{"osd":4,"last update":"Sun Oct 8 06:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.3,"5min":1.3,"15min":1.3},"last":0.94799999999999995},{"interface":"front","average":{"1min":1.222,"5min":1.222,"15min":1.222},"min":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"max":{"1min":1.6499999999999999,"5min":1.6499999999999999,"15min":1.6499999999999999},"last":1.0609999999999999}]},{"osd":5,"last update":"Sun Oct 8 06:10:25 2023","interfaces":[{"interface":"back","average":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"min":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":1.5940000000000001,"5min":1.5940000000000001,"15min":1.5940000000000001},"last":0.79000000000000004},{"interface":"front","average":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"min":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"max":{"1min":1.952,"5min":1.952,"15min":1.952},"last":0.82899999999999996}]},{"osd":6,"last update":"Sun Oct 8 06:10:25 2023","interfaces":[{"interface":"back","average":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"min":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"max":{"1min":1.851,"5min":1.851,"15min":1.851},"last":1.1100000000000001},{"interface":"front","average":{"1min":1.3089999999999999,"5min":1.3089999999999999,"15min":1.3089999999999999},"min":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"max":{"1min":1.9830000000000001,"5min":1.9830000000000001,"15min":1.9830000000000001},"last":1.2410000000000001}]}]},{"osd":6,"up_from":15,"seq":64424509459,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":397312,"data_stored":152886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 06:10:22 2023","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.5660000000000001,"5min":1.5660000000000001,"15min":1.5660000000000001},"last":0.54800000000000004},{"interface":"front","average":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.7370000000000001,"5min":1.7370000000000001,"15min":1.7370000000000001},"last":0.57399999999999995}]},{"osd":1,"last update":"Sun Oct 8 06:10:22 2023","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":2.1019999999999999},{"interface":"front","average":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.7090000000000001,"5min":1.7090000000000001,"15min":1.7090000000000001},"last":0.71399999999999997}]},{"osd":2,"last update":"Sun Oct 8 06:10:22 2023","interfaces":[{"interface":"back","average":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.365,"5min":1.365,"15min":1.365},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.268,"5min":1.268,"15min":1.268},"last":0.51700000000000002}]},{"osd":3,"last update":"Sun Oct 8 06:10:22 2023","interfaces":[{"interface":"back","average":{"1min":1.008,"5min":1.008,"15min":1.008},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.5089999999999999,"5min":1.5089999999999999,"15min":1.5089999999999999},"last":0.61699999999999999},{"interface":"front","average":{"1min":1.018,"5min":1.018,"15min":1.018},"min":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":1.4530000000000001,"5min":1.4530000000000001,"15min":1.4530000000000001},"last":2.1379999999999999}]},{"osd":4,"last update":"Sun Oct 8 06:10:22 2023","interfaces":[{"interface":"back","average":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"min":{"1min":0.748,"5min":0.748,"15min":0.748},"max":{"1min":1.411,"5min":1.411,"15min":1.411},"last":0.67800000000000005},{"interface":"front","average":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"min":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"max":{"1min":1.79,"5min":1.79,"15min":1.79},"last":1.0589999999999999}]},{"osd":5,"last update":"Sun Oct 8 06:10:22 2023","interfaces":[{"interface":"back","average":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"min":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":2.25,"5min":2.25,"15min":2.25},"last":2.0600000000000001},{"interface":"front","average":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"min":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"max":{"1min":2.5950000000000002,"5min":2.5950000000000002,"15min":2.5950000000000002},"last":0.379}]},{"osd":7,"last update":"Sun Oct 8 06:10:22 2023","interfaces":[{"interface":"back","average":{"1min":1.204,"5min":1.204,"15min":1.204},"min":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"max":{"1min":1.6739999999999999,"5min":1.6739999999999999,"15min":1.6739999999999999},"last":1.673},{"interface":"front","average":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"min":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"max":{"1min":1.6299999999999999,"5min":1.6299999999999999,"15min":1.6299999999999999},"last":1.966}]}]},{"osd":5,"up_from":15,"seq":64424509458,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":397312,"data_stored":152942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 06:10:26 2023","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.871,"15min":0.871},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.27,"5min":1.27,"15min":1.27},"last":1.7030000000000001},{"interface":"front","average":{"1min":0.88,"5min":0.88,"15min":0.88},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.375,"5min":1.375,"15min":1.375},"last":1.2909999999999999}]},{"osd":1,"last update":"Sun Oct 8 06:10:26 2023","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.4370000000000001,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":1.6100000000000001},{"interface":"front","average":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.8660000000000001,"5min":1.8660000000000001,"15min":1.8660000000000001},"last":0.997}]},{"osd":2,"last update":"Sun Oct 8 06:10:26 2023","interfaces":[{"interface":"back","average":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.536,"5min":1.536,"15min":1.536},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"min":{"1min":0.626,"5min":0.626,"15min":0.626},"max":{"1min":1.633,"5min":1.633,"15min":1.633},"last":0.93300000000000005}]},{"osd":3,"last update":"Sun Oct 8 06:10:26 2023","interfaces":[{"interface":"back","average":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.7689999999999999,"5min":1.7689999999999999,"15min":1.7689999999999999},"last":1.2010000000000001},{"interface":"front","average":{"1min":1.018,"5min":1.018,"15min":1.018},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.355,"5min":1.355,"15min":1.355},"last":1.2450000000000001}]},{"osd":4,"last update":"Sun Oct 8 06:10:26 2023","interfaces":[{"interface":"back","average":{"1min":1.036,"5min":1.036,"15min":1.036},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.4330000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":1.379},{"interface":"front","average":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":2.056,"5min":2.056,"15min":2.056},"last":1.5389999999999999}]},{"osd":6,"last update":"Sun Oct 8 06:10:26 2023","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"min":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"max":{"1min":1.216,"5min":1.216,"15min":1.216},"last":1.1020000000000001},{"interface":"front","average":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"min":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"max":{"1min":1.827,"5min":1.827,"15min":1.827},"last":1.147}]},{"osd":7,"last update":"Sun Oct 8 06:10:26 2023","interfaces":[{"interface":"back","average":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"min":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":1.9490000000000001,"5min":1.9490000000000001,"15min":1.9490000000000001},"last":1.6579999999999999},{"interface":"front","average":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"min":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.696,"5min":1.696,"15min":1.696},"last":1.175}]}]},{"osd":4,"up_from":15,"seq":64424509458,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":397312,"data_stored":152374,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 06:10:27 2023","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.365,"5min":1.365,"15min":1.365},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.452,"5min":1.452,"15min":1.452},"last":1.121}]},{"osd":1,"last update":"Sun Oct 8 06:10:27 2023","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.87,"15min":0.87},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.282,"5min":1.282,"15min":1.282},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.413,"5min":1.413,"15min":1.413},"last":1.2150000000000001}]},{"osd":2,"last update":"Sun Oct 8 06:10:27 2023","interfaces":[{"interface":"back","average":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"min":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"max":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":1.175},{"interface":"front","average":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.5549999999999999,"5min":1.5549999999999999,"15min":1.5549999999999999},"last":0.99299999999999999}]},{"osd":3,"last update":"Sun Oct 8 06:10:27 2023","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"min":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.181,"5min":1.181,"15min":1.181},"last":1.262},{"interface":"front","average":{"1min":1.069,"5min":1.069,"15min":1.069},"min":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"max":{"1min":1.2509999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":0.94199999999999995}]},{"osd":5,"last update":"Sun Oct 8 06:10:27 2023","interfaces":[{"interface":"back","average":{"1min":1.022,"5min":1.022,"15min":1.022},"min":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"max":{"1min":1.502,"5min":1.502,"15min":1.502},"last":1.298},{"interface":"front","average":{"1min":1.042,"5min":1.042,"15min":1.042},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.5900000000000001,"5min":1.5900000000000001,"15min":1.5900000000000001},"last":1.4430000000000001}]},{"osd":6,"last update":"Sun Oct 8 06:10:27 2023","interfaces":[{"interface":"back","average":{"1min":1.109,"5min":1.109,"15min":1.109},"min":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":1.5900000000000001,"5min":1.5900000000000001,"15min":1.5900000000000001},"last":1.0660000000000001},{"interface":"front","average":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"min":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"max":{"1min":1.5940000000000001,"5min":1.5940000000000001,"15min":1.5940000000000001},"last":1.403}]},{"osd":7,"last update":"Sun Oct 8 06:10:27 2023","interfaces":[{"interface":"back","average":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"min":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.5549999999999999,"5min":1.5549999999999999,"15min":1.5549999999999999},"last":1.3620000000000001},{"interface":"front","average":{"1min":1.28,"5min":1.28,"15min":1.28},"min":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"max":{"1min":2.1280000000000001,"5min":2.1280000000000001,"15min":2.1280000000000001},"last":1.323}]}]},{"osd":2,"up_from":15,"seq":64424509458,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31568,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340272,"statfs":{"total":96636764160,"available":96604438528,"internally_reserved":0,"allocated":393216,"data_stored":152340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 06:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.2509999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.9019999999999999,"5min":1.9019999999999999,"15min":1.9019999999999999},"last":0.55100000000000005}]},{"osd":1,"last update":"Sun Oct 8 06:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.87,"15min":0.87},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.76,"5min":1.76,"15min":1.76},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.628}]},{"osd":3,"last update":"Sun Oct 8 06:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.621,"5min":1.621,"15min":1.621},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":2.3929999999999998,"5min":2.3929999999999998,"15min":2.3929999999999998},"last":0.76300000000000001}]},{"osd":4,"last update":"Sun Oct 8 06:10:25 2023","interfaces":[{"interface":"back","average":{"1min":1.125,"5min":1.125,"15min":1.125},"min":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":2.3010000000000002,"5min":2.3010000000000002,"15min":2.3010000000000002},"last":0.94999999999999996},{"interface":"front","average":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"min":{"1min":0.875,"5min":0.875,"15min":0.875},"max":{"1min":1.6439999999999999,"5min":1.6439999999999999,"15min":1.6439999999999999},"last":1.1919999999999999}]},{"osd":5,"last update":"Sun Oct 8 06:10:25 2023","interfaces":[{"interface":"back","average":{"1min":1.133,"5min":1.133,"15min":1.133},"min":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"max":{"1min":1.726,"5min":1.726,"15min":1.726},"last":0.98899999999999999},{"interface":"front","average":{"1min":1.252,"5min":1.252,"15min":1.252},"min":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"max":{"1min":2.0249999999999999,"5min":2.0249999999999999,"15min":2.0249999999999999},"last":1.1619999999999999}]},{"osd":6,"last update":"Sun Oct 8 06:10:25 2023","interfaces":[{"interface":"back","average":{"1min":1.2889999999999999,"5min":1.2889999999999999,"15min":1.2889999999999999},"min":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"max":{"1min":2.3170000000000002,"5min":2.3170000000000002,"15min":2.3170000000000002},"last":1.0669999999999999},{"interface":"front","average":{"1min":1.143,"5min":1.143,"15min":1.143},"min":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"max":{"1min":2.2069999999999999,"5min":2.2069999999999999,"15min":2.2069999999999999},"last":0.88100000000000001}]},{"osd":7,"last update":"Sun Oct 8 06:10:25 2023","interfaces":[{"interface":"back","average":{"1min":1.171,"5min":1.171,"15min":1.171},"min":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"max":{"1min":1.53,"5min":1.53,"15min":1.53},"last":1.0229999999999999},{"interface":"front","average":{"1min":1.361,"5min":1.361,"15min":1.361},"min":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"max":{"1min":2.379,"5min":2.379,"15min":2.379},"last":1.2330000000000001}]}]},{"osd":1,"up_from":15,"seq":64424509457,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31580,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340260,"statfs":{"total":96636764160,"available":96604426240,"internally_reserved":0,"allocated":405504,"data_stored":153904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 06:10:23 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":1.266,"5min":1.266,"15min":1.266},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":1.157}]},{"osd":2,"last update":"Sun Oct 8 06:10:23 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":2.028,"5min":2.028,"15min":2.028},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":1.0289999999999999}]},{"osd":3,"last update":"Sun Oct 8 06:10:23 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":0.93799999999999994},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":2.0600000000000001,"5min":2.0600000000000001,"15min":2.0600000000000001},"last":0.86899999999999999}]},{"osd":4,"last update":"Sun Oct 8 06:10:23 2023","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"min":{"1min":0.628,"5min":0.628,"15min":0.628},"max":{"1min":1.74,"5min":1.74,"15min":1.74},"last":1.133},{"interface":"front","average":{"1min":0.999,"5min":0.999,"15min":0.999},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.3400000000000001,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":1.2749999999999999}]},{"osd":5,"last update":"Sun Oct 8 06:10:23 2023","interfaces":[{"interface":"back","average":{"1min":1.079,"5min":1.079,"15min":1.079},"min":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.887,"5min":1.887,"15min":1.887},"last":0.998},{"interface":"front","average":{"1min":1.052,"5min":1.052,"15min":1.052},"min":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":1.835,"5min":1.835,"15min":1.835},"last":1.212}]},{"osd":6,"last update":"Sun Oct 8 06:10:23 2023","interfaces":[{"interface":"back","average":{"1min":1.1479999999999999,"5min":1.1479999999999999,"15min":1.1479999999999999},"min":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":1.986,"5min":1.986,"15min":1.986},"last":1.2390000000000001},{"interface":"front","average":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"min":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.9410000000000001,"5min":1.9410000000000001,"15min":1.9410000000000001},"last":1.3160000000000001}]},{"osd":7,"last update":"Sun Oct 8 06:10:23 2023","interfaces":[{"interface":"back","average":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"min":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"max":{"1min":1.3939999999999999,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":1.6419999999999999},{"interface":"front","average":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"min":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":2.1699999999999999,"5min":2.1699999999999999,"15min":2.1699999999999999},"last":1.109}]}]},{"osd":0,"up_from":15,"seq":64424509458,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32140,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339700,"statfs":{"total":96636764160,"available":96603852800,"internally_reserved":0,"allocated":983040,"data_stored":742638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 06:10:27 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.83499999999999996}]},{"osd":2,"last update":"Sun Oct 8 06:10:27 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.143,"5min":1.143,"15min":1.143},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.212,"5min":1.212,"15min":1.212},"last":0.71399999999999997}]},{"osd":3,"last update":"Sun Oct 8 06:10:27 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.575,"5min":1.575,"15min":1.575},"last":1.0960000000000001}]},{"osd":4,"last update":"Sun Oct 8 06:10:27 2023","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"min":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.4259999999999999,"5min":1.4259999999999999,"15min":1.4259999999999999},"last":0.79400000000000004},{"interface":"front","average":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"min":{"1min":0.754,"5min":0.754,"15min":0.754},"max":{"1min":1.8069999999999999,"5min":1.8069999999999999,"15min":1.8069999999999999},"last":1.248}]},{"osd":5,"last update":"Sun Oct 8 06:10:27 2023","interfaces":[{"interface":"back","average":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"min":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"max":{"1min":1.363,"5min":1.363,"15min":1.363},"last":0.93000000000000005},{"interface":"front","average":{"1min":1.018,"5min":1.018,"15min":1.018},"min":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.3959999999999999,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":1.036}]},{"osd":6,"last update":"Sun Oct 8 06:10:27 2023","interfaces":[{"interface":"back","average":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"min":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.7030000000000001,"5min":1.7030000000000001,"15min":1.7030000000000001},"last":1.5489999999999999},{"interface":"front","average":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"min":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"max":{"1min":1.458,"5min":1.458,"15min":1.458},"last":1.006}]},{"osd":7,"last update":"Sun Oct 8 06:10:27 2023","interfaces":[{"interface":"back","average":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.637,"5min":1.637,"15min":1.637},"last":1.0680000000000001},{"interface":"front","average":{"1min":1.105,"5min":1.105,"15min":1.105},"min":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.5149999999999999,"5min":1.5149999999999999,"15min":1.5149999999999999},"last":1.143}]}]},{"osd":3,"up_from":14,"seq":60129542161,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31580,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340260,"statfs":{"total":96636764160,"available":96604426240,"internally_reserved":0,"allocated":405504,"data_stored":153904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 06:10:24 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.754}]},{"osd":1,"last update":"Sun Oct 8 06:10:24 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.98699999999999999},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":1.0249999999999999}]},{"osd":2,"last update":"Sun Oct 8 06:10:24 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":1.323,"5min":1.323,"15min":1.323},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.5660000000000001,"5min":1.5660000000000001,"15min":1.5660000000000001},"last":1.1799999999999999}]},{"osd":4,"last update":"Sun Oct 8 06:10:24 2023","interfaces":[{"interface":"back","average":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"min":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.899,"5min":1.899,"15min":1.899},"last":0.95199999999999996},{"interface":"front","average":{"1min":1.099,"5min":1.099,"15min":1.099},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":2.0950000000000002,"5min":2.0950000000000002,"15min":2.0950000000000002},"last":1.212}]},{"osd":5,"last update":"Sun Oct 8 06:10:24 2023","interfaces":[{"interface":"back","average":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.8129999999999999,"5min":1.8129999999999999,"15min":1.8129999999999999},"last":1.125},{"interface":"front","average":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"min":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":1.857,"5min":1.857,"15min":1.857},"last":1.579}]},{"osd":6,"last update":"Sun Oct 8 06:10:24 2023","interfaces":[{"interface":"back","average":{"1min":1.097,"5min":1.097,"15min":1.097},"min":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.6910000000000001,"5min":1.6910000000000001,"15min":1.6910000000000001},"last":1.6439999999999999},{"interface":"front","average":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"min":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":2.0459999999999998,"5min":2.0459999999999998,"15min":2.0459999999999998},"last":1.1599999999999999}]},{"osd":7,"last update":"Sun Oct 8 06:10:24 2023","interfaces":[{"interface":"back","average":{"1min":1.071,"5min":1.071,"15min":1.071},"min":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":1.7609999999999999,"5min":1.7609999999999999,"15min":1.7609999999999999},"last":1.2629999999999999},{"interface":"front","average":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.99,"5min":1.99,"15min":1.99},"last":1.357}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T06:10:39.916 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T06:10:40.030 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.027+0000 7f8b2f203700 1 Processor -- start 2023-10-08T06:10:40.031 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.027+0000 7f8b2f203700 1 -- start start 2023-10-08T06:10:40.034 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.027+0000 7f8b2f203700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f8b280c21a0 0x7f8b2806c690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:40.034 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.027+0000 7f8b2f203700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f8b281652b0 0x7f8b280cb7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:40.034 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.027+0000 7f8b2f203700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8b28165740 0x7f8b280cbd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:40.034 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.027+0000 7f8b2f203700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b281662c0 con 0x7f8b280c21a0 2023-10-08T06:10:40.034 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.027+0000 7f8b2f203700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b2806c200 con 0x7f8b281652b0 2023-10-08T06:10:40.035 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.027+0000 7f8b2f203700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b28165d00 con 0x7f8b28165740 2023-10-08T06:10:40.035 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.027+0000 7f8b2e201700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f8b280c21a0 0x7f8b2806c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:40.035 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.027+0000 7f8b2e201700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f8b280c21a0 0x7f8b2806c690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:34016/0 (socket says 172.21.15.32:34016) 2023-10-08T06:10:40.035 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.027+0000 7f8b2e201700 1 -- 172.21.15.32:0/70756787 learned_addr learned my addr 172.21.15.32:0/70756787 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:10:40.035 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.031+0000 7f8b2ea02700 1 --2- 172.21.15.32:0/70756787 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8b28165740 0x7f8b280cbd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:40.035 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.031+0000 7f8b2da00700 1 --2- 172.21.15.32:0/70756787 >> v2:172.21.15.40:3300/0 conn(0x7f8b281652b0 0x7f8b280cb7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:40.035 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.031+0000 7f8b2ea02700 1 -- 172.21.15.32:0/70756787 >> v2:172.21.15.40:3300/0 conn(0x7f8b281652b0 msgr2=0x7f8b280cb7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:10:40.036 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.031+0000 7f8b2ea02700 1 --2- 172.21.15.32:0/70756787 >> v2:172.21.15.40:3300/0 conn(0x7f8b281652b0 0x7f8b280cb7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:40.036 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.031+0000 7f8b2ea02700 1 -- 172.21.15.32:0/70756787 >> v2:172.21.15.32:3300/0 conn(0x7f8b280c21a0 msgr2=0x7f8b2806c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:10:40.036 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.031+0000 7f8b2ea02700 1 --2- 172.21.15.32:0/70756787 >> v2:172.21.15.32:3300/0 conn(0x7f8b280c21a0 0x7f8b2806c690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:40.036 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.031+0000 7f8b2ea02700 1 -- 172.21.15.32:0/70756787 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b28165fe0 con 0x7f8b28165740 2023-10-08T06:10:40.036 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.031+0000 7f8b2e201700 1 --2- 172.21.15.32:0/70756787 >> v2:172.21.15.32:3300/0 conn(0x7f8b280c21a0 0x7f8b2806c690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T06:10:40.036 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.031+0000 7f8b2ea02700 1 --2- 172.21.15.32:0/70756787 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8b28165740 0x7f8b280cbd20 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f8b280ced80 tx=0x7f8b18009b30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=93bfc545d78030 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:40.037 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.031+0000 7f8b2d1ff700 1 -- 172.21.15.32:0/70756787 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b18011830 con 0x7f8b28165740 2023-10-08T06:10:40.037 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.031+0000 7f8b2d1ff700 1 -- 172.21.15.32:0/70756787 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b18011990 con 0x7f8b28165740 2023-10-08T06:10:40.037 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.031+0000 7f8b2d1ff700 1 -- 172.21.15.32:0/70756787 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b18011d20 con 0x7f8b28165740 2023-10-08T06:10:40.037 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.031+0000 7f8b2f203700 1 -- 172.21.15.32:0/70756787 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8b28165740 msgr2=0x7f8b280cbd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:40.037 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.031+0000 7f8b2f203700 1 --2- 172.21.15.32:0/70756787 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8b28165740 0x7f8b280cbd20 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f8b280ced80 tx=0x7f8b18009b30 comp rx=0 tx=0).stop 2023-10-08T06:10:40.037 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.031+0000 7f8b2f203700 1 -- 172.21.15.32:0/70756787 shutdown_connections 2023-10-08T06:10:40.037 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.031+0000 7f8b2f203700 1 --2- 172.21.15.32:0/70756787 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8b28165740 0x7f8b280cbd20 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:40.038 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.031+0000 7f8b2f203700 1 --2- 172.21.15.32:0/70756787 >> v2:172.21.15.40:3300/0 conn(0x7f8b281652b0 0x7f8b280cb7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:40.038 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.031+0000 7f8b2f203700 1 --2- 172.21.15.32:0/70756787 >> v2:172.21.15.32:3300/0 conn(0x7f8b280c21a0 0x7f8b2806c690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:40.038 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.031+0000 7f8b2f203700 1 -- 172.21.15.32:0/70756787 >> 172.21.15.32:0/70756787 conn(0x7f8b280b0900 msgr2=0x7f8b280b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:10:40.038 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.031+0000 7f8b2f203700 1 -- 172.21.15.32:0/70756787 shutdown_connections 2023-10-08T06:10:40.038 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.031+0000 7f8b2f203700 1 -- 172.21.15.32:0/70756787 wait complete. 2023-10-08T06:10:40.040 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.035+0000 7f8b2f203700 1 Processor -- start 2023-10-08T06:10:40.040 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.035+0000 7f8b2f203700 1 -- start start 2023-10-08T06:10:40.041 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.035+0000 7f8b2f203700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8b280c21a0 0x7f8b280b2c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:40.041 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.035+0000 7f8b2f203700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8b281652b0 0x7f8b28155c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:40.041 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.035+0000 7f8b2f203700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8b28165740 0x7f8b2806fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:40.041 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.035+0000 7f8b2f203700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b281f6e20 con 0x7f8b281652b0 2023-10-08T06:10:40.041 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.035+0000 7f8b2f203700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b280c2a90 con 0x7f8b280c21a0 2023-10-08T06:10:40.041 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.035+0000 7f8b2f203700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b280b3150 con 0x7f8b28165740 2023-10-08T06:10:40.042 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.035+0000 7f8b2da00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8b281652b0 0x7f8b28155c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:40.042 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.035+0000 7f8b2e201700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8b280c21a0 0x7f8b280b2c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:40.042 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.035+0000 7f8b2da00700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8b281652b0 0x7f8b28155c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:34022/0 (socket says 172.21.15.32:34022) 2023-10-08T06:10:40.042 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.035+0000 7f8b2ea02700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8b28165740 0x7f8b2806fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:40.042 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.035+0000 7f8b2e201700 1 --2- 172.21.15.32:0/606808263 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8b280c21a0 0x7f8b280b2c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.32:36562/0 (socket says 172.21.15.32:36562) 2023-10-08T06:10:40.042 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.035+0000 7f8b2da00700 1 -- 172.21.15.32:0/606808263 learned_addr learned my addr 172.21.15.32:0/606808263 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:10:40.042 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.035+0000 7f8b2ea02700 1 -- 172.21.15.32:0/606808263 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8b280c21a0 msgr2=0x7f8b280b2c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:40.043 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.035+0000 7f8b2ea02700 1 --2- 172.21.15.32:0/606808263 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8b280c21a0 0x7f8b280b2c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:40.043 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.035+0000 7f8b2ea02700 1 -- 172.21.15.32:0/606808263 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8b281652b0 msgr2=0x7f8b28155c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:40.043 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.035+0000 7f8b2ea02700 1 --2- 172.21.15.32:0/606808263 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8b281652b0 0x7f8b28155c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:40.043 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.035+0000 7f8b2ea02700 1 -- 172.21.15.32:0/606808263 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b20009b30 con 0x7f8b28165740 2023-10-08T06:10:40.043 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.035+0000 7f8b2ea02700 1 --2- 172.21.15.32:0/606808263 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8b28165740 0x7f8b2806fb20 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f8b18016000 tx=0x7f8b18004770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:40.043 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.035+0000 7f8b26ffd700 1 -- 172.21.15.32:0/606808263 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b18004450 con 0x7f8b28165740 2023-10-08T06:10:40.043 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.035+0000 7f8b26ffd700 1 -- 172.21.15.32:0/606808263 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b1801e070 con 0x7f8b28165740 2023-10-08T06:10:40.044 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.035+0000 7f8b2f203700 1 -- 172.21.15.32:0/606808263 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b180094b0 con 0x7f8b28165740 2023-10-08T06:10:40.044 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.035+0000 7f8b26ffd700 1 -- 172.21.15.32:0/606808263 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b18003900 con 0x7f8b28165740 2023-10-08T06:10:40.044 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.035+0000 7f8b2f203700 1 -- 172.21.15.32:0/606808263 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b280c2ce0 con 0x7f8b28165740 2023-10-08T06:10:40.044 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.039+0000 7f8b2f203700 1 -- 172.21.15.32:0/606808263 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b28067cd0 con 0x7f8b28165740 2023-10-08T06:10:40.045 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.039+0000 7f8b26ffd700 1 -- 172.21.15.32:0/606808263 <== mon.2 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f8b18003a60 con 0x7f8b28165740 2023-10-08T06:10:40.045 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.039+0000 7f8b26ffd700 1 --2- 172.21.15.32:0/606808263 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f8b14066510 0x7f8b140689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:40.045 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.039+0000 7f8b26ffd700 1 -- 172.21.15.32:0/606808263 <== mon.2 v2:172.21.15.40:3301/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8b18084d00 con 0x7f8b28165740 2023-10-08T06:10:40.045 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.039+0000 7f8b2e201700 1 --2- 172.21.15.32:0/606808263 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f8b14066510 0x7f8b140689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:40.046 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.043+0000 7f8b2e201700 1 --2- 172.21.15.32:0/606808263 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f8b14066510 0x7f8b140689d0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f8b200072c0 tx=0x7f8b2000d040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:40.050 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.047+0000 7f8b26ffd700 1 -- 172.21.15.32:0/606808263 <== mon.2 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f8b180521f0 con 0x7f8b28165740 2023-10-08T06:10:40.213 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.211+0000 7f8b2f203700 1 -- 172.21.15.32:0/606808263 --> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8b2806cbd0 con 0x7f8b14066510 2023-10-08T06:10:40.230 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.227+0000 7f8b26ffd700 1 -- 172.21.15.32:0/606808263 <== mgr.4107 v2:172.21.15.32:6832/2601628338 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286971 (secure 0 0 0) 0x7f8b20011d50 con 0x7f8b14066510 2023-10-08T06:10:40.235 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:10:40.238 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.231+0000 7f8b2f203700 1 -- 172.21.15.32:0/606808263 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f8b14066510 msgr2=0x7f8b140689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:40.238 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.231+0000 7f8b2f203700 1 --2- 172.21.15.32:0/606808263 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f8b14066510 0x7f8b140689d0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f8b200072c0 tx=0x7f8b2000d040 comp rx=0 tx=0).stop 2023-10-08T06:10:40.238 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.231+0000 7f8b2f203700 1 -- 172.21.15.32:0/606808263 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8b28165740 msgr2=0x7f8b2806fb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:40.238 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.231+0000 7f8b2f203700 1 --2- 172.21.15.32:0/606808263 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8b28165740 0x7f8b2806fb20 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f8b18016000 tx=0x7f8b18004770 comp rx=0 tx=0).stop 2023-10-08T06:10:40.238 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.231+0000 7f8b2f203700 1 -- 172.21.15.32:0/606808263 shutdown_connections 2023-10-08T06:10:40.238 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.231+0000 7f8b2f203700 1 --2- 172.21.15.32:0/606808263 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f8b14066510 0x7f8b140689d0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:40.239 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.231+0000 7f8b2f203700 1 --2- 172.21.15.32:0/606808263 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8b281652b0 0x7f8b28155c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:40.239 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.231+0000 7f8b2f203700 1 --2- 172.21.15.32:0/606808263 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8b28165740 0x7f8b2806fb20 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:40.239 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.231+0000 7f8b2f203700 1 --2- 172.21.15.32:0/606808263 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8b280c21a0 0x7f8b280b2c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:40.239 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.231+0000 7f8b2f203700 1 -- 172.21.15.32:0/606808263 >> 172.21.15.32:0/606808263 conn(0x7f8b280b0900 msgr2=0x7f8b280c93b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:10:40.239 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.231+0000 7f8b2f203700 1 -- 172.21.15.32:0/606808263 shutdown_connections 2023-10-08T06:10:40.239 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.231+0000 7f8b2f203700 1 -- 172.21.15.32:0/606808263 wait complete. 2023-10-08T06:10:40.239 INFO:teuthology.orchestra.run.smithi032.stderr:dumped all 2023-10-08T06:10:40.251 INFO:teuthology.orchestra.run.smithi032.stdout:{"pg_ready":true,"pg_map":{"version":67,"stamp":"2023-10-08T06:10:39.269727+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":135,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":237076,"kb_used_data":4264,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754737644,"statfs":{"total":773094113280,"available":772851347456,"internally_reserved":0,"allocated":4366336,"data_stored":2403716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":238276153},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.436915"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-08T06:10:37.371927+0000","last_change":"2023-10-08T06:10:35.863215+0000","last_active":"2023-10-08T06:10:37.371927+0000","last_peered":"2023-10-08T06:10:37.371927+0000","last_clean":"2023-10-08T06:10:37.371927+0000","last_became_active":"2023-10-08T06:10:35.862909+0000","last_became_peered":"2023-10-08T06:10:35.862909+0000","last_unstale":"2023-10-08T06:10:37.371927+0000","last_undegraded":"2023-10-08T06:10:37.371927+0000","last_fullsized":"2023-10-08T06:10:37.371927+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_clean_scrub_stamp":"2023-10-08T06:10:34.831061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:41:45.977745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-08T06:10:36.871569+0000","last_change":"2023-10-08T06:10:35.867329+0000","last_active":"2023-10-08T06:10:36.871569+0000","last_peered":"2023-10-08T06:10:36.871569+0000","last_clean":"2023-10-08T06:10:36.871569+0000","last_became_active":"2023-10-08T06:10:35.867071+0000","last_became_peered":"2023-10-08T06:10:35.867071+0000","last_unstale":"2023-10-08T06:10:36.871569+0000","last_undegraded":"2023-10-08T06:10:36.871569+0000","last_fullsized":"2023-10-08T06:10:36.871569+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_clean_scrub_stamp":"2023-10-08T06:10:34.831061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:00:52.862023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-08T06:10:36.874527+0000","last_change":"2023-10-08T06:10:35.860936+0000","last_active":"2023-10-08T06:10:36.874527+0000","last_peered":"2023-10-08T06:10:36.874527+0000","last_clean":"2023-10-08T06:10:36.874527+0000","last_became_active":"2023-10-08T06:10:35.860104+0000","last_became_peered":"2023-10-08T06:10:35.860104+0000","last_unstale":"2023-10-08T06:10:36.874527+0000","last_undegraded":"2023-10-08T06:10:36.874527+0000","last_fullsized":"2023-10-08T06:10:36.874527+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_clean_scrub_stamp":"2023-10-08T06:10:34.831061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:04:26.488430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-08T06:10:37.372945+0000","last_change":"2023-10-08T06:10:35.870363+0000","last_active":"2023-10-08T06:10:37.372945+0000","last_peered":"2023-10-08T06:10:37.372945+0000","last_clean":"2023-10-08T06:10:37.372945+0000","last_became_active":"2023-10-08T06:10:35.870008+0000","last_became_peered":"2023-10-08T06:10:35.870008+0000","last_unstale":"2023-10-08T06:10:37.372945+0000","last_undegraded":"2023-10-08T06:10:37.372945+0000","last_fullsized":"2023-10-08T06:10:37.372945+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_clean_scrub_stamp":"2023-10-08T06:10:34.831061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:34:04.392768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-08T06:10:37.372737+0000","last_change":"2023-10-08T06:10:35.863975+0000","last_active":"2023-10-08T06:10:37.372737+0000","last_peered":"2023-10-08T06:10:37.372737+0000","last_clean":"2023-10-08T06:10:37.372737+0000","last_became_active":"2023-10-08T06:10:35.863694+0000","last_became_peered":"2023-10-08T06:10:35.863694+0000","last_unstale":"2023-10-08T06:10:37.372737+0000","last_undegraded":"2023-10-08T06:10:37.372737+0000","last_fullsized":"2023-10-08T06:10:37.372737+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_clean_scrub_stamp":"2023-10-08T06:10:34.831061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:12:14.014454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-08T06:10:36.870166+0000","last_change":"2023-10-08T06:10:35.869351+0000","last_active":"2023-10-08T06:10:36.870166+0000","last_peered":"2023-10-08T06:10:36.870166+0000","last_clean":"2023-10-08T06:10:36.870166+0000","last_became_active":"2023-10-08T06:10:35.869069+0000","last_became_peered":"2023-10-08T06:10:35.869069+0000","last_unstale":"2023-10-08T06:10:36.870166+0000","last_undegraded":"2023-10-08T06:10:36.870166+0000","last_fullsized":"2023-10-08T06:10:36.870166+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_clean_scrub_stamp":"2023-10-08T06:10:34.831061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:26:44.371328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-08T06:10:36.872497+0000","last_change":"2023-10-08T06:10:35.865368+0000","last_active":"2023-10-08T06:10:36.872497+0000","last_peered":"2023-10-08T06:10:36.872497+0000","last_clean":"2023-10-08T06:10:36.872497+0000","last_became_active":"2023-10-08T06:10:35.865060+0000","last_became_peered":"2023-10-08T06:10:35.865060+0000","last_unstale":"2023-10-08T06:10:36.872497+0000","last_undegraded":"2023-10-08T06:10:36.872497+0000","last_fullsized":"2023-10-08T06:10:36.872497+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_clean_scrub_stamp":"2023-10-08T06:10:34.831061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:22:49.613418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-08T06:10:36.871541+0000","last_change":"2023-10-08T06:10:35.865248+0000","last_active":"2023-10-08T06:10:36.871541+0000","last_peered":"2023-10-08T06:10:36.871541+0000","last_clean":"2023-10-08T06:10:36.871541+0000","last_became_active":"2023-10-08T06:10:35.864941+0000","last_became_peered":"2023-10-08T06:10:35.864941+0000","last_unstale":"2023-10-08T06:10:36.871541+0000","last_undegraded":"2023-10-08T06:10:36.871541+0000","last_fullsized":"2023-10-08T06:10:36.871541+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_clean_scrub_stamp":"2023-10-08T06:10:34.831061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:58:27.184043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-08T06:10:37.373064+0000","last_change":"2023-10-08T06:10:35.862297+0000","last_active":"2023-10-08T06:10:37.373064+0000","last_peered":"2023-10-08T06:10:37.373064+0000","last_clean":"2023-10-08T06:10:37.373064+0000","last_became_active":"2023-10-08T06:10:35.861956+0000","last_became_peered":"2023-10-08T06:10:35.861956+0000","last_unstale":"2023-10-08T06:10:37.373064+0000","last_undegraded":"2023-10-08T06:10:37.373064+0000","last_fullsized":"2023-10-08T06:10:37.373064+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_clean_scrub_stamp":"2023-10-08T06:10:34.831061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:13:19.900307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-08T06:10:37.374678+0000","last_change":"2023-10-08T06:10:35.866832+0000","last_active":"2023-10-08T06:10:37.374678+0000","last_peered":"2023-10-08T06:10:37.374678+0000","last_clean":"2023-10-08T06:10:37.374678+0000","last_became_active":"2023-10-08T06:10:35.866128+0000","last_became_peered":"2023-10-08T06:10:35.866128+0000","last_unstale":"2023-10-08T06:10:37.374678+0000","last_undegraded":"2023-10-08T06:10:37.374678+0000","last_fullsized":"2023-10-08T06:10:37.374678+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_clean_scrub_stamp":"2023-10-08T06:10:34.831061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:36:41.906523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-08T06:10:36.873226+0000","last_change":"2023-10-08T06:10:35.872268+0000","last_active":"2023-10-08T06:10:36.873226+0000","last_peered":"2023-10-08T06:10:36.873226+0000","last_clean":"2023-10-08T06:10:36.873226+0000","last_became_active":"2023-10-08T06:10:35.872019+0000","last_became_peered":"2023-10-08T06:10:35.872019+0000","last_unstale":"2023-10-08T06:10:36.873226+0000","last_undegraded":"2023-10-08T06:10:36.873226+0000","last_fullsized":"2023-10-08T06:10:36.873226+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_clean_scrub_stamp":"2023-10-08T06:10:34.831061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:10:28.597054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-08T06:10:36.874626+0000","last_change":"2023-10-08T06:10:35.862999+0000","last_active":"2023-10-08T06:10:36.874626+0000","last_peered":"2023-10-08T06:10:36.874626+0000","last_clean":"2023-10-08T06:10:36.874626+0000","last_became_active":"2023-10-08T06:10:35.862526+0000","last_became_peered":"2023-10-08T06:10:35.862526+0000","last_unstale":"2023-10-08T06:10:36.874626+0000","last_undegraded":"2023-10-08T06:10:36.874626+0000","last_fullsized":"2023-10-08T06:10:36.874626+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_clean_scrub_stamp":"2023-10-08T06:10:34.831061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:19:11.190979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-08T06:10:37.373053+0000","last_change":"2023-10-08T06:10:35.858353+0000","last_active":"2023-10-08T06:10:37.373053+0000","last_peered":"2023-10-08T06:10:37.373053+0000","last_clean":"2023-10-08T06:10:37.373053+0000","last_became_active":"2023-10-08T06:10:35.858054+0000","last_became_peered":"2023-10-08T06:10:35.858054+0000","last_unstale":"2023-10-08T06:10:37.373053+0000","last_undegraded":"2023-10-08T06:10:37.373053+0000","last_fullsized":"2023-10-08T06:10:37.373053+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_clean_scrub_stamp":"2023-10-08T06:10:34.831061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:40:02.981787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-08T06:10:36.870510+0000","last_change":"2023-10-08T06:10:35.866081+0000","last_active":"2023-10-08T06:10:36.870510+0000","last_peered":"2023-10-08T06:10:36.870510+0000","last_clean":"2023-10-08T06:10:36.870510+0000","last_became_active":"2023-10-08T06:10:35.865651+0000","last_became_peered":"2023-10-08T06:10:35.865651+0000","last_unstale":"2023-10-08T06:10:36.870510+0000","last_undegraded":"2023-10-08T06:10:36.870510+0000","last_fullsized":"2023-10-08T06:10:36.870510+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_clean_scrub_stamp":"2023-10-08T06:10:34.831061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:43:12.760308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-08T06:10:36.874154+0000","last_change":"2023-10-08T06:10:35.859419+0000","last_active":"2023-10-08T06:10:36.874154+0000","last_peered":"2023-10-08T06:10:36.874154+0000","last_clean":"2023-10-08T06:10:36.874154+0000","last_became_active":"2023-10-08T06:10:35.859088+0000","last_became_peered":"2023-10-08T06:10:35.859088+0000","last_unstale":"2023-10-08T06:10:36.874154+0000","last_undegraded":"2023-10-08T06:10:36.874154+0000","last_fullsized":"2023-10-08T06:10:36.874154+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_clean_scrub_stamp":"2023-10-08T06:10:34.831061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:38:29.387527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-08T06:10:36.872063+0000","last_change":"2023-10-08T06:10:35.871098+0000","last_active":"2023-10-08T06:10:36.872063+0000","last_peered":"2023-10-08T06:10:36.872063+0000","last_clean":"2023-10-08T06:10:36.872063+0000","last_became_active":"2023-10-08T06:10:35.870657+0000","last_became_peered":"2023-10-08T06:10:35.870657+0000","last_unstale":"2023-10-08T06:10:36.872063+0000","last_undegraded":"2023-10-08T06:10:36.872063+0000","last_fullsized":"2023-10-08T06:10:36.872063+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_clean_scrub_stamp":"2023-10-08T06:10:34.831061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:38:29.387527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-08T06:10:36.874126+0000","last_change":"2023-10-08T06:10:35.868016+0000","last_active":"2023-10-08T06:10:36.874126+0000","last_peered":"2023-10-08T06:10:36.874126+0000","last_clean":"2023-10-08T06:10:36.874126+0000","last_became_active":"2023-10-08T06:10:35.867675+0000","last_became_peered":"2023-10-08T06:10:35.867675+0000","last_unstale":"2023-10-08T06:10:36.874126+0000","last_undegraded":"2023-10-08T06:10:36.874126+0000","last_fullsized":"2023-10-08T06:10:36.874126+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_clean_scrub_stamp":"2023-10-08T06:10:34.831061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:36:31.790465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-08T06:10:36.871614+0000","last_change":"2023-10-08T06:10:35.868383+0000","last_active":"2023-10-08T06:10:36.871614+0000","last_peered":"2023-10-08T06:10:36.871614+0000","last_clean":"2023-10-08T06:10:36.871614+0000","last_became_active":"2023-10-08T06:10:35.868085+0000","last_became_peered":"2023-10-08T06:10:35.868085+0000","last_unstale":"2023-10-08T06:10:36.871614+0000","last_undegraded":"2023-10-08T06:10:36.871614+0000","last_fullsized":"2023-10-08T06:10:36.871614+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_clean_scrub_stamp":"2023-10-08T06:10:34.831061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:20:02.778242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-08T06:10:36.871224+0000","last_change":"2023-10-08T06:10:35.866889+0000","last_active":"2023-10-08T06:10:36.871224+0000","last_peered":"2023-10-08T06:10:36.871224+0000","last_clean":"2023-10-08T06:10:36.871224+0000","last_became_active":"2023-10-08T06:10:35.866595+0000","last_became_peered":"2023-10-08T06:10:35.866595+0000","last_unstale":"2023-10-08T06:10:36.871224+0000","last_undegraded":"2023-10-08T06:10:36.871224+0000","last_fullsized":"2023-10-08T06:10:36.871224+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_clean_scrub_stamp":"2023-10-08T06:10:34.831061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:51:38.349833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-08T06:10:37.373733+0000","last_change":"2023-10-08T06:10:35.865812+0000","last_active":"2023-10-08T06:10:37.373733+0000","last_peered":"2023-10-08T06:10:37.373733+0000","last_clean":"2023-10-08T06:10:37.373733+0000","last_became_active":"2023-10-08T06:10:35.865524+0000","last_became_peered":"2023-10-08T06:10:35.865524+0000","last_unstale":"2023-10-08T06:10:37.373733+0000","last_undegraded":"2023-10-08T06:10:37.373733+0000","last_fullsized":"2023-10-08T06:10:37.373733+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_clean_scrub_stamp":"2023-10-08T06:10:34.831061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:06:34.629019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-08T06:10:37.372177+0000","last_change":"2023-10-08T06:10:35.863887+0000","last_active":"2023-10-08T06:10:37.372177+0000","last_peered":"2023-10-08T06:10:37.372177+0000","last_clean":"2023-10-08T06:10:37.372177+0000","last_became_active":"2023-10-08T06:10:35.863564+0000","last_became_peered":"2023-10-08T06:10:35.863564+0000","last_unstale":"2023-10-08T06:10:37.372177+0000","last_undegraded":"2023-10-08T06:10:37.372177+0000","last_fullsized":"2023-10-08T06:10:37.372177+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_clean_scrub_stamp":"2023-10-08T06:10:34.831061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:39:08.224167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-08T06:10:37.371818+0000","last_change":"2023-10-08T06:10:35.863972+0000","last_active":"2023-10-08T06:10:37.371818+0000","last_peered":"2023-10-08T06:10:37.371818+0000","last_clean":"2023-10-08T06:10:37.371818+0000","last_became_active":"2023-10-08T06:10:35.863638+0000","last_became_peered":"2023-10-08T06:10:35.863638+0000","last_unstale":"2023-10-08T06:10:37.371818+0000","last_undegraded":"2023-10-08T06:10:37.371818+0000","last_fullsized":"2023-10-08T06:10:37.371818+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_clean_scrub_stamp":"2023-10-08T06:10:34.831061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:46:58.432384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-08T06:10:37.372683+0000","last_change":"2023-10-08T06:10:35.859870+0000","last_active":"2023-10-08T06:10:37.372683+0000","last_peered":"2023-10-08T06:10:37.372683+0000","last_clean":"2023-10-08T06:10:37.372683+0000","last_became_active":"2023-10-08T06:10:35.859523+0000","last_became_peered":"2023-10-08T06:10:35.859523+0000","last_unstale":"2023-10-08T06:10:37.372683+0000","last_undegraded":"2023-10-08T06:10:37.372683+0000","last_fullsized":"2023-10-08T06:10:37.372683+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_clean_scrub_stamp":"2023-10-08T06:10:34.831061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:34:22.155924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-08T06:10:36.873696+0000","last_change":"2023-10-08T06:10:35.855095+0000","last_active":"2023-10-08T06:10:36.873696+0000","last_peered":"2023-10-08T06:10:36.873696+0000","last_clean":"2023-10-08T06:10:36.873696+0000","last_became_active":"2023-10-08T06:10:35.854794+0000","last_became_peered":"2023-10-08T06:10:35.854794+0000","last_unstale":"2023-10-08T06:10:36.873696+0000","last_undegraded":"2023-10-08T06:10:36.873696+0000","last_fullsized":"2023-10-08T06:10:36.873696+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_clean_scrub_stamp":"2023-10-08T06:10:34.831061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:13:19.900307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-08T06:10:37.373346+0000","last_change":"2023-10-08T06:10:35.864375+0000","last_active":"2023-10-08T06:10:37.373346+0000","last_peered":"2023-10-08T06:10:37.373346+0000","last_clean":"2023-10-08T06:10:37.373346+0000","last_became_active":"2023-10-08T06:10:35.863796+0000","last_became_peered":"2023-10-08T06:10:35.863796+0000","last_unstale":"2023-10-08T06:10:37.373346+0000","last_undegraded":"2023-10-08T06:10:37.373346+0000","last_fullsized":"2023-10-08T06:10:37.373346+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_clean_scrub_stamp":"2023-10-08T06:10:34.831061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:38:29.387527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-08T06:10:36.871759+0000","last_change":"2023-10-08T06:10:35.876158+0000","last_active":"2023-10-08T06:10:36.871759+0000","last_peered":"2023-10-08T06:10:36.871759+0000","last_clean":"2023-10-08T06:10:36.871759+0000","last_became_active":"2023-10-08T06:10:35.875816+0000","last_became_peered":"2023-10-08T06:10:35.875816+0000","last_unstale":"2023-10-08T06:10:36.871759+0000","last_undegraded":"2023-10-08T06:10:36.871759+0000","last_fullsized":"2023-10-08T06:10:36.871759+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_clean_scrub_stamp":"2023-10-08T06:10:34.831061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:40:53.836462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-08T06:10:37.374605+0000","last_change":"2023-10-08T06:10:35.865805+0000","last_active":"2023-10-08T06:10:37.374605+0000","last_peered":"2023-10-08T06:10:37.374605+0000","last_clean":"2023-10-08T06:10:37.374605+0000","last_became_active":"2023-10-08T06:10:35.865361+0000","last_became_peered":"2023-10-08T06:10:35.865361+0000","last_unstale":"2023-10-08T06:10:37.374605+0000","last_undegraded":"2023-10-08T06:10:37.374605+0000","last_fullsized":"2023-10-08T06:10:37.374605+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_clean_scrub_stamp":"2023-10-08T06:10:34.831061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:22:49.613418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-08T06:10:36.874866+0000","last_change":"2023-10-08T06:10:35.854632+0000","last_active":"2023-10-08T06:10:36.874866+0000","last_peered":"2023-10-08T06:10:36.874866+0000","last_clean":"2023-10-08T06:10:36.874866+0000","last_became_active":"2023-10-08T06:10:35.853237+0000","last_became_peered":"2023-10-08T06:10:35.853237+0000","last_unstale":"2023-10-08T06:10:36.874866+0000","last_undegraded":"2023-10-08T06:10:36.874866+0000","last_fullsized":"2023-10-08T06:10:36.874866+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_clean_scrub_stamp":"2023-10-08T06:10:34.831061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:10:28.597054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-08T06:10:37.372550+0000","last_change":"2023-10-08T06:10:35.864775+0000","last_active":"2023-10-08T06:10:37.372550+0000","last_peered":"2023-10-08T06:10:37.372550+0000","last_clean":"2023-10-08T06:10:37.372550+0000","last_became_active":"2023-10-08T06:10:35.863696+0000","last_became_peered":"2023-10-08T06:10:35.863696+0000","last_unstale":"2023-10-08T06:10:37.372550+0000","last_undegraded":"2023-10-08T06:10:37.372550+0000","last_fullsized":"2023-10-08T06:10:37.372550+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_clean_scrub_stamp":"2023-10-08T06:10:34.831061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:41:56.067091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-08T06:10:36.872565+0000","last_change":"2023-10-08T06:10:35.867902+0000","last_active":"2023-10-08T06:10:36.872565+0000","last_peered":"2023-10-08T06:10:36.872565+0000","last_clean":"2023-10-08T06:10:36.872565+0000","last_became_active":"2023-10-08T06:10:35.867581+0000","last_became_peered":"2023-10-08T06:10:35.867581+0000","last_unstale":"2023-10-08T06:10:36.872565+0000","last_undegraded":"2023-10-08T06:10:36.872565+0000","last_fullsized":"2023-10-08T06:10:36.872565+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_clean_scrub_stamp":"2023-10-08T06:10:34.831061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:36:41.906523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-08T06:10:37.370858+0000","last_change":"2023-10-08T06:10:35.858608+0000","last_active":"2023-10-08T06:10:37.370858+0000","last_peered":"2023-10-08T06:10:37.370858+0000","last_clean":"2023-10-08T06:10:37.370858+0000","last_became_active":"2023-10-08T06:10:35.858324+0000","last_became_peered":"2023-10-08T06:10:35.858324+0000","last_unstale":"2023-10-08T06:10:37.370858+0000","last_undegraded":"2023-10-08T06:10:37.370858+0000","last_fullsized":"2023-10-08T06:10:37.370858+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_clean_scrub_stamp":"2023-10-08T06:10:34.831061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:01:23.143779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-08T06:10:36.871641+0000","last_change":"2023-10-08T06:10:35.870914+0000","last_active":"2023-10-08T06:10:36.871641+0000","last_peered":"2023-10-08T06:10:36.871641+0000","last_clean":"2023-10-08T06:10:36.871641+0000","last_became_active":"2023-10-08T06:10:35.870305+0000","last_became_peered":"2023-10-08T06:10:35.870305+0000","last_unstale":"2023-10-08T06:10:36.871641+0000","last_undegraded":"2023-10-08T06:10:36.871641+0000","last_fullsized":"2023-10-08T06:10:36.871641+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_clean_scrub_stamp":"2023-10-08T06:10:34.831061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:41:56.067091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-08T06:10:37.374083+0000","last_change":"2023-10-08T06:10:35.863770+0000","last_active":"2023-10-08T06:10:37.374083+0000","last_peered":"2023-10-08T06:10:37.374083+0000","last_clean":"2023-10-08T06:10:37.374083+0000","last_became_active":"2023-10-08T06:10:35.863472+0000","last_became_peered":"2023-10-08T06:10:35.863472+0000","last_unstale":"2023-10-08T06:10:37.374083+0000","last_undegraded":"2023-10-08T06:10:37.374083+0000","last_fullsized":"2023-10-08T06:10:37.374083+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_clean_scrub_stamp":"2023-10-08T06:10:34.831061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:31:13.744612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"34'4","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-08T06:10:37.372154+0000","last_change":"2023-10-08T06:10:34.861884+0000","last_active":"2023-10-08T06:10:37.372154+0000","last_peered":"2023-10-08T06:10:37.372154+0000","last_clean":"2023-10-08T06:10:37.372154+0000","last_became_active":"2023-10-08T06:10:34.861630+0000","last_became_peered":"2023-10-08T06:10:34.861630+0000","last_unstale":"2023-10-08T06:10:37.372154+0000","last_undegraded":"2023-10-08T06:10:37.372154+0000","last_fullsized":"2023-10-08T06:10:37.372154+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:10:33.827732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:10:33.827732+0000","last_clean_scrub_stamp":"2023-10-08T06:10:33.827732+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:06:14.750979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-08T06:10:37.372032+0000","last_change":"2023-10-08T06:10:35.869022+0000","last_active":"2023-10-08T06:10:37.372032+0000","last_peered":"2023-10-08T06:10:37.372032+0000","last_clean":"2023-10-08T06:10:37.372032+0000","last_became_active":"2023-10-08T06:10:35.868735+0000","last_became_peered":"2023-10-08T06:10:35.868735+0000","last_unstale":"2023-10-08T06:10:37.372032+0000","last_undegraded":"2023-10-08T06:10:37.372032+0000","last_fullsized":"2023-10-08T06:10:37.372032+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_clean_scrub_stamp":"2023-10-08T06:10:34.831061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:31:13.744612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"34'1","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-08T06:10:37.374166+0000","last_change":"2023-10-08T06:10:34.861500+0000","last_active":"2023-10-08T06:10:37.374166+0000","last_peered":"2023-10-08T06:10:37.374166+0000","last_clean":"2023-10-08T06:10:37.374166+0000","last_became_active":"2023-10-08T06:10:34.861207+0000","last_became_peered":"2023-10-08T06:10:34.861207+0000","last_unstale":"2023-10-08T06:10:37.374166+0000","last_undegraded":"2023-10-08T06:10:37.374166+0000","last_fullsized":"2023-10-08T06:10:37.374166+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:10:33.827732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:10:33.827732+0000","last_clean_scrub_stamp":"2023-10-08T06:10:33.827732+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:06:14.750979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-08T06:10:37.372515+0000","last_change":"2023-10-08T06:10:35.870817+0000","last_active":"2023-10-08T06:10:37.372515+0000","last_peered":"2023-10-08T06:10:37.372515+0000","last_clean":"2023-10-08T06:10:37.372515+0000","last_became_active":"2023-10-08T06:10:35.870552+0000","last_became_peered":"2023-10-08T06:10:35.870552+0000","last_unstale":"2023-10-08T06:10:37.372515+0000","last_undegraded":"2023-10-08T06:10:37.372515+0000","last_fullsized":"2023-10-08T06:10:37.372515+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_clean_scrub_stamp":"2023-10-08T06:10:34.831061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:58:27.184043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"34'2","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-08T06:10:36.871229+0000","last_change":"2023-10-08T06:10:34.859559+0000","last_active":"2023-10-08T06:10:36.871229+0000","last_peered":"2023-10-08T06:10:36.871229+0000","last_clean":"2023-10-08T06:10:36.871229+0000","last_became_active":"2023-10-08T06:10:34.858928+0000","last_became_peered":"2023-10-08T06:10:34.858928+0000","last_unstale":"2023-10-08T06:10:36.871229+0000","last_undegraded":"2023-10-08T06:10:36.871229+0000","last_fullsized":"2023-10-08T06:10:36.871229+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:10:33.827732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:10:33.827732+0000","last_clean_scrub_stamp":"2023-10-08T06:10:33.827732+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:57:33.452960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-08T06:10:37.374701+0000","last_change":"2023-10-08T06:10:35.865626+0000","last_active":"2023-10-08T06:10:37.374701+0000","last_peered":"2023-10-08T06:10:37.374701+0000","last_clean":"2023-10-08T06:10:37.374701+0000","last_became_active":"2023-10-08T06:10:35.864968+0000","last_became_peered":"2023-10-08T06:10:35.864968+0000","last_unstale":"2023-10-08T06:10:37.374701+0000","last_undegraded":"2023-10-08T06:10:37.374701+0000","last_fullsized":"2023-10-08T06:10:37.374701+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_clean_scrub_stamp":"2023-10-08T06:10:34.831061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:04:26.488430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"34'2","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-08T06:10:37.373855+0000","last_change":"2023-10-08T06:10:34.854345+0000","last_active":"2023-10-08T06:10:37.373855+0000","last_peered":"2023-10-08T06:10:37.373855+0000","last_clean":"2023-10-08T06:10:37.373855+0000","last_became_active":"2023-10-08T06:10:34.853417+0000","last_became_peered":"2023-10-08T06:10:34.853417+0000","last_unstale":"2023-10-08T06:10:37.373855+0000","last_undegraded":"2023-10-08T06:10:37.373855+0000","last_fullsized":"2023-10-08T06:10:37.373855+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:10:33.827732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:10:33.827732+0000","last_clean_scrub_stamp":"2023-10-08T06:10:33.827732+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:42:39.129767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-08T06:10:36.872697+0000","last_change":"2023-10-08T06:10:35.867847+0000","last_active":"2023-10-08T06:10:36.872697+0000","last_peered":"2023-10-08T06:10:36.872697+0000","last_clean":"2023-10-08T06:10:36.872697+0000","last_became_active":"2023-10-08T06:10:35.867555+0000","last_became_peered":"2023-10-08T06:10:35.867555+0000","last_unstale":"2023-10-08T06:10:36.872697+0000","last_undegraded":"2023-10-08T06:10:36.872697+0000","last_fullsized":"2023-10-08T06:10:36.872697+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_clean_scrub_stamp":"2023-10-08T06:10:34.831061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:04:26.488430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"34'1","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-08T06:10:37.372506+0000","last_change":"2023-10-08T06:10:34.867715+0000","last_active":"2023-10-08T06:10:37.372506+0000","last_peered":"2023-10-08T06:10:37.372506+0000","last_clean":"2023-10-08T06:10:37.372506+0000","last_became_active":"2023-10-08T06:10:34.867414+0000","last_became_peered":"2023-10-08T06:10:34.867414+0000","last_unstale":"2023-10-08T06:10:37.372506+0000","last_undegraded":"2023-10-08T06:10:37.372506+0000","last_fullsized":"2023-10-08T06:10:37.372506+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:10:33.827732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:10:33.827732+0000","last_clean_scrub_stamp":"2023-10-08T06:10:33.827732+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:34:21.152595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-08T06:10:36.874229+0000","last_change":"2023-10-08T06:10:35.856204+0000","last_active":"2023-10-08T06:10:36.874229+0000","last_peered":"2023-10-08T06:10:36.874229+0000","last_clean":"2023-10-08T06:10:36.874229+0000","last_became_active":"2023-10-08T06:10:35.855838+0000","last_became_peered":"2023-10-08T06:10:35.855838+0000","last_unstale":"2023-10-08T06:10:36.874229+0000","last_undegraded":"2023-10-08T06:10:36.874229+0000","last_fullsized":"2023-10-08T06:10:36.874229+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_clean_scrub_stamp":"2023-10-08T06:10:34.831061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:22:49.613418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"34'1","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-08T06:10:37.371822+0000","last_change":"2023-10-08T06:10:34.867818+0000","last_active":"2023-10-08T06:10:37.371822+0000","last_peered":"2023-10-08T06:10:37.371822+0000","last_clean":"2023-10-08T06:10:37.371822+0000","last_became_active":"2023-10-08T06:10:34.867309+0000","last_became_peered":"2023-10-08T06:10:34.867309+0000","last_unstale":"2023-10-08T06:10:37.371822+0000","last_undegraded":"2023-10-08T06:10:37.371822+0000","last_fullsized":"2023-10-08T06:10:37.371822+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:10:33.827732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:10:33.827732+0000","last_clean_scrub_stamp":"2023-10-08T06:10:33.827732+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:11:44.986426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-08T06:10:37.371250+0000","last_change":"2023-10-08T06:10:35.868759+0000","last_active":"2023-10-08T06:10:37.371250+0000","last_peered":"2023-10-08T06:10:37.371250+0000","last_clean":"2023-10-08T06:10:37.371250+0000","last_became_active":"2023-10-08T06:10:35.868469+0000","last_became_peered":"2023-10-08T06:10:35.868469+0000","last_unstale":"2023-10-08T06:10:37.371250+0000","last_undegraded":"2023-10-08T06:10:37.371250+0000","last_fullsized":"2023-10-08T06:10:37.371250+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_clean_scrub_stamp":"2023-10-08T06:10:34.831061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:41:45.977745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-08T06:10:36.870044+0000","last_change":"2023-10-08T06:10:34.862110+0000","last_active":"2023-10-08T06:10:36.870044+0000","last_peered":"2023-10-08T06:10:36.870044+0000","last_clean":"2023-10-08T06:10:36.870044+0000","last_became_active":"2023-10-08T06:10:34.861805+0000","last_became_peered":"2023-10-08T06:10:34.861805+0000","last_unstale":"2023-10-08T06:10:36.870044+0000","last_undegraded":"2023-10-08T06:10:36.870044+0000","last_fullsized":"2023-10-08T06:10:36.870044+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:10:33.827732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:10:33.827732+0000","last_clean_scrub_stamp":"2023-10-08T06:10:33.827732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:24:44.838383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-08T06:10:37.372556+0000","last_change":"2023-10-08T06:10:35.860934+0000","last_active":"2023-10-08T06:10:37.372556+0000","last_peered":"2023-10-08T06:10:37.372556+0000","last_clean":"2023-10-08T06:10:37.372556+0000","last_became_active":"2023-10-08T06:10:35.860567+0000","last_became_peered":"2023-10-08T06:10:35.860567+0000","last_unstale":"2023-10-08T06:10:37.372556+0000","last_undegraded":"2023-10-08T06:10:37.372556+0000","last_fullsized":"2023-10-08T06:10:37.372556+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_clean_scrub_stamp":"2023-10-08T06:10:34.831061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:58:27.184043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-08T06:10:37.371175+0000","last_change":"2023-10-08T06:10:34.856062+0000","last_active":"2023-10-08T06:10:37.371175+0000","last_peered":"2023-10-08T06:10:37.371175+0000","last_clean":"2023-10-08T06:10:37.371175+0000","last_became_active":"2023-10-08T06:10:34.855753+0000","last_became_peered":"2023-10-08T06:10:34.855753+0000","last_unstale":"2023-10-08T06:10:37.371175+0000","last_undegraded":"2023-10-08T06:10:37.371175+0000","last_fullsized":"2023-10-08T06:10:37.371175+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:10:33.827732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:10:33.827732+0000","last_clean_scrub_stamp":"2023-10-08T06:10:33.827732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:06:33.625691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-08T06:10:36.874908+0000","last_change":"2023-10-08T06:10:35.864203+0000","last_active":"2023-10-08T06:10:36.874908+0000","last_peered":"2023-10-08T06:10:36.874908+0000","last_clean":"2023-10-08T06:10:36.874908+0000","last_became_active":"2023-10-08T06:10:35.863887+0000","last_became_peered":"2023-10-08T06:10:35.863887+0000","last_unstale":"2023-10-08T06:10:36.874908+0000","last_undegraded":"2023-10-08T06:10:36.874908+0000","last_fullsized":"2023-10-08T06:10:36.874908+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_clean_scrub_stamp":"2023-10-08T06:10:34.831061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:36:31.790465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-08T06:10:36.871489+0000","last_change":"2023-10-08T06:10:34.862293+0000","last_active":"2023-10-08T06:10:36.871489+0000","last_peered":"2023-10-08T06:10:36.871489+0000","last_clean":"2023-10-08T06:10:36.871489+0000","last_became_active":"2023-10-08T06:10:34.861470+0000","last_became_peered":"2023-10-08T06:10:34.861470+0000","last_unstale":"2023-10-08T06:10:36.871489+0000","last_undegraded":"2023-10-08T06:10:36.871489+0000","last_fullsized":"2023-10-08T06:10:36.871489+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:10:33.827732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:10:33.827732+0000","last_clean_scrub_stamp":"2023-10-08T06:10:33.827732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:16:16.913845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-08T06:10:36.871507+0000","last_change":"2023-10-08T06:10:35.868197+0000","last_active":"2023-10-08T06:10:36.871507+0000","last_peered":"2023-10-08T06:10:36.871507+0000","last_clean":"2023-10-08T06:10:36.871507+0000","last_became_active":"2023-10-08T06:10:35.867889+0000","last_became_peered":"2023-10-08T06:10:35.867889+0000","last_unstale":"2023-10-08T06:10:36.871507+0000","last_undegraded":"2023-10-08T06:10:36.871507+0000","last_fullsized":"2023-10-08T06:10:36.871507+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_clean_scrub_stamp":"2023-10-08T06:10:34.831061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:22:01.124448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-08T06:10:37.374294+0000","last_change":"2023-10-08T06:10:34.865616+0000","last_active":"2023-10-08T06:10:37.374294+0000","last_peered":"2023-10-08T06:10:37.374294+0000","last_clean":"2023-10-08T06:10:37.374294+0000","last_became_active":"2023-10-08T06:10:34.865319+0000","last_became_peered":"2023-10-08T06:10:34.865319+0000","last_unstale":"2023-10-08T06:10:37.374294+0000","last_undegraded":"2023-10-08T06:10:37.374294+0000","last_fullsized":"2023-10-08T06:10:37.374294+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:10:33.827732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:10:33.827732+0000","last_clean_scrub_stamp":"2023-10-08T06:10:33.827732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:01:22.140451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-08T06:10:36.871004+0000","last_change":"2023-10-08T06:10:35.878302+0000","last_active":"2023-10-08T06:10:36.871004+0000","last_peered":"2023-10-08T06:10:36.871004+0000","last_clean":"2023-10-08T06:10:36.871004+0000","last_became_active":"2023-10-08T06:10:35.876855+0000","last_became_peered":"2023-10-08T06:10:35.876855+0000","last_unstale":"2023-10-08T06:10:36.871004+0000","last_undegraded":"2023-10-08T06:10:36.871004+0000","last_fullsized":"2023-10-08T06:10:36.871004+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_clean_scrub_stamp":"2023-10-08T06:10:34.831061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:36:38.416131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"34'3","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-08T06:10:36.874693+0000","last_change":"2023-10-08T06:10:34.860580+0000","last_active":"2023-10-08T06:10:36.874693+0000","last_peered":"2023-10-08T06:10:36.874693+0000","last_clean":"2023-10-08T06:10:36.874693+0000","last_became_active":"2023-10-08T06:10:34.860240+0000","last_became_peered":"2023-10-08T06:10:34.860240+0000","last_unstale":"2023-10-08T06:10:36.874693+0000","last_undegraded":"2023-10-08T06:10:36.874693+0000","last_fullsized":"2023-10-08T06:10:36.874693+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:10:33.827732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:10:33.827732+0000","last_clean_scrub_stamp":"2023-10-08T06:10:33.827732+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:41:55.063762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-08T06:10:36.874290+0000","last_change":"2023-10-08T06:10:35.861195+0000","last_active":"2023-10-08T06:10:36.874290+0000","last_peered":"2023-10-08T06:10:36.874290+0000","last_clean":"2023-10-08T06:10:36.874290+0000","last_became_active":"2023-10-08T06:10:35.860573+0000","last_became_peered":"2023-10-08T06:10:35.860573+0000","last_unstale":"2023-10-08T06:10:36.874290+0000","last_undegraded":"2023-10-08T06:10:36.874290+0000","last_fullsized":"2023-10-08T06:10:36.874290+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_clean_scrub_stamp":"2023-10-08T06:10:34.831061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:36:41.906523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"34'6","reported_seq":18,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-08T06:10:36.871100+0000","last_change":"2023-10-08T06:10:34.860068+0000","last_active":"2023-10-08T06:10:36.871100+0000","last_peered":"2023-10-08T06:10:36.871100+0000","last_clean":"2023-10-08T06:10:36.871100+0000","last_became_active":"2023-10-08T06:10:34.859771+0000","last_became_peered":"2023-10-08T06:10:34.859771+0000","last_unstale":"2023-10-08T06:10:36.871100+0000","last_undegraded":"2023-10-08T06:10:36.871100+0000","last_fullsized":"2023-10-08T06:10:36.871100+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:10:33.827732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:10:33.827732+0000","last_clean_scrub_stamp":"2023-10-08T06:10:33.827732+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:48:28.572880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-08T06:10:37.372649+0000","last_change":"2023-10-08T06:10:35.861836+0000","last_active":"2023-10-08T06:10:37.372649+0000","last_peered":"2023-10-08T06:10:37.372649+0000","last_clean":"2023-10-08T06:10:37.372649+0000","last_became_active":"2023-10-08T06:10:35.861435+0000","last_became_peered":"2023-10-08T06:10:35.861435+0000","last_unstale":"2023-10-08T06:10:37.372649+0000","last_undegraded":"2023-10-08T06:10:37.372649+0000","last_fullsized":"2023-10-08T06:10:37.372649+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_clean_scrub_stamp":"2023-10-08T06:10:34.831061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:41:56.067091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"34'2","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-08T06:10:37.372797+0000","last_change":"2023-10-08T06:10:34.857327+0000","last_active":"2023-10-08T06:10:37.372797+0000","last_peered":"2023-10-08T06:10:37.372797+0000","last_clean":"2023-10-08T06:10:37.372797+0000","last_became_active":"2023-10-08T06:10:34.857031+0000","last_became_peered":"2023-10-08T06:10:34.857031+0000","last_unstale":"2023-10-08T06:10:37.372797+0000","last_undegraded":"2023-10-08T06:10:37.372797+0000","last_fullsized":"2023-10-08T06:10:37.372797+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:10:33.827732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:10:33.827732+0000","last_clean_scrub_stamp":"2023-10-08T06:10:33.827732+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:40:29.692727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-08T06:10:36.870987+0000","last_change":"2023-10-08T06:10:35.869194+0000","last_active":"2023-10-08T06:10:36.870987+0000","last_peered":"2023-10-08T06:10:36.870987+0000","last_clean":"2023-10-08T06:10:36.870987+0000","last_became_active":"2023-10-08T06:10:35.868926+0000","last_became_peered":"2023-10-08T06:10:35.868926+0000","last_unstale":"2023-10-08T06:10:36.870987+0000","last_undegraded":"2023-10-08T06:10:36.870987+0000","last_fullsized":"2023-10-08T06:10:36.870987+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_clean_scrub_stamp":"2023-10-08T06:10:34.831061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:21:04.710213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-08T06:10:37.372873+0000","last_change":"2023-10-08T06:10:34.865502+0000","last_active":"2023-10-08T06:10:37.372873+0000","last_peered":"2023-10-08T06:10:37.372873+0000","last_clean":"2023-10-08T06:10:37.372873+0000","last_became_active":"2023-10-08T06:10:34.865208+0000","last_became_peered":"2023-10-08T06:10:34.865208+0000","last_unstale":"2023-10-08T06:10:37.372873+0000","last_undegraded":"2023-10-08T06:10:37.372873+0000","last_fullsized":"2023-10-08T06:10:37.372873+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:10:33.827732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:10:33.827732+0000","last_clean_scrub_stamp":"2023-10-08T06:10:33.827732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:11:44.986426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-08T06:10:36.871814+0000","last_change":"2023-10-08T06:10:35.868553+0000","last_active":"2023-10-08T06:10:36.871814+0000","last_peered":"2023-10-08T06:10:36.871814+0000","last_clean":"2023-10-08T06:10:36.871814+0000","last_became_active":"2023-10-08T06:10:35.868290+0000","last_became_peered":"2023-10-08T06:10:35.868290+0000","last_unstale":"2023-10-08T06:10:36.871814+0000","last_undegraded":"2023-10-08T06:10:36.871814+0000","last_fullsized":"2023-10-08T06:10:36.871814+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_clean_scrub_stamp":"2023-10-08T06:10:34.831061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:34:04.392768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-08T06:10:36.869817+0000","last_change":"2023-10-08T06:10:34.864309+0000","last_active":"2023-10-08T06:10:36.869817+0000","last_peered":"2023-10-08T06:10:36.869817+0000","last_clean":"2023-10-08T06:10:36.869817+0000","last_became_active":"2023-10-08T06:10:34.864143+0000","last_became_peered":"2023-10-08T06:10:34.864143+0000","last_unstale":"2023-10-08T06:10:36.869817+0000","last_undegraded":"2023-10-08T06:10:36.869817+0000","last_fullsized":"2023-10-08T06:10:36.869817+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:10:33.827732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:10:33.827732+0000","last_clean_scrub_stamp":"2023-10-08T06:10:33.827732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:51:06.669416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-08T06:10:37.370904+0000","last_change":"2023-10-08T06:10:35.871977+0000","last_active":"2023-10-08T06:10:37.370904+0000","last_peered":"2023-10-08T06:10:37.370904+0000","last_clean":"2023-10-08T06:10:37.370904+0000","last_became_active":"2023-10-08T06:10:35.870810+0000","last_became_peered":"2023-10-08T06:10:35.870810+0000","last_unstale":"2023-10-08T06:10:37.370904+0000","last_undegraded":"2023-10-08T06:10:37.370904+0000","last_fullsized":"2023-10-08T06:10:37.370904+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_clean_scrub_stamp":"2023-10-08T06:10:34.831061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:40:30.696056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"34'8","reported_seq":20,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-08T06:10:36.869973+0000","last_change":"2023-10-08T06:10:34.859346+0000","last_active":"2023-10-08T06:10:36.869973+0000","last_peered":"2023-10-08T06:10:36.869973+0000","last_clean":"2023-10-08T06:10:36.869973+0000","last_became_active":"2023-10-08T06:10:34.859032+0000","last_became_peered":"2023-10-08T06:10:34.859032+0000","last_unstale":"2023-10-08T06:10:36.869973+0000","last_undegraded":"2023-10-08T06:10:36.869973+0000","last_fullsized":"2023-10-08T06:10:36.869973+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:10:33.827732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:10:33.827732+0000","last_clean_scrub_stamp":"2023-10-08T06:10:33.827732+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:29:35.128653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-08T06:10:37.372906+0000","last_change":"2023-10-08T06:10:35.867317+0000","last_active":"2023-10-08T06:10:37.372906+0000","last_peered":"2023-10-08T06:10:37.372906+0000","last_clean":"2023-10-08T06:10:37.372906+0000","last_became_active":"2023-10-08T06:10:35.867019+0000","last_became_peered":"2023-10-08T06:10:35.867019+0000","last_unstale":"2023-10-08T06:10:37.372906+0000","last_undegraded":"2023-10-08T06:10:37.372906+0000","last_fullsized":"2023-10-08T06:10:37.372906+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_clean_scrub_stamp":"2023-10-08T06:10:34.831061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:34:04.392768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"34'1","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-08T06:10:37.373800+0000","last_change":"2023-10-08T06:10:34.868103+0000","last_active":"2023-10-08T06:10:37.373800+0000","last_peered":"2023-10-08T06:10:37.373800+0000","last_clean":"2023-10-08T06:10:37.373800+0000","last_became_active":"2023-10-08T06:10:34.867773+0000","last_became_peered":"2023-10-08T06:10:34.867773+0000","last_unstale":"2023-10-08T06:10:37.373800+0000","last_undegraded":"2023-10-08T06:10:37.373800+0000","last_fullsized":"2023-10-08T06:10:37.373800+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:10:33.827732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:10:33.827732+0000","last_clean_scrub_stamp":"2023-10-08T06:10:33.827732+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:31:12.741284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-08T06:10:36.875065+0000","last_change":"2023-10-08T06:10:35.861950+0000","last_active":"2023-10-08T06:10:36.875065+0000","last_peered":"2023-10-08T06:10:36.875065+0000","last_clean":"2023-10-08T06:10:36.875065+0000","last_became_active":"2023-10-08T06:10:35.861663+0000","last_became_peered":"2023-10-08T06:10:35.861663+0000","last_unstale":"2023-10-08T06:10:36.875065+0000","last_undegraded":"2023-10-08T06:10:36.875065+0000","last_fullsized":"2023-10-08T06:10:36.875065+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_clean_scrub_stamp":"2023-10-08T06:10:34.831061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:24:35.767005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"34'2","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-08T06:10:37.372864+0000","last_change":"2023-10-08T06:10:34.856113+0000","last_active":"2023-10-08T06:10:37.372864+0000","last_peered":"2023-10-08T06:10:37.372864+0000","last_clean":"2023-10-08T06:10:37.372864+0000","last_became_active":"2023-10-08T06:10:34.855829+0000","last_became_peered":"2023-10-08T06:10:34.855829+0000","last_unstale":"2023-10-08T06:10:37.372864+0000","last_undegraded":"2023-10-08T06:10:37.372864+0000","last_fullsized":"2023-10-08T06:10:37.372864+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:10:33.827732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:10:33.827732+0000","last_clean_scrub_stamp":"2023-10-08T06:10:33.827732+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:31:50.344322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-08T06:10:37.373242+0000","last_change":"2023-10-08T06:10:35.870034+0000","last_active":"2023-10-08T06:10:37.373242+0000","last_peered":"2023-10-08T06:10:37.373242+0000","last_clean":"2023-10-08T06:10:37.373242+0000","last_became_active":"2023-10-08T06:10:35.869742+0000","last_became_peered":"2023-10-08T06:10:35.869742+0000","last_unstale":"2023-10-08T06:10:37.373242+0000","last_undegraded":"2023-10-08T06:10:37.373242+0000","last_fullsized":"2023-10-08T06:10:37.373242+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_clean_scrub_stamp":"2023-10-08T06:10:34.831061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:13:19.900307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"34'1","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-08T06:10:37.372943+0000","last_change":"2023-10-08T06:10:34.858634+0000","last_active":"2023-10-08T06:10:37.372943+0000","last_peered":"2023-10-08T06:10:37.372943+0000","last_clean":"2023-10-08T06:10:37.372943+0000","last_became_active":"2023-10-08T06:10:34.858170+0000","last_became_peered":"2023-10-08T06:10:34.858170+0000","last_unstale":"2023-10-08T06:10:37.372943+0000","last_undegraded":"2023-10-08T06:10:37.372943+0000","last_fullsized":"2023-10-08T06:10:37.372943+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:10:33.827732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:10:33.827732+0000","last_clean_scrub_stamp":"2023-10-08T06:10:33.827732+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:01:22.140451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-08T06:10:37.374698+0000","last_change":"2023-10-08T06:10:35.864620+0000","last_active":"2023-10-08T06:10:37.374698+0000","last_peered":"2023-10-08T06:10:37.374698+0000","last_clean":"2023-10-08T06:10:37.374698+0000","last_became_active":"2023-10-08T06:10:35.864370+0000","last_became_peered":"2023-10-08T06:10:35.864370+0000","last_unstale":"2023-10-08T06:10:37.374698+0000","last_undegraded":"2023-10-08T06:10:37.374698+0000","last_fullsized":"2023-10-08T06:10:37.374698+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_clean_scrub_stamp":"2023-10-08T06:10:34.831061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:11:45.989754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-08T06:10:37.372580+0000","last_change":"2023-10-08T06:10:34.866913+0000","last_active":"2023-10-08T06:10:37.372580+0000","last_peered":"2023-10-08T06:10:37.372580+0000","last_clean":"2023-10-08T06:10:37.372580+0000","last_became_active":"2023-10-08T06:10:34.866649+0000","last_became_peered":"2023-10-08T06:10:34.866649+0000","last_unstale":"2023-10-08T06:10:37.372580+0000","last_undegraded":"2023-10-08T06:10:37.372580+0000","last_fullsized":"2023-10-08T06:10:37.372580+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:10:33.827732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:10:33.827732+0000","last_clean_scrub_stamp":"2023-10-08T06:10:33.827732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:06:14.750979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-08T06:10:37.372571+0000","last_change":"2023-10-08T06:10:35.869917+0000","last_active":"2023-10-08T06:10:37.372571+0000","last_peered":"2023-10-08T06:10:37.372571+0000","last_clean":"2023-10-08T06:10:37.372571+0000","last_became_active":"2023-10-08T06:10:35.869592+0000","last_became_peered":"2023-10-08T06:10:35.869592+0000","last_unstale":"2023-10-08T06:10:37.372571+0000","last_undegraded":"2023-10-08T06:10:37.372571+0000","last_fullsized":"2023-10-08T06:10:37.372571+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_clean_scrub_stamp":"2023-10-08T06:10:34.831061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:26:04.389284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"34'2","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-08T06:10:37.372976+0000","last_change":"2023-10-08T06:10:34.857621+0000","last_active":"2023-10-08T06:10:37.372976+0000","last_peered":"2023-10-08T06:10:37.372976+0000","last_clean":"2023-10-08T06:10:37.372976+0000","last_became_active":"2023-10-08T06:10:34.857337+0000","last_became_peered":"2023-10-08T06:10:34.857337+0000","last_unstale":"2023-10-08T06:10:37.372976+0000","last_undegraded":"2023-10-08T06:10:37.372976+0000","last_fullsized":"2023-10-08T06:10:37.372976+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:10:33.827732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:10:33.827732+0000","last_clean_scrub_stamp":"2023-10-08T06:10:33.827732+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:19:48.131519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-08T06:10:37.373310+0000","last_change":"2023-10-08T06:10:35.868054+0000","last_active":"2023-10-08T06:10:37.373310+0000","last_peered":"2023-10-08T06:10:37.373310+0000","last_clean":"2023-10-08T06:10:37.373310+0000","last_became_active":"2023-10-08T06:10:35.867764+0000","last_became_peered":"2023-10-08T06:10:35.867764+0000","last_unstale":"2023-10-08T06:10:37.373310+0000","last_undegraded":"2023-10-08T06:10:37.373310+0000","last_fullsized":"2023-10-08T06:10:37.373310+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_clean_scrub_stamp":"2023-10-08T06:10:34.831061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:39:40.990894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-08T06:10:37.371071+0000","last_change":"2023-10-08T06:10:34.864090+0000","last_active":"2023-10-08T06:10:37.371071+0000","last_peered":"2023-10-08T06:10:37.371071+0000","last_clean":"2023-10-08T06:10:37.371071+0000","last_became_active":"2023-10-08T06:10:34.863640+0000","last_became_peered":"2023-10-08T06:10:34.863640+0000","last_unstale":"2023-10-08T06:10:37.371071+0000","last_undegraded":"2023-10-08T06:10:37.371071+0000","last_fullsized":"2023-10-08T06:10:37.371071+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:10:33.827732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:10:33.827732+0000","last_clean_scrub_stamp":"2023-10-08T06:10:33.827732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:36:33.065264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-08T06:10:37.372241+0000","last_change":"2023-10-08T06:10:35.859654+0000","last_active":"2023-10-08T06:10:37.372241+0000","last_peered":"2023-10-08T06:10:37.372241+0000","last_clean":"2023-10-08T06:10:37.372241+0000","last_became_active":"2023-10-08T06:10:35.859378+0000","last_became_peered":"2023-10-08T06:10:35.859378+0000","last_unstale":"2023-10-08T06:10:37.372241+0000","last_undegraded":"2023-10-08T06:10:37.372241+0000","last_fullsized":"2023-10-08T06:10:37.372241+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_clean_scrub_stamp":"2023-10-08T06:10:34.831061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:39:55.219855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-08T06:10:37.372408+0000","last_change":"2023-10-08T06:10:34.851238+0000","last_active":"2023-10-08T06:10:37.372408+0000","last_peered":"2023-10-08T06:10:37.372408+0000","last_clean":"2023-10-08T06:10:37.372408+0000","last_became_active":"2023-10-08T06:10:34.850889+0000","last_became_peered":"2023-10-08T06:10:34.850889+0000","last_unstale":"2023-10-08T06:10:37.372408+0000","last_undegraded":"2023-10-08T06:10:37.372408+0000","last_fullsized":"2023-10-08T06:10:37.372408+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:10:33.827732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:10:33.827732+0000","last_clean_scrub_stamp":"2023-10-08T06:10:33.827732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:39:39.987565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-08T06:10:36.871920+0000","last_change":"2023-10-08T06:10:35.869652+0000","last_active":"2023-10-08T06:10:36.871920+0000","last_peered":"2023-10-08T06:10:36.871920+0000","last_clean":"2023-10-08T06:10:36.871920+0000","last_became_active":"2023-10-08T06:10:35.869329+0000","last_became_peered":"2023-10-08T06:10:35.869329+0000","last_unstale":"2023-10-08T06:10:36.871920+0000","last_undegraded":"2023-10-08T06:10:36.871920+0000","last_fullsized":"2023-10-08T06:10:36.871920+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_clean_scrub_stamp":"2023-10-08T06:10:34.831061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:13:19.900307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-08T06:10:36.873695+0000","last_change":"2023-10-08T06:10:34.863142+0000","last_active":"2023-10-08T06:10:36.873695+0000","last_peered":"2023-10-08T06:10:36.873695+0000","last_clean":"2023-10-08T06:10:36.873695+0000","last_became_active":"2023-10-08T06:10:34.862782+0000","last_became_peered":"2023-10-08T06:10:34.862782+0000","last_unstale":"2023-10-08T06:10:36.873695+0000","last_undegraded":"2023-10-08T06:10:36.873695+0000","last_fullsized":"2023-10-08T06:10:36.873695+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:10:33.827732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:10:33.827732+0000","last_clean_scrub_stamp":"2023-10-08T06:10:33.827732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:41:44.974417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-08T06:10:37.374743+0000","last_change":"2023-10-08T06:10:35.866431+0000","last_active":"2023-10-08T06:10:37.374743+0000","last_peered":"2023-10-08T06:10:37.374743+0000","last_clean":"2023-10-08T06:10:37.374743+0000","last_became_active":"2023-10-08T06:10:35.865979+0000","last_became_peered":"2023-10-08T06:10:35.865979+0000","last_unstale":"2023-10-08T06:10:37.374743+0000","last_undegraded":"2023-10-08T06:10:37.374743+0000","last_fullsized":"2023-10-08T06:10:37.374743+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_clean_scrub_stamp":"2023-10-08T06:10:34.831061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:26:34.835131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"34'2","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-08T06:10:37.376541+0000","last_change":"2023-10-08T06:10:34.866541+0000","last_active":"2023-10-08T06:10:37.376541+0000","last_peered":"2023-10-08T06:10:37.376541+0000","last_clean":"2023-10-08T06:10:37.376541+0000","last_became_active":"2023-10-08T06:10:34.866047+0000","last_became_peered":"2023-10-08T06:10:34.866047+0000","last_unstale":"2023-10-08T06:10:37.376541+0000","last_undegraded":"2023-10-08T06:10:37.376541+0000","last_fullsized":"2023-10-08T06:10:37.376541+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:10:33.827732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:10:33.827732+0000","last_clean_scrub_stamp":"2023-10-08T06:10:33.827732+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:46:57.429056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-08T06:10:36.875129+0000","last_change":"2023-10-08T06:10:35.860384+0000","last_active":"2023-10-08T06:10:36.875129+0000","last_peered":"2023-10-08T06:10:36.875129+0000","last_clean":"2023-10-08T06:10:36.875129+0000","last_became_active":"2023-10-08T06:10:35.860135+0000","last_became_peered":"2023-10-08T06:10:35.860135+0000","last_unstale":"2023-10-08T06:10:36.875129+0000","last_undegraded":"2023-10-08T06:10:36.875129+0000","last_fullsized":"2023-10-08T06:10:36.875129+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_clean_scrub_stamp":"2023-10-08T06:10:34.831061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:39:48.985828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-08T06:10:37.374277+0000","last_change":"2023-10-08T06:10:34.857480+0000","last_active":"2023-10-08T06:10:37.374277+0000","last_peered":"2023-10-08T06:10:37.374277+0000","last_clean":"2023-10-08T06:10:37.374277+0000","last_became_active":"2023-10-08T06:10:34.857172+0000","last_became_peered":"2023-10-08T06:10:34.857172+0000","last_unstale":"2023-10-08T06:10:37.374277+0000","last_undegraded":"2023-10-08T06:10:37.374277+0000","last_fullsized":"2023-10-08T06:10:37.374277+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:10:33.827732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:10:33.827732+0000","last_clean_scrub_stamp":"2023-10-08T06:10:33.827732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:31:50.344322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-08T06:10:37.373728+0000","last_change":"2023-10-08T06:10:35.857858+0000","last_active":"2023-10-08T06:10:37.373728+0000","last_peered":"2023-10-08T06:10:37.373728+0000","last_clean":"2023-10-08T06:10:37.373728+0000","last_became_active":"2023-10-08T06:10:35.857525+0000","last_became_peered":"2023-10-08T06:10:35.857525+0000","last_unstale":"2023-10-08T06:10:37.373728+0000","last_undegraded":"2023-10-08T06:10:37.373728+0000","last_fullsized":"2023-10-08T06:10:37.373728+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_clean_scrub_stamp":"2023-10-08T06:10:34.831061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:41:45.977745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-08T06:10:37.373608+0000","last_change":"2023-10-08T06:10:34.860340+0000","last_active":"2023-10-08T06:10:37.373608+0000","last_peered":"2023-10-08T06:10:37.373608+0000","last_clean":"2023-10-08T06:10:37.373608+0000","last_became_active":"2023-10-08T06:10:34.859736+0000","last_became_peered":"2023-10-08T06:10:34.859736+0000","last_unstale":"2023-10-08T06:10:37.373608+0000","last_undegraded":"2023-10-08T06:10:37.373608+0000","last_fullsized":"2023-10-08T06:10:37.373608+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:10:33.827732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:10:33.827732+0000","last_clean_scrub_stamp":"2023-10-08T06:10:33.827732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:01:22.140451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-08T06:10:37.370861+0000","last_change":"2023-10-08T06:10:35.861029+0000","last_active":"2023-10-08T06:10:37.370861+0000","last_peered":"2023-10-08T06:10:37.370861+0000","last_clean":"2023-10-08T06:10:37.370861+0000","last_became_active":"2023-10-08T06:10:35.860588+0000","last_became_peered":"2023-10-08T06:10:35.860588+0000","last_unstale":"2023-10-08T06:10:37.370861+0000","last_undegraded":"2023-10-08T06:10:37.370861+0000","last_fullsized":"2023-10-08T06:10:37.370861+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_clean_scrub_stamp":"2023-10-08T06:10:34.831061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:34:22.155924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-08T06:10:37.373168+0000","last_change":"2023-10-08T06:10:34.856093+0000","last_active":"2023-10-08T06:10:37.373168+0000","last_peered":"2023-10-08T06:10:37.373168+0000","last_clean":"2023-10-08T06:10:37.373168+0000","last_became_active":"2023-10-08T06:10:34.855698+0000","last_became_peered":"2023-10-08T06:10:34.855698+0000","last_unstale":"2023-10-08T06:10:37.373168+0000","last_undegraded":"2023-10-08T06:10:37.373168+0000","last_fullsized":"2023-10-08T06:10:37.373168+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:10:33.827732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:10:33.827732+0000","last_clean_scrub_stamp":"2023-10-08T06:10:33.827732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:36:33.065264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-08T06:10:37.372775+0000","last_change":"2023-10-08T06:10:35.861394+0000","last_active":"2023-10-08T06:10:37.372775+0000","last_peered":"2023-10-08T06:10:37.372775+0000","last_clean":"2023-10-08T06:10:37.372775+0000","last_became_active":"2023-10-08T06:10:35.861103+0000","last_became_peered":"2023-10-08T06:10:35.861103+0000","last_unstale":"2023-10-08T06:10:37.372775+0000","last_undegraded":"2023-10-08T06:10:37.372775+0000","last_fullsized":"2023-10-08T06:10:37.372775+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_clean_scrub_stamp":"2023-10-08T06:10:34.831061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:40:30.696056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-08T06:10:37.372880+0000","last_change":"2023-10-08T06:10:34.866512+0000","last_active":"2023-10-08T06:10:37.372880+0000","last_peered":"2023-10-08T06:10:37.372880+0000","last_clean":"2023-10-08T06:10:37.372880+0000","last_became_active":"2023-10-08T06:10:34.866018+0000","last_became_peered":"2023-10-08T06:10:34.866018+0000","last_unstale":"2023-10-08T06:10:37.372880+0000","last_undegraded":"2023-10-08T06:10:37.372880+0000","last_fullsized":"2023-10-08T06:10:37.372880+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:10:33.827732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:10:33.827732+0000","last_clean_scrub_stamp":"2023-10-08T06:10:33.827732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:36:33.065264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-08T06:10:36.869890+0000","last_change":"2023-10-08T06:10:35.863353+0000","last_active":"2023-10-08T06:10:36.869890+0000","last_peered":"2023-10-08T06:10:36.869890+0000","last_clean":"2023-10-08T06:10:36.869890+0000","last_became_active":"2023-10-08T06:10:35.863086+0000","last_became_peered":"2023-10-08T06:10:35.863086+0000","last_unstale":"2023-10-08T06:10:36.869890+0000","last_undegraded":"2023-10-08T06:10:36.869890+0000","last_fullsized":"2023-10-08T06:10:36.869890+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_clean_scrub_stamp":"2023-10-08T06:10:34.831061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:48:06.056312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-08T06:10:37.371736+0000","last_change":"2023-10-08T06:10:34.856492+0000","last_active":"2023-10-08T06:10:37.371736+0000","last_peered":"2023-10-08T06:10:37.371736+0000","last_clean":"2023-10-08T06:10:37.371736+0000","last_became_active":"2023-10-08T06:10:34.856178+0000","last_became_peered":"2023-10-08T06:10:34.856178+0000","last_unstale":"2023-10-08T06:10:37.371736+0000","last_undegraded":"2023-10-08T06:10:37.371736+0000","last_fullsized":"2023-10-08T06:10:37.371736+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:10:33.827732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:10:33.827732+0000","last_clean_scrub_stamp":"2023-10-08T06:10:33.827732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:26:33.831803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-08T06:10:37.371512+0000","last_change":"2023-10-08T06:10:35.862111+0000","last_active":"2023-10-08T06:10:37.371512+0000","last_peered":"2023-10-08T06:10:37.371512+0000","last_clean":"2023-10-08T06:10:37.371512+0000","last_became_active":"2023-10-08T06:10:35.861801+0000","last_became_peered":"2023-10-08T06:10:35.861801+0000","last_unstale":"2023-10-08T06:10:37.371512+0000","last_undegraded":"2023-10-08T06:10:37.371512+0000","last_fullsized":"2023-10-08T06:10:37.371512+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_clean_scrub_stamp":"2023-10-08T06:10:34.831061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:31:13.744612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-08T06:10:36.869831+0000","last_change":"2023-10-08T06:10:34.864099+0000","last_active":"2023-10-08T06:10:36.869831+0000","last_peered":"2023-10-08T06:10:36.869831+0000","last_clean":"2023-10-08T06:10:36.869831+0000","last_became_active":"2023-10-08T06:10:34.863775+0000","last_became_peered":"2023-10-08T06:10:34.863775+0000","last_unstale":"2023-10-08T06:10:36.869831+0000","last_undegraded":"2023-10-08T06:10:36.869831+0000","last_fullsized":"2023-10-08T06:10:36.869831+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:10:33.827732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:10:33.827732+0000","last_clean_scrub_stamp":"2023-10-08T06:10:33.827732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:29:56.275726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-08T06:10:36.872927+0000","last_change":"2023-10-08T06:10:35.865971+0000","last_active":"2023-10-08T06:10:36.872927+0000","last_peered":"2023-10-08T06:10:36.872927+0000","last_clean":"2023-10-08T06:10:36.872927+0000","last_became_active":"2023-10-08T06:10:35.865643+0000","last_became_peered":"2023-10-08T06:10:35.865643+0000","last_unstale":"2023-10-08T06:10:36.872927+0000","last_undegraded":"2023-10-08T06:10:36.872927+0000","last_fullsized":"2023-10-08T06:10:36.872927+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:10:34.831061+0000","last_clean_scrub_stamp":"2023-10-08T06:10:34.831061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:19:11.190979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-08T06:10:37.371465+0000","last_change":"2023-10-08T06:10:34.857459+0000","last_active":"2023-10-08T06:10:37.371465+0000","last_peered":"2023-10-08T06:10:37.371465+0000","last_clean":"2023-10-08T06:10:37.371465+0000","last_became_active":"2023-10-08T06:10:34.857161+0000","last_became_peered":"2023-10-08T06:10:34.857161+0000","last_unstale":"2023-10-08T06:10:37.371465+0000","last_undegraded":"2023-10-08T06:10:37.371465+0000","last_fullsized":"2023-10-08T06:10:37.371465+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:10:33.827732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:10:33.827732+0000","last_clean_scrub_stamp":"2023-10-08T06:10:33.827732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:11:44.986426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":176,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-08T06:10:35.857217+0000","last_change":"2023-10-08T06:09:24.811692+0000","last_active":"2023-10-08T06:10:35.857217+0000","last_peered":"2023-10-08T06:10:35.857217+0000","last_clean":"2023-10-08T06:10:35.857217+0000","last_became_active":"2023-10-08T06:09:24.809788+0000","last_became_peered":"2023-10-08T06:09:24.809788+0000","last_unstale":"2023-10-08T06:10:35.857217+0000","last_undegraded":"2023-10-08T06:10:35.857217+0000","last_fullsized":"2023-10-08T06:10:35.857217+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:23.748736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:23.748736+0000","last_clean_scrub_stamp":"2023-10-08T06:09:23.748736+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:39:45.599458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509458,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27984,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343856,"statfs":{"total":96636764160,"available":96608108544,"internally_reserved":0,"allocated":987136,"data_stored":742728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 06:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.173,"5min":1.173,"15min":1.173},"last":0.877},{"interface":"front","average":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.389,"5min":1.389,"15min":1.389},"last":1.036}]},{"osd":1,"last update":"Sun Oct 8 06:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.4530000000000001,"5min":1.4530000000000001,"15min":1.4530000000000001},"last":0.72899999999999998},{"interface":"front","average":{"1min":1.091,"5min":1.091,"15min":1.091},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":2.3820000000000001,"5min":2.3820000000000001,"15min":2.3820000000000001},"last":0.98399999999999999}]},{"osd":2,"last update":"Sun Oct 8 06:10:25 2023","interfaces":[{"interface":"back","average":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.925,"5min":1.925,"15min":1.925},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.6930000000000001,"5min":1.6930000000000001,"15min":1.6930000000000001},"last":1.0089999999999999}]},{"osd":3,"last update":"Sun Oct 8 06:10:25 2023","interfaces":[{"interface":"back","average":{"1min":1.04,"5min":1.04,"15min":1.04},"min":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.8049999999999999,"5min":1.8049999999999999,"15min":1.8049999999999999},"last":1.1579999999999999},{"interface":"front","average":{"1min":1.101,"5min":1.101,"15min":1.101},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.746,"5min":1.746,"15min":1.746},"last":0.91600000000000004}]},{"osd":4,"last update":"Sun Oct 8 06:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.3,"5min":1.3,"15min":1.3},"last":0.94799999999999995},{"interface":"front","average":{"1min":1.222,"5min":1.222,"15min":1.222},"min":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"max":{"1min":1.6499999999999999,"5min":1.6499999999999999,"15min":1.6499999999999999},"last":1.0609999999999999}]},{"osd":5,"last update":"Sun Oct 8 06:10:25 2023","interfaces":[{"interface":"back","average":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"min":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":1.5940000000000001,"5min":1.5940000000000001,"15min":1.5940000000000001},"last":0.79000000000000004},{"interface":"front","average":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"min":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"max":{"1min":1.952,"5min":1.952,"15min":1.952},"last":0.82899999999999996}]},{"osd":6,"last update":"Sun Oct 8 06:10:25 2023","interfaces":[{"interface":"back","average":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"min":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"max":{"1min":1.851,"5min":1.851,"15min":1.851},"last":1.1100000000000001},{"interface":"front","average":{"1min":1.3089999999999999,"5min":1.3089999999999999,"15min":1.3089999999999999},"min":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"max":{"1min":1.9830000000000001,"5min":1.9830000000000001,"15min":1.9830000000000001},"last":1.2410000000000001}]}]},{"osd":6,"up_from":15,"seq":64424509459,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":397312,"data_stored":152886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 06:10:22 2023","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.5660000000000001,"5min":1.5660000000000001,"15min":1.5660000000000001},"last":0.54800000000000004},{"interface":"front","average":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.7370000000000001,"5min":1.7370000000000001,"15min":1.7370000000000001},"last":0.57399999999999995}]},{"osd":1,"last update":"Sun Oct 8 06:10:22 2023","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":2.1019999999999999},{"interface":"front","average":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.7090000000000001,"5min":1.7090000000000001,"15min":1.7090000000000001},"last":0.71399999999999997}]},{"osd":2,"last update":"Sun Oct 8 06:10:22 2023","interfaces":[{"interface":"back","average":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.365,"5min":1.365,"15min":1.365},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.268,"5min":1.268,"15min":1.268},"last":0.51700000000000002}]},{"osd":3,"last update":"Sun Oct 8 06:10:22 2023","interfaces":[{"interface":"back","average":{"1min":1.008,"5min":1.008,"15min":1.008},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.5089999999999999,"5min":1.5089999999999999,"15min":1.5089999999999999},"last":0.61699999999999999},{"interface":"front","average":{"1min":1.018,"5min":1.018,"15min":1.018},"min":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":1.4530000000000001,"5min":1.4530000000000001,"15min":1.4530000000000001},"last":2.1379999999999999}]},{"osd":4,"last update":"Sun Oct 8 06:10:22 2023","interfaces":[{"interface":"back","average":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"min":{"1min":0.748,"5min":0.748,"15min":0.748},"max":{"1min":1.411,"5min":1.411,"15min":1.411},"last":0.67800000000000005},{"interface":"front","average":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"min":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"max":{"1min":1.79,"5min":1.79,"15min":1.79},"last":1.0589999999999999}]},{"osd":5,"last update":"Sun Oct 8 06:10:22 2023","interfaces":[{"interface":"back","average":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"min":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":2.25,"5min":2.25,"15min":2.25},"last":2.0600000000000001},{"interface":"front","average":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"min":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"max":{"1min":2.5950000000000002,"5min":2.5950000000000002,"15min":2.5950000000000002},"last":0.379}]},{"osd":7,"last update":"Sun Oct 8 06:10:22 2023","interfaces":[{"interface":"back","average":{"1min":1.204,"5min":1.204,"15min":1.204},"min":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"max":{"1min":1.6739999999999999,"5min":1.6739999999999999,"15min":1.6739999999999999},"last":1.673},{"interface":"front","average":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"min":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"max":{"1min":1.6299999999999999,"5min":1.6299999999999999,"15min":1.6299999999999999},"last":1.966}]}]},{"osd":5,"up_from":15,"seq":64424509458,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":397312,"data_stored":152942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 06:10:26 2023","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.871,"15min":0.871},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.27,"5min":1.27,"15min":1.27},"last":1.7030000000000001},{"interface":"front","average":{"1min":0.88,"5min":0.88,"15min":0.88},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.375,"5min":1.375,"15min":1.375},"last":1.2909999999999999}]},{"osd":1,"last update":"Sun Oct 8 06:10:26 2023","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.4370000000000001,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":1.6100000000000001},{"interface":"front","average":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.8660000000000001,"5min":1.8660000000000001,"15min":1.8660000000000001},"last":0.997}]},{"osd":2,"last update":"Sun Oct 8 06:10:26 2023","interfaces":[{"interface":"back","average":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.536,"5min":1.536,"15min":1.536},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"min":{"1min":0.626,"5min":0.626,"15min":0.626},"max":{"1min":1.633,"5min":1.633,"15min":1.633},"last":0.93300000000000005}]},{"osd":3,"last update":"Sun Oct 8 06:10:26 2023","interfaces":[{"interface":"back","average":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.7689999999999999,"5min":1.7689999999999999,"15min":1.7689999999999999},"last":1.2010000000000001},{"interface":"front","average":{"1min":1.018,"5min":1.018,"15min":1.018},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.355,"5min":1.355,"15min":1.355},"last":1.2450000000000001}]},{"osd":4,"last update":"Sun Oct 8 06:10:26 2023","interfaces":[{"interface":"back","average":{"1min":1.036,"5min":1.036,"15min":1.036},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.4330000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":1.379},{"interface":"front","average":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":2.056,"5min":2.056,"15min":2.056},"last":1.5389999999999999}]},{"osd":6,"last update":"Sun Oct 8 06:10:26 2023","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"min":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"max":{"1min":1.216,"5min":1.216,"15min":1.216},"last":1.1020000000000001},{"interface":"front","average":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"min":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"max":{"1min":1.827,"5min":1.827,"15min":1.827},"last":1.147}]},{"osd":7,"last update":"Sun Oct 8 06:10:26 2023","interfaces":[{"interface":"back","average":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"min":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":1.9490000000000001,"5min":1.9490000000000001,"15min":1.9490000000000001},"last":1.6579999999999999},{"interface":"front","average":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"min":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.696,"5min":1.696,"15min":1.696},"last":1.175}]}]},{"osd":4,"up_from":15,"seq":64424509458,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":397312,"data_stored":152374,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 06:10:27 2023","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.365,"5min":1.365,"15min":1.365},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.452,"5min":1.452,"15min":1.452},"last":1.121}]},{"osd":1,"last update":"Sun Oct 8 06:10:27 2023","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.87,"15min":0.87},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.282,"5min":1.282,"15min":1.282},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.413,"5min":1.413,"15min":1.413},"last":1.2150000000000001}]},{"osd":2,"last update":"Sun Oct 8 06:10:27 2023","interfaces":[{"interface":"back","average":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"min":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"max":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":1.175},{"interface":"front","average":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.5549999999999999,"5min":1.5549999999999999,"15min":1.5549999999999999},"last":0.99299999999999999}]},{"osd":3,"last update":"Sun Oct 8 06:10:27 2023","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"min":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.181,"5min":1.181,"15min":1.181},"last":1.262},{"interface":"front","average":{"1min":1.069,"5min":1.069,"15min":1.069},"min":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"max":{"1min":1.2509999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":0.94199999999999995}]},{"osd":5,"last update":"Sun Oct 8 06:10:27 2023","interfaces":[{"interface":"back","average":{"1min":1.022,"5min":1.022,"15min":1.022},"min":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"max":{"1min":1.502,"5min":1.502,"15min":1.502},"last":1.298},{"interface":"front","average":{"1min":1.042,"5min":1.042,"15min":1.042},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.5900000000000001,"5min":1.5900000000000001,"15min":1.5900000000000001},"last":1.4430000000000001}]},{"osd":6,"last update":"Sun Oct 8 06:10:27 2023","interfaces":[{"interface":"back","average":{"1min":1.109,"5min":1.109,"15min":1.109},"min":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":1.5900000000000001,"5min":1.5900000000000001,"15min":1.5900000000000001},"last":1.0660000000000001},{"interface":"front","average":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"min":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"max":{"1min":1.5940000000000001,"5min":1.5940000000000001,"15min":1.5940000000000001},"last":1.403}]},{"osd":7,"last update":"Sun Oct 8 06:10:27 2023","interfaces":[{"interface":"back","average":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"min":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.5549999999999999,"5min":1.5549999999999999,"15min":1.5549999999999999},"last":1.3620000000000001},{"interface":"front","average":{"1min":1.28,"5min":1.28,"15min":1.28},"min":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"max":{"1min":2.1280000000000001,"5min":2.1280000000000001,"15min":2.1280000000000001},"last":1.323}]}]},{"osd":2,"up_from":15,"seq":64424509458,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31568,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340272,"statfs":{"total":96636764160,"available":96604438528,"internally_reserved":0,"allocated":393216,"data_stored":152340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 06:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.2509999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.9019999999999999,"5min":1.9019999999999999,"15min":1.9019999999999999},"last":0.55100000000000005}]},{"osd":1,"last update":"Sun Oct 8 06:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.87,"15min":0.87},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.76,"5min":1.76,"15min":1.76},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.628}]},{"osd":3,"last update":"Sun Oct 8 06:10:25 2023","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.621,"5min":1.621,"15min":1.621},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":2.3929999999999998,"5min":2.3929999999999998,"15min":2.3929999999999998},"last":0.76300000000000001}]},{"osd":4,"last update":"Sun Oct 8 06:10:25 2023","interfaces":[{"interface":"back","average":{"1min":1.125,"5min":1.125,"15min":1.125},"min":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":2.3010000000000002,"5min":2.3010000000000002,"15min":2.3010000000000002},"last":0.94999999999999996},{"interface":"front","average":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"min":{"1min":0.875,"5min":0.875,"15min":0.875},"max":{"1min":1.6439999999999999,"5min":1.6439999999999999,"15min":1.6439999999999999},"last":1.1919999999999999}]},{"osd":5,"last update":"Sun Oct 8 06:10:25 2023","interfaces":[{"interface":"back","average":{"1min":1.133,"5min":1.133,"15min":1.133},"min":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"max":{"1min":1.726,"5min":1.726,"15min":1.726},"last":0.98899999999999999},{"interface":"front","average":{"1min":1.252,"5min":1.252,"15min":1.252},"min":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"max":{"1min":2.0249999999999999,"5min":2.0249999999999999,"15min":2.0249999999999999},"last":1.1619999999999999}]},{"osd":6,"last update":"Sun Oct 8 06:10:25 2023","interfaces":[{"interface":"back","average":{"1min":1.2889999999999999,"5min":1.2889999999999999,"15min":1.2889999999999999},"min":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"max":{"1min":2.3170000000000002,"5min":2.3170000000000002,"15min":2.3170000000000002},"last":1.0669999999999999},{"interface":"front","average":{"1min":1.143,"5min":1.143,"15min":1.143},"min":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"max":{"1min":2.2069999999999999,"5min":2.2069999999999999,"15min":2.2069999999999999},"last":0.88100000000000001}]},{"osd":7,"last update":"Sun Oct 8 06:10:25 2023","interfaces":[{"interface":"back","average":{"1min":1.171,"5min":1.171,"15min":1.171},"min":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"max":{"1min":1.53,"5min":1.53,"15min":1.53},"last":1.0229999999999999},{"interface":"front","average":{"1min":1.361,"5min":1.361,"15min":1.361},"min":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"max":{"1min":2.379,"5min":2.379,"15min":2.379},"last":1.2330000000000001}]}]},{"osd":1,"up_from":15,"seq":64424509457,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31580,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340260,"statfs":{"total":96636764160,"available":96604426240,"internally_reserved":0,"allocated":405504,"data_stored":153904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 06:10:23 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":1.266,"5min":1.266,"15min":1.266},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":1.157}]},{"osd":2,"last update":"Sun Oct 8 06:10:23 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":2.028,"5min":2.028,"15min":2.028},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":1.0289999999999999}]},{"osd":3,"last update":"Sun Oct 8 06:10:23 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":0.93799999999999994},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":2.0600000000000001,"5min":2.0600000000000001,"15min":2.0600000000000001},"last":0.86899999999999999}]},{"osd":4,"last update":"Sun Oct 8 06:10:23 2023","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"min":{"1min":0.628,"5min":0.628,"15min":0.628},"max":{"1min":1.74,"5min":1.74,"15min":1.74},"last":1.133},{"interface":"front","average":{"1min":0.999,"5min":0.999,"15min":0.999},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.3400000000000001,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":1.2749999999999999}]},{"osd":5,"last update":"Sun Oct 8 06:10:23 2023","interfaces":[{"interface":"back","average":{"1min":1.079,"5min":1.079,"15min":1.079},"min":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.887,"5min":1.887,"15min":1.887},"last":0.998},{"interface":"front","average":{"1min":1.052,"5min":1.052,"15min":1.052},"min":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":1.835,"5min":1.835,"15min":1.835},"last":1.212}]},{"osd":6,"last update":"Sun Oct 8 06:10:23 2023","interfaces":[{"interface":"back","average":{"1min":1.1479999999999999,"5min":1.1479999999999999,"15min":1.1479999999999999},"min":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":1.986,"5min":1.986,"15min":1.986},"last":1.2390000000000001},{"interface":"front","average":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"min":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.9410000000000001,"5min":1.9410000000000001,"15min":1.9410000000000001},"last":1.3160000000000001}]},{"osd":7,"last update":"Sun Oct 8 06:10:23 2023","interfaces":[{"interface":"back","average":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"min":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"max":{"1min":1.3939999999999999,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":1.6419999999999999},{"interface":"front","average":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"min":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":2.1699999999999999,"5min":2.1699999999999999,"15min":2.1699999999999999},"last":1.109}]}]},{"osd":0,"up_from":15,"seq":64424509458,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32140,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339700,"statfs":{"total":96636764160,"available":96603852800,"internally_reserved":0,"allocated":983040,"data_stored":742638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 06:10:27 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.83499999999999996}]},{"osd":2,"last update":"Sun Oct 8 06:10:27 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.143,"5min":1.143,"15min":1.143},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.212,"5min":1.212,"15min":1.212},"last":0.71399999999999997}]},{"osd":3,"last update":"Sun Oct 8 06:10:27 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.575,"5min":1.575,"15min":1.575},"last":1.0960000000000001}]},{"osd":4,"last update":"Sun Oct 8 06:10:27 2023","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"min":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.4259999999999999,"5min":1.4259999999999999,"15min":1.4259999999999999},"last":0.79400000000000004},{"interface":"front","average":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"min":{"1min":0.754,"5min":0.754,"15min":0.754},"max":{"1min":1.8069999999999999,"5min":1.8069999999999999,"15min":1.8069999999999999},"last":1.248}]},{"osd":5,"last update":"Sun Oct 8 06:10:27 2023","interfaces":[{"interface":"back","average":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"min":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"max":{"1min":1.363,"5min":1.363,"15min":1.363},"last":0.93000000000000005},{"interface":"front","average":{"1min":1.018,"5min":1.018,"15min":1.018},"min":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.3959999999999999,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":1.036}]},{"osd":6,"last update":"Sun Oct 8 06:10:27 2023","interfaces":[{"interface":"back","average":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"min":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.7030000000000001,"5min":1.7030000000000001,"15min":1.7030000000000001},"last":1.5489999999999999},{"interface":"front","average":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"min":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"max":{"1min":1.458,"5min":1.458,"15min":1.458},"last":1.006}]},{"osd":7,"last update":"Sun Oct 8 06:10:27 2023","interfaces":[{"interface":"back","average":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.637,"5min":1.637,"15min":1.637},"last":1.0680000000000001},{"interface":"front","average":{"1min":1.105,"5min":1.105,"15min":1.105},"min":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.5149999999999999,"5min":1.5149999999999999,"15min":1.5149999999999999},"last":1.143}]}]},{"osd":3,"up_from":14,"seq":60129542161,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31580,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340260,"statfs":{"total":96636764160,"available":96604426240,"internally_reserved":0,"allocated":405504,"data_stored":153904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 06:10:24 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.754}]},{"osd":1,"last update":"Sun Oct 8 06:10:24 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.98699999999999999},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":1.0249999999999999}]},{"osd":2,"last update":"Sun Oct 8 06:10:24 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":1.323,"5min":1.323,"15min":1.323},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.5660000000000001,"5min":1.5660000000000001,"15min":1.5660000000000001},"last":1.1799999999999999}]},{"osd":4,"last update":"Sun Oct 8 06:10:24 2023","interfaces":[{"interface":"back","average":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"min":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.899,"5min":1.899,"15min":1.899},"last":0.95199999999999996},{"interface":"front","average":{"1min":1.099,"5min":1.099,"15min":1.099},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":2.0950000000000002,"5min":2.0950000000000002,"15min":2.0950000000000002},"last":1.212}]},{"osd":5,"last update":"Sun Oct 8 06:10:24 2023","interfaces":[{"interface":"back","average":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.8129999999999999,"5min":1.8129999999999999,"15min":1.8129999999999999},"last":1.125},{"interface":"front","average":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"min":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":1.857,"5min":1.857,"15min":1.857},"last":1.579}]},{"osd":6,"last update":"Sun Oct 8 06:10:24 2023","interfaces":[{"interface":"back","average":{"1min":1.097,"5min":1.097,"15min":1.097},"min":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.6910000000000001,"5min":1.6910000000000001,"15min":1.6910000000000001},"last":1.6439999999999999},{"interface":"front","average":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"min":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":2.0459999999999998,"5min":2.0459999999999998,"15min":2.0459999999999998},"last":1.1599999999999999}]},{"osd":7,"last update":"Sun Oct 8 06:10:24 2023","interfaces":[{"interface":"back","average":{"1min":1.071,"5min":1.071,"15min":1.071},"min":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":1.7609999999999999,"5min":1.7609999999999999,"15min":1.7609999999999999},"last":1.2629999999999999},{"interface":"front","average":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.99,"5min":1.99,"15min":1.99},"last":1.357}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T06:10:40.259 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-08T06:10:40.259 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-08T06:10:40.389 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.387+0000 7f7c873f8700 1 Processor -- start 2023-10-08T06:10:40.389 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.387+0000 7f7c873f8700 1 -- start start 2023-10-08T06:10:40.391 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.387+0000 7f7c873f8700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7c8015d7b0 0x7f7c800ce1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:40.391 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.387+0000 7f7c873f8700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f7c800b1e90 0x7f7c800ce710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:40.391 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.387+0000 7f7c873f8700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c80162110 con 0x7f7c800b23e0 2023-10-08T06:10:40.391 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.387+0000 7f7c873f8700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c800d1610 con 0x7f7c800b1e90 2023-10-08T06:10:40.391 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.387+0000 7f7c873f8700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c800d0d40 con 0x7f7c8015d7b0 2023-10-08T06:10:40.391 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.387+0000 7f7c863f6700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7c8015d7b0 0x7f7c800ce1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:40.391 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.387+0000 7f7c86bf7700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f7c800b1e90 0x7f7c800ce710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:40.391 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.387+0000 7f7c863f6700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7c8015d7b0 0x7f7c800ce1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.32:46148/0 (socket says 172.21.15.32:46148) 2023-10-08T06:10:40.392 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.387+0000 7f7c863f6700 1 -- 172.21.15.32:0/2593408419 learned_addr learned my addr 172.21.15.32:0/2593408419 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:10:40.392 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.387+0000 7f7c86bf7700 1 -- 172.21.15.32:0/2593408419 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7c8015d7b0 msgr2=0x7f7c800ce1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:10:40.393 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.387+0000 7f7c86bf7700 1 --2- 172.21.15.32:0/2593408419 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7c8015d7b0 0x7f7c800ce1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:40.393 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.387+0000 7f7c86bf7700 1 -- 172.21.15.32:0/2593408419 >> v1:172.21.15.40:6789/0 conn(0x7f7c800b23e0 legacy=0x7f7c8006a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:40.393 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.387+0000 7f7c86bf7700 1 -- 172.21.15.32:0/2593408419 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c800d0f50 con 0x7f7c800b1e90 2023-10-08T06:10:40.393 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.387+0000 7f7c863f6700 1 --2- 172.21.15.32:0/2593408419 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7c8015d7b0 0x7f7c800ce1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T06:10:40.393 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.391+0000 7f7c86bf7700 1 --2- 172.21.15.32:0/2593408419 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7c800b1e90 0x7f7c800ce710 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f7c78009d90 tx=0x7f7c7800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fb52674d50b258d5 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:40.393 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.391+0000 7f7c853f4700 1 -- 172.21.15.32:0/2593408419 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c7800e070 con 0x7f7c800b1e90 2023-10-08T06:10:40.393 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.391+0000 7f7c853f4700 1 -- 172.21.15.32:0/2593408419 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c7800bb20 con 0x7f7c800b1e90 2023-10-08T06:10:40.393 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.391+0000 7f7c853f4700 1 -- 172.21.15.32:0/2593408419 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c78012430 con 0x7f7c800b1e90 2023-10-08T06:10:40.394 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.391+0000 7f7c873f8700 1 -- 172.21.15.32:0/2593408419 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7c800b1e90 msgr2=0x7f7c800ce710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:40.394 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.391+0000 7f7c873f8700 1 --2- 172.21.15.32:0/2593408419 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7c800b1e90 0x7f7c800ce710 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f7c78009d90 tx=0x7f7c7800b330 comp rx=0 tx=0).stop 2023-10-08T06:10:40.394 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.391+0000 7f7c873f8700 1 -- 172.21.15.32:0/2593408419 shutdown_connections 2023-10-08T06:10:40.394 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.391+0000 7f7c873f8700 1 --2- 172.21.15.32:0/2593408419 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7c800b1e90 0x7f7c800ce710 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:40.394 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.391+0000 7f7c873f8700 1 --2- 172.21.15.32:0/2593408419 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7c8015d7b0 0x7f7c800ce1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:40.394 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.391+0000 7f7c873f8700 1 -- 172.21.15.32:0/2593408419 >> 172.21.15.32:0/2593408419 conn(0x7f7c800d3170 msgr2=0x7f7c800d3580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:10:40.395 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.391+0000 7f7c873f8700 1 -- 172.21.15.32:0/2593408419 shutdown_connections 2023-10-08T06:10:40.395 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.391+0000 7f7c873f8700 1 -- 172.21.15.32:0/2593408419 wait complete. 2023-10-08T06:10:40.396 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.395+0000 7f7c873f8700 1 Processor -- start 2023-10-08T06:10:40.397 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.395+0000 7f7c873f8700 1 -- start start 2023-10-08T06:10:40.399 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.395+0000 7f7c873f8700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7c800b1e90 0x7f7c800c5010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:40.399 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.395+0000 7f7c873f8700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7c800b23e0 0x7f7c800c5550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:40.399 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.395+0000 7f7c873f8700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7c8015d7b0 0x7f7c8014b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:40.399 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.395+0000 7f7c873f8700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c800c5a90 con 0x7f7c800b1e90 2023-10-08T06:10:40.399 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.395+0000 7f7c873f8700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c80148d80 con 0x7f7c8015d7b0 2023-10-08T06:10:40.399 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.395+0000 7f7c873f8700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c80148fd0 con 0x7f7c800b23e0 2023-10-08T06:10:40.400 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.395+0000 7f7c863f6700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7c800b1e90 0x7f7c800c5010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:40.400 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.395+0000 7f7c863f6700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7c800b1e90 0x7f7c800c5010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:58718/0 (socket says 172.21.15.32:58718) 2023-10-08T06:10:40.400 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.395+0000 7f7c863f6700 1 -- 172.21.15.32:0/3879551525 learned_addr learned my addr 172.21.15.32:0/3879551525 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:10:40.400 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.395+0000 7f7c85bf5700 1 --2- 172.21.15.32:0/3879551525 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7c800b23e0 0x7f7c800c5550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:40.400 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.395+0000 7f7c86bf7700 1 --2- 172.21.15.32:0/3879551525 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7c8015d7b0 0x7f7c8014b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:40.401 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.399+0000 7f7c863f6700 1 -- 172.21.15.32:0/3879551525 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7c800b23e0 msgr2=0x7f7c800c5550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:40.401 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.399+0000 7f7c863f6700 1 --2- 172.21.15.32:0/3879551525 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7c800b23e0 0x7f7c800c5550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:40.401 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.399+0000 7f7c863f6700 1 -- 172.21.15.32:0/3879551525 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7c8015d7b0 msgr2=0x7f7c8014b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:40.401 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.399+0000 7f7c863f6700 1 --2- 172.21.15.32:0/3879551525 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7c8015d7b0 0x7f7c8014b0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:40.401 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.399+0000 7f7c863f6700 1 -- 172.21.15.32:0/3879551525 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c7c009570 con 0x7f7c800b1e90 2023-10-08T06:10:40.401 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.399+0000 7f7c863f6700 1 --2- 172.21.15.32:0/3879551525 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7c800b1e90 0x7f7c800c5010 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f7c7c00ebe0 tx=0x7f7c7c00eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:40.402 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.399+0000 7f7c76ffd700 1 -- 172.21.15.32:0/3879551525 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c7c00c850 con 0x7f7c800b1e90 2023-10-08T06:10:40.402 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.399+0000 7f7c76ffd700 1 -- 172.21.15.32:0/3879551525 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c7c00c9b0 con 0x7f7c800b1e90 2023-10-08T06:10:40.402 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.399+0000 7f7c76ffd700 1 -- 172.21.15.32:0/3879551525 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c7c00cd20 con 0x7f7c800b1e90 2023-10-08T06:10:40.402 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.399+0000 7f7c873f8700 1 -- 172.21.15.32:0/3879551525 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c78009a70 con 0x7f7c800b1e90 2023-10-08T06:10:40.402 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.399+0000 7f7c873f8700 1 -- 172.21.15.32:0/3879551525 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c80149590 con 0x7f7c800b1e90 2023-10-08T06:10:40.402 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.399+0000 7f7c873f8700 1 -- 172.21.15.32:0/3879551525 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c80073f00 con 0x7f7c800b1e90 2023-10-08T06:10:40.404 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.403+0000 7f7c76ffd700 1 -- 172.21.15.32:0/3879551525 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f7c7c004020 con 0x7f7c800b1e90 2023-10-08T06:10:40.404 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.403+0000 7f7c76ffd700 1 --2- 172.21.15.32:0/3879551525 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f7c64066510 0x7f7c640689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:40.404 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.403+0000 7f7c76ffd700 1 -- 172.21.15.32:0/3879551525 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7c7c083e80 con 0x7f7c800b1e90 2023-10-08T06:10:40.404 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.403+0000 7f7c85bf5700 1 --2- 172.21.15.32:0/3879551525 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f7c64066510 0x7f7c640689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:40.405 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.403+0000 7f7c85bf5700 1 --2- 172.21.15.32:0/3879551525 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f7c64066510 0x7f7c640689d0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f7c801f6430 tx=0x7f7c70009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:40.413 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.411+0000 7f7c76ffd700 1 -- 172.21.15.32:0/3879551525 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f7c7c051370 con 0x7f7c800b1e90 2023-10-08T06:10:40.636 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.635+0000 7f7c873f8700 1 -- 172.21.15.32:0/3879551525 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f7c800d3fa0 con 0x7f7c800b1e90 2023-10-08T06:10:40.641 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.639+0000 7f7c76ffd700 1 -- 172.21.15.32:0/3879551525 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v9) v1 ==== 190+0+147 (secure 0 0 0) 0x7f7c7c054990 con 0x7f7c800b1e90 2023-10-08T06:10:40.641 INFO:teuthology.orchestra.run.smithi032.stdout:[client.0] 2023-10-08T06:10:40.642 INFO:teuthology.orchestra.run.smithi032.stdout: key = AQBjRyJljskKKBAALCz7TUBic1qBcdHhz2xJFQ== 2023-10-08T06:10:40.642 INFO:teuthology.orchestra.run.smithi032.stdout: caps mds = "allow" 2023-10-08T06:10:40.642 INFO:teuthology.orchestra.run.smithi032.stdout: caps mon = "allow r" 2023-10-08T06:10:40.642 INFO:teuthology.orchestra.run.smithi032.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-10-08T06:10:40.646 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.643+0000 7f7c873f8700 1 -- 172.21.15.32:0/3879551525 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f7c64066510 msgr2=0x7f7c640689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:40.646 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.643+0000 7f7c873f8700 1 --2- 172.21.15.32:0/3879551525 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f7c64066510 0x7f7c640689d0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f7c801f6430 tx=0x7f7c70009040 comp rx=0 tx=0).stop 2023-10-08T06:10:40.646 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.643+0000 7f7c873f8700 1 -- 172.21.15.32:0/3879551525 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7c800b1e90 msgr2=0x7f7c800c5010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:40.646 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.643+0000 7f7c873f8700 1 --2- 172.21.15.32:0/3879551525 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7c800b1e90 0x7f7c800c5010 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f7c7c00ebe0 tx=0x7f7c7c00eef0 comp rx=0 tx=0).stop 2023-10-08T06:10:40.646 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.643+0000 7f7c873f8700 1 -- 172.21.15.32:0/3879551525 shutdown_connections 2023-10-08T06:10:40.646 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.643+0000 7f7c873f8700 1 --2- 172.21.15.32:0/3879551525 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f7c64066510 0x7f7c640689d0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:40.646 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.643+0000 7f7c873f8700 1 --2- 172.21.15.32:0/3879551525 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7c8015d7b0 0x7f7c8014b0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:40.646 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.643+0000 7f7c873f8700 1 --2- 172.21.15.32:0/3879551525 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7c800b23e0 0x7f7c800c5550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:40.646 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.643+0000 7f7c873f8700 1 --2- 172.21.15.32:0/3879551525 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7c800b1e90 0x7f7c800c5010 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:40.646 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.643+0000 7f7c873f8700 1 -- 172.21.15.32:0/3879551525 >> 172.21.15.32:0/3879551525 conn(0x7f7c800d3170 msgr2=0x7f7c800c7140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:10:40.647 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.643+0000 7f7c873f8700 1 -- 172.21.15.32:0/3879551525 shutdown_connections 2023-10-08T06:10:40.647 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.643+0000 7f7c873f8700 1 -- 172.21.15.32:0/3879551525 wait complete. 2023-10-08T06:10:40.647 INFO:teuthology.orchestra.run.smithi032.stderr:updated caps for client.0 2023-10-08T06:10:40.663 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T06:10:40.775 INFO:tasks.ceph.mds.b.smithi040.stderr:2023-10-08T06:10:40.770+0000 7f4c72405700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-08T06:10:40.779 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.775+0000 7fdc3482b700 1 Processor -- start 2023-10-08T06:10:40.779 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.775+0000 7fdc3482b700 1 -- start start 2023-10-08T06:10:40.780 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.779+0000 7fdc3482b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fdc30159ed0 0x7fdc300ca9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:40.780 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.779+0000 7fdc3482b700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fdc300c98c0 0x7fdc300cb510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:40.780 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.779+0000 7fdc3482b700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc300cca40 con 0x7fdc3015a2b0 2023-10-08T06:10:40.780 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.779+0000 7fdc3482b700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc300ccdb0 con 0x7fdc300c98c0 2023-10-08T06:10:40.780 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.779+0000 7fdc3482b700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc300caef0 con 0x7fdc30159ed0 2023-10-08T06:10:40.780 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.779+0000 7fdc2effd700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fdc3015a2b0 0x7fdc300706f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:35470/0 (socket says 172.21.15.32:35470) 2023-10-08T06:10:40.780 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.779+0000 7fdc2effd700 1 -- 172.21.15.32:0/1515157183 learned_addr learned my addr 172.21.15.32:0/1515157183 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-08T06:10:40.780 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.779+0000 7fdc2ffff700 1 --2- 172.21.15.32:0/1515157183 >> v2:172.21.15.32:3300/0 conn(0x7fdc300c98c0 0x7fdc300cb510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:40.781 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.779+0000 7fdc2f7fe700 1 --2- 172.21.15.32:0/1515157183 >> v2:172.21.15.40:3300/0 conn(0x7fdc30159ed0 0x7fdc300ca9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:40.781 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.779+0000 7fdc2e7fc700 1 -- 172.21.15.32:0/1515157183 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2158148451 0 0) 0x7fdc300cca40 con 0x7fdc3015a2b0 2023-10-08T06:10:40.782 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.779+0000 7fdc2e7fc700 1 -- 172.21.15.32:0/1515157183 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdc180035d0 con 0x7fdc3015a2b0 2023-10-08T06:10:40.782 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.779+0000 7fdc2ffff700 1 -- 172.21.15.32:0/1515157183 >> v2:172.21.15.40:3300/0 conn(0x7fdc30159ed0 msgr2=0x7fdc300ca9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:10:40.782 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.779+0000 7fdc2ffff700 1 --2- 172.21.15.32:0/1515157183 >> v2:172.21.15.40:3300/0 conn(0x7fdc30159ed0 0x7fdc300ca9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:40.782 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.779+0000 7fdc2ffff700 1 -- 172.21.15.32:0/1515157183 >> v1:172.21.15.32:6789/0 conn(0x7fdc3015a2b0 legacy=0x7fdc300706f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:40.782 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.779+0000 7fdc2ffff700 1 -- 172.21.15.32:0/1515157183 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc300cdf60 con 0x7fdc300c98c0 2023-10-08T06:10:40.782 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.779+0000 7fdc2ffff700 1 --2- 172.21.15.32:0/1515157183 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdc300c98c0 0x7fdc300cb510 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fdc300685d0 tx=0x7fdc28009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bc9747b5ed8a56b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:40.782 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.779+0000 7fdc2e7fc700 1 -- 172.21.15.32:0/1515157183 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc28011830 con 0x7fdc300c98c0 2023-10-08T06:10:40.782 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.779+0000 7fdc2e7fc700 1 -- 172.21.15.32:0/1515157183 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc28011990 con 0x7fdc300c98c0 2023-10-08T06:10:40.782 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.779+0000 7fdc2e7fc700 1 -- 172.21.15.32:0/1515157183 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc28011d00 con 0x7fdc300c98c0 2023-10-08T06:10:40.783 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.779+0000 7fdc3482b700 1 -- 172.21.15.32:0/1515157183 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdc300c98c0 msgr2=0x7fdc300cb510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:40.783 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.779+0000 7fdc3482b700 1 --2- 172.21.15.32:0/1515157183 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdc300c98c0 0x7fdc300cb510 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fdc300685d0 tx=0x7fdc28009b30 comp rx=0 tx=0).stop 2023-10-08T06:10:40.783 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.779+0000 7fdc3482b700 1 -- 172.21.15.32:0/1515157183 shutdown_connections 2023-10-08T06:10:40.783 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.779+0000 7fdc3482b700 1 --2- 172.21.15.32:0/1515157183 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdc300c98c0 0x7fdc300cb510 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:40.784 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.779+0000 7fdc3482b700 1 --2- 172.21.15.32:0/1515157183 >> v2:172.21.15.40:3300/0 conn(0x7fdc30159ed0 0x7fdc300ca9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:40.784 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.779+0000 7fdc3482b700 1 -- 172.21.15.32:0/1515157183 >> 172.21.15.32:0/1515157183 conn(0x7fdc300b0900 msgr2=0x7fdc300b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:10:40.784 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.779+0000 7fdc3482b700 1 -- 172.21.15.32:0/1515157183 shutdown_connections 2023-10-08T06:10:40.784 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.779+0000 7fdc3482b700 1 -- 172.21.15.32:0/1515157183 wait complete. 2023-10-08T06:10:40.784 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.783+0000 7fdc3482b700 1 Processor -- start 2023-10-08T06:10:40.784 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.783+0000 7fdc3482b700 1 -- start start 2023-10-08T06:10:40.786 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.783+0000 7fdc3482b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdc300c98c0 0x7fdc300b28d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:40.786 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.783+0000 7fdc3482b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdc30159ed0 0x7fdc300c7e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:40.786 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.783+0000 7fdc3482b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdc3015a2b0 0x7fdc300b3ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:40.786 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.783+0000 7fdc3482b700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc300c6db0 con 0x7fdc300c98c0 2023-10-08T06:10:40.786 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.783+0000 7fdc3482b700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc300c7090 con 0x7fdc3015a2b0 2023-10-08T06:10:40.787 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.783+0000 7fdc3482b700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc300c7370 con 0x7fdc30159ed0 2023-10-08T06:10:40.787 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.783+0000 7fdc2f7fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdc300c98c0 0x7fdc300b28d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:40.787 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.783+0000 7fdc2f7fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdc300c98c0 0x7fdc300b28d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:58730/0 (socket says 172.21.15.32:58730) 2023-10-08T06:10:40.787 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.783+0000 7fdc2f7fe700 1 -- 172.21.15.32:0/2801268193 learned_addr learned my addr 172.21.15.32:0/2801268193 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:10:40.787 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.783+0000 7fdc2ffff700 1 --2- 172.21.15.32:0/2801268193 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdc3015a2b0 0x7fdc300b3ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:40.787 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.783+0000 7fdc2effd700 1 --2- 172.21.15.32:0/2801268193 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdc30159ed0 0x7fdc300c7e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:40.788 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.783+0000 7fdc2f7fe700 1 -- 172.21.15.32:0/2801268193 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdc30159ed0 msgr2=0x7fdc300c7e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:40.788 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.783+0000 7fdc2f7fe700 1 --2- 172.21.15.32:0/2801268193 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdc30159ed0 0x7fdc300c7e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:40.788 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.783+0000 7fdc2f7fe700 1 -- 172.21.15.32:0/2801268193 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdc3015a2b0 msgr2=0x7fdc300b3ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:40.789 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.783+0000 7fdc2f7fe700 1 --2- 172.21.15.32:0/2801268193 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdc3015a2b0 0x7fdc300b3ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:40.789 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.783+0000 7fdc2f7fe700 1 -- 172.21.15.32:0/2801268193 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc280094b0 con 0x7fdc300c98c0 2023-10-08T06:10:40.789 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.783+0000 7fdc2f7fe700 1 --2- 172.21.15.32:0/2801268193 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdc300c98c0 0x7fdc300b28d0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fdc2400e9d0 tx=0x7fdc2400ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:40.789 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.783+0000 7fdc17fff700 1 -- 172.21.15.32:0/2801268193 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc24009720 con 0x7fdc300c98c0 2023-10-08T06:10:40.789 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.783+0000 7fdc17fff700 1 -- 172.21.15.32:0/2801268193 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc2400ee70 con 0x7fdc300c98c0 2023-10-08T06:10:40.789 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.783+0000 7fdc3482b700 1 -- 172.21.15.32:0/2801268193 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc300c7650 con 0x7fdc300c98c0 2023-10-08T06:10:40.789 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.787+0000 7fdc17fff700 1 -- 172.21.15.32:0/2801268193 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc2400ca50 con 0x7fdc300c98c0 2023-10-08T06:10:40.789 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.787+0000 7fdc3482b700 1 -- 172.21.15.32:0/2801268193 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc300b2e10 con 0x7fdc300c98c0 2023-10-08T06:10:40.790 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.787+0000 7fdc3482b700 1 -- 172.21.15.32:0/2801268193 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc30073f00 con 0x7fdc300c98c0 2023-10-08T06:10:40.790 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.787+0000 7fdc17fff700 1 -- 172.21.15.32:0/2801268193 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fdc2400cbb0 con 0x7fdc300c98c0 2023-10-08T06:10:40.791 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.787+0000 7fdc17fff700 1 --2- 172.21.15.32:0/2801268193 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fdc1c066510 0x7fdc1c0689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:40.792 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.791+0000 7fdc2effd700 1 --2- 172.21.15.32:0/2801268193 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fdc1c066510 0x7fdc1c0689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:40.792 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.791+0000 7fdc17fff700 1 -- 172.21.15.32:0/2801268193 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdc24083dd0 con 0x7fdc300c98c0 2023-10-08T06:10:40.792 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.791+0000 7fdc2effd700 1 --2- 172.21.15.32:0/2801268193 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fdc1c066510 0x7fdc1c0689d0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fdc3014cf10 tx=0x7fdc20009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:40.796 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.795+0000 7fdc17fff700 1 -- 172.21.15.32:0/2801268193 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fdc240512e0 con 0x7fdc300c98c0 2023-10-08T06:10:41.000 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.999+0000 7fdc3482b700 1 -- 172.21.15.32:0/2801268193 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdc300b4d50 con 0x7fdc300c98c0 2023-10-08T06:10:41.001 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.999+0000 7fdc17fff700 1 -- 172.21.15.32:0/2801268193 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+4909 (secure 0 0 0) 0x7fdc2400ce60 con 0x7fdc300c98c0 2023-10-08T06:10:41.001 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:10:41.002 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":14,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5232,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6835/1178250724","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6834","nonce":1178250724},{"type":"v1","addr":"172.21.15.32:6835","nonce":1178250724}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10},{"gid":5238,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6837/2723596589","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6836","nonce":2723596589},{"type":"v1","addr":"172.21.15.32:6837","nonce":2723596589}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10},{"gid":5323,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6833/3107673350","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":3107673350},{"type":"v1","addr":"172.21.15.40:6833","nonce":3107673350}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T06:10:35.216976+0000","modified":"2023-10-08T06:10:38.240290+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5326},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5326":{"gid":5326,"name":"b","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.40:6835/500201668","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":500201668},{"type":"v1","addr":"172.21.15.40:6835","nonce":500201668}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-10-08T06:10:41.004 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.999+0000 7fdc3482b700 1 -- 172.21.15.32:0/2801268193 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fdc1c066510 msgr2=0x7fdc1c0689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:41.004 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:40.999+0000 7fdc3482b700 1 --2- 172.21.15.32:0/2801268193 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fdc1c066510 0x7fdc1c0689d0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fdc3014cf10 tx=0x7fdc20009040 comp rx=0 tx=0).stop 2023-10-08T06:10:41.004 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.003+0000 7fdc3482b700 1 -- 172.21.15.32:0/2801268193 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdc300c98c0 msgr2=0x7fdc300b28d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:41.004 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.003+0000 7fdc3482b700 1 --2- 172.21.15.32:0/2801268193 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdc300c98c0 0x7fdc300b28d0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fdc2400e9d0 tx=0x7fdc2400ece0 comp rx=0 tx=0).stop 2023-10-08T06:10:41.004 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.003+0000 7fdc3482b700 1 -- 172.21.15.32:0/2801268193 shutdown_connections 2023-10-08T06:10:41.004 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.003+0000 7fdc3482b700 1 --2- 172.21.15.32:0/2801268193 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fdc1c066510 0x7fdc1c0689d0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:41.004 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.003+0000 7fdc3482b700 1 --2- 172.21.15.32:0/2801268193 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdc3015a2b0 0x7fdc300b3ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:41.004 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.003+0000 7fdc3482b700 1 --2- 172.21.15.32:0/2801268193 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdc30159ed0 0x7fdc300c7e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:41.005 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.003+0000 7fdc3482b700 1 --2- 172.21.15.32:0/2801268193 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdc300c98c0 0x7fdc300b28d0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:41.005 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.003+0000 7fdc3482b700 1 -- 172.21.15.32:0/2801268193 >> 172.21.15.32:0/2801268193 conn(0x7fdc300b0900 msgr2=0x7fdc300af9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:10:41.005 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.003+0000 7fdc3482b700 1 -- 172.21.15.32:0/2801268193 shutdown_connections 2023-10-08T06:10:41.005 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.003+0000 7fdc3482b700 1 -- 172.21.15.32:0/2801268193 wait complete. 2023-10-08T06:10:41.005 INFO:teuthology.orchestra.run.smithi032.stderr:dumped fsmap epoch 14 2023-10-08T06:10:41.419 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 14, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-08T06:10:35.216976+0000', 'modified': '2023-10-08T06:10:38.240290+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5326}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5326': {'gid': 5326, 'name': 'b', 'rank': 0, 'incarnation': 11, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.40:6835/500201668', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.40:6834', 'nonce': 500201668}, {'type': 'v1', 'addr': '172.21.15.40:6835', 'nonce': 500201668}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-10-08T06:10:41.419 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-08T06:10:41.419 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-10-08T06:10:41.542 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.539+0000 7f70d0f0d700 1 Processor -- start 2023-10-08T06:10:41.542 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.539+0000 7f70d0f0d700 1 -- start start 2023-10-08T06:10:41.543 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.539+0000 7f70d0f0d700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f70cc0ce4e0 0x7f70cc167e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:41.543 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.539+0000 7f70d0f0d700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70cc0b9000 con 0x7f70cc0b8bc0 2023-10-08T06:10:41.543 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.539+0000 7f70d0f0d700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70cc0d1bb0 con 0x7f70cc15d490 2023-10-08T06:10:41.543 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.539+0000 7f70d0f0d700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70cc0d1e90 con 0x7f70cc0ce4e0 2023-10-08T06:10:41.544 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.539+0000 7f70caffd700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f70cc0b8bc0 0x7f70cc0cddd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:35482/0 (socket says 172.21.15.32:35482) 2023-10-08T06:10:41.544 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.539+0000 7f70caffd700 1 -- 172.21.15.32:0/3157386773 learned_addr learned my addr 172.21.15.32:0/3157386773 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-08T06:10:41.544 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.543+0000 7f70cbfff700 1 --2- 172.21.15.32:0/3157386773 >> v2:172.21.15.40:3300/0 conn(0x7f70cc0ce4e0 0x7f70cc167e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:41.545 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.543+0000 7f70ca7fc700 1 -- 172.21.15.32:0/3157386773 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4184459033 0 0) 0x7f70bc001110 con 0x7f70cc0b8bc0 2023-10-08T06:10:41.545 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.543+0000 7f70ca7fc700 1 -- 172.21.15.32:0/3157386773 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f70b80035d0 con 0x7f70cc0b8bc0 2023-10-08T06:10:41.545 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.543+0000 7f70cbfff700 1 -- 172.21.15.32:0/3157386773 >> v1:172.21.15.40:6789/0 conn(0x7f70cc15d490 legacy=0x7f70cc0d13d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:41.545 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.543+0000 7f70cbfff700 1 -- 172.21.15.32:0/3157386773 >> v1:172.21.15.32:6789/0 conn(0x7f70cc0b8bc0 legacy=0x7f70cc0cddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:41.545 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.543+0000 7f70cbfff700 1 -- 172.21.15.32:0/3157386773 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70cc0d2170 con 0x7f70cc0ce4e0 2023-10-08T06:10:41.545 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.543+0000 7f70cbfff700 1 --2- 172.21.15.32:0/3157386773 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f70cc0ce4e0 0x7f70cc167e20 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f70c4009d90 tx=0x7f70c400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1e086bbafd903583 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:41.546 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.543+0000 7f70ca7fc700 1 -- 172.21.15.32:0/3157386773 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70c400e070 con 0x7f70cc0ce4e0 2023-10-08T06:10:41.546 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.543+0000 7f70ca7fc700 1 -- 172.21.15.32:0/3157386773 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70c400bb20 con 0x7f70cc0ce4e0 2023-10-08T06:10:41.546 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.543+0000 7f70ca7fc700 1 -- 172.21.15.32:0/3157386773 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70c4012430 con 0x7f70cc0ce4e0 2023-10-08T06:10:41.546 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.543+0000 7f70d0f0d700 1 -- 172.21.15.32:0/3157386773 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f70cc0ce4e0 msgr2=0x7f70cc167e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:41.546 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.543+0000 7f70d0f0d700 1 --2- 172.21.15.32:0/3157386773 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f70cc0ce4e0 0x7f70cc167e20 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f70c4009d90 tx=0x7f70c400b330 comp rx=0 tx=0).stop 2023-10-08T06:10:41.547 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.543+0000 7f70d0f0d700 1 -- 172.21.15.32:0/3157386773 shutdown_connections 2023-10-08T06:10:41.547 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.543+0000 7f70d0f0d700 1 --2- 172.21.15.32:0/3157386773 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f70cc0ce4e0 0x7f70cc167e20 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:41.547 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.543+0000 7f70d0f0d700 1 -- 172.21.15.32:0/3157386773 >> 172.21.15.32:0/3157386773 conn(0x7f70cc06ab40 msgr2=0x7f70cc06af20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:10:41.547 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.543+0000 7f70d0f0d700 1 -- 172.21.15.32:0/3157386773 shutdown_connections 2023-10-08T06:10:41.547 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.543+0000 7f70d0f0d700 1 -- 172.21.15.32:0/3157386773 wait complete. 2023-10-08T06:10:41.548 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.547+0000 7f70d0f0d700 1 Processor -- start 2023-10-08T06:10:41.548 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.547+0000 7f70d0f0d700 1 -- start start 2023-10-08T06:10:41.550 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.547+0000 7f70d0f0d700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f70cc0b8bc0 0x7f70cc0c7aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:41.550 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.547+0000 7f70d0f0d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f70cc0ce4e0 0x7f70cc1f5fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:41.550 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.547+0000 7f70d0f0d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f70cc15d490 0x7f70cc14fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:41.550 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.547+0000 7f70d0f0d700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70cc15dbc0 con 0x7f70cc0b8bc0 2023-10-08T06:10:41.550 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.547+0000 7f70d0f0d700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70cc1f6520 con 0x7f70cc15d490 2023-10-08T06:10:41.550 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.547+0000 7f70d0f0d700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70cc15d870 con 0x7f70cc0ce4e0 2023-10-08T06:10:41.551 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.547+0000 7f70cb7fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f70cc0b8bc0 0x7f70cc0c7aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:41.551 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.547+0000 7f70cb7fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f70cc0b8bc0 0x7f70cc0c7aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:58734/0 (socket says 172.21.15.32:58734) 2023-10-08T06:10:41.551 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.547+0000 7f70cb7fe700 1 -- 172.21.15.32:0/3902656585 learned_addr learned my addr 172.21.15.32:0/3902656585 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:10:41.551 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.547+0000 7f70cbfff700 1 --2- 172.21.15.32:0/3902656585 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f70cc15d490 0x7f70cc14fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:41.551 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.547+0000 7f70caffd700 1 --2- 172.21.15.32:0/3902656585 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f70cc0ce4e0 0x7f70cc1f5fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:41.552 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.547+0000 7f70cb7fe700 1 -- 172.21.15.32:0/3902656585 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f70cc0ce4e0 msgr2=0x7f70cc1f5fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:41.552 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.547+0000 7f70cb7fe700 1 --2- 172.21.15.32:0/3902656585 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f70cc0ce4e0 0x7f70cc1f5fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:41.552 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.547+0000 7f70cb7fe700 1 -- 172.21.15.32:0/3902656585 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f70cc15d490 msgr2=0x7f70cc14fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:41.552 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.547+0000 7f70cb7fe700 1 --2- 172.21.15.32:0/3902656585 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f70cc15d490 0x7f70cc14fb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:41.552 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.547+0000 7f70cb7fe700 1 -- 172.21.15.32:0/3902656585 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70c4009a70 con 0x7f70cc0b8bc0 2023-10-08T06:10:41.553 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.547+0000 7f70cb7fe700 1 --2- 172.21.15.32:0/3902656585 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f70cc0b8bc0 0x7f70cc0c7aa0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f70b400c500 tx=0x7f70b400c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:41.553 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.547+0000 7f70c3fff700 1 -- 172.21.15.32:0/3902656585 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70b40052d0 con 0x7f70cc0b8bc0 2023-10-08T06:10:41.553 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.547+0000 7f70c3fff700 1 -- 172.21.15.32:0/3902656585 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70b4005430 con 0x7f70cc0b8bc0 2023-10-08T06:10:41.553 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.547+0000 7f70d0f0d700 1 -- 172.21.15.32:0/3902656585 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70cc1f67c0 con 0x7f70cc0b8bc0 2023-10-08T06:10:41.553 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.547+0000 7f70c3fff700 1 -- 172.21.15.32:0/3902656585 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70b40055a0 con 0x7f70cc0b8bc0 2023-10-08T06:10:41.553 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.551+0000 7f70d0f0d700 1 -- 172.21.15.32:0/3902656585 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70cc1f6d80 con 0x7f70cc0b8bc0 2023-10-08T06:10:41.554 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.551+0000 7f70c3fff700 1 -- 172.21.15.32:0/3902656585 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f70b40038e0 con 0x7f70cc0b8bc0 2023-10-08T06:10:41.555 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.551+0000 7f70c3fff700 1 --2- 172.21.15.32:0/3902656585 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f70ac066510 0x7f70ac0689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:41.555 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.551+0000 7f70caffd700 1 --2- 172.21.15.32:0/3902656585 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f70ac066510 0x7f70ac0689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:41.555 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.551+0000 7f70c3fff700 1 -- 172.21.15.32:0/3902656585 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f70b40830a0 con 0x7f70cc0b8bc0 2023-10-08T06:10:41.556 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.555+0000 7f70caffd700 1 --2- 172.21.15.32:0/3902656585 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f70ac066510 0x7f70ac0689d0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f70bc007fd0 tx=0x7f70bc007c60 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:41.557 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.555+0000 7f70d542b740 1 Processor -- start 2023-10-08T06:10:41.557 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.555+0000 7f70d542b740 1 -- start start 2023-10-08T06:10:41.559 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.555+0000 7f70d542b740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x23a66f0 0x23a6ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:41.559 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.555+0000 7f70d542b740 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x23a49a0 0x23a7010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:41.559 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.555+0000 7f70d542b740 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x23a7550 0x23a7930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:41.559 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.555+0000 7f70d542b740 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x22d6620 con 0x23a7550 2023-10-08T06:10:41.559 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.555+0000 7f70d542b740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x22d3d10 con 0x23a66f0 2023-10-08T06:10:41.559 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.555+0000 7f70d542b740 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x22cf600 con 0x23a49a0 2023-10-08T06:10:41.559 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.555+0000 7f70cbfff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x23a7550 0x23a7930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:41.559 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.555+0000 7f70cbfff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x23a7550 0x23a7930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:58738/0 (socket says 172.21.15.32:58738) 2023-10-08T06:10:41.560 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.555+0000 7f70cbfff700 1 -- 172.21.15.32:0/3366977196 learned_addr learned my addr 172.21.15.32:0/3366977196 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:10:41.560 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.555+0000 7f70caffd700 1 --2- 172.21.15.32:0/3366977196 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x23a49a0 0x23a7010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:41.560 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.555+0000 7f70cb7fe700 1 --2- 172.21.15.32:0/3366977196 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x23a66f0 0x23a6ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:41.560 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.555+0000 7f70cbfff700 1 -- 172.21.15.32:0/3366977196 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x23a49a0 msgr2=0x23a7010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:10:41.560 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.555+0000 7f70cbfff700 1 --2- 172.21.15.32:0/3366977196 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x23a49a0 0x23a7010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:41.560 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.555+0000 7f70cbfff700 1 -- 172.21.15.32:0/3366977196 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x23a66f0 msgr2=0x23a6ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:10:41.560 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.555+0000 7f70cbfff700 1 --2- 172.21.15.32:0/3366977196 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x23a66f0 0x23a6ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:41.560 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.555+0000 7f70cbfff700 1 -- 172.21.15.32:0/3366977196 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x22f4850 con 0x23a7550 2023-10-08T06:10:41.560 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.555+0000 7f70cbfff700 1 --2- 172.21.15.32:0/3366977196 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x23a7550 0x23a7930 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f70c4013000 tx=0x7f70c4010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c618d1cb768b2303 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:41.561 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.555+0000 7f70c17fa700 1 -- 172.21.15.32:0/3366977196 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70c4003b40 con 0x23a7550 2023-10-08T06:10:41.562 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.555+0000 7f70c17fa700 1 -- 172.21.15.32:0/3366977196 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70c4003ca0 con 0x23a7550 2023-10-08T06:10:41.562 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.555+0000 7f70c17fa700 1 -- 172.21.15.32:0/3366977196 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70c4012820 con 0x23a7550 2023-10-08T06:10:41.562 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.559+0000 7f70d542b740 1 -- 172.21.15.32:0/3366977196 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x23a7550 msgr2=0x23a7930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:41.562 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.559+0000 7f70d542b740 1 --2- 172.21.15.32:0/3366977196 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x23a7550 0x23a7930 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f70c4013000 tx=0x7f70c4010000 comp rx=0 tx=0).stop 2023-10-08T06:10:41.562 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.559+0000 7f70d542b740 1 -- 172.21.15.32:0/3366977196 shutdown_connections 2023-10-08T06:10:41.562 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.559+0000 7f70d542b740 1 --2- 172.21.15.32:0/3366977196 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x23a7550 0x23a7930 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:41.562 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.559+0000 7f70d542b740 1 --2- 172.21.15.32:0/3366977196 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x23a49a0 0x23a7010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:41.562 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.559+0000 7f70d542b740 1 --2- 172.21.15.32:0/3366977196 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x23a66f0 0x23a6ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:41.562 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.559+0000 7f70d542b740 1 -- 172.21.15.32:0/3366977196 >> 172.21.15.32:0/3366977196 conn(0x20f44d0 msgr2=0x238f160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:10:41.563 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.559+0000 7f70d542b740 1 -- 172.21.15.32:0/3366977196 shutdown_connections 2023-10-08T06:10:41.563 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.559+0000 7f70d542b740 1 -- 172.21.15.32:0/3366977196 wait complete. 2023-10-08T06:10:41.563 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.559+0000 7f70d542b740 1 -- start start 2023-10-08T06:10:41.563 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.559+0000 7f70d542b740 1 Processor -- start 2023-10-08T06:10:41.565 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.559+0000 7f70d542b740 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x23a49a0 0x2367680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:41.565 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.559+0000 7f70d542b740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x23a66f0 0x238c380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:41.565 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.559+0000 7f70d542b740 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x23a7550 0x238c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:41.565 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.559+0000 7f70d542b740 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x228d6e0 con 0x23a7550 2023-10-08T06:10:41.565 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.559+0000 7f70d542b740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x228d380 con 0x23a66f0 2023-10-08T06:10:41.565 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.559+0000 7f70d542b740 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x2178aa0 con 0x23a49a0 2023-10-08T06:10:41.566 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.559+0000 7f70d542b740 10 client.0 _ll_register_callbacks cb 0x227ca10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T06:10:41.566 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.559+0000 7f70cbfff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x23a7550 0x238c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:41.566 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.559+0000 7f70cbfff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x23a7550 0x238c8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:58752/0 (socket says 172.21.15.32:58752) 2023-10-08T06:10:41.566 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.559+0000 7f70cbfff700 1 -- 172.21.15.32:0/3640523806 learned_addr learned my addr 172.21.15.32:0/3640523806 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:10:41.566 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.559+0000 7f70cb7fe700 1 --2- 172.21.15.32:0/3640523806 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x23a49a0 0x2367680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:41.566 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.559+0000 7f70caffd700 1 --2- 172.21.15.32:0/3640523806 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x23a66f0 0x238c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:41.566 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.559+0000 7f70cbfff700 1 -- 172.21.15.32:0/3640523806 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x23a49a0 msgr2=0x2367680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:10:41.566 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.559+0000 7f70cbfff700 1 --2- 172.21.15.32:0/3640523806 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x23a49a0 0x2367680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:41.566 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.559+0000 7f70cbfff700 1 -- 172.21.15.32:0/3640523806 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x23a66f0 msgr2=0x238c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:10:41.566 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.559+0000 7f70cbfff700 1 --2- 172.21.15.32:0/3640523806 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x23a66f0 0x238c380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:41.566 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.559+0000 7f70cbfff700 1 -- 172.21.15.32:0/3640523806 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70cc0d2170 con 0x23a7550 2023-10-08T06:10:41.567 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.559+0000 7f70caffd700 1 --2- 172.21.15.32:0/3640523806 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x23a66f0 0x238c380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T06:10:41.567 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.559+0000 7f70cbfff700 1 --2- 172.21.15.32:0/3640523806 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x23a7550 0x238c8c0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f70c400b680 tx=0x7f70c400e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a52818b3423df6b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:41.567 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.559+0000 7f70aa7fc700 10 client.0 ms_handle_connect on v2:172.21.15.32:3300/0 2023-10-08T06:10:41.567 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.563+0000 7f70aa7fc700 1 -- 172.21.15.32:0/3640523806 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70c4003b40 con 0x23a7550 2023-10-08T06:10:41.567 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.563+0000 7f70d542b740 1 -- 172.21.15.32:0/3640523806 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x22c85e0 con 0x23a7550 2023-10-08T06:10:41.567 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.563+0000 7f70aa7fc700 1 -- 172.21.15.32:0/3640523806 <== mon.0 v2:172.21.15.32:3300/0 2 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f70c4012e00 con 0x23a7550 2023-10-08T06:10:41.567 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.563+0000 7f70aa7fc700 1 -- 172.21.15.32:0/3640523806 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) v2 ==== 24+0+0 (secure 0 0 0) 0x7f70c4026670 con 0x23a7550 2023-10-08T06:10:41.567 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.563+0000 7f70d542b740 10 client.5415 fetch_fsmap learned FSMap version 14 2023-10-08T06:10:41.567 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.563+0000 7f70d542b740 1 -- 172.21.15.32:0/3640523806 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) v3 -- 0x213f960 con 0x23a7550 2023-10-08T06:10:41.567 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.563+0000 7f70aa7fc700 1 -- 172.21.15.32:0/3640523806 <== mon.0 v2:172.21.15.32:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x22c85e0 con 0x23a7550 2023-10-08T06:10:41.567 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.563+0000 7f70aa7fc700 1 -- 172.21.15.32:0/3640523806 <== mon.0 v2:172.21.15.32:3300/0 5 ==== fsmap(e 14) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f70c40267d0 con 0x23a7550 2023-10-08T06:10:41.567 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.563+0000 7f70d542b740 10 client.5415 fetch_fsmap finished waiting for FSMap version 14 2023-10-08T06:10:41.568 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.563+0000 7f70d542b740 10 client.5415 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-08T06:10:41.568 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.563+0000 7f70d542b740 20 client.5415 populate_metadata read hostname 'smithi032' 2023-10-08T06:10:41.568 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.563+0000 7f70d542b740 1 --2- 172.21.15.32:0/3640523806 >> [v2:172.21.15.40:6834/500201668,v1:172.21.15.40:6835/500201668] conn(0x23b4390 0x23b4770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:41.568 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.563+0000 7f70d542b740 4 client.5415 mds_command: new command op to 5326 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T06:10:41.568 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.563+0000 7f70d542b740 1 -- 172.21.15.32:0/3640523806 --> [v2:172.21.15.40:6834/500201668,v1:172.21.15.40:6835/500201668] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x2288470 con 0x23b4390 2023-10-08T06:10:41.568 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.563+0000 7f70cb7fe700 1 --2- 172.21.15.32:0/3640523806 >> [v2:172.21.15.40:6834/500201668,v1:172.21.15.40:6835/500201668] conn(0x23b4390 0x23b4770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:41.569 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.563+0000 7f70cb7fe700 1 --2- 172.21.15.32:0/3640523806 >> [v2:172.21.15.40:6834/500201668,v1:172.21.15.40:6835/500201668] conn(0x23b4390 0x23b4770 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=47a10175984adc89 server_cookie=f2b758377b27b1a5 in_seq=0 out_seq=0 2023-10-08T06:10:41.569 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.563+0000 7f70aa7fc700 10 client.5415 ms_handle_connect on v2:172.21.15.40:6834/500201668 2023-10-08T06:10:41.569 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.563+0000 7f70aa7fc700 1 -- 172.21.15.32:0/3640523806 <== mds.0 v2:172.21.15.40:6834/500201668 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x2288470 con 0x23b4390 2023-10-08T06:10:41.569 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.563+0000 7f70aa7fc700 10 client.5415 handle_command_reply: tid=0 2023-10-08T06:10:41.570 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.563+0000 7f70d542b740 1 client.5415 shutdown 2023-10-08T06:10:41.570 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.563+0000 7f70d542b740 1 -- 172.21.15.32:0/3640523806 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x23a7550 msgr2=0x238c8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:41.570 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.563+0000 7f70d542b740 1 --2- 172.21.15.32:0/3640523806 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x23a7550 0x238c8c0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f70c400b680 tx=0x7f70c400e000 comp rx=0 tx=0).stop 2023-10-08T06:10:41.570 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.563+0000 7f70d542b740 1 -- 172.21.15.32:0/3640523806 shutdown_connections 2023-10-08T06:10:41.570 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.563+0000 7f70d542b740 1 --2- 172.21.15.32:0/3640523806 >> [v2:172.21.15.40:6834/500201668,v1:172.21.15.40:6835/500201668] conn(0x23b4390 0x23b4770 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:41.570 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.563+0000 7f70d542b740 1 --2- 172.21.15.32:0/3640523806 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x23a7550 0x238c8c0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:41.570 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.563+0000 7f70d542b740 1 --2- 172.21.15.32:0/3640523806 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x23a66f0 0x238c380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:41.570 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.563+0000 7f70d542b740 1 --2- 172.21.15.32:0/3640523806 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x23a49a0 0x2367680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:41.570 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.563+0000 7f70aa7fc700 0 client.5415 ms_handle_reset on v2:172.21.15.40:6834/500201668 2023-10-08T06:10:41.570 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.563+0000 7f70d542b740 1 -- 172.21.15.32:0/3640523806 >> 172.21.15.32:0/3640523806 conn(0x20f44d0 msgr2=0x23a56e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:10:41.570 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.567+0000 7f70d542b740 1 -- 172.21.15.32:0/3640523806 shutdown_connections 2023-10-08T06:10:41.571 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.567+0000 7f70d542b740 1 -- 172.21.15.32:0/3640523806 wait complete. 2023-10-08T06:10:41.571 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.567+0000 7f70d542b740 20 client.5415 trim_cache size 0 max 16384 2023-10-08T06:10:41.587 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.583+0000 7f70d542b740 1 Processor -- start 2023-10-08T06:10:41.588 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.583+0000 7f70d542b740 1 -- start start 2023-10-08T06:10:41.588 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.587+0000 7f70d542b740 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x23a49a0 0x23bd7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:41.589 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.587+0000 7f70d542b740 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x23a66f0 0x23bdd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:41.589 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.587+0000 7f70d542b740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x23a7550 0x23bf640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:41.589 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.587+0000 7f70d542b740 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x229a4f0 con 0x23a49a0 2023-10-08T06:10:41.589 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.587+0000 7f70d542b740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x22ce490 con 0x23a7550 2023-10-08T06:10:41.589 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.587+0000 7f70d542b740 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x2368c20 con 0x23a66f0 2023-10-08T06:10:41.589 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.587+0000 7f70cb7fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x23a49a0 0x23bd7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:41.589 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.587+0000 7f70caffd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x23a66f0 0x23bdd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:41.589 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.587+0000 7f70cb7fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x23a49a0 0x23bd7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:58760/0 (socket says 172.21.15.32:58760) 2023-10-08T06:10:41.589 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.587+0000 7f70cb7fe700 1 -- 172.21.15.32:0/852797026 learned_addr learned my addr 172.21.15.32:0/852797026 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:10:41.589 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.587+0000 7f70cbfff700 1 --2- 172.21.15.32:0/852797026 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x23a7550 0x23bf640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:41.591 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.587+0000 7f70caffd700 1 -- 172.21.15.32:0/852797026 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x23a7550 msgr2=0x23bf640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:10:41.591 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.587+0000 7f70caffd700 1 --2- 172.21.15.32:0/852797026 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x23a7550 0x23bf640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:41.591 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.587+0000 7f70caffd700 1 -- 172.21.15.32:0/852797026 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x23a49a0 msgr2=0x23bd7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:10:41.591 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.587+0000 7f70caffd700 1 --2- 172.21.15.32:0/852797026 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x23a49a0 0x23bd7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:41.591 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.587+0000 7f70caffd700 1 -- 172.21.15.32:0/852797026 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x2367760 con 0x23a66f0 2023-10-08T06:10:41.592 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.587+0000 7f70caffd700 1 --2- 172.21.15.32:0/852797026 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x23a66f0 0x23bdd00 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f70cc0c6fe0 tx=0x7f70bc012000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1e190f9c063bb79e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:41.592 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.587+0000 7f70c1ffb700 1 -- 172.21.15.32:0/852797026 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70bc001ce0 con 0x23a66f0 2023-10-08T06:10:41.592 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.587+0000 7f70c1ffb700 1 -- 172.21.15.32:0/852797026 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70bc014450 con 0x23a66f0 2023-10-08T06:10:41.592 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.587+0000 7f70c1ffb700 1 -- 172.21.15.32:0/852797026 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70bc0147c0 con 0x23a66f0 2023-10-08T06:10:41.592 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.587+0000 7f70d542b740 1 -- 172.21.15.32:0/852797026 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x23a66f0 msgr2=0x23bdd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:41.592 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.587+0000 7f70d542b740 1 --2- 172.21.15.32:0/852797026 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x23a66f0 0x23bdd00 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f70cc0c6fe0 tx=0x7f70bc012000 comp rx=0 tx=0).stop 2023-10-08T06:10:41.592 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.587+0000 7f70d542b740 1 -- 172.21.15.32:0/852797026 shutdown_connections 2023-10-08T06:10:41.592 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.587+0000 7f70d542b740 1 --2- 172.21.15.32:0/852797026 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x23a7550 0x23bf640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:41.592 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.587+0000 7f70d542b740 1 --2- 172.21.15.32:0/852797026 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x23a66f0 0x23bdd00 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:41.592 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.587+0000 7f70d542b740 1 --2- 172.21.15.32:0/852797026 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x23a49a0 0x23bd7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:41.593 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.587+0000 7f70d542b740 1 -- 172.21.15.32:0/852797026 >> 172.21.15.32:0/852797026 conn(0x20f44d0 msgr2=0x238f1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:10:41.593 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.587+0000 7f70d542b740 1 -- 172.21.15.32:0/852797026 shutdown_connections 2023-10-08T06:10:41.593 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.587+0000 7f70d542b740 1 -- 172.21.15.32:0/852797026 wait complete. 2023-10-08T06:10:41.593 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.587+0000 7f70d542b740 1 -- start start 2023-10-08T06:10:41.593 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.587+0000 7f70d542b740 1 Processor -- start 2023-10-08T06:10:41.595 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.591+0000 7f70d542b740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x23a49a0 0x240fe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:41.595 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.591+0000 7f70d542b740 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x23a66f0 0x23cb570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:41.596 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.591+0000 7f70d542b740 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x23a7550 0x23cbab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:41.596 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.591+0000 7f70d542b740 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x22caf70 con 0x23a66f0 2023-10-08T06:10:41.596 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.591+0000 7f70d542b740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x22d2160 con 0x23a49a0 2023-10-08T06:10:41.596 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.591+0000 7f70d542b740 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x22cca00 con 0x23a7550 2023-10-08T06:10:41.596 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.591+0000 7f70d542b740 10 client.0 _ll_register_callbacks cb 0x22944b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T06:10:41.596 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.591+0000 7f70caffd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x23a66f0 0x23cb570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:41.596 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.591+0000 7f70caffd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x23a66f0 0x23cb570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:58768/0 (socket says 172.21.15.32:58768) 2023-10-08T06:10:41.597 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.591+0000 7f70caffd700 1 -- 172.21.15.32:0/1902591456 learned_addr learned my addr 172.21.15.32:0/1902591456 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:10:41.597 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.591+0000 7f70cbfff700 1 --2- 172.21.15.32:0/1902591456 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x23a7550 0x23cbab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:41.597 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.591+0000 7f70cb7fe700 1 --2- 172.21.15.32:0/1902591456 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x23a49a0 0x240fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:41.597 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.591+0000 7f70caffd700 1 -- 172.21.15.32:0/1902591456 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x23a7550 msgr2=0x23cbab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:10:41.597 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.591+0000 7f70caffd700 1 --2- 172.21.15.32:0/1902591456 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x23a7550 0x23cbab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:41.597 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.591+0000 7f70caffd700 1 -- 172.21.15.32:0/1902591456 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x23a49a0 msgr2=0x240fe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T06:10:41.597 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.591+0000 7f70caffd700 1 --2- 172.21.15.32:0/1902591456 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x23a49a0 0x240fe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:41.597 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.591+0000 7f70caffd700 1 -- 172.21.15.32:0/1902591456 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70bc019040 con 0x23a66f0 2023-10-08T06:10:41.597 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.591+0000 7f70caffd700 1 --2- 172.21.15.32:0/1902591456 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x23a66f0 0x23cb570 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f70cc066df0 tx=0x7f70bc000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d218f499807af85 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:41.597 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.591+0000 7f70aa7fc700 10 client.0 ms_handle_connect on v2:172.21.15.32:3300/0 2023-10-08T06:10:41.598 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.591+0000 7f70aa7fc700 1 -- 172.21.15.32:0/1902591456 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70bc001ce0 con 0x23a66f0 2023-10-08T06:10:41.598 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.591+0000 7f70aa7fc700 1 -- 172.21.15.32:0/1902591456 <== mon.0 v2:172.21.15.32:3300/0 2 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f70bc01c040 con 0x23a66f0 2023-10-08T06:10:41.598 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.591+0000 7f70d542b740 1 -- 172.21.15.32:0/1902591456 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f70c4003ca0 con 0x23a66f0 2023-10-08T06:10:41.598 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.591+0000 7f70aa7fc700 1 -- 172.21.15.32:0/1902591456 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) v2 ==== 24+0+0 (secure 0 0 0) 0x7f70bc036420 con 0x23a66f0 2023-10-08T06:10:41.598 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.591+0000 7f70d542b740 10 client.5421 fetch_fsmap learned FSMap version 14 2023-10-08T06:10:41.598 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.591+0000 7f70d542b740 1 -- 172.21.15.32:0/1902591456 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) v3 -- 0x22924f0 con 0x23a66f0 2023-10-08T06:10:41.598 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.591+0000 7f70aa7fc700 1 -- 172.21.15.32:0/1902591456 <== mon.0 v2:172.21.15.32:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70c4003ca0 con 0x23a66f0 2023-10-08T06:10:41.598 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.591+0000 7f70aa7fc700 1 -- 172.21.15.32:0/1902591456 <== mon.0 v2:172.21.15.32:3300/0 5 ==== fsmap(e 14) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f70bc036580 con 0x23a66f0 2023-10-08T06:10:41.598 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.591+0000 7f70d542b740 10 client.5421 fetch_fsmap finished waiting for FSMap version 14 2023-10-08T06:10:41.598 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.591+0000 7f70d542b740 10 client.5421 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-08T06:10:41.598 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.591+0000 7f70d542b740 20 client.5421 populate_metadata read hostname 'smithi032' 2023-10-08T06:10:41.599 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.591+0000 7f70d542b740 1 --2- 172.21.15.32:0/1902591456 >> [v2:172.21.15.40:6834/500201668,v1:172.21.15.40:6835/500201668] conn(0x23c1dc0 0x23c21a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:41.599 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.591+0000 7f70d542b740 4 client.5421 mds_command: new command op to 5326 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-08T06:10:41.599 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.591+0000 7f70d542b740 1 -- 172.21.15.32:0/1902591456 --> [v2:172.21.15.40:6834/500201668,v1:172.21.15.40:6835/500201668] -- command(tid 0: {"prefix": "status"}) v1 -- 0x214b460 con 0x23c1dc0 2023-10-08T06:10:41.599 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.591+0000 7f70cb7fe700 1 --2- 172.21.15.32:0/1902591456 >> [v2:172.21.15.40:6834/500201668,v1:172.21.15.40:6835/500201668] conn(0x23c1dc0 0x23c21a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:41.600 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.595+0000 7f70aa7fc700 10 client.5421 ms_handle_connect on v2:172.21.15.40:6834/500201668 2023-10-08T06:10:41.600 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.595+0000 7f70cb7fe700 1 --2- 172.21.15.32:0/1902591456 >> [v2:172.21.15.40:6834/500201668,v1:172.21.15.40:6835/500201668] conn(0x23c1dc0 0x23c21a0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=887f15d9fced3692 server_cookie=6a2b1700bd3b9cca in_seq=0 out_seq=0 2023-10-08T06:10:41.600 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.595+0000 7f70aa7fc700 1 -- 172.21.15.32:0/1902591456 <== mds.0 v2:172.21.15.40:6834/500201668 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+318 (crc 0 0 0) 0x214b460 con 0x23c1dc0 2023-10-08T06:10:41.600 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.595+0000 7f70aa7fc700 10 client.5421 handle_command_reply: tid=0 2023-10-08T06:10:41.600 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.595+0000 7f70d542b740 1 client.5421 shutdown 2023-10-08T06:10:41.600 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.595+0000 7f70d542b740 1 -- 172.21.15.32:0/1902591456 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x23a66f0 msgr2=0x23cb570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:41.600 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.595+0000 7f70d542b740 1 --2- 172.21.15.32:0/1902591456 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x23a66f0 0x23cb570 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f70cc066df0 tx=0x7f70bc000ed0 comp rx=0 tx=0).stop 2023-10-08T06:10:41.600 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.595+0000 7f70d542b740 1 -- 172.21.15.32:0/1902591456 shutdown_connections 2023-10-08T06:10:41.601 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.595+0000 7f70d542b740 1 --2- 172.21.15.32:0/1902591456 >> [v2:172.21.15.40:6834/500201668,v1:172.21.15.40:6835/500201668] conn(0x23c1dc0 0x23c21a0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:41.601 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.595+0000 7f70d542b740 1 --2- 172.21.15.32:0/1902591456 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x23a66f0 0x23cb570 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:41.601 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.595+0000 7f70d542b740 1 --2- 172.21.15.32:0/1902591456 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x23a7550 0x23cbab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:41.601 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.595+0000 7f70d542b740 1 --2- 172.21.15.32:0/1902591456 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x23a49a0 0x240fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:41.601 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.595+0000 7f70d542b740 1 -- 172.21.15.32:0/1902591456 >> 172.21.15.32:0/1902591456 conn(0x20f44d0 msgr2=0x238f1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:10:41.601 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.595+0000 7f70aa7fc700 0 client.5421 ms_handle_reset on v2:172.21.15.40:6834/500201668 2023-10-08T06:10:41.601 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.595+0000 7f70d542b740 1 -- 172.21.15.32:0/1902591456 shutdown_connections 2023-10-08T06:10:41.601 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.595+0000 7f70d542b740 1 -- 172.21.15.32:0/1902591456 wait complete. 2023-10-08T06:10:41.601 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.595+0000 7f70d542b740 20 client.5421 trim_cache size 0 max 16384 2023-10-08T06:10:41.602 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2023-10-08T06:10:41.602 INFO:teuthology.orchestra.run.smithi032.stdout: "cluster_fsid": "ac672d87-96ae-41e0-9314-623ba2cdbbba", 2023-10-08T06:10:41.602 INFO:teuthology.orchestra.run.smithi032.stdout: "whoami": 0, 2023-10-08T06:10:41.602 INFO:teuthology.orchestra.run.smithi032.stdout: "id": 5326, 2023-10-08T06:10:41.602 INFO:teuthology.orchestra.run.smithi032.stdout: "want_state": "up:active", 2023-10-08T06:10:41.602 INFO:teuthology.orchestra.run.smithi032.stdout: "state": "up:active", 2023-10-08T06:10:41.602 INFO:teuthology.orchestra.run.smithi032.stdout: "fs_name": "cephfs", 2023-10-08T06:10:41.602 INFO:teuthology.orchestra.run.smithi032.stdout: "rank_uptime": 5.730053828, 2023-10-08T06:10:41.602 INFO:teuthology.orchestra.run.smithi032.stdout: "mdsmap_epoch": 14, 2023-10-08T06:10:41.602 INFO:teuthology.orchestra.run.smithi032.stdout: "osdmap_epoch": 35, 2023-10-08T06:10:41.602 INFO:teuthology.orchestra.run.smithi032.stdout: "osdmap_epoch_barrier": 35, 2023-10-08T06:10:41.603 INFO:teuthology.orchestra.run.smithi032.stdout: "uptime": 12.686938258 2023-10-08T06:10:41.603 INFO:teuthology.orchestra.run.smithi032.stdout:} 2023-10-08T06:10:41.603 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.595+0000 7f70d0f0d700 1 -- 172.21.15.32:0/3902656585 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f70ac066510 msgr2=0x7f70ac0689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:41.603 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.595+0000 7f70d0f0d700 1 --2- 172.21.15.32:0/3902656585 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f70ac066510 0x7f70ac0689d0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f70bc007fd0 tx=0x7f70bc007c60 comp rx=0 tx=0).stop 2023-10-08T06:10:41.603 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.595+0000 7f70d0f0d700 1 -- 172.21.15.32:0/3902656585 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f70cc0b8bc0 msgr2=0x7f70cc0c7aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:41.604 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.595+0000 7f70d0f0d700 1 --2- 172.21.15.32:0/3902656585 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f70cc0b8bc0 0x7f70cc0c7aa0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f70b400c500 tx=0x7f70b400c810 comp rx=0 tx=0).stop 2023-10-08T06:10:41.604 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.595+0000 7f70d0f0d700 1 -- 172.21.15.32:0/3902656585 shutdown_connections 2023-10-08T06:10:41.604 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.595+0000 7f70d0f0d700 1 --2- 172.21.15.32:0/3902656585 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f70ac066510 0x7f70ac0689d0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:41.604 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.595+0000 7f70d0f0d700 1 --2- 172.21.15.32:0/3902656585 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f70cc15d490 0x7f70cc14fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:41.604 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.595+0000 7f70d0f0d700 1 --2- 172.21.15.32:0/3902656585 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f70cc0ce4e0 0x7f70cc1f5fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:41.604 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.595+0000 7f70d0f0d700 1 --2- 172.21.15.32:0/3902656585 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f70cc0b8bc0 0x7f70cc0c7aa0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:41.604 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.595+0000 7f70d0f0d700 1 -- 172.21.15.32:0/3902656585 >> 172.21.15.32:0/3902656585 conn(0x7f70cc06ab40 msgr2=0x7f70cc0cd5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:10:41.604 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.595+0000 7f70d0f0d700 1 -- 172.21.15.32:0/3902656585 shutdown_connections 2023-10-08T06:10:41.604 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.595+0000 7f70d0f0d700 1 -- 172.21.15.32:0/3902656585 wait complete. 2023-10-08T06:10:41.611 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-08T06:10:41.730 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.727+0000 7fa325779700 1 Processor -- start 2023-10-08T06:10:41.730 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.727+0000 7fa325779700 1 -- start start 2023-10-08T06:10:41.733 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.731+0000 7fa325779700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fa3180e0370 0x7fa31804f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:41.733 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.731+0000 7fa325779700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3180541d0 con 0x7fa3180061b0 2023-10-08T06:10:41.733 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.731+0000 7fa325779700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa318053410 con 0x7fa3180e3c60 2023-10-08T06:10:41.733 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.731+0000 7fa325779700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3180536f0 con 0x7fa3180e0370 2023-10-08T06:10:41.733 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.731+0000 7fa31f7fe700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fa3180e0370 0x7fa31804f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:41.733 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.731+0000 7fa31f7fe700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fa3180e0370 0x7fa31804f2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:58774/0 (socket says 172.21.15.32:58774) 2023-10-08T06:10:41.733 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.731+0000 7fa31f7fe700 1 -- 172.21.15.32:0/1624448852 learned_addr learned my addr 172.21.15.32:0/1624448852 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:10:41.734 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.731+0000 7fa31f7fe700 1 -- 172.21.15.32:0/1624448852 >> v1:172.21.15.40:6789/0 conn(0x7fa3180e3c60 legacy=0x7fa3180e4040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:41.735 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.731+0000 7fa31f7fe700 1 -- 172.21.15.32:0/1624448852 >> v1:172.21.15.32:6789/0 conn(0x7fa3180061b0 legacy=0x7fa31804f820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:41.735 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.731+0000 7fa31effd700 1 -- 172.21.15.32:0/1624448852 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1758355488 0 0) 0x7fa3180541d0 con 0x7fa3180061b0 2023-10-08T06:10:41.735 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.731+0000 7fa31f7fe700 1 -- 172.21.15.32:0/1624448852 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3180539d0 con 0x7fa3180e0370 2023-10-08T06:10:41.735 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.731+0000 7fa31f7fe700 1 --2- 172.21.15.32:0/1624448852 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa3180e0370 0x7fa31804f2e0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fa314009910 tx=0x7fa314009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ee20f201b16623a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:41.735 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.731+0000 7fa31effd700 1 -- 172.21.15.32:0/1624448852 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa31400ba60 con 0x7fa3180e0370 2023-10-08T06:10:41.735 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.731+0000 7fa31effd700 1 -- 172.21.15.32:0/1624448852 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa31400bbc0 con 0x7fa3180e0370 2023-10-08T06:10:41.735 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.731+0000 7fa31effd700 1 -- 172.21.15.32:0/1624448852 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa314009e60 con 0x7fa3180e0370 2023-10-08T06:10:41.736 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.731+0000 7fa325779700 1 -- 172.21.15.32:0/1624448852 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa3180e0370 msgr2=0x7fa31804f2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:41.736 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.731+0000 7fa325779700 1 --2- 172.21.15.32:0/1624448852 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa3180e0370 0x7fa31804f2e0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fa314009910 tx=0x7fa314009c20 comp rx=0 tx=0).stop 2023-10-08T06:10:41.736 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.735+0000 7fa325779700 1 -- 172.21.15.32:0/1624448852 shutdown_connections 2023-10-08T06:10:41.736 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.735+0000 7fa325779700 1 --2- 172.21.15.32:0/1624448852 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa3180e0370 0x7fa31804f2e0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:41.736 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.735+0000 7fa325779700 1 -- 172.21.15.32:0/1624448852 >> 172.21.15.32:0/1624448852 conn(0x7fa318054c90 msgr2=0x7fa3180550a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:10:41.737 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.735+0000 7fa325779700 1 -- 172.21.15.32:0/1624448852 shutdown_connections 2023-10-08T06:10:41.737 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.735+0000 7fa325779700 1 -- 172.21.15.32:0/1624448852 wait complete. 2023-10-08T06:10:41.738 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.735+0000 7fa325779700 1 Processor -- start 2023-10-08T06:10:41.739 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.735+0000 7fa325779700 1 -- start start 2023-10-08T06:10:41.741 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.739+0000 7fa325779700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa3180061b0 0x7fa3180d88c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:41.741 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.739+0000 7fa325779700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa3180e3c60 0x7fa318176840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:41.741 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.739+0000 7fa325779700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa31804dca0 0x7fa31804e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:41.741 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.739+0000 7fa325779700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa31804d880 con 0x7fa3180e3c60 2023-10-08T06:10:41.742 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.739+0000 7fa325779700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3180e3600 con 0x7fa31804dca0 2023-10-08T06:10:41.742 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.739+0000 7fa325779700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa31804cee0 con 0x7fa3180061b0 2023-10-08T06:10:41.742 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.739+0000 7fa31f7fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa3180e3c60 0x7fa318176840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:41.742 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.739+0000 7fa31f7fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa3180e3c60 0x7fa318176840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:58782/0 (socket says 172.21.15.32:58782) 2023-10-08T06:10:41.742 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.739+0000 7fa31f7fe700 1 -- 172.21.15.32:0/2871121500 learned_addr learned my addr 172.21.15.32:0/2871121500 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:10:41.742 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.739+0000 7fa324f78700 1 --2- 172.21.15.32:0/2871121500 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa31804dca0 0x7fa31804e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:41.742 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.739+0000 7fa31ffff700 1 --2- 172.21.15.32:0/2871121500 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa3180061b0 0x7fa3180d88c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:41.743 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.739+0000 7fa31f7fe700 1 -- 172.21.15.32:0/2871121500 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa3180061b0 msgr2=0x7fa3180d88c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:41.743 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.739+0000 7fa31f7fe700 1 --2- 172.21.15.32:0/2871121500 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa3180061b0 0x7fa3180d88c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:41.743 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.739+0000 7fa31f7fe700 1 -- 172.21.15.32:0/2871121500 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa31804dca0 msgr2=0x7fa31804e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:41.744 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.739+0000 7fa31f7fe700 1 --2- 172.21.15.32:0/2871121500 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa31804dca0 0x7fa31804e130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:41.744 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.739+0000 7fa31f7fe700 1 -- 172.21.15.32:0/2871121500 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa314009570 con 0x7fa3180e3c60 2023-10-08T06:10:41.744 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.739+0000 7fa324f78700 1 --2- 172.21.15.32:0/2871121500 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa31804dca0 0x7fa31804e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T06:10:41.744 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.739+0000 7fa31f7fe700 1 --2- 172.21.15.32:0/2871121500 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa3180e3c60 0x7fa318176840 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fa314009c60 tx=0x7fa314004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:41.744 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.739+0000 7fa31cff9700 1 -- 172.21.15.32:0/2871121500 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa314004550 con 0x7fa3180e3c60 2023-10-08T06:10:41.744 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.739+0000 7fa31cff9700 1 -- 172.21.15.32:0/2871121500 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa31401f070 con 0x7fa3180e3c60 2023-10-08T06:10:41.744 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.739+0000 7fa325779700 1 -- 172.21.15.32:0/2871121500 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa31804d1c0 con 0x7fa3180e3c60 2023-10-08T06:10:41.744 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.739+0000 7fa31cff9700 1 -- 172.21.15.32:0/2871121500 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa314003900 con 0x7fa3180e3c60 2023-10-08T06:10:41.744 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.739+0000 7fa325779700 1 -- 172.21.15.32:0/2871121500 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa31804e670 con 0x7fa3180e3c60 2023-10-08T06:10:41.745 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.743+0000 7fa325779700 1 -- 172.21.15.32:0/2871121500 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa31804d9c0 con 0x7fa3180e3c60 2023-10-08T06:10:41.745 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.743+0000 7fa31cff9700 1 -- 172.21.15.32:0/2871121500 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fa314003a60 con 0x7fa3180e3c60 2023-10-08T06:10:41.745 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.743+0000 7fa31cff9700 1 --2- 172.21.15.32:0/2871121500 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fa304066510 0x7fa3040689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:41.746 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.743+0000 7fa31cff9700 1 -- 172.21.15.32:0/2871121500 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa314021070 con 0x7fa3180e3c60 2023-10-08T06:10:41.746 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.743+0000 7fa31ffff700 1 --2- 172.21.15.32:0/2871121500 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fa304066510 0x7fa3040689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:41.746 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.743+0000 7fa31ffff700 1 --2- 172.21.15.32:0/2871121500 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fa304066510 0x7fa3040689d0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fa30c0018a0 tx=0x7fa30c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:41.753 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.751+0000 7fa31cff9700 1 -- 172.21.15.32:0/2871121500 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fa314052fe0 con 0x7fa3180e3c60 2023-10-08T06:10:41.958 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.955+0000 7fa325779700 1 -- 172.21.15.32:0/2871121500 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fa31804d9c0 con 0x7fa3180e3c60 2023-10-08T06:10:41.959 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.955+0000 7fa31cff9700 1 -- 172.21.15.32:0/2871121500 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v14) v1 ==== 53+0+73 (secure 0 0 0) 0x7fa31804d9c0 con 0x7fa3180e3c60 2023-10-08T06:10:41.959 INFO:teuthology.orchestra.run.smithi032.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-08T06:10:41.962 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.959+0000 7fa325779700 1 -- 172.21.15.32:0/2871121500 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fa304066510 msgr2=0x7fa3040689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:41.962 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.959+0000 7fa325779700 1 --2- 172.21.15.32:0/2871121500 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fa304066510 0x7fa3040689d0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fa30c0018a0 tx=0x7fa30c009040 comp rx=0 tx=0).stop 2023-10-08T06:10:41.962 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.959+0000 7fa325779700 1 -- 172.21.15.32:0/2871121500 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa3180e3c60 msgr2=0x7fa318176840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:41.962 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.959+0000 7fa325779700 1 --2- 172.21.15.32:0/2871121500 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa3180e3c60 0x7fa318176840 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fa314009c60 tx=0x7fa314004770 comp rx=0 tx=0).stop 2023-10-08T06:10:41.962 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.959+0000 7fa325779700 1 -- 172.21.15.32:0/2871121500 shutdown_connections 2023-10-08T06:10:41.962 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.959+0000 7fa325779700 1 --2- 172.21.15.32:0/2871121500 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fa304066510 0x7fa3040689d0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:41.962 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.959+0000 7fa325779700 1 --2- 172.21.15.32:0/2871121500 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa3180e3c60 0x7fa318176840 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:41.962 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.959+0000 7fa325779700 1 --2- 172.21.15.32:0/2871121500 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa31804dca0 0x7fa31804e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:41.963 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.959+0000 7fa325779700 1 --2- 172.21.15.32:0/2871121500 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa3180061b0 0x7fa3180d88c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:41.963 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.959+0000 7fa325779700 1 -- 172.21.15.32:0/2871121500 >> 172.21.15.32:0/2871121500 conn(0x7fa318054c90 msgr2=0x7fa318052840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:10:41.963 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.959+0000 7fa325779700 1 -- 172.21.15.32:0/2871121500 shutdown_connections 2023-10-08T06:10:41.963 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:41.959+0000 7fa325779700 1 -- 172.21.15.32:0/2871121500 wait complete. 2023-10-08T06:10:41.974 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-08T06:10:41.974 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-08T06:10:41.975 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi032.front.sepia.ceph.com 2023-10-08T06:10:41.975 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-08T06:10:41.975 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-08T06:10:41.975 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-08T06:10:41.975 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-08T06:10:41.975 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-08T06:10:41.975 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-08T06:10:41.975 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T06:10:41.975 DEBUG:teuthology.orchestra.run.smithi032:> ip addr 2023-10-08T06:10:41.983 INFO:teuthology.orchestra.run.smithi032.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-08T06:10:41.983 INFO:teuthology.orchestra.run.smithi032.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-08T06:10:41.983 INFO:teuthology.orchestra.run.smithi032.stdout: inet 127.0.0.1/8 scope host lo 2023-10-08T06:10:41.983 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2023-10-08T06:10:41.984 INFO:teuthology.orchestra.run.smithi032.stdout: inet6 ::1/128 scope host 2023-10-08T06:10:41.984 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2023-10-08T06:10:41.984 INFO:teuthology.orchestra.run.smithi032.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-08T06:10:41.984 INFO:teuthology.orchestra.run.smithi032.stdout: link/ether 0c:c4:7a:6b:fd:0c brd ff:ff:ff:ff:ff:ff 2023-10-08T06:10:41.984 INFO:teuthology.orchestra.run.smithi032.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-08T06:10:41.984 INFO:teuthology.orchestra.run.smithi032.stdout: link/ether 0c:c4:7a:6b:fd:0d brd ff:ff:ff:ff:ff:ff 2023-10-08T06:10:41.984 INFO:teuthology.orchestra.run.smithi032.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-08T06:10:41.984 INFO:teuthology.orchestra.run.smithi032.stdout: link/ether ac:1f:6b:f8:26:02 brd ff:ff:ff:ff:ff:ff 2023-10-08T06:10:41.984 INFO:teuthology.orchestra.run.smithi032.stdout: inet 172.21.15.32/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-10-08T06:10:41.984 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft 42489sec preferred_lft 42489sec 2023-10-08T06:10:41.984 INFO:teuthology.orchestra.run.smithi032.stdout: inet6 fe80::ae1f:6bff:fef8:2602/64 scope link 2023-10-08T06:10:41.985 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2023-10-08T06:10:41.985 INFO:teuthology.orchestra.run.smithi032.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-08T06:10:41.985 INFO:teuthology.orchestra.run.smithi032.stdout: link/ether ac:1f:6b:f8:26:03 brd ff:ff:ff:ff:ff:ff 2023-10-08T06:10:41.985 INFO:teuthology.orchestra.run.smithi032.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-10-08T06:10:41.985 INFO:teuthology.orchestra.run.smithi032.stdout: link/ether 02:42:fd:c1:b9:57 brd ff:ff:ff:ff:ff:ff 2023-10-08T06:10:41.985 INFO:teuthology.orchestra.run.smithi032.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-10-08T06:10:41.985 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2023-10-08T06:10:41.985 INFO:teuthology.orchestra.run.smithi032.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-08T06:10:41.985 INFO:teuthology.orchestra.run.smithi032.stdout: link/ether 42:02:c9:15:f5:aa brd ff:ff:ff:ff:ff:ff 2023-10-08T06:10:41.985 INFO:teuthology.orchestra.run.smithi032.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-08T06:10:41.985 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2023-10-08T06:10:41.985 INFO:teuthology.orchestra.run.smithi032.stdout: inet6 fe80::a830:32ff:fe5d:13f4/64 scope link 2023-10-08T06:10:41.986 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2023-10-08T06:10:41.986 INFO:teuthology.orchestra.run.smithi032.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-08T06:10:41.986 INFO:teuthology.orchestra.run.smithi032.stdout: link/ether 42:02:c9:15:f5:aa brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-08T06:10:41.986 INFO:teuthology.orchestra.run.smithi032.stdout: inet6 fe80::4002:c9ff:fe15:f5aa/64 scope link 2023-10-08T06:10:41.986 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2023-10-08T06:10:41.986 INFO:teuthology.orchestra.run.smithi032.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-08T06:10:41.986 INFO:teuthology.orchestra.run.smithi032.stdout: link/ether 9e:0f:e2:4a:5e:e0 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-08T06:10:41.986 INFO:teuthology.orchestra.run.smithi032.stdout: inet6 fe80::9c0f:e2ff:fe4a:5ee0/64 scope link 2023-10-08T06:10:41.986 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2023-10-08T06:10:41.987 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T06:10:41.987 DEBUG:teuthology.orchestra.run.smithi032:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-08T06:10:42.042 INFO:teuthology.orchestra.run.smithi032.stdout:1 2023-10-08T06:10:42.044 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T06:10:42.044 DEBUG:teuthology.orchestra.run.smithi032:> route 2023-10-08T06:10:42.053 INFO:teuthology.orchestra.run.smithi032.stdout:Kernel IP routing table 2023-10-08T06:10:42.053 INFO:teuthology.orchestra.run.smithi032.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-08T06:10:42.053 INFO:teuthology.orchestra.run.smithi032.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-10-08T06:10:42.053 INFO:teuthology.orchestra.run.smithi032.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-10-08T06:10:42.054 INFO:teuthology.orchestra.run.smithi032.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-10-08T06:10:42.054 INFO:teuthology.orchestra.run.smithi032.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-08T06:10:42.054 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T06:10:42.054 DEBUG:teuthology.orchestra.run.smithi032:> (cd / && exec bash -c ' 2023-10-08T06:10:42.054 DEBUG:teuthology.orchestra.run.smithi032:> set -e 2023-10-08T06:10:42.054 DEBUG:teuthology.orchestra.run.smithi032:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-08T06:10:42.054 DEBUG:teuthology.orchestra.run.smithi032:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-08T06:10:42.054 DEBUG:teuthology.orchestra.run.smithi032:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-08T06:10:42.055 DEBUG:teuthology.orchestra.run.smithi032:> ') 2023-10-08T06:10:42.094 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T06:10:42.094 DEBUG:teuthology.orchestra.run.smithi032:> ip netns list 2023-10-08T06:10:42.102 INFO:teuthology.orchestra.run.smithi032.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-08T06:10:42.102 INFO:teuthology.orchestra.run.smithi032.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-08T06:10:42.102 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-08T06:10:42.102 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T06:10:42.102 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip link set brx.0 up 2023-10-08T06:10:42.114 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-10-08T06:10:42.115 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T06:10:42.115 DEBUG:teuthology.orchestra.run.smithi032:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-08T06:10:42.120 INFO:teuthology.orchestra.run.smithi032.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-08T06:10:42.120 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T06:10:42.120 DEBUG:teuthology.orchestra.run.smithi032:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-08T06:10:42.170 DEBUG:teuthology.orchestra.run.smithi032:> sudo modprobe fuse 2023-10-08T06:10:42.185 DEBUG:teuthology.orchestra.run.smithi032:> cat /proc/self/mounts | awk '{print $2}' 2023-10-08T06:10:42.193 INFO:teuthology.orchestra.run.smithi032.stdout:/sys 2023-10-08T06:10:42.194 INFO:teuthology.orchestra.run.smithi032.stdout:/proc 2023-10-08T06:10:42.194 INFO:teuthology.orchestra.run.smithi032.stdout:/dev 2023-10-08T06:10:42.194 INFO:teuthology.orchestra.run.smithi032.stdout:/dev/pts 2023-10-08T06:10:42.194 INFO:teuthology.orchestra.run.smithi032.stdout:/run 2023-10-08T06:10:42.194 INFO:teuthology.orchestra.run.smithi032.stdout:/ 2023-10-08T06:10:42.194 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/kernel/security 2023-10-08T06:10:42.194 INFO:teuthology.orchestra.run.smithi032.stdout:/dev/shm 2023-10-08T06:10:42.194 INFO:teuthology.orchestra.run.smithi032.stdout:/run/lock 2023-10-08T06:10:42.194 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/cgroup 2023-10-08T06:10:42.195 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/cgroup/unified 2023-10-08T06:10:42.195 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/cgroup/systemd 2023-10-08T06:10:42.195 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/pstore 2023-10-08T06:10:42.195 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/bpf 2023-10-08T06:10:42.195 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/cgroup/cpu,cpuacct 2023-10-08T06:10:42.195 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/cgroup/net_cls,net_prio 2023-10-08T06:10:42.195 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/cgroup/blkio 2023-10-08T06:10:42.195 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/cgroup/pids 2023-10-08T06:10:42.195 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/cgroup/memory 2023-10-08T06:10:42.195 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/cgroup/freezer 2023-10-08T06:10:42.195 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/cgroup/perf_event 2023-10-08T06:10:42.195 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/cgroup/cpuset 2023-10-08T06:10:42.196 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/cgroup/devices 2023-10-08T06:10:42.196 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/cgroup/rdma 2023-10-08T06:10:42.196 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/cgroup/hugetlb 2023-10-08T06:10:42.196 INFO:teuthology.orchestra.run.smithi032.stdout:/proc/sys/fs/binfmt_misc 2023-10-08T06:10:42.196 INFO:teuthology.orchestra.run.smithi032.stdout:/dev/hugepages 2023-10-08T06:10:42.196 INFO:teuthology.orchestra.run.smithi032.stdout:/dev/mqueue 2023-10-08T06:10:42.196 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/kernel/debug 2023-10-08T06:10:42.196 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/kernel/tracing 2023-10-08T06:10:42.196 INFO:teuthology.orchestra.run.smithi032.stdout:/run/rpc_pipefs 2023-10-08T06:10:42.196 INFO:teuthology.orchestra.run.smithi032.stdout:/proc/fs/nfsd 2023-10-08T06:10:42.196 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/fuse/connections 2023-10-08T06:10:42.197 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/kernel/config 2023-10-08T06:10:42.197 INFO:teuthology.orchestra.run.smithi032.stdout:/run/user/1000 2023-10-08T06:10:42.197 INFO:teuthology.orchestra.run.smithi032.stdout:/var/lib/ceph 2023-10-08T06:10:42.197 INFO:teuthology.orchestra.run.smithi032.stdout:/var/lib/ceph/osd/ceph-0 2023-10-08T06:10:42.197 INFO:teuthology.orchestra.run.smithi032.stdout:/var/lib/ceph/osd/ceph-1 2023-10-08T06:10:42.197 INFO:teuthology.orchestra.run.smithi032.stdout:/var/lib/ceph/osd/ceph-2 2023-10-08T06:10:42.197 INFO:teuthology.orchestra.run.smithi032.stdout:/var/lib/ceph/osd/ceph-3 2023-10-08T06:10:42.197 INFO:teuthology.orchestra.run.smithi032.stdout:/run/netns 2023-10-08T06:10:42.197 INFO:teuthology.orchestra.run.smithi032.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-08T06:10:42.197 INFO:teuthology.orchestra.run.smithi032.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-08T06:10:42.197 INFO:teuthology.orchestra.run.smithi032.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-08T06:10:42.197 INFO:teuthology.orchestra.run.smithi032.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-08T06:10:42.198 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T06:10:42.198 DEBUG:teuthology.orchestra.run.smithi032:> ls /sys/fs/fuse/connections 2023-10-08T06:10:42.205 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-10-08T06:10:42.206 DEBUG:teuthology.orchestra.run.smithi032:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-10-08T06:10:42.250 DEBUG:teuthology.orchestra.run.smithi032:> sudo modprobe fuse 2023-10-08T06:10:42.266 DEBUG:teuthology.orchestra.run.smithi032:> cat /proc/self/mounts | awk '{print $2}' 2023-10-08T06:10:42.272 INFO:teuthology.orchestra.run.smithi032.stdout:/sys 2023-10-08T06:10:42.272 INFO:teuthology.orchestra.run.smithi032.stdout:/proc 2023-10-08T06:10:42.272 INFO:teuthology.orchestra.run.smithi032.stdout:/dev 2023-10-08T06:10:42.273 INFO:teuthology.orchestra.run.smithi032.stdout:/dev/pts 2023-10-08T06:10:42.273 INFO:teuthology.orchestra.run.smithi032.stdout:/run 2023-10-08T06:10:42.273 INFO:teuthology.orchestra.run.smithi032.stdout:/ 2023-10-08T06:10:42.273 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/kernel/security 2023-10-08T06:10:42.273 INFO:teuthology.orchestra.run.smithi032.stdout:/dev/shm 2023-10-08T06:10:42.273 INFO:teuthology.orchestra.run.smithi032.stdout:/run/lock 2023-10-08T06:10:42.273 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/cgroup 2023-10-08T06:10:42.273 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/cgroup/unified 2023-10-08T06:10:42.273 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/cgroup/systemd 2023-10-08T06:10:42.273 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/pstore 2023-10-08T06:10:42.274 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/bpf 2023-10-08T06:10:42.274 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/cgroup/cpu,cpuacct 2023-10-08T06:10:42.274 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/cgroup/net_cls,net_prio 2023-10-08T06:10:42.274 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/cgroup/blkio 2023-10-08T06:10:42.274 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/cgroup/pids 2023-10-08T06:10:42.274 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/cgroup/memory 2023-10-08T06:10:42.274 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/cgroup/freezer 2023-10-08T06:10:42.274 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/cgroup/perf_event 2023-10-08T06:10:42.274 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/cgroup/cpuset 2023-10-08T06:10:42.274 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/cgroup/devices 2023-10-08T06:10:42.274 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/cgroup/rdma 2023-10-08T06:10:42.275 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/cgroup/hugetlb 2023-10-08T06:10:42.275 INFO:teuthology.orchestra.run.smithi032.stdout:/proc/sys/fs/binfmt_misc 2023-10-08T06:10:42.275 INFO:teuthology.orchestra.run.smithi032.stdout:/dev/hugepages 2023-10-08T06:10:42.275 INFO:teuthology.orchestra.run.smithi032.stdout:/dev/mqueue 2023-10-08T06:10:42.275 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/kernel/debug 2023-10-08T06:10:42.275 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/kernel/tracing 2023-10-08T06:10:42.275 INFO:teuthology.orchestra.run.smithi032.stdout:/run/rpc_pipefs 2023-10-08T06:10:42.275 INFO:teuthology.orchestra.run.smithi032.stdout:/proc/fs/nfsd 2023-10-08T06:10:42.275 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/fuse/connections 2023-10-08T06:10:42.275 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/kernel/config 2023-10-08T06:10:42.275 INFO:teuthology.orchestra.run.smithi032.stdout:/run/user/1000 2023-10-08T06:10:42.276 INFO:teuthology.orchestra.run.smithi032.stdout:/var/lib/ceph 2023-10-08T06:10:42.276 INFO:teuthology.orchestra.run.smithi032.stdout:/var/lib/ceph/osd/ceph-0 2023-10-08T06:10:42.276 INFO:teuthology.orchestra.run.smithi032.stdout:/var/lib/ceph/osd/ceph-1 2023-10-08T06:10:42.276 INFO:teuthology.orchestra.run.smithi032.stdout:/var/lib/ceph/osd/ceph-2 2023-10-08T06:10:42.276 INFO:teuthology.orchestra.run.smithi032.stdout:/var/lib/ceph/osd/ceph-3 2023-10-08T06:10:42.276 INFO:teuthology.orchestra.run.smithi032.stdout:/run/netns 2023-10-08T06:10:42.276 INFO:teuthology.orchestra.run.smithi032.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-08T06:10:42.276 INFO:teuthology.orchestra.run.smithi032.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-08T06:10:42.276 INFO:teuthology.orchestra.run.smithi032.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-08T06:10:42.276 INFO:teuthology.orchestra.run.smithi032.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-08T06:10:42.277 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T06:10:42.277 DEBUG:teuthology.orchestra.run.smithi032:> ls /sys/fs/fuse/connections 2023-10-08T06:10:42.343 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi032.stderr:2023-10-08T06:10:42.339+0000 7f65821c3640 -1 init, newargv = 0x5576153e8aa0 newargc=15 2023-10-08T06:10:42.344 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi032.stderr:ceph-fuse[45161]: starting ceph client 2023-10-08T06:10:42.352 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi032.stderr:ceph-fuse[45161]: starting fuse 2023-10-08T06:10:43.385 DEBUG:teuthology.orchestra.run.smithi032:> sudo modprobe fuse 2023-10-08T06:10:43.404 DEBUG:teuthology.orchestra.run.smithi032:> cat /proc/self/mounts | awk '{print $2}' 2023-10-08T06:10:43.413 INFO:teuthology.orchestra.run.smithi032.stdout:/sys 2023-10-08T06:10:43.413 INFO:teuthology.orchestra.run.smithi032.stdout:/proc 2023-10-08T06:10:43.413 INFO:teuthology.orchestra.run.smithi032.stdout:/dev 2023-10-08T06:10:43.413 INFO:teuthology.orchestra.run.smithi032.stdout:/dev/pts 2023-10-08T06:10:43.413 INFO:teuthology.orchestra.run.smithi032.stdout:/run 2023-10-08T06:10:43.413 INFO:teuthology.orchestra.run.smithi032.stdout:/ 2023-10-08T06:10:43.413 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/kernel/security 2023-10-08T06:10:43.413 INFO:teuthology.orchestra.run.smithi032.stdout:/dev/shm 2023-10-08T06:10:43.413 INFO:teuthology.orchestra.run.smithi032.stdout:/run/lock 2023-10-08T06:10:43.413 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/cgroup 2023-10-08T06:10:43.414 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/cgroup/unified 2023-10-08T06:10:43.414 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/cgroup/systemd 2023-10-08T06:10:43.414 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/pstore 2023-10-08T06:10:43.414 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/bpf 2023-10-08T06:10:43.414 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/cgroup/cpu,cpuacct 2023-10-08T06:10:43.414 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/cgroup/net_cls,net_prio 2023-10-08T06:10:43.414 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/cgroup/blkio 2023-10-08T06:10:43.414 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/cgroup/pids 2023-10-08T06:10:43.414 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/cgroup/memory 2023-10-08T06:10:43.414 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/cgroup/freezer 2023-10-08T06:10:43.414 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/cgroup/perf_event 2023-10-08T06:10:43.414 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/cgroup/cpuset 2023-10-08T06:10:43.415 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/cgroup/devices 2023-10-08T06:10:43.415 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/cgroup/rdma 2023-10-08T06:10:43.415 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/cgroup/hugetlb 2023-10-08T06:10:43.415 INFO:teuthology.orchestra.run.smithi032.stdout:/proc/sys/fs/binfmt_misc 2023-10-08T06:10:43.415 INFO:teuthology.orchestra.run.smithi032.stdout:/dev/hugepages 2023-10-08T06:10:43.415 INFO:teuthology.orchestra.run.smithi032.stdout:/dev/mqueue 2023-10-08T06:10:43.415 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/kernel/debug 2023-10-08T06:10:43.415 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/kernel/tracing 2023-10-08T06:10:43.415 INFO:teuthology.orchestra.run.smithi032.stdout:/run/rpc_pipefs 2023-10-08T06:10:43.415 INFO:teuthology.orchestra.run.smithi032.stdout:/proc/fs/nfsd 2023-10-08T06:10:43.416 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/fs/fuse/connections 2023-10-08T06:10:43.416 INFO:teuthology.orchestra.run.smithi032.stdout:/sys/kernel/config 2023-10-08T06:10:43.416 INFO:teuthology.orchestra.run.smithi032.stdout:/run/user/1000 2023-10-08T06:10:43.416 INFO:teuthology.orchestra.run.smithi032.stdout:/var/lib/ceph 2023-10-08T06:10:43.416 INFO:teuthology.orchestra.run.smithi032.stdout:/var/lib/ceph/osd/ceph-0 2023-10-08T06:10:43.416 INFO:teuthology.orchestra.run.smithi032.stdout:/var/lib/ceph/osd/ceph-1 2023-10-08T06:10:43.416 INFO:teuthology.orchestra.run.smithi032.stdout:/var/lib/ceph/osd/ceph-2 2023-10-08T06:10:43.416 INFO:teuthology.orchestra.run.smithi032.stdout:/var/lib/ceph/osd/ceph-3 2023-10-08T06:10:43.416 INFO:teuthology.orchestra.run.smithi032.stdout:/run/netns 2023-10-08T06:10:43.416 INFO:teuthology.orchestra.run.smithi032.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-08T06:10:43.416 INFO:teuthology.orchestra.run.smithi032.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-08T06:10:43.416 INFO:teuthology.orchestra.run.smithi032.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-08T06:10:43.417 INFO:teuthology.orchestra.run.smithi032.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-08T06:10:43.417 INFO:teuthology.orchestra.run.smithi032.stdout:/home/ubuntu/cephtest/mnt.0 2023-10-08T06:10:43.417 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T06:10:43.418 DEBUG:teuthology.orchestra.run.smithi032:> ls /sys/fs/fuse/connections 2023-10-08T06:10:43.424 INFO:teuthology.orchestra.run.smithi032.stdout:52 2023-10-08T06:10:43.424 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2023-10-08T06:10:43.424 DEBUG:teuthology.orchestra.run.smithi032:> sudo stdin-killer -- python3 -c ' 2023-10-08T06:10:43.424 DEBUG:teuthology.orchestra.run.smithi032:> import glob 2023-10-08T06:10:43.424 DEBUG:teuthology.orchestra.run.smithi032:> import re 2023-10-08T06:10:43.424 DEBUG:teuthology.orchestra.run.smithi032:> import os 2023-10-08T06:10:43.424 DEBUG:teuthology.orchestra.run.smithi032:> import subprocess 2023-10-08T06:10:43.424 DEBUG:teuthology.orchestra.run.smithi032:> 2023-10-08T06:10:43.424 DEBUG:teuthology.orchestra.run.smithi032:> def _find_admin_socket(client_name): 2023-10-08T06:10:43.425 DEBUG:teuthology.orchestra.run.smithi032:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-10-08T06:10:43.425 DEBUG:teuthology.orchestra.run.smithi032:> files = glob.glob(asok_path) 2023-10-08T06:10:43.425 DEBUG:teuthology.orchestra.run.smithi032:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-10-08T06:10:43.425 DEBUG:teuthology.orchestra.run.smithi032:> 2023-10-08T06:10:43.425 DEBUG:teuthology.orchestra.run.smithi032:> # Given a non-glob path, it better be there 2023-10-08T06:10:43.425 DEBUG:teuthology.orchestra.run.smithi032:> if "*" not in asok_path: 2023-10-08T06:10:43.425 DEBUG:teuthology.orchestra.run.smithi032:> assert(len(files) == 1) 2023-10-08T06:10:43.425 DEBUG:teuthology.orchestra.run.smithi032:> return files[0] 2023-10-08T06:10:43.425 DEBUG:teuthology.orchestra.run.smithi032:> 2023-10-08T06:10:43.425 DEBUG:teuthology.orchestra.run.smithi032:> for f in files: 2023-10-08T06:10:43.425 DEBUG:teuthology.orchestra.run.smithi032:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-08T06:10:43.426 DEBUG:teuthology.orchestra.run.smithi032:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-08T06:10:43.426 DEBUG:teuthology.orchestra.run.smithi032:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-08T06:10:43.426 DEBUG:teuthology.orchestra.run.smithi032:> contents = proc_f.read() 2023-10-08T06:10:43.426 DEBUG:teuthology.orchestra.run.smithi032:> if mountpoint in contents: 2023-10-08T06:10:43.426 DEBUG:teuthology.orchestra.run.smithi032:> return f 2023-10-08T06:10:43.426 DEBUG:teuthology.orchestra.run.smithi032:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-08T06:10:43.426 DEBUG:teuthology.orchestra.run.smithi032:> 2023-10-08T06:10:43.426 DEBUG:teuthology.orchestra.run.smithi032:> print(_find_admin_socket("client.0")) 2023-10-08T06:10:43.426 DEBUG:teuthology.orchestra.run.smithi032:> ' 2023-10-08T06:10:43.555 INFO:teuthology.orchestra.run.smithi032.stdout:/var/run/ceph/ceph-client.0.45161.asok 2023-10-08T06:10:43.558 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-08T06:10:43.570 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.45161.asok 2023-10-08T06:10:43.570 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T06:10:43.570 DEBUG:teuthology.orchestra.run.smithi032:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.45161.asok status 2023-10-08T06:10:43.675 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2023-10-08T06:10:43.675 INFO:teuthology.orchestra.run.smithi032.stdout: "metadata": { 2023-10-08T06:10:43.676 INFO:teuthology.orchestra.run.smithi032.stdout: "ceph_sha1": "9725b08fd801c82987c737f7e6d354878f036ee8", 2023-10-08T06:10:43.676 INFO:teuthology.orchestra.run.smithi032.stdout: "ceph_version": "ceph version 18.0.0-6609-g9725b08f (9725b08fd801c82987c737f7e6d354878f036ee8) reef (dev)", 2023-10-08T06:10:43.676 INFO:teuthology.orchestra.run.smithi032.stdout: "entity_id": "0", 2023-10-08T06:10:43.676 INFO:teuthology.orchestra.run.smithi032.stdout: "hostname": "smithi032", 2023-10-08T06:10:43.676 INFO:teuthology.orchestra.run.smithi032.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-10-08T06:10:43.676 INFO:teuthology.orchestra.run.smithi032.stdout: "pid": "45161", 2023-10-08T06:10:43.676 INFO:teuthology.orchestra.run.smithi032.stdout: "root": "/" 2023-10-08T06:10:43.676 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-10-08T06:10:43.676 INFO:teuthology.orchestra.run.smithi032.stdout: "dentry_count": 0, 2023-10-08T06:10:43.676 INFO:teuthology.orchestra.run.smithi032.stdout: "dentry_pinned_count": 0, 2023-10-08T06:10:43.677 INFO:teuthology.orchestra.run.smithi032.stdout: "id": 5439, 2023-10-08T06:10:43.677 INFO:teuthology.orchestra.run.smithi032.stdout: "inst": { 2023-10-08T06:10:43.677 INFO:teuthology.orchestra.run.smithi032.stdout: "name": { 2023-10-08T06:10:43.677 INFO:teuthology.orchestra.run.smithi032.stdout: "type": "client", 2023-10-08T06:10:43.677 INFO:teuthology.orchestra.run.smithi032.stdout: "num": 5439 2023-10-08T06:10:43.677 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-10-08T06:10:43.677 INFO:teuthology.orchestra.run.smithi032.stdout: "addr": { 2023-10-08T06:10:43.677 INFO:teuthology.orchestra.run.smithi032.stdout: "type": "v1", 2023-10-08T06:10:43.677 INFO:teuthology.orchestra.run.smithi032.stdout: "addr": "192.168.0.1:0", 2023-10-08T06:10:43.677 INFO:teuthology.orchestra.run.smithi032.stdout: "nonce": 473696616 2023-10-08T06:10:43.677 INFO:teuthology.orchestra.run.smithi032.stdout: } 2023-10-08T06:10:43.678 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-10-08T06:10:43.678 INFO:teuthology.orchestra.run.smithi032.stdout: "addr": { 2023-10-08T06:10:43.678 INFO:teuthology.orchestra.run.smithi032.stdout: "type": "v1", 2023-10-08T06:10:43.678 INFO:teuthology.orchestra.run.smithi032.stdout: "addr": "192.168.0.1:0", 2023-10-08T06:10:43.678 INFO:teuthology.orchestra.run.smithi032.stdout: "nonce": 473696616 2023-10-08T06:10:43.678 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-10-08T06:10:43.678 INFO:teuthology.orchestra.run.smithi032.stdout: "inst_str": "client.5439 192.168.0.1:0/473696616", 2023-10-08T06:10:43.678 INFO:teuthology.orchestra.run.smithi032.stdout: "addr_str": "192.168.0.1:0/473696616", 2023-10-08T06:10:43.678 INFO:teuthology.orchestra.run.smithi032.stdout: "inode_count": 1, 2023-10-08T06:10:43.678 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_epoch": 14, 2023-10-08T06:10:43.678 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_epoch": 35, 2023-10-08T06:10:43.678 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_epoch_barrier": 0, 2023-10-08T06:10:43.679 INFO:teuthology.orchestra.run.smithi032.stdout: "blocklisted": false, 2023-10-08T06:10:43.679 INFO:teuthology.orchestra.run.smithi032.stdout: "fs_name": "cephfs" 2023-10-08T06:10:43.679 INFO:teuthology.orchestra.run.smithi032.stdout:} 2023-10-08T06:10:43.685 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T06:10:43.686 DEBUG:teuthology.orchestra.run.smithi032:> stat --file-system '--printf=%T 2023-10-08T06:10:43.686 DEBUG:teuthology.orchestra.run.smithi032:> ' -- /home/ubuntu/cephtest/mnt.0 2023-10-08T06:10:43.693 INFO:teuthology.orchestra.run.smithi032.stdout:fuseblk 2023-10-08T06:10:43.693 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-10-08T06:10:43.694 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T06:10:43.694 DEBUG:teuthology.orchestra.run.smithi032:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-08T06:10:43.707 DEBUG:teuthology.orchestra.run.smithi032:> mktemp -d --suffix=xfstests-dev 2023-10-08T06:10:43.713 INFO:teuthology.orchestra.run.smithi032.stdout:/tmp/tmp.p8vAuQqzIgxfstests-dev 2023-10-08T06:10:43.713 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T06:10:43.713 DEBUG:teuthology.orchestra.run.smithi032:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo chmod a+rx /tmp/tmp.p8vAuQqzIgxfstests-dev) 2023-10-08T06:10:43.775 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T06:10:43.775 DEBUG:teuthology.orchestra.run.smithi032:> (cd /home/ubuntu/cephtest/mnt.0 && exec git clone https://git.ceph.com/xfstests-dev.git --depth 1 /tmp/tmp.p8vAuQqzIgxfstests-dev) 2023-10-08T06:10:43.794 INFO:teuthology.orchestra.run.smithi032.stderr:Cloning into '/tmp/tmp.p8vAuQqzIgxfstests-dev'... 2023-10-08T06:10:44.493 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T06:10:44.493 DEBUG:teuthology.orchestra.run.smithi032:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir test) 2023-10-08T06:10:44.509 DEBUG:teuthology.orchestra.run.smithi032:> mktemp -d --suffix=test 2023-10-08T06:10:44.558 INFO:teuthology.orchestra.run.smithi032.stdout:/tmp/tmp.t2WBfhO8BYtest 2023-10-08T06:10:44.558 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T06:10:44.558 DEBUG:teuthology.orchestra.run.smithi032:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir scratch) 2023-10-08T06:10:44.573 DEBUG:teuthology.orchestra.run.smithi032:> mktemp -d --suffix=scratch 2023-10-08T06:10:44.579 INFO:teuthology.orchestra.run.smithi032.stdout:/tmp/tmp.DuxgoqTKXAscratch 2023-10-08T06:10:44.581 INFO:tasks.cephfs.xfstests_dev:distro and version detected is "ubuntu" and "20.04". 2023-10-08T06:10:44.581 DEBUG:teuthology.orchestra.run.smithi032:> sudo apt-get install -y xfslibs-dev uuid-dev libtool-bin e2fsprogs automake gcc libuuid1 quota attr libattr1-dev make libacl1-dev libaio-dev xfsprogs libgdbm-dev gawk fio dbench uuid-runtime python2 sqlite3 2023-10-08T06:10:44.655 INFO:teuthology.orchestra.run.smithi032.stdout:Reading package lists... 2023-10-08T06:10:44.867 INFO:teuthology.orchestra.run.smithi032.stdout:Building dependency tree... 2023-10-08T06:10:44.868 INFO:teuthology.orchestra.run.smithi032.stdout:Reading state information... 2023-10-08T06:10:45.069 INFO:teuthology.orchestra.run.smithi032.stdout:attr is already the newest version (1:2.4.48-5). 2023-10-08T06:10:45.069 INFO:teuthology.orchestra.run.smithi032.stdout:automake is already the newest version (1:1.16.1-4ubuntu6). 2023-10-08T06:10:45.069 INFO:teuthology.orchestra.run.smithi032.stdout:gcc is already the newest version (4:9.3.0-1ubuntu2). 2023-10-08T06:10:45.070 INFO:teuthology.orchestra.run.smithi032.stdout:gcc set to manually installed. 2023-10-08T06:10:45.070 INFO:teuthology.orchestra.run.smithi032.stdout:libacl1-dev is already the newest version (2.2.53-6). 2023-10-08T06:10:45.070 INFO:teuthology.orchestra.run.smithi032.stdout:libaio-dev is already the newest version (0.3.112-5). 2023-10-08T06:10:45.070 INFO:teuthology.orchestra.run.smithi032.stdout:libattr1-dev is already the newest version (1:2.4.48-5). 2023-10-08T06:10:45.070 INFO:teuthology.orchestra.run.smithi032.stdout:libtool-bin is already the newest version (2.4.6-14). 2023-10-08T06:10:45.070 INFO:teuthology.orchestra.run.smithi032.stdout:make is already the newest version (4.2.1-1.2). 2023-10-08T06:10:45.070 INFO:teuthology.orchestra.run.smithi032.stdout:make set to manually installed. 2023-10-08T06:10:45.070 INFO:teuthology.orchestra.run.smithi032.stdout:quota is already the newest version (4.05-1). 2023-10-08T06:10:45.070 INFO:teuthology.orchestra.run.smithi032.stdout:xfslibs-dev is already the newest version (5.3.0-1ubuntu2). 2023-10-08T06:10:45.070 INFO:teuthology.orchestra.run.smithi032.stdout:xfsprogs is already the newest version (5.3.0-1ubuntu2). 2023-10-08T06:10:45.071 INFO:teuthology.orchestra.run.smithi032.stdout:dbench is already the newest version (4.0-2build1). 2023-10-08T06:10:45.071 INFO:teuthology.orchestra.run.smithi032.stdout:python2 is already the newest version (2.7.17-2ubuntu4). 2023-10-08T06:10:45.071 INFO:teuthology.orchestra.run.smithi032.stdout:python2 set to manually installed. 2023-10-08T06:10:45.071 INFO:teuthology.orchestra.run.smithi032.stdout:e2fsprogs is already the newest version (1.45.5-2ubuntu1.1). 2023-10-08T06:10:45.071 INFO:teuthology.orchestra.run.smithi032.stdout:libuuid1 is already the newest version (2.34-0.1ubuntu9.4). 2023-10-08T06:10:45.071 INFO:teuthology.orchestra.run.smithi032.stdout:uuid-dev is already the newest version (2.34-0.1ubuntu9.4). 2023-10-08T06:10:45.071 INFO:teuthology.orchestra.run.smithi032.stdout:The following packages were automatically installed and are no longer required: 2023-10-08T06:10:45.072 INFO:teuthology.orchestra.run.smithi032.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2023-10-08T06:10:45.072 INFO:teuthology.orchestra.run.smithi032.stdout:Use 'sudo apt autoremove' to remove them. 2023-10-08T06:10:45.072 INFO:teuthology.orchestra.run.smithi032.stdout:The following additional packages will be installed: 2023-10-08T06:10:45.072 INFO:teuthology.orchestra.run.smithi032.stdout: libgfapi0 libgfrpc0 libgfxdr0 libglusterfs0 libsqlite3-0 2023-10-08T06:10:45.072 INFO:teuthology.orchestra.run.smithi032.stdout:Suggested packages: 2023-10-08T06:10:45.072 INFO:teuthology.orchestra.run.smithi032.stdout: gnuplot gfio python-scipy gawk-doc sqlite3-doc 2023-10-08T06:10:45.107 INFO:teuthology.orchestra.run.smithi032.stdout:The following NEW packages will be installed: 2023-10-08T06:10:45.109 INFO:teuthology.orchestra.run.smithi032.stdout: fio libgdbm-dev libgfapi0 libgfrpc0 libgfxdr0 libglusterfs0 sqlite3 2023-10-08T06:10:45.109 INFO:teuthology.orchestra.run.smithi032.stdout:The following packages will be upgraded: 2023-10-08T06:10:45.111 INFO:teuthology.orchestra.run.smithi032.stdout: gawk libsqlite3-0 uuid-runtime 2023-10-08T06:10:45.164 INFO:teuthology.orchestra.run.smithi032.stdout:3 upgraded, 7 newly installed, 0 to remove and 244 not upgraded. 2023-10-08T06:10:45.164 INFO:teuthology.orchestra.run.smithi032.stdout:Need to get 2,878 kB of archives. 2023-10-08T06:10:45.164 INFO:teuthology.orchestra.run.smithi032.stdout:After this operation, 7,035 kB of additional disk space will be used. 2023-10-08T06:10:45.165 INFO:teuthology.orchestra.run.smithi032.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 uuid-runtime amd64 2.34-0.1ubuntu9.4 [35.4 kB] 2023-10-08T06:10:45.208 INFO:teuthology.orchestra.run.smithi032.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 gawk amd64 1:5.0.1+dfsg-1ubuntu0.1 [415 kB] 2023-10-08T06:10:45.273 INFO:teuthology.orchestra.run.smithi032.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libsqlite3-0 amd64 3.31.1-4ubuntu0.5 [549 kB] 2023-10-08T06:10:45.293 INFO:teuthology.orchestra.run.smithi032.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/universe amd64 libglusterfs0 amd64 7.2-2build1 [286 kB] 2023-10-08T06:10:45.298 INFO:teuthology.orchestra.run.smithi032.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/universe amd64 libgfxdr0 amd64 7.2-2build1 [24.2 kB] 2023-10-08T06:10:45.299 INFO:teuthology.orchestra.run.smithi032.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal/universe amd64 libgfrpc0 amd64 7.2-2build1 [46.1 kB] 2023-10-08T06:10:45.300 INFO:teuthology.orchestra.run.smithi032.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/universe amd64 libgfapi0 amd64 7.2-2build1 [72.6 kB] 2023-10-08T06:10:45.301 INFO:teuthology.orchestra.run.smithi032.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/universe amd64 fio amd64 3.16-1 [507 kB] 2023-10-08T06:10:45.309 INFO:teuthology.orchestra.run.smithi032.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal/main amd64 libgdbm-dev amd64 1.18.1-5 [83.4 kB] 2023-10-08T06:10:45.311 INFO:teuthology.orchestra.run.smithi032.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 sqlite3 amd64 3.31.1-4ubuntu0.5 [860 kB] 2023-10-08T06:10:45.584 INFO:teuthology.orchestra.run.smithi032.stderr:debconf: unable to initialize frontend: Dialog 2023-10-08T06:10:45.584 INFO:teuthology.orchestra.run.smithi032.stderr:debconf: (Dialog frontend will not work on a dumb terminal, an emacs shell buffer, or without a controlling terminal.) 2023-10-08T06:10:45.584 INFO:teuthology.orchestra.run.smithi032.stderr:debconf: falling back to frontend: Readline 2023-10-08T06:10:45.612 INFO:teuthology.orchestra.run.smithi032.stderr:debconf: unable to initialize frontend: Readline 2023-10-08T06:10:45.612 INFO:teuthology.orchestra.run.smithi032.stderr:debconf: (This frontend requires a controlling tty.) 2023-10-08T06:10:45.613 INFO:teuthology.orchestra.run.smithi032.stderr:debconf: falling back to frontend: Teletype 2023-10-08T06:10:45.619 INFO:teuthology.orchestra.run.smithi032.stderr:dpkg-preconfigure: unable to re-open stdin: 2023-10-08T06:10:45.678 INFO:teuthology.orchestra.run.smithi032.stdout:Fetched 2,878 kB in 0s (14.3 MB/s) 2023-10-08T06:10:45.972 INFO:teuthology.orchestra.run.smithi032.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 155241 files and directories currently installed.) 2023-10-08T06:10:45.977 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../0-uuid-runtime_2.34-0.1ubuntu9.4_amd64.deb ... 2023-10-08T06:10:46.109 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking uuid-runtime (2.34-0.1ubuntu9.4) over (2.34-0.1ubuntu9.3) ... 2023-10-08T06:10:46.568 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../1-gawk_1%3a5.0.1+dfsg-1ubuntu0.1_amd64.deb ... 2023-10-08T06:10:46.674 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking gawk (1:5.0.1+dfsg-1ubuntu0.1) over (1:5.0.1+dfsg-1) ... 2023-10-08T06:10:47.601 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../2-libsqlite3-0_3.31.1-4ubuntu0.5_amd64.deb ... 2023-10-08T06:10:47.793 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking libsqlite3-0:amd64 (3.31.1-4ubuntu0.5) over (3.31.1-4ubuntu0.3) ... 2023-10-08T06:10:48.203 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package libglusterfs0:amd64. 2023-10-08T06:10:48.223 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../3-libglusterfs0_7.2-2build1_amd64.deb ... 2023-10-08T06:10:48.262 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking libglusterfs0:amd64 (7.2-2build1) ... 2023-10-08T06:10:48.599 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package libgfxdr0:amd64. 2023-10-08T06:10:48.616 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../4-libgfxdr0_7.2-2build1_amd64.deb ... 2023-10-08T06:10:48.656 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking libgfxdr0:amd64 (7.2-2build1) ... 2023-10-08T06:10:49.010 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package libgfrpc0:amd64. 2023-10-08T06:10:49.028 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../5-libgfrpc0_7.2-2build1_amd64.deb ... 2023-10-08T06:10:49.068 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking libgfrpc0:amd64 (7.2-2build1) ... 2023-10-08T06:10:49.388 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package libgfapi0:amd64. 2023-10-08T06:10:49.408 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../6-libgfapi0_7.2-2build1_amd64.deb ... 2023-10-08T06:10:49.454 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking libgfapi0:amd64 (7.2-2build1) ... 2023-10-08T06:10:49.816 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package fio. 2023-10-08T06:10:49.834 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../7-fio_3.16-1_amd64.deb ... 2023-10-08T06:10:49.874 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking fio (3.16-1) ... 2023-10-08T06:10:50.220 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package libgdbm-dev:amd64. 2023-10-08T06:10:50.238 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../8-libgdbm-dev_1.18.1-5_amd64.deb ... 2023-10-08T06:10:50.278 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking libgdbm-dev:amd64 (1.18.1-5) ... 2023-10-08T06:10:50.582 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package sqlite3. 2023-10-08T06:10:50.600 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../9-sqlite3_3.31.1-4ubuntu0.5_amd64.deb ... 2023-10-08T06:10:50.640 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking sqlite3 (3.31.1-4ubuntu0.5) ... 2023-10-08T06:10:51.009 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up gawk (1:5.0.1+dfsg-1ubuntu0.1) ... 2023-10-08T06:10:51.262 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up libsqlite3-0:amd64 (3.31.1-4ubuntu0.5) ... 2023-10-08T06:10:51.389 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up libglusterfs0:amd64 (7.2-2build1) ... 2023-10-08T06:10:51.515 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up uuid-runtime (2.34-0.1ubuntu9.4) ... 2023-10-08T06:10:52.509 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up libgdbm-dev:amd64 (1.18.1-5) ... 2023-10-08T06:10:52.660 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up sqlite3 (3.31.1-4ubuntu0.5) ... 2023-10-08T06:10:52.786 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up libgfxdr0:amd64 (7.2-2build1) ... 2023-10-08T06:10:52.912 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up libgfrpc0:amd64 (7.2-2build1) ... 2023-10-08T06:10:53.040 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up libgfapi0:amd64 (7.2-2build1) ... 2023-10-08T06:10:53.158 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up fio (3.16-1) ... 2023-10-08T06:10:53.428 INFO:teuthology.orchestra.run.smithi032.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2023-10-08T06:10:53.604 INFO:teuthology.orchestra.run.smithi032.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2023-10-08T06:10:53.897 INFO:teuthology.orchestra.run.smithi032.stdout:Processing triggers for man-db (2.9.1-1) ... 2023-10-08T06:10:56.000 INFO:teuthology.orchestra.run.smithi032.stdout:Processing triggers for install-info (6.7.0.dfsg.2-5) ... 2023-10-08T06:10:56.590 DEBUG:teuthology.orchestra.run.smithi032:> sudo useradd -m fsgqa 2023-10-08T06:10:56.601 INFO:teuthology.orchestra.run.smithi032.stderr:useradd: user 'fsgqa' already exists 2023-10-08T06:10:56.602 DEBUG:teuthology.orchestra.run:got remote process result: 9 2023-10-08T06:10:56.603 DEBUG:teuthology.orchestra.run.smithi032:> sudo groupadd fsgqa 2023-10-08T06:10:56.613 INFO:teuthology.orchestra.run.smithi032.stderr:groupadd: group 'fsgqa' already exists 2023-10-08T06:10:56.615 DEBUG:teuthology.orchestra.run:got remote process result: 9 2023-10-08T06:10:56.615 DEBUG:teuthology.orchestra.run.smithi032:> sudo useradd fsgqa2 2023-10-08T06:10:56.997 DEBUG:teuthology.orchestra.run.smithi032:> sudo useradd 123456-fsgqa 2023-10-08T06:10:57.419 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json mon dump 2023-10-08T06:10:57.542 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:57.539+0000 7f71dd1e6700 1 Processor -- start 2023-10-08T06:10:57.542 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:57.539+0000 7f71dd1e6700 1 -- start start 2023-10-08T06:10:57.543 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:57.539+0000 7f71dd1e6700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f71d815b980 0x7f71d815f780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:57.543 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:57.539+0000 7f71dd1e6700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71d806fc20 con 0x7f71d80719e0 2023-10-08T06:10:57.543 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:57.539+0000 7f71dd1e6700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71d815fcc0 con 0x7f71d80c9b30 2023-10-08T06:10:57.543 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:57.539+0000 7f71dd1e6700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71d8070430 con 0x7f71d815b980 2023-10-08T06:10:57.543 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:57.539+0000 7f71d77fe700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f71d80719e0 0x7f71d80c9420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:36496/0 (socket says 172.21.15.32:36496) 2023-10-08T06:10:57.543 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:57.539+0000 7f71d77fe700 1 -- 172.21.15.32:0/1082189262 learned_addr learned my addr 172.21.15.32:0/1082189262 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-08T06:10:57.544 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:57.539+0000 7f71d7fff700 1 --2- 172.21.15.32:0/1082189262 >> v2:172.21.15.40:3300/0 conn(0x7f71d815b980 0x7f71d815f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:57.544 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:57.539+0000 7f71d6ffd700 1 -- 172.21.15.32:0/1082189262 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2072719049 0 0) 0x7f71d806fc20 con 0x7f71d80719e0 2023-10-08T06:10:57.544 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:57.539+0000 7f71d6ffd700 1 -- 172.21.15.32:0/1082189262 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f71c00035d0 con 0x7f71d80719e0 2023-10-08T06:10:57.545 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:57.543+0000 7f71d7fff700 1 -- 172.21.15.32:0/1082189262 >> v1:172.21.15.40:6789/0 conn(0x7f71d80c9b30 legacy=0x7f71d815bd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:57.545 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:57.543+0000 7f71d7fff700 1 -- 172.21.15.32:0/1082189262 >> v1:172.21.15.32:6789/0 conn(0x7f71d80719e0 legacy=0x7f71d80c9420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:57.545 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:57.543+0000 7f71d7fff700 1 -- 172.21.15.32:0/1082189262 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71d806fe70 con 0x7f71d815b980 2023-10-08T06:10:57.545 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:57.543+0000 7f71d7fff700 1 --2- 172.21.15.32:0/1082189262 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f71d815b980 0x7f71d815f780 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f71cc009850 tx=0x7f71cc009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3a4203251eb1d866 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:57.545 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:57.543+0000 7f71d6ffd700 1 -- 172.21.15.32:0/1082189262 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71cc011830 con 0x7f71d815b980 2023-10-08T06:10:57.545 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:57.543+0000 7f71d6ffd700 1 -- 172.21.15.32:0/1082189262 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71cc011990 con 0x7f71d815b980 2023-10-08T06:10:57.545 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:57.543+0000 7f71d6ffd700 1 -- 172.21.15.32:0/1082189262 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71cc011d40 con 0x7f71d815b980 2023-10-08T06:10:57.546 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:57.543+0000 7f71dd1e6700 1 -- 172.21.15.32:0/1082189262 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f71d815b980 msgr2=0x7f71d815f780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:57.546 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:57.543+0000 7f71dd1e6700 1 --2- 172.21.15.32:0/1082189262 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f71d815b980 0x7f71d815f780 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f71cc009850 tx=0x7f71cc009b60 comp rx=0 tx=0).stop 2023-10-08T06:10:57.546 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:57.543+0000 7f71dd1e6700 1 -- 172.21.15.32:0/1082189262 shutdown_connections 2023-10-08T06:10:57.546 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:57.543+0000 7f71dd1e6700 1 --2- 172.21.15.32:0/1082189262 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f71d815b980 0x7f71d815f780 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:57.546 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:57.543+0000 7f71dd1e6700 1 -- 172.21.15.32:0/1082189262 >> 172.21.15.32:0/1082189262 conn(0x7f71d80b0900 msgr2=0x7f71d80b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:10:57.546 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:57.543+0000 7f71dd1e6700 1 -- 172.21.15.32:0/1082189262 shutdown_connections 2023-10-08T06:10:57.546 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:57.543+0000 7f71dd1e6700 1 -- 172.21.15.32:0/1082189262 wait complete. 2023-10-08T06:10:57.547 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:57.543+0000 7f71dd1e6700 1 Processor -- start 2023-10-08T06:10:57.547 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:57.543+0000 7f71dd1e6700 1 -- start start 2023-10-08T06:10:57.549 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:57.547+0000 7f71dd1e6700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f71d80719e0 0x7f71d8154210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:57.549 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:57.547+0000 7f71dd1e6700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f71d80c9b30 0x7f71d806bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:57.549 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:57.547+0000 7f71dd1e6700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f71d815b980 0x7f71d806c230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:57.549 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:57.547+0000 7f71dd1e6700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71d80c3c80 con 0x7f71d815b980 2023-10-08T06:10:57.549 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:57.547+0000 7f71dd1e6700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71d80b2fc0 con 0x7f71d80719e0 2023-10-08T06:10:57.549 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:57.547+0000 7f71dd1e6700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71d80c3950 con 0x7f71d80c9b30 2023-10-08T06:10:57.549 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:57.547+0000 7f71dc9e5700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f71d815b980 0x7f71d806c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:57.549 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:57.547+0000 7f71dc9e5700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f71d815b980 0x7f71d806c230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:54016/0 (socket says 172.21.15.32:54016) 2023-10-08T06:10:57.549 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:57.547+0000 7f71dc9e5700 1 -- 172.21.15.32:0/1737352956 learned_addr learned my addr 172.21.15.32:0/1737352956 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:10:57.549 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:57.547+0000 7f71d77fe700 1 --2- 172.21.15.32:0/1737352956 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f71d80c9b30 0x7f71d806bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:57.550 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:57.547+0000 7f71d7fff700 1 --2- 172.21.15.32:0/1737352956 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f71d80719e0 0x7f71d8154210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:57.550 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:57.547+0000 7f71dc9e5700 1 -- 172.21.15.32:0/1737352956 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f71d80c9b30 msgr2=0x7f71d806bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:57.550 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:57.547+0000 7f71dc9e5700 1 --2- 172.21.15.32:0/1737352956 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f71d80c9b30 0x7f71d806bcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:57.550 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:57.547+0000 7f71dc9e5700 1 -- 172.21.15.32:0/1737352956 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f71d80719e0 msgr2=0x7f71d8154210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:57.550 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:57.547+0000 7f71dc9e5700 1 --2- 172.21.15.32:0/1737352956 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f71d80719e0 0x7f71d8154210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:57.550 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:57.547+0000 7f71dc9e5700 1 -- 172.21.15.32:0/1737352956 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71cc0094b0 con 0x7f71d815b980 2023-10-08T06:10:57.551 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:57.547+0000 7f71dc9e5700 1 --2- 172.21.15.32:0/1737352956 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f71d815b980 0x7f71d806c230 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f71d000cbf0 tx=0x7f71d000cf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:57.551 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:57.547+0000 7f71d4ff9700 1 -- 172.21.15.32:0/1737352956 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71d0003c20 con 0x7f71d815b980 2023-10-08T06:10:57.551 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:57.547+0000 7f71d4ff9700 1 -- 172.21.15.32:0/1737352956 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71d0003d80 con 0x7f71d815b980 2023-10-08T06:10:57.551 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:57.547+0000 7f71dd1e6700 1 -- 172.21.15.32:0/1737352956 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71d80b2720 con 0x7f71d815b980 2023-10-08T06:10:57.551 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:57.547+0000 7f71d4ff9700 1 -- 172.21.15.32:0/1737352956 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71d000aaa0 con 0x7f71d815b980 2023-10-08T06:10:57.552 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:57.547+0000 7f71dd1e6700 1 -- 172.21.15.32:0/1737352956 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71d80b2ce0 con 0x7f71d815b980 2023-10-08T06:10:57.553 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:57.547+0000 7f71dd1e6700 1 -- 172.21.15.32:0/1737352956 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71d80c3df0 con 0x7f71d815b980 2023-10-08T06:10:57.553 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:57.551+0000 7f71d4ff9700 1 -- 172.21.15.32:0/1737352956 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f71d000ac00 con 0x7f71d815b980 2023-10-08T06:10:57.554 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:57.551+0000 7f71d4ff9700 1 --2- 172.21.15.32:0/1737352956 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f71c4066510 0x7f71c40689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:57.554 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:57.551+0000 7f71d7fff700 1 --2- 172.21.15.32:0/1737352956 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f71c4066510 0x7f71c40689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:57.554 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:57.551+0000 7f71d4ff9700 1 -- 172.21.15.32:0/1737352956 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f71d0083e60 con 0x7f71d815b980 2023-10-08T06:10:57.554 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:57.551+0000 7f71d7fff700 1 --2- 172.21.15.32:0/1737352956 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f71c4066510 0x7f71c40689d0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f71cc0090b0 tx=0x7f71cc01c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:57.559 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:57.555+0000 7f71d4ff9700 1 -- 172.21.15.32:0/1737352956 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f71d80c3df0 con 0x7f71d815b980 2023-10-08T06:10:57.786 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:57.783+0000 7f71dd1e6700 1 -- 172.21.15.32:0/1737352956 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f71d80c3dc0 con 0x7f71d815b980 2023-10-08T06:10:57.786 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:57.783+0000 7f71d4ff9700 1 -- 172.21.15.32:0/1737352956 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+1268 (secure 0 0 0) 0x7f71d0051240 con 0x7f71d815b980 2023-10-08T06:10:57.787 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:10:57.787 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":1,"fsid":"ac672d87-96ae-41e0-9314-623ba2cdbbba","modified":"2023-10-08T06:08:34.985048Z","created":"2023-10-08T06:08:34.985048Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:3300","nonce":0},{"type":"v1","addr":"172.21.15.32:6789","nonce":0}]},"addr":"172.21.15.32:6789/0","public_addr":"172.21.15.32:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:3300","nonce":0},{"type":"v1","addr":"172.21.15.40:6789","nonce":0}]},"addr":"172.21.15.40:6789/0","public_addr":"172.21.15.40:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:3301","nonce":0},{"type":"v1","addr":"172.21.15.40:6790","nonce":0}]},"addr":"172.21.15.40:6790/0","public_addr":"172.21.15.40:6790/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2023-10-08T06:10:57.789 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:57.787+0000 7f71dd1e6700 1 -- 172.21.15.32:0/1737352956 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f71c4066510 msgr2=0x7f71c40689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:57.790 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:57.787+0000 7f71dd1e6700 1 --2- 172.21.15.32:0/1737352956 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f71c4066510 0x7f71c40689d0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f71cc0090b0 tx=0x7f71cc01c040 comp rx=0 tx=0).stop 2023-10-08T06:10:57.790 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:57.787+0000 7f71dd1e6700 1 -- 172.21.15.32:0/1737352956 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f71d815b980 msgr2=0x7f71d806c230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:57.790 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:57.787+0000 7f71dd1e6700 1 --2- 172.21.15.32:0/1737352956 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f71d815b980 0x7f71d806c230 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f71d000cbf0 tx=0x7f71d000cf00 comp rx=0 tx=0).stop 2023-10-08T06:10:57.790 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:57.787+0000 7f71dd1e6700 1 -- 172.21.15.32:0/1737352956 shutdown_connections 2023-10-08T06:10:57.790 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:57.787+0000 7f71dd1e6700 1 --2- 172.21.15.32:0/1737352956 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f71c4066510 0x7f71c40689d0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:57.790 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:57.787+0000 7f71dd1e6700 1 --2- 172.21.15.32:0/1737352956 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f71d815b980 0x7f71d806c230 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:57.790 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:57.787+0000 7f71dd1e6700 1 --2- 172.21.15.32:0/1737352956 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f71d80c9b30 0x7f71d806bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:57.790 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:57.787+0000 7f71dd1e6700 1 --2- 172.21.15.32:0/1737352956 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f71d80719e0 0x7f71d8154210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:57.790 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:57.787+0000 7f71dd1e6700 1 -- 172.21.15.32:0/1737352956 >> 172.21.15.32:0/1737352956 conn(0x7f71d80b0900 msgr2=0x7f71d815dd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:10:57.790 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:57.787+0000 7f71dd1e6700 1 -- 172.21.15.32:0/1737352956 shutdown_connections 2023-10-08T06:10:57.791 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:57.787+0000 7f71dd1e6700 1 -- 172.21.15.32:0/1737352956 wait complete. 2023-10-08T06:10:57.791 INFO:teuthology.orchestra.run.smithi032.stderr:dumped monmap epoch 1 2023-10-08T06:10:57.802 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth get client.admin 2023-10-08T06:10:57.916 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:57.915+0000 7f8ae9d58700 1 Processor -- start 2023-10-08T06:10:57.916 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:57.915+0000 7f8ae9d58700 1 -- start start 2023-10-08T06:10:57.917 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:57.915+0000 7f8ae9d58700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f8ae40ce600 0x7f8ae41684a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:57.917 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:57.915+0000 7f8ae9d58700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ae40d1620 con 0x7f8ae40b8b20 2023-10-08T06:10:57.917 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:57.915+0000 7f8ae9d58700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ae40d1320 con 0x7f8ae415d4b0 2023-10-08T06:10:57.917 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:57.915+0000 7f8ae9d58700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ae41619f0 con 0x7f8ae40ce600 2023-10-08T06:10:57.917 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:57.915+0000 7f8ae3fff700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f8ae40b8b20 0x7f8ae40cdef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:36502/0 (socket says 172.21.15.32:36502) 2023-10-08T06:10:57.918 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:57.915+0000 7f8ae3fff700 1 -- 172.21.15.32:0/3280708169 learned_addr learned my addr 172.21.15.32:0/3280708169 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-08T06:10:57.918 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:57.915+0000 7f8ae9557700 1 --2- 172.21.15.32:0/3280708169 >> v2:172.21.15.32:3300/0 conn(0x7f8ae40ce600 0x7f8ae41684a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:57.919 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:57.915+0000 7f8ae37fe700 1 -- 172.21.15.32:0/3280708169 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1084201250 0 0) 0x7f8ae40d1620 con 0x7f8ae40b8b20 2023-10-08T06:10:57.919 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:57.915+0000 7f8ae37fe700 1 -- 172.21.15.32:0/3280708169 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8ac40035d0 con 0x7f8ae40b8b20 2023-10-08T06:10:57.919 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:57.915+0000 7f8ae9557700 1 -- 172.21.15.32:0/3280708169 >> v1:172.21.15.40:6789/0 conn(0x7f8ae415d4b0 legacy=0x7f8ae4161110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:57.919 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:57.915+0000 7f8ae9557700 1 -- 172.21.15.32:0/3280708169 >> v1:172.21.15.32:6789/0 conn(0x7f8ae40b8b20 legacy=0x7f8ae40cdef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:57.919 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:57.915+0000 7f8ae9557700 1 -- 172.21.15.32:0/3280708169 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ae4161cd0 con 0x7f8ae40ce600 2023-10-08T06:10:57.919 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:57.915+0000 7f8ae9557700 1 --2- 172.21.15.32:0/3280708169 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8ae40ce600 0x7f8ae41684a0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f8ad4009850 tx=0x7f8ad4009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d1a748f334ce88d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:57.919 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:57.915+0000 7f8ae37fe700 1 -- 172.21.15.32:0/3280708169 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ad4011830 con 0x7f8ae40ce600 2023-10-08T06:10:57.919 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:57.915+0000 7f8ae37fe700 1 -- 172.21.15.32:0/3280708169 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ad4011990 con 0x7f8ae40ce600 2023-10-08T06:10:57.920 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:57.915+0000 7f8ae37fe700 1 -- 172.21.15.32:0/3280708169 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ad4011d40 con 0x7f8ae40ce600 2023-10-08T06:10:57.920 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:57.915+0000 7f8ae9d58700 1 -- 172.21.15.32:0/3280708169 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8ae40ce600 msgr2=0x7f8ae41684a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:57.920 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:57.915+0000 7f8ae9d58700 1 --2- 172.21.15.32:0/3280708169 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8ae40ce600 0x7f8ae41684a0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f8ad4009850 tx=0x7f8ad4009b60 comp rx=0 tx=0).stop 2023-10-08T06:10:57.920 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:57.915+0000 7f8ae9d58700 1 -- 172.21.15.32:0/3280708169 shutdown_connections 2023-10-08T06:10:57.921 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:57.915+0000 7f8ae9d58700 1 --2- 172.21.15.32:0/3280708169 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8ae40ce600 0x7f8ae41684a0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:57.921 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:57.915+0000 7f8ae9d58700 1 -- 172.21.15.32:0/3280708169 >> 172.21.15.32:0/3280708169 conn(0x7f8ae406ac60 msgr2=0x7f8ae406b070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:10:57.921 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:57.919+0000 7f8ae9d58700 1 -- 172.21.15.32:0/3280708169 shutdown_connections 2023-10-08T06:10:57.921 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:57.919+0000 7f8ae9d58700 1 -- 172.21.15.32:0/3280708169 wait complete. 2023-10-08T06:10:57.923 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:57.919+0000 7f8ae9d58700 1 Processor -- start 2023-10-08T06:10:57.923 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:57.919+0000 7f8ae9d58700 1 -- start start 2023-10-08T06:10:57.923 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:57.919+0000 7f8ae9d58700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8ae40b8b20 0x7f8ae40c94b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:57.923 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:57.919+0000 7f8ae9d58700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8ae40ce600 0x7f8ae40b4d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:57.923 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:57.919+0000 7f8ae9d58700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8ae415d4b0 0x7f8ae41f63a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:57.923 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:57.919+0000 7f8ae9d58700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ae40b5240 con 0x7f8ae415d4b0 2023-10-08T06:10:57.924 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:57.919+0000 7f8ae9d58700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ae41f68e0 con 0x7f8ae40b8b20 2023-10-08T06:10:57.924 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:57.919+0000 7f8ae9d58700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ae40b2830 con 0x7f8ae40ce600 2023-10-08T06:10:57.924 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:57.919+0000 7f8ae9557700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8ae415d4b0 0x7f8ae41f63a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:57.924 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:57.919+0000 7f8ae9557700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8ae415d4b0 0x7f8ae41f63a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:54036/0 (socket says 172.21.15.32:54036) 2023-10-08T06:10:57.924 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:57.919+0000 7f8ae9557700 1 -- 172.21.15.32:0/2191034506 learned_addr learned my addr 172.21.15.32:0/2191034506 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T06:10:57.924 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:57.919+0000 7f8ae3fff700 1 --2- 172.21.15.32:0/2191034506 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8ae40ce600 0x7f8ae40b4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:57.924 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:57.919+0000 7f8ae8d56700 1 --2- 172.21.15.32:0/2191034506 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8ae40b8b20 0x7f8ae40c94b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:57.924 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:57.919+0000 7f8ae9557700 1 -- 172.21.15.32:0/2191034506 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8ae40ce600 msgr2=0x7f8ae40b4d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:57.924 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:57.919+0000 7f8ae9557700 1 --2- 172.21.15.32:0/2191034506 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8ae40ce600 0x7f8ae40b4d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:57.924 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:57.919+0000 7f8ae9557700 1 -- 172.21.15.32:0/2191034506 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8ae40b8b20 msgr2=0x7f8ae40c94b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:57.924 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:57.919+0000 7f8ae9557700 1 --2- 172.21.15.32:0/2191034506 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8ae40b8b20 0x7f8ae40c94b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:57.925 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:57.919+0000 7f8ae9557700 1 -- 172.21.15.32:0/2191034506 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ad40094b0 con 0x7f8ae415d4b0 2023-10-08T06:10:57.925 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:57.919+0000 7f8ae8d56700 1 --2- 172.21.15.32:0/2191034506 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8ae40b8b20 0x7f8ae40c94b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T06:10:57.925 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:57.919+0000 7f8ae9557700 1 --2- 172.21.15.32:0/2191034506 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8ae415d4b0 0x7f8ae41f63a0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f8ad40090b0 tx=0x7f8ad4004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:57.925 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:57.919+0000 7f8ae17fa700 1 -- 172.21.15.32:0/2191034506 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ad401ab00 con 0x7f8ae415d4b0 2023-10-08T06:10:57.925 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:57.919+0000 7f8ae9d58700 1 -- 172.21.15.32:0/2191034506 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ae41f6b80 con 0x7f8ae415d4b0 2023-10-08T06:10:57.925 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:57.919+0000 7f8ae17fa700 1 -- 172.21.15.32:0/2191034506 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ad401f070 con 0x7f8ae415d4b0 2023-10-08T06:10:57.925 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:57.919+0000 7f8ae17fa700 1 -- 172.21.15.32:0/2191034506 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ad401b430 con 0x7f8ae415d4b0 2023-10-08T06:10:57.925 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:57.919+0000 7f8ae9d58700 1 -- 172.21.15.32:0/2191034506 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ae41f7140 con 0x7f8ae415d4b0 2023-10-08T06:10:57.926 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:57.923+0000 7f8ae9d58700 1 -- 172.21.15.32:0/2191034506 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ae40686a0 con 0x7f8ae415d4b0 2023-10-08T06:10:57.926 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:57.923+0000 7f8ae17fa700 1 -- 172.21.15.32:0/2191034506 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f8ad401b590 con 0x7f8ae415d4b0 2023-10-08T06:10:57.926 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:57.923+0000 7f8ae17fa700 1 --2- 172.21.15.32:0/2191034506 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f8ac8066510 0x7f8ac80689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T06:10:57.926 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:57.923+0000 7f8ae17fa700 1 -- 172.21.15.32:0/2191034506 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8ad4084ee0 con 0x7f8ae415d4b0 2023-10-08T06:10:57.926 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:57.923+0000 7f8ae8d56700 1 --2- 172.21.15.32:0/2191034506 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f8ac8066510 0x7f8ac80689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T06:10:57.927 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:57.923+0000 7f8ae8d56700 1 --2- 172.21.15.32:0/2191034506 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f8ac8066510 0x7f8ac80689d0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f8acc000f60 tx=0x7f8acc009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T06:10:57.935 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:57.931+0000 7f8ae17fa700 1 -- 172.21.15.32:0/2191034506 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f8ad4052370 con 0x7f8ae415d4b0 2023-10-08T06:10:58.162 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:58.159+0000 7f8ae9d58700 1 -- 172.21.15.32:0/2191034506 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "auth get", "entity": "client.admin"} v 0) v1 -- 0x7f8ae40d0e30 con 0x7f8ae415d4b0 2023-10-08T06:10:58.162 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:58.159+0000 7f8ae17fa700 1 -- 172.21.15.32:0/2191034506 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "auth get", "entity": "client.admin"}]=0 v9) v1 ==== 82+0+151 (secure 0 0 0) 0x7f8ad40210b0 con 0x7f8ae415d4b0 2023-10-08T06:10:58.163 INFO:teuthology.orchestra.run.smithi032.stdout:[client.admin] 2023-10-08T06:10:58.163 INFO:teuthology.orchestra.run.smithi032.stdout: key = AQBjRyJlxMCOBhAAgv1F3ImMj063o4hyhAc0Yg== 2023-10-08T06:10:58.163 INFO:teuthology.orchestra.run.smithi032.stdout: caps mds = "allow *" 2023-10-08T06:10:58.163 INFO:teuthology.orchestra.run.smithi032.stdout: caps mgr = "allow *" 2023-10-08T06:10:58.163 INFO:teuthology.orchestra.run.smithi032.stdout: caps mon = "allow *" 2023-10-08T06:10:58.163 INFO:teuthology.orchestra.run.smithi032.stdout: caps osd = "allow *" 2023-10-08T06:10:58.166 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:58.163+0000 7f8ae9d58700 1 -- 172.21.15.32:0/2191034506 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f8ac8066510 msgr2=0x7f8ac80689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:58.166 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:58.163+0000 7f8ae9d58700 1 --2- 172.21.15.32:0/2191034506 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f8ac8066510 0x7f8ac80689d0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f8acc000f60 tx=0x7f8acc009040 comp rx=0 tx=0).stop 2023-10-08T06:10:58.166 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:58.163+0000 7f8ae9d58700 1 -- 172.21.15.32:0/2191034506 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8ae415d4b0 msgr2=0x7f8ae41f63a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T06:10:58.166 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:58.163+0000 7f8ae9d58700 1 --2- 172.21.15.32:0/2191034506 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8ae415d4b0 0x7f8ae41f63a0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f8ad40090b0 tx=0x7f8ad4004770 comp rx=0 tx=0).stop 2023-10-08T06:10:58.166 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:58.163+0000 7f8ae9d58700 1 -- 172.21.15.32:0/2191034506 shutdown_connections 2023-10-08T06:10:58.166 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:58.163+0000 7f8ae9d58700 1 --2- 172.21.15.32:0/2191034506 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f8ac8066510 0x7f8ac80689d0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:58.167 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:58.163+0000 7f8ae9d58700 1 --2- 172.21.15.32:0/2191034506 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8ae415d4b0 0x7f8ae41f63a0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:58.167 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:58.163+0000 7f8ae9d58700 1 --2- 172.21.15.32:0/2191034506 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8ae40ce600 0x7f8ae40b4d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:58.167 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:58.163+0000 7f8ae9d58700 1 --2- 172.21.15.32:0/2191034506 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8ae40b8b20 0x7f8ae40c94b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T06:10:58.167 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:58.163+0000 7f8ae9d58700 1 -- 172.21.15.32:0/2191034506 >> 172.21.15.32:0/2191034506 conn(0x7f8ae406ac60 msgr2=0x7f8ae415c680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T06:10:58.167 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:58.163+0000 7f8ae9d58700 1 -- 172.21.15.32:0/2191034506 shutdown_connections 2023-10-08T06:10:58.167 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T06:10:58.163+0000 7f8ae9d58700 1 -- 172.21.15.32:0/2191034506 wait complete. 2023-10-08T06:10:58.180 DEBUG:teuthology.orchestra.run.smithi032:> mktemp 2023-10-08T06:10:58.185 INFO:teuthology.orchestra.run.smithi032.stdout:/tmp/tmp.jFC5RFbzRw 2023-10-08T06:10:58.186 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2023-10-08T06:10:58.186 DEBUG:teuthology.orchestra.run.smithi032:> dd of=/tmp/tmp.jFC5RFbzRw 2023-10-08T06:10:58.191 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2023-10-08T06:10:58.191 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd of=/tmp/tmp.p8vAuQqzIgxfstests-dev/local.config 2023-10-08T06:10:58.203 INFO:tasks.cephfs.xfstests_dev:local.config's contents - export FSTYP=ceph-fuse export CEPH_FUSE_BIN_PATH=ceph-fuse export TEST_DEV=ceph-fuse # without this tests won't get started export TEST_DIR=/tmp/tmp.t2WBfhO8BYtest export SCRATCH_DEV= export SCRATCH_MNT=/tmp/tmp.DuxgoqTKXAscratch export CEPHFS_MOUNT_OPTIONS="-m 172.21.15.32:6789 -k /tmp/tmp.jFC5RFbzRw --client_mountpoint /test" 2023-10-08T06:10:58.203 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2023-10-08T06:10:58.203 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd of=/tmp/tmp.p8vAuQqzIgxfstests-dev/ceph.exclude 2023-10-08T06:10:58.263 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo make) 2023-10-08T06:10:58.290 INFO:teuthology.orchestra.run.smithi032.stdout:libtoolize -cfi 2023-10-08T06:10:58.739 INFO:teuthology.orchestra.run.smithi032.stdout:libtoolize: putting auxiliary files in '.'. 2023-10-08T06:10:58.739 INFO:teuthology.orchestra.run.smithi032.stdout:libtoolize: copying file './config.guess' 2023-10-08T06:10:58.749 INFO:teuthology.orchestra.run.smithi032.stdout:libtoolize: copying file './config.sub' 2023-10-08T06:10:58.764 INFO:teuthology.orchestra.run.smithi032.stdout:libtoolize: copying file './install-sh' 2023-10-08T06:10:58.775 INFO:teuthology.orchestra.run.smithi032.stdout:libtoolize: copying file './ltmain.sh' 2023-10-08T06:10:58.823 INFO:teuthology.orchestra.run.smithi032.stdout:libtoolize: putting macros in AC_CONFIG_MACRO_DIRS, 'm4'. 2023-10-08T06:10:58.823 INFO:teuthology.orchestra.run.smithi032.stdout:libtoolize: copying file 'm4/libtool.m4' 2023-10-08T06:10:58.835 INFO:teuthology.orchestra.run.smithi032.stdout:libtoolize: copying file 'm4/ltoptions.m4' 2023-10-08T06:10:58.846 INFO:teuthology.orchestra.run.smithi032.stdout:libtoolize: copying file 'm4/ltsugar.m4' 2023-10-08T06:10:58.857 INFO:teuthology.orchestra.run.smithi032.stdout:libtoolize: copying file 'm4/ltversion.m4' 2023-10-08T06:10:58.865 INFO:teuthology.orchestra.run.smithi032.stdout:libtoolize: copying file 'm4/lt~obsolete.m4' 2023-10-08T06:10:58.873 INFO:teuthology.orchestra.run.smithi032.stdout:libtoolize: Consider adding '-I m4' to ACLOCAL_AMFLAGS in Makefile.am. 2023-10-08T06:10:58.875 INFO:teuthology.orchestra.run.smithi032.stdout:cp include/install-sh . 2023-10-08T06:10:58.876 INFO:teuthology.orchestra.run.smithi032.stdout:aclocal -I m4 2023-10-08T06:11:00.350 INFO:teuthology.orchestra.run.smithi032.stdout:autoheader 2023-10-08T06:11:00.733 INFO:teuthology.orchestra.run.smithi032.stdout:autoconf 2023-10-08T06:11:00.972 INFO:teuthology.orchestra.run.smithi032.stdout:./configure \ 2023-10-08T06:11:00.973 INFO:teuthology.orchestra.run.smithi032.stdout: --libexecdir=/usr/lib \ 2023-10-08T06:11:00.973 INFO:teuthology.orchestra.run.smithi032.stdout: --exec_prefix=/var/lib 2023-10-08T06:11:01.741 INFO:teuthology.orchestra.run.smithi032.stdout:checking build system type... x86_64-pc-linux-gnu 2023-10-08T06:11:01.742 INFO:teuthology.orchestra.run.smithi032.stdout:checking host system type... x86_64-pc-linux-gnu 2023-10-08T06:11:01.784 INFO:teuthology.orchestra.run.smithi032.stdout:checking how to print strings... printf 2023-10-08T06:11:01.784 INFO:teuthology.orchestra.run.smithi032.stdout:checking for gcc... gcc 2023-10-08T06:11:02.000 INFO:teuthology.orchestra.run.smithi032.stdout:checking whether the C compiler works... yes 2023-10-08T06:11:02.001 INFO:teuthology.orchestra.run.smithi032.stdout:checking for C compiler default output file name... a.out 2023-10-08T06:11:02.057 INFO:teuthology.orchestra.run.smithi032.stdout:checking for suffix of executables... 2023-10-08T06:11:02.161 INFO:teuthology.orchestra.run.smithi032.stdout:checking whether we are cross compiling... no 2023-10-08T06:11:02.198 INFO:teuthology.orchestra.run.smithi032.stdout:checking for suffix of object files... o 2023-10-08T06:11:02.227 INFO:teuthology.orchestra.run.smithi032.stdout:checking whether we are using the GNU C compiler... yes 2023-10-08T06:11:02.263 INFO:teuthology.orchestra.run.smithi032.stdout:checking whether gcc accepts -g... yes 2023-10-08T06:11:02.353 INFO:teuthology.orchestra.run.smithi032.stdout:checking for gcc option to accept ISO C89... none needed 2023-10-08T06:11:02.359 INFO:teuthology.orchestra.run.smithi032.stdout:checking for a sed that does not truncate output... /usr/bin/sed 2023-10-08T06:11:02.364 INFO:teuthology.orchestra.run.smithi032.stdout:checking for grep that handles long lines and -e... /usr/bin/grep 2023-10-08T06:11:02.366 INFO:teuthology.orchestra.run.smithi032.stdout:checking for egrep... /usr/bin/grep -E 2023-10-08T06:11:02.369 INFO:teuthology.orchestra.run.smithi032.stdout:checking for fgrep... /usr/bin/grep -F 2023-10-08T06:11:02.377 INFO:teuthology.orchestra.run.smithi032.stdout:checking for ld used by gcc... /usr/bin/ld 2023-10-08T06:11:02.380 INFO:teuthology.orchestra.run.smithi032.stdout:checking if the linker (/usr/bin/ld) is GNU ld... yes 2023-10-08T06:11:02.392 INFO:teuthology.orchestra.run.smithi032.stdout:checking for BSD- or MS-compatible name lister (nm)... /usr/bin/nm -B 2023-10-08T06:11:02.445 INFO:teuthology.orchestra.run.smithi032.stdout:checking the name lister (/usr/bin/nm -B) interface... BSD nm 2023-10-08T06:11:02.445 INFO:teuthology.orchestra.run.smithi032.stdout:checking whether ln -s works... yes 2023-10-08T06:11:02.455 INFO:teuthology.orchestra.run.smithi032.stdout:checking the maximum length of command line arguments... 1572864 2023-10-08T06:11:02.460 INFO:teuthology.orchestra.run.smithi032.stdout:checking how to convert x86_64-pc-linux-gnu file names to x86_64-pc-linux-gnu format... func_convert_file_noop 2023-10-08T06:11:02.461 INFO:teuthology.orchestra.run.smithi032.stdout:checking how to convert x86_64-pc-linux-gnu file names to toolchain format... func_convert_file_noop 2023-10-08T06:11:02.461 INFO:teuthology.orchestra.run.smithi032.stdout:checking for /usr/bin/ld option to reload object files... -r 2023-10-08T06:11:02.462 INFO:teuthology.orchestra.run.smithi032.stdout:checking for objdump... objdump 2023-10-08T06:11:02.464 INFO:teuthology.orchestra.run.smithi032.stdout:checking how to recognize dependent libraries... pass_all 2023-10-08T06:11:02.465 INFO:teuthology.orchestra.run.smithi032.stdout:checking for dlltool... no 2023-10-08T06:11:02.466 INFO:teuthology.orchestra.run.smithi032.stdout:checking how to associate runtime and link libraries... printf %s\n 2023-10-08T06:11:02.467 INFO:teuthology.orchestra.run.smithi032.stdout:checking for ar... ar 2023-10-08T06:11:02.513 INFO:teuthology.orchestra.run.smithi032.stdout:checking for archiver @FILE support... @ 2023-10-08T06:11:02.514 INFO:teuthology.orchestra.run.smithi032.stdout:checking for strip... strip 2023-10-08T06:11:02.516 INFO:teuthology.orchestra.run.smithi032.stdout:checking for ranlib... ranlib 2023-10-08T06:11:02.516 INFO:teuthology.orchestra.run.smithi032.stdout:checking for gawk... gawk 2023-10-08T06:11:02.628 INFO:teuthology.orchestra.run.smithi032.stdout:checking command to parse /usr/bin/nm -B output from gcc object... ok 2023-10-08T06:11:02.631 INFO:teuthology.orchestra.run.smithi032.stdout:checking for sysroot... no 2023-10-08T06:11:02.637 INFO:teuthology.orchestra.run.smithi032.stdout:checking for a working dd... /usr/bin/dd 2023-10-08T06:11:02.643 INFO:teuthology.orchestra.run.smithi032.stdout:checking how to truncate binary pipes... /usr/bin/dd bs=4096 count=1 2023-10-08T06:11:02.671 INFO:teuthology.orchestra.run.smithi032.stdout:checking for mt... mt 2023-10-08T06:11:02.697 INFO:teuthology.orchestra.run.smithi032.stdout:checking if mt is a manifest tool... no 2023-10-08T06:11:02.758 INFO:teuthology.orchestra.run.smithi032.stdout:checking how to run the C preprocessor... gcc -E 2023-10-08T06:11:02.960 INFO:teuthology.orchestra.run.smithi032.stdout:checking for ANSI C header files... yes 2023-10-08T06:11:03.003 INFO:teuthology.orchestra.run.smithi032.stdout:checking for sys/types.h... yes 2023-10-08T06:11:03.060 INFO:teuthology.orchestra.run.smithi032.stdout:checking for sys/stat.h... yes 2023-10-08T06:11:03.109 INFO:teuthology.orchestra.run.smithi032.stdout:checking for stdlib.h... yes 2023-10-08T06:11:03.161 INFO:teuthology.orchestra.run.smithi032.stdout:checking for string.h... yes 2023-10-08T06:11:03.211 INFO:teuthology.orchestra.run.smithi032.stdout:checking for memory.h... yes 2023-10-08T06:11:03.264 INFO:teuthology.orchestra.run.smithi032.stdout:checking for strings.h... yes 2023-10-08T06:11:03.316 INFO:teuthology.orchestra.run.smithi032.stdout:checking for inttypes.h... yes 2023-10-08T06:11:03.369 INFO:teuthology.orchestra.run.smithi032.stdout:checking for stdint.h... yes 2023-10-08T06:11:03.430 INFO:teuthology.orchestra.run.smithi032.stdout:checking for unistd.h... yes 2023-10-08T06:11:03.482 INFO:teuthology.orchestra.run.smithi032.stdout:checking for dlfcn.h... yes 2023-10-08T06:11:03.489 INFO:teuthology.orchestra.run.smithi032.stdout:checking for objdir... .libs 2023-10-08T06:11:03.642 INFO:teuthology.orchestra.run.smithi032.stdout:checking if gcc supports -fno-rtti -fno-exceptions... no 2023-10-08T06:11:03.643 INFO:teuthology.orchestra.run.smithi032.stdout:checking for gcc option to produce PIC... -fPIC -DPIC 2023-10-08T06:11:03.679 INFO:teuthology.orchestra.run.smithi032.stdout:checking if gcc PIC flag -fPIC -DPIC works... yes 2023-10-08T06:11:03.849 INFO:teuthology.orchestra.run.smithi032.stdout:checking if gcc static flag -static works... yes 2023-10-08T06:11:03.892 INFO:teuthology.orchestra.run.smithi032.stdout:checking if gcc supports -c -o file.o... yes 2023-10-08T06:11:03.893 INFO:teuthology.orchestra.run.smithi032.stdout:checking if gcc supports -c -o file.o... (cached) yes 2023-10-08T06:11:03.916 INFO:teuthology.orchestra.run.smithi032.stdout:checking whether the gcc linker (/usr/bin/ld -m elf_x86_64) supports shared libraries... yes 2023-10-08T06:11:03.960 INFO:teuthology.orchestra.run.smithi032.stdout:checking whether -lc should be explicitly linked in... no 2023-10-08T06:11:04.043 INFO:teuthology.orchestra.run.smithi032.stdout:checking dynamic linker characteristics... GNU/Linux ld.so 2023-10-08T06:11:04.043 INFO:teuthology.orchestra.run.smithi032.stdout:checking how to hardcode library paths into programs... immediate 2023-10-08T06:11:04.051 INFO:teuthology.orchestra.run.smithi032.stdout:checking whether stripping libraries is possible... yes 2023-10-08T06:11:04.051 INFO:teuthology.orchestra.run.smithi032.stdout:checking if libtool supports shared libraries... yes 2023-10-08T06:11:04.052 INFO:teuthology.orchestra.run.smithi032.stdout:checking whether to build shared libraries... yes 2023-10-08T06:11:04.052 INFO:teuthology.orchestra.run.smithi032.stdout:checking whether to build static libraries... yes 2023-10-08T06:11:04.069 INFO:teuthology.orchestra.run.smithi032.stdout:checking for gcc... (cached) gcc 2023-10-08T06:11:04.106 INFO:teuthology.orchestra.run.smithi032.stdout:checking whether we are using the GNU C compiler... (cached) yes 2023-10-08T06:11:04.107 INFO:teuthology.orchestra.run.smithi032.stdout:checking whether gcc accepts -g... (cached) yes 2023-10-08T06:11:04.108 INFO:teuthology.orchestra.run.smithi032.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2023-10-08T06:11:04.109 INFO:teuthology.orchestra.run.smithi032.stdout:checking for gmake... no 2023-10-08T06:11:04.109 INFO:teuthology.orchestra.run.smithi032.stdout:checking for make... /usr/bin/make 2023-10-08T06:11:04.110 INFO:teuthology.orchestra.run.smithi032.stderr:./configure: line 8824: test: $(SHELL): binary operator expected 2023-10-08T06:11:04.111 INFO:teuthology.orchestra.run.smithi032.stdout:checking for tar... /bin/tar 2023-10-08T06:11:04.112 INFO:teuthology.orchestra.run.smithi032.stdout:checking for gzip... /bin/gzip 2023-10-08T06:11:04.127 INFO:teuthology.orchestra.run.smithi032.stdout:checking whether gcc -MM is supported... yes 2023-10-08T06:11:04.128 INFO:teuthology.orchestra.run.smithi032.stdout:checking for sort... /bin/sort 2023-10-08T06:11:04.128 INFO:teuthology.orchestra.run.smithi032.stdout:checking whether ln -s works... yes 2023-10-08T06:11:04.129 INFO:teuthology.orchestra.run.smithi032.stdout:checking for rpm... no 2023-10-08T06:11:04.181 INFO:teuthology.orchestra.run.smithi032.stdout:checking assert.h usability... yes 2023-10-08T06:11:04.193 INFO:teuthology.orchestra.run.smithi032.stdout:checking assert.h presence... yes 2023-10-08T06:11:04.194 INFO:teuthology.orchestra.run.smithi032.stdout:checking for assert.h... yes 2023-10-08T06:11:04.250 INFO:teuthology.orchestra.run.smithi032.stdout:checking bstring.h usability... no 2023-10-08T06:11:04.271 INFO:teuthology.orchestra.run.smithi032.stdout:checking bstring.h presence... no 2023-10-08T06:11:04.271 INFO:teuthology.orchestra.run.smithi032.stdout:checking for bstring.h... no 2023-10-08T06:11:04.322 INFO:teuthology.orchestra.run.smithi032.stdout:checking libgen.h usability... yes 2023-10-08T06:11:04.333 INFO:teuthology.orchestra.run.smithi032.stdout:checking libgen.h presence... yes 2023-10-08T06:11:04.333 INFO:teuthology.orchestra.run.smithi032.stdout:checking for libgen.h... yes 2023-10-08T06:11:04.376 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T06:11:04.378 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T06:11:04.395 INFO:teuthology.orchestra.run.smithi032.stdout:checking dirent.h usability... yes 2023-10-08T06:11:04.411 INFO:teuthology.orchestra.run.smithi032.stdout:checking dirent.h presence... yes 2023-10-08T06:11:04.411 INFO:teuthology.orchestra.run.smithi032.stdout:checking for dirent.h... yes 2023-10-08T06:11:04.496 INFO:teuthology.orchestra.run.smithi032.stdout:checking errno.h usability... yes 2023-10-08T06:11:04.510 INFO:teuthology.orchestra.run.smithi032.stdout:checking errno.h presence... yes 2023-10-08T06:11:04.510 INFO:teuthology.orchestra.run.smithi032.stdout:checking for errno.h... yes 2023-10-08T06:11:04.571 INFO:teuthology.orchestra.run.smithi032.stdout:checking malloc.h usability... yes 2023-10-08T06:11:04.591 INFO:teuthology.orchestra.run.smithi032.stdout:checking malloc.h presence... yes 2023-10-08T06:11:04.591 INFO:teuthology.orchestra.run.smithi032.stdout:checking for malloc.h... yes 2023-10-08T06:11:04.645 INFO:teuthology.orchestra.run.smithi032.stdout:checking uuid.h usability... no 2023-10-08T06:11:04.664 INFO:teuthology.orchestra.run.smithi032.stdout:checking uuid.h presence... no 2023-10-08T06:11:04.664 INFO:teuthology.orchestra.run.smithi032.stdout:checking for uuid.h... no 2023-10-08T06:11:04.718 INFO:teuthology.orchestra.run.smithi032.stdout:checking uuid/uuid.h usability... yes 2023-10-08T06:11:04.736 INFO:teuthology.orchestra.run.smithi032.stdout:checking uuid/uuid.h presence... yes 2023-10-08T06:11:04.736 INFO:teuthology.orchestra.run.smithi032.stdout:checking for uuid/uuid.h... yes 2023-10-08T06:11:04.804 INFO:teuthology.orchestra.run.smithi032.stdout:checking sys/uuid.h usability... no 2023-10-08T06:11:04.826 INFO:teuthology.orchestra.run.smithi032.stdout:checking sys/uuid.h presence... no 2023-10-08T06:11:04.826 INFO:teuthology.orchestra.run.smithi032.stdout:checking for sys/uuid.h... no 2023-10-08T06:11:04.883 INFO:teuthology.orchestra.run.smithi032.stdout:checking sys/file.h usability... yes 2023-10-08T06:11:04.897 INFO:teuthology.orchestra.run.smithi032.stdout:checking sys/file.h presence... yes 2023-10-08T06:11:04.897 INFO:teuthology.orchestra.run.smithi032.stdout:checking for sys/file.h... yes 2023-10-08T06:11:04.956 INFO:teuthology.orchestra.run.smithi032.stdout:checking sys/fcntl.h usability... yes 2023-10-08T06:11:04.971 INFO:teuthology.orchestra.run.smithi032.stdout:checking sys/fcntl.h presence... yes 2023-10-08T06:11:04.971 INFO:teuthology.orchestra.run.smithi032.stdout:checking for sys/fcntl.h... yes 2023-10-08T06:11:05.030 INFO:teuthology.orchestra.run.smithi032.stdout:checking sys/syssgi.h usability... no 2023-10-08T06:11:05.052 INFO:teuthology.orchestra.run.smithi032.stdout:checking sys/syssgi.h presence... no 2023-10-08T06:11:05.052 INFO:teuthology.orchestra.run.smithi032.stdout:checking for sys/syssgi.h... no 2023-10-08T06:11:05.131 INFO:teuthology.orchestra.run.smithi032.stdout:checking sys/param.h usability... yes 2023-10-08T06:11:05.151 INFO:teuthology.orchestra.run.smithi032.stdout:checking sys/param.h presence... yes 2023-10-08T06:11:05.151 INFO:teuthology.orchestra.run.smithi032.stdout:checking for sys/param.h... yes 2023-10-08T06:11:05.163 INFO:teuthology.orchestra.run.smithi032.stdout:checking for sys/stat.h... (cached) yes 2023-10-08T06:11:05.224 INFO:teuthology.orchestra.run.smithi032.stdout:checking sys/statvfs.h usability... yes 2023-10-08T06:11:05.240 INFO:teuthology.orchestra.run.smithi032.stdout:checking sys/statvfs.h presence... yes 2023-10-08T06:11:05.240 INFO:teuthology.orchestra.run.smithi032.stdout:checking for sys/statvfs.h... yes 2023-10-08T06:11:05.298 INFO:teuthology.orchestra.run.smithi032.stdout:checking sys/time.h usability... yes 2023-10-08T06:11:05.309 INFO:teuthology.orchestra.run.smithi032.stdout:checking sys/time.h presence... yes 2023-10-08T06:11:05.309 INFO:teuthology.orchestra.run.smithi032.stdout:checking for sys/time.h... yes 2023-10-08T06:11:05.387 INFO:teuthology.orchestra.run.smithi032.stdout:checking sys/ioctl.h usability... yes 2023-10-08T06:11:05.403 INFO:teuthology.orchestra.run.smithi032.stdout:checking sys/ioctl.h presence... yes 2023-10-08T06:11:05.403 INFO:teuthology.orchestra.run.smithi032.stdout:checking for sys/ioctl.h... yes 2023-10-08T06:11:05.469 INFO:teuthology.orchestra.run.smithi032.stdout:checking sys/wait.h usability... yes 2023-10-08T06:11:05.488 INFO:teuthology.orchestra.run.smithi032.stdout:checking sys/wait.h presence... yes 2023-10-08T06:11:05.488 INFO:teuthology.orchestra.run.smithi032.stdout:checking for sys/wait.h... yes 2023-10-08T06:11:05.499 INFO:teuthology.orchestra.run.smithi032.stdout:checking for sys/types.h... (cached) yes 2023-10-08T06:11:05.509 INFO:teuthology.orchestra.run.smithi032.stdout:checking for strings.h... (cached) yes 2023-10-08T06:11:05.563 INFO:teuthology.orchestra.run.smithi032.stdout:checking err.h usability... yes 2023-10-08T06:11:05.578 INFO:teuthology.orchestra.run.smithi032.stdout:checking err.h presence... yes 2023-10-08T06:11:05.579 INFO:teuthology.orchestra.run.smithi032.stdout:checking for err.h... yes 2023-10-08T06:11:05.647 INFO:teuthology.orchestra.run.smithi032.stdout:checking linux/falloc.h usability... yes 2023-10-08T06:11:05.660 INFO:teuthology.orchestra.run.smithi032.stdout:checking linux/falloc.h presence... yes 2023-10-08T06:11:05.660 INFO:teuthology.orchestra.run.smithi032.stdout:checking for linux/falloc.h... yes 2023-10-08T06:11:05.718 INFO:teuthology.orchestra.run.smithi032.stdout:checking sys/fs/xfs_fsops.h usability... no 2023-10-08T06:11:05.739 INFO:teuthology.orchestra.run.smithi032.stdout:checking sys/fs/xfs_fsops.h presence... no 2023-10-08T06:11:05.739 INFO:teuthology.orchestra.run.smithi032.stdout:checking for sys/fs/xfs_fsops.h... no 2023-10-08T06:11:05.791 INFO:teuthology.orchestra.run.smithi032.stdout:checking sys/fs/xfs_itable.h usability... no 2023-10-08T06:11:05.812 INFO:teuthology.orchestra.run.smithi032.stdout:checking sys/fs/xfs_itable.h presence... no 2023-10-08T06:11:05.812 INFO:teuthology.orchestra.run.smithi032.stdout:checking for sys/fs/xfs_itable.h... no 2023-10-08T06:11:05.862 INFO:teuthology.orchestra.run.smithi032.stdout:checking xfs/platform_defs.h usability... no 2023-10-08T06:11:05.881 INFO:teuthology.orchestra.run.smithi032.stdout:checking xfs/platform_defs.h presence... no 2023-10-08T06:11:05.881 INFO:teuthology.orchestra.run.smithi032.stdout:checking for xfs/platform_defs.h... no 2023-10-08T06:11:05.933 INFO:teuthology.orchestra.run.smithi032.stdout:checking btrfs/ioctl.h usability... no 2023-10-08T06:11:05.954 INFO:teuthology.orchestra.run.smithi032.stdout:checking btrfs/ioctl.h presence... no 2023-10-08T06:11:05.954 INFO:teuthology.orchestra.run.smithi032.stdout:checking for btrfs/ioctl.h... no 2023-10-08T06:11:06.005 INFO:teuthology.orchestra.run.smithi032.stdout:checking cifs/ioctl.h usability... no 2023-10-08T06:11:06.026 INFO:teuthology.orchestra.run.smithi032.stdout:checking cifs/ioctl.h presence... no 2023-10-08T06:11:06.026 INFO:teuthology.orchestra.run.smithi032.stdout:checking for cifs/ioctl.h... no 2023-10-08T06:11:06.082 INFO:teuthology.orchestra.run.smithi032.stdout:checking sys/mman.h usability... yes 2023-10-08T06:11:06.093 INFO:teuthology.orchestra.run.smithi032.stdout:checking sys/mman.h presence... yes 2023-10-08T06:11:06.093 INFO:teuthology.orchestra.run.smithi032.stdout:checking for sys/mman.h... yes 2023-10-08T06:11:06.124 INFO:teuthology.orchestra.run.smithi032.stdout:checking for xfs/xfs_log_format.h... no 2023-10-08T06:11:06.184 INFO:teuthology.orchestra.run.smithi032.stdout:checking for uuid_compare... no 2023-10-08T06:11:06.240 INFO:teuthology.orchestra.run.smithi032.stdout:checking for uuid_compare in -luuid... yes 2023-10-08T06:11:06.349 INFO:teuthology.orchestra.run.smithi032.stdout:checking for xfs/xfs.h... yes 2023-10-08T06:11:06.380 INFO:teuthology.orchestra.run.smithi032.stdout:checking for xfs/libxfs.h... no 2023-10-08T06:11:06.414 INFO:teuthology.orchestra.run.smithi032.stdout:checking whether xlog_assign_lsn is declared... no 2023-10-08T06:11:06.464 INFO:teuthology.orchestra.run.smithi032.stdout:checking for xfs/xqm.h... yes 2023-10-08T06:11:06.547 INFO:teuthology.orchestra.run.smithi032.stdout:checking xfsctl from xfs/xfs.h... ok 2023-10-08T06:11:06.598 INFO:teuthology.orchestra.run.smithi032.stdout:checking xfs/handle.h usability... yes 2023-10-08T06:11:06.609 INFO:teuthology.orchestra.run.smithi032.stdout:checking xfs/handle.h presence... yes 2023-10-08T06:11:06.610 INFO:teuthology.orchestra.run.smithi032.stdout:checking for xfs/handle.h... yes 2023-10-08T06:11:06.685 INFO:teuthology.orchestra.run.smithi032.stdout:checking for attr_list_by_handle in -lhandle... yes 2023-10-08T06:11:06.749 INFO:teuthology.orchestra.run.smithi032.stdout:checking sys/acl.h usability... yes 2023-10-08T06:11:06.765 INFO:teuthology.orchestra.run.smithi032.stdout:checking sys/acl.h presence... yes 2023-10-08T06:11:06.765 INFO:teuthology.orchestra.run.smithi032.stdout:checking for sys/acl.h... yes 2023-10-08T06:11:06.823 INFO:teuthology.orchestra.run.smithi032.stdout:checking acl/libacl.h usability... yes 2023-10-08T06:11:06.841 INFO:teuthology.orchestra.run.smithi032.stdout:checking acl/libacl.h presence... yes 2023-10-08T06:11:06.841 INFO:teuthology.orchestra.run.smithi032.stdout:checking for acl/libacl.h... yes 2023-10-08T06:11:06.903 INFO:teuthology.orchestra.run.smithi032.stdout:checking for acl_init in -lacl... yes 2023-10-08T06:11:06.946 INFO:teuthology.orchestra.run.smithi032.stdout:checking gdbm-ndbm.h usability... no 2023-10-08T06:11:06.968 INFO:teuthology.orchestra.run.smithi032.stdout:checking gdbm-ndbm.h presence... no 2023-10-08T06:11:06.968 INFO:teuthology.orchestra.run.smithi032.stdout:checking for gdbm-ndbm.h... no 2023-10-08T06:11:07.012 INFO:teuthology.orchestra.run.smithi032.stdout:checking gdbm/ndbm.h usability... no 2023-10-08T06:11:07.032 INFO:teuthology.orchestra.run.smithi032.stdout:checking gdbm/ndbm.h presence... no 2023-10-08T06:11:07.032 INFO:teuthology.orchestra.run.smithi032.stdout:checking for gdbm/ndbm.h... no 2023-10-08T06:11:07.079 INFO:teuthology.orchestra.run.smithi032.stdout:checking ndbm.h usability... no 2023-10-08T06:11:07.098 INFO:teuthology.orchestra.run.smithi032.stdout:checking ndbm.h presence... no 2023-10-08T06:11:07.098 INFO:teuthology.orchestra.run.smithi032.stdout:checking for ndbm.h... no 2023-10-08T06:11:07.148 INFO:teuthology.orchestra.run.smithi032.stdout:checking libaio.h usability... yes 2023-10-08T06:11:07.168 INFO:teuthology.orchestra.run.smithi032.stdout:checking libaio.h presence... yes 2023-10-08T06:11:07.168 INFO:teuthology.orchestra.run.smithi032.stdout:checking for libaio.h... yes 2023-10-08T06:11:07.215 INFO:teuthology.orchestra.run.smithi032.stdout:checking liburing.h usability... no 2023-10-08T06:11:07.236 INFO:teuthology.orchestra.run.smithi032.stdout:checking liburing.h presence... no 2023-10-08T06:11:07.237 INFO:teuthology.orchestra.run.smithi032.stdout:checking for liburing.h... no 2023-10-08T06:11:07.282 INFO:teuthology.orchestra.run.smithi032.stdout:checking sys/capability.h usability... no 2023-10-08T06:11:07.301 INFO:teuthology.orchestra.run.smithi032.stdout:checking sys/capability.h presence... no 2023-10-08T06:11:07.301 INFO:teuthology.orchestra.run.smithi032.stdout:checking for sys/capability.h... no 2023-10-08T06:11:07.352 INFO:teuthology.orchestra.run.smithi032.stdout:checking linux/fiemap.h usability... yes 2023-10-08T06:11:07.364 INFO:teuthology.orchestra.run.smithi032.stdout:checking linux/fiemap.h presence... yes 2023-10-08T06:11:07.364 INFO:teuthology.orchestra.run.smithi032.stdout:checking for linux/fiemap.h... yes 2023-10-08T06:11:07.426 INFO:teuthology.orchestra.run.smithi032.stdout:checking for fallocate... yes 2023-10-08T06:11:07.489 INFO:teuthology.orchestra.run.smithi032.stdout:checking for open_by_handle_at... yes 2023-10-08T06:11:07.540 INFO:teuthology.orchestra.run.smithi032.stdout:checking sys/prctl.h usability... yes 2023-10-08T06:11:07.554 INFO:teuthology.orchestra.run.smithi032.stdout:checking sys/prctl.h presence... yes 2023-10-08T06:11:07.554 INFO:teuthology.orchestra.run.smithi032.stdout:checking for sys/prctl.h... yes 2023-10-08T06:11:07.609 INFO:teuthology.orchestra.run.smithi032.stdout:checking linux/fs.h usability... yes 2023-10-08T06:11:07.624 INFO:teuthology.orchestra.run.smithi032.stdout:checking linux/fs.h presence... yes 2023-10-08T06:11:07.624 INFO:teuthology.orchestra.run.smithi032.stdout:checking for linux/fs.h... yes 2023-10-08T06:11:07.669 INFO:teuthology.orchestra.run.smithi032.stdout:checking btrfsutil.h usability... no 2023-10-08T06:11:07.690 INFO:teuthology.orchestra.run.smithi032.stdout:checking btrfsutil.h presence... no 2023-10-08T06:11:07.690 INFO:teuthology.orchestra.run.smithi032.stdout:checking for btrfsutil.h... no 2023-10-08T06:11:07.760 INFO:teuthology.orchestra.run.smithi032.stdout:checking for copy_file_range... yes 2023-10-08T06:11:07.826 INFO:teuthology.orchestra.run.smithi032.stdout:checking for SEEK_DATA... yes 2023-10-08T06:11:07.903 INFO:teuthology.orchestra.run.smithi032.stdout:checking for BMV_OF_SHARED... yes 2023-10-08T06:11:07.966 INFO:teuthology.orchestra.run.smithi032.stdout:checking for nftw... yes 2023-10-08T06:11:08.028 INFO:teuthology.orchestra.run.smithi032.stdout:checking for RLIMIT_NOFILE... yes 2023-10-08T06:11:08.064 INFO:teuthology.orchestra.run.smithi032.stdout:checking for FIEXCHANGE_RANGE... no 2023-10-08T06:11:08.125 INFO:teuthology.orchestra.run.smithi032.stdout:checking for renameat2... yes 2023-10-08T06:11:08.174 INFO:teuthology.orchestra.run.smithi032.stdout:checking for reallocarray... yes 2023-10-08T06:11:08.201 INFO:teuthology.orchestra.run.smithi032.stdout:checking for struct mount_attr... no 2023-10-08T06:11:08.272 INFO:teuthology.orchestra.run.smithi032.stdout:checking for struct btrfs_qgroup_limit... yes 2023-10-08T06:11:08.342 INFO:teuthology.orchestra.run.smithi032.stdout:checking for struct btrfs_qgroup_inherit... yes 2023-10-08T06:11:08.408 INFO:teuthology.orchestra.run.smithi032.stdout:checking for struct btrfs_ioctl_vol_args... yes 2023-10-08T06:11:08.478 INFO:teuthology.orchestra.run.smithi032.stdout:checking for struct btrfs_ioctl_vol_args_v2... yes 2023-10-08T06:11:08.547 INFO:teuthology.orchestra.run.smithi032.stdout:checking for struct btrfs_ioctl_ino_lookup_args... yes 2023-10-08T06:11:08.622 INFO:teuthology.orchestra.run.smithi032.stdout:checking for struct btrfs_ioctl_ino_lookup_user_args... yes 2023-10-08T06:11:08.690 INFO:teuthology.orchestra.run.smithi032.stdout:checking for struct btrfs_ioctl_get_subvol_rootref_args... yes 2023-10-08T06:11:08.746 INFO:teuthology.orchestra.run.smithi032.stdout:checking linux/btrfs.h usability... yes 2023-10-08T06:11:08.761 INFO:teuthology.orchestra.run.smithi032.stdout:checking linux/btrfs.h presence... yes 2023-10-08T06:11:08.761 INFO:teuthology.orchestra.run.smithi032.stdout:checking for linux/btrfs.h... yes 2023-10-08T06:11:08.822 INFO:teuthology.orchestra.run.smithi032.stdout:checking linux/btrfs_tree.h usability... yes 2023-10-08T06:11:08.839 INFO:teuthology.orchestra.run.smithi032.stdout:checking linux/btrfs_tree.h presence... yes 2023-10-08T06:11:08.839 INFO:teuthology.orchestra.run.smithi032.stdout:checking for linux/btrfs_tree.h... yes 2023-10-08T06:11:08.902 INFO:teuthology.orchestra.run.smithi032.stdout:checking for struct btrfs_ioctl_vol_args_v2.subvolid... no 2023-10-08T06:11:08.940 INFO:teuthology.orchestra.run.smithi032.stdout:configure: creating ./config.status 2023-10-08T06:11:09.785 INFO:teuthology.orchestra.run.smithi032.stdout:config.status: creating include/builddefs 2023-10-08T06:11:09.812 INFO:teuthology.orchestra.run.smithi032.stdout:config.status: creating include/config.h 2023-10-08T06:11:09.834 INFO:teuthology.orchestra.run.smithi032.stdout:config.status: executing libtool commands 2023-10-08T06:11:09.925 INFO:teuthology.orchestra.run.smithi032.stdout:Building include 2023-10-08T06:11:09.932 INFO:teuthology.orchestra.run.smithi032.stdout:Building lib 2023-10-08T06:11:09.938 INFO:teuthology.orchestra.run.smithi032.stdout: [LTDEP] 2023-10-08T06:11:10.149 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] dataascii.lo 2023-10-08T06:11:10.330 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] databin.lo 2023-10-08T06:11:10.536 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] datapid.lo 2023-10-08T06:11:10.696 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] file_lock.lo 2023-10-08T06:11:10.917 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] forker.lo 2023-10-08T06:11:11.113 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] pattern.lo 2023-10-08T06:11:11.289 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] open_flags.lo 2023-10-08T06:11:11.498 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] random_range.lo 2023-10-08T06:11:11.803 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] string_to_tokens.lo 2023-10-08T06:11:11.952 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] str_to_bytes.lo 2023-10-08T06:11:12.143 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] tlibio.lo 2023-10-08T06:11:12.466 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] write_log.lo 2023-10-08T06:11:12.558 INFO:teuthology.orchestra.run.smithi032.stderr:write_log.c: In function 'wlog_record_write': 2023-10-08T06:11:12.558 INFO:teuthology.orchestra.run.smithi032.stderr:write_log.c:205:6: warning: ignoring return value of 'write', declared with attribute warn_unused_result [-Wunused-result] 2023-10-08T06:11:12.558 INFO:teuthology.orchestra.run.smithi032.stderr: 205 | write(wfile->w_afd, wbuf, reclen); 2023-10-08T06:11:12.558 INFO:teuthology.orchestra.run.smithi032.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-08T06:11:12.559 INFO:teuthology.orchestra.run.smithi032.stderr:write_log.c:209:6: warning: ignoring return value of 'write', declared with attribute warn_unused_result [-Wunused-result] 2023-10-08T06:11:12.559 INFO:teuthology.orchestra.run.smithi032.stderr: 209 | write(wfile->w_rfd, wbuf, reclen); 2023-10-08T06:11:12.559 INFO:teuthology.orchestra.run.smithi032.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-08T06:11:12.760 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] random.lo 2023-10-08T06:11:12.919 INFO:teuthology.orchestra.run.smithi032.stdout: [LD] 2023-10-08T06:11:13.048 INFO:teuthology.orchestra.run.smithi032.stdout:Building ltp 2023-10-08T06:11:13.054 INFO:teuthology.orchestra.run.smithi032.stdout: [DEP] 2023-10-08T06:11:13.248 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] doio 2023-10-08T06:11:14.073 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] fsstress 2023-10-08T06:11:15.622 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] fsx 2023-10-08T06:11:16.621 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] growfiles 2023-10-08T06:11:17.245 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] iogen 2023-10-08T06:11:17.425 INFO:teuthology.orchestra.run.smithi032.stderr:iogen.c: In function 'main': 2023-10-08T06:11:17.425 INFO:teuthology.orchestra.run.smithi032.stderr:iogen.c:280:2: warning: ignoring return value of 'write', declared with attribute warn_unused_result [-Wunused-result] 2023-10-08T06:11:17.425 INFO:teuthology.orchestra.run.smithi032.stderr: 280 | write(outfd, (char *)&req, sizeof(req)); 2023-10-08T06:11:17.425 INFO:teuthology.orchestra.run.smithi032.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-08T06:11:17.428 INFO:teuthology.orchestra.run.smithi032.stderr:iogen.c: In function 'parse_cmdline': 2023-10-08T06:11:17.428 INFO:teuthology.orchestra.run.smithi032.stderr:iogen.c:1535:10: warning: ignoring return value of 'getcwd', declared with attribute warn_unused_result [-Wunused-result] 2023-10-08T06:11:17.428 INFO:teuthology.orchestra.run.smithi032.stderr: 1535 | getcwd(fptr->f_path, 2023-10-08T06:11:17.428 INFO:teuthology.orchestra.run.smithi032.stderr: | ^~~~~~~~~~~~~~~~~~~~ 2023-10-08T06:11:17.429 INFO:teuthology.orchestra.run.smithi032.stderr: 1536 | sizeof(fptr->f_path)-1); 2023-10-08T06:11:17.429 INFO:teuthology.orchestra.run.smithi032.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-08T06:11:17.713 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] aio-stress 2023-10-08T06:11:17.895 INFO:teuthology.orchestra.run.smithi032.stderr:aio-stress.c: In function 'setup_shared_mem': 2023-10-08T06:11:17.895 INFO:teuthology.orchestra.run.smithi032.stderr:aio-stress.c:1013:2: warning: ignoring return value of 'ftruncate', declared with attribute warn_unused_result [-Wunused-result] 2023-10-08T06:11:17.895 INFO:teuthology.orchestra.run.smithi032.stderr: 1013 | ftruncate(fd, total_ram); 2023-10-08T06:11:17.895 INFO:teuthology.orchestra.run.smithi032.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-08T06:11:18.247 INFO:teuthology.orchestra.run.smithi032.stdout:Building src 2023-10-08T06:11:18.259 INFO:teuthology.orchestra.run.smithi032.stdout: [DEP] 2023-10-08T06:11:20.781 INFO:teuthology.orchestra.run.smithi032.stdout: [DEP] 2023-10-08T06:11:20.831 INFO:teuthology.orchestra.run.smithi032.stdout: [DEP] 2023-10-08T06:11:20.847 INFO:teuthology.orchestra.run.smithi032.stdout: [DEP] 2023-10-08T06:11:21.168 INFO:teuthology.orchestra.run.smithi032.stdout: [DEP] 2023-10-08T06:11:21.211 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] dirstress 2023-10-08T06:11:21.548 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] fill 2023-10-08T06:11:21.773 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] fill2 2023-10-08T06:11:22.091 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] getpagesize 2023-10-08T06:11:22.297 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] holes 2023-10-08T06:11:22.571 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] lstat64 2023-10-08T06:11:22.832 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] nametest 2023-10-08T06:11:23.025 INFO:teuthology.orchestra.run.smithi032.stderr:nametest.c: In function 'main': 2023-10-08T06:11:23.025 INFO:teuthology.orchestra.run.smithi032.stderr:nametest.c:236:5: warning: ignoring return value of 'write', declared with attribute warn_unused_result [-Wunused-result] 2023-10-08T06:11:23.025 INFO:teuthology.orchestra.run.smithi032.stderr: 236 | write(1, "\n", 1); 2023-10-08T06:11:23.025 INFO:teuthology.orchestra.run.smithi032.stderr: | ^~~~~~~~~~~~~~~~~ 2023-10-08T06:11:23.025 INFO:teuthology.orchestra.run.smithi032.stderr:nametest.c:238:4: warning: ignoring return value of 'write', declared with attribute warn_unused_result [-Wunused-result] 2023-10-08T06:11:23.025 INFO:teuthology.orchestra.run.smithi032.stderr: 238 | write(1, ".", 1); 2023-10-08T06:11:23.026 INFO:teuthology.orchestra.run.smithi032.stderr: | ^~~~~~~~~~~~~~~~ 2023-10-08T06:11:23.026 INFO:teuthology.orchestra.run.smithi032.stderr:nametest.c:288:5: warning: ignoring return value of 'write', declared with attribute warn_unused_result [-Wunused-result] 2023-10-08T06:11:23.026 INFO:teuthology.orchestra.run.smithi032.stderr: 288 | write(1, ".", 1); 2023-10-08T06:11:23.026 INFO:teuthology.orchestra.run.smithi032.stderr: | ^~~~~~~~~~~~~~~~ 2023-10-08T06:11:23.168 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] permname 2023-10-08T06:11:23.449 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] randholes 2023-10-08T06:11:23.788 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] runas 2023-10-08T06:11:24.031 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] truncfile 2023-10-08T06:11:24.288 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] usemem 2023-10-08T06:11:24.515 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] mmapcat 2023-10-08T06:11:24.684 INFO:teuthology.orchestra.run.smithi032.stderr:mmapcat.c: In function 'main': 2023-10-08T06:11:24.684 INFO:teuthology.orchestra.run.smithi032.stderr:mmapcat.c:29:2: warning: ignoring return value of 'write', declared with attribute warn_unused_result [-Wunused-result] 2023-10-08T06:11:24.684 INFO:teuthology.orchestra.run.smithi032.stderr: 29 | write(1,ptr2,ptr - ptr2); 2023-10-08T06:11:24.684 INFO:teuthology.orchestra.run.smithi032.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-08T06:11:24.735 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] append_reader 2023-10-08T06:11:24.965 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] append_writer 2023-10-08T06:11:25.190 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] dirperf 2023-10-08T06:11:25.492 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] metaperf 2023-10-08T06:11:25.666 INFO:teuthology.orchestra.run.smithi032.stderr:metaperf.c: In function 'crfiles': 2023-10-08T06:11:25.666 INFO:teuthology.orchestra.run.smithi032.stderr:metaperf.c:166:4: warning: ignoring return value of 'write', declared with attribute warn_unused_result [-Wunused-result] 2023-10-08T06:11:25.667 INFO:teuthology.orchestra.run.smithi032.stderr: 166 | write(fd, buf, fsize); 2023-10-08T06:11:25.667 INFO:teuthology.orchestra.run.smithi032.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2023-10-08T06:11:25.667 INFO:teuthology.orchestra.run.smithi032.stderr:metaperf.c: In function 't_linkun': 2023-10-08T06:11:25.668 INFO:teuthology.orchestra.run.smithi032.stderr:metaperf.c:454:4: warning: ignoring return value of 'link', declared with attribute warn_unused_result [-Wunused-result] 2023-10-08T06:11:25.668 INFO:teuthology.orchestra.run.smithi032.stderr: 454 | link("a", *fnp); 2023-10-08T06:11:25.668 INFO:teuthology.orchestra.run.smithi032.stderr: | ^~~~~~~~~~~~~~~ 2023-10-08T06:11:25.668 INFO:teuthology.orchestra.run.smithi032.stderr:metaperf.c: In function 't_chown': 2023-10-08T06:11:25.668 INFO:teuthology.orchestra.run.smithi032.stderr:metaperf.c:404:5: warning: ignoring return value of 'chown', declared with attribute warn_unused_result [-Wunused-result] 2023-10-08T06:11:25.668 INFO:teuthology.orchestra.run.smithi032.stderr: 404 | chown(*fnp, 2, -1); 2023-10-08T06:11:25.668 INFO:teuthology.orchestra.run.smithi032.stderr: | ^~~~~~~~~~~~~~~~~~ 2023-10-08T06:11:25.668 INFO:teuthology.orchestra.run.smithi032.stderr:metaperf.c:406:5: warning: ignoring return value of 'chown', declared with attribute warn_unused_result [-Wunused-result] 2023-10-08T06:11:25.668 INFO:teuthology.orchestra.run.smithi032.stderr: 406 | chown(*fnp, 1, -1); 2023-10-08T06:11:25.668 INFO:teuthology.orchestra.run.smithi032.stderr: | ^~~~~~~~~~~~~~~~~~ 2023-10-08T06:11:25.669 INFO:teuthology.orchestra.run.smithi032.stderr:metaperf.c: In function 'i_chown': 2023-10-08T06:11:25.669 INFO:teuthology.orchestra.run.smithi032.stderr:metaperf.c:291:3: warning: ignoring return value of 'chown', declared with attribute warn_unused_result [-Wunused-result] 2023-10-08T06:11:25.669 INFO:teuthology.orchestra.run.smithi032.stderr: 291 | chown(*fnp, 1, -1); 2023-10-08T06:11:25.669 INFO:teuthology.orchestra.run.smithi032.stderr: | ^~~~~~~~~~~~~~~~~~ 2023-10-08T06:11:25.669 INFO:teuthology.orchestra.run.smithi032.stderr:metaperf.c: In function 'main': 2023-10-08T06:11:25.669 INFO:teuthology.orchestra.run.smithi032.stderr:metaperf.c:152:2: warning: ignoring return value of 'chdir', declared with attribute warn_unused_result [-Wunused-result] 2023-10-08T06:11:25.669 INFO:teuthology.orchestra.run.smithi032.stderr: 152 | chdir(".."); 2023-10-08T06:11:25.669 INFO:teuthology.orchestra.run.smithi032.stderr: | ^~~~~~~~~~~ 2023-10-08T06:11:25.835 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] devzero 2023-10-08T06:11:26.085 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] feature 2023-10-08T06:11:26.385 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] alloc 2023-10-08T06:11:26.571 INFO:teuthology.orchestra.run.smithi032.stderr:alloc.c: In function 'main': 2023-10-08T06:11:26.571 INFO:teuthology.orchestra.run.smithi032.stderr:alloc.c:247:3: warning: ignoring return value of 'mkstemp', declared with attribute warn_unused_result [-Wunused-result] 2023-10-08T06:11:26.572 INFO:teuthology.orchestra.run.smithi032.stderr: 247 | mkstemp(tmpfile); 2023-10-08T06:11:26.572 INFO:teuthology.orchestra.run.smithi032.stderr: | ^~~~~~~~~~~~~~~~ 2023-10-08T06:11:26.683 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] fault 2023-10-08T06:11:26.922 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] fstest 2023-10-08T06:11:27.253 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] t_access_root 2023-10-08T06:11:27.420 INFO:teuthology.orchestra.run.smithi032.stderr:t_access_root.c: In function 'main': 2023-10-08T06:11:27.420 INFO:teuthology.orchestra.run.smithi032.stderr:t_access_root.c:55:5: warning: ignoring return value of 'system', declared with attribute warn_unused_result [-Wunused-result] 2023-10-08T06:11:27.420 INFO:teuthology.orchestra.run.smithi032.stderr: 55 | system(cmd); 2023-10-08T06:11:27.421 INFO:teuthology.orchestra.run.smithi032.stderr: | ^~~~~~~~~~~ 2023-10-08T06:11:27.481 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] godown 2023-10-08T06:11:27.723 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] resvtest 2023-10-08T06:11:27.990 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] writemod 2023-10-08T06:11:28.209 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] writev_on_pagefault 2023-10-08T06:11:28.546 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] makeextents 2023-10-08T06:11:28.810 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] itrash 2023-10-08T06:11:29.040 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] rename 2023-10-08T06:11:29.249 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] multi_open_unlink 2023-10-08T06:11:29.493 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] unwritten_sync 2023-10-08T06:11:29.759 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] genhashnames 2023-10-08T06:11:30.020 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] t_holes 2023-10-08T06:11:30.230 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] t_mmap_writev 2023-10-08T06:11:30.448 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] t_truncate_cmtime 2023-10-08T06:11:30.682 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] dirhash_collide 2023-10-08T06:11:30.939 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] t_rename_overwrite 2023-10-08T06:11:31.150 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] holetest 2023-10-08T06:11:31.329 INFO:teuthology.orchestra.run.smithi032.stderr:holetest.c: In function 'pt_write_marker': 2023-10-08T06:11:31.330 INFO:teuthology.orchestra.run.smithi032.stderr:holetest.c:140:3: warning: ignoring return value of 'pwrite', declared with attribute warn_unused_result [-Wunused-result] 2023-10-08T06:11:31.330 INFO:teuthology.orchestra.run.smithi032.stderr: 140 | pwrite(fd, &tid, sizeof(tid), i * page_size + pgoff); 2023-10-08T06:11:31.330 INFO:teuthology.orchestra.run.smithi032.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-08T06:11:31.454 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] t_truncate_self 2023-10-08T06:11:31.666 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] af_unix 2023-10-08T06:11:31.894 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] t_mmap_stale_pmd 2023-10-08T06:11:32.057 INFO:teuthology.orchestra.run.smithi032.stderr:t_mmap_stale_pmd.c: In function 'main': 2023-10-08T06:11:32.057 INFO:teuthology.orchestra.run.smithi032.stderr:t_mmap_stale_pmd.c:42:2: warning: ignoring return value of 'ftruncate', declared with attribute warn_unused_result [-Wunused-result] 2023-10-08T06:11:32.057 INFO:teuthology.orchestra.run.smithi032.stderr: 42 | ftruncate(fd, 0); 2023-10-08T06:11:32.057 INFO:teuthology.orchestra.run.smithi032.stderr: | ^~~~~~~~~~~~~~~~ 2023-10-08T06:11:32.057 INFO:teuthology.orchestra.run.smithi032.stderr:t_mmap_stale_pmd.c:43:2: warning: ignoring return value of 'ftruncate', declared with attribute warn_unused_result [-Wunused-result] 2023-10-08T06:11:32.057 INFO:teuthology.orchestra.run.smithi032.stderr: 43 | ftruncate(fd, MiB(4)); 2023-10-08T06:11:32.058 INFO:teuthology.orchestra.run.smithi032.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2023-10-08T06:11:32.058 INFO:teuthology.orchestra.run.smithi032.stderr:t_mmap_stale_pmd.c:55:2: warning: ignoring return value of 'pwrite', declared with attribute warn_unused_result [-Wunused-result] 2023-10-08T06:11:32.058 INFO:teuthology.orchestra.run.smithi032.stderr: 55 | pwrite(fd, buffer, strlen(buffer), MiB(2)); 2023-10-08T06:11:32.058 INFO:teuthology.orchestra.run.smithi032.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-08T06:11:32.114 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] t_mmap_cow_race 2023-10-08T06:11:32.291 INFO:teuthology.orchestra.run.smithi032.stderr:t_mmap_cow_race.c: In function 'main': 2023-10-08T06:11:32.291 INFO:teuthology.orchestra.run.smithi032.stderr:t_mmap_cow_race.c:61:2: warning: ignoring return value of 'ftruncate', declared with attribute warn_unused_result [-Wunused-result] 2023-10-08T06:11:32.291 INFO:teuthology.orchestra.run.smithi032.stderr: 61 | ftruncate(fd, 0); 2023-10-08T06:11:32.291 INFO:teuthology.orchestra.run.smithi032.stderr: | ^~~~~~~~~~~~~~~~ 2023-10-08T06:11:32.292 INFO:teuthology.orchestra.run.smithi032.stderr:t_mmap_cow_race.c:62:2: warning: ignoring return value of 'ftruncate', declared with attribute warn_unused_result [-Wunused-result] 2023-10-08T06:11:32.292 INFO:teuthology.orchestra.run.smithi032.stderr: 62 | ftruncate(fd, MiB(2)); 2023-10-08T06:11:32.292 INFO:teuthology.orchestra.run.smithi032.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2023-10-08T06:11:32.354 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] t_mmap_fallocate 2023-10-08T06:11:32.577 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] fsync-err 2023-10-08T06:11:32.847 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] t_mmap_write_ro 2023-10-08T06:11:33.079 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] t_ext4_dax_journal_corruption 2023-10-08T06:11:33.251 INFO:teuthology.orchestra.run.smithi032.stderr:t_ext4_dax_journal_corruption.c: In function 'main': 2023-10-08T06:11:33.251 INFO:teuthology.orchestra.run.smithi032.stderr:t_ext4_dax_journal_corruption.c:61:2: warning: ignoring return value of 'ftruncate', declared with attribute warn_unused_result [-Wunused-result] 2023-10-08T06:11:33.251 INFO:teuthology.orchestra.run.smithi032.stderr: 61 | ftruncate(fd, 0); 2023-10-08T06:11:33.251 INFO:teuthology.orchestra.run.smithi032.stderr: | ^~~~~~~~~~~~~~~~ 2023-10-08T06:11:33.318 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] t_ext4_dax_inline_corruption 2023-10-08T06:11:33.549 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] t_ofd_locks 2023-10-08T06:11:33.826 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] t_mmap_collision 2023-10-08T06:11:34.112 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] mmap-write-concurrent 2023-10-08T06:11:34.363 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] t_get_file_time 2023-10-08T06:11:34.423 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T06:11:34.425 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T06:11:34.577 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] t_create_short_dirs 2023-10-08T06:11:34.822 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] t_create_long_dirs 2023-10-08T06:11:35.064 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] t_enospc 2023-10-08T06:11:35.337 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] t_mmap_writev_overlap 2023-10-08T06:11:35.579 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] checkpoint_journal 2023-10-08T06:11:35.813 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] mmap-rw-fault 2023-10-08T06:11:36.081 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] allocstale 2023-10-08T06:11:36.318 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] t_mmap_cow_memory_failure 2023-10-08T06:11:36.565 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] fake-dump-rootino 2023-10-08T06:11:36.795 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] dio-buf-fault 2023-10-08T06:11:37.021 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] xfsctl 2023-10-08T06:11:37.291 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] bstat 2023-10-08T06:11:37.576 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] t_mtab 2023-10-08T06:11:37.747 INFO:teuthology.orchestra.run.smithi032.stderr:t_mtab.c: In function 'update_mtab': 2023-10-08T06:11:37.747 INFO:teuthology.orchestra.run.smithi032.stderr:t_mtab.c:256:3: warning: ignoring return value of 'chown', declared with attribute warn_unused_result [-Wunused-result] 2023-10-08T06:11:37.747 INFO:teuthology.orchestra.run.smithi032.stderr: 256 | chown (mounted_temp, sbuf.st_uid, sbuf.st_gid); 2023-10-08T06:11:37.748 INFO:teuthology.orchestra.run.smithi032.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-08T06:11:37.840 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] getdevicesize 2023-10-08T06:11:38.050 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] preallo_rw_pattern_reader 2023-10-08T06:11:38.232 INFO:teuthology.orchestra.run.smithi032.stderr:In file included from preallo_rw_pattern_reader.c:2: 2023-10-08T06:11:38.233 INFO:teuthology.orchestra.run.smithi032.stderr:iopat.c: In function 'main': 2023-10-08T06:11:38.233 INFO:teuthology.orchestra.run.smithi032.stderr:iopat.c:38:4: warning: ignoring return value of 'read', declared with attribute warn_unused_result [-Wunused-result] 2023-10-08T06:11:38.233 INFO:teuthology.orchestra.run.smithi032.stderr: 38 | read(fd, &x, 1048576); 2023-10-08T06:11:38.233 INFO:teuthology.orchestra.run.smithi032.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2023-10-08T06:11:38.285 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] preallo_rw_pattern_writer 2023-10-08T06:11:38.473 INFO:teuthology.orchestra.run.smithi032.stderr:In file included from preallo_rw_pattern_writer.c:2: 2023-10-08T06:11:38.473 INFO:teuthology.orchestra.run.smithi032.stderr:iopat.c: In function 'main': 2023-10-08T06:11:38.473 INFO:teuthology.orchestra.run.smithi032.stderr:iopat.c:34:4: warning: ignoring return value of 'write', declared with attribute warn_unused_result [-Wunused-result] 2023-10-08T06:11:38.473 INFO:teuthology.orchestra.run.smithi032.stderr: 34 | write(fd, &x, 1048576); 2023-10-08T06:11:38.473 INFO:teuthology.orchestra.run.smithi032.stderr: | ^~~~~~~~~~~~~~~~~~~~~~ 2023-10-08T06:11:38.523 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] ftrunc 2023-10-08T06:11:38.754 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] trunc 2023-10-08T06:11:38.993 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] fs_perms 2023-10-08T06:11:39.171 INFO:teuthology.orchestra.run.smithi032.stderr:fs_perms.c: In function 'main': 2023-10-08T06:11:39.171 INFO:teuthology.orchestra.run.smithi032.stderr:fs_perms.c:54:4: warning: ignoring return value of 'system', declared with attribute warn_unused_result [-Wunused-result] 2023-10-08T06:11:39.172 INFO:teuthology.orchestra.run.smithi032.stderr: 54 | system("rm -f test.file"); 2023-10-08T06:11:39.172 INFO:teuthology.orchestra.run.smithi032.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-08T06:11:39.172 INFO:teuthology.orchestra.run.smithi032.stderr:fs_perms.c: In function 'testsetup': 2023-10-08T06:11:39.172 INFO:teuthology.orchestra.run.smithi032.stderr:fs_perms.c:67:4: warning: ignoring return value of 'system', declared with attribute warn_unused_result [-Wunused-result] 2023-10-08T06:11:39.172 INFO:teuthology.orchestra.run.smithi032.stderr: 67 | system("cp testx.file test.file"); 2023-10-08T06:11:39.172 INFO:teuthology.orchestra.run.smithi032.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-08T06:11:39.172 INFO:teuthology.orchestra.run.smithi032.stderr:fs_perms.c:69:4: warning: ignoring return value of 'chown', declared with attribute warn_unused_result [-Wunused-result] 2023-10-08T06:11:39.172 INFO:teuthology.orchestra.run.smithi032.stderr: 69 | chown("test.file",cuserId,cgroupId); 2023-10-08T06:11:39.172 INFO:teuthology.orchestra.run.smithi032.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-08T06:11:39.173 INFO:teuthology.orchestra.run.smithi032.stderr:fs_perms.c: In function 'testfperm': 2023-10-08T06:11:39.173 INFO:teuthology.orchestra.run.smithi032.stderr:fs_perms.c:123:5: warning: ignoring return value of 'seteuid', declared with attribute warn_unused_result [-Wunused-result] 2023-10-08T06:11:39.173 INFO:teuthology.orchestra.run.smithi032.stderr: 123 | seteuid(0); 2023-10-08T06:11:39.173 INFO:teuthology.orchestra.run.smithi032.stderr: | ^~~~~~~~~~ 2023-10-08T06:11:39.173 INFO:teuthology.orchestra.run.smithi032.stderr:fs_perms.c:124:5: warning: ignoring return value of 'setegid', declared with attribute warn_unused_result [-Wunused-result] 2023-10-08T06:11:39.173 INFO:teuthology.orchestra.run.smithi032.stderr: 124 | setegid(0); 2023-10-08T06:11:39.173 INFO:teuthology.orchestra.run.smithi032.stderr: | ^~~~~~~~~~ 2023-10-08T06:11:39.233 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] testx 2023-10-08T06:11:39.439 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] looptest 2023-10-08T06:11:39.717 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] locktest 2023-10-08T06:11:40.130 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] unwritten_mmap 2023-10-08T06:11:40.365 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] bulkstat_unlink_test 2023-10-08T06:11:40.541 INFO:teuthology.orchestra.run.smithi032.stderr:bulkstat_unlink_test.c: In function 'main': 2023-10-08T06:11:40.541 INFO:teuthology.orchestra.run.smithi032.stderr:bulkstat_unlink_test.c:106:4: warning: ignoring return value of 'write', declared with attribute warn_unused_result [-Wunused-result] 2023-10-08T06:11:40.541 INFO:teuthology.orchestra.run.smithi032.stderr: 106 | write(fd[i], fname, sizeof(fname)); 2023-10-08T06:11:40.541 INFO:teuthology.orchestra.run.smithi032.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-08T06:11:40.541 INFO:teuthology.orchestra.run.smithi032.stderr:bulkstat_unlink_test.c:178:3: warning: ignoring return value of 'system', declared with attribute warn_unused_result [-Wunused-result] 2023-10-08T06:11:40.541 INFO:teuthology.orchestra.run.smithi032.stderr: 178 | system(fname); 2023-10-08T06:11:40.541 INFO:teuthology.orchestra.run.smithi032.stderr: | ^~~~~~~~~~~~~ 2023-10-08T06:11:40.638 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] deduperace 2023-10-08T06:11:40.917 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] bulkstat_unlink_test_modified 2023-10-08T06:11:41.102 INFO:teuthology.orchestra.run.smithi032.stderr:bulkstat_unlink_test_modified.c: In function 'main': 2023-10-08T06:11:41.102 INFO:teuthology.orchestra.run.smithi032.stderr:bulkstat_unlink_test_modified.c:83:6: warning: ignoring return value of 'write', declared with attribute warn_unused_result [-Wunused-result] 2023-10-08T06:11:41.103 INFO:teuthology.orchestra.run.smithi032.stderr: 83 | write(fd, fname, sizeof(fname)); 2023-10-08T06:11:41.103 INFO:teuthology.orchestra.run.smithi032.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-08T06:11:41.103 INFO:teuthology.orchestra.run.smithi032.stderr:bulkstat_unlink_test_modified.c:139:6: warning: ignoring return value of 'write', declared with attribute warn_unused_result [-Wunused-result] 2023-10-08T06:11:41.103 INFO:teuthology.orchestra.run.smithi032.stderr: 139 | write(fd, fname, sizeof(fname)); 2023-10-08T06:11:41.103 INFO:teuthology.orchestra.run.smithi032.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-08T06:11:41.103 INFO:teuthology.orchestra.run.smithi032.stderr:bulkstat_unlink_test_modified.c:185:2: warning: ignoring return value of 'system', declared with attribute warn_unused_result [-Wunused-result] 2023-10-08T06:11:41.103 INFO:teuthology.orchestra.run.smithi032.stderr: 185 | system(fname); 2023-10-08T06:11:41.103 INFO:teuthology.orchestra.run.smithi032.stderr: | ^~~~~~~~~~~~~ 2023-10-08T06:11:41.200 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] t_dir_offset 2023-10-08T06:11:41.417 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] t_futimens 2023-10-08T06:11:41.621 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] t_immutable 2023-10-08T06:11:41.821 INFO:teuthology.orchestra.run.smithi032.stderr:t_immutable.c: In function 'create_test_area': 2023-10-08T06:11:41.822 INFO:teuthology.orchestra.run.smithi032.stderr:t_immutable.c:2061:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-10-08T06:11:41.822 INFO:teuthology.orchestra.run.smithi032.stderr: 2061 | asprintf(&path, "%s/immutable.d", dir); 2023-10-08T06:11:41.822 INFO:teuthology.orchestra.run.smithi032.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-08T06:11:41.822 INFO:teuthology.orchestra.run.smithi032.stderr:t_immutable.c:2096:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-10-08T06:11:41.822 INFO:teuthology.orchestra.run.smithi032.stderr: 2096 | asprintf(&path, "%s/append-only.d", dir); 2023-10-08T06:11:41.822 INFO:teuthology.orchestra.run.smithi032.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-08T06:11:41.824 INFO:teuthology.orchestra.run.smithi032.stderr:t_immutable.c: In function 'remove_test_area': 2023-10-08T06:11:41.824 INFO:teuthology.orchestra.run.smithi032.stderr:t_immutable.c:2152:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-10-08T06:11:41.824 INFO:teuthology.orchestra.run.smithi032.stderr: 2152 | asprintf(&path, "%s/immutable.d", dir); 2023-10-08T06:11:41.824 INFO:teuthology.orchestra.run.smithi032.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-08T06:11:41.824 INFO:teuthology.orchestra.run.smithi032.stderr:t_immutable.c:2163:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-10-08T06:11:41.824 INFO:teuthology.orchestra.run.smithi032.stderr: 2163 | asprintf(&path, "%s/empty-immutable.d", dir); 2023-10-08T06:11:41.824 INFO:teuthology.orchestra.run.smithi032.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-08T06:11:41.824 INFO:teuthology.orchestra.run.smithi032.stderr:t_immutable.c:2175:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-10-08T06:11:41.825 INFO:teuthology.orchestra.run.smithi032.stderr: 2175 | asprintf(&path, "%s/append-only.d", dir); 2023-10-08T06:11:41.825 INFO:teuthology.orchestra.run.smithi032.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-08T06:11:41.825 INFO:teuthology.orchestra.run.smithi032.stderr:t_immutable.c:2186:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-10-08T06:11:41.825 INFO:teuthology.orchestra.run.smithi032.stderr: 2186 | asprintf(&path, "%s/empty-append-only.d", dir); 2023-10-08T06:11:41.825 INFO:teuthology.orchestra.run.smithi032.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-08T06:11:41.825 INFO:teuthology.orchestra.run.smithi032.stderr:t_immutable.c:2197:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-10-08T06:11:41.825 INFO:teuthology.orchestra.run.smithi032.stderr: 2197 | asprintf(&path, "%s/append-only.f", dir); 2023-10-08T06:11:41.825 INFO:teuthology.orchestra.run.smithi032.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-08T06:11:41.825 INFO:teuthology.orchestra.run.smithi032.stderr:t_immutable.c:2209:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-10-08T06:11:41.825 INFO:teuthology.orchestra.run.smithi032.stderr: 2209 | asprintf(&path, "%s/immutable.f", dir); 2023-10-08T06:11:41.825 INFO:teuthology.orchestra.run.smithi032.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-08T06:11:41.825 INFO:teuthology.orchestra.run.smithi032.stderr:t_immutable.c: In function 'check_test_area': 2023-10-08T06:11:41.826 INFO:teuthology.orchestra.run.smithi032.stderr:t_immutable.c:1788:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-10-08T06:11:41.826 INFO:teuthology.orchestra.run.smithi032.stderr: 1788 | asprintf(&path, "%s/", dir); 2023-10-08T06:11:41.826 INFO:teuthology.orchestra.run.smithi032.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-08T06:11:41.826 INFO:teuthology.orchestra.run.smithi032.stderr:t_immutable.c:1800:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-10-08T06:11:41.826 INFO:teuthology.orchestra.run.smithi032.stderr: 1800 | asprintf(&path, "%s/immutable.f", dir); 2023-10-08T06:11:41.826 INFO:teuthology.orchestra.run.smithi032.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-08T06:11:41.826 INFO:teuthology.orchestra.run.smithi032.stderr:t_immutable.c:1812:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-10-08T06:11:41.826 INFO:teuthology.orchestra.run.smithi032.stderr: 1812 | asprintf(&path, "%s/append-only.f", dir); 2023-10-08T06:11:41.826 INFO:teuthology.orchestra.run.smithi032.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-08T06:11:41.826 INFO:teuthology.orchestra.run.smithi032.stderr:t_immutable.c:1824:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-10-08T06:11:41.826 INFO:teuthology.orchestra.run.smithi032.stderr: 1824 | asprintf(&path, "%s/immutable.d", dir); 2023-10-08T06:11:41.826 INFO:teuthology.orchestra.run.smithi032.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-08T06:11:41.827 INFO:teuthology.orchestra.run.smithi032.stderr:t_immutable.c:1837:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-10-08T06:11:41.827 INFO:teuthology.orchestra.run.smithi032.stderr: 1837 | asprintf(&path, "%s/append-only.d", dir); 2023-10-08T06:11:41.827 INFO:teuthology.orchestra.run.smithi032.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-08T06:11:41.827 INFO:teuthology.orchestra.run.smithi032.stderr:t_immutable.c:1850:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-10-08T06:11:41.827 INFO:teuthology.orchestra.run.smithi032.stderr: 1850 | asprintf(&path, "%s/immutable.d/file", dir); 2023-10-08T06:11:41.827 INFO:teuthology.orchestra.run.smithi032.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-08T06:11:41.827 INFO:teuthology.orchestra.run.smithi032.stderr:t_immutable.c:1862:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-10-08T06:11:41.827 INFO:teuthology.orchestra.run.smithi032.stderr: 1862 | asprintf(&path, "%s/append-only.d/file", dir); 2023-10-08T06:11:41.827 INFO:teuthology.orchestra.run.smithi032.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-08T06:11:41.827 INFO:teuthology.orchestra.run.smithi032.stderr:t_immutable.c:1874:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-10-08T06:11:41.827 INFO:teuthology.orchestra.run.smithi032.stderr: 1874 | asprintf(&path, "%s/immutable.d/dir", dir); 2023-10-08T06:11:41.828 INFO:teuthology.orchestra.run.smithi032.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-08T06:11:41.828 INFO:teuthology.orchestra.run.smithi032.stderr:t_immutable.c:1887:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-10-08T06:11:41.828 INFO:teuthology.orchestra.run.smithi032.stderr: 1887 | asprintf(&path, "%s/append-only.d/dir", dir); 2023-10-08T06:11:41.828 INFO:teuthology.orchestra.run.smithi032.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-08T06:11:41.829 INFO:teuthology.orchestra.run.smithi032.stderr:t_immutable.c: In function 'test_immutable': 2023-10-08T06:11:41.829 INFO:teuthology.orchestra.run.smithi032.stderr:t_immutable.c:151:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-10-08T06:11:41.829 INFO:teuthology.orchestra.run.smithi032.stderr: 151 | asprintf(&path, "%s/immutable.f", dir); 2023-10-08T06:11:41.829 INFO:teuthology.orchestra.run.smithi032.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-08T06:11:41.829 INFO:teuthology.orchestra.run.smithi032.stderr:t_immutable.c:381:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-10-08T06:11:41.829 INFO:teuthology.orchestra.run.smithi032.stderr: 381 | asprintf(&linkpath, "%s/immutable.f.hardlink", dir); 2023-10-08T06:11:41.829 INFO:teuthology.orchestra.run.smithi032.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-08T06:11:41.829 INFO:teuthology.orchestra.run.smithi032.stderr:t_immutable.c:408:9: warning: ignoring return value of 'chown', declared with attribute warn_unused_result [-Wunused-result] 2023-10-08T06:11:41.829 INFO:teuthology.orchestra.run.smithi032.stderr: 408 | chown(path, 0, 0); 2023-10-08T06:11:41.829 INFO:teuthology.orchestra.run.smithi032.stderr: | ^~~~~~~~~~~~~~~~~ 2023-10-08T06:11:41.829 INFO:teuthology.orchestra.run.smithi032.stderr:t_immutable.c:485:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-10-08T06:11:41.830 INFO:teuthology.orchestra.run.smithi032.stderr: 485 | asprintf(&linkpath, "%s/immutable.f.newname", dir); 2023-10-08T06:11:41.830 INFO:teuthology.orchestra.run.smithi032.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-08T06:11:41.830 INFO:teuthology.orchestra.run.smithi032.stderr:t_immutable.c:532:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-10-08T06:11:41.830 INFO:teuthology.orchestra.run.smithi032.stderr: 532 | asprintf(&path, "%s/immutable.d/file", dir); 2023-10-08T06:11:41.830 INFO:teuthology.orchestra.run.smithi032.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-08T06:11:41.830 INFO:teuthology.orchestra.run.smithi032.stderr:t_immutable.c:553:9: warning: ignoring return value of 'chown', declared with attribute warn_unused_result [-Wunused-result] 2023-10-08T06:11:41.830 INFO:teuthology.orchestra.run.smithi032.stderr: 553 | chown(path, 0, 0); 2023-10-08T06:11:41.830 INFO:teuthology.orchestra.run.smithi032.stderr: | ^~~~~~~~~~~~~~~~~ 2023-10-08T06:11:41.830 INFO:teuthology.orchestra.run.smithi032.stderr:t_immutable.c:556:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-10-08T06:11:41.830 INFO:teuthology.orchestra.run.smithi032.stderr: 556 | asprintf(&linkpath, "%s/immutable.d/file.link", dir); 2023-10-08T06:11:41.830 INFO:teuthology.orchestra.run.smithi032.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-08T06:11:41.830 INFO:teuthology.orchestra.run.smithi032.stderr:t_immutable.c:575:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-10-08T06:11:41.831 INFO:teuthology.orchestra.run.smithi032.stderr: 575 | asprintf(&linkpath, "%s/immutable.d/file.newname", dir); 2023-10-08T06:11:41.831 INFO:teuthology.orchestra.run.smithi032.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-08T06:11:41.831 INFO:teuthology.orchestra.run.smithi032.stderr:t_immutable.c:595:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-10-08T06:11:41.831 INFO:teuthology.orchestra.run.smithi032.stderr: 595 | asprintf(&path, "%s/immutable.d/newfile", dir); 2023-10-08T06:11:41.831 INFO:teuthology.orchestra.run.smithi032.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-08T06:11:41.831 INFO:teuthology.orchestra.run.smithi032.stderr:t_immutable.c:619:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-10-08T06:11:41.831 INFO:teuthology.orchestra.run.smithi032.stderr: 619 | asprintf(&path, "%s/immutable.d/newdir", dir); 2023-10-08T06:11:41.831 INFO:teuthology.orchestra.run.smithi032.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-08T06:11:41.831 INFO:teuthology.orchestra.run.smithi032.stderr:t_immutable.c:631:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-10-08T06:11:41.831 INFO:teuthology.orchestra.run.smithi032.stderr: 631 | asprintf(&path, "%s/immutable.d/dir/newfile-%d", dir, getuid()); 2023-10-08T06:11:41.831 INFO:teuthology.orchestra.run.smithi032.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-08T06:11:41.831 INFO:teuthology.orchestra.run.smithi032.stderr:t_immutable.c:653:16: warning: ignoring return value of 'chown', declared with attribute warn_unused_result [-Wunused-result] 2023-10-08T06:11:41.832 INFO:teuthology.orchestra.run.smithi032.stderr: 653 | chown(path, 0, 0); 2023-10-08T06:11:41.832 INFO:teuthology.orchestra.run.smithi032.stderr: | ^~~~~~~~~~~~~~~~~ 2023-10-08T06:11:41.832 INFO:teuthology.orchestra.run.smithi032.stderr:t_immutable.c:657:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-10-08T06:11:41.832 INFO:teuthology.orchestra.run.smithi032.stderr: 657 | asprintf(&path, "%s/immutable.d/dir", dir); 2023-10-08T06:11:41.832 INFO:teuthology.orchestra.run.smithi032.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-08T06:11:41.832 INFO:teuthology.orchestra.run.smithi032.stderr:t_immutable.c:668:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-10-08T06:11:41.832 INFO:teuthology.orchestra.run.smithi032.stderr: 668 | asprintf(&path, "%s/immutable.d", dir); 2023-10-08T06:11:41.832 INFO:teuthology.orchestra.run.smithi032.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-08T06:11:41.832 INFO:teuthology.orchestra.run.smithi032.stderr:t_immutable.c:705:9: warning: ignoring return value of 'chown', declared with attribute warn_unused_result [-Wunused-result] 2023-10-08T06:11:41.832 INFO:teuthology.orchestra.run.smithi032.stderr: 705 | chown(path, 0, 0); 2023-10-08T06:11:41.832 INFO:teuthology.orchestra.run.smithi032.stderr: | ^~~~~~~~~~~~~~~~~ 2023-10-08T06:11:41.832 INFO:teuthology.orchestra.run.smithi032.stderr:t_immutable.c:782:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-10-08T06:11:41.833 INFO:teuthology.orchestra.run.smithi032.stderr: 782 | asprintf(&path, "%s/empty-immutable.d", dir); 2023-10-08T06:11:41.833 INFO:teuthology.orchestra.run.smithi032.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-08T06:11:41.835 INFO:teuthology.orchestra.run.smithi032.stderr:t_immutable.c: In function 'test_append': 2023-10-08T06:11:41.835 INFO:teuthology.orchestra.run.smithi032.stderr:t_immutable.c:822:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-10-08T06:11:41.835 INFO:teuthology.orchestra.run.smithi032.stderr: 822 | asprintf(&path, "%s/append-only.f", dir); 2023-10-08T06:11:41.835 INFO:teuthology.orchestra.run.smithi032.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-08T06:11:41.835 INFO:teuthology.orchestra.run.smithi032.stderr:t_immutable.c:1024:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-10-08T06:11:41.835 INFO:teuthology.orchestra.run.smithi032.stderr: 1024 | asprintf(&linkpath, "%s/append-only.f.hardlink", dir); 2023-10-08T06:11:41.835 INFO:teuthology.orchestra.run.smithi032.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-08T06:11:41.835 INFO:teuthology.orchestra.run.smithi032.stderr:t_immutable.c:1051:9: warning: ignoring return value of 'chown', declared with attribute warn_unused_result [-Wunused-result] 2023-10-08T06:11:41.835 INFO:teuthology.orchestra.run.smithi032.stderr: 1051 | chown(path, 0, 0); 2023-10-08T06:11:41.835 INFO:teuthology.orchestra.run.smithi032.stderr: | ^~~~~~~~~~~~~~~~~ 2023-10-08T06:11:41.835 INFO:teuthology.orchestra.run.smithi032.stderr:t_immutable.c:1126:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-10-08T06:11:41.836 INFO:teuthology.orchestra.run.smithi032.stderr: 1126 | asprintf(&linkpath, "%s/append-only.f.newname", dir); 2023-10-08T06:11:41.836 INFO:teuthology.orchestra.run.smithi032.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-08T06:11:41.836 INFO:teuthology.orchestra.run.smithi032.stderr:t_immutable.c:1495:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-10-08T06:11:41.836 INFO:teuthology.orchestra.run.smithi032.stderr: 1495 | asprintf(&path, "%s/append-only.d/file", dir); 2023-10-08T06:11:41.836 INFO:teuthology.orchestra.run.smithi032.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-08T06:11:41.836 INFO:teuthology.orchestra.run.smithi032.stderr:t_immutable.c:1516:9: warning: ignoring return value of 'chown', declared with attribute warn_unused_result [-Wunused-result] 2023-10-08T06:11:41.836 INFO:teuthology.orchestra.run.smithi032.stderr: 1516 | chown(path, 0, 0); 2023-10-08T06:11:41.836 INFO:teuthology.orchestra.run.smithi032.stderr: | ^~~~~~~~~~~~~~~~~ 2023-10-08T06:11:41.836 INFO:teuthology.orchestra.run.smithi032.stderr:t_immutable.c:1519:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-10-08T06:11:41.836 INFO:teuthology.orchestra.run.smithi032.stderr: 1519 | asprintf(&linkpath, "%s/append-only.d/file.link-%d", dir, getuid()); 2023-10-08T06:11:41.836 INFO:teuthology.orchestra.run.smithi032.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-08T06:11:41.836 INFO:teuthology.orchestra.run.smithi032.stderr:t_immutable.c:1529:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-10-08T06:11:41.837 INFO:teuthology.orchestra.run.smithi032.stderr: 1529 | asprintf(&linkpath, "%s/append-only.d/file.symlink-%d", dir, getuid()); 2023-10-08T06:11:41.837 INFO:teuthology.orchestra.run.smithi032.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-08T06:11:41.837 INFO:teuthology.orchestra.run.smithi032.stderr:t_immutable.c:1539:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-10-08T06:11:41.837 INFO:teuthology.orchestra.run.smithi032.stderr: 1539 | asprintf(&linkpath, "%s/append-only.d/file.newname", dir); 2023-10-08T06:11:41.837 INFO:teuthology.orchestra.run.smithi032.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-08T06:11:41.837 INFO:teuthology.orchestra.run.smithi032.stderr:t_immutable.c:1559:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-10-08T06:11:41.837 INFO:teuthology.orchestra.run.smithi032.stderr: 1559 | asprintf(&path, "%s/append-only.d/newfile-%d", dir, getuid()); 2023-10-08T06:11:41.837 INFO:teuthology.orchestra.run.smithi032.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-08T06:11:41.837 INFO:teuthology.orchestra.run.smithi032.stderr:t_immutable.c:1573:4: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-10-08T06:11:41.837 INFO:teuthology.orchestra.run.smithi032.stderr: 1573 | asprintf(&path, "%s/append-only.d/newdev-%d", dir, getuid()); 2023-10-08T06:11:41.837 INFO:teuthology.orchestra.run.smithi032.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-08T06:11:41.838 INFO:teuthology.orchestra.run.smithi032.stderr:t_immutable.c:1586:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-10-08T06:11:41.838 INFO:teuthology.orchestra.run.smithi032.stderr: 1586 | asprintf(&path, "%s/append-only.d/newdir-%d", dir, getuid()); 2023-10-08T06:11:41.838 INFO:teuthology.orchestra.run.smithi032.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-08T06:11:41.838 INFO:teuthology.orchestra.run.smithi032.stderr:t_immutable.c:1596:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-10-08T06:11:41.838 INFO:teuthology.orchestra.run.smithi032.stderr: 1596 | asprintf(&path, "%s/append-only.d/newdir-%d/newfile-%d", dir, getuid(), getuid()); 2023-10-08T06:11:41.838 INFO:teuthology.orchestra.run.smithi032.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-08T06:11:41.838 INFO:teuthology.orchestra.run.smithi032.stderr:t_immutable.c:1618:16: warning: ignoring return value of 'chown', declared with attribute warn_unused_result [-Wunused-result] 2023-10-08T06:11:41.838 INFO:teuthology.orchestra.run.smithi032.stderr: 1618 | chown(path, 0, 0); 2023-10-08T06:11:41.838 INFO:teuthology.orchestra.run.smithi032.stderr: | ^~~~~~~~~~~~~~~~~ 2023-10-08T06:11:41.838 INFO:teuthology.orchestra.run.smithi032.stderr:t_immutable.c:1622:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-10-08T06:11:41.838 INFO:teuthology.orchestra.run.smithi032.stderr: 1622 | asprintf(&path, "%s/append-only.d/dir/newfile-%d", dir, getuid()); 2023-10-08T06:11:41.838 INFO:teuthology.orchestra.run.smithi032.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-08T06:11:41.839 INFO:teuthology.orchestra.run.smithi032.stderr:t_immutable.c:1644:16: warning: ignoring return value of 'chown', declared with attribute warn_unused_result [-Wunused-result] 2023-10-08T06:11:41.839 INFO:teuthology.orchestra.run.smithi032.stderr: 1644 | chown(path, 0, 0); 2023-10-08T06:11:41.839 INFO:teuthology.orchestra.run.smithi032.stderr: | ^~~~~~~~~~~~~~~~~ 2023-10-08T06:11:41.839 INFO:teuthology.orchestra.run.smithi032.stderr:t_immutable.c:1648:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-10-08T06:11:41.839 INFO:teuthology.orchestra.run.smithi032.stderr: 1648 | asprintf(&path, "%s/append-only.d/dir", dir); 2023-10-08T06:11:41.839 INFO:teuthology.orchestra.run.smithi032.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-08T06:11:41.839 INFO:teuthology.orchestra.run.smithi032.stderr:t_immutable.c:1659:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-10-08T06:11:41.839 INFO:teuthology.orchestra.run.smithi032.stderr: 1659 | asprintf(&path, "%s/append-only.d", dir); 2023-10-08T06:11:41.839 INFO:teuthology.orchestra.run.smithi032.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-08T06:11:41.839 INFO:teuthology.orchestra.run.smithi032.stderr:t_immutable.c:1692:9: warning: ignoring return value of 'chown', declared with attribute warn_unused_result [-Wunused-result] 2023-10-08T06:11:41.839 INFO:teuthology.orchestra.run.smithi032.stderr: 1692 | chown(path, 0, 0); 2023-10-08T06:11:41.839 INFO:teuthology.orchestra.run.smithi032.stderr: | ^~~~~~~~~~~~~~~~~ 2023-10-08T06:11:41.840 INFO:teuthology.orchestra.run.smithi032.stderr:t_immutable.c:1769:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-10-08T06:11:41.840 INFO:teuthology.orchestra.run.smithi032.stderr: 1769 | asprintf(&path, "%s/empty-append-only.d", dir); 2023-10-08T06:11:41.840 INFO:teuthology.orchestra.run.smithi032.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-08T06:11:42.426 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] stale_handle 2023-10-08T06:11:42.606 INFO:teuthology.orchestra.run.smithi032.stderr:stale_handle.c: In function 'main': 2023-10-08T06:11:42.607 INFO:teuthology.orchestra.run.smithi032.stderr:stale_handle.c:102:2: warning: ignoring return value of 'system', declared with attribute warn_unused_result [-Wunused-result] 2023-10-08T06:11:42.607 INFO:teuthology.orchestra.run.smithi032.stderr: 102 | system("echo 3 > /proc/sys/vm/drop_caches"); 2023-10-08T06:11:42.607 INFO:teuthology.orchestra.run.smithi032.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-08T06:11:42.668 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] pwrite_mmap_blocked 2023-10-08T06:11:42.887 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] t_dir_offset2 2023-10-08T06:11:43.166 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] seek_sanity_test 2023-10-08T06:11:43.357 INFO:teuthology.orchestra.run.smithi032.stderr:seek_sanity_test.c: In function 'test18': 2023-10-08T06:11:43.357 INFO:teuthology.orchestra.run.smithi032.stderr:seek_sanity_test.c:460:2: warning: ignoring return value of 'ftruncate', declared with attribute warn_unused_result [-Wunused-result] 2023-10-08T06:11:43.357 INFO:teuthology.orchestra.run.smithi032.stderr: 460 | ftruncate(fd, 0); 2023-10-08T06:11:43.357 INFO:teuthology.orchestra.run.smithi032.stderr: | ^~~~~~~~~~~~~~~~ 2023-10-08T06:11:43.360 INFO:teuthology.orchestra.run.smithi032.stderr:seek_sanity_test.c: In function 'test_basic_support': 2023-10-08T06:11:43.360 INFO:teuthology.orchestra.run.smithi032.stderr:seek_sanity_test.c:1207:2: warning: ignoring return value of 'ftruncate', declared with attribute warn_unused_result [-Wunused-result] 2023-10-08T06:11:43.360 INFO:teuthology.orchestra.run.smithi032.stderr: 1207 | ftruncate(fd, 0); 2023-10-08T06:11:43.360 INFO:teuthology.orchestra.run.smithi032.stderr: | ^~~~~~~~~~~~~~~~ 2023-10-08T06:11:43.360 INFO:teuthology.orchestra.run.smithi032.stderr:seek_sanity_test.c:1256:2: warning: ignoring return value of 'ftruncate', declared with attribute warn_unused_result [-Wunused-result] 2023-10-08T06:11:43.360 INFO:teuthology.orchestra.run.smithi032.stderr: 1256 | ftruncate(fd, 0); 2023-10-08T06:11:43.360 INFO:teuthology.orchestra.run.smithi032.stderr: | ^~~~~~~~~~~~~~~~ 2023-10-08T06:11:43.360 INFO:teuthology.orchestra.run.smithi032.stderr:seek_sanity_test.c: In function 'get_io_sizes': 2023-10-08T06:11:43.361 INFO:teuthology.orchestra.run.smithi032.stderr:seek_sanity_test.c:88:3: warning: ignoring return value of 'ftruncate', declared with attribute warn_unused_result [-Wunused-result] 2023-10-08T06:11:43.361 INFO:teuthology.orchestra.run.smithi032.stderr: 88 | ftruncate(fd, 0); 2023-10-08T06:11:43.361 INFO:teuthology.orchestra.run.smithi032.stderr: | ^~~~~~~~~~~~~~~~ 2023-10-08T06:11:43.361 INFO:teuthology.orchestra.run.smithi032.stderr:seek_sanity_test.c:89:3: warning: ignoring return value of 'pwrite', declared with attribute warn_unused_result [-Wunused-result] 2023-10-08T06:11:43.361 INFO:teuthology.orchestra.run.smithi032.stderr: 89 | pwrite(fd, "a", 1, offset); 2023-10-08T06:11:43.361 INFO:teuthology.orchestra.run.smithi032.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-08T06:11:43.361 INFO:teuthology.orchestra.run.smithi032.stderr:seek_sanity_test.c:98:3: warning: ignoring return value of 'ftruncate', declared with attribute warn_unused_result [-Wunused-result] 2023-10-08T06:11:43.361 INFO:teuthology.orchestra.run.smithi032.stderr: 98 | ftruncate(fd, 0); 2023-10-08T06:11:43.361 INFO:teuthology.orchestra.run.smithi032.stderr: | ^~~~~~~~~~~~~~~~ 2023-10-08T06:11:43.361 INFO:teuthology.orchestra.run.smithi032.stderr:seek_sanity_test.c:99:3: warning: ignoring return value of 'pwrite', declared with attribute warn_unused_result [-Wunused-result] 2023-10-08T06:11:43.361 INFO:teuthology.orchestra.run.smithi032.stderr: 99 | pwrite(fd, "a", 1, offset); 2023-10-08T06:11:43.362 INFO:teuthology.orchestra.run.smithi032.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-08T06:11:43.697 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] seek_copy_test 2023-10-08T06:11:43.957 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] t_readdir_1 2023-10-08T06:11:44.125 INFO:teuthology.orchestra.run.smithi032.stderr:t_readdir_1.c: In function 'main': 2023-10-08T06:11:44.125 INFO:teuthology.orchestra.run.smithi032.stderr:t_readdir_1.c:30:25: warning: ignoring return value of 'read', declared with attribute warn_unused_result [-Wunused-result] 2023-10-08T06:11:44.125 INFO:teuthology.orchestra.run.smithi032.stderr: 30 | read(fd, buf, 100); 2023-10-08T06:11:44.125 INFO:teuthology.orchestra.run.smithi032.stderr: | ^~~~~~~~~~~~~~~~~~ 2023-10-08T06:11:44.175 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] t_readdir_2 2023-10-08T06:11:44.393 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] fsync-tester 2023-10-08T06:11:44.559 INFO:teuthology.orchestra.run.smithi032.stderr:fsync-tester.c: In function 'main': 2023-10-08T06:11:44.559 INFO:teuthology.orchestra.run.smithi032.stderr:fsync-tester.c:391:3: warning: ignoring return value of 'read', declared with attribute warn_unused_result [-Wunused-result] 2023-10-08T06:11:44.559 INFO:teuthology.orchestra.run.smithi032.stderr: 391 | read(fd, &seed, sizeof(seed)); 2023-10-08T06:11:44.560 INFO:teuthology.orchestra.run.smithi032.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-08T06:11:44.560 INFO:teuthology.orchestra.run.smithi032.stderr:fsync-tester.c:541:3: warning: ignoring return value of 'system', declared with attribute warn_unused_result [-Wunused-result] 2023-10-08T06:11:44.560 INFO:teuthology.orchestra.run.smithi032.stderr: 541 | system("reboot -fn"); 2023-10-08T06:11:44.560 INFO:teuthology.orchestra.run.smithi032.stderr: | ^~~~~~~~~~~~~~~~~~~~ 2023-10-08T06:11:44.560 INFO:teuthology.orchestra.run.smithi032.stderr:fsync-tester.c: In function 'drop_all_caches': 2023-10-08T06:11:44.560 INFO:teuthology.orchestra.run.smithi032.stderr:fsync-tester.c:90:2: warning: ignoring return value of 'write', declared with attribute warn_unused_result [-Wunused-result] 2023-10-08T06:11:44.560 INFO:teuthology.orchestra.run.smithi032.stderr: 90 | write(fd, value, sizeof(value)-1); 2023-10-08T06:11:44.561 INFO:teuthology.orchestra.run.smithi032.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-08T06:11:44.726 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] nsexec 2023-10-08T06:11:44.977 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] cloner 2023-10-08T06:11:45.237 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] renameat2 2023-10-08T06:11:45.475 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] t_getcwd 2023-10-08T06:11:45.645 INFO:teuthology.orchestra.run.smithi032.stderr:t_getcwd.c: In function 'test_getcwd': 2023-10-08T06:11:45.646 INFO:teuthology.orchestra.run.smithi032.stderr:t_getcwd.c:21:3: warning: ignoring return value of 'getcwd', declared with attribute warn_unused_result [-Wunused-result] 2023-10-08T06:11:45.646 INFO:teuthology.orchestra.run.smithi032.stderr: 21 | getcwd(cur_cwd, BUF_SIZE); 2023-10-08T06:11:45.646 INFO:teuthology.orchestra.run.smithi032.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-08T06:11:45.706 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] e4compact 2023-10-08T06:11:45.991 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] test-nextquota 2023-10-08T06:11:46.236 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] punch-alternating 2023-10-08T06:11:46.490 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] attr-list-by-handle-cursor-test 2023-10-08T06:11:46.741 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] listxattr 2023-10-08T06:11:46.958 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] dio-interleaved 2023-10-08T06:11:47.197 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] t_dir_type 2023-10-08T06:11:47.427 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] dio-invalidate-cache 2023-10-08T06:11:47.593 INFO:teuthology.orchestra.run.smithi032.stderr:dio-invalidate-cache.c: In function 'main': 2023-10-08T06:11:47.593 INFO:teuthology.orchestra.run.smithi032.stderr:dio-invalidate-cache.c:286:3: warning: ignoring return value of 'write', declared with attribute warn_unused_result [-Wunused-result] 2023-10-08T06:11:47.593 INFO:teuthology.orchestra.run.smithi032.stderr: 286 | write(fd, buf, blksz * nr_child); 2023-10-08T06:11:47.593 INFO:teuthology.orchestra.run.smithi032.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-10-08T06:11:47.712 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] stat_test 2023-10-08T06:11:48.108 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] t_encrypted_d_revalidate 2023-10-08T06:11:48.345 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] attr_replace_test 2023-10-08T06:11:48.589 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] swapon 2023-10-08T06:11:48.830 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] mkswap 2023-10-08T06:11:49.057 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] t_attr_corruption 2023-10-08T06:11:49.285 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] t_open_tmpfiles 2023-10-08T06:11:49.547 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] fscrypt-crypt-util 2023-10-08T06:11:50.361 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] bulkstat_null_ocount 2023-10-08T06:11:50.589 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] splice-test 2023-10-08T06:11:50.848 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] chprojid_fail 2023-10-08T06:11:51.081 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] detached_mounts_propagation 2023-10-08T06:11:51.345 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] ext4_resize 2023-10-08T06:11:51.655 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] t_readdir_3 2023-10-08T06:11:51.857 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] splice2pipe 2023-10-08T06:11:52.030 INFO:teuthology.orchestra.run.smithi032.stderr:splice2pipe.c: In function 'prepare_pipe': 2023-10-08T06:11:52.030 INFO:teuthology.orchestra.run.smithi032.stderr:splice2pipe.c:57:3: warning: ignoring return value of 'write', declared with attribute warn_unused_result [-Wunused-result] 2023-10-08T06:11:52.030 INFO:teuthology.orchestra.run.smithi032.stderr: 57 | write(p[1], buffer, n); 2023-10-08T06:11:52.030 INFO:teuthology.orchestra.run.smithi032.stderr: | ^~~~~~~~~~~~~~~~~~~~~~ 2023-10-08T06:11:52.030 INFO:teuthology.orchestra.run.smithi032.stderr:splice2pipe.c:65:3: warning: ignoring return value of 'read', declared with attribute warn_unused_result [-Wunused-result] 2023-10-08T06:11:52.030 INFO:teuthology.orchestra.run.smithi032.stderr: 65 | read(p[0], buffer, n); 2023-10-08T06:11:52.030 INFO:teuthology.orchestra.run.smithi032.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2023-10-08T06:11:52.102 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] uuid_ioctl 2023-10-08T06:11:52.336 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] fiemap-tester 2023-10-08T06:11:52.697 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] t_stripealign 2023-10-08T06:11:52.920 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] open_by_handle 2023-10-08T06:11:53.259 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] t_mmap_dio 2023-10-08T06:11:53.497 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] xfsfind 2023-10-08T06:11:53.781 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] fssum 2023-10-08T06:11:54.332 INFO:teuthology.orchestra.run.smithi032.stdout:Building log-writes 2023-10-08T06:11:54.341 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] replay-log 2023-10-08T06:11:54.768 INFO:teuthology.orchestra.run.smithi032.stdout:Building perf 2023-10-08T06:11:54.775 INFO:teuthology.orchestra.run.smithi032.stdout:Building aio-dio-regress 2023-10-08T06:11:54.785 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] aio-dio-append-write-fallocate-race 2023-10-08T06:11:55.044 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] aio-dio-fcntl-race 2023-10-08T06:11:55.295 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] aio-dio-subblock-eof-read 2023-10-08T06:11:55.521 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] aio-dio-append-write-read-race 2023-10-08T06:11:55.783 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] aio-dio-invalidate-readahead 2023-10-08T06:11:56.028 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] aio-dio-hole-filling-race 2023-10-08T06:11:56.257 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] aio-free-ring-with-bogus-nr-pages 2023-10-08T06:11:56.470 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] aio-last-ref-held-by-io 2023-10-08T06:11:56.730 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] aio-dio-cycle-write 2023-10-08T06:11:56.899 INFO:teuthology.orchestra.run.smithi032.stderr:aio-dio-cycle-write.c: In function 'init_test': 2023-10-08T06:11:56.899 INFO:teuthology.orchestra.run.smithi032.stderr:aio-dio-cycle-write.c:83:2: warning: ignoring return value of 'ftruncate', declared with attribute warn_unused_result [-Wunused-result] 2023-10-08T06:11:56.899 INFO:teuthology.orchestra.run.smithi032.stderr: 83 | ftruncate(fd, buf_size); 2023-10-08T06:11:56.899 INFO:teuthology.orchestra.run.smithi032.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~ 2023-10-08T06:11:57.010 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] aio-dio-extend-stat 2023-10-08T06:11:57.256 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] aio-io-setup-with-nonwritable-context-pointer 2023-10-08T06:11:57.451 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] aiocp 2023-10-08T06:11:57.774 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] aio-dio-invalidate-failure 2023-10-08T06:11:58.012 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] aiodio_sparse2 2023-10-08T06:11:58.179 INFO:teuthology.orchestra.run.smithi032.stderr:aiodio_sparse2.c: In function 'aiodio_sparse': 2023-10-08T06:11:58.179 INFO:teuthology.orchestra.run.smithi032.stderr:aiodio_sparse2.c:111:3: warning: ignoring return value of 'ftruncate', declared with attribute warn_unused_result [-Wunused-result] 2023-10-08T06:11:58.179 INFO:teuthology.orchestra.run.smithi032.stderr: 111 | ftruncate(fd, filesize); 2023-10-08T06:11:58.179 INFO:teuthology.orchestra.run.smithi032.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~ 2023-10-08T06:11:58.179 INFO:teuthology.orchestra.run.smithi032.stderr:aiodio_sparse2.c: In function 'dirty_freeblocks': 2023-10-08T06:11:58.180 INFO:teuthology.orchestra.run.smithi032.stderr:aiodio_sparse2.c:274:2: warning: ignoring return value of 'ftruncate', declared with attribute warn_unused_result [-Wunused-result] 2023-10-08T06:11:58.180 INFO:teuthology.orchestra.run.smithi032.stderr: 274 | ftruncate(fd, size); 2023-10-08T06:11:58.180 INFO:teuthology.orchestra.run.smithi032.stderr: | ^~~~~~~~~~~~~~~~~~~ 2023-10-08T06:11:58.320 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] aio-dio-cow-race 2023-10-08T06:11:58.551 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] aio-dio-write-verify 2023-10-08T06:11:58.835 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] aio-dio-eof-race 2023-10-08T06:11:59.111 INFO:teuthology.orchestra.run.smithi032.stdout:Building vfs 2023-10-08T06:11:59.123 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] vfstest 2023-10-08T06:12:01.403 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] mount-idmapped 2023-10-08T06:12:01.884 INFO:teuthology.orchestra.run.smithi032.stdout:Building m4 2023-10-08T06:12:01.889 INFO:teuthology.orchestra.run.smithi032.stdout:Building common 2023-10-08T06:12:01.895 INFO:teuthology.orchestra.run.smithi032.stdout:Building tests 2023-10-08T06:12:01.905 INFO:teuthology.orchestra.run.smithi032.stdout:Building perf 2023-10-08T06:12:01.916 INFO:teuthology.orchestra.run.smithi032.stdout: [GROUP] /tmp/tmp.p8vAuQqzIgxfstests-dev/tests/perf/group.list 2023-10-08T06:12:01.939 INFO:teuthology.orchestra.run.smithi032.stdout:Building ext4 2023-10-08T06:12:01.949 INFO:teuthology.orchestra.run.smithi032.stdout: [GROUP] /tmp/tmp.p8vAuQqzIgxfstests-dev/tests/ext4/group.list 2023-10-08T06:12:02.031 INFO:teuthology.orchestra.run.smithi032.stdout:Building ocfs2 2023-10-08T06:12:02.043 INFO:teuthology.orchestra.run.smithi032.stdout: [GROUP] /tmp/tmp.p8vAuQqzIgxfstests-dev/tests/ocfs2/group.list 2023-10-08T06:12:02.071 INFO:teuthology.orchestra.run.smithi032.stdout:Building overlay 2023-10-08T06:12:02.083 INFO:teuthology.orchestra.run.smithi032.stdout: [GROUP] /tmp/tmp.p8vAuQqzIgxfstests-dev/tests/overlay/group.list 2023-10-08T06:12:02.169 INFO:teuthology.orchestra.run.smithi032.stdout:Building cifs 2023-10-08T06:12:02.180 INFO:teuthology.orchestra.run.smithi032.stdout: [GROUP] /tmp/tmp.p8vAuQqzIgxfstests-dev/tests/cifs/group.list 2023-10-08T06:12:02.205 INFO:teuthology.orchestra.run.smithi032.stdout:Building generic 2023-10-08T06:12:02.220 INFO:teuthology.orchestra.run.smithi032.stdout: [GROUP] /tmp/tmp.p8vAuQqzIgxfstests-dev/tests/generic/group.list 2023-10-08T06:12:02.418 INFO:teuthology.orchestra.run.smithi032.stdout:Building shared 2023-10-08T06:12:02.430 INFO:teuthology.orchestra.run.smithi032.stdout: [GROUP] /tmp/tmp.p8vAuQqzIgxfstests-dev/tests/shared/group.list 2023-10-08T06:12:02.467 INFO:teuthology.orchestra.run.smithi032.stdout:Building xfs 2023-10-08T06:12:02.482 INFO:teuthology.orchestra.run.smithi032.stdout: [GROUP] /tmp/tmp.p8vAuQqzIgxfstests-dev/tests/xfs/group.list 2023-10-08T06:12:02.686 INFO:teuthology.orchestra.run.smithi032.stdout:Building f2fs 2023-10-08T06:12:02.696 INFO:teuthology.orchestra.run.smithi032.stdout: [GROUP] /tmp/tmp.p8vAuQqzIgxfstests-dev/tests/f2fs/group.list 2023-10-08T06:12:02.732 INFO:teuthology.orchestra.run.smithi032.stdout:Building udf 2023-10-08T06:12:02.742 INFO:teuthology.orchestra.run.smithi032.stdout: [GROUP] /tmp/tmp.p8vAuQqzIgxfstests-dev/tests/udf/group.list 2023-10-08T06:12:02.767 INFO:teuthology.orchestra.run.smithi032.stdout:Building ceph 2023-10-08T06:12:02.779 INFO:teuthology.orchestra.run.smithi032.stdout: [GROUP] /tmp/tmp.p8vAuQqzIgxfstests-dev/tests/ceph/group.list 2023-10-08T06:12:02.810 INFO:teuthology.orchestra.run.smithi032.stdout:Building nfs 2023-10-08T06:12:02.822 INFO:teuthology.orchestra.run.smithi032.stdout: [GROUP] /tmp/tmp.p8vAuQqzIgxfstests-dev/tests/nfs/group.list 2023-10-08T06:12:02.853 INFO:teuthology.orchestra.run.smithi032.stdout:Building btrfs 2023-10-08T06:12:02.866 INFO:teuthology.orchestra.run.smithi032.stdout: [GROUP] /tmp/tmp.p8vAuQqzIgxfstests-dev/tests/btrfs/group.list 2023-10-08T06:12:02.990 INFO:teuthology.orchestra.run.smithi032.stdout:Building tmpfs 2023-10-08T06:12:03.001 INFO:teuthology.orchestra.run.smithi032.stdout: [GROUP] /tmp/tmp.p8vAuQqzIgxfstests-dev/tests/tmpfs/group.list 2023-10-08T06:12:03.029 INFO:teuthology.orchestra.run.smithi032.stdout:Building selftest 2023-10-08T06:12:03.039 INFO:teuthology.orchestra.run.smithi032.stdout: [GROUP] /tmp/tmp.p8vAuQqzIgxfstests-dev/tests/selftest/group.list 2023-10-08T06:12:03.067 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo make install) 2023-10-08T06:12:03.107 INFO:teuthology.orchestra.run.smithi032.stdout:Building include 2023-10-08T06:12:03.115 INFO:teuthology.orchestra.run.smithi032.stdout:Building lib 2023-10-08T06:12:03.124 INFO:teuthology.orchestra.run.smithi032.stdout:Building ltp 2023-10-08T06:12:03.133 INFO:teuthology.orchestra.run.smithi032.stdout:Building src 2023-10-08T06:12:03.200 INFO:teuthology.orchestra.run.smithi032.stdout:Building log-writes 2023-10-08T06:12:03.209 INFO:teuthology.orchestra.run.smithi032.stdout:Building perf 2023-10-08T06:12:03.216 INFO:teuthology.orchestra.run.smithi032.stdout:Building aio-dio-regress 2023-10-08T06:12:03.225 INFO:teuthology.orchestra.run.smithi032.stdout:Building vfs 2023-10-08T06:12:03.233 INFO:teuthology.orchestra.run.smithi032.stdout:Building m4 2023-10-08T06:12:03.241 INFO:teuthology.orchestra.run.smithi032.stdout:Building common 2023-10-08T06:12:03.249 INFO:teuthology.orchestra.run.smithi032.stdout:Building tests 2023-10-08T06:12:03.260 INFO:teuthology.orchestra.run.smithi032.stdout:Building perf 2023-10-08T06:12:03.272 INFO:teuthology.orchestra.run.smithi032.stdout: [GROUP] /tmp/tmp.p8vAuQqzIgxfstests-dev/tests/perf/group.list 2023-10-08T06:12:03.293 INFO:teuthology.orchestra.run.smithi032.stdout:Building ext4 2023-10-08T06:12:03.305 INFO:teuthology.orchestra.run.smithi032.stdout: [GROUP] /tmp/tmp.p8vAuQqzIgxfstests-dev/tests/ext4/group.list 2023-10-08T06:12:03.386 INFO:teuthology.orchestra.run.smithi032.stdout:Building ocfs2 2023-10-08T06:12:03.398 INFO:teuthology.orchestra.run.smithi032.stdout: [GROUP] /tmp/tmp.p8vAuQqzIgxfstests-dev/tests/ocfs2/group.list 2023-10-08T06:12:03.427 INFO:teuthology.orchestra.run.smithi032.stdout:Building overlay 2023-10-08T06:12:03.439 INFO:teuthology.orchestra.run.smithi032.stdout: [GROUP] /tmp/tmp.p8vAuQqzIgxfstests-dev/tests/overlay/group.list 2023-10-08T06:12:03.523 INFO:teuthology.orchestra.run.smithi032.stdout:Building cifs 2023-10-08T06:12:03.535 INFO:teuthology.orchestra.run.smithi032.stdout: [GROUP] /tmp/tmp.p8vAuQqzIgxfstests-dev/tests/cifs/group.list 2023-10-08T06:12:03.561 INFO:teuthology.orchestra.run.smithi032.stdout:Building generic 2023-10-08T06:12:03.575 INFO:teuthology.orchestra.run.smithi032.stdout: [GROUP] /tmp/tmp.p8vAuQqzIgxfstests-dev/tests/generic/group.list 2023-10-08T06:12:03.778 INFO:teuthology.orchestra.run.smithi032.stdout:Building shared 2023-10-08T06:12:03.791 INFO:teuthology.orchestra.run.smithi032.stdout: [GROUP] /tmp/tmp.p8vAuQqzIgxfstests-dev/tests/shared/group.list 2023-10-08T06:12:03.826 INFO:teuthology.orchestra.run.smithi032.stdout:Building xfs 2023-10-08T06:12:03.842 INFO:teuthology.orchestra.run.smithi032.stdout: [GROUP] /tmp/tmp.p8vAuQqzIgxfstests-dev/tests/xfs/group.list 2023-10-08T06:12:04.031 INFO:teuthology.orchestra.run.smithi032.stdout:Building f2fs 2023-10-08T06:12:04.042 INFO:teuthology.orchestra.run.smithi032.stdout: [GROUP] /tmp/tmp.p8vAuQqzIgxfstests-dev/tests/f2fs/group.list 2023-10-08T06:12:04.081 INFO:teuthology.orchestra.run.smithi032.stdout:Building udf 2023-10-08T06:12:04.093 INFO:teuthology.orchestra.run.smithi032.stdout: [GROUP] /tmp/tmp.p8vAuQqzIgxfstests-dev/tests/udf/group.list 2023-10-08T06:12:04.116 INFO:teuthology.orchestra.run.smithi032.stdout:Building ceph 2023-10-08T06:12:04.128 INFO:teuthology.orchestra.run.smithi032.stdout: [GROUP] /tmp/tmp.p8vAuQqzIgxfstests-dev/tests/ceph/group.list 2023-10-08T06:12:04.160 INFO:teuthology.orchestra.run.smithi032.stdout:Building nfs 2023-10-08T06:12:04.172 INFO:teuthology.orchestra.run.smithi032.stdout: [GROUP] /tmp/tmp.p8vAuQqzIgxfstests-dev/tests/nfs/group.list 2023-10-08T06:12:04.202 INFO:teuthology.orchestra.run.smithi032.stdout:Building btrfs 2023-10-08T06:12:04.213 INFO:teuthology.orchestra.run.smithi032.stdout: [GROUP] /tmp/tmp.p8vAuQqzIgxfstests-dev/tests/btrfs/group.list 2023-10-08T06:12:04.342 INFO:teuthology.orchestra.run.smithi032.stdout:Building tmpfs 2023-10-08T06:12:04.353 INFO:teuthology.orchestra.run.smithi032.stdout: [GROUP] /tmp/tmp.p8vAuQqzIgxfstests-dev/tests/tmpfs/group.list 2023-10-08T06:12:04.381 INFO:teuthology.orchestra.run.smithi032.stdout:Building selftest 2023-10-08T06:12:04.390 INFO:teuthology.orchestra.run.smithi032.stdout: [GROUP] /tmp/tmp.p8vAuQqzIgxfstests-dev/tests/selftest/group.list 2023-10-08T06:12:04.417 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/make --no-print-directory Q=@ -C include install 2023-10-08T06:12:04.423 INFO:teuthology.orchestra.run.smithi032.stdout:make[1]: Nothing to be done for 'install'. 2023-10-08T06:12:04.423 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/make --no-print-directory Q=@ -C lib install 2023-10-08T06:12:04.430 INFO:teuthology.orchestra.run.smithi032.stdout:make[1]: Nothing to be done for 'install'. 2023-10-08T06:12:04.430 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/make --no-print-directory Q=@ -C ltp install 2023-10-08T06:12:04.437 INFO:teuthology.orchestra.run.smithi032.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/ltp 2023-10-08T06:12:04.457 INFO:teuthology.orchestra.run.smithi032.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 doio fsstress fsx growfiles iogen aio-stress /var/lib/xfstests/ltp 2023-10-08T06:12:04.470 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T06:12:04.472 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T06:12:04.622 INFO:teuthology.orchestra.run.smithi032.stdout:../install-sh -o root -g root -m 755 rwtest.sh /var/lib/xfstests/ltp 2023-10-08T06:12:04.643 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/make --no-print-directory Q=@ -C src install 2023-10-08T06:12:04.679 INFO:teuthology.orchestra.run.smithi032.stdout:Building log-writes 2023-10-08T06:12:04.685 INFO:teuthology.orchestra.run.smithi032.stdout:Building perf 2023-10-08T06:12:04.692 INFO:teuthology.orchestra.run.smithi032.stdout:Building aio-dio-regress 2023-10-08T06:12:04.700 INFO:teuthology.orchestra.run.smithi032.stdout:Building vfs 2023-10-08T06:12:04.705 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/make -C log-writes install 2023-10-08T06:12:04.708 INFO:teuthology.orchestra.run.smithi032.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/log-writes 2023-10-08T06:12:04.728 INFO:teuthology.orchestra.run.smithi032.stdout:../../install-sh -o root -g root -m 755 replay-log /var/lib/xfstests/src/log-writes 2023-10-08T06:12:04.747 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/make -C perf install 2023-10-08T06:12:04.752 INFO:teuthology.orchestra.run.smithi032.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/perf 2023-10-08T06:12:04.771 INFO:teuthology.orchestra.run.smithi032.stdout:../../install-sh -o root -g root -m 755 ResultData.py fio-insert-and-compare.py FioResultDecoder.py FioCompare.py generate-schema.py fio-results.sql /var/lib/xfstests/src/perf 2023-10-08T06:12:04.818 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/make -C aio-dio-regress install 2023-10-08T06:12:04.824 INFO:teuthology.orchestra.run.smithi032.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/aio-dio-regress 2023-10-08T06:12:04.844 INFO:teuthology.orchestra.run.smithi032.stdout:../../install-sh -o root -g root -m 755 aio-dio-fcntl-race aio-dio-subblock-eof-read aio-dio-append-write-read-race aio-dio-invalidate-readahead aio-dio-hole-filling-race aio-free-ring-with-bogus-nr-pages aio-last-ref-held-by-io aio-dio-cycle-write aio-dio-extend-stat aio-io-setup-with-nonwritable-context-pointer aiocp aio-dio-append-write-fallocate-race aio-dio-invalidate-failure aiodio_sparse2 aio-dio-cow-race aio-dio-write-verify aio-dio-eof-race /var/lib/xfstests/src/aio-dio-regress 2023-10-08T06:12:04.953 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/make -C vfs install 2023-10-08T06:12:04.959 INFO:teuthology.orchestra.run.smithi032.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/vfs 2023-10-08T06:12:04.979 INFO:teuthology.orchestra.run.smithi032.stdout:../../install-sh -o root -g root -m 755 vfstest mount-idmapped /var/lib/xfstests/src/vfs 2023-10-08T06:12:05.006 INFO:teuthology.orchestra.run.smithi032.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src 2023-10-08T06:12:05.026 INFO:teuthology.orchestra.run.smithi032.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 dirstress fill fill2 getpagesize holes lstat64 nametest permname randholes runas truncfile usemem mmapcat append_reader append_writer dirperf metaperf devzero feature alloc fault fstest t_access_root godown resvtest writemod writev_on_pagefault makeextents itrash rename multi_open_unlink unwritten_sync genhashnames t_holes t_mmap_writev t_truncate_cmtime dirhash_collide t_rename_overwrite holetest t_truncate_self af_unix t_mmap_stale_pmd t_mmap_cow_race t_mmap_fallocate fsync-err t_mmap_write_ro t_ext4_dax_journal_corruption t_ext4_dax_inline_corruption t_ofd_locks t_mmap_collision mmap-write-concurrent t_get_file_time t_create_short_dirs t_create_long_dirs t_enospc t_mmap_writev_overlap checkpoint_journal mmap-rw-fault allocstale t_mmap_cow_memory_failure fake-dump-rootino dio-buf-fault xfsctl bstat t_mtab getdevicesize preallo_rw_pattern_reader preallo_rw_pattern_writer ftrunc trunc fs_perms testx looptest locktest unwritten_mmap bulkstat_unlink_test deduperace bulkstat_unlink_test_modified t_dir_offset t_futimens t_immutable stale_handle pwrite_mmap_blocked t_dir_offset2 seek_sanity_test seek_copy_test t_readdir_1 t_readdir_2 fsync-tester nsexec cloner renameat2 t_getcwd e4compact test-nextquota punch-alternating attr-list-by-handle-cursor-test listxattr dio-interleaved t_dir_type dio-invalidate-cache stat_test t_encrypted_d_revalidate attr_replace_test swapon mkswap t_attr_corruption t_open_tmpfiles fscrypt-crypt-util bulkstat_null_ocount splice-test chprojid_fail detached_mounts_propagation ext4_resize t_readdir_3 splice2pipe uuid_ioctl fiemap-tester t_stripealign open_by_handle t_mmap_dio xfsfind fssum /var/lib/xfstests/src 2023-10-08T06:12:07.856 INFO:teuthology.orchestra.run.smithi032.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 dmerror fill2attr fill2fs fill2fs_check scaleread.sh btrfs_crc32c_forged_name.py popdir.pl popattr.py soak_duration.awk /var/lib/xfstests/src 2023-10-08T06:12:08.088 INFO:teuthology.orchestra.run.smithi032.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 644 dumpfile /var/lib/xfstests/src 2023-10-08T06:12:08.144 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/make --no-print-directory Q=@ -C m4 install 2023-10-08T06:12:08.150 INFO:teuthology.orchestra.run.smithi032.stdout:make[1]: Nothing to be done for 'install'. 2023-10-08T06:12:08.150 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/make --no-print-directory Q=@ -C common install 2023-10-08T06:12:08.154 INFO:teuthology.orchestra.run.smithi032.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/common 2023-10-08T06:12:08.173 INFO:teuthology.orchestra.run.smithi032.stdout:../install-sh -o root -g root -m 644 * /var/lib/xfstests/common 2023-10-08T06:12:08.446 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/make --no-print-directory Q=@ -C tests install 2023-10-08T06:12:08.452 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/make --no-print-directory Q=@ -C /tmp/tmp.p8vAuQqzIgxfstests-dev/tests/btrfs/ install 2023-10-08T06:12:08.459 INFO:teuthology.orchestra.run.smithi032.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/btrfs 2023-10-08T06:12:08.479 INFO:teuthology.orchestra.run.smithi032.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 299 300 /var/lib/xfstests/tests/btrfs 2023-10-08T06:12:10.153 INFO:teuthology.orchestra.run.smithi032.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/btrfs 2023-10-08T06:12:10.174 INFO:teuthology.orchestra.run.smithi032.stdout:../../install-sh -o root -g root -m 644 278.out 041.out 016.out 145.out 156.out 104.out 240.out 180.out 282.out 267.out 280.out 140.out 265.out 008.out 040.out 106.out 199.out 233.out 234.out 101.out 248.out 009.out 033.out 252.out 270.out 148.out 088.out 036.out 296.out 137.out 125.out 110.out 165.out 152.out 264.out 015.out 192.out 075.out 178.out 052.out 256.out 207.out 228.out 028.out 273.out 074.out 251.out 176.out 209.out 020.out 195.out 215.out 115.out 250.out 191.out 266.out 111.out 051.out 177.out 219.out 119.out 244.out 128.out 232.out 162.out 070.out 147.out 288.out 196.out 242.out 143.out 187.out 024.out 220.out 142.out 238.out 120.out 202.out 102.out 002.out 171.out 261.out 045.out 092.out 082.out 072.out 068.out 048.out 062.out 084.out 129.out 066.out 229.out 254.out 011.out 029.out 183.out 275.out 134.out 170.out 260.out 034.out 065.out 286.out 161.out 245.out 056.out 216.out 116.out 043.out 274.out 287.out 010.out 001.out 276.out 295.out 138.out 237.out 297.out 153.out 181.out 160.out 175.out 091.out 081.out 071.out 061.out 239.out 067.out 300.out 200.out 100.out 258.out 269.out 208.out 039.out 099.out 222.out 169.out 098.out 290.out 080.out 060.out 206.out 108.out 006.out 167.out 217.out 133.out 117.out 017.out 236.out 211.out 158.out 085.out 057.out 146.out 188.out 189.out 204.out 046.out 279.out 225.out 073.out 174.out 268.out 135.out 025.out 124.out 035.out 172.out 103.out 058.out 262.out 042.out 193.out 097.out 283.out 083.out 247.out 186.out 053.out 109.out 157.out 164.out 094.out 241.out 089.out 141.out 212.out 214.out 014.out 223.out 086.out 123.out 179.out 144.out 032.out 277.out 136.out 005.out 096.out 198.out 190.out 173.out 050.out 205.out 105.out 263.out 257.out 291.out 185.out 095.out 285.out 155.out 201.out 019.out 063.out 299.out 151.out 231.out 227.out 069.out 131.out 213.out 113.out 013.out 031.out 182.out 272.out 078.out 004.out 184.out 044.out 259.out 210.out 132.out 037.out 093.out 197.out 235.out 127.out 230.out 027.out 292.out 130.out 023.out 030.out 203.out 003.out 055.out 114.out 243.out 194.out 159.out 249.out 122.out 166.out 022.out 289.out 038.out 284.out 281.out 090.out 224.out 154.out 076.out 271.out 149.out 064.out 077.out 218.out 118.out 018.out 047.out 168.out 007.out 293.out 079.out 054.out 059.out 150.out 049.out 226.out 163.out 126.out 026.out 021.out 253.out 246.out 255.out 139.out 221.out 087.out 294.out 121.out 112.out 012.out 107.out /var/lib/xfstests/tests/btrfs 2023-10-08T06:12:11.844 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/make --no-print-directory Q=@ -C /tmp/tmp.p8vAuQqzIgxfstests-dev/tests/ceph/ install 2023-10-08T06:12:11.850 INFO:teuthology.orchestra.run.smithi032.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ceph 2023-10-08T06:12:11.872 INFO:teuthology.orchestra.run.smithi032.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 /var/lib/xfstests/tests/ceph 2023-10-08T06:12:11.902 INFO:teuthology.orchestra.run.smithi032.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ceph 2023-10-08T06:12:11.920 INFO:teuthology.orchestra.run.smithi032.stdout:../../install-sh -o root -g root -m 644 003.out 005.out 001.out 004.out 002.out /var/lib/xfstests/tests/ceph 2023-10-08T06:12:11.962 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/make --no-print-directory Q=@ -C /tmp/tmp.p8vAuQqzIgxfstests-dev/tests/cifs/ install 2023-10-08T06:12:11.968 INFO:teuthology.orchestra.run.smithi032.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/cifs 2023-10-08T06:12:11.988 INFO:teuthology.orchestra.run.smithi032.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/cifs 2023-10-08T06:12:12.008 INFO:teuthology.orchestra.run.smithi032.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/cifs 2023-10-08T06:12:12.028 INFO:teuthology.orchestra.run.smithi032.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/cifs 2023-10-08T06:12:12.048 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/make --no-print-directory Q=@ -C /tmp/tmp.p8vAuQqzIgxfstests-dev/tests/ext4/ install 2023-10-08T06:12:12.053 INFO:teuthology.orchestra.run.smithi032.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ext4 2023-10-08T06:12:12.072 INFO:teuthology.orchestra.run.smithi032.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 271 301 302 303 304 305 306 307 308 /var/lib/xfstests/tests/ext4 2023-10-08T06:12:12.444 INFO:teuthology.orchestra.run.smithi032.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ext4 2023-10-08T06:12:12.464 INFO:teuthology.orchestra.run.smithi032.stdout:../../install-sh -o root -g root -m 644 001.out.nodelalloc 001.out.default 001.out.nozero 001.cfg 049.out 032.out 039.out 045.out 054.out 056.out 308.out 008.out 040.out 307.out 005.out 021.out 012.out 009.out 033.out 015.out 050.out 026.out 034.out 046.out 018.out 010.out 047.out 303.out 302.out 020.out 002.out 028.out 024.out 013.out 031.out 027.out 306.out 048.out 038.out 044.out 052.out 025.out 029.out 011.out 042.out 304.out 055.out 030.out 003.out 017.out 043.out 053.out 035.out 016.out 058.out 022.out 006.out 004.out 057.out 014.out 036.out 271.out 051.out 041.out 037.out 305.out 019.out 301.out 007.out 023.out 059.out /var/lib/xfstests/tests/ext4 2023-10-08T06:12:12.864 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/make --no-print-directory Q=@ -C /tmp/tmp.p8vAuQqzIgxfstests-dev/tests/f2fs/ install 2023-10-08T06:12:12.870 INFO:teuthology.orchestra.run.smithi032.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/f2fs 2023-10-08T06:12:12.889 INFO:teuthology.orchestra.run.smithi032.stdout:../../install-sh -o root -g root -m 755 001 002 /var/lib/xfstests/tests/f2fs 2023-10-08T06:12:12.915 INFO:teuthology.orchestra.run.smithi032.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/f2fs 2023-10-08T06:12:12.936 INFO:teuthology.orchestra.run.smithi032.stdout:../../install-sh -o root -g root -m 644 001.out 002.out /var/lib/xfstests/tests/f2fs 2023-10-08T06:12:12.963 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/make --no-print-directory Q=@ -C /tmp/tmp.p8vAuQqzIgxfstests-dev/tests/generic/ install 2023-10-08T06:12:12.973 INFO:teuthology.orchestra.run.smithi032.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/generic 2023-10-08T06:12:12.992 INFO:teuthology.orchestra.run.smithi032.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 569 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 596 597 598 599 600 601 602 603 604 605 606 607 608 609 610 611 612 613 614 615 616 617 618 619 620 621 622 623 624 625 626 627 628 629 630 631 632 633 634 635 636 637 638 639 640 641 642 643 644 645 646 647 648 649 650 651 652 653 654 655 656 657 658 659 660 661 662 663 664 665 666 667 668 669 670 671 672 673 674 675 676 677 678 679 680 681 682 683 684 685 686 687 688 689 690 691 692 693 694 695 696 697 698 699 700 701 702 703 704 705 706 707 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 728 729 730 731 /var/lib/xfstests/tests/generic 2023-10-08T06:12:17.057 INFO:teuthology.orchestra.run.smithi032.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/generic 2023-10-08T06:12:17.078 INFO:teuthology.orchestra.run.smithi032.stdout:../../install-sh -o root -g root -m 644 035.out.nfs 035.out.default 050.out.nojournal 050.out.xfsquota 050.out.default 050.cfg 035.cfg 047.out 021.out 233.out 518.out 055.out 295.out 683.out 337.out 385.out 082.out 270.out 237.out 502.out 088.out 597.out 097.out 202.out 137.out 034.out 110.out 389.out 593.out 571.out 040.out 646.out 592.out 282.out 728.out 468.out 628.out 428.out 507.out 328.out 566.out 127.out 557.out 273.out 182.out 420.out 609.out 576.out 087.out 506.out 057.out 195.out 711.out 007.out 466.out 311.out 532.out 591.out 719.out 111.out 432.out 519.out 623.out 131.out 319.out 177.out 219.out 119.out 423.out 661.out 232.out 183.out 645.out 134.out 260.out 095.out 611.out 638.out 465.out 716.out 161.out 416.out 026.out 216.out 116.out 043.out 358.out 338.out 238.out 439.out 138.out 263.out 497.out 160.out 647.out 433.out 481.out 061.out 377.out 686.out 333.out 258.out 322.out 039.out 222.out 098.out 330.out 690.out 480.out 706.out 606.out 406.out 306.out 206.out 106.out 006.out 447.out 003.out 217.out 120.out 191.out 117.out 355.out 357.out 542.out 485.out 074.out 033.out 188.out 367.out 489.out 279.out 624.out 524.out 174.out 163.out 324.out 224.out 257.out 124.out 672.out 668.out 058.out 262.out 366.out 648.out 042.out 537.out 193.out 083.out 399.out 365.out 509.out 568.out 309.out 209.out 441.out 255.out 356.out 474.out 341.out 094.out 241.out 089.out 691.out 616.out 614.out 514.out 312.out 141.out 314.out 214.out 381.out 056.out 671.out 041.out 016.out 340.out 649.out 572.out 586.out 240.out 549.out 673.out 633.out 321.out 140.out 708.out 608.out 449.out 185.out 408.out 308.out 208.out 380.out 670.out 604.out 404.out 104.out 599.out 476.out 192.out 199.out 278.out 639.out 443.out 540.out 186.out 539.out 133.out 164.out 376.out 589.out 154.out 339.out 652.out 239.out 440.out 498.out 139.out 180.out 267.out 317.out 552.out 017.out 169.out 565.out 315.out 580.out 452.out 679.out 336.out 020.out 252.out 585.out 678.out 448.out 352.out 348.out 651.out 184.out 435.out 409.out 248.out 009.out 482.out 625.out 283.out 488.out 496.out 325.out 551.out 225.out 636.out 125.out 544.out 693.out 296.out 650.out 152.out 563.out 143.out 024.out 015.out 392.out 682.out 472.out 595.out 578.out 642.out 550.out 052.out 062.out 655.out 276.out 451.out 450.out 463.out 004.out 157.out 069.out 644.out 316.out 344.out 487.out 715.out 615.out 395.out 151.out 415.out 674.out 215.out 115.out 384.out 351.out 250.out 266.out 051.out 536.out 228.out 577.out 244.out 128.out 662.out 579.out 144.out 405.out 205.out 136.out 598.out 363.out 712.out 176.out 198.out 723.out 108.out 390.out 680.out 705.out 605.out 505.out 305.out 105.out 005.out 523.out 084.out 149.out 179.out 703.out 619.out 727.out 685.out 562.out 419.out 388.out 527.out 158.out 044.out 019.out 695.out 086.out 574.out 332.out 060.out 142.out 584.out 045.out 372.out 478.out 612.out 462.out 173.out 687.out 350.out 132.out 037.out 293.out 197.out 492.out 499.out 246.out 032.out 112.out 660.out 414.out 063.out 101.out 561.out 343.out 323.out 702.out 362.out 387.out 594.out 438.out 721.out 289.out 699.out 284.out 477.out 621.out 290.out 548.out 299.out 456.out 707.out 461.out 391.out 445.out 632.out 256.out 493.out 107.out 658.out 251.out 526.out 479.out 713.out 426.out 221.out 326.out 226.out 413.out 126.out 121.out 313.out 555.out 460.out 694.out 347.out 275.out 038.out 090.out 361.out 528.out 564.out 294.out 656.out 066.out 455.out 558.out 162.out 147.out 288.out 396.out 547.out 531.out 698.out 148.out 301.out 360.out 374.out 261.out 076.out 657.out 692.out 304.out 634.out 724.out 129.out 726.out 729.out 458.out 534.out 626.out 529.out 603.out 434.out 329.out 587.out 165.out 229.out 590.out 371.out 234.out 486.out 223.out 123.out 669.out 023.out 459.out 688.out 277.out 516.out 146.out 398.out 696.out 247.out 427.out 190.out 280.out 484.out 491.out 187.out 046.out 227.out 731.out 583.out 285.out 631.out 654.out 359.out 501.out 171.out 155.out 431.out 099.out 331.out 231.out 613.out 513.out 028.out 213.out 730.out 113.out 013.out 031.out 630.out 675.out 667.out 272.out 530.out 627.out 573.out 430.out 310.out 454.out 259.out 210.out 327.out 397.out 067.out 093.out 287.out 230.out 027.out 292.out 130.out 370.out 403.out 030.out 203.out 103.out 354.out 025.out 386.out 560.out 722.out 291.out 622.out 243.out 522.out 543.out 422.out 394.out 159.out 249.out 122.out 689.out 166.out 022.out 424.out 637.out 684.out 490.out 353.out 375.out 181.out 676.out 271.out 570.out 618.out 064.out 018.out 418.out 077.out 218.out 118.out 575.out 172.out 079.out 469.out 054.out 059.out 049.out 442.out 569.out 521.out 378.out 253.out 421.out 475.out 512.out 494.out 412.out 212.out 538.out 379.out 342.out 012.out 167.out 554.out 070.out 596.out 720.out 620.out 196.out 520.out 242.out 457.out 320.out 220.out 629.out 602.out 153.out 402.out 302.out 102.out 002.out 717.out 617.out 517.out 429.out 417.out 156.out 092.out 664.out 072.out 068.out 473.out 369.out 511.out 411.out 029.out 211.out 011.out 659.out 194.out 170.out 053.out 065.out 286.out 245.out 437.out 545.out 714.out 559.out 710.out 036.out 610.out 510.out 274.out 410.out 701.out 601.out 401.out 201.out 010.out 001.out 495.out 281.out 048.out 665.out 114.out 014.out 346.out 581.out 297.out 145.out 168.out 641.out 436.out 091.out 081.out 071.out 075.out 653.out 700.out 600.out 500.out 400.out 300.out 200.out 100.out 464.out 541.out 269.out 546.out 382.out 677.out 553.out 178.out 175.out 298.out 446.out 444.out 080.out 709.out 607.out 508.out 407.out 307.out 207.out 109.out 008.out 643.out 150.out 349.out 453.out 666.out 236.out 078.out 364.out 567.out 725.out 582.out 383.out 085.out 704.out 588.out 635.out 334.out 504.out 525.out 189.out 204.out 535.out 425.out 345.out 318.out 467.out 368.out 681.out 254.out 335.out 718.out 073.out 235.out 470.out 268.out 556.out 135.out 503.out 533.out 303.out 264.out 515.out 373.out 265.out 697.out 640.out 483.out 096.out 393.out 663.out /var/lib/xfstests/tests/generic 2023-10-08T06:12:21.180 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/make --no-print-directory Q=@ -C /tmp/tmp.p8vAuQqzIgxfstests-dev/tests/nfs/ install 2023-10-08T06:12:21.185 INFO:teuthology.orchestra.run.smithi032.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/nfs 2023-10-08T06:12:21.204 INFO:teuthology.orchestra.run.smithi032.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/nfs 2023-10-08T06:12:21.224 INFO:teuthology.orchestra.run.smithi032.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/nfs 2023-10-08T06:12:21.244 INFO:teuthology.orchestra.run.smithi032.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/nfs 2023-10-08T06:12:21.265 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/make --no-print-directory Q=@ -C /tmp/tmp.p8vAuQqzIgxfstests-dev/tests/ocfs2/ install 2023-10-08T06:12:21.270 INFO:teuthology.orchestra.run.smithi032.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ocfs2 2023-10-08T06:12:21.290 INFO:teuthology.orchestra.run.smithi032.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/ocfs2 2023-10-08T06:12:21.310 INFO:teuthology.orchestra.run.smithi032.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ocfs2 2023-10-08T06:12:21.330 INFO:teuthology.orchestra.run.smithi032.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/ocfs2 2023-10-08T06:12:21.351 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/make --no-print-directory Q=@ -C /tmp/tmp.p8vAuQqzIgxfstests-dev/tests/overlay/ install 2023-10-08T06:12:21.357 INFO:teuthology.orchestra.run.smithi032.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/overlay 2023-10-08T06:12:21.377 INFO:teuthology.orchestra.run.smithi032.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 /var/lib/xfstests/tests/overlay 2023-10-08T06:12:21.924 INFO:teuthology.orchestra.run.smithi032.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/overlay 2023-10-08T06:12:21.944 INFO:teuthology.orchestra.run.smithi032.stdout:../../install-sh -o root -g root -m 644 103.out 003.out 074.out 079.out 018.out 024.out 078.out 069.out 020.out 102.out 002.out 060.out 113.out 013.out 031.out 015.out 117.out 057.out 072.out 106.out 048.out 062.out 038.out 052.out 076.out 110.out 037.out 029.out 112.out 042.out 035.out 073.out 068.out 055.out 030.out 034.out 017.out 043.out 053.out 109.out 116.out 016.out 056.out 010.out 001.out 009.out 065.out 022.out 004.out 115.out 066.out 114.out 014.out 071.out 007.out 061.out 051.out 011.out 041.out 067.out 058.out 111.out 100.out 064.out 005.out 104.out 028.out 027.out 080.out 023.out 059.out 049.out 032.out 039.out 105.out 054.out 025.out 026.out 036.out 070.out 108.out 008.out 040.out 107.out 006.out 075.out 021.out 047.out 046.out 012.out 101.out 063.out 033.out 077.out 050.out 045.out 044.out 019.out /var/lib/xfstests/tests/overlay 2023-10-08T06:12:22.497 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/make --no-print-directory Q=@ -C /tmp/tmp.p8vAuQqzIgxfstests-dev/tests/perf/ install 2023-10-08T06:12:22.502 INFO:teuthology.orchestra.run.smithi032.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/perf 2023-10-08T06:12:22.522 INFO:teuthology.orchestra.run.smithi032.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/perf 2023-10-08T06:12:22.541 INFO:teuthology.orchestra.run.smithi032.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/perf 2023-10-08T06:12:22.562 INFO:teuthology.orchestra.run.smithi032.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/perf 2023-10-08T06:12:22.582 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/make --no-print-directory Q=@ -C /tmp/tmp.p8vAuQqzIgxfstests-dev/tests/selftest/ install 2023-10-08T06:12:22.588 INFO:teuthology.orchestra.run.smithi032.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/selftest 2023-10-08T06:12:22.607 INFO:teuthology.orchestra.run.smithi032.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 /var/lib/xfstests/tests/selftest 2023-10-08T06:12:22.654 INFO:teuthology.orchestra.run.smithi032.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/selftest 2023-10-08T06:12:22.674 INFO:teuthology.orchestra.run.smithi032.stdout:../../install-sh -o root -g root -m 644 003.out 005.out 006.out 001.out 004.out 002.out /var/lib/xfstests/tests/selftest 2023-10-08T06:12:22.721 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/make --no-print-directory Q=@ -C /tmp/tmp.p8vAuQqzIgxfstests-dev/tests/shared/ install 2023-10-08T06:12:22.727 INFO:teuthology.orchestra.run.smithi032.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/shared 2023-10-08T06:12:22.747 INFO:teuthology.orchestra.run.smithi032.stdout:../../install-sh -o root -g root -m 755 002 032 298 /var/lib/xfstests/tests/shared 2023-10-08T06:12:22.778 INFO:teuthology.orchestra.run.smithi032.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/shared 2023-10-08T06:12:22.798 INFO:teuthology.orchestra.run.smithi032.stdout:../../install-sh -o root -g root -m 644 032.out 298.out 002.out /var/lib/xfstests/tests/shared 2023-10-08T06:12:22.830 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/make --no-print-directory Q=@ -C /tmp/tmp.p8vAuQqzIgxfstests-dev/tests/tmpfs/ install 2023-10-08T06:12:22.836 INFO:teuthology.orchestra.run.smithi032.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/tmpfs 2023-10-08T06:12:22.856 INFO:teuthology.orchestra.run.smithi032.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/tmpfs 2023-10-08T06:12:22.874 INFO:teuthology.orchestra.run.smithi032.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/tmpfs 2023-10-08T06:12:22.895 INFO:teuthology.orchestra.run.smithi032.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/tmpfs 2023-10-08T06:12:22.915 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/make --no-print-directory Q=@ -C /tmp/tmp.p8vAuQqzIgxfstests-dev/tests/udf/ install 2023-10-08T06:12:22.921 INFO:teuthology.orchestra.run.smithi032.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/udf 2023-10-08T06:12:22.941 INFO:teuthology.orchestra.run.smithi032.stdout:../../install-sh -o root -g root -m 755 102 /var/lib/xfstests/tests/udf 2023-10-08T06:12:22.961 INFO:teuthology.orchestra.run.smithi032.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/udf 2023-10-08T06:12:22.980 INFO:teuthology.orchestra.run.smithi032.stdout:../../install-sh -o root -g root -m 644 102.out /var/lib/xfstests/tests/udf 2023-10-08T06:12:23.000 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/make --no-print-directory Q=@ -C /tmp/tmp.p8vAuQqzIgxfstests-dev/tests/xfs/ install 2023-10-08T06:12:23.011 INFO:teuthology.orchestra.run.smithi032.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/xfs 2023-10-08T06:12:23.030 INFO:teuthology.orchestra.run.smithi032.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 569 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 596 597 598 599 600 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 728 729 730 731 732 733 734 735 736 737 738 739 740 741 742 743 744 745 746 747 748 749 750 751 752 753 754 755 756 757 758 759 760 761 762 763 764 765 766 767 768 769 770 771 772 773 774 775 776 777 778 779 780 781 782 783 784 785 786 787 788 789 790 791 792 793 794 795 796 797 798 799 800 /var/lib/xfstests/tests/xfs 2023-10-08T06:12:26.869 INFO:teuthology.orchestra.run.smithi032.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/xfs 2023-10-08T06:12:26.886 INFO:teuthology.orchestra.run.smithi032.stdout:../../install-sh -o root -g root -m 644 033.out.crc 216.out.64mblog 096.out.external 033.out.default 071.out.64 216.out.classic 096.out.internal 071.out.32 216.cfg 033.cfg 185.out 508.out 221.out 057.out 308.out 208.out 737.out 108.out 404.out 457.out 455.out 233.out 194.out 443.out 295.out 497.out 337.out 237.out 759.out 502.out 088.out 366.out 202.out 137.out 002.out 389.out 593.out 571.out 775.out 040.out 765.out 592.out 282.out 728.out 528.out 428.out 407.out 328.out 566.out 261.out 557.out 273.out 468.out 074.out 427.out 059.out 789.out 195.out 711.out 732.out 784.out 532.out 191.out 111.out 432.out 519.out 419.out 131.out 319.out 177.out 219.out 119.out 423.out 232.out 529.out 434.out 076.out 329.out 229.out 103.out 234.out 183.out 733.out 134.out 260.out 157.out 718.out 034.out 465.out 716.out 161.out 416.out 116.out 043.out 155.out 358.out 338.out 238.out 224.out 065.out 439.out 138.out 189.out 097.out 160.out 175.out 291.out 481.out 345.out 025.out 772.out 768.out 258.out 379.out 322.out 039.out 742.out 098.out 480.out 060.out 506.out 406.out 306.out 206.out 006.out 167.out 003.out 217.out 117.out 355.out 017.out 542.out 783.out 485.out 442.out 188.out 026.out 342.out 467.out 281.out 524.out 174.out 163.out 771.out 324.out 313.out 257.out 124.out 758.out 058.out 741.out 384.out 262.out 042.out 377.out 193.out 799.out 473.out 770.out 365.out 409.out 309.out 209.out 441.out 109.out 255.out 740.out 356.out 474.out 341.out 094.out 712.out 241.out 089.out 540.out 256.out 714.out 514.out 141.out 314.out 214.out 114.out 381.out 147.out 275.out 041.out 721.out 340.out 793.out 156.out 572.out 568.out 586.out 240.out 180.out 549.out 267.out 280.out 543.out 140.out 708.out 449.out 204.out 535.out 104.out 425.out 399.out 254.out 335.out 531.out 235.out 470.out 268.out 556.out 135.out 503.out 533.out 303.out 264.out 110.out 318.out 515.out 373.out 036.out 169.out 483.out 393.out 333.out 599.out 476.out 087.out 192.out 199.out 739.out 068.out 591.out 752.out 736.out 236.out 773.out 539.out 749.out 164.out 376.out 154.out 587.out 339.out 239.out 440.out 458.out 456.out 489.out 139.out 774.out 790.out 317.out 552.out 781.out 064.out 444.out 580.out 452.out 020.out 252.out 585.out 724.out 352.out 794.out 348.out 394.out 184.out 435.out 509.out 466.out 278.out 248.out 785.out 009.out 283.out 750.out 045.out 297.out 488.out 496.out 325.out 551.out 225.out 125.out 186.out 544.out 296.out 152.out 563.out 143.out 436.out 392.out 545.out 075.out 472.out 463.out 550.out 052.out 062.out 276.out 266.out 450.out 744.out 004.out 764.out 069.out 316.out 487.out 762.out 715.out 395.out 151.out 415.out 315.out 344.out 215.out 115.out 015.out 351.out 250.out 464.out 051.out 536.out 228.out 244.out 128.out 385.out 336.out 086.out 579.out 144.out 505.out 205.out 136.out 537.out 176.out 198.out 723.out 390.out 178.out 050.out 405.out 305.out 105.out 005.out 523.out 437.out 719.out 727.out 363.out 095.out 562.out 382.out 271.out 570.out 388.out 590.out 527.out 158.out 044.out 019.out 577.out 777.out 760.out 574.out 332.out 372.out 478.out 462.out 220.out 350.out 132.out 293.out 492.out 263.out 212.out 499.out 246.out 112.out 099.out 414.out 063.out 101.out 561.out 166.out 343.out 362.out 387.out 798.out 594.out 438.out 265.out 289.out 106.out 477.out 290.out 548.out 299.out 364.out 595.out 461.out 391.out 451.out 493.out 786.out 007.out 448.out 251.out 380.out 526.out 479.out 713.out 426.out 150.out 326.out 082.out 226.out 413.out 126.out 555.out 761.out 347.out 035.out 361.out 564.out 294.out 788.out 066.out 795.out 597.out 747.out 558.out 162.out 796.out 197.out 396.out 576.out 547.out 298.out 148.out 301.out 360.out 374.out 734.out 447.out 292.out 304.out 482.out 129.out 726.out 729.out 048.out 534.out 073.out 368.out 486.out 223.out 123.out 179.out 023.out 032.out 748.out 277.out 433.out 516.out 146.out 424.out 398.out 168.out 751.out 190.out 173.out 484.out 491.out 754.out 016.out 046.out 227.out 731.out 782.out 583.out 285.out 127.out 501.out 171.out 581.out 027.out 431.out 288.out 331.out 791.out 743.out 047.out 231.out 024.out 513.out 371.out 213.out 730.out 113.out 013.out 031.out 367.out 182.out 323.out 272.out 530.out 573.out 430.out 569.out 454.out 259.out 210.out 327.out 330.out 067.out 093.out 287.out 230.out 769.out 061.out 130.out 370.out 403.out 030.out 203.out 354.out 165.out 386.out 560.out 055.out 722.out 245.out 243.out 522.out 787.out 745.out 422.out 222.out 159.out 598.out 249.out 122.out 022.out 038.out 346.out 578.out 490.out 565.out 353.out 375.out 181.out 500.out 149.out 518.out 018.out 418.out 077.out 218.out 118.out 575.out 780.out 172.out 792.out 079.out 469.out 054.out 049.out 021.out 738.out 755.out 776.out 521.out 270.out 378.out 253.out 421.out 321.out 475.out 512.out 494.out 412.out 312.out 121.out 538.out 012.out 028.out 554.out 397.out 070.out 596.out 720.out 196.out 520.out 242.out 420.out 498.out 320.out 120.out 153.out 402.out 302.out 102.out 717.out 460.out 517.out 429.out 417.out 142.out 092.out 357.out 072.out 778.out 084.out 056.out 369.out 247.out 511.out 411.out 029.out 311.out 211.out 011.out 767.out 187.out 170.out 053.out 133.out 286.out 756.out 766.out 559.out 710.out 510.out 274.out 410.out 310.out 401.out 201.out 010.out 001.out 495.out 584.out 589.out 753.out 014.out 459.out 145.out 797.out 757.out 091.out 081.out 083.out 800.out 600.out 037.out 400.out 300.out 200.out 100.out 359.out 471.out 541.out 445.out 779.out 269.out 546.out 279.out 553.out 763.out 446.out 090.out 080.out 709.out 507.out 408.out 307.out 207.out 107.out 008.out 746.out 284.out 349.out 453.out 078.out 567.out 725.out 582.out 735.out 383.out 085.out 588.out 334.out 504.out 525.out /var/lib/xfstests/tests/xfs 2023-10-08T06:12:30.765 INFO:teuthology.orchestra.run.smithi032.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests 2023-10-08T06:12:30.787 INFO:teuthology.orchestra.run.smithi032.stdout:./install-sh -o root -g root -m 755 -d /var/lib/xfstests 2023-10-08T06:12:30.806 INFO:teuthology.orchestra.run.smithi032.stdout:./install-sh -o root -g root -m 755 check /var/lib/xfstests 2023-10-08T06:12:30.827 INFO:teuthology.orchestra.run.smithi032.stdout:./install-sh -o root -g root -m 644 randomize.awk /var/lib/xfstests 2023-10-08T06:12:30.849 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T06:12:30.850 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec ls tests/generic) 2023-10-08T06:12:30.859 INFO:teuthology.orchestra.run.smithi032.stdout:001 2023-10-08T06:12:30.859 INFO:teuthology.orchestra.run.smithi032.stdout:001.out 2023-10-08T06:12:30.859 INFO:teuthology.orchestra.run.smithi032.stdout:002 2023-10-08T06:12:30.859 INFO:teuthology.orchestra.run.smithi032.stdout:002.out 2023-10-08T06:12:30.859 INFO:teuthology.orchestra.run.smithi032.stdout:003 2023-10-08T06:12:30.859 INFO:teuthology.orchestra.run.smithi032.stdout:003.out 2023-10-08T06:12:30.859 INFO:teuthology.orchestra.run.smithi032.stdout:004 2023-10-08T06:12:30.860 INFO:teuthology.orchestra.run.smithi032.stdout:004.out 2023-10-08T06:12:30.860 INFO:teuthology.orchestra.run.smithi032.stdout:005 2023-10-08T06:12:30.860 INFO:teuthology.orchestra.run.smithi032.stdout:005.out 2023-10-08T06:12:30.860 INFO:teuthology.orchestra.run.smithi032.stdout:006 2023-10-08T06:12:30.860 INFO:teuthology.orchestra.run.smithi032.stdout:006.out 2023-10-08T06:12:30.860 INFO:teuthology.orchestra.run.smithi032.stdout:007 2023-10-08T06:12:30.860 INFO:teuthology.orchestra.run.smithi032.stdout:007.out 2023-10-08T06:12:30.860 INFO:teuthology.orchestra.run.smithi032.stdout:008 2023-10-08T06:12:30.860 INFO:teuthology.orchestra.run.smithi032.stdout:008.out 2023-10-08T06:12:30.860 INFO:teuthology.orchestra.run.smithi032.stdout:009 2023-10-08T06:12:30.860 INFO:teuthology.orchestra.run.smithi032.stdout:009.out 2023-10-08T06:12:30.861 INFO:teuthology.orchestra.run.smithi032.stdout:010 2023-10-08T06:12:30.861 INFO:teuthology.orchestra.run.smithi032.stdout:010.out 2023-10-08T06:12:30.861 INFO:teuthology.orchestra.run.smithi032.stdout:011 2023-10-08T06:12:30.861 INFO:teuthology.orchestra.run.smithi032.stdout:011.out 2023-10-08T06:12:30.861 INFO:teuthology.orchestra.run.smithi032.stdout:012 2023-10-08T06:12:30.861 INFO:teuthology.orchestra.run.smithi032.stdout:012.out 2023-10-08T06:12:30.861 INFO:teuthology.orchestra.run.smithi032.stdout:013 2023-10-08T06:12:30.861 INFO:teuthology.orchestra.run.smithi032.stdout:013.out 2023-10-08T06:12:30.861 INFO:teuthology.orchestra.run.smithi032.stdout:014 2023-10-08T06:12:30.861 INFO:teuthology.orchestra.run.smithi032.stdout:014.out 2023-10-08T06:12:30.861 INFO:teuthology.orchestra.run.smithi032.stdout:015 2023-10-08T06:12:30.861 INFO:teuthology.orchestra.run.smithi032.stdout:015.out 2023-10-08T06:12:30.862 INFO:teuthology.orchestra.run.smithi032.stdout:016 2023-10-08T06:12:30.862 INFO:teuthology.orchestra.run.smithi032.stdout:016.out 2023-10-08T06:12:30.862 INFO:teuthology.orchestra.run.smithi032.stdout:017 2023-10-08T06:12:30.862 INFO:teuthology.orchestra.run.smithi032.stdout:017.out 2023-10-08T06:12:30.862 INFO:teuthology.orchestra.run.smithi032.stdout:018 2023-10-08T06:12:30.862 INFO:teuthology.orchestra.run.smithi032.stdout:018.out 2023-10-08T06:12:30.862 INFO:teuthology.orchestra.run.smithi032.stdout:019 2023-10-08T06:12:30.862 INFO:teuthology.orchestra.run.smithi032.stdout:019.out 2023-10-08T06:12:30.862 INFO:teuthology.orchestra.run.smithi032.stdout:020 2023-10-08T06:12:30.862 INFO:teuthology.orchestra.run.smithi032.stdout:020.out 2023-10-08T06:12:30.862 INFO:teuthology.orchestra.run.smithi032.stdout:021 2023-10-08T06:12:30.863 INFO:teuthology.orchestra.run.smithi032.stdout:021.out 2023-10-08T06:12:30.863 INFO:teuthology.orchestra.run.smithi032.stdout:022 2023-10-08T06:12:30.863 INFO:teuthology.orchestra.run.smithi032.stdout:022.out 2023-10-08T06:12:30.863 INFO:teuthology.orchestra.run.smithi032.stdout:023 2023-10-08T06:12:30.863 INFO:teuthology.orchestra.run.smithi032.stdout:023.out 2023-10-08T06:12:30.863 INFO:teuthology.orchestra.run.smithi032.stdout:024 2023-10-08T06:12:30.863 INFO:teuthology.orchestra.run.smithi032.stdout:024.out 2023-10-08T06:12:30.863 INFO:teuthology.orchestra.run.smithi032.stdout:025 2023-10-08T06:12:30.863 INFO:teuthology.orchestra.run.smithi032.stdout:025.out 2023-10-08T06:12:30.863 INFO:teuthology.orchestra.run.smithi032.stdout:026 2023-10-08T06:12:30.863 INFO:teuthology.orchestra.run.smithi032.stdout:026.out 2023-10-08T06:12:30.863 INFO:teuthology.orchestra.run.smithi032.stdout:027 2023-10-08T06:12:30.864 INFO:teuthology.orchestra.run.smithi032.stdout:027.out 2023-10-08T06:12:30.864 INFO:teuthology.orchestra.run.smithi032.stdout:028 2023-10-08T06:12:30.864 INFO:teuthology.orchestra.run.smithi032.stdout:028.out 2023-10-08T06:12:30.864 INFO:teuthology.orchestra.run.smithi032.stdout:029 2023-10-08T06:12:30.864 INFO:teuthology.orchestra.run.smithi032.stdout:029.out 2023-10-08T06:12:30.864 INFO:teuthology.orchestra.run.smithi032.stdout:030 2023-10-08T06:12:30.864 INFO:teuthology.orchestra.run.smithi032.stdout:030.out 2023-10-08T06:12:30.864 INFO:teuthology.orchestra.run.smithi032.stdout:031 2023-10-08T06:12:30.864 INFO:teuthology.orchestra.run.smithi032.stdout:031.out 2023-10-08T06:12:30.864 INFO:teuthology.orchestra.run.smithi032.stdout:032 2023-10-08T06:12:30.864 INFO:teuthology.orchestra.run.smithi032.stdout:032.out 2023-10-08T06:12:30.865 INFO:teuthology.orchestra.run.smithi032.stdout:033 2023-10-08T06:12:30.865 INFO:teuthology.orchestra.run.smithi032.stdout:033.out 2023-10-08T06:12:30.865 INFO:teuthology.orchestra.run.smithi032.stdout:034 2023-10-08T06:12:30.865 INFO:teuthology.orchestra.run.smithi032.stdout:034.out 2023-10-08T06:12:30.865 INFO:teuthology.orchestra.run.smithi032.stdout:035 2023-10-08T06:12:30.865 INFO:teuthology.orchestra.run.smithi032.stdout:035.cfg 2023-10-08T06:12:30.865 INFO:teuthology.orchestra.run.smithi032.stdout:035.out.default 2023-10-08T06:12:30.865 INFO:teuthology.orchestra.run.smithi032.stdout:035.out.nfs 2023-10-08T06:12:30.866 INFO:teuthology.orchestra.run.smithi032.stdout:036 2023-10-08T06:12:30.866 INFO:teuthology.orchestra.run.smithi032.stdout:036.out 2023-10-08T06:12:30.866 INFO:teuthology.orchestra.run.smithi032.stdout:037 2023-10-08T06:12:30.866 INFO:teuthology.orchestra.run.smithi032.stdout:037.out 2023-10-08T06:12:30.866 INFO:teuthology.orchestra.run.smithi032.stdout:038 2023-10-08T06:12:30.866 INFO:teuthology.orchestra.run.smithi032.stdout:038.out 2023-10-08T06:12:30.866 INFO:teuthology.orchestra.run.smithi032.stdout:039 2023-10-08T06:12:30.866 INFO:teuthology.orchestra.run.smithi032.stdout:039.out 2023-10-08T06:12:30.866 INFO:teuthology.orchestra.run.smithi032.stdout:040 2023-10-08T06:12:30.867 INFO:teuthology.orchestra.run.smithi032.stdout:040.out 2023-10-08T06:12:30.867 INFO:teuthology.orchestra.run.smithi032.stdout:041 2023-10-08T06:12:30.867 INFO:teuthology.orchestra.run.smithi032.stdout:041.out 2023-10-08T06:12:30.867 INFO:teuthology.orchestra.run.smithi032.stdout:042 2023-10-08T06:12:30.867 INFO:teuthology.orchestra.run.smithi032.stdout:042.out 2023-10-08T06:12:30.867 INFO:teuthology.orchestra.run.smithi032.stdout:043 2023-10-08T06:12:30.867 INFO:teuthology.orchestra.run.smithi032.stdout:043.out 2023-10-08T06:12:30.867 INFO:teuthology.orchestra.run.smithi032.stdout:044 2023-10-08T06:12:30.867 INFO:teuthology.orchestra.run.smithi032.stdout:044.out 2023-10-08T06:12:30.867 INFO:teuthology.orchestra.run.smithi032.stdout:045 2023-10-08T06:12:30.867 INFO:teuthology.orchestra.run.smithi032.stdout:045.out 2023-10-08T06:12:30.868 INFO:teuthology.orchestra.run.smithi032.stdout:046 2023-10-08T06:12:30.868 INFO:teuthology.orchestra.run.smithi032.stdout:046.out 2023-10-08T06:12:30.868 INFO:teuthology.orchestra.run.smithi032.stdout:047 2023-10-08T06:12:30.868 INFO:teuthology.orchestra.run.smithi032.stdout:047.out 2023-10-08T06:12:30.868 INFO:teuthology.orchestra.run.smithi032.stdout:048 2023-10-08T06:12:30.868 INFO:teuthology.orchestra.run.smithi032.stdout:048.out 2023-10-08T06:12:30.868 INFO:teuthology.orchestra.run.smithi032.stdout:049 2023-10-08T06:12:30.868 INFO:teuthology.orchestra.run.smithi032.stdout:049.out 2023-10-08T06:12:30.868 INFO:teuthology.orchestra.run.smithi032.stdout:050 2023-10-08T06:12:30.868 INFO:teuthology.orchestra.run.smithi032.stdout:050.cfg 2023-10-08T06:12:30.868 INFO:teuthology.orchestra.run.smithi032.stdout:050.out.default 2023-10-08T06:12:30.869 INFO:teuthology.orchestra.run.smithi032.stdout:050.out.nojournal 2023-10-08T06:12:30.869 INFO:teuthology.orchestra.run.smithi032.stdout:050.out.xfsquota 2023-10-08T06:12:30.869 INFO:teuthology.orchestra.run.smithi032.stdout:051 2023-10-08T06:12:30.869 INFO:teuthology.orchestra.run.smithi032.stdout:051.out 2023-10-08T06:12:30.869 INFO:teuthology.orchestra.run.smithi032.stdout:052 2023-10-08T06:12:30.869 INFO:teuthology.orchestra.run.smithi032.stdout:052.out 2023-10-08T06:12:30.869 INFO:teuthology.orchestra.run.smithi032.stdout:053 2023-10-08T06:12:30.869 INFO:teuthology.orchestra.run.smithi032.stdout:053.out 2023-10-08T06:12:30.869 INFO:teuthology.orchestra.run.smithi032.stdout:054 2023-10-08T06:12:30.869 INFO:teuthology.orchestra.run.smithi032.stdout:054.out 2023-10-08T06:12:30.869 INFO:teuthology.orchestra.run.smithi032.stdout:055 2023-10-08T06:12:30.869 INFO:teuthology.orchestra.run.smithi032.stdout:055.out 2023-10-08T06:12:30.870 INFO:teuthology.orchestra.run.smithi032.stdout:056 2023-10-08T06:12:30.870 INFO:teuthology.orchestra.run.smithi032.stdout:056.out 2023-10-08T06:12:30.870 INFO:teuthology.orchestra.run.smithi032.stdout:057 2023-10-08T06:12:30.870 INFO:teuthology.orchestra.run.smithi032.stdout:057.out 2023-10-08T06:12:30.870 INFO:teuthology.orchestra.run.smithi032.stdout:058 2023-10-08T06:12:30.870 INFO:teuthology.orchestra.run.smithi032.stdout:058.out 2023-10-08T06:12:30.870 INFO:teuthology.orchestra.run.smithi032.stdout:059 2023-10-08T06:12:30.870 INFO:teuthology.orchestra.run.smithi032.stdout:059.out 2023-10-08T06:12:30.870 INFO:teuthology.orchestra.run.smithi032.stdout:060 2023-10-08T06:12:30.870 INFO:teuthology.orchestra.run.smithi032.stdout:060.out 2023-10-08T06:12:30.870 INFO:teuthology.orchestra.run.smithi032.stdout:061 2023-10-08T06:12:30.871 INFO:teuthology.orchestra.run.smithi032.stdout:061.out 2023-10-08T06:12:30.871 INFO:teuthology.orchestra.run.smithi032.stdout:062 2023-10-08T06:12:30.871 INFO:teuthology.orchestra.run.smithi032.stdout:062.out 2023-10-08T06:12:30.871 INFO:teuthology.orchestra.run.smithi032.stdout:063 2023-10-08T06:12:30.871 INFO:teuthology.orchestra.run.smithi032.stdout:063.out 2023-10-08T06:12:30.871 INFO:teuthology.orchestra.run.smithi032.stdout:064 2023-10-08T06:12:30.871 INFO:teuthology.orchestra.run.smithi032.stdout:064.out 2023-10-08T06:12:30.871 INFO:teuthology.orchestra.run.smithi032.stdout:065 2023-10-08T06:12:30.871 INFO:teuthology.orchestra.run.smithi032.stdout:065.out 2023-10-08T06:12:30.871 INFO:teuthology.orchestra.run.smithi032.stdout:066 2023-10-08T06:12:30.871 INFO:teuthology.orchestra.run.smithi032.stdout:066.out 2023-10-08T06:12:30.872 INFO:teuthology.orchestra.run.smithi032.stdout:067 2023-10-08T06:12:30.872 INFO:teuthology.orchestra.run.smithi032.stdout:067.out 2023-10-08T06:12:30.872 INFO:teuthology.orchestra.run.smithi032.stdout:068 2023-10-08T06:12:30.872 INFO:teuthology.orchestra.run.smithi032.stdout:068.out 2023-10-08T06:12:30.872 INFO:teuthology.orchestra.run.smithi032.stdout:069 2023-10-08T06:12:30.872 INFO:teuthology.orchestra.run.smithi032.stdout:069.out 2023-10-08T06:12:30.872 INFO:teuthology.orchestra.run.smithi032.stdout:070 2023-10-08T06:12:30.872 INFO:teuthology.orchestra.run.smithi032.stdout:070.out 2023-10-08T06:12:30.872 INFO:teuthology.orchestra.run.smithi032.stdout:071 2023-10-08T06:12:30.872 INFO:teuthology.orchestra.run.smithi032.stdout:071.out 2023-10-08T06:12:30.872 INFO:teuthology.orchestra.run.smithi032.stdout:072 2023-10-08T06:12:30.872 INFO:teuthology.orchestra.run.smithi032.stdout:072.out 2023-10-08T06:12:30.873 INFO:teuthology.orchestra.run.smithi032.stdout:073 2023-10-08T06:12:30.873 INFO:teuthology.orchestra.run.smithi032.stdout:073.out 2023-10-08T06:12:30.873 INFO:teuthology.orchestra.run.smithi032.stdout:074 2023-10-08T06:12:30.873 INFO:teuthology.orchestra.run.smithi032.stdout:074.out 2023-10-08T06:12:30.873 INFO:teuthology.orchestra.run.smithi032.stdout:075 2023-10-08T06:12:30.873 INFO:teuthology.orchestra.run.smithi032.stdout:075.out 2023-10-08T06:12:30.873 INFO:teuthology.orchestra.run.smithi032.stdout:076 2023-10-08T06:12:30.873 INFO:teuthology.orchestra.run.smithi032.stdout:076.out 2023-10-08T06:12:30.873 INFO:teuthology.orchestra.run.smithi032.stdout:077 2023-10-08T06:12:30.873 INFO:teuthology.orchestra.run.smithi032.stdout:077.out 2023-10-08T06:12:30.873 INFO:teuthology.orchestra.run.smithi032.stdout:078 2023-10-08T06:12:30.874 INFO:teuthology.orchestra.run.smithi032.stdout:078.out 2023-10-08T06:12:30.874 INFO:teuthology.orchestra.run.smithi032.stdout:079 2023-10-08T06:12:30.874 INFO:teuthology.orchestra.run.smithi032.stdout:079.out 2023-10-08T06:12:30.874 INFO:teuthology.orchestra.run.smithi032.stdout:080 2023-10-08T06:12:30.874 INFO:teuthology.orchestra.run.smithi032.stdout:080.out 2023-10-08T06:12:30.874 INFO:teuthology.orchestra.run.smithi032.stdout:081 2023-10-08T06:12:30.874 INFO:teuthology.orchestra.run.smithi032.stdout:081.out 2023-10-08T06:12:30.874 INFO:teuthology.orchestra.run.smithi032.stdout:082 2023-10-08T06:12:30.874 INFO:teuthology.orchestra.run.smithi032.stdout:082.out 2023-10-08T06:12:30.874 INFO:teuthology.orchestra.run.smithi032.stdout:083 2023-10-08T06:12:30.874 INFO:teuthology.orchestra.run.smithi032.stdout:083.out 2023-10-08T06:12:30.875 INFO:teuthology.orchestra.run.smithi032.stdout:084 2023-10-08T06:12:30.875 INFO:teuthology.orchestra.run.smithi032.stdout:084.out 2023-10-08T06:12:30.875 INFO:teuthology.orchestra.run.smithi032.stdout:085 2023-10-08T06:12:30.875 INFO:teuthology.orchestra.run.smithi032.stdout:085.out 2023-10-08T06:12:30.875 INFO:teuthology.orchestra.run.smithi032.stdout:086 2023-10-08T06:12:30.875 INFO:teuthology.orchestra.run.smithi032.stdout:086.out 2023-10-08T06:12:30.875 INFO:teuthology.orchestra.run.smithi032.stdout:087 2023-10-08T06:12:30.875 INFO:teuthology.orchestra.run.smithi032.stdout:087.out 2023-10-08T06:12:30.875 INFO:teuthology.orchestra.run.smithi032.stdout:088 2023-10-08T06:12:30.875 INFO:teuthology.orchestra.run.smithi032.stdout:088.out 2023-10-08T06:12:30.876 INFO:teuthology.orchestra.run.smithi032.stdout:089 2023-10-08T06:12:30.877 INFO:teuthology.orchestra.run.smithi032.stdout:089.out 2023-10-08T06:12:30.877 INFO:teuthology.orchestra.run.smithi032.stdout:090 2023-10-08T06:12:30.877 INFO:teuthology.orchestra.run.smithi032.stdout:090.out 2023-10-08T06:12:30.877 INFO:teuthology.orchestra.run.smithi032.stdout:091 2023-10-08T06:12:30.877 INFO:teuthology.orchestra.run.smithi032.stdout:091.out 2023-10-08T06:12:30.877 INFO:teuthology.orchestra.run.smithi032.stdout:092 2023-10-08T06:12:30.877 INFO:teuthology.orchestra.run.smithi032.stdout:092.out 2023-10-08T06:12:30.877 INFO:teuthology.orchestra.run.smithi032.stdout:093 2023-10-08T06:12:30.877 INFO:teuthology.orchestra.run.smithi032.stdout:093.out 2023-10-08T06:12:30.877 INFO:teuthology.orchestra.run.smithi032.stdout:094 2023-10-08T06:12:30.878 INFO:teuthology.orchestra.run.smithi032.stdout:094.out 2023-10-08T06:12:30.878 INFO:teuthology.orchestra.run.smithi032.stdout:095 2023-10-08T06:12:30.878 INFO:teuthology.orchestra.run.smithi032.stdout:095.out 2023-10-08T06:12:30.878 INFO:teuthology.orchestra.run.smithi032.stdout:096 2023-10-08T06:12:30.878 INFO:teuthology.orchestra.run.smithi032.stdout:096.out 2023-10-08T06:12:30.878 INFO:teuthology.orchestra.run.smithi032.stdout:097 2023-10-08T06:12:30.878 INFO:teuthology.orchestra.run.smithi032.stdout:097.out 2023-10-08T06:12:30.878 INFO:teuthology.orchestra.run.smithi032.stdout:098 2023-10-08T06:12:30.878 INFO:teuthology.orchestra.run.smithi032.stdout:098.out 2023-10-08T06:12:30.878 INFO:teuthology.orchestra.run.smithi032.stdout:099 2023-10-08T06:12:30.878 INFO:teuthology.orchestra.run.smithi032.stdout:099.out 2023-10-08T06:12:30.879 INFO:teuthology.orchestra.run.smithi032.stdout:100 2023-10-08T06:12:30.879 INFO:teuthology.orchestra.run.smithi032.stdout:100.out 2023-10-08T06:12:30.879 INFO:teuthology.orchestra.run.smithi032.stdout:101 2023-10-08T06:12:30.879 INFO:teuthology.orchestra.run.smithi032.stdout:101.out 2023-10-08T06:12:30.879 INFO:teuthology.orchestra.run.smithi032.stdout:102 2023-10-08T06:12:30.879 INFO:teuthology.orchestra.run.smithi032.stdout:102.out 2023-10-08T06:12:30.879 INFO:teuthology.orchestra.run.smithi032.stdout:103 2023-10-08T06:12:30.879 INFO:teuthology.orchestra.run.smithi032.stdout:103.out 2023-10-08T06:12:30.879 INFO:teuthology.orchestra.run.smithi032.stdout:104 2023-10-08T06:12:30.879 INFO:teuthology.orchestra.run.smithi032.stdout:104.out 2023-10-08T06:12:30.879 INFO:teuthology.orchestra.run.smithi032.stdout:105 2023-10-08T06:12:30.879 INFO:teuthology.orchestra.run.smithi032.stdout:105.out 2023-10-08T06:12:30.880 INFO:teuthology.orchestra.run.smithi032.stdout:106 2023-10-08T06:12:30.880 INFO:teuthology.orchestra.run.smithi032.stdout:106.out 2023-10-08T06:12:30.880 INFO:teuthology.orchestra.run.smithi032.stdout:107 2023-10-08T06:12:30.880 INFO:teuthology.orchestra.run.smithi032.stdout:107.out 2023-10-08T06:12:30.880 INFO:teuthology.orchestra.run.smithi032.stdout:108 2023-10-08T06:12:30.880 INFO:teuthology.orchestra.run.smithi032.stdout:108.out 2023-10-08T06:12:30.880 INFO:teuthology.orchestra.run.smithi032.stdout:109 2023-10-08T06:12:30.880 INFO:teuthology.orchestra.run.smithi032.stdout:109.out 2023-10-08T06:12:30.880 INFO:teuthology.orchestra.run.smithi032.stdout:110 2023-10-08T06:12:30.880 INFO:teuthology.orchestra.run.smithi032.stdout:110.out 2023-10-08T06:12:30.880 INFO:teuthology.orchestra.run.smithi032.stdout:111 2023-10-08T06:12:30.881 INFO:teuthology.orchestra.run.smithi032.stdout:111.out 2023-10-08T06:12:30.881 INFO:teuthology.orchestra.run.smithi032.stdout:112 2023-10-08T06:12:30.881 INFO:teuthology.orchestra.run.smithi032.stdout:112.out 2023-10-08T06:12:30.881 INFO:teuthology.orchestra.run.smithi032.stdout:113 2023-10-08T06:12:30.881 INFO:teuthology.orchestra.run.smithi032.stdout:113.out 2023-10-08T06:12:30.881 INFO:teuthology.orchestra.run.smithi032.stdout:114 2023-10-08T06:12:30.881 INFO:teuthology.orchestra.run.smithi032.stdout:114.out 2023-10-08T06:12:30.881 INFO:teuthology.orchestra.run.smithi032.stdout:115 2023-10-08T06:12:30.881 INFO:teuthology.orchestra.run.smithi032.stdout:115.out 2023-10-08T06:12:30.881 INFO:teuthology.orchestra.run.smithi032.stdout:116 2023-10-08T06:12:30.881 INFO:teuthology.orchestra.run.smithi032.stdout:116.out 2023-10-08T06:12:30.881 INFO:teuthology.orchestra.run.smithi032.stdout:117 2023-10-08T06:12:30.882 INFO:teuthology.orchestra.run.smithi032.stdout:117.out 2023-10-08T06:12:30.882 INFO:teuthology.orchestra.run.smithi032.stdout:118 2023-10-08T06:12:30.882 INFO:teuthology.orchestra.run.smithi032.stdout:118.out 2023-10-08T06:12:30.882 INFO:teuthology.orchestra.run.smithi032.stdout:119 2023-10-08T06:12:30.882 INFO:teuthology.orchestra.run.smithi032.stdout:119.out 2023-10-08T06:12:30.882 INFO:teuthology.orchestra.run.smithi032.stdout:120 2023-10-08T06:12:30.882 INFO:teuthology.orchestra.run.smithi032.stdout:120.out 2023-10-08T06:12:30.882 INFO:teuthology.orchestra.run.smithi032.stdout:121 2023-10-08T06:12:30.882 INFO:teuthology.orchestra.run.smithi032.stdout:121.out 2023-10-08T06:12:30.882 INFO:teuthology.orchestra.run.smithi032.stdout:122 2023-10-08T06:12:30.882 INFO:teuthology.orchestra.run.smithi032.stdout:122.out 2023-10-08T06:12:30.882 INFO:teuthology.orchestra.run.smithi032.stdout:123 2023-10-08T06:12:30.883 INFO:teuthology.orchestra.run.smithi032.stdout:123.out 2023-10-08T06:12:30.883 INFO:teuthology.orchestra.run.smithi032.stdout:124 2023-10-08T06:12:30.883 INFO:teuthology.orchestra.run.smithi032.stdout:124.out 2023-10-08T06:12:30.883 INFO:teuthology.orchestra.run.smithi032.stdout:125 2023-10-08T06:12:30.883 INFO:teuthology.orchestra.run.smithi032.stdout:125.out 2023-10-08T06:12:30.883 INFO:teuthology.orchestra.run.smithi032.stdout:126 2023-10-08T06:12:30.883 INFO:teuthology.orchestra.run.smithi032.stdout:126.out 2023-10-08T06:12:30.883 INFO:teuthology.orchestra.run.smithi032.stdout:127 2023-10-08T06:12:30.883 INFO:teuthology.orchestra.run.smithi032.stdout:127.out 2023-10-08T06:12:30.883 INFO:teuthology.orchestra.run.smithi032.stdout:128 2023-10-08T06:12:30.883 INFO:teuthology.orchestra.run.smithi032.stdout:128.out 2023-10-08T06:12:30.883 INFO:teuthology.orchestra.run.smithi032.stdout:129 2023-10-08T06:12:30.884 INFO:teuthology.orchestra.run.smithi032.stdout:129.out 2023-10-08T06:12:30.884 INFO:teuthology.orchestra.run.smithi032.stdout:130 2023-10-08T06:12:30.884 INFO:teuthology.orchestra.run.smithi032.stdout:130.out 2023-10-08T06:12:30.884 INFO:teuthology.orchestra.run.smithi032.stdout:131 2023-10-08T06:12:30.884 INFO:teuthology.orchestra.run.smithi032.stdout:131.out 2023-10-08T06:12:30.884 INFO:teuthology.orchestra.run.smithi032.stdout:132 2023-10-08T06:12:30.884 INFO:teuthology.orchestra.run.smithi032.stdout:132.out 2023-10-08T06:12:30.884 INFO:teuthology.orchestra.run.smithi032.stdout:133 2023-10-08T06:12:30.884 INFO:teuthology.orchestra.run.smithi032.stdout:133.out 2023-10-08T06:12:30.884 INFO:teuthology.orchestra.run.smithi032.stdout:134 2023-10-08T06:12:30.884 INFO:teuthology.orchestra.run.smithi032.stdout:134.out 2023-10-08T06:12:30.885 INFO:teuthology.orchestra.run.smithi032.stdout:135 2023-10-08T06:12:30.885 INFO:teuthology.orchestra.run.smithi032.stdout:135.out 2023-10-08T06:12:30.885 INFO:teuthology.orchestra.run.smithi032.stdout:136 2023-10-08T06:12:30.885 INFO:teuthology.orchestra.run.smithi032.stdout:136.out 2023-10-08T06:12:30.885 INFO:teuthology.orchestra.run.smithi032.stdout:137 2023-10-08T06:12:30.885 INFO:teuthology.orchestra.run.smithi032.stdout:137.out 2023-10-08T06:12:30.885 INFO:teuthology.orchestra.run.smithi032.stdout:138 2023-10-08T06:12:30.885 INFO:teuthology.orchestra.run.smithi032.stdout:138.out 2023-10-08T06:12:30.885 INFO:teuthology.orchestra.run.smithi032.stdout:139 2023-10-08T06:12:30.885 INFO:teuthology.orchestra.run.smithi032.stdout:139.out 2023-10-08T06:12:30.885 INFO:teuthology.orchestra.run.smithi032.stdout:140 2023-10-08T06:12:30.885 INFO:teuthology.orchestra.run.smithi032.stdout:140.out 2023-10-08T06:12:30.886 INFO:teuthology.orchestra.run.smithi032.stdout:141 2023-10-08T06:12:30.886 INFO:teuthology.orchestra.run.smithi032.stdout:141.out 2023-10-08T06:12:30.886 INFO:teuthology.orchestra.run.smithi032.stdout:142 2023-10-08T06:12:30.886 INFO:teuthology.orchestra.run.smithi032.stdout:142.out 2023-10-08T06:12:30.886 INFO:teuthology.orchestra.run.smithi032.stdout:143 2023-10-08T06:12:30.886 INFO:teuthology.orchestra.run.smithi032.stdout:143.out 2023-10-08T06:12:30.886 INFO:teuthology.orchestra.run.smithi032.stdout:144 2023-10-08T06:12:30.886 INFO:teuthology.orchestra.run.smithi032.stdout:144.out 2023-10-08T06:12:30.886 INFO:teuthology.orchestra.run.smithi032.stdout:145 2023-10-08T06:12:30.886 INFO:teuthology.orchestra.run.smithi032.stdout:145.out 2023-10-08T06:12:30.886 INFO:teuthology.orchestra.run.smithi032.stdout:146 2023-10-08T06:12:30.886 INFO:teuthology.orchestra.run.smithi032.stdout:146.out 2023-10-08T06:12:30.887 INFO:teuthology.orchestra.run.smithi032.stdout:147 2023-10-08T06:12:30.887 INFO:teuthology.orchestra.run.smithi032.stdout:147.out 2023-10-08T06:12:30.887 INFO:teuthology.orchestra.run.smithi032.stdout:148 2023-10-08T06:12:30.887 INFO:teuthology.orchestra.run.smithi032.stdout:148.out 2023-10-08T06:12:30.887 INFO:teuthology.orchestra.run.smithi032.stdout:149 2023-10-08T06:12:30.887 INFO:teuthology.orchestra.run.smithi032.stdout:149.out 2023-10-08T06:12:30.887 INFO:teuthology.orchestra.run.smithi032.stdout:150 2023-10-08T06:12:30.887 INFO:teuthology.orchestra.run.smithi032.stdout:150.out 2023-10-08T06:12:30.887 INFO:teuthology.orchestra.run.smithi032.stdout:151 2023-10-08T06:12:30.887 INFO:teuthology.orchestra.run.smithi032.stdout:151.out 2023-10-08T06:12:30.887 INFO:teuthology.orchestra.run.smithi032.stdout:152 2023-10-08T06:12:30.887 INFO:teuthology.orchestra.run.smithi032.stdout:152.out 2023-10-08T06:12:30.887 INFO:teuthology.orchestra.run.smithi032.stdout:153 2023-10-08T06:12:30.888 INFO:teuthology.orchestra.run.smithi032.stdout:153.out 2023-10-08T06:12:30.888 INFO:teuthology.orchestra.run.smithi032.stdout:154 2023-10-08T06:12:30.888 INFO:teuthology.orchestra.run.smithi032.stdout:154.out 2023-10-08T06:12:30.888 INFO:teuthology.orchestra.run.smithi032.stdout:155 2023-10-08T06:12:30.888 INFO:teuthology.orchestra.run.smithi032.stdout:155.out 2023-10-08T06:12:30.888 INFO:teuthology.orchestra.run.smithi032.stdout:156 2023-10-08T06:12:30.888 INFO:teuthology.orchestra.run.smithi032.stdout:156.out 2023-10-08T06:12:30.888 INFO:teuthology.orchestra.run.smithi032.stdout:157 2023-10-08T06:12:30.888 INFO:teuthology.orchestra.run.smithi032.stdout:157.out 2023-10-08T06:12:30.888 INFO:teuthology.orchestra.run.smithi032.stdout:158 2023-10-08T06:12:30.888 INFO:teuthology.orchestra.run.smithi032.stdout:158.out 2023-10-08T06:12:30.888 INFO:teuthology.orchestra.run.smithi032.stdout:159 2023-10-08T06:12:30.889 INFO:teuthology.orchestra.run.smithi032.stdout:159.out 2023-10-08T06:12:30.889 INFO:teuthology.orchestra.run.smithi032.stdout:160 2023-10-08T06:12:30.889 INFO:teuthology.orchestra.run.smithi032.stdout:160.out 2023-10-08T06:12:30.889 INFO:teuthology.orchestra.run.smithi032.stdout:161 2023-10-08T06:12:30.889 INFO:teuthology.orchestra.run.smithi032.stdout:161.out 2023-10-08T06:12:30.889 INFO:teuthology.orchestra.run.smithi032.stdout:162 2023-10-08T06:12:30.889 INFO:teuthology.orchestra.run.smithi032.stdout:162.out 2023-10-08T06:12:30.889 INFO:teuthology.orchestra.run.smithi032.stdout:163 2023-10-08T06:12:30.889 INFO:teuthology.orchestra.run.smithi032.stdout:163.out 2023-10-08T06:12:30.890 INFO:teuthology.orchestra.run.smithi032.stdout:164 2023-10-08T06:12:30.890 INFO:teuthology.orchestra.run.smithi032.stdout:164.out 2023-10-08T06:12:30.890 INFO:teuthology.orchestra.run.smithi032.stdout:165 2023-10-08T06:12:30.890 INFO:teuthology.orchestra.run.smithi032.stdout:165.out 2023-10-08T06:12:30.890 INFO:teuthology.orchestra.run.smithi032.stdout:166 2023-10-08T06:12:30.890 INFO:teuthology.orchestra.run.smithi032.stdout:166.out 2023-10-08T06:12:30.890 INFO:teuthology.orchestra.run.smithi032.stdout:167 2023-10-08T06:12:30.890 INFO:teuthology.orchestra.run.smithi032.stdout:167.out 2023-10-08T06:12:30.890 INFO:teuthology.orchestra.run.smithi032.stdout:168 2023-10-08T06:12:30.890 INFO:teuthology.orchestra.run.smithi032.stdout:168.out 2023-10-08T06:12:30.890 INFO:teuthology.orchestra.run.smithi032.stdout:169 2023-10-08T06:12:30.891 INFO:teuthology.orchestra.run.smithi032.stdout:169.out 2023-10-08T06:12:30.891 INFO:teuthology.orchestra.run.smithi032.stdout:170 2023-10-08T06:12:30.891 INFO:teuthology.orchestra.run.smithi032.stdout:170.out 2023-10-08T06:12:30.891 INFO:teuthology.orchestra.run.smithi032.stdout:171 2023-10-08T06:12:30.891 INFO:teuthology.orchestra.run.smithi032.stdout:171.out 2023-10-08T06:12:30.891 INFO:teuthology.orchestra.run.smithi032.stdout:172 2023-10-08T06:12:30.891 INFO:teuthology.orchestra.run.smithi032.stdout:172.out 2023-10-08T06:12:30.891 INFO:teuthology.orchestra.run.smithi032.stdout:173 2023-10-08T06:12:30.891 INFO:teuthology.orchestra.run.smithi032.stdout:173.out 2023-10-08T06:12:30.891 INFO:teuthology.orchestra.run.smithi032.stdout:174 2023-10-08T06:12:30.891 INFO:teuthology.orchestra.run.smithi032.stdout:174.out 2023-10-08T06:12:30.892 INFO:teuthology.orchestra.run.smithi032.stdout:175 2023-10-08T06:12:30.892 INFO:teuthology.orchestra.run.smithi032.stdout:175.out 2023-10-08T06:12:30.892 INFO:teuthology.orchestra.run.smithi032.stdout:176 2023-10-08T06:12:30.892 INFO:teuthology.orchestra.run.smithi032.stdout:176.out 2023-10-08T06:12:30.892 INFO:teuthology.orchestra.run.smithi032.stdout:177 2023-10-08T06:12:30.892 INFO:teuthology.orchestra.run.smithi032.stdout:177.out 2023-10-08T06:12:30.892 INFO:teuthology.orchestra.run.smithi032.stdout:178 2023-10-08T06:12:30.892 INFO:teuthology.orchestra.run.smithi032.stdout:178.out 2023-10-08T06:12:30.892 INFO:teuthology.orchestra.run.smithi032.stdout:179 2023-10-08T06:12:30.892 INFO:teuthology.orchestra.run.smithi032.stdout:179.out 2023-10-08T06:12:30.892 INFO:teuthology.orchestra.run.smithi032.stdout:180 2023-10-08T06:12:30.892 INFO:teuthology.orchestra.run.smithi032.stdout:180.out 2023-10-08T06:12:30.893 INFO:teuthology.orchestra.run.smithi032.stdout:181 2023-10-08T06:12:30.893 INFO:teuthology.orchestra.run.smithi032.stdout:181.out 2023-10-08T06:12:30.893 INFO:teuthology.orchestra.run.smithi032.stdout:182 2023-10-08T06:12:30.893 INFO:teuthology.orchestra.run.smithi032.stdout:182.out 2023-10-08T06:12:30.893 INFO:teuthology.orchestra.run.smithi032.stdout:183 2023-10-08T06:12:30.893 INFO:teuthology.orchestra.run.smithi032.stdout:183.out 2023-10-08T06:12:30.893 INFO:teuthology.orchestra.run.smithi032.stdout:184 2023-10-08T06:12:30.893 INFO:teuthology.orchestra.run.smithi032.stdout:184.out 2023-10-08T06:12:30.893 INFO:teuthology.orchestra.run.smithi032.stdout:185 2023-10-08T06:12:30.893 INFO:teuthology.orchestra.run.smithi032.stdout:185.out 2023-10-08T06:12:30.893 INFO:teuthology.orchestra.run.smithi032.stdout:186 2023-10-08T06:12:30.893 INFO:teuthology.orchestra.run.smithi032.stdout:186.out 2023-10-08T06:12:30.894 INFO:teuthology.orchestra.run.smithi032.stdout:187 2023-10-08T06:12:30.894 INFO:teuthology.orchestra.run.smithi032.stdout:187.out 2023-10-08T06:12:30.894 INFO:teuthology.orchestra.run.smithi032.stdout:188 2023-10-08T06:12:30.894 INFO:teuthology.orchestra.run.smithi032.stdout:188.out 2023-10-08T06:12:30.894 INFO:teuthology.orchestra.run.smithi032.stdout:189 2023-10-08T06:12:30.894 INFO:teuthology.orchestra.run.smithi032.stdout:189.out 2023-10-08T06:12:30.894 INFO:teuthology.orchestra.run.smithi032.stdout:190 2023-10-08T06:12:30.894 INFO:teuthology.orchestra.run.smithi032.stdout:190.out 2023-10-08T06:12:30.894 INFO:teuthology.orchestra.run.smithi032.stdout:191 2023-10-08T06:12:30.894 INFO:teuthology.orchestra.run.smithi032.stdout:191.out 2023-10-08T06:12:30.894 INFO:teuthology.orchestra.run.smithi032.stdout:192 2023-10-08T06:12:30.894 INFO:teuthology.orchestra.run.smithi032.stdout:192.out 2023-10-08T06:12:30.895 INFO:teuthology.orchestra.run.smithi032.stdout:193 2023-10-08T06:12:30.895 INFO:teuthology.orchestra.run.smithi032.stdout:193.out 2023-10-08T06:12:30.895 INFO:teuthology.orchestra.run.smithi032.stdout:194 2023-10-08T06:12:30.895 INFO:teuthology.orchestra.run.smithi032.stdout:194.out 2023-10-08T06:12:30.895 INFO:teuthology.orchestra.run.smithi032.stdout:195 2023-10-08T06:12:30.895 INFO:teuthology.orchestra.run.smithi032.stdout:195.out 2023-10-08T06:12:30.895 INFO:teuthology.orchestra.run.smithi032.stdout:196 2023-10-08T06:12:30.895 INFO:teuthology.orchestra.run.smithi032.stdout:196.out 2023-10-08T06:12:30.895 INFO:teuthology.orchestra.run.smithi032.stdout:197 2023-10-08T06:12:30.895 INFO:teuthology.orchestra.run.smithi032.stdout:197.out 2023-10-08T06:12:30.895 INFO:teuthology.orchestra.run.smithi032.stdout:198 2023-10-08T06:12:30.895 INFO:teuthology.orchestra.run.smithi032.stdout:198.out 2023-10-08T06:12:30.896 INFO:teuthology.orchestra.run.smithi032.stdout:199 2023-10-08T06:12:30.896 INFO:teuthology.orchestra.run.smithi032.stdout:199.out 2023-10-08T06:12:30.896 INFO:teuthology.orchestra.run.smithi032.stdout:200 2023-10-08T06:12:30.896 INFO:teuthology.orchestra.run.smithi032.stdout:200.out 2023-10-08T06:12:30.896 INFO:teuthology.orchestra.run.smithi032.stdout:201 2023-10-08T06:12:30.896 INFO:teuthology.orchestra.run.smithi032.stdout:201.out 2023-10-08T06:12:30.896 INFO:teuthology.orchestra.run.smithi032.stdout:202 2023-10-08T06:12:30.896 INFO:teuthology.orchestra.run.smithi032.stdout:202.out 2023-10-08T06:12:30.896 INFO:teuthology.orchestra.run.smithi032.stdout:203 2023-10-08T06:12:30.896 INFO:teuthology.orchestra.run.smithi032.stdout:203.out 2023-10-08T06:12:30.896 INFO:teuthology.orchestra.run.smithi032.stdout:204 2023-10-08T06:12:30.896 INFO:teuthology.orchestra.run.smithi032.stdout:204.out 2023-10-08T06:12:30.897 INFO:teuthology.orchestra.run.smithi032.stdout:205 2023-10-08T06:12:30.897 INFO:teuthology.orchestra.run.smithi032.stdout:205.out 2023-10-08T06:12:30.897 INFO:teuthology.orchestra.run.smithi032.stdout:206 2023-10-08T06:12:30.897 INFO:teuthology.orchestra.run.smithi032.stdout:206.out 2023-10-08T06:12:30.897 INFO:teuthology.orchestra.run.smithi032.stdout:207 2023-10-08T06:12:30.897 INFO:teuthology.orchestra.run.smithi032.stdout:207.out 2023-10-08T06:12:30.897 INFO:teuthology.orchestra.run.smithi032.stdout:208 2023-10-08T06:12:30.897 INFO:teuthology.orchestra.run.smithi032.stdout:208.out 2023-10-08T06:12:30.897 INFO:teuthology.orchestra.run.smithi032.stdout:209 2023-10-08T06:12:30.897 INFO:teuthology.orchestra.run.smithi032.stdout:209.out 2023-10-08T06:12:30.897 INFO:teuthology.orchestra.run.smithi032.stdout:210 2023-10-08T06:12:30.898 INFO:teuthology.orchestra.run.smithi032.stdout:210.out 2023-10-08T06:12:30.898 INFO:teuthology.orchestra.run.smithi032.stdout:211 2023-10-08T06:12:30.898 INFO:teuthology.orchestra.run.smithi032.stdout:211.out 2023-10-08T06:12:30.898 INFO:teuthology.orchestra.run.smithi032.stdout:212 2023-10-08T06:12:30.898 INFO:teuthology.orchestra.run.smithi032.stdout:212.out 2023-10-08T06:12:30.898 INFO:teuthology.orchestra.run.smithi032.stdout:213 2023-10-08T06:12:30.898 INFO:teuthology.orchestra.run.smithi032.stdout:213.out 2023-10-08T06:12:30.898 INFO:teuthology.orchestra.run.smithi032.stdout:214 2023-10-08T06:12:30.898 INFO:teuthology.orchestra.run.smithi032.stdout:214.out 2023-10-08T06:12:30.898 INFO:teuthology.orchestra.run.smithi032.stdout:215 2023-10-08T06:12:30.898 INFO:teuthology.orchestra.run.smithi032.stdout:215.out 2023-10-08T06:12:30.898 INFO:teuthology.orchestra.run.smithi032.stdout:216 2023-10-08T06:12:30.899 INFO:teuthology.orchestra.run.smithi032.stdout:216.out 2023-10-08T06:12:30.899 INFO:teuthology.orchestra.run.smithi032.stdout:217 2023-10-08T06:12:30.899 INFO:teuthology.orchestra.run.smithi032.stdout:217.out 2023-10-08T06:12:30.899 INFO:teuthology.orchestra.run.smithi032.stdout:218 2023-10-08T06:12:30.899 INFO:teuthology.orchestra.run.smithi032.stdout:218.out 2023-10-08T06:12:30.899 INFO:teuthology.orchestra.run.smithi032.stdout:219 2023-10-08T06:12:30.899 INFO:teuthology.orchestra.run.smithi032.stdout:219.out 2023-10-08T06:12:30.899 INFO:teuthology.orchestra.run.smithi032.stdout:220 2023-10-08T06:12:30.899 INFO:teuthology.orchestra.run.smithi032.stdout:220.out 2023-10-08T06:12:30.899 INFO:teuthology.orchestra.run.smithi032.stdout:221 2023-10-08T06:12:30.899 INFO:teuthology.orchestra.run.smithi032.stdout:221.out 2023-10-08T06:12:30.899 INFO:teuthology.orchestra.run.smithi032.stdout:222 2023-10-08T06:12:30.900 INFO:teuthology.orchestra.run.smithi032.stdout:222.out 2023-10-08T06:12:30.900 INFO:teuthology.orchestra.run.smithi032.stdout:223 2023-10-08T06:12:30.900 INFO:teuthology.orchestra.run.smithi032.stdout:223.out 2023-10-08T06:12:30.900 INFO:teuthology.orchestra.run.smithi032.stdout:224 2023-10-08T06:12:30.900 INFO:teuthology.orchestra.run.smithi032.stdout:224.out 2023-10-08T06:12:30.900 INFO:teuthology.orchestra.run.smithi032.stdout:225 2023-10-08T06:12:30.900 INFO:teuthology.orchestra.run.smithi032.stdout:225.out 2023-10-08T06:12:30.900 INFO:teuthology.orchestra.run.smithi032.stdout:226 2023-10-08T06:12:30.900 INFO:teuthology.orchestra.run.smithi032.stdout:226.out 2023-10-08T06:12:30.900 INFO:teuthology.orchestra.run.smithi032.stdout:227 2023-10-08T06:12:30.900 INFO:teuthology.orchestra.run.smithi032.stdout:227.out 2023-10-08T06:12:30.900 INFO:teuthology.orchestra.run.smithi032.stdout:228 2023-10-08T06:12:30.901 INFO:teuthology.orchestra.run.smithi032.stdout:228.out 2023-10-08T06:12:30.901 INFO:teuthology.orchestra.run.smithi032.stdout:229 2023-10-08T06:12:30.901 INFO:teuthology.orchestra.run.smithi032.stdout:229.out 2023-10-08T06:12:30.901 INFO:teuthology.orchestra.run.smithi032.stdout:230 2023-10-08T06:12:30.901 INFO:teuthology.orchestra.run.smithi032.stdout:230.out 2023-10-08T06:12:30.901 INFO:teuthology.orchestra.run.smithi032.stdout:231 2023-10-08T06:12:30.901 INFO:teuthology.orchestra.run.smithi032.stdout:231.out 2023-10-08T06:12:30.901 INFO:teuthology.orchestra.run.smithi032.stdout:232 2023-10-08T06:12:30.901 INFO:teuthology.orchestra.run.smithi032.stdout:232.out 2023-10-08T06:12:30.901 INFO:teuthology.orchestra.run.smithi032.stdout:233 2023-10-08T06:12:30.901 INFO:teuthology.orchestra.run.smithi032.stdout:233.out 2023-10-08T06:12:30.901 INFO:teuthology.orchestra.run.smithi032.stdout:234 2023-10-08T06:12:30.901 INFO:teuthology.orchestra.run.smithi032.stdout:234.out 2023-10-08T06:12:30.902 INFO:teuthology.orchestra.run.smithi032.stdout:235 2023-10-08T06:12:30.902 INFO:teuthology.orchestra.run.smithi032.stdout:235.out 2023-10-08T06:12:30.902 INFO:teuthology.orchestra.run.smithi032.stdout:236 2023-10-08T06:12:30.902 INFO:teuthology.orchestra.run.smithi032.stdout:236.out 2023-10-08T06:12:30.902 INFO:teuthology.orchestra.run.smithi032.stdout:237 2023-10-08T06:12:30.902 INFO:teuthology.orchestra.run.smithi032.stdout:237.out 2023-10-08T06:12:30.902 INFO:teuthology.orchestra.run.smithi032.stdout:238 2023-10-08T06:12:30.902 INFO:teuthology.orchestra.run.smithi032.stdout:238.out 2023-10-08T06:12:30.902 INFO:teuthology.orchestra.run.smithi032.stdout:239 2023-10-08T06:12:30.902 INFO:teuthology.orchestra.run.smithi032.stdout:239.out 2023-10-08T06:12:30.902 INFO:teuthology.orchestra.run.smithi032.stdout:240 2023-10-08T06:12:30.903 INFO:teuthology.orchestra.run.smithi032.stdout:240.out 2023-10-08T06:12:30.903 INFO:teuthology.orchestra.run.smithi032.stdout:241 2023-10-08T06:12:30.903 INFO:teuthology.orchestra.run.smithi032.stdout:241.out 2023-10-08T06:12:30.903 INFO:teuthology.orchestra.run.smithi032.stdout:242 2023-10-08T06:12:30.903 INFO:teuthology.orchestra.run.smithi032.stdout:242.out 2023-10-08T06:12:30.903 INFO:teuthology.orchestra.run.smithi032.stdout:243 2023-10-08T06:12:30.903 INFO:teuthology.orchestra.run.smithi032.stdout:243.out 2023-10-08T06:12:30.903 INFO:teuthology.orchestra.run.smithi032.stdout:244 2023-10-08T06:12:30.903 INFO:teuthology.orchestra.run.smithi032.stdout:244.out 2023-10-08T06:12:30.903 INFO:teuthology.orchestra.run.smithi032.stdout:245 2023-10-08T06:12:30.903 INFO:teuthology.orchestra.run.smithi032.stdout:245.out 2023-10-08T06:12:30.903 INFO:teuthology.orchestra.run.smithi032.stdout:246 2023-10-08T06:12:30.903 INFO:teuthology.orchestra.run.smithi032.stdout:246.out 2023-10-08T06:12:30.904 INFO:teuthology.orchestra.run.smithi032.stdout:247 2023-10-08T06:12:30.904 INFO:teuthology.orchestra.run.smithi032.stdout:247.out 2023-10-08T06:12:30.904 INFO:teuthology.orchestra.run.smithi032.stdout:248 2023-10-08T06:12:30.904 INFO:teuthology.orchestra.run.smithi032.stdout:248.out 2023-10-08T06:12:30.904 INFO:teuthology.orchestra.run.smithi032.stdout:249 2023-10-08T06:12:30.904 INFO:teuthology.orchestra.run.smithi032.stdout:249.out 2023-10-08T06:12:30.904 INFO:teuthology.orchestra.run.smithi032.stdout:250 2023-10-08T06:12:30.904 INFO:teuthology.orchestra.run.smithi032.stdout:250.out 2023-10-08T06:12:30.904 INFO:teuthology.orchestra.run.smithi032.stdout:251 2023-10-08T06:12:30.904 INFO:teuthology.orchestra.run.smithi032.stdout:251.out 2023-10-08T06:12:30.904 INFO:teuthology.orchestra.run.smithi032.stdout:252 2023-10-08T06:12:30.904 INFO:teuthology.orchestra.run.smithi032.stdout:252.out 2023-10-08T06:12:30.905 INFO:teuthology.orchestra.run.smithi032.stdout:253 2023-10-08T06:12:30.905 INFO:teuthology.orchestra.run.smithi032.stdout:253.out 2023-10-08T06:12:30.905 INFO:teuthology.orchestra.run.smithi032.stdout:254 2023-10-08T06:12:30.905 INFO:teuthology.orchestra.run.smithi032.stdout:254.out 2023-10-08T06:12:30.905 INFO:teuthology.orchestra.run.smithi032.stdout:255 2023-10-08T06:12:30.905 INFO:teuthology.orchestra.run.smithi032.stdout:255.out 2023-10-08T06:12:30.905 INFO:teuthology.orchestra.run.smithi032.stdout:256 2023-10-08T06:12:30.905 INFO:teuthology.orchestra.run.smithi032.stdout:256.out 2023-10-08T06:12:30.905 INFO:teuthology.orchestra.run.smithi032.stdout:257 2023-10-08T06:12:30.905 INFO:teuthology.orchestra.run.smithi032.stdout:257.out 2023-10-08T06:12:30.905 INFO:teuthology.orchestra.run.smithi032.stdout:258 2023-10-08T06:12:30.905 INFO:teuthology.orchestra.run.smithi032.stdout:258.out 2023-10-08T06:12:30.906 INFO:teuthology.orchestra.run.smithi032.stdout:259 2023-10-08T06:12:30.906 INFO:teuthology.orchestra.run.smithi032.stdout:259.out 2023-10-08T06:12:30.906 INFO:teuthology.orchestra.run.smithi032.stdout:260 2023-10-08T06:12:30.906 INFO:teuthology.orchestra.run.smithi032.stdout:260.out 2023-10-08T06:12:30.906 INFO:teuthology.orchestra.run.smithi032.stdout:261 2023-10-08T06:12:30.906 INFO:teuthology.orchestra.run.smithi032.stdout:261.out 2023-10-08T06:12:30.906 INFO:teuthology.orchestra.run.smithi032.stdout:262 2023-10-08T06:12:30.906 INFO:teuthology.orchestra.run.smithi032.stdout:262.out 2023-10-08T06:12:30.906 INFO:teuthology.orchestra.run.smithi032.stdout:263 2023-10-08T06:12:30.906 INFO:teuthology.orchestra.run.smithi032.stdout:263.out 2023-10-08T06:12:30.906 INFO:teuthology.orchestra.run.smithi032.stdout:264 2023-10-08T06:12:30.906 INFO:teuthology.orchestra.run.smithi032.stdout:264.out 2023-10-08T06:12:30.907 INFO:teuthology.orchestra.run.smithi032.stdout:265 2023-10-08T06:12:30.907 INFO:teuthology.orchestra.run.smithi032.stdout:265.out 2023-10-08T06:12:30.907 INFO:teuthology.orchestra.run.smithi032.stdout:266 2023-10-08T06:12:30.907 INFO:teuthology.orchestra.run.smithi032.stdout:266.out 2023-10-08T06:12:30.907 INFO:teuthology.orchestra.run.smithi032.stdout:267 2023-10-08T06:12:30.907 INFO:teuthology.orchestra.run.smithi032.stdout:267.out 2023-10-08T06:12:30.907 INFO:teuthology.orchestra.run.smithi032.stdout:268 2023-10-08T06:12:30.907 INFO:teuthology.orchestra.run.smithi032.stdout:268.out 2023-10-08T06:12:30.907 INFO:teuthology.orchestra.run.smithi032.stdout:269 2023-10-08T06:12:30.907 INFO:teuthology.orchestra.run.smithi032.stdout:269.out 2023-10-08T06:12:30.907 INFO:teuthology.orchestra.run.smithi032.stdout:270 2023-10-08T06:12:30.907 INFO:teuthology.orchestra.run.smithi032.stdout:270.out 2023-10-08T06:12:30.907 INFO:teuthology.orchestra.run.smithi032.stdout:271 2023-10-08T06:12:30.908 INFO:teuthology.orchestra.run.smithi032.stdout:271.out 2023-10-08T06:12:30.908 INFO:teuthology.orchestra.run.smithi032.stdout:272 2023-10-08T06:12:30.908 INFO:teuthology.orchestra.run.smithi032.stdout:272.out 2023-10-08T06:12:30.908 INFO:teuthology.orchestra.run.smithi032.stdout:273 2023-10-08T06:12:30.908 INFO:teuthology.orchestra.run.smithi032.stdout:273.out 2023-10-08T06:12:30.908 INFO:teuthology.orchestra.run.smithi032.stdout:274 2023-10-08T06:12:30.908 INFO:teuthology.orchestra.run.smithi032.stdout:274.out 2023-10-08T06:12:30.908 INFO:teuthology.orchestra.run.smithi032.stdout:275 2023-10-08T06:12:30.908 INFO:teuthology.orchestra.run.smithi032.stdout:275.out 2023-10-08T06:12:30.908 INFO:teuthology.orchestra.run.smithi032.stdout:276 2023-10-08T06:12:30.908 INFO:teuthology.orchestra.run.smithi032.stdout:276.out 2023-10-08T06:12:30.908 INFO:teuthology.orchestra.run.smithi032.stdout:277 2023-10-08T06:12:30.909 INFO:teuthology.orchestra.run.smithi032.stdout:277.out 2023-10-08T06:12:30.909 INFO:teuthology.orchestra.run.smithi032.stdout:278 2023-10-08T06:12:30.909 INFO:teuthology.orchestra.run.smithi032.stdout:278.out 2023-10-08T06:12:30.909 INFO:teuthology.orchestra.run.smithi032.stdout:279 2023-10-08T06:12:30.909 INFO:teuthology.orchestra.run.smithi032.stdout:279.out 2023-10-08T06:12:30.909 INFO:teuthology.orchestra.run.smithi032.stdout:280 2023-10-08T06:12:30.909 INFO:teuthology.orchestra.run.smithi032.stdout:280.out 2023-10-08T06:12:30.909 INFO:teuthology.orchestra.run.smithi032.stdout:281 2023-10-08T06:12:30.909 INFO:teuthology.orchestra.run.smithi032.stdout:281.out 2023-10-08T06:12:30.909 INFO:teuthology.orchestra.run.smithi032.stdout:282 2023-10-08T06:12:30.909 INFO:teuthology.orchestra.run.smithi032.stdout:282.out 2023-10-08T06:12:30.909 INFO:teuthology.orchestra.run.smithi032.stdout:283 2023-10-08T06:12:30.910 INFO:teuthology.orchestra.run.smithi032.stdout:283.out 2023-10-08T06:12:30.910 INFO:teuthology.orchestra.run.smithi032.stdout:284 2023-10-08T06:12:30.910 INFO:teuthology.orchestra.run.smithi032.stdout:284.out 2023-10-08T06:12:30.910 INFO:teuthology.orchestra.run.smithi032.stdout:285 2023-10-08T06:12:30.910 INFO:teuthology.orchestra.run.smithi032.stdout:285.out 2023-10-08T06:12:30.910 INFO:teuthology.orchestra.run.smithi032.stdout:286 2023-10-08T06:12:30.910 INFO:teuthology.orchestra.run.smithi032.stdout:286.out 2023-10-08T06:12:30.910 INFO:teuthology.orchestra.run.smithi032.stdout:287 2023-10-08T06:12:30.910 INFO:teuthology.orchestra.run.smithi032.stdout:287.out 2023-10-08T06:12:30.910 INFO:teuthology.orchestra.run.smithi032.stdout:288 2023-10-08T06:12:30.910 INFO:teuthology.orchestra.run.smithi032.stdout:288.out 2023-10-08T06:12:30.911 INFO:teuthology.orchestra.run.smithi032.stdout:289 2023-10-08T06:12:30.911 INFO:teuthology.orchestra.run.smithi032.stdout:289.out 2023-10-08T06:12:30.911 INFO:teuthology.orchestra.run.smithi032.stdout:290 2023-10-08T06:12:30.911 INFO:teuthology.orchestra.run.smithi032.stdout:290.out 2023-10-08T06:12:30.911 INFO:teuthology.orchestra.run.smithi032.stdout:291 2023-10-08T06:12:30.911 INFO:teuthology.orchestra.run.smithi032.stdout:291.out 2023-10-08T06:12:30.911 INFO:teuthology.orchestra.run.smithi032.stdout:292 2023-10-08T06:12:30.911 INFO:teuthology.orchestra.run.smithi032.stdout:292.out 2023-10-08T06:12:30.911 INFO:teuthology.orchestra.run.smithi032.stdout:293 2023-10-08T06:12:30.911 INFO:teuthology.orchestra.run.smithi032.stdout:293.out 2023-10-08T06:12:30.913 INFO:teuthology.orchestra.run.smithi032.stdout:294 2023-10-08T06:12:30.913 INFO:teuthology.orchestra.run.smithi032.stdout:294.out 2023-10-08T06:12:30.913 INFO:teuthology.orchestra.run.smithi032.stdout:295 2023-10-08T06:12:30.913 INFO:teuthology.orchestra.run.smithi032.stdout:295.out 2023-10-08T06:12:30.913 INFO:teuthology.orchestra.run.smithi032.stdout:296 2023-10-08T06:12:30.913 INFO:teuthology.orchestra.run.smithi032.stdout:296.out 2023-10-08T06:12:30.913 INFO:teuthology.orchestra.run.smithi032.stdout:297 2023-10-08T06:12:30.913 INFO:teuthology.orchestra.run.smithi032.stdout:297.out 2023-10-08T06:12:30.913 INFO:teuthology.orchestra.run.smithi032.stdout:298 2023-10-08T06:12:30.913 INFO:teuthology.orchestra.run.smithi032.stdout:298.out 2023-10-08T06:12:30.914 INFO:teuthology.orchestra.run.smithi032.stdout:299 2023-10-08T06:12:30.914 INFO:teuthology.orchestra.run.smithi032.stdout:299.out 2023-10-08T06:12:30.914 INFO:teuthology.orchestra.run.smithi032.stdout:300 2023-10-08T06:12:30.914 INFO:teuthology.orchestra.run.smithi032.stdout:300.out 2023-10-08T06:12:30.914 INFO:teuthology.orchestra.run.smithi032.stdout:301 2023-10-08T06:12:30.914 INFO:teuthology.orchestra.run.smithi032.stdout:301.out 2023-10-08T06:12:30.914 INFO:teuthology.orchestra.run.smithi032.stdout:302 2023-10-08T06:12:30.914 INFO:teuthology.orchestra.run.smithi032.stdout:302.out 2023-10-08T06:12:30.914 INFO:teuthology.orchestra.run.smithi032.stdout:303 2023-10-08T06:12:30.914 INFO:teuthology.orchestra.run.smithi032.stdout:303.out 2023-10-08T06:12:30.914 INFO:teuthology.orchestra.run.smithi032.stdout:304 2023-10-08T06:12:30.914 INFO:teuthology.orchestra.run.smithi032.stdout:304.out 2023-10-08T06:12:30.915 INFO:teuthology.orchestra.run.smithi032.stdout:305 2023-10-08T06:12:30.915 INFO:teuthology.orchestra.run.smithi032.stdout:305.out 2023-10-08T06:12:30.915 INFO:teuthology.orchestra.run.smithi032.stdout:306 2023-10-08T06:12:30.915 INFO:teuthology.orchestra.run.smithi032.stdout:306.out 2023-10-08T06:12:30.915 INFO:teuthology.orchestra.run.smithi032.stdout:307 2023-10-08T06:12:30.915 INFO:teuthology.orchestra.run.smithi032.stdout:307.out 2023-10-08T06:12:30.915 INFO:teuthology.orchestra.run.smithi032.stdout:308 2023-10-08T06:12:30.915 INFO:teuthology.orchestra.run.smithi032.stdout:308.out 2023-10-08T06:12:30.915 INFO:teuthology.orchestra.run.smithi032.stdout:309 2023-10-08T06:12:30.915 INFO:teuthology.orchestra.run.smithi032.stdout:309.out 2023-10-08T06:12:30.915 INFO:teuthology.orchestra.run.smithi032.stdout:310 2023-10-08T06:12:30.915 INFO:teuthology.orchestra.run.smithi032.stdout:310.out 2023-10-08T06:12:30.915 INFO:teuthology.orchestra.run.smithi032.stdout:311 2023-10-08T06:12:30.916 INFO:teuthology.orchestra.run.smithi032.stdout:311.out 2023-10-08T06:12:30.916 INFO:teuthology.orchestra.run.smithi032.stdout:312 2023-10-08T06:12:30.916 INFO:teuthology.orchestra.run.smithi032.stdout:312.out 2023-10-08T06:12:30.916 INFO:teuthology.orchestra.run.smithi032.stdout:313 2023-10-08T06:12:30.916 INFO:teuthology.orchestra.run.smithi032.stdout:313.out 2023-10-08T06:12:30.916 INFO:teuthology.orchestra.run.smithi032.stdout:314 2023-10-08T06:12:30.916 INFO:teuthology.orchestra.run.smithi032.stdout:314.out 2023-10-08T06:12:30.916 INFO:teuthology.orchestra.run.smithi032.stdout:315 2023-10-08T06:12:30.916 INFO:teuthology.orchestra.run.smithi032.stdout:315.out 2023-10-08T06:12:30.916 INFO:teuthology.orchestra.run.smithi032.stdout:316 2023-10-08T06:12:30.916 INFO:teuthology.orchestra.run.smithi032.stdout:316.out 2023-10-08T06:12:30.916 INFO:teuthology.orchestra.run.smithi032.stdout:317 2023-10-08T06:12:30.917 INFO:teuthology.orchestra.run.smithi032.stdout:317.out 2023-10-08T06:12:30.917 INFO:teuthology.orchestra.run.smithi032.stdout:318 2023-10-08T06:12:30.917 INFO:teuthology.orchestra.run.smithi032.stdout:318.out 2023-10-08T06:12:30.917 INFO:teuthology.orchestra.run.smithi032.stdout:319 2023-10-08T06:12:30.917 INFO:teuthology.orchestra.run.smithi032.stdout:319.out 2023-10-08T06:12:30.917 INFO:teuthology.orchestra.run.smithi032.stdout:320 2023-10-08T06:12:30.917 INFO:teuthology.orchestra.run.smithi032.stdout:320.out 2023-10-08T06:12:30.917 INFO:teuthology.orchestra.run.smithi032.stdout:321 2023-10-08T06:12:30.917 INFO:teuthology.orchestra.run.smithi032.stdout:321.out 2023-10-08T06:12:30.917 INFO:teuthology.orchestra.run.smithi032.stdout:322 2023-10-08T06:12:30.917 INFO:teuthology.orchestra.run.smithi032.stdout:322.out 2023-10-08T06:12:30.917 INFO:teuthology.orchestra.run.smithi032.stdout:323 2023-10-08T06:12:30.918 INFO:teuthology.orchestra.run.smithi032.stdout:323.out 2023-10-08T06:12:30.918 INFO:teuthology.orchestra.run.smithi032.stdout:324 2023-10-08T06:12:30.918 INFO:teuthology.orchestra.run.smithi032.stdout:324.out 2023-10-08T06:12:30.918 INFO:teuthology.orchestra.run.smithi032.stdout:325 2023-10-08T06:12:30.918 INFO:teuthology.orchestra.run.smithi032.stdout:325.out 2023-10-08T06:12:30.918 INFO:teuthology.orchestra.run.smithi032.stdout:326 2023-10-08T06:12:30.918 INFO:teuthology.orchestra.run.smithi032.stdout:326.out 2023-10-08T06:12:30.918 INFO:teuthology.orchestra.run.smithi032.stdout:327 2023-10-08T06:12:30.918 INFO:teuthology.orchestra.run.smithi032.stdout:327.out 2023-10-08T06:12:30.918 INFO:teuthology.orchestra.run.smithi032.stdout:328 2023-10-08T06:12:30.918 INFO:teuthology.orchestra.run.smithi032.stdout:328.out 2023-10-08T06:12:30.918 INFO:teuthology.orchestra.run.smithi032.stdout:329 2023-10-08T06:12:30.919 INFO:teuthology.orchestra.run.smithi032.stdout:329.out 2023-10-08T06:12:30.919 INFO:teuthology.orchestra.run.smithi032.stdout:330 2023-10-08T06:12:30.919 INFO:teuthology.orchestra.run.smithi032.stdout:330.out 2023-10-08T06:12:30.919 INFO:teuthology.orchestra.run.smithi032.stdout:331 2023-10-08T06:12:30.919 INFO:teuthology.orchestra.run.smithi032.stdout:331.out 2023-10-08T06:12:30.919 INFO:teuthology.orchestra.run.smithi032.stdout:332 2023-10-08T06:12:30.919 INFO:teuthology.orchestra.run.smithi032.stdout:332.out 2023-10-08T06:12:30.919 INFO:teuthology.orchestra.run.smithi032.stdout:333 2023-10-08T06:12:30.919 INFO:teuthology.orchestra.run.smithi032.stdout:333.out 2023-10-08T06:12:30.919 INFO:teuthology.orchestra.run.smithi032.stdout:334 2023-10-08T06:12:30.919 INFO:teuthology.orchestra.run.smithi032.stdout:334.out 2023-10-08T06:12:30.920 INFO:teuthology.orchestra.run.smithi032.stdout:335 2023-10-08T06:12:30.920 INFO:teuthology.orchestra.run.smithi032.stdout:335.out 2023-10-08T06:12:30.920 INFO:teuthology.orchestra.run.smithi032.stdout:336 2023-10-08T06:12:30.920 INFO:teuthology.orchestra.run.smithi032.stdout:336.out 2023-10-08T06:12:30.920 INFO:teuthology.orchestra.run.smithi032.stdout:337 2023-10-08T06:12:30.920 INFO:teuthology.orchestra.run.smithi032.stdout:337.out 2023-10-08T06:12:30.920 INFO:teuthology.orchestra.run.smithi032.stdout:338 2023-10-08T06:12:30.920 INFO:teuthology.orchestra.run.smithi032.stdout:338.out 2023-10-08T06:12:30.920 INFO:teuthology.orchestra.run.smithi032.stdout:339 2023-10-08T06:12:30.920 INFO:teuthology.orchestra.run.smithi032.stdout:339.out 2023-10-08T06:12:30.920 INFO:teuthology.orchestra.run.smithi032.stdout:340 2023-10-08T06:12:30.920 INFO:teuthology.orchestra.run.smithi032.stdout:340.out 2023-10-08T06:12:30.921 INFO:teuthology.orchestra.run.smithi032.stdout:341 2023-10-08T06:12:30.921 INFO:teuthology.orchestra.run.smithi032.stdout:341.out 2023-10-08T06:12:30.921 INFO:teuthology.orchestra.run.smithi032.stdout:342 2023-10-08T06:12:30.921 INFO:teuthology.orchestra.run.smithi032.stdout:342.out 2023-10-08T06:12:30.921 INFO:teuthology.orchestra.run.smithi032.stdout:343 2023-10-08T06:12:30.921 INFO:teuthology.orchestra.run.smithi032.stdout:343.out 2023-10-08T06:12:30.921 INFO:teuthology.orchestra.run.smithi032.stdout:344 2023-10-08T06:12:30.921 INFO:teuthology.orchestra.run.smithi032.stdout:344.out 2023-10-08T06:12:30.921 INFO:teuthology.orchestra.run.smithi032.stdout:345 2023-10-08T06:12:30.921 INFO:teuthology.orchestra.run.smithi032.stdout:345.out 2023-10-08T06:12:30.921 INFO:teuthology.orchestra.run.smithi032.stdout:346 2023-10-08T06:12:30.922 INFO:teuthology.orchestra.run.smithi032.stdout:346.out 2023-10-08T06:12:30.922 INFO:teuthology.orchestra.run.smithi032.stdout:347 2023-10-08T06:12:30.922 INFO:teuthology.orchestra.run.smithi032.stdout:347.out 2023-10-08T06:12:30.922 INFO:teuthology.orchestra.run.smithi032.stdout:348 2023-10-08T06:12:30.922 INFO:teuthology.orchestra.run.smithi032.stdout:348.out 2023-10-08T06:12:30.922 INFO:teuthology.orchestra.run.smithi032.stdout:349 2023-10-08T06:12:30.922 INFO:teuthology.orchestra.run.smithi032.stdout:349.out 2023-10-08T06:12:30.922 INFO:teuthology.orchestra.run.smithi032.stdout:350 2023-10-08T06:12:30.922 INFO:teuthology.orchestra.run.smithi032.stdout:350.out 2023-10-08T06:12:30.922 INFO:teuthology.orchestra.run.smithi032.stdout:351 2023-10-08T06:12:30.922 INFO:teuthology.orchestra.run.smithi032.stdout:351.out 2023-10-08T06:12:30.922 INFO:teuthology.orchestra.run.smithi032.stdout:352 2023-10-08T06:12:30.923 INFO:teuthology.orchestra.run.smithi032.stdout:352.out 2023-10-08T06:12:30.923 INFO:teuthology.orchestra.run.smithi032.stdout:353 2023-10-08T06:12:30.923 INFO:teuthology.orchestra.run.smithi032.stdout:353.out 2023-10-08T06:12:30.923 INFO:teuthology.orchestra.run.smithi032.stdout:354 2023-10-08T06:12:30.923 INFO:teuthology.orchestra.run.smithi032.stdout:354.out 2023-10-08T06:12:30.923 INFO:teuthology.orchestra.run.smithi032.stdout:355 2023-10-08T06:12:30.923 INFO:teuthology.orchestra.run.smithi032.stdout:355.out 2023-10-08T06:12:30.923 INFO:teuthology.orchestra.run.smithi032.stdout:356 2023-10-08T06:12:30.923 INFO:teuthology.orchestra.run.smithi032.stdout:356.out 2023-10-08T06:12:30.923 INFO:teuthology.orchestra.run.smithi032.stdout:357 2023-10-08T06:12:30.923 INFO:teuthology.orchestra.run.smithi032.stdout:357.out 2023-10-08T06:12:30.923 INFO:teuthology.orchestra.run.smithi032.stdout:358 2023-10-08T06:12:30.923 INFO:teuthology.orchestra.run.smithi032.stdout:358.out 2023-10-08T06:12:30.924 INFO:teuthology.orchestra.run.smithi032.stdout:359 2023-10-08T06:12:30.924 INFO:teuthology.orchestra.run.smithi032.stdout:359.out 2023-10-08T06:12:30.924 INFO:teuthology.orchestra.run.smithi032.stdout:360 2023-10-08T06:12:30.924 INFO:teuthology.orchestra.run.smithi032.stdout:360.out 2023-10-08T06:12:30.924 INFO:teuthology.orchestra.run.smithi032.stdout:361 2023-10-08T06:12:30.924 INFO:teuthology.orchestra.run.smithi032.stdout:361.out 2023-10-08T06:12:30.924 INFO:teuthology.orchestra.run.smithi032.stdout:362 2023-10-08T06:12:30.924 INFO:teuthology.orchestra.run.smithi032.stdout:362.out 2023-10-08T06:12:30.924 INFO:teuthology.orchestra.run.smithi032.stdout:363 2023-10-08T06:12:30.924 INFO:teuthology.orchestra.run.smithi032.stdout:363.out 2023-10-08T06:12:30.924 INFO:teuthology.orchestra.run.smithi032.stdout:364 2023-10-08T06:12:30.924 INFO:teuthology.orchestra.run.smithi032.stdout:364.out 2023-10-08T06:12:30.925 INFO:teuthology.orchestra.run.smithi032.stdout:365 2023-10-08T06:12:30.925 INFO:teuthology.orchestra.run.smithi032.stdout:365.out 2023-10-08T06:12:30.925 INFO:teuthology.orchestra.run.smithi032.stdout:366 2023-10-08T06:12:30.925 INFO:teuthology.orchestra.run.smithi032.stdout:366.out 2023-10-08T06:12:30.925 INFO:teuthology.orchestra.run.smithi032.stdout:367 2023-10-08T06:12:30.925 INFO:teuthology.orchestra.run.smithi032.stdout:367.out 2023-10-08T06:12:30.925 INFO:teuthology.orchestra.run.smithi032.stdout:368 2023-10-08T06:12:30.925 INFO:teuthology.orchestra.run.smithi032.stdout:368.out 2023-10-08T06:12:30.925 INFO:teuthology.orchestra.run.smithi032.stdout:369 2023-10-08T06:12:30.925 INFO:teuthology.orchestra.run.smithi032.stdout:369.out 2023-10-08T06:12:30.925 INFO:teuthology.orchestra.run.smithi032.stdout:370 2023-10-08T06:12:30.925 INFO:teuthology.orchestra.run.smithi032.stdout:370.out 2023-10-08T06:12:30.926 INFO:teuthology.orchestra.run.smithi032.stdout:371 2023-10-08T06:12:30.926 INFO:teuthology.orchestra.run.smithi032.stdout:371.out 2023-10-08T06:12:30.926 INFO:teuthology.orchestra.run.smithi032.stdout:372 2023-10-08T06:12:30.926 INFO:teuthology.orchestra.run.smithi032.stdout:372.out 2023-10-08T06:12:30.926 INFO:teuthology.orchestra.run.smithi032.stdout:373 2023-10-08T06:12:30.926 INFO:teuthology.orchestra.run.smithi032.stdout:373.out 2023-10-08T06:12:30.926 INFO:teuthology.orchestra.run.smithi032.stdout:374 2023-10-08T06:12:30.926 INFO:teuthology.orchestra.run.smithi032.stdout:374.out 2023-10-08T06:12:30.926 INFO:teuthology.orchestra.run.smithi032.stdout:375 2023-10-08T06:12:30.926 INFO:teuthology.orchestra.run.smithi032.stdout:375.out 2023-10-08T06:12:30.926 INFO:teuthology.orchestra.run.smithi032.stdout:376 2023-10-08T06:12:30.926 INFO:teuthology.orchestra.run.smithi032.stdout:376.out 2023-10-08T06:12:30.927 INFO:teuthology.orchestra.run.smithi032.stdout:377 2023-10-08T06:12:30.927 INFO:teuthology.orchestra.run.smithi032.stdout:377.out 2023-10-08T06:12:30.927 INFO:teuthology.orchestra.run.smithi032.stdout:378 2023-10-08T06:12:30.927 INFO:teuthology.orchestra.run.smithi032.stdout:378.out 2023-10-08T06:12:30.927 INFO:teuthology.orchestra.run.smithi032.stdout:379 2023-10-08T06:12:30.927 INFO:teuthology.orchestra.run.smithi032.stdout:379.out 2023-10-08T06:12:30.927 INFO:teuthology.orchestra.run.smithi032.stdout:380 2023-10-08T06:12:30.927 INFO:teuthology.orchestra.run.smithi032.stdout:380.out 2023-10-08T06:12:30.927 INFO:teuthology.orchestra.run.smithi032.stdout:381 2023-10-08T06:12:30.927 INFO:teuthology.orchestra.run.smithi032.stdout:381.out 2023-10-08T06:12:30.927 INFO:teuthology.orchestra.run.smithi032.stdout:382 2023-10-08T06:12:30.928 INFO:teuthology.orchestra.run.smithi032.stdout:382.out 2023-10-08T06:12:30.928 INFO:teuthology.orchestra.run.smithi032.stdout:383 2023-10-08T06:12:30.928 INFO:teuthology.orchestra.run.smithi032.stdout:383.out 2023-10-08T06:12:30.928 INFO:teuthology.orchestra.run.smithi032.stdout:384 2023-10-08T06:12:30.928 INFO:teuthology.orchestra.run.smithi032.stdout:384.out 2023-10-08T06:12:30.928 INFO:teuthology.orchestra.run.smithi032.stdout:385 2023-10-08T06:12:30.928 INFO:teuthology.orchestra.run.smithi032.stdout:385.out 2023-10-08T06:12:30.928 INFO:teuthology.orchestra.run.smithi032.stdout:386 2023-10-08T06:12:30.928 INFO:teuthology.orchestra.run.smithi032.stdout:386.out 2023-10-08T06:12:30.928 INFO:teuthology.orchestra.run.smithi032.stdout:387 2023-10-08T06:12:30.928 INFO:teuthology.orchestra.run.smithi032.stdout:387.out 2023-10-08T06:12:30.928 INFO:teuthology.orchestra.run.smithi032.stdout:388 2023-10-08T06:12:30.928 INFO:teuthology.orchestra.run.smithi032.stdout:388.out 2023-10-08T06:12:30.929 INFO:teuthology.orchestra.run.smithi032.stdout:389 2023-10-08T06:12:30.929 INFO:teuthology.orchestra.run.smithi032.stdout:389.out 2023-10-08T06:12:30.929 INFO:teuthology.orchestra.run.smithi032.stdout:390 2023-10-08T06:12:30.929 INFO:teuthology.orchestra.run.smithi032.stdout:390.out 2023-10-08T06:12:30.929 INFO:teuthology.orchestra.run.smithi032.stdout:391 2023-10-08T06:12:30.929 INFO:teuthology.orchestra.run.smithi032.stdout:391.out 2023-10-08T06:12:30.929 INFO:teuthology.orchestra.run.smithi032.stdout:392 2023-10-08T06:12:30.929 INFO:teuthology.orchestra.run.smithi032.stdout:392.out 2023-10-08T06:12:30.929 INFO:teuthology.orchestra.run.smithi032.stdout:393 2023-10-08T06:12:30.929 INFO:teuthology.orchestra.run.smithi032.stdout:393.out 2023-10-08T06:12:30.929 INFO:teuthology.orchestra.run.smithi032.stdout:394 2023-10-08T06:12:30.929 INFO:teuthology.orchestra.run.smithi032.stdout:394.out 2023-10-08T06:12:30.930 INFO:teuthology.orchestra.run.smithi032.stdout:395 2023-10-08T06:12:30.930 INFO:teuthology.orchestra.run.smithi032.stdout:395.out 2023-10-08T06:12:30.930 INFO:teuthology.orchestra.run.smithi032.stdout:396 2023-10-08T06:12:30.930 INFO:teuthology.orchestra.run.smithi032.stdout:396.out 2023-10-08T06:12:30.930 INFO:teuthology.orchestra.run.smithi032.stdout:397 2023-10-08T06:12:30.930 INFO:teuthology.orchestra.run.smithi032.stdout:397.out 2023-10-08T06:12:30.930 INFO:teuthology.orchestra.run.smithi032.stdout:398 2023-10-08T06:12:30.930 INFO:teuthology.orchestra.run.smithi032.stdout:398.out 2023-10-08T06:12:30.930 INFO:teuthology.orchestra.run.smithi032.stdout:399 2023-10-08T06:12:30.930 INFO:teuthology.orchestra.run.smithi032.stdout:399.out 2023-10-08T06:12:30.930 INFO:teuthology.orchestra.run.smithi032.stdout:400 2023-10-08T06:12:30.930 INFO:teuthology.orchestra.run.smithi032.stdout:400.out 2023-10-08T06:12:30.931 INFO:teuthology.orchestra.run.smithi032.stdout:401 2023-10-08T06:12:30.931 INFO:teuthology.orchestra.run.smithi032.stdout:401.out 2023-10-08T06:12:30.931 INFO:teuthology.orchestra.run.smithi032.stdout:402 2023-10-08T06:12:30.931 INFO:teuthology.orchestra.run.smithi032.stdout:402.out 2023-10-08T06:12:30.931 INFO:teuthology.orchestra.run.smithi032.stdout:403 2023-10-08T06:12:30.931 INFO:teuthology.orchestra.run.smithi032.stdout:403.out 2023-10-08T06:12:30.931 INFO:teuthology.orchestra.run.smithi032.stdout:404 2023-10-08T06:12:30.931 INFO:teuthology.orchestra.run.smithi032.stdout:404.out 2023-10-08T06:12:30.931 INFO:teuthology.orchestra.run.smithi032.stdout:405 2023-10-08T06:12:30.931 INFO:teuthology.orchestra.run.smithi032.stdout:405.out 2023-10-08T06:12:30.931 INFO:teuthology.orchestra.run.smithi032.stdout:406 2023-10-08T06:12:30.931 INFO:teuthology.orchestra.run.smithi032.stdout:406.out 2023-10-08T06:12:30.931 INFO:teuthology.orchestra.run.smithi032.stdout:407 2023-10-08T06:12:30.932 INFO:teuthology.orchestra.run.smithi032.stdout:407.out 2023-10-08T06:12:30.932 INFO:teuthology.orchestra.run.smithi032.stdout:408 2023-10-08T06:12:30.932 INFO:teuthology.orchestra.run.smithi032.stdout:408.out 2023-10-08T06:12:30.932 INFO:teuthology.orchestra.run.smithi032.stdout:409 2023-10-08T06:12:30.932 INFO:teuthology.orchestra.run.smithi032.stdout:409.out 2023-10-08T06:12:30.932 INFO:teuthology.orchestra.run.smithi032.stdout:410 2023-10-08T06:12:30.932 INFO:teuthology.orchestra.run.smithi032.stdout:410.out 2023-10-08T06:12:30.932 INFO:teuthology.orchestra.run.smithi032.stdout:411 2023-10-08T06:12:30.932 INFO:teuthology.orchestra.run.smithi032.stdout:411.out 2023-10-08T06:12:30.932 INFO:teuthology.orchestra.run.smithi032.stdout:412 2023-10-08T06:12:30.932 INFO:teuthology.orchestra.run.smithi032.stdout:412.out 2023-10-08T06:12:30.932 INFO:teuthology.orchestra.run.smithi032.stdout:413 2023-10-08T06:12:30.933 INFO:teuthology.orchestra.run.smithi032.stdout:413.out 2023-10-08T06:12:30.933 INFO:teuthology.orchestra.run.smithi032.stdout:414 2023-10-08T06:12:30.933 INFO:teuthology.orchestra.run.smithi032.stdout:414.out 2023-10-08T06:12:30.933 INFO:teuthology.orchestra.run.smithi032.stdout:415 2023-10-08T06:12:30.933 INFO:teuthology.orchestra.run.smithi032.stdout:415.out 2023-10-08T06:12:30.933 INFO:teuthology.orchestra.run.smithi032.stdout:416 2023-10-08T06:12:30.933 INFO:teuthology.orchestra.run.smithi032.stdout:416.out 2023-10-08T06:12:30.933 INFO:teuthology.orchestra.run.smithi032.stdout:417 2023-10-08T06:12:30.933 INFO:teuthology.orchestra.run.smithi032.stdout:417.out 2023-10-08T06:12:30.933 INFO:teuthology.orchestra.run.smithi032.stdout:418 2023-10-08T06:12:30.933 INFO:teuthology.orchestra.run.smithi032.stdout:418.out 2023-10-08T06:12:30.933 INFO:teuthology.orchestra.run.smithi032.stdout:419 2023-10-08T06:12:30.933 INFO:teuthology.orchestra.run.smithi032.stdout:419.out 2023-10-08T06:12:30.934 INFO:teuthology.orchestra.run.smithi032.stdout:420 2023-10-08T06:12:30.934 INFO:teuthology.orchestra.run.smithi032.stdout:420.out 2023-10-08T06:12:30.934 INFO:teuthology.orchestra.run.smithi032.stdout:421 2023-10-08T06:12:30.934 INFO:teuthology.orchestra.run.smithi032.stdout:421.out 2023-10-08T06:12:30.934 INFO:teuthology.orchestra.run.smithi032.stdout:422 2023-10-08T06:12:30.934 INFO:teuthology.orchestra.run.smithi032.stdout:422.out 2023-10-08T06:12:30.934 INFO:teuthology.orchestra.run.smithi032.stdout:423 2023-10-08T06:12:30.934 INFO:teuthology.orchestra.run.smithi032.stdout:423.out 2023-10-08T06:12:30.934 INFO:teuthology.orchestra.run.smithi032.stdout:424 2023-10-08T06:12:30.934 INFO:teuthology.orchestra.run.smithi032.stdout:424.out 2023-10-08T06:12:30.934 INFO:teuthology.orchestra.run.smithi032.stdout:425 2023-10-08T06:12:30.935 INFO:teuthology.orchestra.run.smithi032.stdout:425.out 2023-10-08T06:12:30.935 INFO:teuthology.orchestra.run.smithi032.stdout:426 2023-10-08T06:12:30.935 INFO:teuthology.orchestra.run.smithi032.stdout:426.out 2023-10-08T06:12:30.935 INFO:teuthology.orchestra.run.smithi032.stdout:427 2023-10-08T06:12:30.935 INFO:teuthology.orchestra.run.smithi032.stdout:427.out 2023-10-08T06:12:30.935 INFO:teuthology.orchestra.run.smithi032.stdout:428 2023-10-08T06:12:30.935 INFO:teuthology.orchestra.run.smithi032.stdout:428.out 2023-10-08T06:12:30.935 INFO:teuthology.orchestra.run.smithi032.stdout:429 2023-10-08T06:12:30.935 INFO:teuthology.orchestra.run.smithi032.stdout:429.out 2023-10-08T06:12:30.935 INFO:teuthology.orchestra.run.smithi032.stdout:430 2023-10-08T06:12:30.935 INFO:teuthology.orchestra.run.smithi032.stdout:430.out 2023-10-08T06:12:30.935 INFO:teuthology.orchestra.run.smithi032.stdout:431 2023-10-08T06:12:30.935 INFO:teuthology.orchestra.run.smithi032.stdout:431.out 2023-10-08T06:12:30.936 INFO:teuthology.orchestra.run.smithi032.stdout:432 2023-10-08T06:12:30.936 INFO:teuthology.orchestra.run.smithi032.stdout:432.out 2023-10-08T06:12:30.936 INFO:teuthology.orchestra.run.smithi032.stdout:433 2023-10-08T06:12:30.936 INFO:teuthology.orchestra.run.smithi032.stdout:433.out 2023-10-08T06:12:30.936 INFO:teuthology.orchestra.run.smithi032.stdout:434 2023-10-08T06:12:30.936 INFO:teuthology.orchestra.run.smithi032.stdout:434.out 2023-10-08T06:12:30.936 INFO:teuthology.orchestra.run.smithi032.stdout:435 2023-10-08T06:12:30.936 INFO:teuthology.orchestra.run.smithi032.stdout:435.out 2023-10-08T06:12:30.936 INFO:teuthology.orchestra.run.smithi032.stdout:436 2023-10-08T06:12:30.936 INFO:teuthology.orchestra.run.smithi032.stdout:436.out 2023-10-08T06:12:30.936 INFO:teuthology.orchestra.run.smithi032.stdout:437 2023-10-08T06:12:30.936 INFO:teuthology.orchestra.run.smithi032.stdout:437.out 2023-10-08T06:12:30.937 INFO:teuthology.orchestra.run.smithi032.stdout:438 2023-10-08T06:12:30.937 INFO:teuthology.orchestra.run.smithi032.stdout:438.out 2023-10-08T06:12:30.937 INFO:teuthology.orchestra.run.smithi032.stdout:439 2023-10-08T06:12:30.937 INFO:teuthology.orchestra.run.smithi032.stdout:439.out 2023-10-08T06:12:30.937 INFO:teuthology.orchestra.run.smithi032.stdout:440 2023-10-08T06:12:30.937 INFO:teuthology.orchestra.run.smithi032.stdout:440.out 2023-10-08T06:12:30.937 INFO:teuthology.orchestra.run.smithi032.stdout:441 2023-10-08T06:12:30.937 INFO:teuthology.orchestra.run.smithi032.stdout:441.out 2023-10-08T06:12:30.937 INFO:teuthology.orchestra.run.smithi032.stdout:442 2023-10-08T06:12:30.937 INFO:teuthology.orchestra.run.smithi032.stdout:442.out 2023-10-08T06:12:30.937 INFO:teuthology.orchestra.run.smithi032.stdout:443 2023-10-08T06:12:30.937 INFO:teuthology.orchestra.run.smithi032.stdout:443.out 2023-10-08T06:12:30.937 INFO:teuthology.orchestra.run.smithi032.stdout:444 2023-10-08T06:12:30.938 INFO:teuthology.orchestra.run.smithi032.stdout:444.out 2023-10-08T06:12:30.938 INFO:teuthology.orchestra.run.smithi032.stdout:445 2023-10-08T06:12:30.938 INFO:teuthology.orchestra.run.smithi032.stdout:445.out 2023-10-08T06:12:30.938 INFO:teuthology.orchestra.run.smithi032.stdout:446 2023-10-08T06:12:30.938 INFO:teuthology.orchestra.run.smithi032.stdout:446.out 2023-10-08T06:12:30.938 INFO:teuthology.orchestra.run.smithi032.stdout:447 2023-10-08T06:12:30.938 INFO:teuthology.orchestra.run.smithi032.stdout:447.out 2023-10-08T06:12:30.938 INFO:teuthology.orchestra.run.smithi032.stdout:448 2023-10-08T06:12:30.938 INFO:teuthology.orchestra.run.smithi032.stdout:448.out 2023-10-08T06:12:30.938 INFO:teuthology.orchestra.run.smithi032.stdout:449 2023-10-08T06:12:30.938 INFO:teuthology.orchestra.run.smithi032.stdout:449.out 2023-10-08T06:12:30.938 INFO:teuthology.orchestra.run.smithi032.stdout:450 2023-10-08T06:12:30.939 INFO:teuthology.orchestra.run.smithi032.stdout:450.out 2023-10-08T06:12:30.939 INFO:teuthology.orchestra.run.smithi032.stdout:451 2023-10-08T06:12:30.939 INFO:teuthology.orchestra.run.smithi032.stdout:451.out 2023-10-08T06:12:30.939 INFO:teuthology.orchestra.run.smithi032.stdout:452 2023-10-08T06:12:30.939 INFO:teuthology.orchestra.run.smithi032.stdout:452.out 2023-10-08T06:12:30.939 INFO:teuthology.orchestra.run.smithi032.stdout:453 2023-10-08T06:12:30.939 INFO:teuthology.orchestra.run.smithi032.stdout:453.out 2023-10-08T06:12:30.939 INFO:teuthology.orchestra.run.smithi032.stdout:454 2023-10-08T06:12:30.939 INFO:teuthology.orchestra.run.smithi032.stdout:454.out 2023-10-08T06:12:30.939 INFO:teuthology.orchestra.run.smithi032.stdout:455 2023-10-08T06:12:30.939 INFO:teuthology.orchestra.run.smithi032.stdout:455.out 2023-10-08T06:12:30.939 INFO:teuthology.orchestra.run.smithi032.stdout:456 2023-10-08T06:12:30.940 INFO:teuthology.orchestra.run.smithi032.stdout:456.out 2023-10-08T06:12:30.940 INFO:teuthology.orchestra.run.smithi032.stdout:457 2023-10-08T06:12:30.940 INFO:teuthology.orchestra.run.smithi032.stdout:457.out 2023-10-08T06:12:30.940 INFO:teuthology.orchestra.run.smithi032.stdout:458 2023-10-08T06:12:30.940 INFO:teuthology.orchestra.run.smithi032.stdout:458.out 2023-10-08T06:12:30.940 INFO:teuthology.orchestra.run.smithi032.stdout:459 2023-10-08T06:12:30.940 INFO:teuthology.orchestra.run.smithi032.stdout:459.out 2023-10-08T06:12:30.940 INFO:teuthology.orchestra.run.smithi032.stdout:460 2023-10-08T06:12:30.940 INFO:teuthology.orchestra.run.smithi032.stdout:460.out 2023-10-08T06:12:30.940 INFO:teuthology.orchestra.run.smithi032.stdout:461 2023-10-08T06:12:30.940 INFO:teuthology.orchestra.run.smithi032.stdout:461.out 2023-10-08T06:12:30.940 INFO:teuthology.orchestra.run.smithi032.stdout:462 2023-10-08T06:12:30.940 INFO:teuthology.orchestra.run.smithi032.stdout:462.out 2023-10-08T06:12:30.941 INFO:teuthology.orchestra.run.smithi032.stdout:463 2023-10-08T06:12:30.941 INFO:teuthology.orchestra.run.smithi032.stdout:463.out 2023-10-08T06:12:30.941 INFO:teuthology.orchestra.run.smithi032.stdout:464 2023-10-08T06:12:30.941 INFO:teuthology.orchestra.run.smithi032.stdout:464.out 2023-10-08T06:12:30.941 INFO:teuthology.orchestra.run.smithi032.stdout:465 2023-10-08T06:12:30.941 INFO:teuthology.orchestra.run.smithi032.stdout:465.out 2023-10-08T06:12:30.941 INFO:teuthology.orchestra.run.smithi032.stdout:466 2023-10-08T06:12:30.941 INFO:teuthology.orchestra.run.smithi032.stdout:466.out 2023-10-08T06:12:30.941 INFO:teuthology.orchestra.run.smithi032.stdout:467 2023-10-08T06:12:30.941 INFO:teuthology.orchestra.run.smithi032.stdout:467.out 2023-10-08T06:12:30.941 INFO:teuthology.orchestra.run.smithi032.stdout:468 2023-10-08T06:12:30.942 INFO:teuthology.orchestra.run.smithi032.stdout:468.out 2023-10-08T06:12:30.942 INFO:teuthology.orchestra.run.smithi032.stdout:469 2023-10-08T06:12:30.942 INFO:teuthology.orchestra.run.smithi032.stdout:469.out 2023-10-08T06:12:30.942 INFO:teuthology.orchestra.run.smithi032.stdout:470 2023-10-08T06:12:30.942 INFO:teuthology.orchestra.run.smithi032.stdout:470.out 2023-10-08T06:12:30.942 INFO:teuthology.orchestra.run.smithi032.stdout:472 2023-10-08T06:12:30.942 INFO:teuthology.orchestra.run.smithi032.stdout:472.out 2023-10-08T06:12:30.942 INFO:teuthology.orchestra.run.smithi032.stdout:473 2023-10-08T06:12:30.942 INFO:teuthology.orchestra.run.smithi032.stdout:473.out 2023-10-08T06:12:30.942 INFO:teuthology.orchestra.run.smithi032.stdout:474 2023-10-08T06:12:30.942 INFO:teuthology.orchestra.run.smithi032.stdout:474.out 2023-10-08T06:12:30.942 INFO:teuthology.orchestra.run.smithi032.stdout:475 2023-10-08T06:12:30.943 INFO:teuthology.orchestra.run.smithi032.stdout:475.out 2023-10-08T06:12:30.943 INFO:teuthology.orchestra.run.smithi032.stdout:476 2023-10-08T06:12:30.943 INFO:teuthology.orchestra.run.smithi032.stdout:476.out 2023-10-08T06:12:30.943 INFO:teuthology.orchestra.run.smithi032.stdout:477 2023-10-08T06:12:30.943 INFO:teuthology.orchestra.run.smithi032.stdout:477.out 2023-10-08T06:12:30.943 INFO:teuthology.orchestra.run.smithi032.stdout:478 2023-10-08T06:12:30.943 INFO:teuthology.orchestra.run.smithi032.stdout:478.out 2023-10-08T06:12:30.943 INFO:teuthology.orchestra.run.smithi032.stdout:479 2023-10-08T06:12:30.943 INFO:teuthology.orchestra.run.smithi032.stdout:479.out 2023-10-08T06:12:30.943 INFO:teuthology.orchestra.run.smithi032.stdout:480 2023-10-08T06:12:30.943 INFO:teuthology.orchestra.run.smithi032.stdout:480.out 2023-10-08T06:12:30.943 INFO:teuthology.orchestra.run.smithi032.stdout:481 2023-10-08T06:12:30.943 INFO:teuthology.orchestra.run.smithi032.stdout:481.out 2023-10-08T06:12:30.944 INFO:teuthology.orchestra.run.smithi032.stdout:482 2023-10-08T06:12:30.944 INFO:teuthology.orchestra.run.smithi032.stdout:482.out 2023-10-08T06:12:30.944 INFO:teuthology.orchestra.run.smithi032.stdout:483 2023-10-08T06:12:30.944 INFO:teuthology.orchestra.run.smithi032.stdout:483.out 2023-10-08T06:12:30.944 INFO:teuthology.orchestra.run.smithi032.stdout:484 2023-10-08T06:12:30.944 INFO:teuthology.orchestra.run.smithi032.stdout:484.out 2023-10-08T06:12:30.944 INFO:teuthology.orchestra.run.smithi032.stdout:485 2023-10-08T06:12:30.944 INFO:teuthology.orchestra.run.smithi032.stdout:485.out 2023-10-08T06:12:30.944 INFO:teuthology.orchestra.run.smithi032.stdout:486 2023-10-08T06:12:30.944 INFO:teuthology.orchestra.run.smithi032.stdout:486.out 2023-10-08T06:12:30.944 INFO:teuthology.orchestra.run.smithi032.stdout:487 2023-10-08T06:12:30.944 INFO:teuthology.orchestra.run.smithi032.stdout:487.out 2023-10-08T06:12:30.945 INFO:teuthology.orchestra.run.smithi032.stdout:488 2023-10-08T06:12:30.945 INFO:teuthology.orchestra.run.smithi032.stdout:488.out 2023-10-08T06:12:30.945 INFO:teuthology.orchestra.run.smithi032.stdout:489 2023-10-08T06:12:30.945 INFO:teuthology.orchestra.run.smithi032.stdout:489.out 2023-10-08T06:12:30.945 INFO:teuthology.orchestra.run.smithi032.stdout:490 2023-10-08T06:12:30.945 INFO:teuthology.orchestra.run.smithi032.stdout:490.out 2023-10-08T06:12:30.945 INFO:teuthology.orchestra.run.smithi032.stdout:491 2023-10-08T06:12:30.945 INFO:teuthology.orchestra.run.smithi032.stdout:491.out 2023-10-08T06:12:30.945 INFO:teuthology.orchestra.run.smithi032.stdout:492 2023-10-08T06:12:30.945 INFO:teuthology.orchestra.run.smithi032.stdout:492.out 2023-10-08T06:12:30.945 INFO:teuthology.orchestra.run.smithi032.stdout:493 2023-10-08T06:12:30.945 INFO:teuthology.orchestra.run.smithi032.stdout:493.out 2023-10-08T06:12:30.946 INFO:teuthology.orchestra.run.smithi032.stdout:494 2023-10-08T06:12:30.946 INFO:teuthology.orchestra.run.smithi032.stdout:494.out 2023-10-08T06:12:30.946 INFO:teuthology.orchestra.run.smithi032.stdout:495 2023-10-08T06:12:30.946 INFO:teuthology.orchestra.run.smithi032.stdout:495.out 2023-10-08T06:12:30.946 INFO:teuthology.orchestra.run.smithi032.stdout:496 2023-10-08T06:12:30.946 INFO:teuthology.orchestra.run.smithi032.stdout:496.out 2023-10-08T06:12:30.946 INFO:teuthology.orchestra.run.smithi032.stdout:497 2023-10-08T06:12:30.946 INFO:teuthology.orchestra.run.smithi032.stdout:497.out 2023-10-08T06:12:30.946 INFO:teuthology.orchestra.run.smithi032.stdout:498 2023-10-08T06:12:30.946 INFO:teuthology.orchestra.run.smithi032.stdout:498.out 2023-10-08T06:12:30.946 INFO:teuthology.orchestra.run.smithi032.stdout:499 2023-10-08T06:12:30.946 INFO:teuthology.orchestra.run.smithi032.stdout:499.out 2023-10-08T06:12:30.946 INFO:teuthology.orchestra.run.smithi032.stdout:500 2023-10-08T06:12:30.947 INFO:teuthology.orchestra.run.smithi032.stdout:500.out 2023-10-08T06:12:30.947 INFO:teuthology.orchestra.run.smithi032.stdout:501 2023-10-08T06:12:30.947 INFO:teuthology.orchestra.run.smithi032.stdout:501.out 2023-10-08T06:12:30.947 INFO:teuthology.orchestra.run.smithi032.stdout:502 2023-10-08T06:12:30.947 INFO:teuthology.orchestra.run.smithi032.stdout:502.out 2023-10-08T06:12:30.947 INFO:teuthology.orchestra.run.smithi032.stdout:503 2023-10-08T06:12:30.947 INFO:teuthology.orchestra.run.smithi032.stdout:503.out 2023-10-08T06:12:30.947 INFO:teuthology.orchestra.run.smithi032.stdout:504 2023-10-08T06:12:30.947 INFO:teuthology.orchestra.run.smithi032.stdout:504.out 2023-10-08T06:12:30.947 INFO:teuthology.orchestra.run.smithi032.stdout:505 2023-10-08T06:12:30.947 INFO:teuthology.orchestra.run.smithi032.stdout:505.out 2023-10-08T06:12:30.947 INFO:teuthology.orchestra.run.smithi032.stdout:506 2023-10-08T06:12:30.948 INFO:teuthology.orchestra.run.smithi032.stdout:506.out 2023-10-08T06:12:30.948 INFO:teuthology.orchestra.run.smithi032.stdout:507 2023-10-08T06:12:30.948 INFO:teuthology.orchestra.run.smithi032.stdout:507.out 2023-10-08T06:12:30.948 INFO:teuthology.orchestra.run.smithi032.stdout:508 2023-10-08T06:12:30.948 INFO:teuthology.orchestra.run.smithi032.stdout:508.out 2023-10-08T06:12:30.948 INFO:teuthology.orchestra.run.smithi032.stdout:509 2023-10-08T06:12:30.948 INFO:teuthology.orchestra.run.smithi032.stdout:509.out 2023-10-08T06:12:30.948 INFO:teuthology.orchestra.run.smithi032.stdout:510 2023-10-08T06:12:30.948 INFO:teuthology.orchestra.run.smithi032.stdout:510.out 2023-10-08T06:12:30.948 INFO:teuthology.orchestra.run.smithi032.stdout:511 2023-10-08T06:12:30.948 INFO:teuthology.orchestra.run.smithi032.stdout:511.out 2023-10-08T06:12:30.948 INFO:teuthology.orchestra.run.smithi032.stdout:512 2023-10-08T06:12:30.949 INFO:teuthology.orchestra.run.smithi032.stdout:512.out 2023-10-08T06:12:30.949 INFO:teuthology.orchestra.run.smithi032.stdout:513 2023-10-08T06:12:30.949 INFO:teuthology.orchestra.run.smithi032.stdout:513.out 2023-10-08T06:12:30.949 INFO:teuthology.orchestra.run.smithi032.stdout:514 2023-10-08T06:12:30.949 INFO:teuthology.orchestra.run.smithi032.stdout:514.out 2023-10-08T06:12:30.949 INFO:teuthology.orchestra.run.smithi032.stdout:515 2023-10-08T06:12:30.949 INFO:teuthology.orchestra.run.smithi032.stdout:515.out 2023-10-08T06:12:30.949 INFO:teuthology.orchestra.run.smithi032.stdout:516 2023-10-08T06:12:30.949 INFO:teuthology.orchestra.run.smithi032.stdout:516.out 2023-10-08T06:12:30.949 INFO:teuthology.orchestra.run.smithi032.stdout:517 2023-10-08T06:12:30.949 INFO:teuthology.orchestra.run.smithi032.stdout:517.out 2023-10-08T06:12:30.949 INFO:teuthology.orchestra.run.smithi032.stdout:518 2023-10-08T06:12:30.950 INFO:teuthology.orchestra.run.smithi032.stdout:518.out 2023-10-08T06:12:30.950 INFO:teuthology.orchestra.run.smithi032.stdout:519 2023-10-08T06:12:30.950 INFO:teuthology.orchestra.run.smithi032.stdout:519.out 2023-10-08T06:12:30.950 INFO:teuthology.orchestra.run.smithi032.stdout:520 2023-10-08T06:12:30.950 INFO:teuthology.orchestra.run.smithi032.stdout:520.out 2023-10-08T06:12:30.950 INFO:teuthology.orchestra.run.smithi032.stdout:521 2023-10-08T06:12:30.950 INFO:teuthology.orchestra.run.smithi032.stdout:521.out 2023-10-08T06:12:30.950 INFO:teuthology.orchestra.run.smithi032.stdout:522 2023-10-08T06:12:30.950 INFO:teuthology.orchestra.run.smithi032.stdout:522.out 2023-10-08T06:12:30.950 INFO:teuthology.orchestra.run.smithi032.stdout:523 2023-10-08T06:12:30.950 INFO:teuthology.orchestra.run.smithi032.stdout:523.out 2023-10-08T06:12:30.951 INFO:teuthology.orchestra.run.smithi032.stdout:524 2023-10-08T06:12:30.951 INFO:teuthology.orchestra.run.smithi032.stdout:524.out 2023-10-08T06:12:30.951 INFO:teuthology.orchestra.run.smithi032.stdout:525 2023-10-08T06:12:30.951 INFO:teuthology.orchestra.run.smithi032.stdout:525.out 2023-10-08T06:12:30.951 INFO:teuthology.orchestra.run.smithi032.stdout:526 2023-10-08T06:12:30.951 INFO:teuthology.orchestra.run.smithi032.stdout:526.out 2023-10-08T06:12:30.951 INFO:teuthology.orchestra.run.smithi032.stdout:527 2023-10-08T06:12:30.951 INFO:teuthology.orchestra.run.smithi032.stdout:527.out 2023-10-08T06:12:30.951 INFO:teuthology.orchestra.run.smithi032.stdout:528 2023-10-08T06:12:30.951 INFO:teuthology.orchestra.run.smithi032.stdout:528.out 2023-10-08T06:12:30.951 INFO:teuthology.orchestra.run.smithi032.stdout:529 2023-10-08T06:12:30.951 INFO:teuthology.orchestra.run.smithi032.stdout:529.out 2023-10-08T06:12:30.952 INFO:teuthology.orchestra.run.smithi032.stdout:530 2023-10-08T06:12:30.952 INFO:teuthology.orchestra.run.smithi032.stdout:530.out 2023-10-08T06:12:30.952 INFO:teuthology.orchestra.run.smithi032.stdout:531 2023-10-08T06:12:30.952 INFO:teuthology.orchestra.run.smithi032.stdout:531.out 2023-10-08T06:12:30.952 INFO:teuthology.orchestra.run.smithi032.stdout:532 2023-10-08T06:12:30.952 INFO:teuthology.orchestra.run.smithi032.stdout:532.out 2023-10-08T06:12:30.952 INFO:teuthology.orchestra.run.smithi032.stdout:533 2023-10-08T06:12:30.952 INFO:teuthology.orchestra.run.smithi032.stdout:533.out 2023-10-08T06:12:30.952 INFO:teuthology.orchestra.run.smithi032.stdout:534 2023-10-08T06:12:30.952 INFO:teuthology.orchestra.run.smithi032.stdout:534.out 2023-10-08T06:12:30.952 INFO:teuthology.orchestra.run.smithi032.stdout:535 2023-10-08T06:12:30.952 INFO:teuthology.orchestra.run.smithi032.stdout:535.out 2023-10-08T06:12:30.952 INFO:teuthology.orchestra.run.smithi032.stdout:536 2023-10-08T06:12:30.953 INFO:teuthology.orchestra.run.smithi032.stdout:536.out 2023-10-08T06:12:30.953 INFO:teuthology.orchestra.run.smithi032.stdout:537 2023-10-08T06:12:30.953 INFO:teuthology.orchestra.run.smithi032.stdout:537.out 2023-10-08T06:12:30.953 INFO:teuthology.orchestra.run.smithi032.stdout:538 2023-10-08T06:12:30.953 INFO:teuthology.orchestra.run.smithi032.stdout:538.out 2023-10-08T06:12:30.953 INFO:teuthology.orchestra.run.smithi032.stdout:539 2023-10-08T06:12:30.953 INFO:teuthology.orchestra.run.smithi032.stdout:539.out 2023-10-08T06:12:30.953 INFO:teuthology.orchestra.run.smithi032.stdout:540 2023-10-08T06:12:30.953 INFO:teuthology.orchestra.run.smithi032.stdout:540.out 2023-10-08T06:12:30.954 INFO:teuthology.orchestra.run.smithi032.stdout:541 2023-10-08T06:12:30.954 INFO:teuthology.orchestra.run.smithi032.stdout:541.out 2023-10-08T06:12:30.954 INFO:teuthology.orchestra.run.smithi032.stdout:542 2023-10-08T06:12:30.954 INFO:teuthology.orchestra.run.smithi032.stdout:542.out 2023-10-08T06:12:30.954 INFO:teuthology.orchestra.run.smithi032.stdout:543 2023-10-08T06:12:30.954 INFO:teuthology.orchestra.run.smithi032.stdout:543.out 2023-10-08T06:12:30.954 INFO:teuthology.orchestra.run.smithi032.stdout:544 2023-10-08T06:12:30.954 INFO:teuthology.orchestra.run.smithi032.stdout:544.out 2023-10-08T06:12:30.954 INFO:teuthology.orchestra.run.smithi032.stdout:545 2023-10-08T06:12:30.954 INFO:teuthology.orchestra.run.smithi032.stdout:545.out 2023-10-08T06:12:30.954 INFO:teuthology.orchestra.run.smithi032.stdout:546 2023-10-08T06:12:30.955 INFO:teuthology.orchestra.run.smithi032.stdout:546.out 2023-10-08T06:12:30.955 INFO:teuthology.orchestra.run.smithi032.stdout:547 2023-10-08T06:12:30.955 INFO:teuthology.orchestra.run.smithi032.stdout:547.out 2023-10-08T06:12:30.955 INFO:teuthology.orchestra.run.smithi032.stdout:548 2023-10-08T06:12:30.955 INFO:teuthology.orchestra.run.smithi032.stdout:548.out 2023-10-08T06:12:30.955 INFO:teuthology.orchestra.run.smithi032.stdout:549 2023-10-08T06:12:30.955 INFO:teuthology.orchestra.run.smithi032.stdout:549.out 2023-10-08T06:12:30.955 INFO:teuthology.orchestra.run.smithi032.stdout:550 2023-10-08T06:12:30.955 INFO:teuthology.orchestra.run.smithi032.stdout:550.out 2023-10-08T06:12:30.955 INFO:teuthology.orchestra.run.smithi032.stdout:551 2023-10-08T06:12:30.955 INFO:teuthology.orchestra.run.smithi032.stdout:551.out 2023-10-08T06:12:30.955 INFO:teuthology.orchestra.run.smithi032.stdout:552 2023-10-08T06:12:30.956 INFO:teuthology.orchestra.run.smithi032.stdout:552.out 2023-10-08T06:12:30.956 INFO:teuthology.orchestra.run.smithi032.stdout:553 2023-10-08T06:12:30.956 INFO:teuthology.orchestra.run.smithi032.stdout:553.out 2023-10-08T06:12:30.956 INFO:teuthology.orchestra.run.smithi032.stdout:554 2023-10-08T06:12:30.956 INFO:teuthology.orchestra.run.smithi032.stdout:554.out 2023-10-08T06:12:30.956 INFO:teuthology.orchestra.run.smithi032.stdout:555 2023-10-08T06:12:30.956 INFO:teuthology.orchestra.run.smithi032.stdout:555.out 2023-10-08T06:12:30.956 INFO:teuthology.orchestra.run.smithi032.stdout:556 2023-10-08T06:12:30.956 INFO:teuthology.orchestra.run.smithi032.stdout:556.out 2023-10-08T06:12:30.956 INFO:teuthology.orchestra.run.smithi032.stdout:557 2023-10-08T06:12:30.956 INFO:teuthology.orchestra.run.smithi032.stdout:557.out 2023-10-08T06:12:30.957 INFO:teuthology.orchestra.run.smithi032.stdout:558 2023-10-08T06:12:30.957 INFO:teuthology.orchestra.run.smithi032.stdout:558.out 2023-10-08T06:12:30.957 INFO:teuthology.orchestra.run.smithi032.stdout:559 2023-10-08T06:12:30.957 INFO:teuthology.orchestra.run.smithi032.stdout:559.out 2023-10-08T06:12:30.957 INFO:teuthology.orchestra.run.smithi032.stdout:560 2023-10-08T06:12:30.957 INFO:teuthology.orchestra.run.smithi032.stdout:560.out 2023-10-08T06:12:30.957 INFO:teuthology.orchestra.run.smithi032.stdout:561 2023-10-08T06:12:30.957 INFO:teuthology.orchestra.run.smithi032.stdout:561.out 2023-10-08T06:12:30.957 INFO:teuthology.orchestra.run.smithi032.stdout:562 2023-10-08T06:12:30.957 INFO:teuthology.orchestra.run.smithi032.stdout:562.out 2023-10-08T06:12:30.957 INFO:teuthology.orchestra.run.smithi032.stdout:563 2023-10-08T06:12:30.957 INFO:teuthology.orchestra.run.smithi032.stdout:563.out 2023-10-08T06:12:30.958 INFO:teuthology.orchestra.run.smithi032.stdout:564 2023-10-08T06:12:30.958 INFO:teuthology.orchestra.run.smithi032.stdout:564.out 2023-10-08T06:12:30.958 INFO:teuthology.orchestra.run.smithi032.stdout:565 2023-10-08T06:12:30.958 INFO:teuthology.orchestra.run.smithi032.stdout:565.out 2023-10-08T06:12:30.958 INFO:teuthology.orchestra.run.smithi032.stdout:566 2023-10-08T06:12:30.958 INFO:teuthology.orchestra.run.smithi032.stdout:566.out 2023-10-08T06:12:30.958 INFO:teuthology.orchestra.run.smithi032.stdout:567 2023-10-08T06:12:30.958 INFO:teuthology.orchestra.run.smithi032.stdout:567.out 2023-10-08T06:12:30.958 INFO:teuthology.orchestra.run.smithi032.stdout:568 2023-10-08T06:12:30.958 INFO:teuthology.orchestra.run.smithi032.stdout:568.out 2023-10-08T06:12:30.958 INFO:teuthology.orchestra.run.smithi032.stdout:569 2023-10-08T06:12:30.958 INFO:teuthology.orchestra.run.smithi032.stdout:569.out 2023-10-08T06:12:30.959 INFO:teuthology.orchestra.run.smithi032.stdout:570 2023-10-08T06:12:30.959 INFO:teuthology.orchestra.run.smithi032.stdout:570.out 2023-10-08T06:12:30.959 INFO:teuthology.orchestra.run.smithi032.stdout:571 2023-10-08T06:12:30.959 INFO:teuthology.orchestra.run.smithi032.stdout:571.out 2023-10-08T06:12:30.959 INFO:teuthology.orchestra.run.smithi032.stdout:572 2023-10-08T06:12:30.959 INFO:teuthology.orchestra.run.smithi032.stdout:572.out 2023-10-08T06:12:30.959 INFO:teuthology.orchestra.run.smithi032.stdout:573 2023-10-08T06:12:30.959 INFO:teuthology.orchestra.run.smithi032.stdout:573.out 2023-10-08T06:12:30.959 INFO:teuthology.orchestra.run.smithi032.stdout:574 2023-10-08T06:12:30.959 INFO:teuthology.orchestra.run.smithi032.stdout:574.out 2023-10-08T06:12:30.959 INFO:teuthology.orchestra.run.smithi032.stdout:575 2023-10-08T06:12:30.959 INFO:teuthology.orchestra.run.smithi032.stdout:575.out 2023-10-08T06:12:30.959 INFO:teuthology.orchestra.run.smithi032.stdout:576 2023-10-08T06:12:30.960 INFO:teuthology.orchestra.run.smithi032.stdout:576.out 2023-10-08T06:12:30.960 INFO:teuthology.orchestra.run.smithi032.stdout:577 2023-10-08T06:12:30.960 INFO:teuthology.orchestra.run.smithi032.stdout:577.out 2023-10-08T06:12:30.960 INFO:teuthology.orchestra.run.smithi032.stdout:578 2023-10-08T06:12:30.960 INFO:teuthology.orchestra.run.smithi032.stdout:578.out 2023-10-08T06:12:30.960 INFO:teuthology.orchestra.run.smithi032.stdout:579 2023-10-08T06:12:30.960 INFO:teuthology.orchestra.run.smithi032.stdout:579.out 2023-10-08T06:12:30.960 INFO:teuthology.orchestra.run.smithi032.stdout:580 2023-10-08T06:12:30.960 INFO:teuthology.orchestra.run.smithi032.stdout:580.out 2023-10-08T06:12:30.960 INFO:teuthology.orchestra.run.smithi032.stdout:581 2023-10-08T06:12:30.960 INFO:teuthology.orchestra.run.smithi032.stdout:581.out 2023-10-08T06:12:30.960 INFO:teuthology.orchestra.run.smithi032.stdout:582 2023-10-08T06:12:30.961 INFO:teuthology.orchestra.run.smithi032.stdout:582.out 2023-10-08T06:12:30.961 INFO:teuthology.orchestra.run.smithi032.stdout:583 2023-10-08T06:12:30.961 INFO:teuthology.orchestra.run.smithi032.stdout:583.out 2023-10-08T06:12:30.961 INFO:teuthology.orchestra.run.smithi032.stdout:584 2023-10-08T06:12:30.961 INFO:teuthology.orchestra.run.smithi032.stdout:584.out 2023-10-08T06:12:30.961 INFO:teuthology.orchestra.run.smithi032.stdout:585 2023-10-08T06:12:30.961 INFO:teuthology.orchestra.run.smithi032.stdout:585.out 2023-10-08T06:12:30.961 INFO:teuthology.orchestra.run.smithi032.stdout:586 2023-10-08T06:12:30.961 INFO:teuthology.orchestra.run.smithi032.stdout:586.out 2023-10-08T06:12:30.961 INFO:teuthology.orchestra.run.smithi032.stdout:587 2023-10-08T06:12:30.961 INFO:teuthology.orchestra.run.smithi032.stdout:587.out 2023-10-08T06:12:30.961 INFO:teuthology.orchestra.run.smithi032.stdout:588 2023-10-08T06:12:30.961 INFO:teuthology.orchestra.run.smithi032.stdout:588.out 2023-10-08T06:12:30.962 INFO:teuthology.orchestra.run.smithi032.stdout:589 2023-10-08T06:12:30.962 INFO:teuthology.orchestra.run.smithi032.stdout:589.out 2023-10-08T06:12:30.962 INFO:teuthology.orchestra.run.smithi032.stdout:590 2023-10-08T06:12:30.962 INFO:teuthology.orchestra.run.smithi032.stdout:590.out 2023-10-08T06:12:30.962 INFO:teuthology.orchestra.run.smithi032.stdout:591 2023-10-08T06:12:30.962 INFO:teuthology.orchestra.run.smithi032.stdout:591.out 2023-10-08T06:12:30.962 INFO:teuthology.orchestra.run.smithi032.stdout:592 2023-10-08T06:12:30.962 INFO:teuthology.orchestra.run.smithi032.stdout:592.out 2023-10-08T06:12:30.962 INFO:teuthology.orchestra.run.smithi032.stdout:593 2023-10-08T06:12:30.962 INFO:teuthology.orchestra.run.smithi032.stdout:593.out 2023-10-08T06:12:30.962 INFO:teuthology.orchestra.run.smithi032.stdout:594 2023-10-08T06:12:30.962 INFO:teuthology.orchestra.run.smithi032.stdout:594.out 2023-10-08T06:12:30.963 INFO:teuthology.orchestra.run.smithi032.stdout:595 2023-10-08T06:12:30.963 INFO:teuthology.orchestra.run.smithi032.stdout:595.out 2023-10-08T06:12:30.963 INFO:teuthology.orchestra.run.smithi032.stdout:596 2023-10-08T06:12:30.963 INFO:teuthology.orchestra.run.smithi032.stdout:596.out 2023-10-08T06:12:30.963 INFO:teuthology.orchestra.run.smithi032.stdout:597 2023-10-08T06:12:30.963 INFO:teuthology.orchestra.run.smithi032.stdout:597.out 2023-10-08T06:12:30.963 INFO:teuthology.orchestra.run.smithi032.stdout:598 2023-10-08T06:12:30.963 INFO:teuthology.orchestra.run.smithi032.stdout:598.out 2023-10-08T06:12:30.963 INFO:teuthology.orchestra.run.smithi032.stdout:599 2023-10-08T06:12:30.963 INFO:teuthology.orchestra.run.smithi032.stdout:599.out 2023-10-08T06:12:30.963 INFO:teuthology.orchestra.run.smithi032.stdout:600 2023-10-08T06:12:30.963 INFO:teuthology.orchestra.run.smithi032.stdout:600.out 2023-10-08T06:12:30.964 INFO:teuthology.orchestra.run.smithi032.stdout:601 2023-10-08T06:12:30.964 INFO:teuthology.orchestra.run.smithi032.stdout:601.out 2023-10-08T06:12:30.964 INFO:teuthology.orchestra.run.smithi032.stdout:602 2023-10-08T06:12:30.964 INFO:teuthology.orchestra.run.smithi032.stdout:602.out 2023-10-08T06:12:30.964 INFO:teuthology.orchestra.run.smithi032.stdout:603 2023-10-08T06:12:30.964 INFO:teuthology.orchestra.run.smithi032.stdout:603.out 2023-10-08T06:12:30.964 INFO:teuthology.orchestra.run.smithi032.stdout:604 2023-10-08T06:12:30.964 INFO:teuthology.orchestra.run.smithi032.stdout:604.out 2023-10-08T06:12:30.964 INFO:teuthology.orchestra.run.smithi032.stdout:605 2023-10-08T06:12:30.964 INFO:teuthology.orchestra.run.smithi032.stdout:605.out 2023-10-08T06:12:30.964 INFO:teuthology.orchestra.run.smithi032.stdout:606 2023-10-08T06:12:30.964 INFO:teuthology.orchestra.run.smithi032.stdout:606.out 2023-10-08T06:12:30.965 INFO:teuthology.orchestra.run.smithi032.stdout:607 2023-10-08T06:12:30.965 INFO:teuthology.orchestra.run.smithi032.stdout:607.out 2023-10-08T06:12:30.965 INFO:teuthology.orchestra.run.smithi032.stdout:608 2023-10-08T06:12:30.965 INFO:teuthology.orchestra.run.smithi032.stdout:608.out 2023-10-08T06:12:30.965 INFO:teuthology.orchestra.run.smithi032.stdout:609 2023-10-08T06:12:30.965 INFO:teuthology.orchestra.run.smithi032.stdout:609.out 2023-10-08T06:12:30.965 INFO:teuthology.orchestra.run.smithi032.stdout:610 2023-10-08T06:12:30.965 INFO:teuthology.orchestra.run.smithi032.stdout:610.out 2023-10-08T06:12:30.965 INFO:teuthology.orchestra.run.smithi032.stdout:611 2023-10-08T06:12:30.965 INFO:teuthology.orchestra.run.smithi032.stdout:611.out 2023-10-08T06:12:30.965 INFO:teuthology.orchestra.run.smithi032.stdout:612 2023-10-08T06:12:30.966 INFO:teuthology.orchestra.run.smithi032.stdout:612.out 2023-10-08T06:12:30.966 INFO:teuthology.orchestra.run.smithi032.stdout:613 2023-10-08T06:12:30.966 INFO:teuthology.orchestra.run.smithi032.stdout:613.out 2023-10-08T06:12:30.966 INFO:teuthology.orchestra.run.smithi032.stdout:614 2023-10-08T06:12:30.966 INFO:teuthology.orchestra.run.smithi032.stdout:614.out 2023-10-08T06:12:30.966 INFO:teuthology.orchestra.run.smithi032.stdout:615 2023-10-08T06:12:30.966 INFO:teuthology.orchestra.run.smithi032.stdout:615.out 2023-10-08T06:12:30.966 INFO:teuthology.orchestra.run.smithi032.stdout:616 2023-10-08T06:12:30.966 INFO:teuthology.orchestra.run.smithi032.stdout:616.out 2023-10-08T06:12:30.966 INFO:teuthology.orchestra.run.smithi032.stdout:617 2023-10-08T06:12:30.966 INFO:teuthology.orchestra.run.smithi032.stdout:617.out 2023-10-08T06:12:30.966 INFO:teuthology.orchestra.run.smithi032.stdout:618 2023-10-08T06:12:30.967 INFO:teuthology.orchestra.run.smithi032.stdout:618.out 2023-10-08T06:12:30.967 INFO:teuthology.orchestra.run.smithi032.stdout:619 2023-10-08T06:12:30.967 INFO:teuthology.orchestra.run.smithi032.stdout:619.out 2023-10-08T06:12:30.967 INFO:teuthology.orchestra.run.smithi032.stdout:620 2023-10-08T06:12:30.967 INFO:teuthology.orchestra.run.smithi032.stdout:620.out 2023-10-08T06:12:30.967 INFO:teuthology.orchestra.run.smithi032.stdout:621 2023-10-08T06:12:30.967 INFO:teuthology.orchestra.run.smithi032.stdout:621.out 2023-10-08T06:12:30.967 INFO:teuthology.orchestra.run.smithi032.stdout:622 2023-10-08T06:12:30.967 INFO:teuthology.orchestra.run.smithi032.stdout:622.out 2023-10-08T06:12:30.967 INFO:teuthology.orchestra.run.smithi032.stdout:623 2023-10-08T06:12:30.967 INFO:teuthology.orchestra.run.smithi032.stdout:623.out 2023-10-08T06:12:30.967 INFO:teuthology.orchestra.run.smithi032.stdout:624 2023-10-08T06:12:30.968 INFO:teuthology.orchestra.run.smithi032.stdout:624.out 2023-10-08T06:12:30.968 INFO:teuthology.orchestra.run.smithi032.stdout:625 2023-10-08T06:12:30.968 INFO:teuthology.orchestra.run.smithi032.stdout:625.out 2023-10-08T06:12:30.968 INFO:teuthology.orchestra.run.smithi032.stdout:626 2023-10-08T06:12:30.968 INFO:teuthology.orchestra.run.smithi032.stdout:626.out 2023-10-08T06:12:30.968 INFO:teuthology.orchestra.run.smithi032.stdout:627 2023-10-08T06:12:30.968 INFO:teuthology.orchestra.run.smithi032.stdout:627.out 2023-10-08T06:12:30.968 INFO:teuthology.orchestra.run.smithi032.stdout:628 2023-10-08T06:12:30.968 INFO:teuthology.orchestra.run.smithi032.stdout:628.out 2023-10-08T06:12:30.968 INFO:teuthology.orchestra.run.smithi032.stdout:629 2023-10-08T06:12:30.968 INFO:teuthology.orchestra.run.smithi032.stdout:629.out 2023-10-08T06:12:30.969 INFO:teuthology.orchestra.run.smithi032.stdout:630 2023-10-08T06:12:30.969 INFO:teuthology.orchestra.run.smithi032.stdout:630.out 2023-10-08T06:12:30.969 INFO:teuthology.orchestra.run.smithi032.stdout:631 2023-10-08T06:12:30.969 INFO:teuthology.orchestra.run.smithi032.stdout:631.out 2023-10-08T06:12:30.969 INFO:teuthology.orchestra.run.smithi032.stdout:632 2023-10-08T06:12:30.969 INFO:teuthology.orchestra.run.smithi032.stdout:632.out 2023-10-08T06:12:30.969 INFO:teuthology.orchestra.run.smithi032.stdout:633 2023-10-08T06:12:30.969 INFO:teuthology.orchestra.run.smithi032.stdout:633.out 2023-10-08T06:12:30.969 INFO:teuthology.orchestra.run.smithi032.stdout:634 2023-10-08T06:12:30.969 INFO:teuthology.orchestra.run.smithi032.stdout:634.out 2023-10-08T06:12:30.969 INFO:teuthology.orchestra.run.smithi032.stdout:635 2023-10-08T06:12:30.969 INFO:teuthology.orchestra.run.smithi032.stdout:635.out 2023-10-08T06:12:30.970 INFO:teuthology.orchestra.run.smithi032.stdout:636 2023-10-08T06:12:30.970 INFO:teuthology.orchestra.run.smithi032.stdout:636.out 2023-10-08T06:12:30.970 INFO:teuthology.orchestra.run.smithi032.stdout:637 2023-10-08T06:12:30.970 INFO:teuthology.orchestra.run.smithi032.stdout:637.out 2023-10-08T06:12:30.970 INFO:teuthology.orchestra.run.smithi032.stdout:638 2023-10-08T06:12:30.970 INFO:teuthology.orchestra.run.smithi032.stdout:638.out 2023-10-08T06:12:30.970 INFO:teuthology.orchestra.run.smithi032.stdout:639 2023-10-08T06:12:30.970 INFO:teuthology.orchestra.run.smithi032.stdout:639.out 2023-10-08T06:12:30.970 INFO:teuthology.orchestra.run.smithi032.stdout:640 2023-10-08T06:12:30.970 INFO:teuthology.orchestra.run.smithi032.stdout:640.out 2023-10-08T06:12:30.971 INFO:teuthology.orchestra.run.smithi032.stdout:641 2023-10-08T06:12:30.971 INFO:teuthology.orchestra.run.smithi032.stdout:641.out 2023-10-08T06:12:30.971 INFO:teuthology.orchestra.run.smithi032.stdout:642 2023-10-08T06:12:30.971 INFO:teuthology.orchestra.run.smithi032.stdout:642.out 2023-10-08T06:12:30.971 INFO:teuthology.orchestra.run.smithi032.stdout:643 2023-10-08T06:12:30.971 INFO:teuthology.orchestra.run.smithi032.stdout:643.out 2023-10-08T06:12:30.971 INFO:teuthology.orchestra.run.smithi032.stdout:644 2023-10-08T06:12:30.971 INFO:teuthology.orchestra.run.smithi032.stdout:644.out 2023-10-08T06:12:30.971 INFO:teuthology.orchestra.run.smithi032.stdout:645 2023-10-08T06:12:30.971 INFO:teuthology.orchestra.run.smithi032.stdout:645.out 2023-10-08T06:12:30.971 INFO:teuthology.orchestra.run.smithi032.stdout:646 2023-10-08T06:12:30.971 INFO:teuthology.orchestra.run.smithi032.stdout:646.out 2023-10-08T06:12:30.971 INFO:teuthology.orchestra.run.smithi032.stdout:647 2023-10-08T06:12:30.971 INFO:teuthology.orchestra.run.smithi032.stdout:647.out 2023-10-08T06:12:30.972 INFO:teuthology.orchestra.run.smithi032.stdout:648 2023-10-08T06:12:30.972 INFO:teuthology.orchestra.run.smithi032.stdout:648.out 2023-10-08T06:12:30.972 INFO:teuthology.orchestra.run.smithi032.stdout:649 2023-10-08T06:12:30.972 INFO:teuthology.orchestra.run.smithi032.stdout:649.out 2023-10-08T06:12:30.972 INFO:teuthology.orchestra.run.smithi032.stdout:650 2023-10-08T06:12:30.972 INFO:teuthology.orchestra.run.smithi032.stdout:650.out 2023-10-08T06:12:30.972 INFO:teuthology.orchestra.run.smithi032.stdout:651 2023-10-08T06:12:30.972 INFO:teuthology.orchestra.run.smithi032.stdout:651.out 2023-10-08T06:12:30.972 INFO:teuthology.orchestra.run.smithi032.stdout:652 2023-10-08T06:12:30.972 INFO:teuthology.orchestra.run.smithi032.stdout:652.out 2023-10-08T06:12:30.972 INFO:teuthology.orchestra.run.smithi032.stdout:653 2023-10-08T06:12:30.972 INFO:teuthology.orchestra.run.smithi032.stdout:653.out 2023-10-08T06:12:30.973 INFO:teuthology.orchestra.run.smithi032.stdout:654 2023-10-08T06:12:30.973 INFO:teuthology.orchestra.run.smithi032.stdout:654.out 2023-10-08T06:12:30.973 INFO:teuthology.orchestra.run.smithi032.stdout:655 2023-10-08T06:12:30.973 INFO:teuthology.orchestra.run.smithi032.stdout:655.out 2023-10-08T06:12:30.973 INFO:teuthology.orchestra.run.smithi032.stdout:656 2023-10-08T06:12:30.973 INFO:teuthology.orchestra.run.smithi032.stdout:656.out 2023-10-08T06:12:30.973 INFO:teuthology.orchestra.run.smithi032.stdout:657 2023-10-08T06:12:30.973 INFO:teuthology.orchestra.run.smithi032.stdout:657.out 2023-10-08T06:12:30.973 INFO:teuthology.orchestra.run.smithi032.stdout:658 2023-10-08T06:12:30.973 INFO:teuthology.orchestra.run.smithi032.stdout:658.out 2023-10-08T06:12:30.973 INFO:teuthology.orchestra.run.smithi032.stdout:659 2023-10-08T06:12:30.973 INFO:teuthology.orchestra.run.smithi032.stdout:659.out 2023-10-08T06:12:30.973 INFO:teuthology.orchestra.run.smithi032.stdout:660 2023-10-08T06:12:30.974 INFO:teuthology.orchestra.run.smithi032.stdout:660.out 2023-10-08T06:12:30.974 INFO:teuthology.orchestra.run.smithi032.stdout:661 2023-10-08T06:12:30.974 INFO:teuthology.orchestra.run.smithi032.stdout:661.out 2023-10-08T06:12:30.974 INFO:teuthology.orchestra.run.smithi032.stdout:662 2023-10-08T06:12:30.974 INFO:teuthology.orchestra.run.smithi032.stdout:662.out 2023-10-08T06:12:30.974 INFO:teuthology.orchestra.run.smithi032.stdout:663 2023-10-08T06:12:30.974 INFO:teuthology.orchestra.run.smithi032.stdout:663.out 2023-10-08T06:12:30.974 INFO:teuthology.orchestra.run.smithi032.stdout:664 2023-10-08T06:12:30.974 INFO:teuthology.orchestra.run.smithi032.stdout:664.out 2023-10-08T06:12:30.974 INFO:teuthology.orchestra.run.smithi032.stdout:665 2023-10-08T06:12:30.974 INFO:teuthology.orchestra.run.smithi032.stdout:665.out 2023-10-08T06:12:30.975 INFO:teuthology.orchestra.run.smithi032.stdout:666 2023-10-08T06:12:30.975 INFO:teuthology.orchestra.run.smithi032.stdout:666.out 2023-10-08T06:12:30.975 INFO:teuthology.orchestra.run.smithi032.stdout:667 2023-10-08T06:12:30.975 INFO:teuthology.orchestra.run.smithi032.stdout:667.out 2023-10-08T06:12:30.975 INFO:teuthology.orchestra.run.smithi032.stdout:668 2023-10-08T06:12:30.975 INFO:teuthology.orchestra.run.smithi032.stdout:668.out 2023-10-08T06:12:30.975 INFO:teuthology.orchestra.run.smithi032.stdout:669 2023-10-08T06:12:30.975 INFO:teuthology.orchestra.run.smithi032.stdout:669.out 2023-10-08T06:12:30.975 INFO:teuthology.orchestra.run.smithi032.stdout:670 2023-10-08T06:12:30.975 INFO:teuthology.orchestra.run.smithi032.stdout:670.out 2023-10-08T06:12:30.975 INFO:teuthology.orchestra.run.smithi032.stdout:671 2023-10-08T06:12:30.975 INFO:teuthology.orchestra.run.smithi032.stdout:671.out 2023-10-08T06:12:30.976 INFO:teuthology.orchestra.run.smithi032.stdout:672 2023-10-08T06:12:30.976 INFO:teuthology.orchestra.run.smithi032.stdout:672.out 2023-10-08T06:12:30.976 INFO:teuthology.orchestra.run.smithi032.stdout:673 2023-10-08T06:12:30.976 INFO:teuthology.orchestra.run.smithi032.stdout:673.out 2023-10-08T06:12:30.976 INFO:teuthology.orchestra.run.smithi032.stdout:674 2023-10-08T06:12:30.976 INFO:teuthology.orchestra.run.smithi032.stdout:674.out 2023-10-08T06:12:30.976 INFO:teuthology.orchestra.run.smithi032.stdout:675 2023-10-08T06:12:30.976 INFO:teuthology.orchestra.run.smithi032.stdout:675.out 2023-10-08T06:12:30.976 INFO:teuthology.orchestra.run.smithi032.stdout:676 2023-10-08T06:12:30.976 INFO:teuthology.orchestra.run.smithi032.stdout:676.out 2023-10-08T06:12:30.976 INFO:teuthology.orchestra.run.smithi032.stdout:677 2023-10-08T06:12:30.976 INFO:teuthology.orchestra.run.smithi032.stdout:677.out 2023-10-08T06:12:30.977 INFO:teuthology.orchestra.run.smithi032.stdout:678 2023-10-08T06:12:30.977 INFO:teuthology.orchestra.run.smithi032.stdout:678.out 2023-10-08T06:12:30.977 INFO:teuthology.orchestra.run.smithi032.stdout:679 2023-10-08T06:12:30.977 INFO:teuthology.orchestra.run.smithi032.stdout:679.out 2023-10-08T06:12:30.977 INFO:teuthology.orchestra.run.smithi032.stdout:680 2023-10-08T06:12:30.977 INFO:teuthology.orchestra.run.smithi032.stdout:680.out 2023-10-08T06:12:30.977 INFO:teuthology.orchestra.run.smithi032.stdout:681 2023-10-08T06:12:30.977 INFO:teuthology.orchestra.run.smithi032.stdout:681.out 2023-10-08T06:12:30.977 INFO:teuthology.orchestra.run.smithi032.stdout:682 2023-10-08T06:12:30.977 INFO:teuthology.orchestra.run.smithi032.stdout:682.out 2023-10-08T06:12:30.977 INFO:teuthology.orchestra.run.smithi032.stdout:683 2023-10-08T06:12:30.977 INFO:teuthology.orchestra.run.smithi032.stdout:683.out 2023-10-08T06:12:30.978 INFO:teuthology.orchestra.run.smithi032.stdout:684 2023-10-08T06:12:30.978 INFO:teuthology.orchestra.run.smithi032.stdout:684.out 2023-10-08T06:12:30.978 INFO:teuthology.orchestra.run.smithi032.stdout:685 2023-10-08T06:12:30.978 INFO:teuthology.orchestra.run.smithi032.stdout:685.out 2023-10-08T06:12:30.978 INFO:teuthology.orchestra.run.smithi032.stdout:686 2023-10-08T06:12:30.978 INFO:teuthology.orchestra.run.smithi032.stdout:686.out 2023-10-08T06:12:30.978 INFO:teuthology.orchestra.run.smithi032.stdout:687 2023-10-08T06:12:30.978 INFO:teuthology.orchestra.run.smithi032.stdout:687.out 2023-10-08T06:12:30.978 INFO:teuthology.orchestra.run.smithi032.stdout:688 2023-10-08T06:12:30.978 INFO:teuthology.orchestra.run.smithi032.stdout:688.out 2023-10-08T06:12:30.978 INFO:teuthology.orchestra.run.smithi032.stdout:689 2023-10-08T06:12:30.978 INFO:teuthology.orchestra.run.smithi032.stdout:689.out 2023-10-08T06:12:30.979 INFO:teuthology.orchestra.run.smithi032.stdout:690 2023-10-08T06:12:30.979 INFO:teuthology.orchestra.run.smithi032.stdout:690.out 2023-10-08T06:12:30.979 INFO:teuthology.orchestra.run.smithi032.stdout:691 2023-10-08T06:12:30.979 INFO:teuthology.orchestra.run.smithi032.stdout:691.out 2023-10-08T06:12:30.979 INFO:teuthology.orchestra.run.smithi032.stdout:692 2023-10-08T06:12:30.979 INFO:teuthology.orchestra.run.smithi032.stdout:692.out 2023-10-08T06:12:30.979 INFO:teuthology.orchestra.run.smithi032.stdout:693 2023-10-08T06:12:30.979 INFO:teuthology.orchestra.run.smithi032.stdout:693.out 2023-10-08T06:12:30.979 INFO:teuthology.orchestra.run.smithi032.stdout:694 2023-10-08T06:12:30.979 INFO:teuthology.orchestra.run.smithi032.stdout:694.out 2023-10-08T06:12:30.979 INFO:teuthology.orchestra.run.smithi032.stdout:695 2023-10-08T06:12:30.979 INFO:teuthology.orchestra.run.smithi032.stdout:695.out 2023-10-08T06:12:30.980 INFO:teuthology.orchestra.run.smithi032.stdout:696 2023-10-08T06:12:30.980 INFO:teuthology.orchestra.run.smithi032.stdout:696.out 2023-10-08T06:12:30.980 INFO:teuthology.orchestra.run.smithi032.stdout:697 2023-10-08T06:12:30.980 INFO:teuthology.orchestra.run.smithi032.stdout:697.out 2023-10-08T06:12:30.980 INFO:teuthology.orchestra.run.smithi032.stdout:698 2023-10-08T06:12:30.980 INFO:teuthology.orchestra.run.smithi032.stdout:698.out 2023-10-08T06:12:30.980 INFO:teuthology.orchestra.run.smithi032.stdout:699 2023-10-08T06:12:30.980 INFO:teuthology.orchestra.run.smithi032.stdout:699.out 2023-10-08T06:12:30.980 INFO:teuthology.orchestra.run.smithi032.stdout:700 2023-10-08T06:12:30.980 INFO:teuthology.orchestra.run.smithi032.stdout:700.out 2023-10-08T06:12:30.980 INFO:teuthology.orchestra.run.smithi032.stdout:701 2023-10-08T06:12:30.980 INFO:teuthology.orchestra.run.smithi032.stdout:701.out 2023-10-08T06:12:30.981 INFO:teuthology.orchestra.run.smithi032.stdout:702 2023-10-08T06:12:30.981 INFO:teuthology.orchestra.run.smithi032.stdout:702.out 2023-10-08T06:12:30.981 INFO:teuthology.orchestra.run.smithi032.stdout:703 2023-10-08T06:12:30.981 INFO:teuthology.orchestra.run.smithi032.stdout:703.out 2023-10-08T06:12:30.981 INFO:teuthology.orchestra.run.smithi032.stdout:704 2023-10-08T06:12:30.981 INFO:teuthology.orchestra.run.smithi032.stdout:704.out 2023-10-08T06:12:30.981 INFO:teuthology.orchestra.run.smithi032.stdout:705 2023-10-08T06:12:30.981 INFO:teuthology.orchestra.run.smithi032.stdout:705.out 2023-10-08T06:12:30.981 INFO:teuthology.orchestra.run.smithi032.stdout:706 2023-10-08T06:12:30.981 INFO:teuthology.orchestra.run.smithi032.stdout:706.out 2023-10-08T06:12:30.981 INFO:teuthology.orchestra.run.smithi032.stdout:707 2023-10-08T06:12:30.981 INFO:teuthology.orchestra.run.smithi032.stdout:707.out 2023-10-08T06:12:30.982 INFO:teuthology.orchestra.run.smithi032.stdout:708 2023-10-08T06:12:30.982 INFO:teuthology.orchestra.run.smithi032.stdout:708.out 2023-10-08T06:12:30.982 INFO:teuthology.orchestra.run.smithi032.stdout:709 2023-10-08T06:12:30.982 INFO:teuthology.orchestra.run.smithi032.stdout:709.out 2023-10-08T06:12:30.982 INFO:teuthology.orchestra.run.smithi032.stdout:710 2023-10-08T06:12:30.982 INFO:teuthology.orchestra.run.smithi032.stdout:710.out 2023-10-08T06:12:30.982 INFO:teuthology.orchestra.run.smithi032.stdout:711 2023-10-08T06:12:30.982 INFO:teuthology.orchestra.run.smithi032.stdout:711.out 2023-10-08T06:12:30.982 INFO:teuthology.orchestra.run.smithi032.stdout:712 2023-10-08T06:12:30.982 INFO:teuthology.orchestra.run.smithi032.stdout:712.out 2023-10-08T06:12:30.982 INFO:teuthology.orchestra.run.smithi032.stdout:713 2023-10-08T06:12:30.982 INFO:teuthology.orchestra.run.smithi032.stdout:713.out 2023-10-08T06:12:30.983 INFO:teuthology.orchestra.run.smithi032.stdout:714 2023-10-08T06:12:30.983 INFO:teuthology.orchestra.run.smithi032.stdout:714.out 2023-10-08T06:12:30.983 INFO:teuthology.orchestra.run.smithi032.stdout:715 2023-10-08T06:12:30.983 INFO:teuthology.orchestra.run.smithi032.stdout:715.out 2023-10-08T06:12:30.983 INFO:teuthology.orchestra.run.smithi032.stdout:716 2023-10-08T06:12:30.983 INFO:teuthology.orchestra.run.smithi032.stdout:716.out 2023-10-08T06:12:30.983 INFO:teuthology.orchestra.run.smithi032.stdout:717 2023-10-08T06:12:30.983 INFO:teuthology.orchestra.run.smithi032.stdout:717.out 2023-10-08T06:12:30.983 INFO:teuthology.orchestra.run.smithi032.stdout:718 2023-10-08T06:12:30.983 INFO:teuthology.orchestra.run.smithi032.stdout:718.out 2023-10-08T06:12:30.983 INFO:teuthology.orchestra.run.smithi032.stdout:719 2023-10-08T06:12:30.983 INFO:teuthology.orchestra.run.smithi032.stdout:719.out 2023-10-08T06:12:30.984 INFO:teuthology.orchestra.run.smithi032.stdout:720 2023-10-08T06:12:30.984 INFO:teuthology.orchestra.run.smithi032.stdout:720.out 2023-10-08T06:12:30.984 INFO:teuthology.orchestra.run.smithi032.stdout:721 2023-10-08T06:12:30.984 INFO:teuthology.orchestra.run.smithi032.stdout:721.out 2023-10-08T06:12:30.984 INFO:teuthology.orchestra.run.smithi032.stdout:722 2023-10-08T06:12:30.984 INFO:teuthology.orchestra.run.smithi032.stdout:722.out 2023-10-08T06:12:30.984 INFO:teuthology.orchestra.run.smithi032.stdout:723 2023-10-08T06:12:30.984 INFO:teuthology.orchestra.run.smithi032.stdout:723.out 2023-10-08T06:12:30.984 INFO:teuthology.orchestra.run.smithi032.stdout:724 2023-10-08T06:12:30.984 INFO:teuthology.orchestra.run.smithi032.stdout:724.out 2023-10-08T06:12:30.984 INFO:teuthology.orchestra.run.smithi032.stdout:725 2023-10-08T06:12:30.984 INFO:teuthology.orchestra.run.smithi032.stdout:725.out 2023-10-08T06:12:30.985 INFO:teuthology.orchestra.run.smithi032.stdout:726 2023-10-08T06:12:30.985 INFO:teuthology.orchestra.run.smithi032.stdout:726.out 2023-10-08T06:12:30.985 INFO:teuthology.orchestra.run.smithi032.stdout:727 2023-10-08T06:12:30.985 INFO:teuthology.orchestra.run.smithi032.stdout:727.out 2023-10-08T06:12:30.985 INFO:teuthology.orchestra.run.smithi032.stdout:728 2023-10-08T06:12:30.985 INFO:teuthology.orchestra.run.smithi032.stdout:728.out 2023-10-08T06:12:30.985 INFO:teuthology.orchestra.run.smithi032.stdout:729 2023-10-08T06:12:30.985 INFO:teuthology.orchestra.run.smithi032.stdout:729.out 2023-10-08T06:12:30.985 INFO:teuthology.orchestra.run.smithi032.stdout:730 2023-10-08T06:12:30.985 INFO:teuthology.orchestra.run.smithi032.stdout:730.out 2023-10-08T06:12:30.985 INFO:teuthology.orchestra.run.smithi032.stdout:731 2023-10-08T06:12:30.985 INFO:teuthology.orchestra.run.smithi032.stdout:731.out 2023-10-08T06:12:30.986 INFO:teuthology.orchestra.run.smithi032.stdout:group.list 2023-10-08T06:12:30.986 INFO:teuthology.orchestra.run.smithi032.stdout:Makefile 2023-10-08T06:12:30.987 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/001) 2023-10-08T06:12:31.294 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T06:12:31.303 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T06:12:31.303 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:12:34.542 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T06:12:34.545 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T06:12:35.712 INFO:teuthology.orchestra.run.smithi032.stdout:generic/001 4s 2023-10-08T06:12:35.723 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/001 2023-10-08T06:12:35.724 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T06:12:35.729 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:12:35.733 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi032.stderr:ceph-fuse[45161]: fuse finished with error 0 and tester_r 0 2023-10-08T06:12:35.746 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T06:12:35.746 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/002) 2023-10-08T06:12:36.049 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T06:12:36.058 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T06:12:36.058 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:12:37.137 INFO:teuthology.orchestra.run.smithi032.stdout:generic/002 1s 2023-10-08T06:12:37.150 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/002 2023-10-08T06:12:37.151 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T06:12:37.155 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:12:37.170 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T06:12:37.171 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/003) 2023-10-08T06:12:37.480 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T06:12:37.489 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T06:12:37.489 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:12:37.740 INFO:teuthology.orchestra.run.smithi032.stdout:generic/003 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T06:12:37.748 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/003 2023-10-08T06:12:37.748 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/003 2023-10-08T06:12:37.748 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T06:12:37.754 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:12:37.773 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T06:12:37.773 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/004) 2023-10-08T06:12:38.078 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T06:12:38.087 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T06:12:38.088 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:12:38.348 INFO:teuthology.orchestra.run.smithi032.stdout:generic/004 [not run] O_TMPFILE is not supported 2023-10-08T06:12:38.357 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/004 2023-10-08T06:12:38.357 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/004 2023-10-08T06:12:38.358 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T06:12:38.364 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:12:38.382 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T06:12:38.383 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/005) 2023-10-08T06:12:38.689 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T06:12:38.697 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T06:12:38.698 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:12:39.976 INFO:teuthology.orchestra.run.smithi032.stdout:generic/005 1s 2023-10-08T06:12:39.988 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/005 2023-10-08T06:12:39.989 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T06:12:39.994 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:12:40.014 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T06:12:40.014 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/006) 2023-10-08T06:12:40.319 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T06:12:40.329 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T06:12:40.329 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:13:04.613 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T06:13:04.616 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T06:13:34.683 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T06:13:34.686 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T06:13:41.775 INFO:teuthology.orchestra.run.smithi032.stdout:generic/006 61s 2023-10-08T06:13:41.785 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/006 2023-10-08T06:13:41.785 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T06:13:41.789 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:13:41.804 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T06:13:41.805 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/007) 2023-10-08T06:13:42.110 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T06:13:42.119 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T06:13:42.120 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:14:04.732 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T06:14:04.735 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T06:14:35.117 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T06:14:35.120 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T06:15:05.164 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T06:15:05.167 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T06:15:35.386 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T06:15:35.389 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T06:16:01.204 INFO:teuthology.orchestra.run.smithi032.stdout:generic/007 139s 2023-10-08T06:16:01.216 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/007 2023-10-08T06:16:01.216 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T06:16:01.221 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:16:01.244 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T06:16:01.245 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/008) 2023-10-08T06:16:01.545 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T06:16:01.554 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T06:16:01.555 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:16:03.947 INFO:teuthology.orchestra.run.smithi032.stdout:generic/008 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-10-08T06:16:03.952 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/008 2023-10-08T06:16:03.952 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/008 2023-10-08T06:16:03.952 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T06:16:03.955 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:16:03.970 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T06:16:03.970 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/009) 2023-10-08T06:16:04.273 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T06:16:04.283 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T06:16:04.283 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:16:05.437 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T06:16:05.439 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T06:16:06.176 INFO:teuthology.orchestra.run.smithi032.stdout:generic/009 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-10-08T06:16:06.184 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/009 2023-10-08T06:16:06.185 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/009 2023-10-08T06:16:06.185 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T06:16:06.190 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:16:06.209 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T06:16:06.210 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/010) 2023-10-08T06:16:06.521 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T06:16:06.531 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T06:16:06.532 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:16:06.785 INFO:teuthology.orchestra.run.smithi032.stdout:generic/010 [not run] /tmp/tmp.p8vAuQqzIgxfstests-dev/src/dbtest not built 2023-10-08T06:16:06.793 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/010 2023-10-08T06:16:06.793 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/010 2023-10-08T06:16:06.794 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T06:16:06.799 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:16:06.816 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T06:16:06.816 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/011) 2023-10-08T06:16:07.115 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T06:16:07.125 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T06:16:07.125 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:16:35.508 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T06:16:35.510 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T06:17:03.368 INFO:teuthology.orchestra.run.smithi032.stdout:generic/011 56s 2023-10-08T06:17:03.380 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/011 2023-10-08T06:17:03.380 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T06:17:03.386 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:17:03.406 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T06:17:03.407 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/012) 2023-10-08T06:17:03.710 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T06:17:03.722 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T06:17:03.722 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:17:06.015 INFO:teuthology.orchestra.run.smithi032.stdout:generic/012 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-10-08T06:17:06.024 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/012 2023-10-08T06:17:06.024 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/012 2023-10-08T06:17:06.024 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T06:17:06.029 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:17:06.047 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T06:17:06.047 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/013) 2023-10-08T06:17:06.081 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T06:17:06.084 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T06:17:06.356 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T06:17:06.366 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T06:17:06.366 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:17:36.425 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T06:17:36.428 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T06:18:07.063 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T06:18:07.066 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T06:18:37.385 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T06:18:37.388 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T06:18:48.796 INFO:teuthology.orchestra.run.smithi032.stdout:generic/013 102s 2023-10-08T06:18:48.872 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/013 2023-10-08T06:18:48.872 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T06:18:48.876 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:18:48.891 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T06:18:48.891 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/014) 2023-10-08T06:18:49.211 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T06:18:49.222 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T06:18:49.222 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:19:07.781 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T06:19:07.784 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T06:19:07.839 INFO:tasks.ceph.mds.d.smithi040.stderr:2023-10-08T06:19:07.832+0000 7fa77bedd700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 42019) UID: 0 2023-10-08T06:19:07.840 INFO:tasks.ceph.mds.b.smithi040.stderr:2023-10-08T06:19:07.832+0000 7f4c7640d700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 42019) UID: 0 2023-10-08T06:22:11.521 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T06:22:11.524 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T06:22:41.571 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T06:22:41.573 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T06:23:11.634 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T06:23:11.637 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T06:23:42.008 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T06:23:42.011 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T06:24:12.092 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T06:24:12.095 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T06:24:27.346 INFO:teuthology.orchestra.run.smithi032.stdout:generic/014 338s 2023-10-08T06:24:27.355 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/014 2023-10-08T06:24:27.355 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T06:24:27.374 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:24:27.389 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T06:24:27.389 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/015) 2023-10-08T06:24:27.841 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T06:24:27.850 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T06:24:27.850 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:24:28.117 INFO:teuthology.orchestra.run.smithi032.stdout:generic/015 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T06:24:28.126 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/015 2023-10-08T06:24:28.126 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/015 2023-10-08T06:24:28.126 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T06:24:28.132 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:24:28.159 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T06:24:28.159 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/016) 2023-10-08T06:24:28.486 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T06:24:28.502 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T06:24:28.503 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:24:30.286 INFO:teuthology.orchestra.run.smithi032.stdout:generic/016 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-10-08T06:24:30.312 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/016 2023-10-08T06:24:30.312 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/016 2023-10-08T06:24:30.312 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T06:24:30.316 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:24:30.333 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T06:24:30.333 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/017) 2023-10-08T06:24:30.737 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T06:24:30.741 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T06:24:30.741 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:24:31.050 INFO:teuthology.orchestra.run.smithi032.stdout:generic/017 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T06:24:31.054 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/017 2023-10-08T06:24:31.054 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/017 2023-10-08T06:24:31.054 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T06:24:31.061 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:24:31.076 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T06:24:31.077 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/018) 2023-10-08T06:24:31.461 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T06:24:31.467 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T06:24:31.467 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:24:31.744 INFO:teuthology.orchestra.run.smithi032.stdout:generic/018 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T06:24:31.753 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/018 2023-10-08T06:24:31.753 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/018 2023-10-08T06:24:31.753 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T06:24:31.758 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:24:31.775 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T06:24:31.775 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/019) 2023-10-08T06:24:32.143 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T06:24:32.149 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T06:24:32.149 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:24:32.436 INFO:teuthology.orchestra.run.smithi032.stdout:generic/019 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T06:24:32.442 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/019 2023-10-08T06:24:32.442 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/019 2023-10-08T06:24:32.442 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T06:24:32.448 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:24:32.466 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T06:24:32.467 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/020) 2023-10-08T06:24:32.894 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T06:24:32.899 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T06:24:32.900 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:24:42.502 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T06:24:42.504 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T06:24:47.891 INFO:teuthology.orchestra.run.smithi032.stdout:generic/020 - output mismatch (see /tmp/tmp.p8vAuQqzIgxfstests-dev/results//generic/020.out.bad) 2023-10-08T06:24:47.894 INFO:teuthology.orchestra.run.smithi032.stdout: --- tests/generic/020.out 2023-10-08 06:10:44.399319240 +0000 2023-10-08T06:24:47.894 INFO:teuthology.orchestra.run.smithi032.stdout: +++ /tmp/tmp.p8vAuQqzIgxfstests-dev/results//generic/020.out.bad 2023-10-08 06:24:47.884938942 +0000 2023-10-08T06:24:47.894 INFO:teuthology.orchestra.run.smithi032.stdout: @@ -47,9 +47,13 @@ 2023-10-08T06:24:47.895 INFO:teuthology.orchestra.run.smithi032.stdout: user.snrub="fish2\012" 2023-10-08T06:24:47.895 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:24:47.895 INFO:teuthology.orchestra.run.smithi032.stdout: *** really long value 2023-10-08T06:24:47.895 INFO:teuthology.orchestra.run.smithi032.stdout: -0000000 00 2023-10-08T06:24:47.895 INFO:teuthology.orchestra.run.smithi032.stdout: -* 2023-10-08T06:24:47.895 INFO:teuthology.orchestra.run.smithi032.stdout: -ATTRSIZE 2023-10-08T06:24:47.895 INFO:teuthology.orchestra.run.smithi032.stdout: +attr_set: No space left on device 2023-10-08T06:24:47.895 INFO:teuthology.orchestra.run.smithi032.stdout: +Could not set "long_attr" for 2023-10-08T06:24:47.895 INFO:teuthology.orchestra.run.smithi032.stdout: +attr_get: No data available 2023-10-08T06:24:47.895 INFO:teuthology.orchestra.run.smithi032.stdout: +Could not get "long_attr" for 2023-10-08T06:24:47.896 INFO:teuthology.orchestra.run.smithi032.stdout: +0000000 2023-10-08T06:24:47.896 INFO:teuthology.orchestra.run.smithi032.stdout: +attr_remove: No data available 2023-10-08T06:24:47.896 INFO:teuthology.orchestra.run.smithi032.stdout: +Could not remove "long_attr" for 2023-10-08T06:24:47.896 INFO:teuthology.orchestra.run.smithi032.stdout: *** set/get/remove really long names (expect failure) 2023-10-08T06:24:47.896 INFO:teuthology.orchestra.run.smithi032.stdout: attr_set: Invalid argument 2023-10-08T06:24:47.896 INFO:teuthology.orchestra.run.smithi032.stdout: Could not set "XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX" for 2023-10-08T06:24:47.898 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/020 2023-10-08T06:24:47.899 INFO:teuthology.orchestra.run.smithi032.stdout:Failures: generic/020 2023-10-08T06:24:47.899 INFO:teuthology.orchestra.run.smithi032.stdout:Failed 1 of 1 tests 2023-10-08T06:24:47.907 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:24:47.920 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T06:24:47.920 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-10-08T06:24:47.920 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-10-08T06:24:47.921 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/021) 2023-10-08T06:24:48.318 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T06:24:48.330 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T06:24:48.330 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:24:50.190 INFO:teuthology.orchestra.run.smithi032.stdout:generic/021 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-10-08T06:24:50.200 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/021 2023-10-08T06:24:50.200 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/021 2023-10-08T06:24:50.200 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T06:24:50.209 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:24:50.227 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T06:24:50.228 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/022) 2023-10-08T06:24:50.573 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T06:24:50.578 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T06:24:50.578 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:24:52.362 INFO:teuthology.orchestra.run.smithi032.stdout:generic/022 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-10-08T06:24:52.378 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/022 2023-10-08T06:24:52.378 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/022 2023-10-08T06:24:52.379 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T06:24:52.383 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:24:52.403 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T06:24:52.404 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/023) 2023-10-08T06:24:52.772 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T06:24:52.788 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T06:24:52.788 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:24:55.170 INFO:teuthology.orchestra.run.smithi032.stdout:generic/023 3s 2023-10-08T06:24:55.185 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/023 2023-10-08T06:24:55.185 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T06:24:55.195 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:24:55.209 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T06:24:55.209 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/024) 2023-10-08T06:24:55.529 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T06:24:55.537 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T06:24:55.538 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:24:55.865 INFO:teuthology.orchestra.run.smithi032.stdout:generic/024 [not run] kernel doesn't support renameat2 syscall 2023-10-08T06:24:55.876 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/024 2023-10-08T06:24:55.876 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/024 2023-10-08T06:24:55.876 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T06:24:55.879 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:24:55.897 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T06:24:55.897 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/025) 2023-10-08T06:24:56.269 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T06:24:56.274 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T06:24:56.275 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:24:56.569 INFO:teuthology.orchestra.run.smithi032.stdout:generic/025 [not run] kernel doesn't support renameat2 syscall 2023-10-08T06:24:56.574 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/025 2023-10-08T06:24:56.574 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/025 2023-10-08T06:24:56.575 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T06:24:56.589 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:24:56.614 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T06:24:56.614 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/026) 2023-10-08T06:24:57.000 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T06:24:57.012 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T06:24:57.012 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:24:57.354 INFO:teuthology.orchestra.run.smithi032.stdout:generic/026 [not run] ACLs not supported by this filesystem type: ceph-fuse 2023-10-08T06:24:57.370 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/026 2023-10-08T06:24:57.370 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/026 2023-10-08T06:24:57.371 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T06:24:57.373 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:24:57.387 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T06:24:57.388 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/027) 2023-10-08T06:24:57.766 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T06:24:57.781 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T06:24:57.782 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:24:58.026 INFO:teuthology.orchestra.run.smithi032.stdout:generic/027 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T06:24:58.049 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/027 2023-10-08T06:24:58.049 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/027 2023-10-08T06:24:58.049 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T06:24:58.059 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:24:58.085 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T06:24:58.085 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/028) 2023-10-08T06:24:58.454 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T06:24:58.467 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T06:24:58.467 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:25:03.778 INFO:teuthology.orchestra.run.smithi032.stdout:generic/028 5s 2023-10-08T06:25:03.788 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/028 2023-10-08T06:25:03.788 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T06:25:03.794 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:25:03.813 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T06:25:03.814 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/029) 2023-10-08T06:25:04.148 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T06:25:04.155 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T06:25:04.155 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:25:04.426 INFO:teuthology.orchestra.run.smithi032.stdout:generic/029 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T06:25:04.432 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/029 2023-10-08T06:25:04.433 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/029 2023-10-08T06:25:04.433 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T06:25:04.436 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:25:04.455 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T06:25:04.456 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/030) 2023-10-08T06:25:04.840 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T06:25:04.860 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T06:25:04.860 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:25:05.107 INFO:teuthology.orchestra.run.smithi032.stdout:generic/030 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T06:25:05.123 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/030 2023-10-08T06:25:05.123 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/030 2023-10-08T06:25:05.124 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T06:25:05.126 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:25:05.144 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T06:25:05.145 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/031) 2023-10-08T06:25:05.542 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T06:25:05.547 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T06:25:05.548 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:25:05.830 INFO:teuthology.orchestra.run.smithi032.stdout:generic/031 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T06:25:05.835 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/031 2023-10-08T06:25:05.835 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/031 2023-10-08T06:25:05.835 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T06:25:05.840 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:25:05.860 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T06:25:05.861 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/032) 2023-10-08T06:25:06.245 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T06:25:06.256 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T06:25:06.256 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:25:06.508 INFO:teuthology.orchestra.run.smithi032.stdout:generic/032 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T06:25:06.516 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/032 2023-10-08T06:25:06.516 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/032 2023-10-08T06:25:06.516 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T06:25:06.519 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:25:06.542 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T06:25:06.543 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/033) 2023-10-08T06:25:06.959 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T06:25:06.966 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T06:25:06.967 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:25:07.226 INFO:teuthology.orchestra.run.smithi032.stdout:generic/033 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T06:25:07.239 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/033 2023-10-08T06:25:07.239 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/033 2023-10-08T06:25:07.239 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T06:25:07.248 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:25:07.260 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T06:25:07.261 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/034) 2023-10-08T06:25:07.658 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T06:25:07.665 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T06:25:07.665 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:25:07.929 INFO:teuthology.orchestra.run.smithi032.stdout:generic/034 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T06:25:07.938 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/034 2023-10-08T06:25:07.938 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/034 2023-10-08T06:25:07.938 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T06:25:07.946 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:25:07.963 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T06:25:07.963 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/035) 2023-10-08T06:25:08.371 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T06:25:08.379 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T06:25:08.379 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:25:08.801 INFO:teuthology.orchestra.run.smithi032.stdout:generic/035 0s 2023-10-08T06:25:08.814 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/035 2023-10-08T06:25:08.814 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T06:25:08.823 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:25:08.843 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T06:25:08.843 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/036) 2023-10-08T06:25:09.254 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T06:25:09.277 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T06:25:09.277 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:25:12.544 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T06:25:12.547 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T06:25:19.778 INFO:teuthology.orchestra.run.smithi032.stdout:generic/036 10s 2023-10-08T06:25:19.792 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/036 2023-10-08T06:25:19.792 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T06:25:19.795 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:25:19.824 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T06:25:19.824 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/037) 2023-10-08T06:25:20.171 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T06:25:20.177 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T06:25:20.177 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:25:20.442 INFO:teuthology.orchestra.run.smithi032.stdout:generic/037 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T06:25:20.455 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/037 2023-10-08T06:25:20.455 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/037 2023-10-08T06:25:20.455 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T06:25:20.457 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:25:20.475 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T06:25:20.476 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/038) 2023-10-08T06:25:20.865 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T06:25:20.875 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T06:25:20.875 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:25:21.119 INFO:teuthology.orchestra.run.smithi032.stdout:generic/038 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T06:25:21.125 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/038 2023-10-08T06:25:21.125 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/038 2023-10-08T06:25:21.125 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T06:25:21.128 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:25:21.141 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T06:25:21.141 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/039) 2023-10-08T06:25:21.529 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T06:25:21.545 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T06:25:21.545 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:25:21.808 INFO:teuthology.orchestra.run.smithi032.stdout:generic/039 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T06:25:21.813 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/039 2023-10-08T06:25:21.814 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/039 2023-10-08T06:25:21.814 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T06:25:21.825 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:25:21.844 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T06:25:21.844 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/040) 2023-10-08T06:25:22.225 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T06:25:22.234 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T06:25:22.234 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:25:22.469 INFO:teuthology.orchestra.run.smithi032.stdout:generic/040 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T06:25:22.475 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/040 2023-10-08T06:25:22.475 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/040 2023-10-08T06:25:22.475 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T06:25:22.483 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:25:22.504 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T06:25:22.505 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/041) 2023-10-08T06:25:22.929 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T06:25:22.935 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T06:25:22.936 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:25:23.238 INFO:teuthology.orchestra.run.smithi032.stdout:generic/041 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T06:25:23.247 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/041 2023-10-08T06:25:23.247 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/041 2023-10-08T06:25:23.247 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T06:25:23.251 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:25:23.272 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T06:25:23.273 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/042) 2023-10-08T06:25:23.653 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T06:25:23.658 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T06:25:23.658 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:25:23.962 INFO:teuthology.orchestra.run.smithi032.stdout:generic/042 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T06:25:23.978 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/042 2023-10-08T06:25:23.978 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/042 2023-10-08T06:25:23.979 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T06:25:23.985 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:25:24.007 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T06:25:24.007 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/043) 2023-10-08T06:25:24.403 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T06:25:24.408 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T06:25:24.409 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:25:24.704 INFO:teuthology.orchestra.run.smithi032.stdout:generic/043 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T06:25:24.718 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/043 2023-10-08T06:25:24.718 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/043 2023-10-08T06:25:24.719 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T06:25:24.722 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:25:24.746 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T06:25:24.746 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/044) 2023-10-08T06:25:25.146 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T06:25:25.156 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T06:25:25.156 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:25:25.412 INFO:teuthology.orchestra.run.smithi032.stdout:generic/044 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T06:25:25.423 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/044 2023-10-08T06:25:25.423 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/044 2023-10-08T06:25:25.423 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T06:25:25.426 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:25:25.441 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T06:25:25.441 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/045) 2023-10-08T06:25:25.834 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T06:25:25.850 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T06:25:25.851 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:25:26.120 INFO:teuthology.orchestra.run.smithi032.stdout:generic/045 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T06:25:26.131 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/045 2023-10-08T06:25:26.131 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/045 2023-10-08T06:25:26.131 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T06:25:26.135 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:25:26.157 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T06:25:26.157 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/046) 2023-10-08T06:25:26.511 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T06:25:26.526 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T06:25:26.526 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:25:26.814 INFO:teuthology.orchestra.run.smithi032.stdout:generic/046 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T06:25:26.833 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/046 2023-10-08T06:25:26.833 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/046 2023-10-08T06:25:26.833 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T06:25:26.837 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:25:26.857 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T06:25:26.857 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/047) 2023-10-08T06:25:27.235 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T06:25:27.264 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T06:25:27.264 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:25:27.524 INFO:teuthology.orchestra.run.smithi032.stdout:generic/047 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T06:25:27.534 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/047 2023-10-08T06:25:27.535 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/047 2023-10-08T06:25:27.535 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T06:25:27.542 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:25:27.563 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T06:25:27.563 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/048) 2023-10-08T06:25:27.943 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T06:25:27.949 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T06:25:27.950 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:25:28.218 INFO:teuthology.orchestra.run.smithi032.stdout:generic/048 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T06:25:28.224 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/048 2023-10-08T06:25:28.224 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/048 2023-10-08T06:25:28.224 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T06:25:28.230 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:25:28.258 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T06:25:28.258 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/049) 2023-10-08T06:25:28.625 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T06:25:28.637 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T06:25:28.637 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:25:28.917 INFO:teuthology.orchestra.run.smithi032.stdout:generic/049 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T06:25:28.925 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/049 2023-10-08T06:25:28.925 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/049 2023-10-08T06:25:28.925 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T06:25:28.933 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:25:28.954 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T06:25:28.955 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/050) 2023-10-08T06:25:29.390 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T06:25:29.400 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T06:25:29.400 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:25:29.669 INFO:teuthology.orchestra.run.smithi032.stdout:generic/050 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T06:25:29.676 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/050 2023-10-08T06:25:29.676 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/050 2023-10-08T06:25:29.676 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T06:25:29.690 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:25:29.703 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T06:25:29.703 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/051) 2023-10-08T06:25:30.125 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T06:25:30.138 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T06:25:30.139 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:25:30.419 INFO:teuthology.orchestra.run.smithi032.stdout:generic/051 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T06:25:30.424 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/051 2023-10-08T06:25:30.425 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/051 2023-10-08T06:25:30.425 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T06:25:30.435 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:25:30.454 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T06:25:30.454 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/052) 2023-10-08T06:25:30.790 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T06:25:30.792 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T06:25:30.792 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:25:31.059 INFO:teuthology.orchestra.run.smithi032.stdout:generic/052 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T06:25:31.072 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/052 2023-10-08T06:25:31.072 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/052 2023-10-08T06:25:31.072 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T06:25:31.076 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:25:31.095 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T06:25:31.095 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/053) 2023-10-08T06:25:31.482 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T06:25:31.500 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T06:25:31.500 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:25:31.774 INFO:teuthology.orchestra.run.smithi032.stdout:generic/053 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T06:25:31.793 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/053 2023-10-08T06:25:31.793 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/053 2023-10-08T06:25:31.793 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T06:25:31.800 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:25:31.810 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T06:25:31.810 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/054) 2023-10-08T06:25:32.202 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T06:25:32.210 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T06:25:32.210 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:25:32.476 INFO:teuthology.orchestra.run.smithi032.stdout:generic/054 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T06:25:32.498 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/054 2023-10-08T06:25:32.504 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/054 2023-10-08T06:25:32.504 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T06:25:32.505 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:25:32.521 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T06:25:32.521 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/055) 2023-10-08T06:25:32.913 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T06:25:33.123 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T06:25:33.123 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:25:33.182 INFO:teuthology.orchestra.run.smithi032.stdout:generic/055 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T06:25:33.187 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/055 2023-10-08T06:25:33.187 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/055 2023-10-08T06:25:33.187 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T06:25:33.197 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:25:33.215 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T06:25:33.215 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/056) 2023-10-08T06:25:33.616 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T06:25:33.634 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T06:25:33.635 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:25:33.944 INFO:teuthology.orchestra.run.smithi032.stdout:generic/056 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T06:25:33.955 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/056 2023-10-08T06:25:33.955 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/056 2023-10-08T06:25:33.956 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T06:25:33.961 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:25:33.976 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T06:25:33.977 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/057) 2023-10-08T06:25:34.362 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T06:25:34.379 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T06:25:34.379 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:25:34.659 INFO:teuthology.orchestra.run.smithi032.stdout:generic/057 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T06:25:34.671 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/057 2023-10-08T06:25:34.671 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/057 2023-10-08T06:25:34.671 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T06:25:34.679 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:25:34.701 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T06:25:34.701 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/058) 2023-10-08T06:25:35.090 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T06:25:35.096 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T06:25:35.096 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:25:37.312 INFO:teuthology.orchestra.run.smithi032.stdout:generic/058 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-10-08T06:25:37.321 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/058 2023-10-08T06:25:37.321 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/058 2023-10-08T06:25:37.321 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T06:25:37.326 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:25:37.345 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T06:25:37.345 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/059) 2023-10-08T06:25:37.661 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T06:25:37.671 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T06:25:37.671 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:25:37.943 INFO:teuthology.orchestra.run.smithi032.stdout:generic/059 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T06:25:37.953 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/059 2023-10-08T06:25:37.953 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/059 2023-10-08T06:25:37.953 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T06:25:37.961 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:25:37.976 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T06:25:37.976 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/060) 2023-10-08T06:25:38.306 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T06:25:38.311 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T06:25:38.311 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:25:40.337 INFO:teuthology.orchestra.run.smithi032.stdout:generic/060 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-10-08T06:25:40.346 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/060 2023-10-08T06:25:40.347 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/060 2023-10-08T06:25:40.347 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T06:25:40.352 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:25:40.371 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T06:25:40.371 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/061) 2023-10-08T06:25:40.681 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T06:25:40.691 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T06:25:40.691 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:25:42.610 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T06:25:42.612 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T06:25:42.735 INFO:teuthology.orchestra.run.smithi032.stdout:generic/061 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-10-08T06:25:42.743 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/061 2023-10-08T06:25:42.743 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/061 2023-10-08T06:25:42.743 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T06:25:42.749 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:25:42.766 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T06:25:42.766 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/062) 2023-10-08T06:25:43.078 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T06:25:43.088 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T06:25:43.088 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:25:43.326 INFO:teuthology.orchestra.run.smithi032.stdout:generic/062 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T06:25:43.334 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/062 2023-10-08T06:25:43.335 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/062 2023-10-08T06:25:43.335 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T06:25:43.341 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:25:43.359 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T06:25:43.359 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/063) 2023-10-08T06:25:43.671 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T06:25:43.681 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T06:25:43.681 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:25:45.750 INFO:teuthology.orchestra.run.smithi032.stdout:generic/063 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-10-08T06:25:45.759 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/063 2023-10-08T06:25:45.759 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/063 2023-10-08T06:25:45.759 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T06:25:45.765 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:25:45.782 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T06:25:45.782 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/064) 2023-10-08T06:25:46.096 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T06:25:46.105 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T06:25:46.105 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:25:46.346 INFO:teuthology.orchestra.run.smithi032.stdout:generic/064 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T06:25:46.353 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/064 2023-10-08T06:25:46.354 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/064 2023-10-08T06:25:46.354 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T06:25:46.359 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:25:46.375 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T06:25:46.376 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/065) 2023-10-08T06:25:46.688 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T06:25:46.698 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T06:25:46.698 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:25:46.972 INFO:teuthology.orchestra.run.smithi032.stdout:generic/065 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T06:25:46.982 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/065 2023-10-08T06:25:46.982 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/065 2023-10-08T06:25:46.982 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T06:25:46.987 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:25:47.004 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T06:25:47.004 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/066) 2023-10-08T06:25:47.322 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T06:25:47.331 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T06:25:47.332 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:25:47.601 INFO:teuthology.orchestra.run.smithi032.stdout:generic/066 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T06:25:47.608 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/066 2023-10-08T06:25:47.609 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/066 2023-10-08T06:25:47.609 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T06:25:47.614 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:25:47.629 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T06:25:47.630 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/067) 2023-10-08T06:25:47.927 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T06:25:47.936 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T06:25:47.936 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:25:48.234 INFO:teuthology.orchestra.run.smithi032.stdout:generic/067 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T06:25:48.243 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/067 2023-10-08T06:25:48.243 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/067 2023-10-08T06:25:48.243 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T06:25:48.249 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:25:48.266 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T06:25:48.266 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/068) 2023-10-08T06:25:48.582 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T06:25:48.592 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T06:25:48.592 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:25:48.860 INFO:teuthology.orchestra.run.smithi032.stdout:generic/068 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T06:25:48.868 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/068 2023-10-08T06:25:48.868 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/068 2023-10-08T06:25:48.868 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T06:25:48.874 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:25:48.891 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T06:25:48.892 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/069) 2023-10-08T06:25:49.212 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T06:25:49.220 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T06:25:49.220 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:25:49.466 INFO:teuthology.orchestra.run.smithi032.stdout:generic/069 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T06:25:49.474 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/069 2023-10-08T06:25:49.474 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/069 2023-10-08T06:25:49.474 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T06:25:49.479 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:25:49.498 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T06:25:49.498 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/070) 2023-10-08T06:25:49.800 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T06:25:49.809 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T06:25:49.810 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:26:12.681 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T06:26:12.684 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T06:26:42.737 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T06:26:42.740 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T06:27:13.028 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T06:27:13.030 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T06:27:28.373 INFO:teuthology.orchestra.run.smithi032.stdout:generic/070 99s 2023-10-08T06:27:28.391 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/070 2023-10-08T06:27:28.392 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T06:27:28.401 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:27:28.415 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T06:27:28.415 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/071) 2023-10-08T06:27:28.778 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T06:27:28.796 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T06:27:28.796 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:27:29.064 INFO:teuthology.orchestra.run.smithi032.stdout:generic/071 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T06:27:29.075 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/071 2023-10-08T06:27:29.075 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/071 2023-10-08T06:27:29.075 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T06:27:29.080 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:27:29.099 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T06:27:29.099 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/072) 2023-10-08T06:27:29.488 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T06:27:29.496 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T06:27:29.496 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:27:31.183 INFO:teuthology.orchestra.run.smithi032.stdout:generic/072 [not run] xfs_io fcollapse failed (old kernel/wrong fs?) 2023-10-08T06:27:31.196 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/072 2023-10-08T06:27:31.197 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/072 2023-10-08T06:27:31.197 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T06:27:31.200 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:27:31.223 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T06:27:31.224 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/073) 2023-10-08T06:27:31.621 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T06:27:31.630 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T06:27:31.630 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:27:31.917 INFO:teuthology.orchestra.run.smithi032.stdout:generic/073 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T06:27:31.921 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/073 2023-10-08T06:27:31.921 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/073 2023-10-08T06:27:31.921 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T06:27:31.924 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:27:31.938 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T06:27:31.939 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/074) 2023-10-08T06:27:32.322 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T06:27:32.330 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T06:27:32.330 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:27:43.083 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T06:27:43.086 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T06:28:13.138 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T06:28:13.141 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T06:28:43.586 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T06:28:43.588 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T06:29:13.877 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T06:29:13.879 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T06:29:44.308 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T06:29:44.311 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T06:30:14.358 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T06:30:14.361 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T06:30:44.738 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T06:30:44.741 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T06:31:15.005 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T06:31:15.007 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T06:31:45.112 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T06:31:45.115 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T06:32:15.919 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T06:32:15.921 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T06:32:45.981 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T06:32:45.983 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T06:33:16.075 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T06:33:16.078 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T06:33:46.335 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T06:33:46.337 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T06:34:16.598 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T06:34:16.600 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T06:34:47.089 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T06:34:47.092 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T06:35:17.346 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T06:35:17.349 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T06:35:47.578 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T06:35:47.580 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T06:36:17.628 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T06:36:17.631 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T06:36:48.174 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T06:36:48.193 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T06:37:18.272 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T06:37:18.275 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T06:37:48.366 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T06:37:48.368 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T06:38:18.448 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T06:38:18.450 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T06:38:48.517 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T06:38:48.519 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T06:39:18.820 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T06:39:18.823 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T06:39:42.197 INFO:tasks.ceph.osd.7.smithi040.stderr:2023-10-08T06:39:42.193+0000 7f40ef350700 -1 bdev(0x5619d9be8e00 /var/lib/ceph/osd/ceph-7/block) aio_submit retries 2 2023-10-08T06:39:48.888 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T06:39:48.890 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T06:40:18.945 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T06:40:18.947 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T06:40:48.999 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T06:40:49.002 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T06:41:19.065 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T06:41:19.067 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T06:41:49.456 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T06:41:49.460 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T06:42:19.513 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T06:42:19.516 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T06:42:49.588 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T06:42:49.590 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T06:43:19.661 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T06:43:19.664 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T06:43:49.710 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T06:43:49.713 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T06:44:19.750 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T06:44:19.753 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T06:44:49.857 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T06:44:49.859 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T06:45:19.938 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T06:45:19.941 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T06:45:50.536 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T06:45:50.538 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T06:46:21.112 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T06:46:21.115 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T06:46:51.670 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T06:46:51.673 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T06:47:22.363 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T06:47:22.365 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T06:47:52.462 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T06:47:52.464 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T06:48:22.545 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T06:48:22.547 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T06:48:52.609 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T06:48:52.612 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T06:49:22.674 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T06:49:22.676 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T06:49:34.558 INFO:tasks.ceph.osd.7.smithi040.stderr:2023-10-08T06:49:34.556+0000 7f40ef350700 -1 bdev(0x5619d9be8e00 /var/lib/ceph/osd/ceph-7/block) aio_submit retries 1 2023-10-08T06:49:52.989 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T06:49:52.991 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T06:50:23.463 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T06:50:23.466 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T06:50:53.516 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T06:50:53.518 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T06:51:23.578 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T06:51:23.580 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T06:51:53.640 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T06:51:53.642 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T06:52:23.686 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T06:52:23.689 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T06:52:53.733 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T06:52:53.737 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T06:53:05.286 INFO:teuthology.orchestra.run.smithi032.stdout:generic/074 1533s 2023-10-08T06:53:05.366 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/074 2023-10-08T06:53:05.366 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T06:53:05.372 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:53:05.390 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T06:53:05.391 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/075) 2023-10-08T06:53:06.167 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T06:53:06.177 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T06:53:06.177 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:53:23.781 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T06:53:23.784 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T06:53:53.838 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T06:53:53.841 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T06:54:23.454 INFO:teuthology.orchestra.run.smithi032.stdout:generic/075 77s 2023-10-08T06:54:23.467 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/075 2023-10-08T06:54:23.467 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T06:54:23.473 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:54:23.490 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T06:54:23.490 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/076) 2023-10-08T06:54:23.804 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T06:54:23.814 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T06:54:23.814 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:54:23.885 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T06:54:23.889 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T06:54:24.066 INFO:teuthology.orchestra.run.smithi032.stdout:generic/076 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T06:54:24.075 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/076 2023-10-08T06:54:24.075 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/076 2023-10-08T06:54:24.075 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T06:54:24.080 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:54:24.098 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T06:54:24.098 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/077) 2023-10-08T06:54:24.413 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T06:54:24.423 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T06:54:24.423 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:54:25.614 INFO:teuthology.orchestra.run.smithi032.stdout:generic/077 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T06:54:25.624 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/077 2023-10-08T06:54:25.624 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/077 2023-10-08T06:54:25.624 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T06:54:25.630 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:54:25.647 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T06:54:25.648 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/078) 2023-10-08T06:54:25.970 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T06:54:25.980 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T06:54:25.980 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:54:26.323 INFO:teuthology.orchestra.run.smithi032.stdout:generic/078 [not run] kernel doesn't support renameat2 syscall 2023-10-08T06:54:26.331 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/078 2023-10-08T06:54:26.331 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/078 2023-10-08T06:54:26.331 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T06:54:26.337 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:54:26.354 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T06:54:26.354 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/079) 2023-10-08T06:54:26.671 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T06:54:26.681 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T06:54:26.681 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:54:27.022 INFO:teuthology.orchestra.run.smithi032.stdout:generic/079 [not run] file system doesn't support chattr +ia 2023-10-08T06:54:27.031 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/079 2023-10-08T06:54:27.031 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/079 2023-10-08T06:54:27.031 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T06:54:27.035 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:54:27.053 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T06:54:27.054 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/080) 2023-10-08T06:54:27.360 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T06:54:27.369 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T06:54:27.369 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:54:29.765 INFO:teuthology.orchestra.run.smithi032.stdout:generic/080 2s 2023-10-08T06:54:29.779 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/080 2023-10-08T06:54:29.779 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T06:54:29.784 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:54:29.798 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T06:54:29.798 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/081) 2023-10-08T06:54:30.113 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T06:54:30.123 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T06:54:30.123 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:54:30.374 INFO:teuthology.orchestra.run.smithi032.stdout:generic/081 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T06:54:30.382 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/081 2023-10-08T06:54:30.382 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/081 2023-10-08T06:54:30.382 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T06:54:30.388 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:54:30.405 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T06:54:30.405 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/082) 2023-10-08T06:54:30.734 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T06:54:30.744 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T06:54:30.744 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:54:31.011 INFO:teuthology.orchestra.run.smithi032.stdout:generic/082 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T06:54:31.020 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/082 2023-10-08T06:54:31.020 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/082 2023-10-08T06:54:31.020 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T06:54:31.026 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:54:31.044 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T06:54:31.044 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/083) 2023-10-08T06:54:31.366 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T06:54:31.376 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T06:54:31.376 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:54:31.626 INFO:teuthology.orchestra.run.smithi032.stdout:generic/083 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T06:54:31.635 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/083 2023-10-08T06:54:31.635 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/083 2023-10-08T06:54:31.635 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T06:54:31.640 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:54:31.660 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T06:54:31.661 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/084) 2023-10-08T06:54:31.976 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T06:54:31.986 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T06:54:31.986 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:54:32.240 INFO:teuthology.orchestra.run.smithi032.stdout:generic/084 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T06:54:32.247 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/084 2023-10-08T06:54:32.247 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/084 2023-10-08T06:54:32.248 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T06:54:32.253 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:54:32.271 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T06:54:32.272 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/085) 2023-10-08T06:54:32.591 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T06:54:32.599 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T06:54:32.600 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:54:32.884 INFO:teuthology.orchestra.run.smithi032.stdout:generic/085 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T06:54:32.894 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/085 2023-10-08T06:54:32.894 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/085 2023-10-08T06:54:32.894 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T06:54:32.899 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:54:32.916 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T06:54:32.916 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/086) 2023-10-08T06:54:33.236 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T06:54:33.245 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T06:54:33.245 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:54:37.708 INFO:teuthology.orchestra.run.smithi032.stdout:generic/086 4s 2023-10-08T06:54:37.820 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/086 2023-10-08T06:54:37.820 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T06:54:37.826 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:54:37.880 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T06:54:37.881 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/087) 2023-10-08T06:54:39.466 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T06:54:39.474 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T06:54:39.474 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:54:40.189 INFO:teuthology.orchestra.run.smithi032.stdout:generic/087 1s 2023-10-08T06:54:40.285 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/087 2023-10-08T06:54:40.285 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T06:54:40.285 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:54:40.285 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T06:54:40.285 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/088) 2023-10-08T06:54:40.612 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T06:54:40.623 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T06:54:40.623 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:54:40.996 INFO:teuthology.orchestra.run.smithi032.stdout:generic/088 0s 2023-10-08T06:54:41.009 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/088 2023-10-08T06:54:41.009 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T06:54:41.014 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:54:41.032 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T06:54:41.032 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/089) 2023-10-08T06:54:41.353 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T06:54:41.361 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T06:54:41.362 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T06:54:53.957 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T06:54:53.960 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T06:55:24.061 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T06:55:24.064 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T06:55:54.120 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T06:55:54.124 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T06:56:24.543 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T06:56:24.546 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T06:56:54.598 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T06:56:54.601 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T06:57:24.656 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T06:57:24.712 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T06:57:54.990 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T06:57:54.994 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T06:58:25.036 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T06:58:25.039 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T06:58:25.155 INFO:tasks.ceph.osd.4.smithi040.stderr:2023-10-08T06:58:25.153+0000 7ff0fd263700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 43352) UID: 0 2023-10-08T06:58:25.156 INFO:tasks.ceph.osd.5.smithi040.stderr:2023-10-08T06:58:25.153+0000 7f5dfedf1700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 43352) UID: 0 2023-10-08T06:58:25.156 INFO:tasks.ceph.osd.6.smithi040.stderr:2023-10-08T06:58:25.153+0000 7f1be92f5700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 43352) UID: 0 2023-10-08T06:58:25.156 INFO:tasks.ceph.osd.7.smithi040.stderr:2023-10-08T06:58:25.153+0000 7f410cbd5700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 43352) UID: 0 2023-10-08T07:01:17.937 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T07:01:17.940 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T07:01:18.119 INFO:tasks.ceph.mds.d.smithi040.stderr:2023-10-08T07:01:18.115+0000 7fa77bedd700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 43361) UID: 0 2023-10-08T07:01:18.119 INFO:tasks.ceph.mds.b.smithi040.stderr:2023-10-08T07:01:18.115+0000 7f4c7640d700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 43361) UID: 0 2023-10-08T07:04:28.217 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T07:04:28.220 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T07:04:58.264 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T07:04:58.267 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T07:05:28.717 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T07:05:28.720 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T07:05:58.763 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T07:05:58.766 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T07:06:28.833 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T07:06:28.836 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T07:06:59.164 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T07:06:59.167 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T07:07:29.207 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T07:07:29.210 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T07:07:59.260 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T07:07:59.263 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T07:07:59.281 INFO:tasks.ceph.mds.d.smithi040.stderr:2023-10-08T07:07:59.277+0000 7fa77bedd700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 43397) UID: 0 2023-10-08T07:07:59.281 INFO:tasks.ceph.mds.b.smithi040.stderr:2023-10-08T07:07:59.277+0000 7f4c7640d700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 43397) UID: 0 2023-10-08T07:10:38.461 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T07:10:38.464 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T07:10:38.503 INFO:tasks.ceph.osd.0.smithi032.stderr:2023-10-08T07:10:38.499+0000 7f519f0f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 124265) UID: 0 2023-10-08T07:10:38.503 INFO:tasks.ceph.osd.3.smithi032.stderr:2023-10-08T07:10:38.499+0000 7ff6419ae700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 124265) UID: 0 2023-10-08T07:10:38.503 INFO:tasks.ceph.osd.2.smithi032.stderr:2023-10-08T07:10:38.499+0000 7fe8a3511700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 124265) UID: 0 2023-10-08T07:10:38.505 INFO:tasks.ceph.osd.1.smithi032.stderr:2023-10-08T07:10:38.503+0000 7efe8aecf700 -1 Fail to open '/proc/124265/cmdline' error = (2) No such file or directory 2023-10-08T07:10:38.505 INFO:tasks.ceph.osd.1.smithi032.stderr:2023-10-08T07:10:38.503+0000 7efe8aecf700 -1 received signal: Hangup from (PID: 124265) UID: 0 2023-10-08T07:13:22.166 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T07:13:22.418 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T07:13:52.479 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T07:13:52.481 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T07:14:22.535 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T07:14:22.538 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T07:14:52.841 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T07:14:52.844 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T07:14:52.870 INFO:tasks.ceph.mds.b.smithi040.stderr:2023-10-08T07:14:52.864+0000 7f4c7640d700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 43421) UID: 0 2023-10-08T07:14:52.871 INFO:tasks.ceph.mds.d.smithi040.stderr:2023-10-08T07:14:52.864+0000 7fa77bedd700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 43421) UID: 0 2023-10-08T07:17:29.275 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T07:17:29.278 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T07:17:59.561 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T07:17:59.625 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T07:18:29.707 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T07:18:29.711 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T07:18:59.769 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T07:18:59.773 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T07:19:29.811 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T07:19:29.814 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T07:19:59.883 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T07:19:59.886 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T07:20:30.309 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T07:20:30.789 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T07:21:00.840 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T07:21:00.842 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T07:21:30.893 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T07:21:30.896 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T07:22:00.965 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T07:22:01.001 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T07:22:01.019 INFO:tasks.ceph.mds.b.smithi040.stderr:2023-10-08T07:22:01.015+0000 7f4c7640d700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 43460) UID: 0 2023-10-08T07:22:01.019 INFO:tasks.ceph.mds.d.smithi040.stderr:2023-10-08T07:22:01.015+0000 7fa77bedd700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 43460) UID: 0 2023-10-08T07:22:35.992 INFO:teuthology.orchestra.run.smithi032.stdout:generic/089 1674s 2023-10-08T07:22:36.007 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/089 2023-10-08T07:22:36.008 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T07:22:36.014 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T07:22:36.030 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T07:22:36.031 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/090) 2023-10-08T07:22:36.334 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T07:22:36.344 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T07:22:36.344 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T07:22:36.674 INFO:teuthology.orchestra.run.smithi032.stdout:generic/090 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T07:22:36.683 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/090 2023-10-08T07:22:36.683 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/090 2023-10-08T07:22:36.683 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T07:22:36.689 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T07:22:36.707 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T07:22:36.708 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/091) 2023-10-08T07:22:37.034 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T07:22:37.043 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T07:22:37.043 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T07:23:59.097 INFO:tasks.ceph.osd.4.smithi040.stderr:2023-10-08T07:23:59.093+0000 7ff0fd263700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 43468) UID: 0 2023-10-08T07:23:59.098 INFO:tasks.ceph.osd.5.smithi040.stderr:2023-10-08T07:23:59.093+0000 7f5dfedf1700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 43468) UID: 0 2023-10-08T07:23:59.098 INFO:tasks.ceph.osd.6.smithi040.stderr:2023-10-08T07:23:59.093+0000 7f1be92f5700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 43468) UID: 0 2023-10-08T07:23:59.098 INFO:tasks.ceph.osd.7.smithi040.stderr:2023-10-08T07:23:59.093+0000 7f410cbd5700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 43468) UID: 0 2023-10-08T07:26:13.723 INFO:teuthology.orchestra.run.smithi032.stdout:generic/091 216s 2023-10-08T07:26:13.738 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/091 2023-10-08T07:26:13.738 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T07:26:13.746 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T07:26:13.759 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T07:26:13.760 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/092) 2023-10-08T07:26:14.075 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T07:26:14.086 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T07:26:14.086 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T07:26:14.469 INFO:teuthology.orchestra.run.smithi032.stdout:generic/092 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-10-08T07:26:14.479 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/092 2023-10-08T07:26:14.479 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/092 2023-10-08T07:26:14.479 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T07:26:14.484 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T07:26:14.501 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T07:26:14.501 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/093) 2023-10-08T07:26:14.820 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T07:26:14.831 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T07:26:14.831 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T07:26:15.806 INFO:teuthology.orchestra.run.smithi032.stdout:generic/093 1s 2023-10-08T07:26:15.819 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/093 2023-10-08T07:26:15.819 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T07:26:15.824 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T07:26:15.841 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T07:26:15.841 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/094) 2023-10-08T07:26:16.159 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T07:26:16.170 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T07:26:16.170 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T07:26:16.425 INFO:teuthology.orchestra.run.smithi032.stdout:generic/094 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T07:26:16.434 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/094 2023-10-08T07:26:16.434 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/094 2023-10-08T07:26:16.434 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T07:26:16.439 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T07:26:16.456 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T07:26:16.456 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/095) 2023-10-08T07:26:16.778 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T07:26:16.788 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T07:26:16.788 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T07:26:17.057 INFO:teuthology.orchestra.run.smithi032.stdout:generic/095 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T07:26:17.066 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/095 2023-10-08T07:26:17.067 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/095 2023-10-08T07:26:17.067 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T07:26:17.072 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T07:26:17.089 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T07:26:17.090 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/096) 2023-10-08T07:26:17.411 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T07:26:17.423 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T07:26:17.423 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T07:26:17.668 INFO:teuthology.orchestra.run.smithi032.stdout:generic/096 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T07:26:17.677 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/096 2023-10-08T07:26:17.677 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/096 2023-10-08T07:26:17.677 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T07:26:17.683 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T07:26:17.702 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T07:26:17.702 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/097) 2023-10-08T07:26:18.016 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T07:26:18.025 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T07:26:18.025 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T07:26:18.652 INFO:teuthology.orchestra.run.smithi032.stdout:generic/097 0s 2023-10-08T07:26:18.667 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/097 2023-10-08T07:26:18.667 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T07:26:18.672 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T07:26:18.687 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T07:26:18.687 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/098) 2023-10-08T07:26:19.016 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T07:26:19.028 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T07:26:19.028 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T07:26:19.269 INFO:teuthology.orchestra.run.smithi032.stdout:generic/098 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T07:26:19.277 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/098 2023-10-08T07:26:19.277 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/098 2023-10-08T07:26:19.277 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T07:26:19.283 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T07:26:19.302 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T07:26:19.302 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/099) 2023-10-08T07:26:19.618 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T07:26:19.628 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T07:26:19.628 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T07:26:19.997 INFO:teuthology.orchestra.run.smithi032.stdout:generic/099 [not run] ACLs not supported by this filesystem type: ceph-fuse 2023-10-08T07:26:20.007 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/099 2023-10-08T07:26:20.007 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/099 2023-10-08T07:26:20.007 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T07:26:20.012 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T07:26:20.030 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T07:26:20.031 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/100) 2023-10-08T07:26:20.352 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T07:26:20.361 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T07:26:20.361 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T07:26:24.042 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T07:26:24.045 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T07:26:54.129 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T07:26:54.278 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T07:27:20.432 INFO:teuthology.orchestra.run.smithi032.stdout:generic/100 60s 2023-10-08T07:27:20.445 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/100 2023-10-08T07:27:20.445 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T07:27:20.449 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T07:27:20.471 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T07:27:20.471 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/101) 2023-10-08T07:27:20.723 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T07:27:20.732 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T07:27:20.733 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T07:27:21.009 INFO:teuthology.orchestra.run.smithi032.stdout:generic/101 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T07:27:21.018 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/101 2023-10-08T07:27:21.019 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/101 2023-10-08T07:27:21.019 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T07:27:21.025 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T07:27:21.044 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T07:27:21.044 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/102) 2023-10-08T07:27:21.362 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T07:27:21.373 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T07:27:21.373 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T07:27:21.650 INFO:teuthology.orchestra.run.smithi032.stdout:generic/102 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T07:27:21.658 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/102 2023-10-08T07:27:21.658 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/102 2023-10-08T07:27:21.658 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T07:27:21.664 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T07:27:21.681 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T07:27:21.681 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/103) 2023-10-08T07:27:21.999 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T07:27:22.008 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T07:27:22.008 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T07:27:22.257 INFO:teuthology.orchestra.run.smithi032.stdout:generic/103 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T07:27:22.266 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/103 2023-10-08T07:27:22.266 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/103 2023-10-08T07:27:22.267 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T07:27:22.274 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T07:27:22.289 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T07:27:22.290 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/104) 2023-10-08T07:27:22.612 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T07:27:22.622 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T07:27:22.622 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T07:27:22.901 INFO:teuthology.orchestra.run.smithi032.stdout:generic/104 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T07:27:22.910 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/104 2023-10-08T07:27:22.910 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/104 2023-10-08T07:27:22.911 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T07:27:22.916 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T07:27:22.933 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T07:27:22.933 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/105) 2023-10-08T07:27:23.254 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T07:27:23.262 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T07:27:23.262 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T07:27:23.524 INFO:teuthology.orchestra.run.smithi032.stdout:generic/105 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T07:27:23.533 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/105 2023-10-08T07:27:23.533 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/105 2023-10-08T07:27:23.533 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T07:27:23.538 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T07:27:23.555 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T07:27:23.555 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/106) 2023-10-08T07:27:23.876 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T07:27:23.886 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T07:27:23.886 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T07:27:24.155 INFO:teuthology.orchestra.run.smithi032.stdout:generic/106 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T07:27:24.164 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/106 2023-10-08T07:27:24.165 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/106 2023-10-08T07:27:24.165 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T07:27:24.170 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T07:27:24.188 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T07:27:24.189 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/107) 2023-10-08T07:27:24.503 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T07:27:24.635 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T07:27:24.635 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T07:27:24.653 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T07:27:24.655 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T07:27:24.782 INFO:teuthology.orchestra.run.smithi032.stdout:generic/107 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T07:27:24.791 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/107 2023-10-08T07:27:24.791 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/107 2023-10-08T07:27:24.791 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T07:27:24.797 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T07:27:24.814 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T07:27:24.814 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/108) 2023-10-08T07:27:25.128 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T07:27:25.137 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T07:27:25.137 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T07:27:26.721 INFO:teuthology.orchestra.run.smithi032.stdout:generic/108 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T07:27:26.731 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/108 2023-10-08T07:27:26.731 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/108 2023-10-08T07:27:26.731 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T07:27:26.735 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T07:27:26.757 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T07:27:26.758 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/109) 2023-10-08T07:27:27.073 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T07:27:27.082 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T07:27:27.082 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T07:27:27.385 INFO:teuthology.orchestra.run.smithi032.stdout:generic/109 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T07:27:27.393 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/109 2023-10-08T07:27:27.394 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/109 2023-10-08T07:27:27.394 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T07:27:27.399 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T07:27:27.416 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T07:27:27.417 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/110) 2023-10-08T07:27:27.733 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T07:27:27.742 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T07:27:27.742 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T07:27:28.123 INFO:teuthology.orchestra.run.smithi032.stdout:generic/110 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-10-08T07:27:28.130 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/110 2023-10-08T07:27:28.131 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/110 2023-10-08T07:27:28.131 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T07:27:28.136 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T07:27:28.152 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T07:27:28.152 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/111) 2023-10-08T07:27:28.460 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T07:27:28.467 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T07:27:28.467 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T07:27:28.815 INFO:teuthology.orchestra.run.smithi032.stdout:generic/111 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-10-08T07:27:28.823 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/111 2023-10-08T07:27:28.823 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/111 2023-10-08T07:27:28.823 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T07:27:28.828 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T07:27:28.844 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T07:27:28.845 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/112) 2023-10-08T07:27:29.150 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T07:27:29.160 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T07:27:29.160 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T07:27:54.698 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T07:27:54.701 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T07:28:24.747 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T07:28:24.749 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T07:28:24.768 INFO:tasks.ceph.osd.1.smithi032.stderr:2023-10-08T07:28:24.762+0000 7efe8aecf700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 152232) UID: 0 2023-10-08T07:28:24.769 INFO:tasks.ceph.osd.0.smithi032.stderr:2023-10-08T07:28:24.762+0000 7f519f0f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 152232) UID: 0 2023-10-08T07:28:24.769 INFO:tasks.ceph.osd.3.smithi032.stderr:2023-10-08T07:28:24.762+0000 7ff6419ae700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 152232) UID: 0 2023-10-08T07:28:24.769 INFO:tasks.ceph.osd.2.smithi032.stderr:2023-10-08T07:28:24.762+0000 7fe8a3511700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 152232) UID: 0 2023-10-08T07:28:46.505 INFO:teuthology.orchestra.run.smithi032.stdout:generic/112 77s 2023-10-08T07:28:46.515 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/112 2023-10-08T07:28:46.515 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T07:28:46.519 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T07:28:46.536 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T07:28:46.536 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/113) 2023-10-08T07:28:46.861 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T07:28:46.866 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T07:28:46.866 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T07:29:46.215 INFO:teuthology.orchestra.run.smithi032.stdout:generic/113 60s 2023-10-08T07:29:46.224 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/113 2023-10-08T07:29:46.224 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T07:29:46.227 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T07:29:46.243 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T07:29:46.243 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/114) 2023-10-08T07:29:46.529 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T07:29:46.536 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T07:29:46.537 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T07:29:46.933 INFO:teuthology.orchestra.run.smithi032.stdout:generic/114 [not run] device block size: 4096 greater than 512 2023-10-08T07:29:46.939 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/114 2023-10-08T07:29:46.940 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/114 2023-10-08T07:29:46.940 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T07:29:46.944 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T07:29:46.959 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T07:29:46.959 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/115) 2023-10-08T07:29:47.223 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T07:29:47.230 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T07:29:47.230 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T07:29:47.532 INFO:teuthology.orchestra.run.smithi032.stdout:generic/115 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-10-08T07:29:47.540 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/115 2023-10-08T07:29:47.540 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/115 2023-10-08T07:29:47.540 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T07:29:47.545 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T07:29:47.559 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T07:29:47.559 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/116) 2023-10-08T07:29:47.818 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T07:29:47.825 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T07:29:47.826 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T07:29:48.123 INFO:teuthology.orchestra.run.smithi032.stdout:generic/116 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-10-08T07:29:48.131 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/116 2023-10-08T07:29:48.131 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/116 2023-10-08T07:29:48.131 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T07:29:48.136 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T07:29:48.149 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T07:29:48.149 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/117) 2023-10-08T07:29:48.438 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T07:29:48.445 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T07:29:48.445 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T07:29:48.635 INFO:teuthology.orchestra.run.smithi032.stdout:generic/117 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T07:29:48.640 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/117 2023-10-08T07:29:48.641 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/117 2023-10-08T07:29:48.641 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T07:29:48.645 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T07:29:48.660 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T07:29:48.660 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/118) 2023-10-08T07:29:48.917 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T07:29:48.925 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T07:29:48.925 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T07:29:49.238 INFO:teuthology.orchestra.run.smithi032.stdout:generic/118 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-10-08T07:29:49.245 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/118 2023-10-08T07:29:49.245 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/118 2023-10-08T07:29:49.245 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T07:29:49.250 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T07:29:49.264 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T07:29:49.264 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/119) 2023-10-08T07:29:49.547 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T07:29:49.556 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T07:29:49.556 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T07:29:49.828 INFO:teuthology.orchestra.run.smithi032.stdout:generic/119 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-10-08T07:29:49.835 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/119 2023-10-08T07:29:49.836 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/119 2023-10-08T07:29:49.836 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T07:29:49.841 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T07:29:49.855 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T07:29:49.855 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/120) 2023-10-08T07:29:50.148 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T07:29:50.155 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T07:29:50.156 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T07:29:50.370 INFO:teuthology.orchestra.run.smithi032.stdout:generic/120 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T07:29:50.377 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/120 2023-10-08T07:29:50.377 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/120 2023-10-08T07:29:50.378 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T07:29:50.383 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T07:29:50.400 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T07:29:50.400 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/121) 2023-10-08T07:29:50.668 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T07:29:50.675 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T07:29:50.675 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T07:29:50.998 INFO:teuthology.orchestra.run.smithi032.stdout:generic/121 [not run] Dedupe not supported by test filesystem type: ceph-fuse 2023-10-08T07:29:51.004 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/121 2023-10-08T07:29:51.004 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/121 2023-10-08T07:29:51.004 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T07:29:51.009 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T07:29:51.023 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T07:29:51.023 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/122) 2023-10-08T07:29:51.304 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T07:29:51.310 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T07:29:51.311 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T07:29:51.635 INFO:teuthology.orchestra.run.smithi032.stdout:generic/122 [not run] Dedupe not supported by test filesystem type: ceph-fuse 2023-10-08T07:29:51.641 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/122 2023-10-08T07:29:51.642 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/122 2023-10-08T07:29:51.642 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T07:29:51.645 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T07:29:51.660 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T07:29:51.660 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/123) 2023-10-08T07:29:51.933 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T07:29:51.940 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T07:29:51.940 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T07:29:52.617 INFO:teuthology.orchestra.run.smithi032.stdout:generic/123 1s 2023-10-08T07:29:52.625 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/123 2023-10-08T07:29:52.625 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T07:29:52.628 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T07:29:52.641 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T07:29:52.641 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/124) 2023-10-08T07:29:52.898 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T07:29:52.906 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T07:29:52.906 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T07:29:53.188 INFO:teuthology.orchestra.run.smithi032.stdout:generic/124 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T07:29:53.195 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/124 2023-10-08T07:29:53.195 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/124 2023-10-08T07:29:53.195 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T07:29:53.199 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T07:29:53.213 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T07:29:53.214 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/125) 2023-10-08T07:29:53.473 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T07:29:53.480 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T07:29:53.480 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T07:30:54.147 INFO:teuthology.orchestra.run.smithi032.stdout:generic/125 61s 2023-10-08T07:30:54.161 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/125 2023-10-08T07:30:54.161 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T07:30:54.165 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T07:30:54.180 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T07:30:54.180 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/126) 2023-10-08T07:30:54.497 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T07:30:54.507 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T07:30:54.507 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T07:30:55.581 INFO:teuthology.orchestra.run.smithi032.stdout:generic/126 - output mismatch (see /tmp/tmp.p8vAuQqzIgxfstests-dev/results//generic/126.out.bad) 2023-10-08T07:30:55.587 INFO:teuthology.orchestra.run.smithi032.stdout: --- tests/generic/126.out 2023-10-08 06:10:44.407319065 +0000 2023-10-08T07:30:55.587 INFO:teuthology.orchestra.run.smithi032.stdout: +++ /tmp/tmp.p8vAuQqzIgxfstests-dev/results//generic/126.out.bad 2023-10-08 07:30:55.575585683 +0000 2023-10-08T07:30:55.587 INFO:teuthology.orchestra.run.smithi032.stdout: @@ -1,7 +1,7 @@ 2023-10-08T07:30:55.587 INFO:teuthology.orchestra.run.smithi032.stdout: QA output created by 126 2023-10-08T07:30:55.587 INFO:teuthology.orchestra.run.smithi032.stdout: -x a 001 file owned by (99/99) as user/group(12/100) PASS 2023-10-08T07:30:55.588 INFO:teuthology.orchestra.run.smithi032.stdout: -x a 010 file owned by (99/99) as user/group(200/99) PASS 2023-10-08T07:30:55.588 INFO:teuthology.orchestra.run.smithi032.stdout: -x a 100 file owned by (99/99) as user/group(99/500) PASS 2023-10-08T07:30:55.588 INFO:teuthology.orchestra.run.smithi032.stdout: +x a 001 file owned by (99/99) as user/group(12/100) FAIL 2023-10-08T07:30:55.588 INFO:teuthology.orchestra.run.smithi032.stdout: +x a 010 file owned by (99/99) as user/group(200/99) FAIL 2023-10-08T07:30:55.588 INFO:teuthology.orchestra.run.smithi032.stdout: +x a 100 file owned by (99/99) as user/group(99/500) FAIL 2023-10-08T07:30:55.588 INFO:teuthology.orchestra.run.smithi032.stdout: w a 002 file owned by (99/99) as user/group(12/100) PASS 2023-10-08T07:30:55.588 INFO:teuthology.orchestra.run.smithi032.stdout: w a 020 file owned by (99/99) as user/group(200/99) PASS 2023-10-08T07:30:55.588 INFO:teuthology.orchestra.run.smithi032.stdout: w a 200 file owned by (99/99) as user/group(99/500) PASS 2023-10-08T07:30:55.593 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/126 2023-10-08T07:30:55.593 INFO:teuthology.orchestra.run.smithi032.stdout:Failures: generic/126 2023-10-08T07:30:55.593 INFO:teuthology.orchestra.run.smithi032.stdout:Failed 1 of 1 tests 2023-10-08T07:30:55.599 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T07:30:55.616 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T07:30:55.616 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-10-08T07:30:55.616 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-10-08T07:30:55.617 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/127) 2023-10-08T07:30:55.927 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T07:30:55.936 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T07:30:55.936 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T07:31:11.849 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T07:31:11.851 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T07:31:11.877 INFO:tasks.ceph.osd.4.smithi040.stderr:2023-10-08T07:31:11.872+0000 7ff0fd263700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 43499) UID: 0 2023-10-08T07:31:11.877 INFO:tasks.ceph.osd.6.smithi040.stderr:2023-10-08T07:31:11.872+0000 7f1be92f5700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 43499) UID: 0 2023-10-08T07:31:11.878 INFO:tasks.ceph.osd.5.smithi040.stderr:2023-10-08T07:31:11.872+0000 7f5dfedf1700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 43499) UID: 0 2023-10-08T07:31:11.878 INFO:tasks.ceph.osd.7.smithi040.stderr:2023-10-08T07:31:11.872+0000 7f410cbd5700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 43499) UID: 0 2023-10-08T07:33:36.415 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T07:33:36.418 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T07:34:06.470 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T07:34:06.473 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T07:34:36.535 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T07:34:36.538 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T07:35:06.584 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T07:35:06.586 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T07:35:36.657 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T07:35:36.660 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T07:36:06.703 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T07:36:06.706 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T07:36:36.754 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T07:36:36.757 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T07:37:06.958 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T07:37:06.961 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T07:37:37.009 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T07:37:37.012 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T07:38:07.066 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T07:38:07.068 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T07:38:37.115 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T07:38:37.123 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T07:39:07.164 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T07:39:07.167 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T07:39:37.364 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T07:39:37.368 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T07:40:07.436 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T07:40:07.439 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T07:40:37.493 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T07:40:37.496 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T07:41:07.791 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T07:41:07.794 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T07:41:37.849 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T07:41:37.851 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T07:42:07.920 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T07:42:07.923 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T07:42:37.969 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T07:42:37.972 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T07:43:08.016 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T07:43:08.018 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T07:43:38.076 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T07:43:38.078 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T07:44:08.125 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T07:44:08.128 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T07:44:38.174 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T07:44:38.177 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T07:45:08.223 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T07:45:08.225 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T07:45:38.313 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T07:45:38.316 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T07:46:08.370 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T07:46:08.372 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T07:46:38.428 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T07:46:38.430 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T07:47:08.492 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T07:47:08.495 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T07:47:38.541 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T07:47:38.543 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T07:48:08.615 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T07:48:08.618 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T07:48:38.677 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T07:48:38.679 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T07:49:08.732 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T07:49:08.737 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T07:49:38.777 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T07:49:38.780 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T07:50:08.817 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T07:50:08.820 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T07:50:38.874 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T07:50:38.877 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T07:51:08.917 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T07:51:08.921 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T07:51:38.972 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T07:51:38.975 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T07:52:09.066 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T07:52:09.069 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T07:52:39.119 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T07:52:39.122 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T07:53:09.160 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T07:53:09.163 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T07:53:39.218 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T07:53:39.220 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T07:54:09.273 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T07:54:09.276 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T07:54:39.322 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T07:54:39.325 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T07:55:09.380 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T07:55:09.382 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T07:55:39.445 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T07:55:39.448 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T07:56:09.494 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T07:56:09.497 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T07:56:39.543 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T07:56:39.545 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T07:57:09.603 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T07:57:09.606 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T07:57:39.656 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T07:57:39.658 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T07:58:09.705 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T07:58:09.708 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T07:58:39.762 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T07:58:39.765 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T07:59:01.607 INFO:teuthology.orchestra.run.smithi032.stdout:generic/127 1686s 2023-10-08T07:59:01.622 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/127 2023-10-08T07:59:01.622 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T07:59:01.629 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T07:59:01.649 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T07:59:01.650 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/128) 2023-10-08T07:59:01.966 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T07:59:01.975 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T07:59:01.975 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T07:59:02.223 INFO:teuthology.orchestra.run.smithi032.stdout:generic/128 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T07:59:02.233 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/128 2023-10-08T07:59:02.233 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/128 2023-10-08T07:59:02.233 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T07:59:02.239 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T07:59:02.257 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T07:59:02.257 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/129) 2023-10-08T07:59:02.584 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T07:59:02.593 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T07:59:02.593 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T07:59:02.838 INFO:teuthology.orchestra.run.smithi032.stdout:generic/129 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T07:59:02.847 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/129 2023-10-08T07:59:02.847 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/129 2023-10-08T07:59:02.847 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T07:59:02.852 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T07:59:02.869 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T07:59:02.869 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/130) 2023-10-08T07:59:03.188 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T07:59:03.196 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T07:59:03.197 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T07:59:03.445 INFO:teuthology.orchestra.run.smithi032.stdout:generic/130 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T07:59:03.453 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/130 2023-10-08T07:59:03.454 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/130 2023-10-08T07:59:03.454 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T07:59:03.459 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T07:59:03.476 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T07:59:03.477 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/131) 2023-10-08T07:59:03.799 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T07:59:03.809 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T07:59:03.809 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T07:59:05.479 INFO:teuthology.orchestra.run.smithi032.stdout:generic/131 2s 2023-10-08T07:59:05.491 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/131 2023-10-08T07:59:05.491 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T07:59:05.497 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T07:59:05.512 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T07:59:05.512 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/132) 2023-10-08T07:59:05.824 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T07:59:05.834 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T07:59:05.834 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T07:59:06.081 INFO:teuthology.orchestra.run.smithi032.stdout:generic/132 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T07:59:06.089 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/132 2023-10-08T07:59:06.090 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/132 2023-10-08T07:59:06.090 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T07:59:06.096 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T07:59:06.113 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T07:59:06.113 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/133) 2023-10-08T07:59:06.426 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T07:59:06.436 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T07:59:06.436 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T07:59:09.819 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T07:59:09.821 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T07:59:39.878 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T07:59:39.881 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:00:09.935 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:00:09.938 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:00:40.010 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:00:40.012 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:01:10.225 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:01:10.227 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:01:40.272 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:01:40.275 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:02:10.333 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:02:10.336 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:02:40.405 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:02:40.409 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:03:10.516 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:03:10.521 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:03:40.568 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:03:40.571 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:04:10.626 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:04:10.629 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:04:40.673 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:04:40.676 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:05:10.720 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:05:10.723 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:05:40.794 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:05:40.799 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:06:01.203 INFO:teuthology.orchestra.run.smithi032.stdout:generic/133 415s 2023-10-08T08:06:01.219 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/133 2023-10-08T08:06:01.219 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:06:01.224 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:06:01.242 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:06:01.242 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/134) 2023-10-08T08:06:01.609 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:06:01.628 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:06:01.628 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:06:01.978 INFO:teuthology.orchestra.run.smithi032.stdout:generic/134 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-10-08T08:06:01.988 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/134 2023-10-08T08:06:01.988 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/134 2023-10-08T08:06:01.988 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:06:01.993 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:06:02.010 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:06:02.010 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/135) 2023-10-08T08:06:02.318 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:06:02.328 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:06:02.328 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:06:02.670 INFO:teuthology.orchestra.run.smithi032.stdout:generic/135 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:06:02.680 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/135 2023-10-08T08:06:02.680 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/135 2023-10-08T08:06:02.680 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:06:02.686 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:06:02.706 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:06:02.706 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/136) 2023-10-08T08:06:03.030 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:06:03.040 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:06:03.041 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:06:03.416 INFO:teuthology.orchestra.run.smithi032.stdout:generic/136 [not run] Dedupe not supported by test filesystem type: ceph-fuse 2023-10-08T08:06:03.425 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/136 2023-10-08T08:06:03.425 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/136 2023-10-08T08:06:03.425 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:06:03.431 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:06:03.449 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:06:03.449 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/137) 2023-10-08T08:06:03.774 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:06:03.783 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:06:03.783 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:06:04.178 INFO:teuthology.orchestra.run.smithi032.stdout:generic/137 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-10-08T08:06:04.187 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/137 2023-10-08T08:06:04.187 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/137 2023-10-08T08:06:04.187 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:06:04.191 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:06:04.208 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:06:04.209 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/138) 2023-10-08T08:06:04.524 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:06:04.532 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:06:04.532 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:06:04.886 INFO:teuthology.orchestra.run.smithi032.stdout:generic/138 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-10-08T08:06:04.894 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/138 2023-10-08T08:06:04.894 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/138 2023-10-08T08:06:04.894 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:06:04.900 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:06:04.917 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:06:04.918 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/139) 2023-10-08T08:06:05.231 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:06:05.241 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:06:05.241 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:06:05.578 INFO:teuthology.orchestra.run.smithi032.stdout:generic/139 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-10-08T08:06:05.587 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/139 2023-10-08T08:06:05.587 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/139 2023-10-08T08:06:05.587 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:06:05.593 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:06:05.612 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:06:05.612 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/140) 2023-10-08T08:06:05.928 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:06:05.937 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:06:05.938 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:06:06.324 INFO:teuthology.orchestra.run.smithi032.stdout:generic/140 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-10-08T08:06:06.333 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/140 2023-10-08T08:06:06.333 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/140 2023-10-08T08:06:06.333 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:06:06.339 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:06:06.358 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:06:06.358 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/141) 2023-10-08T08:06:06.655 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:06:06.665 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:06:06.665 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:06:06.914 INFO:teuthology.orchestra.run.smithi032.stdout:generic/141 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:06:06.923 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/141 2023-10-08T08:06:06.923 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/141 2023-10-08T08:06:06.924 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:06:06.929 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:06:06.946 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:06:06.946 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/142) 2023-10-08T08:06:07.256 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:06:07.266 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:06:07.266 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:06:07.619 INFO:teuthology.orchestra.run.smithi032.stdout:generic/142 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-10-08T08:06:07.628 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/142 2023-10-08T08:06:07.628 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/142 2023-10-08T08:06:07.628 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:06:07.634 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:06:07.652 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:06:07.652 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/143) 2023-10-08T08:06:07.951 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:06:07.960 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:06:07.960 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:06:08.323 INFO:teuthology.orchestra.run.smithi032.stdout:generic/143 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-10-08T08:06:08.333 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/143 2023-10-08T08:06:08.333 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/143 2023-10-08T08:06:08.333 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:06:08.337 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:06:08.355 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:06:08.355 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/144) 2023-10-08T08:06:08.657 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:06:08.665 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:06:08.665 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:06:09.021 INFO:teuthology.orchestra.run.smithi032.stdout:generic/144 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-10-08T08:06:09.030 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/144 2023-10-08T08:06:09.030 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/144 2023-10-08T08:06:09.030 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:06:09.036 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:06:09.052 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:06:09.052 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/145) 2023-10-08T08:06:09.363 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:06:09.373 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:06:09.373 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:06:09.715 INFO:teuthology.orchestra.run.smithi032.stdout:generic/145 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-10-08T08:06:09.724 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/145 2023-10-08T08:06:09.724 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/145 2023-10-08T08:06:09.724 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:06:09.730 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:06:09.748 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:06:09.748 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/146) 2023-10-08T08:06:10.063 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:06:10.073 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:06:10.073 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:06:10.437 INFO:teuthology.orchestra.run.smithi032.stdout:generic/146 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-10-08T08:06:10.445 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/146 2023-10-08T08:06:10.445 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/146 2023-10-08T08:06:10.445 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:06:10.451 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:06:10.468 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:06:10.469 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/147) 2023-10-08T08:06:10.785 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:06:10.795 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:06:10.795 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:06:10.867 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:06:10.870 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:06:11.146 INFO:teuthology.orchestra.run.smithi032.stdout:generic/147 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-10-08T08:06:11.155 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/147 2023-10-08T08:06:11.155 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/147 2023-10-08T08:06:11.155 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:06:11.161 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:06:11.180 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:06:11.180 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/148) 2023-10-08T08:06:11.508 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:06:11.516 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:06:11.516 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:06:11.875 INFO:teuthology.orchestra.run.smithi032.stdout:generic/148 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-10-08T08:06:11.884 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/148 2023-10-08T08:06:11.884 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/148 2023-10-08T08:06:11.884 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:06:11.890 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:06:11.908 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:06:11.909 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/149) 2023-10-08T08:06:12.224 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:06:12.234 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:06:12.235 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:06:12.596 INFO:teuthology.orchestra.run.smithi032.stdout:generic/149 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-10-08T08:06:12.605 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/149 2023-10-08T08:06:12.606 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/149 2023-10-08T08:06:12.606 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:06:12.611 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:06:12.629 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:06:12.630 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/150) 2023-10-08T08:06:12.939 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:06:12.948 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:06:12.948 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:06:13.306 INFO:teuthology.orchestra.run.smithi032.stdout:generic/150 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-10-08T08:06:13.315 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/150 2023-10-08T08:06:13.316 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/150 2023-10-08T08:06:13.316 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:06:13.322 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:06:13.340 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:06:13.340 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/151) 2023-10-08T08:06:13.657 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:06:13.667 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:06:13.667 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:06:14.031 INFO:teuthology.orchestra.run.smithi032.stdout:generic/151 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-10-08T08:06:14.039 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/151 2023-10-08T08:06:14.039 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/151 2023-10-08T08:06:14.039 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:06:14.045 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:06:14.063 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:06:14.063 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/152) 2023-10-08T08:06:14.374 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:06:14.384 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:06:14.384 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:06:14.721 INFO:teuthology.orchestra.run.smithi032.stdout:generic/152 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-10-08T08:06:14.730 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/152 2023-10-08T08:06:14.730 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/152 2023-10-08T08:06:14.730 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:06:14.736 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:06:14.754 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:06:14.754 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/153) 2023-10-08T08:06:15.060 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:06:15.069 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:06:15.069 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:06:15.427 INFO:teuthology.orchestra.run.smithi032.stdout:generic/153 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-10-08T08:06:15.435 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/153 2023-10-08T08:06:15.435 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/153 2023-10-08T08:06:15.435 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:06:15.441 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:06:15.458 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:06:15.458 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/154) 2023-10-08T08:06:15.775 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:06:15.785 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:06:15.785 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:06:16.142 INFO:teuthology.orchestra.run.smithi032.stdout:generic/154 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-10-08T08:06:16.152 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/154 2023-10-08T08:06:16.152 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/154 2023-10-08T08:06:16.152 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:06:16.159 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:06:16.176 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:06:16.176 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/155) 2023-10-08T08:06:16.485 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:06:16.495 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:06:16.495 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:06:16.846 INFO:teuthology.orchestra.run.smithi032.stdout:generic/155 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-10-08T08:06:16.855 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/155 2023-10-08T08:06:16.855 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/155 2023-10-08T08:06:16.855 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:06:16.861 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:06:16.879 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:06:16.879 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/156) 2023-10-08T08:06:17.193 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:06:17.202 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:06:17.203 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:06:17.551 INFO:teuthology.orchestra.run.smithi032.stdout:generic/156 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-10-08T08:06:17.558 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/156 2023-10-08T08:06:17.558 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/156 2023-10-08T08:06:17.558 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:06:17.562 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:06:17.578 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:06:17.578 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/157) 2023-10-08T08:06:17.899 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:06:17.908 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:06:17.908 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:06:18.267 INFO:teuthology.orchestra.run.smithi032.stdout:generic/157 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-10-08T08:06:18.277 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/157 2023-10-08T08:06:18.277 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/157 2023-10-08T08:06:18.277 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:06:18.283 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:06:18.302 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:06:18.302 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/158) 2023-10-08T08:06:18.617 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:06:18.627 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:06:18.628 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:06:19.009 INFO:teuthology.orchestra.run.smithi032.stdout:generic/158 [not run] Dedupe not supported by test filesystem type: ceph-fuse 2023-10-08T08:06:19.018 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/158 2023-10-08T08:06:19.018 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/158 2023-10-08T08:06:19.018 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:06:19.025 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:06:19.042 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:06:19.042 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/159) 2023-10-08T08:06:19.345 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:06:19.354 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:06:19.354 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:06:19.692 INFO:teuthology.orchestra.run.smithi032.stdout:generic/159 [not run] file system doesn't support chattr +i 2023-10-08T08:06:19.699 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/159 2023-10-08T08:06:19.699 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/159 2023-10-08T08:06:19.699 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:06:19.704 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:06:19.720 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:06:19.720 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/160) 2023-10-08T08:06:20.044 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:06:20.054 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:06:20.054 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:06:20.370 INFO:teuthology.orchestra.run.smithi032.stdout:generic/160 [not run] file system doesn't support chattr +i 2023-10-08T08:06:20.377 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/160 2023-10-08T08:06:20.377 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/160 2023-10-08T08:06:20.377 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:06:20.382 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:06:20.400 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:06:20.400 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/161) 2023-10-08T08:06:20.719 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:06:20.729 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:06:20.730 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:06:20.972 INFO:teuthology.orchestra.run.smithi032.stdout:generic/161 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:06:20.980 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/161 2023-10-08T08:06:20.981 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/161 2023-10-08T08:06:20.981 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:06:20.986 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:06:21.003 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:06:21.003 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/162) 2023-10-08T08:06:21.323 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:06:21.332 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:06:21.332 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:06:21.594 INFO:teuthology.orchestra.run.smithi032.stdout:generic/162 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:06:21.602 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/162 2023-10-08T08:06:21.602 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/162 2023-10-08T08:06:21.602 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:06:21.607 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:06:21.623 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:06:21.623 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/163) 2023-10-08T08:06:21.949 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:06:21.959 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:06:21.959 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:06:22.209 INFO:teuthology.orchestra.run.smithi032.stdout:generic/163 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:06:22.218 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/163 2023-10-08T08:06:22.218 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/163 2023-10-08T08:06:22.218 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:06:22.224 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:06:22.239 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:06:22.240 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/164) 2023-10-08T08:06:22.563 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:06:22.573 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:06:22.574 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:06:22.820 INFO:teuthology.orchestra.run.smithi032.stdout:generic/164 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:06:22.829 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/164 2023-10-08T08:06:22.829 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/164 2023-10-08T08:06:22.829 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:06:22.835 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:06:22.852 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:06:22.852 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/165) 2023-10-08T08:06:23.183 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:06:23.193 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:06:23.193 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:06:23.454 INFO:teuthology.orchestra.run.smithi032.stdout:generic/165 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:06:23.462 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/165 2023-10-08T08:06:23.462 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/165 2023-10-08T08:06:23.463 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:06:23.468 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:06:23.486 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:06:23.490 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/166) 2023-10-08T08:06:23.812 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:06:23.822 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:06:23.822 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:06:24.081 INFO:teuthology.orchestra.run.smithi032.stdout:generic/166 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:06:24.091 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/166 2023-10-08T08:06:24.091 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/166 2023-10-08T08:06:24.091 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:06:24.097 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:06:24.115 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:06:24.116 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/167) 2023-10-08T08:06:24.440 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:06:24.450 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:06:24.450 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:06:24.692 INFO:teuthology.orchestra.run.smithi032.stdout:generic/167 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:06:24.700 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/167 2023-10-08T08:06:24.700 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/167 2023-10-08T08:06:24.700 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:06:24.706 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:06:24.724 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:06:24.725 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/168) 2023-10-08T08:06:25.049 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:06:25.058 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:06:25.058 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:06:25.314 INFO:teuthology.orchestra.run.smithi032.stdout:generic/168 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:06:25.322 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/168 2023-10-08T08:06:25.322 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/168 2023-10-08T08:06:25.323 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:06:25.328 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:06:25.346 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:06:25.347 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/169) 2023-10-08T08:06:25.678 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:06:25.687 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:06:25.688 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:06:25.937 INFO:teuthology.orchestra.run.smithi032.stdout:generic/169 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:06:25.945 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/169 2023-10-08T08:06:25.946 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/169 2023-10-08T08:06:25.946 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:06:25.951 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:06:25.969 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:06:25.969 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/170) 2023-10-08T08:06:26.293 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:06:26.301 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:06:26.301 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:06:26.553 INFO:teuthology.orchestra.run.smithi032.stdout:generic/170 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:06:26.562 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/170 2023-10-08T08:06:26.562 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/170 2023-10-08T08:06:26.562 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:06:26.568 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:06:26.586 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:06:26.586 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/171) 2023-10-08T08:06:26.910 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:06:26.920 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:06:26.920 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:06:27.202 INFO:teuthology.orchestra.run.smithi032.stdout:generic/171 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:06:27.211 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/171 2023-10-08T08:06:27.211 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/171 2023-10-08T08:06:27.211 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:06:27.216 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:06:27.231 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:06:27.232 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/172) 2023-10-08T08:06:27.550 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:06:27.558 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:06:27.559 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:06:27.816 INFO:teuthology.orchestra.run.smithi032.stdout:generic/172 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:06:27.825 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/172 2023-10-08T08:06:27.825 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/172 2023-10-08T08:06:27.825 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:06:27.830 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:06:27.848 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:06:27.848 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/173) 2023-10-08T08:06:28.179 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:06:28.188 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:06:28.188 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:06:28.450 INFO:teuthology.orchestra.run.smithi032.stdout:generic/173 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:06:28.458 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/173 2023-10-08T08:06:28.458 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/173 2023-10-08T08:06:28.458 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:06:28.465 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:06:28.482 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:06:28.483 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/174) 2023-10-08T08:06:28.798 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:06:28.808 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:06:28.808 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:06:29.071 INFO:teuthology.orchestra.run.smithi032.stdout:generic/174 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:06:29.080 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/174 2023-10-08T08:06:29.080 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/174 2023-10-08T08:06:29.080 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:06:29.086 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:06:29.104 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:06:29.105 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/175) 2023-10-08T08:06:29.425 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:06:29.435 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:06:29.435 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:06:29.691 INFO:teuthology.orchestra.run.smithi032.stdout:generic/175 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:06:29.700 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/175 2023-10-08T08:06:29.700 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/175 2023-10-08T08:06:29.700 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:06:29.705 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:06:29.724 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:06:29.724 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/176) 2023-10-08T08:06:30.056 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:06:30.065 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:06:30.065 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:06:30.316 INFO:teuthology.orchestra.run.smithi032.stdout:generic/176 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:06:30.325 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/176 2023-10-08T08:06:30.325 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/176 2023-10-08T08:06:30.326 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:06:30.332 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:06:30.350 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:06:30.350 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/177) 2023-10-08T08:06:30.673 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:06:30.683 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:06:30.683 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:06:30.963 INFO:teuthology.orchestra.run.smithi032.stdout:generic/177 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:06:30.972 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/177 2023-10-08T08:06:30.972 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/177 2023-10-08T08:06:30.972 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:06:30.978 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:06:30.997 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:06:30.997 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/178) 2023-10-08T08:06:31.329 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:06:31.339 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:06:31.339 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:06:31.710 INFO:teuthology.orchestra.run.smithi032.stdout:generic/178 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-10-08T08:06:31.719 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/178 2023-10-08T08:06:31.720 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/178 2023-10-08T08:06:31.720 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:06:31.725 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:06:31.744 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:06:31.744 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/179) 2023-10-08T08:06:32.068 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:06:32.119 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:06:32.119 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:06:32.441 INFO:teuthology.orchestra.run.smithi032.stdout:generic/179 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-10-08T08:06:32.450 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/179 2023-10-08T08:06:32.450 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/179 2023-10-08T08:06:32.450 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:06:32.455 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:06:32.471 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:06:32.472 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/180) 2023-10-08T08:06:32.791 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:06:32.801 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:06:32.801 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:06:33.164 INFO:teuthology.orchestra.run.smithi032.stdout:generic/180 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-10-08T08:06:33.172 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/180 2023-10-08T08:06:33.172 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/180 2023-10-08T08:06:33.172 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:06:33.178 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:06:33.196 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:06:33.196 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/181) 2023-10-08T08:06:33.526 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:06:33.540 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:06:33.540 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:06:33.886 INFO:teuthology.orchestra.run.smithi032.stdout:generic/181 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-10-08T08:06:33.896 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/181 2023-10-08T08:06:33.896 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/181 2023-10-08T08:06:33.897 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:06:33.902 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:06:33.919 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:06:33.920 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/182) 2023-10-08T08:06:34.247 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:06:34.257 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:06:34.257 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:06:34.621 INFO:teuthology.orchestra.run.smithi032.stdout:generic/182 [not run] Dedupe not supported by test filesystem type: ceph-fuse 2023-10-08T08:06:34.629 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/182 2023-10-08T08:06:34.629 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/182 2023-10-08T08:06:34.629 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:06:34.634 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:06:34.651 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:06:34.652 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/183) 2023-10-08T08:06:34.980 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:06:34.990 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:06:34.990 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:06:35.241 INFO:teuthology.orchestra.run.smithi032.stdout:generic/183 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:06:35.249 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/183 2023-10-08T08:06:35.250 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/183 2023-10-08T08:06:35.250 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:06:35.255 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:06:35.271 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:06:35.272 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/184) 2023-10-08T08:06:35.599 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:06:35.608 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:06:35.608 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:06:35.967 INFO:teuthology.orchestra.run.smithi032.stdout:generic/184 [failed, exit status 1]- output mismatch (see /tmp/tmp.p8vAuQqzIgxfstests-dev/results//generic/184.out.bad) 2023-10-08T08:06:35.972 INFO:teuthology.orchestra.run.smithi032.stdout: --- tests/generic/184.out 2023-10-08 06:10:44.411318977 +0000 2023-10-08T08:06:35.972 INFO:teuthology.orchestra.run.smithi032.stdout: +++ /tmp/tmp.p8vAuQqzIgxfstests-dev/results//generic/184.out.bad 2023-10-08 08:06:35.948386057 +0000 2023-10-08T08:06:35.972 INFO:teuthology.orchestra.run.smithi032.stdout: @@ -1 +1,2 @@ 2023-10-08T08:06:35.972 INFO:teuthology.orchestra.run.smithi032.stdout: QA output created by 184 2023-10-08T08:06:35.972 INFO:teuthology.orchestra.run.smithi032.stdout: +/tmp/tmp.p8vAuQqzIgxfstests-dev/tests/generic/184: line 23: /tmp/tmp.t2WBfhO8BYtest/null: Permission denied 2023-10-08T08:06:35.980 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/184 2023-10-08T08:06:35.980 INFO:teuthology.orchestra.run.smithi032.stdout:Failures: generic/184 2023-10-08T08:06:35.980 INFO:teuthology.orchestra.run.smithi032.stdout:Failed 1 of 1 tests 2023-10-08T08:06:35.985 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:06:35.999 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T08:06:35.999 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-10-08T08:06:36.000 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-10-08T08:06:36.000 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/185) 2023-10-08T08:06:36.333 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:06:36.343 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:06:36.343 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:06:36.591 INFO:teuthology.orchestra.run.smithi032.stdout:generic/185 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:06:36.599 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/185 2023-10-08T08:06:36.599 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/185 2023-10-08T08:06:36.599 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:06:36.605 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:06:36.623 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:06:36.623 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/186) 2023-10-08T08:06:36.949 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:06:36.959 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:06:36.959 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:06:37.218 INFO:teuthology.orchestra.run.smithi032.stdout:generic/186 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:06:37.226 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/186 2023-10-08T08:06:37.227 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/186 2023-10-08T08:06:37.227 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:06:37.233 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:06:37.249 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:06:37.249 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/187) 2023-10-08T08:06:37.571 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:06:37.580 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:06:37.580 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:06:37.832 INFO:teuthology.orchestra.run.smithi032.stdout:generic/187 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:06:37.840 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/187 2023-10-08T08:06:37.840 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/187 2023-10-08T08:06:37.841 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:06:37.847 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:06:37.863 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:06:37.863 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/188) 2023-10-08T08:06:38.185 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:06:38.195 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:06:38.195 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:06:38.443 INFO:teuthology.orchestra.run.smithi032.stdout:generic/188 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:06:38.451 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/188 2023-10-08T08:06:38.451 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/188 2023-10-08T08:06:38.452 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:06:38.457 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:06:38.475 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:06:38.476 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/189) 2023-10-08T08:06:38.801 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:06:38.811 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:06:38.811 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:06:39.070 INFO:teuthology.orchestra.run.smithi032.stdout:generic/189 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:06:39.077 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/189 2023-10-08T08:06:39.078 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/189 2023-10-08T08:06:39.078 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:06:39.083 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:06:39.100 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:06:39.100 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/190) 2023-10-08T08:06:39.420 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:06:39.429 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:06:39.429 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:06:39.674 INFO:teuthology.orchestra.run.smithi032.stdout:generic/190 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:06:39.683 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/190 2023-10-08T08:06:39.683 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/190 2023-10-08T08:06:39.683 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:06:39.689 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:06:39.707 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:06:39.708 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/191) 2023-10-08T08:06:40.023 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:06:40.033 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:06:40.033 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:06:40.283 INFO:teuthology.orchestra.run.smithi032.stdout:generic/191 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:06:40.291 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/191 2023-10-08T08:06:40.292 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/191 2023-10-08T08:06:40.292 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:06:40.297 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:06:40.316 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:06:40.317 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/192) 2023-10-08T08:06:40.648 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:06:40.658 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:06:40.658 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:06:40.928 INFO:teuthology.orchestra.run.smithi032.stdout:generic/192 [not run] atime not maintained by ceph-fuse 2023-10-08T08:06:40.937 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/192 2023-10-08T08:06:40.937 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/192 2023-10-08T08:06:40.938 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:06:40.944 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:06:40.962 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:06:40.962 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/193) 2023-10-08T08:06:41.060 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:06:41.063 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:06:41.286 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:06:41.295 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:06:41.295 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:06:42.416 INFO:teuthology.orchestra.run.smithi032.stdout:generic/193 - output mismatch (see /tmp/tmp.p8vAuQqzIgxfstests-dev/results//generic/193.out.bad) 2023-10-08T08:06:42.421 INFO:teuthology.orchestra.run.smithi032.stdout: --- tests/generic/193.out 2023-10-08 06:10:44.411318977 +0000 2023-10-08T08:06:42.421 INFO:teuthology.orchestra.run.smithi032.stdout: +++ /tmp/tmp.p8vAuQqzIgxfstests-dev/results//generic/193.out.bad 2023-10-08 08:06:42.408254685 +0000 2023-10-08T08:06:42.421 INFO:teuthology.orchestra.run.smithi032.stdout: @@ -24,7 +24,6 @@ 2023-10-08T08:06:42.422 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:06:42.422 INFO:teuthology.orchestra.run.smithi032.stdout: user: chmod a+r on qa_user owned file (should succeed) 2023-10-08T08:06:42.422 INFO:teuthology.orchestra.run.smithi032.stdout: user: chmod a+r on root owned file (should fail) 2023-10-08T08:06:42.422 INFO:teuthology.orchestra.run.smithi032.stdout: -chmod: changing permissions of 'test.root': Operation not permitted 2023-10-08T08:06:42.422 INFO:teuthology.orchestra.run.smithi032.stdout: check that the sgid bit is cleared 2023-10-08T08:06:42.422 INFO:teuthology.orchestra.run.smithi032.stdout: -rw-rw-rw- 2023-10-08T08:06:42.422 INFO:teuthology.orchestra.run.smithi032.stdout: check that suid bit is not cleared 2023-10-08T08:06:42.427 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/193 2023-10-08T08:06:42.427 INFO:teuthology.orchestra.run.smithi032.stdout:Failures: generic/193 2023-10-08T08:06:42.427 INFO:teuthology.orchestra.run.smithi032.stdout:Failed 1 of 1 tests 2023-10-08T08:06:42.432 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:06:42.450 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T08:06:42.450 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-10-08T08:06:42.450 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-10-08T08:06:42.451 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/194) 2023-10-08T08:06:42.765 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:06:42.775 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:06:42.775 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:06:43.027 INFO:teuthology.orchestra.run.smithi032.stdout:generic/194 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:06:43.036 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/194 2023-10-08T08:06:43.036 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/194 2023-10-08T08:06:43.036 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:06:43.041 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:06:43.058 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:06:43.058 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/195) 2023-10-08T08:06:43.388 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:06:43.398 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:06:43.398 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:06:43.647 INFO:teuthology.orchestra.run.smithi032.stdout:generic/195 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:06:43.654 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/195 2023-10-08T08:06:43.654 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/195 2023-10-08T08:06:43.654 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:06:43.660 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:06:43.679 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:06:43.679 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/196) 2023-10-08T08:06:43.998 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:06:44.008 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:06:44.008 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:06:44.266 INFO:teuthology.orchestra.run.smithi032.stdout:generic/196 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:06:44.275 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/196 2023-10-08T08:06:44.275 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/196 2023-10-08T08:06:44.275 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:06:44.281 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:06:44.297 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:06:44.297 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/197) 2023-10-08T08:06:44.621 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:06:44.628 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:06:44.629 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:06:44.881 INFO:teuthology.orchestra.run.smithi032.stdout:generic/197 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:06:44.890 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/197 2023-10-08T08:06:44.891 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/197 2023-10-08T08:06:44.891 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:06:44.896 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:06:44.913 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:06:44.913 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/198) 2023-10-08T08:06:45.233 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:06:45.242 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:06:45.242 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:06:46.531 INFO:teuthology.orchestra.run.smithi032.stdout:generic/198 1s 2023-10-08T08:06:46.544 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/198 2023-10-08T08:06:46.544 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:06:46.550 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:06:46.567 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:06:46.567 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/199) 2023-10-08T08:06:46.883 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:06:46.892 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:06:46.892 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:06:47.144 INFO:teuthology.orchestra.run.smithi032.stdout:generic/199 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:06:47.152 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/199 2023-10-08T08:06:47.152 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/199 2023-10-08T08:06:47.152 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:06:47.157 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:06:47.175 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:06:47.175 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/200) 2023-10-08T08:06:47.501 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:06:47.510 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:06:47.511 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:06:47.769 INFO:teuthology.orchestra.run.smithi032.stdout:generic/200 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:06:47.777 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/200 2023-10-08T08:06:47.778 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/200 2023-10-08T08:06:47.778 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:06:47.783 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:06:47.802 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:06:47.802 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/201) 2023-10-08T08:06:48.127 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:06:48.136 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:06:48.137 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:06:48.391 INFO:teuthology.orchestra.run.smithi032.stdout:generic/201 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:06:48.400 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/201 2023-10-08T08:06:48.400 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/201 2023-10-08T08:06:48.400 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:06:48.405 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:06:48.426 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:06:48.426 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/202) 2023-10-08T08:06:48.760 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:06:48.770 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:06:48.770 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:06:49.031 INFO:teuthology.orchestra.run.smithi032.stdout:generic/202 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:06:49.039 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/202 2023-10-08T08:06:49.039 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/202 2023-10-08T08:06:49.040 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:06:49.045 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:06:49.063 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:06:49.063 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/203) 2023-10-08T08:06:49.379 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:06:49.389 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:06:49.389 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:06:49.639 INFO:teuthology.orchestra.run.smithi032.stdout:generic/203 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:06:49.647 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/203 2023-10-08T08:06:49.648 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/203 2023-10-08T08:06:49.648 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:06:49.653 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:06:49.668 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:06:49.668 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/204) 2023-10-08T08:06:49.991 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:06:50.000 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:06:50.000 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:06:50.966 INFO:teuthology.orchestra.run.smithi032.stdout:generic/204 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:06:50.975 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/204 2023-10-08T08:06:50.975 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/204 2023-10-08T08:06:50.975 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:06:50.981 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:06:50.998 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:06:50.999 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/205) 2023-10-08T08:06:51.319 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:06:51.328 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:06:51.329 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:06:51.592 INFO:teuthology.orchestra.run.smithi032.stdout:generic/205 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:06:51.601 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/205 2023-10-08T08:06:51.601 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/205 2023-10-08T08:06:51.601 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:06:51.607 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:06:51.624 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:06:51.624 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/206) 2023-10-08T08:06:51.949 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:06:51.960 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:06:51.960 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:06:52.219 INFO:teuthology.orchestra.run.smithi032.stdout:generic/206 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:06:52.229 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/206 2023-10-08T08:06:52.229 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/206 2023-10-08T08:06:52.229 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:06:52.235 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:06:52.253 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:06:52.253 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/207) 2023-10-08T08:06:52.577 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:06:52.586 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:06:52.586 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:07:11.137 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:07:11.140 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:07:24.974 INFO:teuthology.orchestra.run.smithi032.stdout:generic/207 32s 2023-10-08T08:07:24.988 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/207 2023-10-08T08:07:24.988 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:07:24.994 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:07:25.014 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:07:25.014 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/208) 2023-10-08T08:07:25.343 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:07:25.352 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:07:25.353 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:07:41.364 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:07:41.367 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:08:11.409 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:08:11.411 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:08:41.468 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:08:41.471 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:09:11.528 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:09:11.531 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:09:41.584 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:09:41.587 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:10:11.633 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:10:11.636 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:10:41.707 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:10:41.709 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:10:45.876 INFO:teuthology.orchestra.run.smithi032.stdout:generic/208 200s 2023-10-08T08:10:45.886 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/208 2023-10-08T08:10:45.886 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:10:45.890 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:10:45.906 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:10:45.906 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/209) 2023-10-08T08:10:46.232 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:10:46.241 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:10:46.241 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:11:03.038 INFO:teuthology.orchestra.run.smithi032.stdout:generic/209 [failed, exit status 1]- output mismatch (see /tmp/tmp.p8vAuQqzIgxfstests-dev/results//generic/209.out.bad) 2023-10-08T08:11:03.042 INFO:teuthology.orchestra.run.smithi032.stdout: --- tests/generic/209.out 2023-10-08 06:10:44.411318977 +0000 2023-10-08T08:11:03.042 INFO:teuthology.orchestra.run.smithi032.stdout: +++ /tmp/tmp.p8vAuQqzIgxfstests-dev/results//generic/209.out.bad 2023-10-08 08:11:03.030951397 +0000 2023-10-08T08:11:03.043 INFO:teuthology.orchestra.run.smithi032.stdout: @@ -1,2 +1,2 @@ 2023-10-08T08:11:03.043 INFO:teuthology.orchestra.run.smithi032.stdout: QA output created by 209 2023-10-08T08:11:03.043 INFO:teuthology.orchestra.run.smithi032.stdout: -test ran for 30 seconds without error 2023-10-08T08:11:03.043 INFO:teuthology.orchestra.run.smithi032.stdout: +reader found old byte at pos 4096 2023-10-08T08:11:03.043 INFO:teuthology.orchestra.run.smithi032.stdout: \ No newline at end of file 2023-10-08T08:11:03.049 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/209 2023-10-08T08:11:03.049 INFO:teuthology.orchestra.run.smithi032.stdout:Failures: generic/209 2023-10-08T08:11:03.049 INFO:teuthology.orchestra.run.smithi032.stdout:Failed 1 of 1 tests 2023-10-08T08:11:03.055 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:11:03.068 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T08:11:03.069 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-10-08T08:11:03.070 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-10-08T08:11:03.070 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/210) 2023-10-08T08:11:03.399 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:11:03.408 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:11:03.408 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:11:03.927 INFO:teuthology.orchestra.run.smithi032.stdout:generic/210 0s 2023-10-08T08:11:03.940 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/210 2023-10-08T08:11:03.940 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:11:03.945 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:11:03.964 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:11:03.964 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/211) 2023-10-08T08:11:04.285 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:11:04.295 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:11:04.296 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:11:04.820 INFO:teuthology.orchestra.run.smithi032.stdout:generic/211 0s 2023-10-08T08:11:04.831 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/211 2023-10-08T08:11:04.832 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:11:04.837 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:11:04.851 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:11:04.851 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/212) 2023-10-08T08:11:05.176 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:11:05.185 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:11:05.185 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:11:05.643 INFO:teuthology.orchestra.run.smithi032.stdout:generic/212 0s 2023-10-08T08:11:05.657 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/212 2023-10-08T08:11:05.657 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:11:05.663 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:11:05.684 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:11:05.684 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/213) 2023-10-08T08:11:06.006 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:11:06.015 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:11:06.015 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:11:06.728 INFO:teuthology.orchestra.run.smithi032.stdout:generic/213 - output mismatch (see /tmp/tmp.p8vAuQqzIgxfstests-dev/results//generic/213.out.bad) 2023-10-08T08:11:06.733 INFO:teuthology.orchestra.run.smithi032.stdout: --- tests/generic/213.out 2023-10-08 06:10:44.411318977 +0000 2023-10-08T08:11:06.733 INFO:teuthology.orchestra.run.smithi032.stdout: +++ /tmp/tmp.p8vAuQqzIgxfstests-dev/results//generic/213.out.bad 2023-10-08 08:11:06.722876231 +0000 2023-10-08T08:11:06.734 INFO:teuthology.orchestra.run.smithi032.stdout: @@ -1,4 +1,3 @@ 2023-10-08T08:11:06.734 INFO:teuthology.orchestra.run.smithi032.stdout: QA output created by 213 2023-10-08T08:11:06.734 INFO:teuthology.orchestra.run.smithi032.stdout: We should get: fallocate: No space left on device 2023-10-08T08:11:06.734 INFO:teuthology.orchestra.run.smithi032.stdout: Strangely, xfs_io sometimes says "Success" when something went wrong, FYI 2023-10-08T08:11:06.734 INFO:teuthology.orchestra.run.smithi032.stdout: -fallocate: No space left on device 2023-10-08T08:11:06.740 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/213 2023-10-08T08:11:06.740 INFO:teuthology.orchestra.run.smithi032.stdout:Failures: generic/213 2023-10-08T08:11:06.740 INFO:teuthology.orchestra.run.smithi032.stdout:Failed 1 of 1 tests 2023-10-08T08:11:06.746 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:11:06.765 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T08:11:06.766 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-10-08T08:11:06.766 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-10-08T08:11:06.766 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/214) 2023-10-08T08:11:07.092 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:11:07.102 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:11:07.102 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:11:07.923 INFO:teuthology.orchestra.run.smithi032.stdout:generic/214 0s 2023-10-08T08:11:07.934 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/214 2023-10-08T08:11:07.934 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:11:07.936 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:11:07.954 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:11:07.954 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/215) 2023-10-08T08:11:08.337 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:11:08.357 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:11:08.357 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:11:11.705 INFO:teuthology.orchestra.run.smithi032.stdout:generic/215 3s 2023-10-08T08:11:11.725 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/215 2023-10-08T08:11:11.725 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:11:11.728 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:11:11.751 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:11:11.752 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/216) 2023-10-08T08:11:11.771 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:11:11.773 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:11:12.167 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:11:12.178 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:11:12.178 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:11:12.438 INFO:teuthology.orchestra.run.smithi032.stdout:generic/216 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:11:12.443 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/216 2023-10-08T08:11:12.444 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/216 2023-10-08T08:11:12.444 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:11:12.449 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:11:12.473 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:11:12.474 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/217) 2023-10-08T08:11:12.909 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:11:12.929 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:11:12.930 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:11:13.201 INFO:teuthology.orchestra.run.smithi032.stdout:generic/217 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:11:13.206 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/217 2023-10-08T08:11:13.206 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/217 2023-10-08T08:11:13.206 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:11:13.209 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:11:13.219 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:11:13.219 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/218) 2023-10-08T08:11:13.618 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:11:13.626 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:11:13.627 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:11:13.894 INFO:teuthology.orchestra.run.smithi032.stdout:generic/218 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:11:13.902 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/218 2023-10-08T08:11:13.902 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/218 2023-10-08T08:11:13.902 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:11:13.907 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:11:13.949 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:11:13.949 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/219) 2023-10-08T08:11:14.351 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:11:14.364 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:11:14.365 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:11:14.622 INFO:teuthology.orchestra.run.smithi032.stdout:generic/219 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:11:14.626 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/219 2023-10-08T08:11:14.626 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/219 2023-10-08T08:11:14.627 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:11:14.629 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:11:14.661 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:11:14.661 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/220) 2023-10-08T08:11:15.022 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:11:15.033 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:11:15.034 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:11:15.297 INFO:teuthology.orchestra.run.smithi032.stdout:generic/220 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:11:15.311 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/220 2023-10-08T08:11:15.311 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/220 2023-10-08T08:11:15.311 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:11:15.316 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:11:15.340 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:11:15.341 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/221) 2023-10-08T08:11:15.753 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:11:15.769 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:11:15.770 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:11:17.086 INFO:teuthology.orchestra.run.smithi032.stdout:generic/221 2s 2023-10-08T08:11:17.093 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/221 2023-10-08T08:11:17.093 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:11:17.096 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:11:17.109 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:11:17.110 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/222) 2023-10-08T08:11:17.474 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:11:17.478 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:11:17.478 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:11:17.759 INFO:teuthology.orchestra.run.smithi032.stdout:generic/222 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:11:17.773 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/222 2023-10-08T08:11:17.774 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/222 2023-10-08T08:11:17.774 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:11:17.776 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:11:17.790 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:11:17.790 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/223) 2023-10-08T08:11:18.176 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:11:18.187 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:11:18.187 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:11:18.458 INFO:teuthology.orchestra.run.smithi032.stdout:generic/223 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:11:18.470 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/223 2023-10-08T08:11:18.470 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/223 2023-10-08T08:11:18.470 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:11:18.473 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:11:18.491 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:11:18.491 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/224) 2023-10-08T08:11:18.910 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:11:18.919 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:11:18.919 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:11:19.198 INFO:teuthology.orchestra.run.smithi032.stdout:generic/224 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:11:19.209 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/224 2023-10-08T08:11:19.209 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/224 2023-10-08T08:11:19.209 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:11:19.211 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:11:19.243 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:11:19.243 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/225) 2023-10-08T08:11:19.701 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:11:19.712 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:11:19.712 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:11:19.927 INFO:teuthology.orchestra.run.smithi032.stdout:generic/225 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:11:19.936 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/225 2023-10-08T08:11:19.936 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/225 2023-10-08T08:11:19.936 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:11:19.939 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:11:19.962 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:11:19.962 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/226) 2023-10-08T08:11:20.353 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:11:20.375 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:11:20.376 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:11:20.670 INFO:teuthology.orchestra.run.smithi032.stdout:generic/226 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:11:20.683 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/226 2023-10-08T08:11:20.683 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/226 2023-10-08T08:11:20.683 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:11:20.701 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:11:20.715 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:11:20.715 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/227) 2023-10-08T08:11:21.127 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:11:21.143 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:11:21.143 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:11:21.406 INFO:teuthology.orchestra.run.smithi032.stdout:generic/227 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:11:21.417 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/227 2023-10-08T08:11:21.417 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/227 2023-10-08T08:11:21.418 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:11:21.420 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:11:21.440 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:11:21.440 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/228) 2023-10-08T08:11:21.809 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:11:21.820 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:11:21.820 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:11:22.407 INFO:teuthology.orchestra.run.smithi032.stdout:generic/228 1s 2023-10-08T08:11:22.425 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/228 2023-10-08T08:11:22.426 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:11:22.446 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:11:22.459 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:11:22.459 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/229) 2023-10-08T08:11:22.848 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:11:22.859 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:11:22.859 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:11:23.137 INFO:teuthology.orchestra.run.smithi032.stdout:generic/229 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:11:23.142 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/229 2023-10-08T08:11:23.142 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/229 2023-10-08T08:11:23.142 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:11:23.145 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:11:23.168 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:11:23.169 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/230) 2023-10-08T08:11:23.569 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:11:23.578 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:11:23.578 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:11:23.852 INFO:teuthology.orchestra.run.smithi032.stdout:generic/230 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:11:23.857 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/230 2023-10-08T08:11:23.857 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/230 2023-10-08T08:11:23.857 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:11:23.865 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:11:23.899 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:11:23.899 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/231) 2023-10-08T08:11:24.334 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:11:24.340 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:11:24.340 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:11:24.588 INFO:teuthology.orchestra.run.smithi032.stdout:generic/231 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:11:24.592 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/231 2023-10-08T08:11:24.592 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/231 2023-10-08T08:11:24.592 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:11:24.596 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:11:24.611 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:11:24.611 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/232) 2023-10-08T08:11:24.977 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:11:24.986 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:11:24.987 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:11:25.270 INFO:teuthology.orchestra.run.smithi032.stdout:generic/232 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:11:25.275 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/232 2023-10-08T08:11:25.275 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/232 2023-10-08T08:11:25.275 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:11:25.278 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:11:25.295 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:11:25.295 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/233) 2023-10-08T08:11:25.700 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:11:25.705 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:11:25.705 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:11:25.959 INFO:teuthology.orchestra.run.smithi032.stdout:generic/233 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:11:25.964 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/233 2023-10-08T08:11:25.964 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/233 2023-10-08T08:11:25.964 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:11:25.968 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:11:25.981 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:11:25.981 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/234) 2023-10-08T08:11:26.454 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:11:26.472 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:11:26.472 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:11:26.741 INFO:teuthology.orchestra.run.smithi032.stdout:generic/234 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:11:26.750 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/234 2023-10-08T08:11:26.750 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/234 2023-10-08T08:11:26.750 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:11:26.754 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:11:26.769 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:11:26.769 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/235) 2023-10-08T08:11:27.197 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:11:27.209 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:11:27.209 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:11:27.470 INFO:teuthology.orchestra.run.smithi032.stdout:generic/235 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:11:27.485 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/235 2023-10-08T08:11:27.485 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/235 2023-10-08T08:11:27.486 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:11:27.488 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:11:27.499 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:11:27.499 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/236) 2023-10-08T08:11:27.864 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:11:27.880 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:11:27.881 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:11:29.300 INFO:teuthology.orchestra.run.smithi032.stdout:generic/236 2s 2023-10-08T08:11:29.311 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/236 2023-10-08T08:11:29.314 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:11:29.314 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:11:29.341 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:11:29.342 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/237) 2023-10-08T08:11:29.746 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:11:29.750 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:11:29.750 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:11:30.162 INFO:teuthology.orchestra.run.smithi032.stdout:generic/237 [not run] ACLs not supported by this filesystem type: ceph-fuse 2023-10-08T08:11:30.167 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/237 2023-10-08T08:11:30.167 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/237 2023-10-08T08:11:30.167 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:11:30.171 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:11:30.192 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:11:30.193 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/238) 2023-10-08T08:11:30.638 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:11:30.650 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:11:30.650 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:11:30.927 INFO:teuthology.orchestra.run.smithi032.stdout:generic/238 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:11:30.942 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/238 2023-10-08T08:11:30.942 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/238 2023-10-08T08:11:30.942 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:11:30.947 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:11:30.956 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:11:30.957 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/239) 2023-10-08T08:11:31.357 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:11:31.368 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:11:31.368 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:11:41.818 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:11:41.821 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:12:11.925 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:12:11.937 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:12:42.348 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:12:42.351 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:13:12.446 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:13:12.449 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:13:42.555 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:13:42.562 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:14:05.871 INFO:teuthology.orchestra.run.smithi032.stdout:generic/239 154s 2023-10-08T08:14:05.926 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/239 2023-10-08T08:14:05.927 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:14:05.930 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:14:05.952 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:14:05.953 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/240) 2023-10-08T08:14:06.903 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:14:06.910 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:14:06.910 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:14:11.502 INFO:teuthology.orchestra.run.smithi032.stdout:generic/240 5s 2023-10-08T08:14:11.515 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/240 2023-10-08T08:14:11.515 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:14:11.518 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:14:11.536 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:14:11.537 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/241) 2023-10-08T08:14:11.954 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:14:11.973 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:14:11.973 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:14:12.685 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:14:12.687 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:14:43.024 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:14:43.029 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:15:13.105 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:15:13.107 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:15:25.750 INFO:teuthology.orchestra.run.smithi032.stdout:generic/241 74s 2023-10-08T08:15:25.785 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/241 2023-10-08T08:15:25.786 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:15:25.787 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:15:25.810 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:15:25.810 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/242) 2023-10-08T08:15:26.357 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:15:26.366 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:15:26.366 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:15:26.809 INFO:teuthology.orchestra.run.smithi032.stdout:generic/242 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:15:26.814 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/242 2023-10-08T08:15:26.815 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/242 2023-10-08T08:15:26.815 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:15:26.819 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:15:26.839 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:15:26.839 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/243) 2023-10-08T08:15:27.265 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:15:27.279 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:15:27.279 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:15:27.558 INFO:teuthology.orchestra.run.smithi032.stdout:generic/243 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:15:27.565 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/243 2023-10-08T08:15:27.566 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/243 2023-10-08T08:15:27.566 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:15:27.568 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:15:27.582 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:15:27.582 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/244) 2023-10-08T08:15:27.986 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:15:27.991 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:15:27.991 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:15:28.280 INFO:teuthology.orchestra.run.smithi032.stdout:generic/244 [not run] disk quotas not supported by this filesystem type: ceph-fuse 2023-10-08T08:15:28.290 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/244 2023-10-08T08:15:28.290 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/244 2023-10-08T08:15:28.290 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:15:28.309 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:15:28.319 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:15:28.319 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/245) 2023-10-08T08:15:28.728 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:15:28.736 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:15:28.736 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:15:29.235 INFO:teuthology.orchestra.run.smithi032.stdout:generic/245 1s 2023-10-08T08:15:29.260 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/245 2023-10-08T08:15:29.260 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:15:29.263 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:15:29.284 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:15:29.285 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/246) 2023-10-08T08:15:29.687 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:15:29.695 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:15:29.695 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:15:30.094 INFO:teuthology.orchestra.run.smithi032.stdout:generic/246 1s 2023-10-08T08:15:30.110 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/246 2023-10-08T08:15:30.110 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:15:30.115 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:15:30.137 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:15:30.137 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/247) 2023-10-08T08:15:30.517 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:15:30.536 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:15:30.537 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:15:43.176 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:15:43.178 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:16:13.229 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:16:13.231 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:16:29.377 INFO:teuthology.orchestra.run.smithi032.stdout:generic/247 59s 2023-10-08T08:16:29.392 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/247 2023-10-08T08:16:29.392 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:16:29.396 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:16:29.412 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:16:29.413 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/248) 2023-10-08T08:16:29.813 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:16:29.833 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:16:29.833 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:16:30.228 INFO:teuthology.orchestra.run.smithi032.stdout:generic/248 1s 2023-10-08T08:16:30.244 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/248 2023-10-08T08:16:30.244 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:16:30.247 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:16:30.279 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:16:30.279 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/249) 2023-10-08T08:16:30.624 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:16:30.631 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:16:30.631 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:16:33.403 INFO:teuthology.orchestra.run.smithi032.stdout:generic/249 3s 2023-10-08T08:16:33.419 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/249 2023-10-08T08:16:33.419 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:16:33.426 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:16:33.440 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:16:33.440 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/250) 2023-10-08T08:16:33.836 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:16:33.842 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:16:33.842 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:16:34.161 INFO:teuthology.orchestra.run.smithi032.stdout:generic/250 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:16:34.165 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/250 2023-10-08T08:16:34.165 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/250 2023-10-08T08:16:34.165 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:16:34.167 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:16:34.178 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:16:34.178 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/251) 2023-10-08T08:16:34.588 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:16:34.605 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:16:34.605 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:16:34.909 INFO:teuthology.orchestra.run.smithi032.stdout:generic/251 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:16:34.919 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/251 2023-10-08T08:16:34.919 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/251 2023-10-08T08:16:34.919 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:16:34.922 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:16:34.944 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:16:34.944 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/252) 2023-10-08T08:16:35.345 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:16:35.355 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:16:35.355 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:16:35.673 INFO:teuthology.orchestra.run.smithi032.stdout:generic/252 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:16:35.678 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/252 2023-10-08T08:16:35.679 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/252 2023-10-08T08:16:35.679 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:16:35.681 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:16:35.703 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:16:35.703 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/253) 2023-10-08T08:16:36.111 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:16:36.125 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:16:36.125 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:16:36.397 INFO:teuthology.orchestra.run.smithi032.stdout:generic/253 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:16:36.405 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/253 2023-10-08T08:16:36.406 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/253 2023-10-08T08:16:36.406 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:16:36.412 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:16:36.435 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:16:36.435 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/254) 2023-10-08T08:16:36.820 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:16:36.839 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:16:36.839 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:16:37.123 INFO:teuthology.orchestra.run.smithi032.stdout:generic/254 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:16:37.137 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/254 2023-10-08T08:16:37.137 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/254 2023-10-08T08:16:37.137 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:16:37.142 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:16:37.172 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:16:37.172 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/255) 2023-10-08T08:16:37.565 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:16:37.581 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:16:37.581 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:16:39.382 INFO:teuthology.orchestra.run.smithi032.stdout:generic/255 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-10-08T08:16:39.392 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/255 2023-10-08T08:16:39.392 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/255 2023-10-08T08:16:39.392 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:16:39.398 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:16:39.423 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:16:39.424 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/256) 2023-10-08T08:16:39.884 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:16:39.893 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:16:39.893 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:16:41.631 INFO:teuthology.orchestra.run.smithi032.stdout:generic/256 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:16:41.637 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/256 2023-10-08T08:16:41.638 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/256 2023-10-08T08:16:41.639 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:16:41.640 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:16:41.652 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:16:41.652 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/257) 2023-10-08T08:16:42.073 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:16:42.096 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:16:42.096 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:16:43.282 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:16:43.284 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:16:44.842 INFO:teuthology.orchestra.run.smithi032.stdout:generic/257 2s 2023-10-08T08:16:44.956 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/257 2023-10-08T08:16:44.956 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:16:45.033 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:16:45.230 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:16:45.231 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/258) 2023-10-08T08:16:45.693 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:16:45.699 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:16:45.699 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:16:46.094 INFO:teuthology.orchestra.run.smithi032.stdout:generic/258 [failed, exit status 1]- output mismatch (see /tmp/tmp.p8vAuQqzIgxfstests-dev/results//generic/258.out.bad) 2023-10-08T08:16:46.106 INFO:teuthology.orchestra.run.smithi032.stdout: --- tests/generic/258.out 2023-10-08 06:10:44.415318890 +0000 2023-10-08T08:16:46.106 INFO:teuthology.orchestra.run.smithi032.stdout: +++ /tmp/tmp.p8vAuQqzIgxfstests-dev/results//generic/258.out.bad 2023-10-08 08:16:46.088022553 +0000 2023-10-08T08:16:46.106 INFO:teuthology.orchestra.run.smithi032.stdout: @@ -1,5 +1,6 @@ 2023-10-08T08:16:46.106 INFO:teuthology.orchestra.run.smithi032.stdout: QA output created by 258 2023-10-08T08:16:46.106 INFO:teuthology.orchestra.run.smithi032.stdout: Creating file with timestamp of Jan 1, 1960 2023-10-08T08:16:46.107 INFO:teuthology.orchestra.run.smithi032.stdout: Testing for negative seconds since epoch 2023-10-08T08:16:46.107 INFO:teuthology.orchestra.run.smithi032.stdout: -Remounting to flush cache 2023-10-08T08:16:46.107 INFO:teuthology.orchestra.run.smithi032.stdout: -Testing for negative seconds since epoch 2023-10-08T08:16:46.107 INFO:teuthology.orchestra.run.smithi032.stdout: +Timestamp wrapped: 3979351756 2023-10-08T08:16:46.107 INFO:teuthology.orchestra.run.smithi032.stdout: +Timestamp wrapped 2023-10-08T08:16:46.107 INFO:teuthology.orchestra.run.smithi032.stdout: +(see /tmp/tmp.p8vAuQqzIgxfstests-dev/results//generic/258.full for details) 2023-10-08T08:16:46.111 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/258 2023-10-08T08:16:46.111 INFO:teuthology.orchestra.run.smithi032.stdout:Failures: generic/258 2023-10-08T08:16:46.111 INFO:teuthology.orchestra.run.smithi032.stdout:Failed 1 of 1 tests 2023-10-08T08:16:46.120 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:16:46.142 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T08:16:46.143 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-10-08T08:16:46.143 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-10-08T08:16:46.143 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/259) 2023-10-08T08:16:46.598 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:16:46.610 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:16:46.610 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:16:46.869 INFO:teuthology.orchestra.run.smithi032.stdout:generic/259 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:16:46.887 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/259 2023-10-08T08:16:46.887 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/259 2023-10-08T08:16:46.887 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:16:46.889 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:16:46.900 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:16:46.900 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/260) 2023-10-08T08:16:47.281 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:16:47.290 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:16:47.290 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:16:47.559 INFO:teuthology.orchestra.run.smithi032.stdout:generic/260 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:16:47.567 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/260 2023-10-08T08:16:47.568 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/260 2023-10-08T08:16:47.568 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:16:47.574 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:16:47.605 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:16:47.605 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/261) 2023-10-08T08:16:48.009 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:16:48.014 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:16:48.015 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:16:48.272 INFO:teuthology.orchestra.run.smithi032.stdout:generic/261 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:16:48.284 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/261 2023-10-08T08:16:48.284 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/261 2023-10-08T08:16:48.285 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:16:48.287 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:16:48.309 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:16:48.310 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/262) 2023-10-08T08:16:48.670 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:16:48.678 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:16:48.678 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:16:48.962 INFO:teuthology.orchestra.run.smithi032.stdout:generic/262 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:16:48.977 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/262 2023-10-08T08:16:48.977 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/262 2023-10-08T08:16:48.977 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:16:48.989 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:16:49.022 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:16:49.023 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/263) 2023-10-08T08:16:49.422 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:16:49.428 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:16:49.428 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:17:13.348 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:17:13.351 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:17:43.404 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:17:43.407 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:18:13.784 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:18:13.787 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:18:31.454 INFO:teuthology.orchestra.run.smithi032.stdout:generic/263 102s 2023-10-08T08:18:31.466 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/263 2023-10-08T08:18:31.467 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:18:31.472 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:18:31.489 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:18:31.489 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/264) 2023-10-08T08:18:31.805 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:18:31.814 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:18:31.814 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:18:32.094 INFO:teuthology.orchestra.run.smithi032.stdout:generic/264 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:18:32.103 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/264 2023-10-08T08:18:32.103 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/264 2023-10-08T08:18:32.103 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:18:32.108 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:18:32.126 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:18:32.127 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/265) 2023-10-08T08:18:32.451 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:18:32.460 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:18:32.460 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:18:32.809 INFO:teuthology.orchestra.run.smithi032.stdout:generic/265 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:18:32.817 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/265 2023-10-08T08:18:32.817 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/265 2023-10-08T08:18:32.817 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:18:32.823 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:18:32.840 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:18:32.840 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/266) 2023-10-08T08:18:33.162 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:18:33.172 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:18:33.172 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:18:33.455 INFO:teuthology.orchestra.run.smithi032.stdout:generic/266 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:18:33.465 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/266 2023-10-08T08:18:33.465 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/266 2023-10-08T08:18:33.465 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:18:33.471 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:18:33.489 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:18:33.490 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/267) 2023-10-08T08:18:33.810 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:18:33.818 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:18:33.819 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:18:34.091 INFO:teuthology.orchestra.run.smithi032.stdout:generic/267 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:18:34.101 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/267 2023-10-08T08:18:34.101 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/267 2023-10-08T08:18:34.101 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:18:34.107 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:18:34.125 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:18:34.125 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/268) 2023-10-08T08:18:34.431 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:18:34.441 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:18:34.441 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:18:34.930 INFO:teuthology.orchestra.run.smithi032.stdout:generic/268 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:18:34.992 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/268 2023-10-08T08:18:34.993 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/268 2023-10-08T08:18:34.993 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:18:34.996 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:18:35.113 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:18:35.113 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/269) 2023-10-08T08:18:35.420 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:18:35.429 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:18:35.429 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:18:35.677 INFO:teuthology.orchestra.run.smithi032.stdout:generic/269 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:18:35.686 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/269 2023-10-08T08:18:35.686 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/269 2023-10-08T08:18:35.686 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:18:35.692 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:18:35.710 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:18:35.710 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/270) 2023-10-08T08:18:36.026 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:18:36.035 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:18:36.035 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:18:36.315 INFO:teuthology.orchestra.run.smithi032.stdout:generic/270 [not run] disk quotas not supported by this filesystem type: ceph-fuse 2023-10-08T08:18:36.324 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/270 2023-10-08T08:18:36.324 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/270 2023-10-08T08:18:36.324 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:18:36.330 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:18:36.348 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:18:36.348 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/271) 2023-10-08T08:18:36.677 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:18:36.686 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:18:36.686 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:18:36.957 INFO:teuthology.orchestra.run.smithi032.stdout:generic/271 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:18:36.966 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/271 2023-10-08T08:18:36.967 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/271 2023-10-08T08:18:36.967 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:18:36.973 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:18:36.990 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:18:36.991 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/272) 2023-10-08T08:18:37.294 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:18:37.304 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:18:37.304 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:18:37.578 INFO:teuthology.orchestra.run.smithi032.stdout:generic/272 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:18:37.588 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/272 2023-10-08T08:18:37.588 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/272 2023-10-08T08:18:37.588 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:18:37.594 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:18:37.614 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:18:37.614 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/273) 2023-10-08T08:18:37.920 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:18:37.929 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:18:37.929 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:18:38.181 INFO:teuthology.orchestra.run.smithi032.stdout:generic/273 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:18:38.190 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/273 2023-10-08T08:18:38.190 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/273 2023-10-08T08:18:38.190 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:18:38.197 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:18:38.219 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:18:38.219 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/274) 2023-10-08T08:18:38.541 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:18:38.550 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:18:38.550 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:18:38.796 INFO:teuthology.orchestra.run.smithi032.stdout:generic/274 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:18:38.805 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/274 2023-10-08T08:18:38.805 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/274 2023-10-08T08:18:38.805 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:18:38.810 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:18:38.828 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:18:38.828 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/275) 2023-10-08T08:18:39.149 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:18:39.157 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:18:39.157 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:18:39.408 INFO:teuthology.orchestra.run.smithi032.stdout:generic/275 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:18:39.417 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/275 2023-10-08T08:18:39.417 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/275 2023-10-08T08:18:39.417 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:18:39.423 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:18:39.445 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:18:39.445 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/276) 2023-10-08T08:18:39.761 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:18:39.768 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:18:39.768 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:18:40.051 INFO:teuthology.orchestra.run.smithi032.stdout:generic/276 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:18:40.061 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/276 2023-10-08T08:18:40.061 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/276 2023-10-08T08:18:40.061 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:18:40.067 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:18:40.085 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:18:40.086 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/277) 2023-10-08T08:18:40.399 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:18:40.408 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:18:40.408 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:18:40.672 INFO:teuthology.orchestra.run.smithi032.stdout:generic/277 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:18:40.681 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/277 2023-10-08T08:18:40.681 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/277 2023-10-08T08:18:40.681 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:18:40.686 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:18:40.704 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:18:40.705 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/278) 2023-10-08T08:18:41.013 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:18:41.022 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:18:41.022 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:18:41.308 INFO:teuthology.orchestra.run.smithi032.stdout:generic/278 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:18:41.318 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/278 2023-10-08T08:18:41.318 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/278 2023-10-08T08:18:41.318 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:18:41.324 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:18:41.342 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:18:41.343 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/279) 2023-10-08T08:18:41.656 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:18:41.665 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:18:41.666 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:18:41.942 INFO:teuthology.orchestra.run.smithi032.stdout:generic/279 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:18:41.950 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/279 2023-10-08T08:18:41.951 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/279 2023-10-08T08:18:41.951 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:18:41.956 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:18:41.976 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:18:41.976 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/280) 2023-10-08T08:18:42.290 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:18:42.299 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:18:42.299 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:18:42.614 INFO:teuthology.orchestra.run.smithi032.stdout:generic/280 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:18:42.623 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/280 2023-10-08T08:18:42.623 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/280 2023-10-08T08:18:42.623 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:18:42.629 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:18:42.647 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:18:42.648 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/281) 2023-10-08T08:18:42.964 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:18:42.973 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:18:42.973 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:18:43.254 INFO:teuthology.orchestra.run.smithi032.stdout:generic/281 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:18:43.263 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/281 2023-10-08T08:18:43.264 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/281 2023-10-08T08:18:43.264 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:18:43.269 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:18:43.288 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:18:43.288 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/282) 2023-10-08T08:18:43.612 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:18:43.621 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:18:43.621 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:18:43.835 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:18:43.838 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:18:43.903 INFO:teuthology.orchestra.run.smithi032.stdout:generic/282 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:18:43.913 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/282 2023-10-08T08:18:43.913 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/282 2023-10-08T08:18:43.913 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:18:43.919 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:18:43.937 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:18:43.938 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/283) 2023-10-08T08:18:44.254 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:18:44.263 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:18:44.263 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:18:44.559 INFO:teuthology.orchestra.run.smithi032.stdout:generic/283 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:18:44.569 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/283 2023-10-08T08:18:44.569 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/283 2023-10-08T08:18:44.569 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:18:44.575 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:18:44.595 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:18:44.595 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/284) 2023-10-08T08:18:44.925 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:18:44.935 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:18:44.935 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:18:45.187 INFO:teuthology.orchestra.run.smithi032.stdout:generic/284 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:18:45.195 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/284 2023-10-08T08:18:45.196 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/284 2023-10-08T08:18:45.196 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:18:45.201 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:18:45.219 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:18:45.219 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/285) 2023-10-08T08:18:45.533 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:18:45.543 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:18:45.543 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:18:48.561 INFO:teuthology.orchestra.run.smithi032.stdout:generic/285 3s 2023-10-08T08:18:48.573 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/285 2023-10-08T08:18:48.573 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:18:48.578 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:18:48.597 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:18:48.597 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/286) 2023-10-08T08:18:48.903 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:18:48.913 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:18:48.913 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:19:13.875 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:19:13.877 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:19:43.932 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:19:43.935 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:20:07.236 INFO:teuthology.orchestra.run.smithi032.stdout:generic/286 79s 2023-10-08T08:20:07.247 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/286 2023-10-08T08:20:07.247 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:20:07.251 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:20:07.267 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:20:07.267 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/287) 2023-10-08T08:20:07.678 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:20:07.682 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:20:07.682 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:20:07.966 INFO:teuthology.orchestra.run.smithi032.stdout:generic/287 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:20:07.975 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/287 2023-10-08T08:20:07.975 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/287 2023-10-08T08:20:07.975 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:20:07.981 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:20:07.999 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:20:08.000 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/288) 2023-10-08T08:20:08.326 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:20:08.336 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:20:08.336 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:20:08.584 INFO:teuthology.orchestra.run.smithi032.stdout:generic/288 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:20:08.593 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/288 2023-10-08T08:20:08.593 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/288 2023-10-08T08:20:08.593 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:20:08.599 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:20:08.617 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:20:08.618 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/289) 2023-10-08T08:20:08.942 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:20:08.951 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:20:08.951 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:20:09.209 INFO:teuthology.orchestra.run.smithi032.stdout:generic/289 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:20:09.217 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/289 2023-10-08T08:20:09.218 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/289 2023-10-08T08:20:09.218 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:20:09.223 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:20:09.243 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:20:09.243 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/290) 2023-10-08T08:20:09.567 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:20:09.576 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:20:09.576 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:20:09.832 INFO:teuthology.orchestra.run.smithi032.stdout:generic/290 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:20:09.839 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/290 2023-10-08T08:20:09.839 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/290 2023-10-08T08:20:09.840 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:20:09.845 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:20:09.862 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:20:09.862 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/291) 2023-10-08T08:20:10.184 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:20:10.194 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:20:10.194 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:20:10.439 INFO:teuthology.orchestra.run.smithi032.stdout:generic/291 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:20:10.447 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/291 2023-10-08T08:20:10.447 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/291 2023-10-08T08:20:10.448 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:20:10.452 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:20:10.470 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:20:10.470 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/292) 2023-10-08T08:20:10.789 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:20:10.798 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:20:10.798 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:20:11.052 INFO:teuthology.orchestra.run.smithi032.stdout:generic/292 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:20:11.061 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/292 2023-10-08T08:20:11.061 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/292 2023-10-08T08:20:11.061 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:20:11.067 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:20:11.085 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:20:11.085 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/293) 2023-10-08T08:20:11.401 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:20:11.411 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:20:11.411 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:20:11.660 INFO:teuthology.orchestra.run.smithi032.stdout:generic/293 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:20:11.668 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/293 2023-10-08T08:20:11.669 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/293 2023-10-08T08:20:11.669 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:20:11.674 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:20:11.692 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:20:11.692 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/294) 2023-10-08T08:20:11.998 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:20:12.007 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:20:12.007 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:20:12.257 INFO:teuthology.orchestra.run.smithi032.stdout:generic/294 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:20:12.262 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/294 2023-10-08T08:20:12.262 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/294 2023-10-08T08:20:12.262 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:20:12.267 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:20:12.289 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:20:12.289 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/295) 2023-10-08T08:20:12.608 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:20:12.618 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:20:12.618 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:20:12.879 INFO:teuthology.orchestra.run.smithi032.stdout:generic/295 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:20:12.887 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/295 2023-10-08T08:20:12.887 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/295 2023-10-08T08:20:12.887 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:20:12.893 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:20:12.915 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:20:12.915 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/296) 2023-10-08T08:20:13.235 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:20:13.243 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:20:13.243 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:20:13.512 INFO:teuthology.orchestra.run.smithi032.stdout:generic/296 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:20:13.521 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/296 2023-10-08T08:20:13.521 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/296 2023-10-08T08:20:13.521 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:20:13.527 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:20:13.543 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:20:13.543 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/297) 2023-10-08T08:20:13.855 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:20:13.864 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:20:13.865 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:20:13.988 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:20:13.990 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:20:14.127 INFO:teuthology.orchestra.run.smithi032.stdout:generic/297 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:20:14.134 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/297 2023-10-08T08:20:14.134 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/297 2023-10-08T08:20:14.135 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:20:14.141 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:20:14.160 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:20:14.160 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/298) 2023-10-08T08:20:14.480 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:20:14.490 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:20:14.490 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:20:14.737 INFO:teuthology.orchestra.run.smithi032.stdout:generic/298 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:20:14.745 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/298 2023-10-08T08:20:14.746 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/298 2023-10-08T08:20:14.746 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:20:14.751 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:20:14.769 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:20:14.770 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/299) 2023-10-08T08:20:15.082 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:20:15.090 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:20:15.091 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:20:15.351 INFO:teuthology.orchestra.run.smithi032.stdout:generic/299 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:20:15.360 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/299 2023-10-08T08:20:15.360 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/299 2023-10-08T08:20:15.360 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:20:15.366 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:20:15.385 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:20:15.385 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/300) 2023-10-08T08:20:15.700 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:20:15.709 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:20:15.709 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:20:15.955 INFO:teuthology.orchestra.run.smithi032.stdout:generic/300 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:20:15.963 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/300 2023-10-08T08:20:15.963 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/300 2023-10-08T08:20:15.964 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:20:15.969 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:20:15.987 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:20:15.988 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/301) 2023-10-08T08:20:16.313 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:20:16.324 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:20:16.324 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:20:16.569 INFO:teuthology.orchestra.run.smithi032.stdout:generic/301 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:20:16.577 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/301 2023-10-08T08:20:16.577 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/301 2023-10-08T08:20:16.577 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:20:16.582 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:20:16.600 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:20:16.601 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/302) 2023-10-08T08:20:16.918 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:20:16.928 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:20:16.928 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:20:17.187 INFO:teuthology.orchestra.run.smithi032.stdout:generic/302 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:20:17.196 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/302 2023-10-08T08:20:17.196 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/302 2023-10-08T08:20:17.197 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:20:17.202 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:20:17.220 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:20:17.220 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/303) 2023-10-08T08:20:17.541 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:20:17.550 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:20:17.550 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:20:17.926 INFO:teuthology.orchestra.run.smithi032.stdout:generic/303 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-10-08T08:20:17.934 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/303 2023-10-08T08:20:17.934 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/303 2023-10-08T08:20:17.934 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:20:17.940 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:20:17.959 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:20:17.960 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/304) 2023-10-08T08:20:18.283 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:20:18.292 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:20:18.292 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:20:18.655 INFO:teuthology.orchestra.run.smithi032.stdout:generic/304 [not run] Dedupe not supported by test filesystem type: ceph-fuse 2023-10-08T08:20:18.662 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/304 2023-10-08T08:20:18.662 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/304 2023-10-08T08:20:18.662 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:20:18.667 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:20:18.683 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:20:18.683 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/305) 2023-10-08T08:20:19.000 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:20:19.009 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:20:19.010 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:20:19.271 INFO:teuthology.orchestra.run.smithi032.stdout:generic/305 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:20:19.280 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/305 2023-10-08T08:20:19.280 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/305 2023-10-08T08:20:19.280 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:20:19.285 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:20:19.303 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:20:19.303 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/306) 2023-10-08T08:20:19.611 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:20:19.620 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:20:19.620 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:20:19.873 INFO:teuthology.orchestra.run.smithi032.stdout:generic/306 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:20:19.882 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/306 2023-10-08T08:20:19.882 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/306 2023-10-08T08:20:19.882 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:20:19.888 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:20:19.910 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:20:19.910 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/307) 2023-10-08T08:20:20.227 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:20:20.236 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:20:20.236 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:20:20.499 INFO:teuthology.orchestra.run.smithi032.stdout:generic/307 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:20:20.509 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/307 2023-10-08T08:20:20.509 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/307 2023-10-08T08:20:20.509 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:20:20.514 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:20:20.532 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:20:20.532 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/308) 2023-10-08T08:20:20.839 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:20:20.848 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:20:20.848 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:20:21.174 INFO:teuthology.orchestra.run.smithi032.stdout:generic/308 1s 2023-10-08T08:20:21.187 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/308 2023-10-08T08:20:21.187 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:20:21.193 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:20:21.210 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:20:21.210 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/309) 2023-10-08T08:20:21.519 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:20:21.528 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:20:21.528 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:20:22.938 INFO:teuthology.orchestra.run.smithi032.stdout:generic/309 1s 2023-10-08T08:20:22.951 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/309 2023-10-08T08:20:22.952 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:20:22.956 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:20:22.971 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:20:22.972 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/310) 2023-10-08T08:20:23.280 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:20:23.290 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:20:23.290 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:20:44.043 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:20:44.046 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:21:14.090 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:21:14.093 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:21:44.147 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:21:44.150 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:22:09.862 INFO:teuthology.orchestra.run.smithi032.stdout:generic/310 106s 2023-10-08T08:22:09.875 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/310 2023-10-08T08:22:09.875 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:22:09.881 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:22:09.901 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:22:09.901 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/311) 2023-10-08T08:22:10.171 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:22:10.178 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:22:10.178 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:22:10.512 INFO:teuthology.orchestra.run.smithi032.stdout:generic/311 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:22:10.521 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/311 2023-10-08T08:22:10.521 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/311 2023-10-08T08:22:10.521 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:22:10.527 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:22:10.545 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:22:10.545 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/312) 2023-10-08T08:22:11.073 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:22:11.083 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:22:11.083 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:22:11.388 INFO:teuthology.orchestra.run.smithi032.stdout:generic/312 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:22:11.397 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/312 2023-10-08T08:22:11.398 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/312 2023-10-08T08:22:11.398 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:22:11.404 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:22:11.423 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:22:11.423 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/313) 2023-10-08T08:22:11.730 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:22:11.738 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:22:11.739 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:22:14.466 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:22:14.469 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:22:16.130 INFO:teuthology.orchestra.run.smithi032.stdout:generic/313 5s 2023-10-08T08:22:16.141 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/313 2023-10-08T08:22:16.142 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:22:16.147 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:22:16.165 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:22:16.166 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/314) 2023-10-08T08:22:16.481 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:22:16.491 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:22:16.491 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:22:17.164 INFO:teuthology.orchestra.run.smithi032.stdout:generic/314 1s 2023-10-08T08:22:17.177 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/314 2023-10-08T08:22:17.177 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:22:17.182 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:22:17.199 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:22:17.199 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/315) 2023-10-08T08:22:17.505 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:22:17.514 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:22:17.514 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:22:19.471 INFO:teuthology.orchestra.run.smithi032.stdout:generic/315 2s 2023-10-08T08:22:19.485 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/315 2023-10-08T08:22:19.485 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:22:19.491 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:22:19.508 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:22:19.509 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/316) 2023-10-08T08:22:19.805 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:22:19.813 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:22:19.813 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:22:21.836 INFO:teuthology.orchestra.run.smithi032.stdout:generic/316 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-10-08T08:22:21.845 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/316 2023-10-08T08:22:21.845 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/316 2023-10-08T08:22:21.845 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:22:21.851 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:22:21.869 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:22:21.870 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/317) 2023-10-08T08:22:22.181 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:22:22.191 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:22:22.192 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:22:22.453 INFO:teuthology.orchestra.run.smithi032.stdout:generic/317 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:22:22.462 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/317 2023-10-08T08:22:22.462 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/317 2023-10-08T08:22:22.462 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:22:22.467 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:22:22.482 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:22:22.483 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/318) 2023-10-08T08:22:22.793 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:22:22.802 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:22:22.802 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:22:23.053 INFO:teuthology.orchestra.run.smithi032.stdout:generic/318 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:22:23.061 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/318 2023-10-08T08:22:23.061 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/318 2023-10-08T08:22:23.061 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:22:23.066 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:22:23.084 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:22:23.084 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/319) 2023-10-08T08:22:23.399 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:22:23.409 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:22:23.409 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:22:23.712 INFO:teuthology.orchestra.run.smithi032.stdout:generic/319 [not run] ACLs not supported by this filesystem type: ceph-fuse 2023-10-08T08:22:23.720 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/319 2023-10-08T08:22:23.720 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/319 2023-10-08T08:22:23.720 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:22:23.725 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:22:23.744 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:22:23.744 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/320) 2023-10-08T08:22:24.062 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:22:24.071 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:22:24.071 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:22:24.319 INFO:teuthology.orchestra.run.smithi032.stdout:generic/320 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:22:24.328 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/320 2023-10-08T08:22:24.328 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/320 2023-10-08T08:22:24.328 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:22:24.334 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:22:24.353 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:22:24.353 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/321) 2023-10-08T08:22:24.672 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:22:24.681 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:22:24.682 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:22:24.964 INFO:teuthology.orchestra.run.smithi032.stdout:generic/321 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:22:24.973 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/321 2023-10-08T08:22:24.974 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/321 2023-10-08T08:22:24.974 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:22:24.979 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:22:24.996 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:22:24.997 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/322) 2023-10-08T08:22:25.311 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:22:25.321 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:22:25.321 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:22:25.598 INFO:teuthology.orchestra.run.smithi032.stdout:generic/322 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:22:25.608 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/322 2023-10-08T08:22:25.608 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/322 2023-10-08T08:22:25.608 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:22:25.614 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:22:25.631 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:22:25.631 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/323) 2023-10-08T08:22:25.944 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:22:25.954 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:22:25.954 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:22:44.518 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:22:44.520 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:22:44.557 INFO:tasks.ceph.osd.0.smithi032.stderr:2023-10-08T08:22:44.548+0000 7f519f0f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 251953) UID: 0 2023-10-08T08:22:44.557 INFO:tasks.ceph.osd.1.smithi032.stderr:2023-10-08T08:22:44.548+0000 7efe8aecf700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 251953) UID: 0 2023-10-08T08:22:44.558 INFO:tasks.ceph.osd.3.smithi032.stderr:2023-10-08T08:22:44.552+0000 7ff6419ae700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 251953) UID: 0 2023-10-08T08:22:44.558 INFO:tasks.ceph.osd.2.smithi032.stderr:2023-10-08T08:22:44.552+0000 7fe8a3511700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 251953) UID: 0 2023-10-08T08:24:28.313 INFO:teuthology.orchestra.run.smithi032.stdout:generic/323 122s 2023-10-08T08:24:28.410 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/323 2023-10-08T08:24:28.410 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:24:28.416 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:24:28.441 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:24:28.441 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/324) 2023-10-08T08:24:29.065 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:24:29.075 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:24:29.075 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:24:29.786 INFO:teuthology.orchestra.run.smithi032.stdout:generic/324 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:24:29.795 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/324 2023-10-08T08:24:29.795 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/324 2023-10-08T08:24:29.795 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:24:29.800 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:24:29.819 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:24:29.819 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/325) 2023-10-08T08:24:30.133 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:24:30.142 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:24:30.142 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:24:30.747 INFO:teuthology.orchestra.run.smithi032.stdout:generic/325 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:24:30.755 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/325 2023-10-08T08:24:30.755 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/325 2023-10-08T08:24:30.755 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:24:30.760 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:24:30.781 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:24:30.781 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/326) 2023-10-08T08:24:31.063 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:24:31.071 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:24:31.072 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:24:31.305 INFO:teuthology.orchestra.run.smithi032.stdout:generic/326 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:24:31.314 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/326 2023-10-08T08:24:31.314 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/326 2023-10-08T08:24:31.314 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:24:31.319 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:24:31.337 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:24:31.338 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/327) 2023-10-08T08:24:31.609 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:24:31.616 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:24:31.616 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:24:31.971 INFO:teuthology.orchestra.run.smithi032.stdout:generic/327 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:24:31.978 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/327 2023-10-08T08:24:31.978 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/327 2023-10-08T08:24:31.978 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:24:31.983 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:24:31.999 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:24:32.000 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/328) 2023-10-08T08:24:32.282 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:24:32.289 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:24:32.289 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:24:32.542 INFO:teuthology.orchestra.run.smithi032.stdout:generic/328 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:24:32.551 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/328 2023-10-08T08:24:32.551 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/328 2023-10-08T08:24:32.551 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:24:32.557 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:24:32.572 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:24:32.573 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/329) 2023-10-08T08:24:32.860 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:24:32.868 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:24:32.868 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:24:33.179 INFO:teuthology.orchestra.run.smithi032.stdout:generic/329 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:24:33.189 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/329 2023-10-08T08:24:33.189 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/329 2023-10-08T08:24:33.189 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:24:33.193 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:24:33.211 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:24:33.211 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/330) 2023-10-08T08:24:33.507 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:24:33.516 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:24:33.516 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:24:33.748 INFO:teuthology.orchestra.run.smithi032.stdout:generic/330 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:24:33.757 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/330 2023-10-08T08:24:33.757 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/330 2023-10-08T08:24:33.757 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:24:33.762 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:24:33.779 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:24:33.779 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/331) 2023-10-08T08:24:34.074 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:24:34.082 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:24:34.082 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:24:34.403 INFO:teuthology.orchestra.run.smithi032.stdout:generic/331 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:24:34.409 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/331 2023-10-08T08:24:34.409 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/331 2023-10-08T08:24:34.409 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:24:34.414 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:24:34.430 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:24:34.430 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/332) 2023-10-08T08:24:34.707 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:24:34.715 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:24:34.715 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:24:34.954 INFO:teuthology.orchestra.run.smithi032.stdout:generic/332 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:24:34.962 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/332 2023-10-08T08:24:34.962 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/332 2023-10-08T08:24:34.962 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:24:34.967 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:24:34.983 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:24:34.983 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/333) 2023-10-08T08:24:35.256 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:24:35.264 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:24:35.264 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:24:35.486 INFO:teuthology.orchestra.run.smithi032.stdout:generic/333 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:24:35.493 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/333 2023-10-08T08:24:35.493 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/333 2023-10-08T08:24:35.493 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:24:35.498 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:24:35.514 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:24:35.514 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/334) 2023-10-08T08:24:35.791 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:24:35.800 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:24:35.801 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:24:36.050 INFO:teuthology.orchestra.run.smithi032.stdout:generic/334 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:24:36.054 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/334 2023-10-08T08:24:36.054 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/334 2023-10-08T08:24:36.055 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:24:36.059 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:24:36.075 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:24:36.075 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/335) 2023-10-08T08:24:36.373 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:24:36.383 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:24:36.383 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:24:36.643 INFO:teuthology.orchestra.run.smithi032.stdout:generic/335 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:24:36.650 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/335 2023-10-08T08:24:36.650 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/335 2023-10-08T08:24:36.650 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:24:36.656 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:24:36.673 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:24:36.673 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/336) 2023-10-08T08:24:36.959 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:24:36.965 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:24:36.966 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:24:37.243 INFO:teuthology.orchestra.run.smithi032.stdout:generic/336 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:24:37.250 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/336 2023-10-08T08:24:37.250 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/336 2023-10-08T08:24:37.250 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:24:37.256 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:24:37.272 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:24:37.272 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/337) 2023-10-08T08:24:37.553 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:24:37.560 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:24:37.560 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:24:37.808 INFO:teuthology.orchestra.run.smithi032.stdout:generic/337 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:24:37.816 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/337 2023-10-08T08:24:37.816 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/337 2023-10-08T08:24:37.816 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:24:37.822 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:24:37.838 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:24:37.838 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/338) 2023-10-08T08:24:38.116 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:24:38.123 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:24:38.123 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:24:38.434 INFO:teuthology.orchestra.run.smithi032.stdout:generic/338 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:24:38.443 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/338 2023-10-08T08:24:38.443 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/338 2023-10-08T08:24:38.443 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:24:38.448 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:24:38.468 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:24:38.469 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/339) 2023-10-08T08:24:38.749 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:24:38.758 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:24:38.758 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:24:38.977 INFO:teuthology.orchestra.run.smithi032.stdout:generic/339 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:24:38.985 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/339 2023-10-08T08:24:38.985 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/339 2023-10-08T08:24:38.985 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:24:38.991 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:24:39.003 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:24:39.004 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/340) 2023-10-08T08:24:39.272 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:24:39.281 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:24:39.281 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:24:39.520 INFO:teuthology.orchestra.run.smithi032.stdout:generic/340 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:24:39.527 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/340 2023-10-08T08:24:39.527 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/340 2023-10-08T08:24:39.527 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:24:39.532 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:24:39.546 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:24:39.547 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/341) 2023-10-08T08:24:39.835 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:24:39.842 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:24:39.842 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:24:40.122 INFO:teuthology.orchestra.run.smithi032.stdout:generic/341 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:24:40.131 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/341 2023-10-08T08:24:40.132 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/341 2023-10-08T08:24:40.132 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:24:40.137 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:24:40.154 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:24:40.154 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/342) 2023-10-08T08:24:40.431 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:24:40.437 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:24:40.437 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:24:40.689 INFO:teuthology.orchestra.run.smithi032.stdout:generic/342 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:24:40.696 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/342 2023-10-08T08:24:40.696 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/342 2023-10-08T08:24:40.696 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:24:40.701 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:24:40.717 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:24:40.717 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/343) 2023-10-08T08:24:40.995 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:24:41.002 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:24:41.002 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:24:41.252 INFO:teuthology.orchestra.run.smithi032.stdout:generic/343 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:24:41.261 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/343 2023-10-08T08:24:41.261 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/343 2023-10-08T08:24:41.261 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:24:41.266 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:24:41.282 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:24:41.282 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/344) 2023-10-08T08:24:41.544 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:24:41.551 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:24:41.552 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:24:41.773 INFO:teuthology.orchestra.run.smithi032.stdout:generic/344 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:24:41.783 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/344 2023-10-08T08:24:41.783 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/344 2023-10-08T08:24:41.783 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:24:41.788 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:24:41.806 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:24:41.806 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/345) 2023-10-08T08:24:42.119 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:24:42.126 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:24:42.126 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:24:42.353 INFO:teuthology.orchestra.run.smithi032.stdout:generic/345 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:24:42.360 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/345 2023-10-08T08:24:42.361 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/345 2023-10-08T08:24:42.361 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:24:42.365 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:24:42.381 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:24:42.381 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/346) 2023-10-08T08:24:42.654 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:24:42.662 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:24:42.662 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:24:42.889 INFO:teuthology.orchestra.run.smithi032.stdout:generic/346 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:24:42.896 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/346 2023-10-08T08:24:42.896 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/346 2023-10-08T08:24:42.896 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:24:42.901 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:24:42.919 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:24:42.919 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/347) 2023-10-08T08:24:43.190 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:24:43.198 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:24:43.198 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:24:43.560 INFO:teuthology.orchestra.run.smithi032.stdout:generic/347 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:24:43.568 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/347 2023-10-08T08:24:43.568 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/347 2023-10-08T08:24:43.568 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:24:43.572 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:24:43.586 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:24:43.587 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/348) 2023-10-08T08:24:43.868 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:24:43.874 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:24:43.875 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:24:44.110 INFO:teuthology.orchestra.run.smithi032.stdout:generic/348 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:24:44.119 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/348 2023-10-08T08:24:44.119 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/348 2023-10-08T08:24:44.119 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:24:44.124 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:24:44.140 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:24:44.141 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/349) 2023-10-08T08:24:44.433 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:24:44.442 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:24:44.442 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:24:46.191 INFO:teuthology.orchestra.run.smithi032.stdout:generic/349 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-10-08T08:24:46.198 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/349 2023-10-08T08:24:46.198 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/349 2023-10-08T08:24:46.198 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:24:46.202 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:24:46.220 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:24:46.220 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/350) 2023-10-08T08:24:46.498 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:24:46.507 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:24:46.507 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:24:49.459 INFO:teuthology.orchestra.run.smithi032.stdout:generic/350 3s 2023-10-08T08:24:49.473 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/350 2023-10-08T08:24:49.473 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:24:49.480 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:24:49.497 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:24:49.497 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/351) 2023-10-08T08:24:49.800 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:24:49.805 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:24:49.805 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:24:51.381 INFO:teuthology.orchestra.run.smithi032.stdout:generic/351 [not run] xfs_io finsert failed (old kernel/wrong fs?) 2023-10-08T08:24:51.465 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/351 2023-10-08T08:24:51.465 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/351 2023-10-08T08:24:51.465 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:24:51.465 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:24:51.465 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:24:51.466 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/352) 2023-10-08T08:24:51.751 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:24:51.757 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:24:51.757 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:24:52.022 INFO:teuthology.orchestra.run.smithi032.stdout:generic/352 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:24:52.031 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/352 2023-10-08T08:24:52.031 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/352 2023-10-08T08:24:52.031 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:24:52.036 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:24:52.051 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:24:52.051 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/353) 2023-10-08T08:24:52.358 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:24:52.365 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:24:52.365 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:24:52.601 INFO:teuthology.orchestra.run.smithi032.stdout:generic/353 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:24:52.609 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/353 2023-10-08T08:24:52.610 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/353 2023-10-08T08:24:52.610 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:24:52.615 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:24:52.630 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:24:52.630 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/354) 2023-10-08T08:24:52.916 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:24:52.924 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:24:52.924 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:24:53.157 INFO:teuthology.orchestra.run.smithi032.stdout:generic/354 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:24:53.164 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/354 2023-10-08T08:24:53.164 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/354 2023-10-08T08:24:53.164 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:24:53.169 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:24:53.188 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:24:53.189 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/355) 2023-10-08T08:24:53.475 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:24:53.483 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:24:53.483 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:24:55.227 INFO:teuthology.orchestra.run.smithi032.stdout:generic/355 2s 2023-10-08T08:24:55.244 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/355 2023-10-08T08:24:55.245 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:24:55.251 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:24:55.269 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:24:55.269 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/356) 2023-10-08T08:24:55.574 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:24:55.582 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:24:55.582 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:24:55.823 INFO:teuthology.orchestra.run.smithi032.stdout:generic/356 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:24:55.831 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/356 2023-10-08T08:24:55.831 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/356 2023-10-08T08:24:55.831 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:24:55.836 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:24:55.850 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:24:55.851 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/357) 2023-10-08T08:24:56.109 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:24:56.116 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:24:56.116 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:24:56.491 INFO:teuthology.orchestra.run.smithi032.stdout:generic/357 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:24:56.497 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/357 2023-10-08T08:24:56.497 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/357 2023-10-08T08:24:56.497 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:24:56.501 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:24:56.517 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:24:56.517 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/358) 2023-10-08T08:24:56.797 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:24:56.806 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:24:56.807 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:24:57.115 INFO:teuthology.orchestra.run.smithi032.stdout:generic/358 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:24:57.123 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/358 2023-10-08T08:24:57.123 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/358 2023-10-08T08:24:57.123 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:24:57.128 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:24:57.143 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:24:57.143 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/359) 2023-10-08T08:24:57.420 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:24:57.428 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:24:57.428 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:24:57.658 INFO:teuthology.orchestra.run.smithi032.stdout:generic/359 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:24:57.666 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/359 2023-10-08T08:24:57.666 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/359 2023-10-08T08:24:57.666 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:24:57.671 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:24:57.688 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:24:57.688 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/360) 2023-10-08T08:24:57.956 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:24:57.963 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:24:57.963 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:24:58.528 INFO:teuthology.orchestra.run.smithi032.stdout:generic/360 1s 2023-10-08T08:24:58.538 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/360 2023-10-08T08:24:58.539 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:24:58.544 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:24:58.559 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:24:58.559 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/361) 2023-10-08T08:24:58.835 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:24:58.842 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:24:58.843 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:24:59.265 INFO:teuthology.orchestra.run.smithi032.stdout:generic/361 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:24:59.274 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/361 2023-10-08T08:24:59.275 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/361 2023-10-08T08:24:59.275 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:24:59.280 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:24:59.298 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:24:59.298 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/362) 2023-10-08T08:24:59.597 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:24:59.604 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:24:59.605 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:24:59.831 INFO:teuthology.orchestra.run.smithi032.stdout:generic/362 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:24:59.838 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/362 2023-10-08T08:24:59.838 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/362 2023-10-08T08:24:59.839 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:24:59.843 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:24:59.858 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:24:59.858 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/363) 2023-10-08T08:25:00.126 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:25:00.134 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:25:00.134 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:25:00.348 INFO:teuthology.orchestra.run.smithi032.stdout:generic/363 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:25:00.356 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/363 2023-10-08T08:25:00.356 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/363 2023-10-08T08:25:00.356 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:25:00.362 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:25:00.378 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:25:00.378 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/364) 2023-10-08T08:25:00.647 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:25:00.654 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:25:00.654 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:25:00.915 INFO:teuthology.orchestra.run.smithi032.stdout:generic/364 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:25:00.922 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/364 2023-10-08T08:25:00.922 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/364 2023-10-08T08:25:00.922 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:25:00.926 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:25:00.941 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:25:00.942 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/365) 2023-10-08T08:25:01.239 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:25:01.247 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:25:01.247 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:25:01.455 INFO:teuthology.orchestra.run.smithi032.stdout:generic/365 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:25:01.461 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/365 2023-10-08T08:25:01.461 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/365 2023-10-08T08:25:01.461 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:25:01.465 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:25:01.481 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:25:01.481 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/366) 2023-10-08T08:25:01.785 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:25:01.792 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:25:01.792 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:25:02.004 INFO:teuthology.orchestra.run.smithi032.stdout:generic/366 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:25:02.011 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/366 2023-10-08T08:25:02.011 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/366 2023-10-08T08:25:02.011 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:25:02.016 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:25:02.032 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:25:02.032 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/367) 2023-10-08T08:25:02.317 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:25:02.324 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:25:02.324 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:25:02.529 INFO:teuthology.orchestra.run.smithi032.stdout:generic/367 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:25:02.536 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/367 2023-10-08T08:25:02.537 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/367 2023-10-08T08:25:02.537 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:25:02.541 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:25:02.556 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:25:02.556 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/368) 2023-10-08T08:25:02.827 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:25:02.834 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:25:02.835 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:25:03.075 INFO:teuthology.orchestra.run.smithi032.stdout:generic/368 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:25:03.082 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/368 2023-10-08T08:25:03.082 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/368 2023-10-08T08:25:03.082 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:25:03.087 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:25:03.103 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:25:03.103 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/369) 2023-10-08T08:25:03.381 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:25:03.388 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:25:03.388 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:25:03.628 INFO:teuthology.orchestra.run.smithi032.stdout:generic/369 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:25:03.635 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/369 2023-10-08T08:25:03.636 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/369 2023-10-08T08:25:03.636 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:25:03.640 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:25:03.657 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:25:03.657 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/370) 2023-10-08T08:25:03.924 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:25:03.932 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:25:03.932 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:25:04.158 INFO:teuthology.orchestra.run.smithi032.stdout:generic/370 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:25:04.165 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/370 2023-10-08T08:25:04.165 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/370 2023-10-08T08:25:04.165 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:25:04.170 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:25:04.187 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:25:04.187 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/371) 2023-10-08T08:25:04.503 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:25:04.512 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:25:04.513 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:25:04.725 INFO:teuthology.orchestra.run.smithi032.stdout:generic/371 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:25:04.732 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/371 2023-10-08T08:25:04.732 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/371 2023-10-08T08:25:04.732 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:25:04.736 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:25:04.753 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:25:04.753 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/372) 2023-10-08T08:25:05.037 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:25:05.045 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:25:05.045 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:25:05.294 INFO:teuthology.orchestra.run.smithi032.stdout:generic/372 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:25:05.299 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/372 2023-10-08T08:25:05.299 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/372 2023-10-08T08:25:05.299 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:25:05.304 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:25:05.319 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:25:05.319 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/373) 2023-10-08T08:25:05.611 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:25:05.619 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:25:05.619 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:25:05.843 INFO:teuthology.orchestra.run.smithi032.stdout:generic/373 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:25:05.850 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/373 2023-10-08T08:25:05.850 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/373 2023-10-08T08:25:05.851 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:25:05.855 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:25:05.872 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:25:05.872 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/374) 2023-10-08T08:25:06.148 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:25:06.156 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:25:06.156 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:25:06.391 INFO:teuthology.orchestra.run.smithi032.stdout:generic/374 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:25:06.399 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/374 2023-10-08T08:25:06.399 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/374 2023-10-08T08:25:06.399 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:25:06.405 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:25:06.421 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:25:06.421 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/375) 2023-10-08T08:25:06.717 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:25:06.725 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:25:06.725 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:25:07.054 INFO:teuthology.orchestra.run.smithi032.stdout:generic/375 [not run] ACLs not supported by this filesystem type: ceph-fuse 2023-10-08T08:25:07.061 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/375 2023-10-08T08:25:07.061 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/375 2023-10-08T08:25:07.061 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:25:07.066 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:25:07.081 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:25:07.081 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/376) 2023-10-08T08:25:07.372 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:25:07.381 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:25:07.381 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:25:07.753 INFO:teuthology.orchestra.run.smithi032.stdout:generic/376 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:25:07.761 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/376 2023-10-08T08:25:07.761 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/376 2023-10-08T08:25:07.762 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:25:07.767 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:25:07.784 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:25:07.784 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/377) 2023-10-08T08:25:08.060 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:25:08.068 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:25:08.068 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:25:08.305 INFO:teuthology.orchestra.run.smithi032.stdout:generic/377 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:25:08.313 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/377 2023-10-08T08:25:08.313 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/377 2023-10-08T08:25:08.313 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:25:08.317 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:25:08.332 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:25:08.332 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/378) 2023-10-08T08:25:08.608 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:25:08.617 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:25:08.618 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:25:10.241 INFO:teuthology.orchestra.run.smithi032.stdout:generic/378 2s 2023-10-08T08:25:10.252 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/378 2023-10-08T08:25:10.253 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:25:10.259 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:25:10.277 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:25:10.278 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/379) 2023-10-08T08:25:10.560 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:25:10.568 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:25:10.568 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:25:10.918 INFO:teuthology.orchestra.run.smithi032.stdout:generic/379 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:25:10.926 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/379 2023-10-08T08:25:10.926 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/379 2023-10-08T08:25:10.927 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:25:10.932 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:25:10.948 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:25:10.948 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/380) 2023-10-08T08:25:11.232 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:25:11.240 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:25:11.240 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:25:11.463 INFO:teuthology.orchestra.run.smithi032.stdout:generic/380 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:25:11.470 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/380 2023-10-08T08:25:11.470 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/380 2023-10-08T08:25:11.470 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:25:11.475 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:25:11.490 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:25:11.490 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/381) 2023-10-08T08:25:11.771 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:25:11.779 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:25:11.779 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:25:12.005 INFO:teuthology.orchestra.run.smithi032.stdout:generic/381 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:25:12.013 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/381 2023-10-08T08:25:12.013 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/381 2023-10-08T08:25:12.013 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:25:12.019 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:25:12.034 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:25:12.034 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/382) 2023-10-08T08:25:12.340 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:25:12.349 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:25:12.349 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:25:12.589 INFO:teuthology.orchestra.run.smithi032.stdout:generic/382 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:25:12.596 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/382 2023-10-08T08:25:12.596 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/382 2023-10-08T08:25:12.596 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:25:12.601 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:25:12.615 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:25:12.616 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/383) 2023-10-08T08:25:12.893 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:25:12.901 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:25:12.901 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:25:13.125 INFO:teuthology.orchestra.run.smithi032.stdout:generic/383 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:25:13.132 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/383 2023-10-08T08:25:13.132 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/383 2023-10-08T08:25:13.132 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:25:13.136 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:25:13.151 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:25:13.151 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/384) 2023-10-08T08:25:13.428 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:25:13.436 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:25:13.436 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:25:13.898 INFO:teuthology.orchestra.run.smithi032.stdout:generic/384 [not run] disk quotas not supported by this filesystem type: ceph-fuse 2023-10-08T08:25:13.906 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/384 2023-10-08T08:25:13.906 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/384 2023-10-08T08:25:13.906 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:25:13.911 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:25:13.928 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:25:13.928 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/385) 2023-10-08T08:25:14.238 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:25:14.246 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:25:14.246 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:25:14.479 INFO:teuthology.orchestra.run.smithi032.stdout:generic/385 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:25:14.486 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/385 2023-10-08T08:25:14.487 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/385 2023-10-08T08:25:14.487 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:25:14.491 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:25:14.506 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:25:14.507 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/386) 2023-10-08T08:25:14.792 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:25:14.798 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:25:14.799 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:25:15.055 INFO:teuthology.orchestra.run.smithi032.stdout:generic/386 [not run] disk quotas not supported by this filesystem type: ceph-fuse 2023-10-08T08:25:15.062 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/386 2023-10-08T08:25:15.063 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/386 2023-10-08T08:25:15.063 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:25:15.068 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:25:15.083 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:25:15.083 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/387) 2023-10-08T08:25:15.357 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:25:15.364 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:25:15.364 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:25:15.583 INFO:teuthology.orchestra.run.smithi032.stdout:generic/387 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:25:15.590 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/387 2023-10-08T08:25:15.590 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/387 2023-10-08T08:25:15.590 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:25:15.595 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:25:15.611 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:25:15.611 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/388) 2023-10-08T08:25:15.886 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:25:15.894 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:25:15.894 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:25:16.136 INFO:teuthology.orchestra.run.smithi032.stdout:generic/388 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:25:16.143 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/388 2023-10-08T08:25:16.144 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/388 2023-10-08T08:25:16.144 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:25:16.148 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:25:16.163 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:25:16.163 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/389) 2023-10-08T08:25:16.449 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:25:16.457 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:25:16.458 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:25:16.719 INFO:teuthology.orchestra.run.smithi032.stdout:generic/389 [not run] O_TMPFILE is not supported 2023-10-08T08:25:16.730 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/389 2023-10-08T08:25:16.730 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/389 2023-10-08T08:25:16.731 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:25:16.731 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:25:16.747 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:25:16.748 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/390) 2023-10-08T08:25:17.048 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:25:17.056 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:25:17.056 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:25:17.449 INFO:teuthology.orchestra.run.smithi032.stdout:generic/390 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:25:17.459 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/390 2023-10-08T08:25:17.459 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/390 2023-10-08T08:25:17.459 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:25:17.464 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:25:17.480 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:25:17.480 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/391) 2023-10-08T08:25:17.763 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:25:17.770 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:25:17.770 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:25:58.317 INFO:teuthology.orchestra.run.smithi032.stdout:generic/391 40s 2023-10-08T08:25:58.791 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/391 2023-10-08T08:25:58.792 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:25:58.798 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:25:58.932 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:25:58.933 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/392) 2023-10-08T08:26:01.836 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:26:01.844 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:26:01.844 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:26:02.206 INFO:teuthology.orchestra.run.smithi032.stdout:generic/392 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:26:02.212 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/392 2023-10-08T08:26:02.212 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/392 2023-10-08T08:26:02.212 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:26:02.218 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:26:02.231 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:26:02.232 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/393) 2023-10-08T08:26:02.644 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:26:02.658 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:26:02.659 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:26:02.923 INFO:teuthology.orchestra.run.smithi032.stdout:generic/393 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:26:02.929 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/393 2023-10-08T08:26:02.929 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/393 2023-10-08T08:26:02.929 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:26:02.935 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:26:02.956 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:26:02.957 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/394) 2023-10-08T08:26:03.371 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:26:03.383 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:26:03.384 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:26:03.767 INFO:teuthology.orchestra.run.smithi032.stdout:generic/394 0s 2023-10-08T08:26:03.774 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/394 2023-10-08T08:26:03.774 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:26:03.779 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:26:03.812 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:26:03.812 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/395) 2023-10-08T08:26:04.228 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:26:04.237 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:26:04.237 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:26:04.591 INFO:teuthology.orchestra.run.smithi032.stdout:generic/395 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:26:04.603 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/395 2023-10-08T08:26:04.603 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/395 2023-10-08T08:26:04.603 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:26:04.607 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:26:04.633 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:26:04.633 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/396) 2023-10-08T08:26:05.125 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:26:05.133 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:26:05.133 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:26:05.453 INFO:teuthology.orchestra.run.smithi032.stdout:generic/396 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:26:05.458 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/396 2023-10-08T08:26:05.459 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/396 2023-10-08T08:26:05.459 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:26:05.466 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:26:05.488 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:26:05.489 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/397) 2023-10-08T08:26:05.847 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:26:05.857 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:26:05.857 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:26:06.235 INFO:teuthology.orchestra.run.smithi032.stdout:generic/397 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:26:06.244 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/397 2023-10-08T08:26:06.244 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/397 2023-10-08T08:26:06.244 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:26:06.250 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:26:06.269 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:26:06.269 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/398) 2023-10-08T08:26:06.581 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:26:06.591 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:26:06.591 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:26:06.903 INFO:teuthology.orchestra.run.smithi032.stdout:generic/398 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:26:06.912 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/398 2023-10-08T08:26:06.912 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/398 2023-10-08T08:26:06.912 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:26:06.917 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:26:06.932 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:26:06.932 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/399) 2023-10-08T08:26:07.250 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:26:07.260 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:26:07.261 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:26:07.585 INFO:teuthology.orchestra.run.smithi032.stdout:generic/399 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:26:07.593 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/399 2023-10-08T08:26:07.594 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/399 2023-10-08T08:26:07.594 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:26:07.599 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:26:07.617 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:26:07.617 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/400) 2023-10-08T08:26:07.938 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:26:07.948 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:26:07.948 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:26:08.204 INFO:teuthology.orchestra.run.smithi032.stdout:generic/400 [not run] disk quotas not supported by this filesystem type: ceph-fuse 2023-10-08T08:26:08.212 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/400 2023-10-08T08:26:08.213 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/400 2023-10-08T08:26:08.213 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:26:08.219 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:26:08.236 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:26:08.237 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/401) 2023-10-08T08:26:08.554 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:26:08.563 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:26:08.563 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:26:08.820 INFO:teuthology.orchestra.run.smithi032.stdout:generic/401 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:26:08.828 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/401 2023-10-08T08:26:08.829 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/401 2023-10-08T08:26:08.829 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:26:08.834 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:26:08.853 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:26:08.854 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/402) 2023-10-08T08:26:09.166 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:26:09.176 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:26:09.176 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:26:09.440 INFO:teuthology.orchestra.run.smithi032.stdout:generic/402 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:26:09.449 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/402 2023-10-08T08:26:09.449 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/402 2023-10-08T08:26:09.449 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:26:09.455 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:26:09.473 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:26:09.473 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/403) 2023-10-08T08:26:09.778 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:26:09.787 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:26:09.787 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:26:10.030 INFO:teuthology.orchestra.run.smithi032.stdout:generic/403 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:26:10.038 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/403 2023-10-08T08:26:10.039 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/403 2023-10-08T08:26:10.039 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:26:10.044 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:26:10.065 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:26:10.066 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/404) 2023-10-08T08:26:10.392 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:26:10.401 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:26:10.401 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:26:12.361 INFO:teuthology.orchestra.run.smithi032.stdout:generic/404 [not run] xfs_io finsert failed (old kernel/wrong fs?) 2023-10-08T08:26:12.368 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/404 2023-10-08T08:26:12.369 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/404 2023-10-08T08:26:12.369 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:26:12.374 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:26:12.394 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:26:12.395 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/405) 2023-10-08T08:26:12.703 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:26:12.713 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:26:12.713 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:26:13.084 INFO:teuthology.orchestra.run.smithi032.stdout:generic/405 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:26:13.093 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/405 2023-10-08T08:26:13.093 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/405 2023-10-08T08:26:13.093 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:26:13.098 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:26:13.116 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:26:13.116 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/406) 2023-10-08T08:26:13.426 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:26:13.435 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:26:13.436 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:26:13.686 INFO:teuthology.orchestra.run.smithi032.stdout:generic/406 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:26:13.695 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/406 2023-10-08T08:26:13.695 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/406 2023-10-08T08:26:13.695 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:26:13.701 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:26:13.719 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:26:13.719 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/407) 2023-10-08T08:26:14.033 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:26:14.043 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:26:14.043 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:26:14.440 INFO:teuthology.orchestra.run.smithi032.stdout:generic/407 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-10-08T08:26:14.445 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/407 2023-10-08T08:26:14.445 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/407 2023-10-08T08:26:14.445 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:26:14.451 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:26:14.469 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:26:14.469 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/408) 2023-10-08T08:26:14.788 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:26:14.797 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:26:14.797 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:26:15.184 INFO:teuthology.orchestra.run.smithi032.stdout:generic/408 [not run] Dedupe not supported by test filesystem type: ceph-fuse 2023-10-08T08:26:15.193 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/408 2023-10-08T08:26:15.193 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/408 2023-10-08T08:26:15.193 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:26:15.199 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:26:15.217 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:26:15.217 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/409) 2023-10-08T08:26:15.530 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:26:15.537 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:26:15.537 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:26:15.793 INFO:teuthology.orchestra.run.smithi032.stdout:generic/409 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:26:15.802 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/409 2023-10-08T08:26:15.802 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/409 2023-10-08T08:26:15.803 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:26:15.808 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:26:15.823 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:26:15.824 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/410) 2023-10-08T08:26:16.142 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:26:16.152 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:26:16.153 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:26:16.421 INFO:teuthology.orchestra.run.smithi032.stdout:generic/410 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:26:16.430 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/410 2023-10-08T08:26:16.430 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/410 2023-10-08T08:26:16.430 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:26:16.436 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:26:16.455 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:26:16.456 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/411) 2023-10-08T08:26:16.774 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:26:16.782 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:26:16.782 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:26:17.044 INFO:teuthology.orchestra.run.smithi032.stdout:generic/411 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:26:17.054 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/411 2023-10-08T08:26:17.054 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/411 2023-10-08T08:26:17.054 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:26:17.060 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:26:17.079 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:26:17.079 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/412) 2023-10-08T08:26:17.396 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:26:17.405 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:26:17.405 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:26:17.655 INFO:teuthology.orchestra.run.smithi032.stdout:generic/412 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:26:17.664 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/412 2023-10-08T08:26:17.664 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/412 2023-10-08T08:26:17.664 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:26:17.670 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:26:17.692 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:26:17.692 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/413) 2023-10-08T08:26:18.017 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:26:18.026 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:26:18.026 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:26:18.297 INFO:teuthology.orchestra.run.smithi032.stdout:generic/413 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:26:18.307 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/413 2023-10-08T08:26:18.307 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/413 2023-10-08T08:26:18.307 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:26:18.313 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:26:18.330 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:26:18.330 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/414) 2023-10-08T08:26:18.647 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:26:18.655 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:26:18.655 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:26:18.903 INFO:teuthology.orchestra.run.smithi032.stdout:generic/414 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:26:18.912 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/414 2023-10-08T08:26:18.912 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/414 2023-10-08T08:26:18.912 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:26:18.918 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:26:18.938 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:26:18.939 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/415) 2023-10-08T08:26:19.279 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:26:19.289 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:26:19.289 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:26:19.541 INFO:teuthology.orchestra.run.smithi032.stdout:generic/415 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:26:19.550 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/415 2023-10-08T08:26:19.550 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/415 2023-10-08T08:26:19.550 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:26:19.555 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:26:19.573 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:26:19.573 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/416) 2023-10-08T08:26:19.883 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:26:19.891 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:26:19.892 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:26:20.137 INFO:teuthology.orchestra.run.smithi032.stdout:generic/416 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:26:20.146 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/416 2023-10-08T08:26:20.146 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/416 2023-10-08T08:26:20.146 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:26:20.151 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:26:20.169 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:26:20.170 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/417) 2023-10-08T08:26:20.482 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:26:20.491 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:26:20.491 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:26:20.745 INFO:teuthology.orchestra.run.smithi032.stdout:generic/417 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:26:20.754 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/417 2023-10-08T08:26:20.754 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/417 2023-10-08T08:26:20.755 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:26:20.759 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:26:20.778 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:26:20.778 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/418) 2023-10-08T08:26:21.088 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:26:21.098 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:26:21.098 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:26:21.437 INFO:teuthology.orchestra.run.smithi032.stdout:generic/418 [not run] require ceph-fuse to be valid block disk 2023-10-08T08:26:21.445 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/418 2023-10-08T08:26:21.445 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/418 2023-10-08T08:26:21.445 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:26:21.450 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:26:21.467 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:26:21.467 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/419) 2023-10-08T08:26:21.783 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:26:21.793 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:26:21.793 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:26:22.125 INFO:teuthology.orchestra.run.smithi032.stdout:generic/419 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:26:22.135 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/419 2023-10-08T08:26:22.135 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/419 2023-10-08T08:26:22.135 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:26:22.141 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:26:22.159 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:26:22.159 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/420) 2023-10-08T08:26:22.467 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:26:22.478 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:26:22.478 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:26:24.552 INFO:teuthology.orchestra.run.smithi032.stdout:generic/420 2s 2023-10-08T08:26:24.565 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/420 2023-10-08T08:26:24.565 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:26:24.572 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:26:24.589 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:26:24.590 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/421) 2023-10-08T08:26:24.900 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:26:24.905 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:26:24.905 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:26:25.230 INFO:teuthology.orchestra.run.smithi032.stdout:generic/421 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:26:25.240 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/421 2023-10-08T08:26:25.240 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/421 2023-10-08T08:26:25.240 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:26:25.247 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:26:25.266 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:26:25.266 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/422) 2023-10-08T08:26:25.582 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:26:25.592 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:26:25.592 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:26:25.853 INFO:teuthology.orchestra.run.smithi032.stdout:generic/422 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:26:25.861 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/422 2023-10-08T08:26:25.861 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/422 2023-10-08T08:26:25.862 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:26:25.867 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:26:25.885 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:26:25.885 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/423) 2023-10-08T08:26:26.203 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:26:26.212 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:26:26.212 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:26:26.762 INFO:teuthology.orchestra.run.smithi032.stdout:generic/423 0s 2023-10-08T08:26:26.774 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/423 2023-10-08T08:26:26.774 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:26:26.778 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:26:26.795 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:26:26.796 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/424) 2023-10-08T08:26:27.103 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:26:27.112 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:26:27.112 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:26:27.438 INFO:teuthology.orchestra.run.smithi032.stdout:generic/424 [not run] file system doesn't support any of /usr/bin/chattr +a/+c/+d/+i 2023-10-08T08:26:27.448 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/424 2023-10-08T08:26:27.448 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/424 2023-10-08T08:26:27.448 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:26:27.454 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:26:27.472 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:26:27.472 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/425) 2023-10-08T08:26:27.777 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:26:27.787 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:26:27.788 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:26:28.043 INFO:teuthology.orchestra.run.smithi032.stdout:generic/425 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:26:28.052 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/425 2023-10-08T08:26:28.052 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/425 2023-10-08T08:26:28.052 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:26:28.057 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:26:28.076 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:26:28.076 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/426) 2023-10-08T08:26:28.401 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:26:28.411 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:26:28.411 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:26:31.103 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:26:31.106 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:27:01.210 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:27:01.217 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:27:27.195 INFO:teuthology.orchestra.run.smithi032.stdout:generic/426 - output mismatch (see /tmp/tmp.p8vAuQqzIgxfstests-dev/results//generic/426.out.bad) 2023-10-08T08:27:27.210 INFO:teuthology.orchestra.run.smithi032.stdout: --- tests/generic/426.out 2023-10-08 06:10:44.423318716 +0000 2023-10-08T08:27:27.210 INFO:teuthology.orchestra.run.smithi032.stdout: +++ /tmp/tmp.p8vAuQqzIgxfstests-dev/results//generic/426.out.bad 2023-10-08 08:27:27.167264603 +0000 2023-10-08T08:27:27.210 INFO:teuthology.orchestra.run.smithi032.stdout: @@ -1,5 +1,77 @@ 2023-10-08T08:27:27.210 INFO:teuthology.orchestra.run.smithi032.stdout: QA output created by 426 2023-10-08T08:27:27.210 INFO:teuthology.orchestra.run.smithi032.stdout: test_file_handles TEST_DIR/426-dir -d 2023-10-08T08:27:27.210 INFO:teuthology.orchestra.run.smithi032.stdout: +open_by_handle(/tmp/tmp.t2WBfhO8BYtest/426-dir/file000487) opened an unlinked file! 2023-10-08T08:27:27.211 INFO:teuthology.orchestra.run.smithi032.stdout: +open_by_handle(/tmp/tmp.t2WBfhO8BYtest/426-dir/file000488) opened an unlinked file! 2023-10-08T08:27:27.211 INFO:teuthology.orchestra.run.smithi032.stdout: +open_by_handle(/tmp/tmp.t2WBfhO8BYtest/426-dir/file000489) opened an unlinked file! 2023-10-08T08:27:27.211 INFO:teuthology.orchestra.run.smithi032.stdout: +open_by_handle(/tmp/tmp.t2WBfhO8BYtest/426-dir/file000490) opened an unlinked file! 2023-10-08T08:27:27.211 INFO:teuthology.orchestra.run.smithi032.stdout: +open_by_handle(/tmp/tmp.t2WBfhO8BYtest/426-dir/file000491) opened an unlinked file! 2023-10-08T08:27:27.211 INFO:teuthology.orchestra.run.smithi032.stdout: +open_by_handle(/tmp/tmp.t2WBfhO8BYtest/426-dir/file000492) opened an unlinked file! 2023-10-08T08:27:27.211 INFO:teuthology.orchestra.run.smithi032.stdout: +open_by_handle(/tmp/tmp.t2WBfhO8BYtest/426-dir/file000493) opened an unlinked file! 2023-10-08T08:27:27.211 INFO:teuthology.orchestra.run.smithi032.stdout: +open_by_handle(/tmp/tmp.t2WBfhO8BYtest/426-dir/file000494) opened an unlinked file! 2023-10-08T08:27:27.211 INFO:teuthology.orchestra.run.smithi032.stdout: +open_by_handle(/tmp/tmp.t2WBfhO8BYtest/426-dir/file000495) opened an unlinked file! 2023-10-08T08:27:27.211 INFO:teuthology.orchestra.run.smithi032.stdout: +open_by_handle(/tmp/tmp.t2WBfhO8BYtest/426-dir/file000496) opened an unlinked file! 2023-10-08T08:27:27.211 INFO:teuthology.orchestra.run.smithi032.stdout: +open_by_handle(/tmp/tmp.t2WBfhO8BYtest/426-dir/file000497) opened an unlinked file! 2023-10-08T08:27:27.211 INFO:teuthology.orchestra.run.smithi032.stdout: +open_by_handle(/tmp/tmp.t2WBfhO8BYtest/426-dir/file000498) opened an unlinked file! 2023-10-08T08:27:27.211 INFO:teuthology.orchestra.run.smithi032.stdout: +open_by_handle(/tmp/tmp.t2WBfhO8BYtest/426-dir/file000499) opened an unlinked file! 2023-10-08T08:27:27.212 INFO:teuthology.orchestra.run.smithi032.stdout: +open_by_handle(/tmp/tmp.t2WBfhO8BYtest/426-dir/file000500) opened an unlinked file! 2023-10-08T08:27:27.212 INFO:teuthology.orchestra.run.smithi032.stdout: +open_by_handle(/tmp/tmp.t2WBfhO8BYtest/426-dir/file000501) opened an unlinked file! 2023-10-08T08:27:27.212 INFO:teuthology.orchestra.run.smithi032.stdout: +open_by_handle(/tmp/tmp.t2WBfhO8BYtest/426-dir/file000502) opened an unlinked file! 2023-10-08T08:27:27.212 INFO:teuthology.orchestra.run.smithi032.stdout: +open_by_handle(/tmp/tmp.t2WBfhO8BYtest/426-dir/file000503) opened an unlinked file! 2023-10-08T08:27:27.212 INFO:teuthology.orchestra.run.smithi032.stdout: +open_by_handle(/tmp/tmp.t2WBfhO8BYtest/426-dir/file000504) opened an unlinked file! 2023-10-08T08:27:27.212 INFO:teuthology.orchestra.run.smithi032.stdout: +open_by_handle(/tmp/tmp.t2WBfhO8BYtest/426-dir/file000505) opened an unlinked file! 2023-10-08T08:27:27.212 INFO:teuthology.orchestra.run.smithi032.stdout: +open_by_handle(/tmp/tmp.t2WBfhO8BYtest/426-dir/file000506) opened an unlinked file! 2023-10-08T08:27:27.212 INFO:teuthology.orchestra.run.smithi032.stdout: +open_by_handle(/tmp/tmp.t2WBfhO8BYtest/426-dir/file000507) opened an unlinked file! 2023-10-08T08:27:27.212 INFO:teuthology.orchestra.run.smithi032.stdout: +open_by_handle(/tmp/tmp.t2WBfhO8BYtest/426-dir/file000508) opened an unlinked file! 2023-10-08T08:27:27.212 INFO:teuthology.orchestra.run.smithi032.stdout: +open_by_handle(/tmp/tmp.t2WBfhO8BYtest/426-dir/file000509) opened an unlinked file! 2023-10-08T08:27:27.212 INFO:teuthology.orchestra.run.smithi032.stdout: +open_by_handle(/tmp/tmp.t2WBfhO8BYtest/426-dir/file000510) opened an unlinked file! 2023-10-08T08:27:27.213 INFO:teuthology.orchestra.run.smithi032.stdout: +open_by_handle(/tmp/tmp.t2WBfhO8BYtest/426-dir/file000511) opened an unlinked file! 2023-10-08T08:27:27.213 INFO:teuthology.orchestra.run.smithi032.stdout: +open_by_handle(/tmp/tmp.t2WBfhO8BYtest/426-dir/file000512) opened an unlinked file! 2023-10-08T08:27:27.213 INFO:teuthology.orchestra.run.smithi032.stdout: +open_by_handle(/tmp/tmp.t2WBfhO8BYtest/426-dir/file000513) opened an unlinked file! 2023-10-08T08:27:27.213 INFO:teuthology.orchestra.run.smithi032.stdout: +open_by_handle(/tmp/tmp.t2WBfhO8BYtest/426-dir/file000514) opened an unlinked file! 2023-10-08T08:27:27.213 INFO:teuthology.orchestra.run.smithi032.stdout: +open_by_handle(/tmp/tmp.t2WBfhO8BYtest/426-dir/file000515) opened an unlinked file! 2023-10-08T08:27:27.213 INFO:teuthology.orchestra.run.smithi032.stdout: +open_by_handle(/tmp/tmp.t2WBfhO8BYtest/426-dir/file000516) opened an unlinked file! 2023-10-08T08:27:27.213 INFO:teuthology.orchestra.run.smithi032.stdout: +open_by_handle(/tmp/tmp.t2WBfhO8BYtest/426-dir/file000517) opened an unlinked file! 2023-10-08T08:27:27.213 INFO:teuthology.orchestra.run.smithi032.stdout: +open_by_handle(/tmp/tmp.t2WBfhO8BYtest/426-dir/file000518) opened an unlinked file! 2023-10-08T08:27:27.213 INFO:teuthology.orchestra.run.smithi032.stdout: +open_by_handle(/tmp/tmp.t2WBfhO8BYtest/426-dir/file000519) opened an unlinked file! 2023-10-08T08:27:27.213 INFO:teuthology.orchestra.run.smithi032.stdout: +open_by_handle(/tmp/tmp.t2WBfhO8BYtest/426-dir/file000520) opened an unlinked file! 2023-10-08T08:27:27.213 INFO:teuthology.orchestra.run.smithi032.stdout: +open_by_handle(/tmp/tmp.t2WBfhO8BYtest/426-dir/file000521) opened an unlinked file! 2023-10-08T08:27:27.213 INFO:teuthology.orchestra.run.smithi032.stdout: +open_by_handle(/tmp/tmp.t2WBfhO8BYtest/426-dir/file000522) opened an unlinked file! 2023-10-08T08:27:27.214 INFO:teuthology.orchestra.run.smithi032.stdout: +open_by_handle(/tmp/tmp.t2WBfhO8BYtest/426-dir/file000523) opened an unlinked file! 2023-10-08T08:27:27.214 INFO:teuthology.orchestra.run.smithi032.stdout: +open_by_handle(/tmp/tmp.t2WBfhO8BYtest/426-dir/file000524) opened an unlinked file! 2023-10-08T08:27:27.214 INFO:teuthology.orchestra.run.smithi032.stdout: +open_by_handle(/tmp/tmp.t2WBfhO8BYtest/426-dir/file000525) opened an unlinked file! 2023-10-08T08:27:27.214 INFO:teuthology.orchestra.run.smithi032.stdout: +open_by_handle(/tmp/tmp.t2WBfhO8BYtest/426-dir/file000526) opened an unlinked file! 2023-10-08T08:27:27.214 INFO:teuthology.orchestra.run.smithi032.stdout: +open_by_handle(/tmp/tmp.t2WBfhO8BYtest/426-dir/file000527) opened an unlinked file! 2023-10-08T08:27:27.214 INFO:teuthology.orchestra.run.smithi032.stdout: +open_by_handle(/tmp/tmp.t2WBfhO8BYtest/426-dir/file000528) opened an unlinked file! 2023-10-08T08:27:27.214 INFO:teuthology.orchestra.run.smithi032.stdout: +open_by_handle(/tmp/tmp.t2WBfhO8BYtest/426-dir/file000529) opened an unlinked file! 2023-10-08T08:27:27.214 INFO:teuthology.orchestra.run.smithi032.stdout: +open_by_handle(/tmp/tmp.t2WBfhO8BYtest/426-dir/file000530) opened an unlinked file! 2023-10-08T08:27:27.215 INFO:teuthology.orchestra.run.smithi032.stdout: +open_by_handle(/tmp/tmp.t2WBfhO8BYtest/426-dir/file000531) opened an unlinked file! 2023-10-08T08:27:27.215 INFO:teuthology.orchestra.run.smithi032.stdout: +open_by_handle(/tmp/tmp.t2WBfhO8BYtest/426-dir/file000532) opened an unlinked file! 2023-10-08T08:27:27.215 INFO:teuthology.orchestra.run.smithi032.stdout: +open_by_handle(/tmp/tmp.t2WBfhO8BYtest/426-dir/file000533) opened an unlinked file! 2023-10-08T08:27:27.215 INFO:teuthology.orchestra.run.smithi032.stdout: +open_by_handle(/tmp/tmp.t2WBfhO8BYtest/426-dir/file000534) opened an unlinked file! 2023-10-08T08:27:27.215 INFO:teuthology.orchestra.run.smithi032.stdout: +open_by_handle(/tmp/tmp.t2WBfhO8BYtest/426-dir/file000535) opened an unlinked file! 2023-10-08T08:27:27.215 INFO:teuthology.orchestra.run.smithi032.stdout: +open_by_handle(/tmp/tmp.t2WBfhO8BYtest/426-dir/file000536) opened an unlinked file! 2023-10-08T08:27:27.215 INFO:teuthology.orchestra.run.smithi032.stdout: +open_by_handle(/tmp/tmp.t2WBfhO8BYtest/426-dir/file000537) opened an unlinked file! 2023-10-08T08:27:27.215 INFO:teuthology.orchestra.run.smithi032.stdout: +open_by_handle(/tmp/tmp.t2WBfhO8BYtest/426-dir/file000538) opened an unlinked file! 2023-10-08T08:27:27.215 INFO:teuthology.orchestra.run.smithi032.stdout: +open_by_handle(/tmp/tmp.t2WBfhO8BYtest/426-dir/file000539) opened an unlinked file! 2023-10-08T08:27:27.215 INFO:teuthology.orchestra.run.smithi032.stdout: +open_by_handle(/tmp/tmp.t2WBfhO8BYtest/426-dir/file000540) opened an unlinked file! 2023-10-08T08:27:27.215 INFO:teuthology.orchestra.run.smithi032.stdout: +open_by_handle(/tmp/tmp.t2WBfhO8BYtest/426-dir/file000541) opened an unlinked file! 2023-10-08T08:27:27.215 INFO:teuthology.orchestra.run.smithi032.stdout: +open_by_handle(/tmp/tmp.t2WBfhO8BYtest/426-dir/file000542) opened an unlinked file! 2023-10-08T08:27:27.216 INFO:teuthology.orchestra.run.smithi032.stdout: +open_by_handle(/tmp/tmp.t2WBfhO8BYtest/426-dir/file000543) opened an unlinked file! 2023-10-08T08:27:27.216 INFO:teuthology.orchestra.run.smithi032.stdout: +open_by_handle(/tmp/tmp.t2WBfhO8BYtest/426-dir/file000544) opened an unlinked file! 2023-10-08T08:27:27.216 INFO:teuthology.orchestra.run.smithi032.stdout: +open_by_handle(/tmp/tmp.t2WBfhO8BYtest/426-dir/file000545) opened an unlinked file! 2023-10-08T08:27:27.216 INFO:teuthology.orchestra.run.smithi032.stdout: +open_by_handle(/tmp/tmp.t2WBfhO8BYtest/426-dir/file000546) opened an unlinked file! 2023-10-08T08:27:27.216 INFO:teuthology.orchestra.run.smithi032.stdout: +open_by_handle(/tmp/tmp.t2WBfhO8BYtest/426-dir/file000547) opened an unlinked file! 2023-10-08T08:27:27.216 INFO:teuthology.orchestra.run.smithi032.stdout: +open_by_handle(/tmp/tmp.t2WBfhO8BYtest/426-dir/file000548) opened an unlinked file! 2023-10-08T08:27:27.216 INFO:teuthology.orchestra.run.smithi032.stdout: +open_by_handle(/tmp/tmp.t2WBfhO8BYtest/426-dir/file000549) opened an unlinked file! 2023-10-08T08:27:27.216 INFO:teuthology.orchestra.run.smithi032.stdout: +open_by_handle(/tmp/tmp.t2WBfhO8BYtest/426-dir/file000550) opened an unlinked file! 2023-10-08T08:27:27.216 INFO:teuthology.orchestra.run.smithi032.stdout: +open_by_handle(/tmp/tmp.t2WBfhO8BYtest/426-dir/file000551) opened an unlinked file! 2023-10-08T08:27:27.216 INFO:teuthology.orchestra.run.smithi032.stdout: +open_by_handle(/tmp/tmp.t2WBfhO8BYtest/426-dir/file000552) opened an unlinked file! 2023-10-08T08:27:27.216 INFO:teuthology.orchestra.run.smithi032.stdout: +open_by_handle(/tmp/tmp.t2WBfhO8BYtest/426-dir/file000553) opened an unlinked file! 2023-10-08T08:27:27.217 INFO:teuthology.orchestra.run.smithi032.stdout: +open_by_handle(/tmp/tmp.t2WBfhO8BYtest/426-dir/file000554) opened an unlinked file! 2023-10-08T08:27:27.217 INFO:teuthology.orchestra.run.smithi032.stdout: +open_by_handle(/tmp/tmp.t2WBfhO8BYtest/426-dir/file000555) opened an unlinked file! 2023-10-08T08:27:27.217 INFO:teuthology.orchestra.run.smithi032.stdout: +open_by_handle(/tmp/tmp.t2WBfhO8BYtest/426-dir/file000556) opened an unlinked file! 2023-10-08T08:27:27.217 INFO:teuthology.orchestra.run.smithi032.stdout: +open_by_handle(/tmp/tmp.t2WBfhO8BYtest/426-dir/file000557) opened an unlinked file! 2023-10-08T08:27:27.217 INFO:teuthology.orchestra.run.smithi032.stdout: +open_by_handle(/tmp/tmp.t2WBfhO8BYtest/426-dir/file000558) opened an unlinked file! 2023-10-08T08:27:27.217 INFO:teuthology.orchestra.run.smithi032.stdout: test_file_handles TEST_DIR/426-dir 2023-10-08T08:27:27.217 INFO:teuthology.orchestra.run.smithi032.stdout: test_file_handles TEST_DIR/426-dir -l 2023-10-08T08:27:27.217 INFO:teuthology.orchestra.run.smithi032.stdout: test_file_handles TEST_DIR/426-dir -u 2023-10-08T08:27:27.232 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/426 2023-10-08T08:27:27.232 INFO:teuthology.orchestra.run.smithi032.stdout:Failures: generic/426 2023-10-08T08:27:27.232 INFO:teuthology.orchestra.run.smithi032.stdout:Failed 1 of 1 tests 2023-10-08T08:27:27.247 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:27:27.304 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T08:27:27.305 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-10-08T08:27:27.305 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-10-08T08:27:27.305 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/427) 2023-10-08T08:27:28.881 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:27:28.891 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:27:28.891 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:27:29.233 INFO:teuthology.orchestra.run.smithi032.stdout:generic/427 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:27:29.242 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/427 2023-10-08T08:27:29.242 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/427 2023-10-08T08:27:29.242 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:27:29.247 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:27:29.265 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:27:29.265 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/428) 2023-10-08T08:27:29.591 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:27:29.600 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:27:29.601 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:27:29.917 INFO:teuthology.orchestra.run.smithi032.stdout:generic/428 0s 2023-10-08T08:27:29.930 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/428 2023-10-08T08:27:29.931 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:27:29.936 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:27:29.954 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:27:29.955 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/429) 2023-10-08T08:27:30.288 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:27:30.297 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:27:30.298 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:27:30.631 INFO:teuthology.orchestra.run.smithi032.stdout:generic/429 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:27:30.640 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/429 2023-10-08T08:27:30.640 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/429 2023-10-08T08:27:30.641 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:27:30.646 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:27:30.664 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:27:30.664 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/430) 2023-10-08T08:27:30.995 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:27:31.004 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:27:31.004 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:27:31.630 INFO:teuthology.orchestra.run.smithi032.stdout:generic/430 0s 2023-10-08T08:27:31.645 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/430 2023-10-08T08:27:31.645 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:27:31.650 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:27:31.663 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:27:31.664 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/431) 2023-10-08T08:27:31.766 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:27:31.768 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:27:31.984 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:27:31.994 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:27:31.994 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:27:32.542 INFO:teuthology.orchestra.run.smithi032.stdout:generic/431 0s 2023-10-08T08:27:32.555 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/431 2023-10-08T08:27:32.555 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:27:32.561 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:27:32.579 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:27:32.579 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/432) 2023-10-08T08:27:32.898 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:27:32.906 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:27:32.907 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:27:33.457 INFO:teuthology.orchestra.run.smithi032.stdout:generic/432 1s 2023-10-08T08:27:33.470 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/432 2023-10-08T08:27:33.470 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:27:33.476 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:27:33.493 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:27:33.493 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/433) 2023-10-08T08:27:33.824 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:27:33.834 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:27:33.834 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:27:34.341 INFO:teuthology.orchestra.run.smithi032.stdout:generic/433 1s 2023-10-08T08:27:34.353 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/433 2023-10-08T08:27:34.353 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:27:34.361 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:27:34.374 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:27:34.374 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/434) 2023-10-08T08:27:34.688 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:27:34.697 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:27:34.697 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:27:35.210 INFO:teuthology.orchestra.run.smithi032.stdout:generic/434 - output mismatch (see /tmp/tmp.p8vAuQqzIgxfstests-dev/results//generic/434.out.bad) 2023-10-08T08:27:35.216 INFO:teuthology.orchestra.run.smithi032.stdout: --- tests/generic/434.out 2023-10-08 06:10:44.423318716 +0000 2023-10-08T08:27:35.216 INFO:teuthology.orchestra.run.smithi032.stdout: +++ /tmp/tmp.p8vAuQqzIgxfstests-dev/results//generic/434.out.bad 2023-10-08 08:27:35.203103787 +0000 2023-10-08T08:27:35.216 INFO:teuthology.orchestra.run.smithi032.stdout: @@ -9,6 +9,6 @@ 2023-10-08T08:27:35.216 INFO:teuthology.orchestra.run.smithi032.stdout: copy_range: Bad file descriptor 2023-10-08T08:27:35.217 INFO:teuthology.orchestra.run.smithi032.stdout: d41d8cd98f00b204e9800998ecf8427e TEST_DIR/test-434/copy 2023-10-08T08:27:35.217 INFO:teuthology.orchestra.run.smithi032.stdout: Try to copy to a device 2023-10-08T08:27:35.217 INFO:teuthology.orchestra.run.smithi032.stdout: -copy_range: Invalid argument 2023-10-08T08:27:35.217 INFO:teuthology.orchestra.run.smithi032.stdout: +/tmp/tmp.t2WBfhO8BYtest/test-434/dev1: Permission denied 2023-10-08T08:27:35.217 INFO:teuthology.orchestra.run.smithi032.stdout: Try to copy to a fifo 2023-10-08T08:27:35.217 INFO:teuthology.orchestra.run.smithi032.stdout: copy_range: Invalid argument 2023-10-08T08:27:35.225 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/434 2023-10-08T08:27:35.226 INFO:teuthology.orchestra.run.smithi032.stdout:Failures: generic/434 2023-10-08T08:27:35.226 INFO:teuthology.orchestra.run.smithi032.stdout:Failed 1 of 1 tests 2023-10-08T08:27:35.227 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:27:35.246 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T08:27:35.247 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-10-08T08:27:35.247 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-10-08T08:27:35.247 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/435) 2023-10-08T08:27:35.575 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:27:35.585 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:27:35.585 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:27:35.896 INFO:teuthology.orchestra.run.smithi032.stdout:generic/435 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:27:35.905 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/435 2023-10-08T08:27:35.905 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/435 2023-10-08T08:27:35.905 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:27:35.910 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:27:35.926 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:27:35.926 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/436) 2023-10-08T08:27:36.252 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:27:36.262 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:27:36.262 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:27:38.217 INFO:teuthology.orchestra.run.smithi032.stdout:generic/436 2s 2023-10-08T08:27:38.230 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/436 2023-10-08T08:27:38.230 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:27:38.235 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:27:38.257 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:27:38.257 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/437) 2023-10-08T08:27:38.585 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:27:38.593 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:27:38.593 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:27:39.726 INFO:teuthology.orchestra.run.smithi032.stdout:generic/437 1s 2023-10-08T08:27:39.738 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/437 2023-10-08T08:27:39.739 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:27:39.743 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:27:39.761 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:27:39.761 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/438) 2023-10-08T08:27:40.082 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:27:40.091 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:27:40.091 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:28:01.854 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:28:01.857 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:28:31.918 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:28:31.920 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:29:01.963 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:29:01.966 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:29:32.397 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:29:32.399 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:29:43.394 INFO:teuthology.orchestra.run.smithi032.stdout:generic/438 123s 2023-10-08T08:29:43.407 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/438 2023-10-08T08:29:43.407 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:29:43.410 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:29:43.421 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:29:43.421 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/439) 2023-10-08T08:29:43.698 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:29:43.706 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:29:43.706 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:29:43.919 INFO:teuthology.orchestra.run.smithi032.stdout:generic/439 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:29:43.926 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/439 2023-10-08T08:29:43.926 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/439 2023-10-08T08:29:43.927 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:29:43.932 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:29:43.948 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:29:43.948 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/440) 2023-10-08T08:29:44.229 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:29:44.236 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:29:44.236 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:29:44.503 INFO:teuthology.orchestra.run.smithi032.stdout:generic/440 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:29:44.511 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/440 2023-10-08T08:29:44.511 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/440 2023-10-08T08:29:44.511 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:29:44.516 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:29:44.532 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:29:44.532 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/441) 2023-10-08T08:29:44.815 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:29:44.823 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:29:44.823 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:29:45.110 INFO:teuthology.orchestra.run.smithi032.stdout:generic/441 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:29:45.116 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/441 2023-10-08T08:29:45.116 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/441 2023-10-08T08:29:45.116 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:29:45.121 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:29:45.137 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:29:45.138 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/442) 2023-10-08T08:29:45.426 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:29:45.434 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:29:45.434 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:29:45.673 INFO:teuthology.orchestra.run.smithi032.stdout:generic/442 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:29:45.681 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/442 2023-10-08T08:29:45.681 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/442 2023-10-08T08:29:45.681 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:29:45.686 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:29:45.700 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:29:45.701 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/443) 2023-10-08T08:29:45.982 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:29:45.989 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:29:45.989 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:29:46.260 INFO:teuthology.orchestra.run.smithi032.stdout:generic/443 1s 2023-10-08T08:29:46.270 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/443 2023-10-08T08:29:46.270 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:29:46.275 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:29:46.289 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:29:46.290 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/444) 2023-10-08T08:29:46.568 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:29:46.576 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:29:46.577 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:29:46.882 INFO:teuthology.orchestra.run.smithi032.stdout:generic/444 [not run] ACLs not supported by this filesystem type: ceph-fuse 2023-10-08T08:29:46.889 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/444 2023-10-08T08:29:46.889 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/444 2023-10-08T08:29:46.890 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:29:46.894 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:29:46.909 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:29:46.909 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/445) 2023-10-08T08:29:47.193 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:29:47.200 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:29:47.200 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:29:49.081 INFO:teuthology.orchestra.run.smithi032.stdout:generic/445 2s 2023-10-08T08:29:49.094 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/445 2023-10-08T08:29:49.094 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:29:49.099 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:29:49.116 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:29:49.117 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/446) 2023-10-08T08:29:49.432 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:29:49.441 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:29:49.441 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:29:49.684 INFO:teuthology.orchestra.run.smithi032.stdout:generic/446 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:29:49.692 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/446 2023-10-08T08:29:49.692 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/446 2023-10-08T08:29:49.692 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:29:49.697 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:29:49.717 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:29:49.717 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/447) 2023-10-08T08:29:50.032 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:29:50.041 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:29:50.042 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:29:50.293 INFO:teuthology.orchestra.run.smithi032.stdout:generic/447 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:29:50.302 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/447 2023-10-08T08:29:50.302 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/447 2023-10-08T08:29:50.302 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:29:50.308 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:29:50.326 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:29:50.327 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/448) 2023-10-08T08:29:50.645 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:29:50.654 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:29:50.654 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:29:52.488 INFO:teuthology.orchestra.run.smithi032.stdout:generic/448 2s 2023-10-08T08:29:52.501 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/448 2023-10-08T08:29:52.501 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:29:52.506 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:29:52.522 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:29:52.523 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/449) 2023-10-08T08:29:52.833 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:29:52.843 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:29:52.843 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:29:53.086 INFO:teuthology.orchestra.run.smithi032.stdout:generic/449 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:29:53.095 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/449 2023-10-08T08:29:53.095 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/449 2023-10-08T08:29:53.095 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:29:53.101 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:29:53.120 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:29:53.120 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/450) 2023-10-08T08:29:53.437 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:29:53.447 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:29:53.447 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:29:55.429 INFO:teuthology.orchestra.run.smithi032.stdout:generic/450 2s 2023-10-08T08:29:55.442 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/450 2023-10-08T08:29:55.442 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:29:55.447 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:29:55.465 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:29:55.466 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/451) 2023-10-08T08:29:55.784 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:29:55.793 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:29:55.793 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:29:56.441 INFO:teuthology.orchestra.run.smithi032.stdout:generic/451 - output mismatch (see /tmp/tmp.p8vAuQqzIgxfstests-dev/results//generic/451.out.bad) 2023-10-08T08:29:56.445 INFO:teuthology.orchestra.run.smithi032.stdout: --- tests/generic/451.out 2023-10-08 06:10:44.427318628 +0000 2023-10-08T08:29:56.446 INFO:teuthology.orchestra.run.smithi032.stdout: +++ /tmp/tmp.p8vAuQqzIgxfstests-dev/results//generic/451.out.bad 2023-10-08 08:29:56.436274617 +0000 2023-10-08T08:29:56.446 INFO:teuthology.orchestra.run.smithi032.stdout: @@ -1,2 +1,5 @@ 2023-10-08T08:29:56.446 INFO:teuthology.orchestra.run.smithi032.stdout: QA output created by 451 2023-10-08T08:29:56.446 INFO:teuthology.orchestra.run.smithi032.stdout: +get stale data from buffer read 2023-10-08T08:29:56.446 INFO:teuthology.orchestra.run.smithi032.stdout: +00000000 55 55 55 55 55 55 55 55 55 55 55 55 55 55 55 55 UUUUUUUUUUUUUUUU 2023-10-08T08:29:56.446 INFO:teuthology.orchestra.run.smithi032.stdout: +000a0000 2023-10-08T08:29:56.446 INFO:teuthology.orchestra.run.smithi032.stdout: Silence is golden 2023-10-08T08:29:56.451 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/451 2023-10-08T08:29:56.451 INFO:teuthology.orchestra.run.smithi032.stdout:Failures: generic/451 2023-10-08T08:29:56.451 INFO:teuthology.orchestra.run.smithi032.stdout:Failed 1 of 1 tests 2023-10-08T08:29:56.457 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:29:56.474 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T08:29:56.475 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-10-08T08:29:56.475 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-10-08T08:29:56.475 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/452) 2023-10-08T08:29:56.812 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:29:56.821 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:29:56.821 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:29:57.068 INFO:teuthology.orchestra.run.smithi032.stdout:generic/452 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:29:57.076 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/452 2023-10-08T08:29:57.076 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/452 2023-10-08T08:29:57.076 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:29:57.082 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:29:57.099 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:29:57.099 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/453) 2023-10-08T08:29:57.428 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:29:57.438 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:29:57.438 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:29:57.686 INFO:teuthology.orchestra.run.smithi032.stdout:generic/453 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:29:57.695 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/453 2023-10-08T08:29:57.696 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/453 2023-10-08T08:29:57.696 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:29:57.701 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:29:57.719 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:29:57.720 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/454) 2023-10-08T08:29:58.046 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:29:58.056 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:29:58.056 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:29:58.310 INFO:teuthology.orchestra.run.smithi032.stdout:generic/454 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:29:58.318 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/454 2023-10-08T08:29:58.318 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/454 2023-10-08T08:29:58.318 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:29:58.323 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:29:58.341 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:29:58.341 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/455) 2023-10-08T08:29:58.672 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:29:58.682 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:29:58.682 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:29:59.064 INFO:teuthology.orchestra.run.smithi032.stdout:generic/455 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:29:59.073 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/455 2023-10-08T08:29:59.073 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/455 2023-10-08T08:29:59.073 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:29:59.079 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:29:59.098 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:29:59.099 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/456) 2023-10-08T08:29:59.421 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:29:59.430 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:29:59.430 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:29:59.711 INFO:teuthology.orchestra.run.smithi032.stdout:generic/456 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:29:59.720 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/456 2023-10-08T08:29:59.720 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/456 2023-10-08T08:29:59.721 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:29:59.727 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:29:59.746 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:29:59.746 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/457) 2023-10-08T08:30:00.061 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:30:00.072 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:30:00.072 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:30:00.455 INFO:teuthology.orchestra.run.smithi032.stdout:generic/457 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:30:00.464 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/457 2023-10-08T08:30:00.464 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/457 2023-10-08T08:30:00.464 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:30:00.471 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:30:00.489 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:30:00.490 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/458) 2023-10-08T08:30:00.804 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:30:00.814 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:30:00.815 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:30:01.068 INFO:teuthology.orchestra.run.smithi032.stdout:generic/458 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:30:01.077 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/458 2023-10-08T08:30:01.077 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/458 2023-10-08T08:30:01.077 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:30:01.082 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:30:01.097 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:30:01.098 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/459) 2023-10-08T08:30:01.422 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:30:01.431 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:30:01.431 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:30:01.871 INFO:teuthology.orchestra.run.smithi032.stdout:generic/459 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:30:01.879 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/459 2023-10-08T08:30:01.880 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/459 2023-10-08T08:30:01.880 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:30:01.885 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:30:01.902 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:30:01.902 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/460) 2023-10-08T08:30:02.214 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:30:02.223 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:30:02.224 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:30:02.442 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:30:02.444 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:30:02.474 INFO:teuthology.orchestra.run.smithi032.stdout:generic/460 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:30:02.485 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/460 2023-10-08T08:30:02.485 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/460 2023-10-08T08:30:02.485 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:30:02.489 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:30:02.506 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:30:02.508 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/461) 2023-10-08T08:30:02.875 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:30:02.884 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:30:02.884 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:30:03.134 INFO:teuthology.orchestra.run.smithi032.stdout:generic/461 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:30:03.142 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/461 2023-10-08T08:30:03.143 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/461 2023-10-08T08:30:03.143 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:30:03.150 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:30:03.166 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:30:03.167 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/462) 2023-10-08T08:30:03.499 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:30:03.508 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:30:03.509 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:30:03.767 INFO:teuthology.orchestra.run.smithi032.stdout:generic/462 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:30:03.775 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/462 2023-10-08T08:30:03.775 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/462 2023-10-08T08:30:03.775 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:30:03.781 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:30:03.800 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:30:03.801 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/463) 2023-10-08T08:30:04.126 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:30:04.135 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:30:04.135 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:30:04.528 INFO:teuthology.orchestra.run.smithi032.stdout:generic/463 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-10-08T08:30:04.538 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/463 2023-10-08T08:30:04.538 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/463 2023-10-08T08:30:04.538 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:30:04.544 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:30:04.562 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:30:04.562 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/464) 2023-10-08T08:30:04.889 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:30:04.895 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:30:04.895 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:30:05.134 INFO:teuthology.orchestra.run.smithi032.stdout:generic/464 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:30:05.140 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/464 2023-10-08T08:30:05.140 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/464 2023-10-08T08:30:05.140 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:30:05.146 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:30:05.166 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:30:05.166 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/465) 2023-10-08T08:30:05.484 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:30:05.493 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:30:05.493 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:30:27.123 INFO:teuthology.orchestra.run.smithi032.stdout:generic/465 22s 2023-10-08T08:30:27.134 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/465 2023-10-08T08:30:27.135 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:30:27.139 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:30:27.152 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:30:27.153 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/466) 2023-10-08T08:30:27.469 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:30:27.479 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:30:27.479 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:30:27.733 INFO:teuthology.orchestra.run.smithi032.stdout:generic/466 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:30:27.741 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/466 2023-10-08T08:30:27.742 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/466 2023-10-08T08:30:27.742 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:30:27.747 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:30:27.767 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:30:27.767 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/467) 2023-10-08T08:30:28.089 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:30:28.099 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:30:28.099 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:30:32.490 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:30:32.493 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:30:35.487 INFO:teuthology.orchestra.run.smithi032.stdout:generic/467 - output mismatch (see /tmp/tmp.p8vAuQqzIgxfstests-dev/results//generic/467.out.bad) 2023-10-08T08:30:35.504 INFO:teuthology.orchestra.run.smithi032.stdout: --- tests/generic/467.out 2023-10-08 06:10:44.427318628 +0000 2023-10-08T08:30:35.504 INFO:teuthology.orchestra.run.smithi032.stdout: +++ /tmp/tmp.p8vAuQqzIgxfstests-dev/results//generic/467.out.bad 2023-10-08 08:30:35.459492037 +0000 2023-10-08T08:30:35.504 INFO:teuthology.orchestra.run.smithi032.stdout: @@ -1,5 +1,15 @@ 2023-10-08T08:30:35.504 INFO:teuthology.orchestra.run.smithi032.stdout: QA output created by 467 2023-10-08T08:30:35.505 INFO:teuthology.orchestra.run.smithi032.stdout: test_file_handles TEST_DIR/467-dir -dp 2023-10-08T08:30:35.505 INFO:teuthology.orchestra.run.smithi032.stdout: +open_by_handle(/tmp/tmp.t2WBfhO8BYtest/467-dir/file000000) opened an unlinked file! 2023-10-08T08:30:35.505 INFO:teuthology.orchestra.run.smithi032.stdout: +open_by_handle(/tmp/tmp.t2WBfhO8BYtest/467-dir/file000001) opened an unlinked file! 2023-10-08T08:30:35.505 INFO:teuthology.orchestra.run.smithi032.stdout: +open_by_handle(/tmp/tmp.t2WBfhO8BYtest/467-dir/file000002) opened an unlinked file! 2023-10-08T08:30:35.505 INFO:teuthology.orchestra.run.smithi032.stdout: +open_by_handle(/tmp/tmp.t2WBfhO8BYtest/467-dir/file000003) opened an unlinked file! 2023-10-08T08:30:35.505 INFO:teuthology.orchestra.run.smithi032.stdout: +open_by_handle(/tmp/tmp.t2WBfhO8BYtest/467-dir/file000004) opened an unlinked file! 2023-10-08T08:30:35.505 INFO:teuthology.orchestra.run.smithi032.stdout: +open_by_handle(/tmp/tmp.t2WBfhO8BYtest/467-dir/file000005) opened an unlinked file! 2023-10-08T08:30:35.505 INFO:teuthology.orchestra.run.smithi032.stdout: +open_by_handle(/tmp/tmp.t2WBfhO8BYtest/467-dir/file000006) opened an unlinked file! 2023-10-08T08:30:35.505 INFO:teuthology.orchestra.run.smithi032.stdout: +open_by_handle(/tmp/tmp.t2WBfhO8BYtest/467-dir/file000007) opened an unlinked file! 2023-10-08T08:30:35.505 INFO:teuthology.orchestra.run.smithi032.stdout: +open_by_handle(/tmp/tmp.t2WBfhO8BYtest/467-dir/file000008) opened an unlinked file! 2023-10-08T08:30:35.505 INFO:teuthology.orchestra.run.smithi032.stdout: +open_by_handle(/tmp/tmp.t2WBfhO8BYtest/467-dir/file000009) opened an unlinked file! 2023-10-08T08:30:35.505 INFO:teuthology.orchestra.run.smithi032.stdout: test_file_handles TEST_DIR/467-dir -rp 2023-10-08T08:30:35.506 INFO:teuthology.orchestra.run.smithi032.stdout: test_file_handles TEST_DIR/467-dir -dkr 2023-10-08T08:30:35.506 INFO:teuthology.orchestra.run.smithi032.stdout: test_file_handles TEST_DIR/467-dir -lr 2023-10-08T08:30:35.520 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/467 2023-10-08T08:30:35.521 INFO:teuthology.orchestra.run.smithi032.stdout:Failures: generic/467 2023-10-08T08:30:35.521 INFO:teuthology.orchestra.run.smithi032.stdout:Failed 1 of 1 tests 2023-10-08T08:30:35.531 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:30:35.580 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T08:30:35.580 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-10-08T08:30:35.581 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-10-08T08:30:35.581 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/468) 2023-10-08T08:30:37.183 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:30:37.191 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:30:37.191 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:30:37.539 INFO:teuthology.orchestra.run.smithi032.stdout:generic/468 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:30:37.548 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/468 2023-10-08T08:30:37.548 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/468 2023-10-08T08:30:37.548 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:30:37.554 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:30:37.572 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:30:37.573 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/469) 2023-10-08T08:30:37.882 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:30:37.893 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:30:37.893 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:30:41.514 INFO:teuthology.orchestra.run.smithi032.stdout:generic/469 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-10-08T08:30:41.521 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/469 2023-10-08T08:30:41.522 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/469 2023-10-08T08:30:41.522 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:30:41.527 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:30:41.546 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:30:41.546 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/470) 2023-10-08T08:30:41.867 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:30:41.876 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:30:41.876 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:30:42.190 INFO:teuthology.orchestra.run.smithi032.stdout:generic/470 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:30:42.199 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/470 2023-10-08T08:30:42.200 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/470 2023-10-08T08:30:42.200 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:30:42.206 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:30:42.223 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:30:42.223 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/472) 2023-10-08T08:30:42.546 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:30:42.555 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:30:42.555 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:30:42.814 INFO:teuthology.orchestra.run.smithi032.stdout:generic/472 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:30:42.823 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/472 2023-10-08T08:30:42.823 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/472 2023-10-08T08:30:42.823 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:30:42.829 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:30:42.847 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:30:42.848 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/473) 2023-10-08T08:30:43.168 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:30:43.177 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:30:43.177 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:30:43.554 INFO:teuthology.orchestra.run.smithi032.stdout:generic/473 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-10-08T08:30:43.563 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/473 2023-10-08T08:30:43.563 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/473 2023-10-08T08:30:43.563 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:30:43.569 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:30:43.587 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:30:43.587 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/474) 2023-10-08T08:30:43.911 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:30:43.919 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:30:43.920 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:30:44.173 INFO:teuthology.orchestra.run.smithi032.stdout:generic/474 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:30:44.183 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/474 2023-10-08T08:30:44.183 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/474 2023-10-08T08:30:44.183 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:30:44.189 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:30:44.208 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:30:44.208 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/475) 2023-10-08T08:30:44.532 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:30:44.542 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:30:44.543 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:30:44.859 INFO:teuthology.orchestra.run.smithi032.stdout:generic/475 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:30:44.868 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/475 2023-10-08T08:30:44.868 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/475 2023-10-08T08:30:44.868 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:30:44.875 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:30:44.892 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:30:44.893 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/476) 2023-10-08T08:30:45.227 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:30:45.236 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:30:45.236 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:30:45.496 INFO:teuthology.orchestra.run.smithi032.stdout:generic/476 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:30:45.505 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/476 2023-10-08T08:30:45.505 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/476 2023-10-08T08:30:45.505 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:30:45.511 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:30:45.529 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:30:45.529 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/477) 2023-10-08T08:30:45.854 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:30:45.862 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:30:45.863 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:30:53.470 INFO:teuthology.orchestra.run.smithi032.stdout:generic/477 8s 2023-10-08T08:30:53.676 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/477 2023-10-08T08:30:53.677 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:30:53.683 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:30:53.725 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:30:53.725 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/478) 2023-10-08T08:30:55.153 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:30:55.162 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:30:55.163 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:31:03.711 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:31:03.714 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:31:06.275 INFO:teuthology.orchestra.run.smithi032.stdout:generic/478 - output mismatch (see /tmp/tmp.p8vAuQqzIgxfstests-dev/results//generic/478.out.bad) 2023-10-08T08:31:06.281 INFO:teuthology.orchestra.run.smithi032.stdout: --- tests/generic/478.out 2023-10-08 06:10:44.427318628 +0000 2023-10-08T08:31:06.281 INFO:teuthology.orchestra.run.smithi032.stdout: +++ /tmp/tmp.p8vAuQqzIgxfstests-dev/results//generic/478.out.bad 2023-10-08 08:31:06.266873973 +0000 2023-10-08T08:31:06.281 INFO:teuthology.orchestra.run.smithi032.stdout: @@ -1,6 +1,6 @@ 2023-10-08T08:31:06.281 INFO:teuthology.orchestra.run.smithi032.stdout: QA output created by 478 2023-10-08T08:31:06.281 INFO:teuthology.orchestra.run.smithi032.stdout: get wrlck 2023-10-08T08:31:06.281 INFO:teuthology.orchestra.run.smithi032.stdout: -lock could be placed 2023-10-08T08:31:06.281 INFO:teuthology.orchestra.run.smithi032.stdout: +get wrlck 2023-10-08T08:31:06.281 INFO:teuthology.orchestra.run.smithi032.stdout: get wrlck 2023-10-08T08:31:06.281 INFO:teuthology.orchestra.run.smithi032.stdout: get wrlck 2023-10-08T08:31:06.282 INFO:teuthology.orchestra.run.smithi032.stdout: lock could be placed 2023-10-08T08:31:06.282 INFO:teuthology.orchestra.run.smithi032.stdout: @@ -9,8 +9,8 @@ 2023-10-08T08:31:06.282 INFO:teuthology.orchestra.run.smithi032.stdout: lock could be placed 2023-10-08T08:31:06.282 INFO:teuthology.orchestra.run.smithi032.stdout: lock could be placed 2023-10-08T08:31:06.282 INFO:teuthology.orchestra.run.smithi032.stdout: get wrlck 2023-10-08T08:31:06.282 INFO:teuthology.orchestra.run.smithi032.stdout: -lock could be placed 2023-10-08T08:31:06.282 INFO:teuthology.orchestra.run.smithi032.stdout: -lock could be placed 2023-10-08T08:31:06.282 INFO:teuthology.orchestra.run.smithi032.stdout: +get wrlck 2023-10-08T08:31:06.282 INFO:teuthology.orchestra.run.smithi032.stdout: +get wrlck 2023-10-08T08:31:06.282 INFO:teuthology.orchestra.run.smithi032.stdout: lock could be placed 2023-10-08T08:31:06.282 INFO:teuthology.orchestra.run.smithi032.stdout: lock could be placed 2023-10-08T08:31:06.283 INFO:teuthology.orchestra.run.smithi032.stdout: lock could be placed 2023-10-08T08:31:06.283 INFO:teuthology.orchestra.run.smithi032.stdout: @@ -25,7 +25,7 @@ 2023-10-08T08:31:06.283 INFO:teuthology.orchestra.run.smithi032.stdout: lock could be placed 2023-10-08T08:31:06.283 INFO:teuthology.orchestra.run.smithi032.stdout: get wrlck 2023-10-08T08:31:06.283 INFO:teuthology.orchestra.run.smithi032.stdout: lock could be placed 2023-10-08T08:31:06.283 INFO:teuthology.orchestra.run.smithi032.stdout: -lock could be placed 2023-10-08T08:31:06.283 INFO:teuthology.orchestra.run.smithi032.stdout: +get wrlck 2023-10-08T08:31:06.283 INFO:teuthology.orchestra.run.smithi032.stdout: lock could be placed 2023-10-08T08:31:06.283 INFO:teuthology.orchestra.run.smithi032.stdout: lock could be placed 2023-10-08T08:31:06.283 INFO:teuthology.orchestra.run.smithi032.stdout: lock could be placed 2023-10-08T08:31:06.283 INFO:teuthology.orchestra.run.smithi032.stdout: @@ -37,16 +37,16 @@ 2023-10-08T08:31:06.283 INFO:teuthology.orchestra.run.smithi032.stdout: get rdlck 2023-10-08T08:31:06.284 INFO:teuthology.orchestra.run.smithi032.stdout: get rdlck 2023-10-08T08:31:06.284 INFO:teuthology.orchestra.run.smithi032.stdout: lock could be placed 2023-10-08T08:31:06.284 INFO:teuthology.orchestra.run.smithi032.stdout: -lock could be placed 2023-10-08T08:31:06.284 INFO:teuthology.orchestra.run.smithi032.stdout: +get rdlck 2023-10-08T08:31:06.284 INFO:teuthology.orchestra.run.smithi032.stdout: get rdlck 2023-10-08T08:31:06.284 INFO:teuthology.orchestra.run.smithi032.stdout: lock could be placed 2023-10-08T08:31:06.284 INFO:teuthology.orchestra.run.smithi032.stdout: get rdlck 2023-10-08T08:31:06.284 INFO:teuthology.orchestra.run.smithi032.stdout: get rdlck 2023-10-08T08:31:06.284 INFO:teuthology.orchestra.run.smithi032.stdout: -lock could be placed 2023-10-08T08:31:06.284 INFO:teuthology.orchestra.run.smithi032.stdout: +get rdlck 2023-10-08T08:31:06.284 INFO:teuthology.orchestra.run.smithi032.stdout: get rdlck 2023-10-08T08:31:06.284 INFO:teuthology.orchestra.run.smithi032.stdout: get rdlck 2023-10-08T08:31:06.285 INFO:teuthology.orchestra.run.smithi032.stdout: lock could be placed 2023-10-08T08:31:06.285 INFO:teuthology.orchestra.run.smithi032.stdout: -lock could be placed 2023-10-08T08:31:06.285 INFO:teuthology.orchestra.run.smithi032.stdout: +get rdlck 2023-10-08T08:31:06.285 INFO:teuthology.orchestra.run.smithi032.stdout: lock could be placed 2023-10-08T08:31:06.285 INFO:teuthology.orchestra.run.smithi032.stdout: lock could be placed 2023-10-08T08:31:06.285 INFO:teuthology.orchestra.run.smithi032.stdout: lock could be placed 2023-10-08T08:31:06.287 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/478 2023-10-08T08:31:06.287 INFO:teuthology.orchestra.run.smithi032.stdout:Failures: generic/478 2023-10-08T08:31:06.288 INFO:teuthology.orchestra.run.smithi032.stdout:Failed 1 of 1 tests 2023-10-08T08:31:06.293 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:31:06.311 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T08:31:06.312 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-10-08T08:31:06.312 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-10-08T08:31:06.312 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/479) 2023-10-08T08:31:06.630 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:31:06.641 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:31:06.641 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:31:06.962 INFO:teuthology.orchestra.run.smithi032.stdout:generic/479 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:31:06.971 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/479 2023-10-08T08:31:06.971 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/479 2023-10-08T08:31:06.971 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:31:06.977 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:31:06.995 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:31:06.996 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/480) 2023-10-08T08:31:07.312 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:31:07.321 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:31:07.322 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:31:07.608 INFO:teuthology.orchestra.run.smithi032.stdout:generic/480 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:31:07.617 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/480 2023-10-08T08:31:07.617 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/480 2023-10-08T08:31:07.617 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:31:07.623 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:31:07.642 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:31:07.642 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/481) 2023-10-08T08:31:07.952 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:31:07.961 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:31:07.961 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:31:08.254 INFO:teuthology.orchestra.run.smithi032.stdout:generic/481 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:31:08.264 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/481 2023-10-08T08:31:08.264 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/481 2023-10-08T08:31:08.264 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:31:08.270 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:31:08.289 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:31:08.289 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/482) 2023-10-08T08:31:08.610 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:31:08.619 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:31:08.619 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:31:09.005 INFO:teuthology.orchestra.run.smithi032.stdout:generic/482 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:31:09.014 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/482 2023-10-08T08:31:09.015 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/482 2023-10-08T08:31:09.015 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:31:09.022 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:31:09.038 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:31:09.038 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/483) 2023-10-08T08:31:09.359 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:31:09.368 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:31:09.368 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:31:09.654 INFO:teuthology.orchestra.run.smithi032.stdout:generic/483 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:31:09.663 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/483 2023-10-08T08:31:09.663 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/483 2023-10-08T08:31:09.664 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:31:09.670 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:31:09.686 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:31:09.686 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/484) 2023-10-08T08:31:10.006 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:31:10.014 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:31:10.015 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:31:10.283 INFO:teuthology.orchestra.run.smithi032.stdout:generic/484 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:31:10.292 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/484 2023-10-08T08:31:10.293 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/484 2023-10-08T08:31:10.293 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:31:10.298 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:31:10.319 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:31:10.319 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/485) 2023-10-08T08:31:10.642 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:31:10.651 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:31:10.651 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:31:12.651 INFO:teuthology.orchestra.run.smithi032.stdout:generic/485 [not run] xfs_io finsert failed (old kernel/wrong fs?) 2023-10-08T08:31:12.660 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/485 2023-10-08T08:31:12.660 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/485 2023-10-08T08:31:12.660 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:31:12.666 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:31:12.684 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:31:12.684 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/486) 2023-10-08T08:31:12.989 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:31:12.997 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:31:12.997 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:31:13.330 INFO:teuthology.orchestra.run.smithi032.stdout:generic/486 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:31:13.339 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/486 2023-10-08T08:31:13.339 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/486 2023-10-08T08:31:13.339 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:31:13.344 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:31:13.362 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:31:13.362 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/487) 2023-10-08T08:31:13.685 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:31:13.696 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:31:13.696 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:31:13.968 INFO:teuthology.orchestra.run.smithi032.stdout:generic/487 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:31:13.977 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/487 2023-10-08T08:31:13.978 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/487 2023-10-08T08:31:13.978 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:31:13.983 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:31:14.002 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:31:14.002 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/488) 2023-10-08T08:31:14.322 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:31:14.331 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:31:14.332 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:31:14.576 INFO:teuthology.orchestra.run.smithi032.stdout:generic/488 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:31:14.584 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/488 2023-10-08T08:31:14.585 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/488 2023-10-08T08:31:14.585 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:31:14.590 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:31:14.609 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:31:14.610 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/489) 2023-10-08T08:31:14.935 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:31:14.946 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:31:14.947 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:31:15.228 INFO:teuthology.orchestra.run.smithi032.stdout:generic/489 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:31:15.237 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/489 2023-10-08T08:31:15.237 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/489 2023-10-08T08:31:15.237 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:31:15.243 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:31:15.263 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:31:15.263 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/490) 2023-10-08T08:31:15.587 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:31:15.598 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:31:15.598 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:31:17.319 INFO:teuthology.orchestra.run.smithi032.stdout:generic/490 2s 2023-10-08T08:31:17.332 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/490 2023-10-08T08:31:17.332 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:31:17.338 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:31:17.359 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:31:17.359 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/491) 2023-10-08T08:31:17.670 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:31:17.680 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:31:17.680 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:31:17.947 INFO:teuthology.orchestra.run.smithi032.stdout:generic/491 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:31:17.975 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/491 2023-10-08T08:31:17.975 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/491 2023-10-08T08:31:17.975 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:31:17.983 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:31:17.993 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:31:17.994 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/492) 2023-10-08T08:31:18.310 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:31:18.319 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:31:18.320 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:31:18.564 INFO:teuthology.orchestra.run.smithi032.stdout:generic/492 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:31:18.573 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/492 2023-10-08T08:31:18.573 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/492 2023-10-08T08:31:18.573 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:31:18.579 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:31:18.595 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:31:18.596 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/493) 2023-10-08T08:31:18.910 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:31:18.920 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:31:18.920 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:31:19.168 INFO:teuthology.orchestra.run.smithi032.stdout:generic/493 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:31:19.177 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/493 2023-10-08T08:31:19.178 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/493 2023-10-08T08:31:19.178 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:31:19.184 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:31:19.203 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:31:19.203 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/494) 2023-10-08T08:31:19.527 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:31:19.537 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:31:19.537 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:31:19.773 INFO:teuthology.orchestra.run.smithi032.stdout:generic/494 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:31:19.781 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/494 2023-10-08T08:31:19.781 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/494 2023-10-08T08:31:19.782 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:31:19.787 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:31:19.806 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:31:19.806 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/495) 2023-10-08T08:31:20.093 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:31:20.102 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:31:20.103 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:31:20.345 INFO:teuthology.orchestra.run.smithi032.stdout:generic/495 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:31:20.354 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/495 2023-10-08T08:31:20.354 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/495 2023-10-08T08:31:20.355 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:31:20.360 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:31:20.378 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:31:20.378 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/496) 2023-10-08T08:31:20.695 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:31:20.705 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:31:20.705 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:31:20.971 INFO:teuthology.orchestra.run.smithi032.stdout:generic/496 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:31:20.980 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/496 2023-10-08T08:31:20.980 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/496 2023-10-08T08:31:20.980 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:31:20.986 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:31:21.004 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:31:21.005 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/497) 2023-10-08T08:31:21.318 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:31:21.327 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:31:21.327 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:31:21.572 INFO:teuthology.orchestra.run.smithi032.stdout:generic/497 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:31:21.581 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/497 2023-10-08T08:31:21.581 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/497 2023-10-08T08:31:21.581 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:31:21.587 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:31:21.606 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:31:21.606 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/498) 2023-10-08T08:31:21.926 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:31:21.936 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:31:21.936 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:31:22.213 INFO:teuthology.orchestra.run.smithi032.stdout:generic/498 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:31:22.220 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/498 2023-10-08T08:31:22.220 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/498 2023-10-08T08:31:22.220 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:31:22.226 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:31:22.244 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:31:22.244 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/499) 2023-10-08T08:31:22.555 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:31:22.564 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:31:22.564 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:31:22.810 INFO:teuthology.orchestra.run.smithi032.stdout:generic/499 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:31:22.819 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/499 2023-10-08T08:31:22.819 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/499 2023-10-08T08:31:22.819 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:31:22.825 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:31:22.843 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:31:22.844 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/500) 2023-10-08T08:31:23.166 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:31:23.174 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:31:23.175 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:31:23.512 INFO:teuthology.orchestra.run.smithi032.stdout:generic/500 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:31:23.521 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/500 2023-10-08T08:31:23.521 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/500 2023-10-08T08:31:23.521 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:31:23.527 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:31:23.544 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:31:23.545 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/501) 2023-10-08T08:31:23.855 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:31:23.864 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:31:23.864 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:31:24.240 INFO:teuthology.orchestra.run.smithi032.stdout:generic/501 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:31:24.249 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/501 2023-10-08T08:31:24.249 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/501 2023-10-08T08:31:24.249 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:31:24.254 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:31:24.272 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:31:24.272 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/502) 2023-10-08T08:31:24.594 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:31:24.603 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:31:24.604 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:31:24.894 INFO:teuthology.orchestra.run.smithi032.stdout:generic/502 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:31:24.904 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/502 2023-10-08T08:31:24.904 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/502 2023-10-08T08:31:24.904 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:31:24.910 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:31:24.927 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:31:24.928 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/503) 2023-10-08T08:31:25.235 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:31:25.244 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:31:25.244 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:31:25.503 INFO:teuthology.orchestra.run.smithi032.stdout:generic/503 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:31:25.512 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/503 2023-10-08T08:31:25.512 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/503 2023-10-08T08:31:25.512 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:31:25.517 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:31:25.534 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:31:25.535 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/504) 2023-10-08T08:31:25.862 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:31:25.871 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:31:25.871 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:31:26.235 INFO:teuthology.orchestra.run.smithi032.stdout:generic/504 - output mismatch (see /tmp/tmp.p8vAuQqzIgxfstests-dev/results//generic/504.out.bad) 2023-10-08T08:31:26.240 INFO:teuthology.orchestra.run.smithi032.stdout: --- tests/generic/504.out 2023-10-08 06:10:44.427318628 +0000 2023-10-08T08:31:26.240 INFO:teuthology.orchestra.run.smithi032.stdout: +++ /tmp/tmp.p8vAuQqzIgxfstests-dev/results//generic/504.out.bad 2023-10-08 08:31:26.226473425 +0000 2023-10-08T08:31:26.240 INFO:teuthology.orchestra.run.smithi032.stdout: @@ -1,2 +1,3 @@ 2023-10-08T08:31:26.241 INFO:teuthology.orchestra.run.smithi032.stdout: QA output created by 504 2023-10-08T08:31:26.241 INFO:teuthology.orchestra.run.smithi032.stdout: +lock info not found 2023-10-08T08:31:26.241 INFO:teuthology.orchestra.run.smithi032.stdout: Silence is golden 2023-10-08T08:31:26.246 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/504 2023-10-08T08:31:26.246 INFO:teuthology.orchestra.run.smithi032.stdout:Failures: generic/504 2023-10-08T08:31:26.246 INFO:teuthology.orchestra.run.smithi032.stdout:Failed 1 of 1 tests 2023-10-08T08:31:26.251 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:31:26.268 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T08:31:26.269 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-10-08T08:31:26.269 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-10-08T08:31:26.269 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/505) 2023-10-08T08:31:26.594 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:31:26.604 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:31:26.604 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:31:26.850 INFO:teuthology.orchestra.run.smithi032.stdout:generic/505 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:31:26.859 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/505 2023-10-08T08:31:26.859 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/505 2023-10-08T08:31:26.859 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:31:26.864 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:31:26.882 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:31:26.883 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/506) 2023-10-08T08:31:27.199 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:31:27.210 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:31:27.210 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:31:27.471 INFO:teuthology.orchestra.run.smithi032.stdout:generic/506 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:31:27.480 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/506 2023-10-08T08:31:27.480 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/506 2023-10-08T08:31:27.480 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:31:27.486 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:31:27.504 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:31:27.504 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/507) 2023-10-08T08:31:27.815 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:31:27.825 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:31:27.825 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:31:28.168 INFO:teuthology.orchestra.run.smithi032.stdout:generic/507 [not run] file system doesn't support chattr +ASai 2023-10-08T08:31:28.173 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/507 2023-10-08T08:31:28.173 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/507 2023-10-08T08:31:28.173 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:31:28.177 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:31:28.190 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:31:28.190 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/508) 2023-10-08T08:31:28.511 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:31:28.520 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:31:28.520 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:31:28.782 INFO:teuthology.orchestra.run.smithi032.stdout:generic/508 [not run] lsattr not supported by test filesystem type: ceph-fuse 2023-10-08T08:31:28.791 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/508 2023-10-08T08:31:28.791 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/508 2023-10-08T08:31:28.791 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:31:28.797 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:31:28.814 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:31:28.814 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/509) 2023-10-08T08:31:29.132 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:31:29.142 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:31:29.142 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:31:29.418 INFO:teuthology.orchestra.run.smithi032.stdout:generic/509 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:31:29.427 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/509 2023-10-08T08:31:29.427 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/509 2023-10-08T08:31:29.427 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:31:29.436 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:31:29.451 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:31:29.452 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/510) 2023-10-08T08:31:29.765 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:31:29.774 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:31:29.774 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:31:30.043 INFO:teuthology.orchestra.run.smithi032.stdout:generic/510 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:31:30.052 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/510 2023-10-08T08:31:30.052 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/510 2023-10-08T08:31:30.052 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:31:30.058 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:31:30.077 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:31:30.077 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/511) 2023-10-08T08:31:30.404 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:31:30.414 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:31:30.414 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:31:30.664 INFO:teuthology.orchestra.run.smithi032.stdout:generic/511 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:31:30.672 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/511 2023-10-08T08:31:30.672 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/511 2023-10-08T08:31:30.672 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:31:30.677 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:31:30.694 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:31:30.694 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/512) 2023-10-08T08:31:31.018 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:31:31.027 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:31:31.028 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:31:31.314 INFO:teuthology.orchestra.run.smithi032.stdout:generic/512 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:31:31.324 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/512 2023-10-08T08:31:31.324 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/512 2023-10-08T08:31:31.324 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:31:31.330 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:31:31.346 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:31:31.347 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/513) 2023-10-08T08:31:31.665 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:31:31.675 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:31:31.675 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:31:31.930 INFO:teuthology.orchestra.run.smithi032.stdout:generic/513 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:31:31.939 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/513 2023-10-08T08:31:31.939 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/513 2023-10-08T08:31:31.939 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:31:31.944 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:31:31.961 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:31:31.961 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/514) 2023-10-08T08:31:32.287 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:31:32.297 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:31:32.297 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:31:32.549 INFO:teuthology.orchestra.run.smithi032.stdout:generic/514 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:31:32.557 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/514 2023-10-08T08:31:32.557 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/514 2023-10-08T08:31:32.558 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:31:32.563 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:31:32.580 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:31:32.581 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/515) 2023-10-08T08:31:32.901 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:31:32.910 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:31:32.911 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:31:33.151 INFO:teuthology.orchestra.run.smithi032.stdout:generic/515 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:31:33.160 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/515 2023-10-08T08:31:33.160 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/515 2023-10-08T08:31:33.160 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:31:33.165 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:31:33.182 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:31:33.182 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/516) 2023-10-08T08:31:33.500 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:31:33.510 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:31:33.511 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:31:33.799 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:31:33.801 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:31:33.884 INFO:teuthology.orchestra.run.smithi032.stdout:generic/516 [not run] Dedupe not supported by test filesystem type: ceph-fuse 2023-10-08T08:31:33.892 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/516 2023-10-08T08:31:33.892 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/516 2023-10-08T08:31:33.892 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:31:33.898 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:31:33.915 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:31:33.916 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/517) 2023-10-08T08:31:34.227 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:31:34.237 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:31:34.237 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:31:34.498 INFO:teuthology.orchestra.run.smithi032.stdout:generic/517 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:31:34.507 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/517 2023-10-08T08:31:34.507 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/517 2023-10-08T08:31:34.507 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:31:34.513 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:31:34.531 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:31:34.532 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/518) 2023-10-08T08:31:34.852 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:31:34.862 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:31:34.863 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:31:35.111 INFO:teuthology.orchestra.run.smithi032.stdout:generic/518 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:31:35.120 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/518 2023-10-08T08:31:35.120 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/518 2023-10-08T08:31:35.120 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:31:35.125 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:31:35.144 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:31:35.144 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/519) 2023-10-08T08:31:35.470 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:31:35.479 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:31:35.479 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:31:35.725 INFO:teuthology.orchestra.run.smithi032.stdout:generic/519 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:31:35.733 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/519 2023-10-08T08:31:35.733 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/519 2023-10-08T08:31:35.734 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:31:35.739 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:31:35.757 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:31:35.757 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/520) 2023-10-08T08:31:36.074 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:31:36.083 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:31:36.084 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:31:36.361 INFO:teuthology.orchestra.run.smithi032.stdout:generic/520 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T08:31:36.370 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/520 2023-10-08T08:31:36.370 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/520 2023-10-08T08:31:36.370 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T08:31:36.376 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:31:36.394 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T08:31:36.394 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/521) 2023-10-08T08:31:36.715 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T08:31:36.725 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T08:31:36.725 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T08:32:03.952 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:32:03.955 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:32:34.014 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:32:34.016 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:33:04.062 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:33:04.065 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:33:34.112 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:33:34.115 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:34:04.190 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:34:04.192 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:34:34.239 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:34:34.242 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:35:04.295 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:35:04.298 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:35:34.345 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:35:34.347 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:36:04.415 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:36:04.417 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:36:34.464 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:36:34.466 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:37:04.827 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:37:04.830 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:37:34.910 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:37:34.913 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:38:04.960 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:38:04.963 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:38:35.011 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:38:35.014 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:39:05.054 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:39:05.057 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:39:35.101 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:39:35.104 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:40:05.463 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:40:05.465 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:40:35.670 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:40:35.673 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:41:05.750 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:41:05.753 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:41:35.801 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:41:35.805 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:42:05.855 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:42:05.857 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:42:05.901 INFO:tasks.ceph.mds.d.smithi040.stderr:2023-10-08T08:42:05.895+0000 7fa77bedd700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 43930) UID: 0 2023-10-08T08:42:05.901 INFO:tasks.ceph.mds.b.smithi040.stderr:2023-10-08T08:42:05.895+0000 7f4c7640d700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 43930) UID: 0 2023-10-08T08:44:29.859 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:44:29.863 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:44:59.915 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:44:59.918 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:45:29.970 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:45:29.973 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:46:00.027 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:46:00.029 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:46:30.111 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:46:30.114 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:47:00.165 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:47:00.424 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:47:30.487 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:47:30.489 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:48:00.560 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:48:00.563 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:48:30.607 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:48:30.610 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:49:00.709 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:49:00.712 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:49:30.754 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:49:30.757 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:50:00.802 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:50:00.804 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:50:30.849 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:50:30.852 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:51:00.900 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:51:00.902 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:51:30.972 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:51:30.975 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:52:01.024 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:52:01.027 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:52:31.073 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:52:31.076 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:53:01.138 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:53:01.141 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:53:31.185 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:53:31.189 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:54:01.237 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:54:01.240 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:54:31.282 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:54:31.285 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:55:01.332 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:55:01.335 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:55:31.378 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:55:31.381 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:56:01.426 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:56:01.428 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:56:31.504 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:56:31.507 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:57:01.554 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:57:01.557 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:57:31.597 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:57:31.600 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:58:01.676 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:58:01.679 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:58:31.732 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:58:31.735 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:59:02.006 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:59:02.009 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:59:32.063 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T08:59:32.066 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:00:02.114 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:00:02.117 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:00:32.393 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:00:32.395 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:01:02.440 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:01:02.443 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:01:32.522 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:01:32.526 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:02:02.571 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:02:02.574 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:02:32.618 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:02:32.621 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:03:02.696 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:03:02.699 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:03:32.756 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:03:32.759 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:04:02.808 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:04:02.811 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:04:32.856 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:04:32.859 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:05:02.908 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:05:02.911 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:05:32.955 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:05:32.958 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:06:02.999 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:06:03.002 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:06:33.069 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:06:33.072 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:07:03.120 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:07:03.122 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:07:33.168 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:07:33.170 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:08:03.240 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:08:03.243 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:08:33.288 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:08:33.291 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:09:03.348 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:09:03.350 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:09:33.391 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:09:33.394 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:10:03.439 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:10:03.442 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:10:33.487 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:10:33.489 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:11:03.535 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:11:03.538 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:11:33.610 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:11:33.613 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:12:03.662 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:12:03.665 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:12:33.714 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:12:33.717 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:13:03.775 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:13:03.778 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:13:33.823 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:13:33.826 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:13:33.845 INFO:tasks.ceph.osd.1.smithi032.stderr:2023-10-08T09:13:33.844+0000 7efe8aecf700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 370668) UID: 0 2023-10-08T09:13:33.846 INFO:tasks.ceph.osd.0.smithi032.stderr:2023-10-08T09:13:33.844+0000 7f519f0f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 370668) UID: 0 2023-10-08T09:13:33.846 INFO:tasks.ceph.osd.2.smithi032.stderr:2023-10-08T09:13:33.844+0000 7fe8a3511700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 370668) UID: 0 2023-10-08T09:13:33.846 INFO:tasks.ceph.osd.3.smithi032.stderr:2023-10-08T09:13:33.844+0000 7ff6419ae700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 370668) UID: 0 2023-10-08T09:15:47.936 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:15:47.939 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:16:17.993 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:16:17.996 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:16:48.073 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:16:48.076 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:17:18.121 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:17:18.189 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:17:48.509 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:17:48.512 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:18:18.583 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:18:18.586 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:18:48.633 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:18:48.635 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:19:18.696 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:19:18.699 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:19:48.747 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:19:48.749 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:20:18.792 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:20:18.795 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:20:48.847 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:20:48.849 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:21:19.071 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:21:19.074 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:21:49.145 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:21:49.147 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:22:19.196 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:22:19.199 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:22:49.244 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:22:49.247 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:23:19.313 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:23:19.316 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:23:49.367 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:23:49.369 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:24:19.419 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:24:19.425 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:24:49.477 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:24:49.480 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:25:19.527 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:25:19.531 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:25:49.582 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:25:49.585 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:26:19.643 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:26:19.647 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:26:49.724 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:26:49.727 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:27:19.772 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:27:19.774 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:27:49.837 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:27:49.841 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:28:19.893 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:28:19.896 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:28:49.945 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:28:49.947 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:29:19.993 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:29:19.996 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:29:50.043 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:29:50.045 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:30:20.090 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:30:20.092 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:30:50.136 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:30:50.138 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:31:20.186 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:31:20.190 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:31:50.265 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:31:50.268 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:32:20.309 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:32:20.312 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:32:50.360 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:32:50.363 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:33:20.426 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:33:20.428 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:33:50.480 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:33:50.482 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:34:20.528 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:34:20.531 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:34:50.580 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:34:50.583 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:35:20.636 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:35:20.638 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:35:50.692 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:35:50.695 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:36:20.735 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:36:20.740 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:36:50.807 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:36:50.809 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:37:20.900 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:37:20.903 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:37:51.243 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:37:51.246 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:38:21.306 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:38:21.309 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:38:51.352 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:38:51.355 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:39:21.399 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:39:21.401 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:39:51.450 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:39:51.453 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:40:21.510 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:40:21.512 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:40:51.557 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:40:51.560 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:41:21.604 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:41:21.606 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:41:51.675 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:41:51.677 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:42:21.725 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:42:21.728 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:42:51.771 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:42:51.774 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:43:21.832 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:43:21.835 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:43:51.877 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:43:51.880 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:44:21.921 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:44:21.924 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:44:51.971 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:44:51.975 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:45:22.021 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:45:22.024 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:45:52.087 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:45:52.090 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:46:22.161 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:46:22.163 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:46:52.234 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:46:52.236 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:47:22.288 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:47:23.405 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:47:53.469 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:47:53.472 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:48:23.800 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:48:23.803 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:48:53.847 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:48:53.850 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:49:23.897 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:49:23.900 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:49:53.949 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:49:53.951 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:50:24.000 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:50:24.003 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:50:54.053 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:50:54.055 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:51:24.110 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:51:24.113 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:51:54.192 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:51:54.195 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:52:24.251 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:52:24.253 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:52:54.301 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:52:54.303 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:53:24.370 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:53:24.373 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:53:34.964 INFO:teuthology.orchestra.run.smithi032.stdout:generic/521 4918s 2023-10-08T09:53:34.980 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/521 2023-10-08T09:53:34.980 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T09:53:34.985 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T09:53:35.002 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T09:53:35.003 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/522) 2023-10-08T09:53:35.318 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T09:53:35.327 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T09:53:35.327 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T09:53:54.422 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:53:54.425 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:54:24.480 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:54:24.482 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:54:54.525 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:54:54.528 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:55:24.572 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:55:24.575 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:55:54.621 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:55:54.624 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:56:24.724 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:56:24.726 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:56:54.791 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:56:54.794 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:57:24.847 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:57:24.850 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:57:54.896 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:57:54.899 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:58:24.967 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:58:24.970 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:58:55.214 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:58:55.217 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:59:25.270 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:59:25.273 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:59:55.315 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T09:59:55.318 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:00:25.405 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:00:25.408 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:00:55.453 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:00:55.456 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:01:25.503 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:01:25.506 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:01:55.563 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:01:55.565 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:01:55.585 INFO:tasks.ceph.osd.1.smithi032.stderr:2023-10-08T10:01:55.578+0000 7efe8aecf700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 371405) UID: 0 2023-10-08T10:01:55.585 INFO:tasks.ceph.osd.3.smithi032.stderr:2023-10-08T10:01:55.578+0000 7ff6419ae700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 371405) UID: 0 2023-10-08T10:01:55.586 INFO:tasks.ceph.osd.2.smithi032.stderr:2023-10-08T10:01:55.578+0000 7fe8a3511700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 371405) UID: 0 2023-10-08T10:01:55.586 INFO:tasks.ceph.osd.0.smithi032.stderr:2023-10-08T10:01:55.578+0000 7f519f0f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 371405) UID: 0 2023-10-08T10:04:26.857 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:04:26.860 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:04:57.068 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:04:57.070 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:05:27.119 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:05:27.122 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:05:57.172 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:05:57.175 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:06:27.315 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:06:27.317 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:06:57.384 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:06:57.387 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:07:27.429 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:07:27.432 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:07:57.472 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:07:57.476 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:08:27.523 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:08:27.526 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:08:57.579 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:08:57.582 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:09:27.628 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:09:27.631 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:09:57.698 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:09:57.701 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:10:27.749 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:10:27.752 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:10:57.801 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:10:57.804 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:11:27.843 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:11:27.846 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:11:57.909 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:11:57.911 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:12:27.971 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:12:27.974 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:12:58.020 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:12:58.022 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:13:28.066 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:13:28.068 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:13:58.110 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:13:58.113 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:14:28.154 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:14:28.157 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:14:58.221 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:14:58.224 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:15:28.274 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:15:28.276 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:15:58.323 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:15:58.326 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:16:28.378 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:16:28.381 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:16:58.448 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:16:58.452 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:17:28.503 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:17:28.505 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:17:58.554 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:17:58.557 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:18:28.603 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:18:28.605 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:18:58.653 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:18:58.656 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:19:28.699 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:19:28.702 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:19:58.763 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:19:58.766 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:20:28.817 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:20:28.820 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:20:58.861 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:20:58.864 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:21:28.906 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:21:28.911 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:21:59.056 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:21:59.059 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:22:29.110 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:22:29.113 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:22:59.159 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:22:59.162 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:23:29.216 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:23:29.219 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:23:59.272 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:23:59.275 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:24:29.323 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:24:29.326 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:24:59.385 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:24:59.387 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:25:29.432 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:25:29.435 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:25:59.481 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:25:59.483 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:26:29.541 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:26:29.543 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:26:59.603 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:26:59.606 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:27:29.669 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:27:29.672 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:27:59.717 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:27:59.720 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:28:29.768 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:28:29.770 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:28:59.823 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:28:59.826 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:29:29.871 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:29:29.873 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:29:59.940 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:29:59.943 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:30:29.985 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:30:29.988 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:31:00.035 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:31:00.038 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:31:30.087 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:31:30.089 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:32:00.153 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:32:00.156 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:32:30.202 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:32:30.205 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:33:00.258 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:33:00.260 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:33:00.283 INFO:tasks.ceph.mds.b.smithi040.stderr:2023-10-08T10:33:00.279+0000 7f4c7640d700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 44576) UID: 0 2023-10-08T10:33:00.283 INFO:tasks.ceph.mds.d.smithi040.stderr:2023-10-08T10:33:00.279+0000 7fa77bedd700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 44576) UID: 0 2023-10-08T10:35:26.982 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:35:26.985 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:35:57.047 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:35:57.049 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:36:27.099 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:36:27.102 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:36:57.147 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:36:57.149 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:37:27.225 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:37:27.228 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:37:57.276 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:37:57.279 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:38:27.334 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:38:27.337 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:38:57.383 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:38:57.385 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:39:27.440 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:39:27.444 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:39:57.487 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:39:57.490 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:40:27.572 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:40:27.577 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:40:57.928 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:40:57.937 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:41:27.983 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:41:27.986 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:41:58.041 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:41:58.043 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:42:28.119 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:42:28.121 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:42:58.245 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:42:58.248 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:43:28.295 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:43:28.297 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:43:58.529 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:43:58.531 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:44:28.576 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:44:28.578 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:44:58.627 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:44:58.631 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:45:28.687 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:45:28.691 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:45:58.740 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:45:58.743 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:46:28.790 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:46:28.793 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:46:58.842 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:46:58.845 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:47:28.905 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:47:28.908 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:47:58.950 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:47:58.953 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:48:28.993 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:48:28.995 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:48:59.036 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:48:59.039 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:49:29.079 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:49:29.082 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:49:59.129 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:49:59.132 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:50:29.206 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:50:29.209 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:50:59.250 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:50:59.302 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:51:29.358 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:51:29.361 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:51:59.401 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:51:59.404 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:52:29.473 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:52:29.476 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:52:59.521 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:52:59.523 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:53:29.595 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:53:29.597 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:53:59.643 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:53:59.646 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:54:29.690 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:54:29.692 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:54:59.736 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:54:59.739 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:55:29.796 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:55:29.798 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:55:48.307 INFO:teuthology.orchestra.run.smithi032.stdout:generic/522 3733s 2023-10-08T10:55:48.389 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/522 2023-10-08T10:55:48.390 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T10:55:48.395 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T10:55:48.413 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T10:55:48.413 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/523) 2023-10-08T10:55:49.203 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T10:55:49.214 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T10:55:49.215 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T10:55:49.518 INFO:teuthology.orchestra.run.smithi032.stdout:generic/523 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T10:55:49.526 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/523 2023-10-08T10:55:49.526 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/523 2023-10-08T10:55:49.526 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T10:55:49.532 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T10:55:49.550 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T10:55:49.550 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/524) 2023-10-08T10:55:49.867 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T10:55:49.875 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T10:55:49.875 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T10:55:50.110 INFO:teuthology.orchestra.run.smithi032.stdout:generic/524 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T10:55:50.118 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/524 2023-10-08T10:55:50.118 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/524 2023-10-08T10:55:50.118 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T10:55:50.123 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T10:55:50.140 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T10:55:50.140 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/525) 2023-10-08T10:55:50.460 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T10:55:50.470 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T10:55:50.470 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T10:55:50.719 INFO:teuthology.orchestra.run.smithi032.stdout:generic/525 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T10:55:50.728 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/525 2023-10-08T10:55:50.728 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/525 2023-10-08T10:55:50.728 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T10:55:50.734 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T10:55:50.752 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T10:55:50.752 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/526) 2023-10-08T10:55:51.069 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T10:55:51.079 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T10:55:51.079 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T10:55:51.409 INFO:teuthology.orchestra.run.smithi032.stdout:generic/526 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T10:55:51.418 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/526 2023-10-08T10:55:51.418 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/526 2023-10-08T10:55:51.418 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T10:55:51.424 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T10:55:51.442 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T10:55:51.443 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/527) 2023-10-08T10:55:51.755 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T10:55:51.765 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T10:55:51.765 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T10:55:52.049 INFO:teuthology.orchestra.run.smithi032.stdout:generic/527 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T10:55:52.058 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/527 2023-10-08T10:55:52.059 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/527 2023-10-08T10:55:52.059 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T10:55:52.064 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T10:55:52.082 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T10:55:52.082 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/528) 2023-10-08T10:55:52.393 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T10:55:52.401 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T10:55:52.402 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T10:55:52.715 INFO:teuthology.orchestra.run.smithi032.stdout:generic/528 [not run] inode creation time not supported by this filesystem 2023-10-08T10:55:52.724 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/528 2023-10-08T10:55:52.724 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/528 2023-10-08T10:55:52.724 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T10:55:52.730 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T10:55:52.747 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T10:55:52.747 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/529) 2023-10-08T10:55:53.066 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T10:55:53.077 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T10:55:53.077 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T10:55:53.367 INFO:teuthology.orchestra.run.smithi032.stdout:generic/529 [not run] ACLs not supported by this filesystem type: ceph-fuse 2023-10-08T10:55:53.373 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/529 2023-10-08T10:55:53.373 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/529 2023-10-08T10:55:53.373 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T10:55:53.377 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T10:55:53.390 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T10:55:53.390 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/530) 2023-10-08T10:55:53.696 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T10:55:53.706 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T10:55:53.707 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T10:55:53.949 INFO:teuthology.orchestra.run.smithi032.stdout:generic/530 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T10:55:53.958 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/530 2023-10-08T10:55:53.958 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/530 2023-10-08T10:55:53.958 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T10:55:53.964 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T10:55:53.982 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T10:55:53.982 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/531) 2023-10-08T10:55:54.309 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T10:55:54.319 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T10:55:54.319 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T10:55:54.578 INFO:teuthology.orchestra.run.smithi032.stdout:generic/531 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T10:55:54.587 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/531 2023-10-08T10:55:54.587 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/531 2023-10-08T10:55:54.587 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T10:55:54.592 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T10:55:54.610 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T10:55:54.610 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/532) 2023-10-08T10:55:54.932 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T10:55:54.942 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T10:55:54.942 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T10:55:55.285 INFO:teuthology.orchestra.run.smithi032.stdout:generic/532 1s 2023-10-08T10:55:55.297 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/532 2023-10-08T10:55:55.297 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T10:55:55.302 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T10:55:55.319 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T10:55:55.319 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/533) 2023-10-08T10:55:55.640 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T10:55:55.649 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T10:55:55.649 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T10:55:56.417 INFO:teuthology.orchestra.run.smithi032.stdout:generic/533 1s 2023-10-08T10:55:56.429 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/533 2023-10-08T10:55:56.429 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T10:55:56.434 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T10:55:56.451 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T10:55:56.451 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/534) 2023-10-08T10:55:56.775 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T10:55:56.783 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T10:55:56.783 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T10:55:57.052 INFO:teuthology.orchestra.run.smithi032.stdout:generic/534 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T10:55:57.061 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/534 2023-10-08T10:55:57.061 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/534 2023-10-08T10:55:57.061 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T10:55:57.068 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T10:55:57.087 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T10:55:57.087 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/535) 2023-10-08T10:55:57.397 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T10:55:57.406 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T10:55:57.406 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T10:55:57.679 INFO:teuthology.orchestra.run.smithi032.stdout:generic/535 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T10:55:57.689 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/535 2023-10-08T10:55:57.689 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/535 2023-10-08T10:55:57.689 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T10:55:57.694 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T10:55:57.712 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T10:55:57.712 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/536) 2023-10-08T10:55:58.035 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T10:55:58.045 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T10:55:58.045 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T10:55:58.301 INFO:teuthology.orchestra.run.smithi032.stdout:generic/536 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T10:55:58.310 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/536 2023-10-08T10:55:58.311 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/536 2023-10-08T10:55:58.311 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T10:55:58.317 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T10:55:58.334 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T10:55:58.334 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/537) 2023-10-08T10:55:58.655 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T10:55:58.665 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T10:55:58.666 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T10:55:58.908 INFO:teuthology.orchestra.run.smithi032.stdout:generic/537 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T10:55:58.916 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/537 2023-10-08T10:55:58.916 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/537 2023-10-08T10:55:58.916 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T10:55:58.921 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T10:55:58.940 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T10:55:58.940 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/538) 2023-10-08T10:55:59.254 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T10:55:59.263 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T10:55:59.263 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T10:55:59.841 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:55:59.844 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:56:29.898 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:56:29.901 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:56:59.945 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:56:59.948 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:57:30.008 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:57:30.011 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:58:00.061 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:58:00.064 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:58:30.117 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:58:30.119 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:59:00.166 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:59:00.169 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:59:30.214 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T10:59:30.216 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:00:00.257 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:00:00.260 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:00:30.312 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:00:30.315 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:01:00.364 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:01:00.367 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:01:30.545 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:01:30.548 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:02:00.596 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:02:00.599 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:02:30.669 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:02:30.672 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:03:00.710 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:03:00.712 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:03:30.763 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:03:30.766 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:04:00.828 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:04:00.831 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:04:30.875 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:04:30.877 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:05:00.925 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:05:00.927 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:05:30.989 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:05:30.993 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:06:01.069 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:06:01.071 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:06:31.117 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:06:31.119 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:07:01.165 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:07:01.168 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:07:31.222 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:07:31.225 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:08:01.267 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:08:01.270 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:08:31.322 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:08:31.324 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:09:01.370 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:09:01.373 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:09:31.446 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:09:31.449 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:10:01.492 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:10:01.495 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:10:31.546 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:10:31.550 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:11:01.604 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:11:01.606 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:11:31.666 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:11:31.668 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:12:01.727 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:12:01.730 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:12:31.792 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:12:31.795 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:13:01.839 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:13:01.841 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:13:31.895 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:13:31.898 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:14:01.945 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:14:01.948 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:14:31.987 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:14:31.990 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:15:02.035 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:15:02.038 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:15:32.084 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:15:32.087 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:16:02.139 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:16:02.142 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:16:32.252 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:16:32.290 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:17:02.349 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:17:02.352 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:17:32.424 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:17:32.426 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:18:02.593 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:18:02.596 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:18:32.645 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:18:32.652 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:19:02.699 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:19:02.702 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:19:32.748 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:19:32.751 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:20:02.805 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:20:02.808 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:20:32.868 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:20:32.871 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:21:02.924 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:21:02.927 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:21:32.972 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:21:32.975 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:22:03.023 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:22:03.026 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:22:33.090 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:22:33.092 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:23:03.152 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:23:03.154 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:23:33.202 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:23:33.205 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:24:03.248 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:24:03.250 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:24:33.316 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:24:33.319 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:25:03.364 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:25:03.367 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:25:33.429 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:25:33.432 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:26:03.478 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:26:03.481 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:26:33.530 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:26:33.533 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:27:03.581 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:27:03.583 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:27:33.638 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:27:33.641 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:28:03.686 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:28:03.689 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:28:33.759 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:28:33.762 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:29:03.809 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:29:03.812 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:29:33.866 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:29:33.869 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:30:04.013 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:30:04.016 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:30:34.069 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:30:34.075 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:31:04.126 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:31:04.129 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:31:34.398 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:31:34.401 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:32:04.441 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:32:04.445 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:32:34.514 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:32:34.517 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:32:34.543 INFO:tasks.ceph.osd.4.smithi040.stderr:2023-10-08T11:32:34.539+0000 7ff0fd263700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 44950) UID: 0 2023-10-08T11:32:34.543 INFO:tasks.ceph.osd.5.smithi040.stderr:2023-10-08T11:32:34.539+0000 7f5dfedf1700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 44950) UID: 0 2023-10-08T11:32:34.544 INFO:tasks.ceph.osd.6.smithi040.stderr:2023-10-08T11:32:34.539+0000 7f1be92f5700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 44950) UID: 0 2023-10-08T11:32:34.544 INFO:tasks.ceph.osd.7.smithi040.stderr:2023-10-08T11:32:34.539+0000 7f410cbd5700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 44950) UID: 0 2023-10-08T11:34:53.132 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:34:53.135 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:35:23.208 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:35:23.210 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:35:53.272 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:35:53.275 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:36:23.320 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:36:23.323 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:36:53.369 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:36:53.372 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:37:23.429 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:37:23.432 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:37:53.508 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:37:53.511 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:38:23.967 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:38:23.970 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:38:54.014 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:38:54.016 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:39:24.067 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:39:24.070 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:39:54.115 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:39:54.118 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:40:24.157 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:40:24.160 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:40:24.200 INFO:tasks.ceph.osd.4.smithi040.stderr:2023-10-08T11:40:24.197+0000 7ff0fd263700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 44994) UID: 0 2023-10-08T11:40:24.200 INFO:tasks.ceph.osd.6.smithi040.stderr:2023-10-08T11:40:24.197+0000 7f1be92f5700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 44994) UID: 0 2023-10-08T11:40:24.201 INFO:tasks.ceph.osd.7.smithi040.stderr:2023-10-08T11:40:24.197+0000 7f410cbd5700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 44994) UID: 0 2023-10-08T11:40:24.201 INFO:tasks.ceph.osd.5.smithi040.stderr:2023-10-08T11:40:24.197+0000 7f5dfedf1700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 44994) UID: 0 2023-10-08T11:42:49.404 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:42:49.407 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:43:19.467 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:43:19.469 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:43:49.515 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:43:49.518 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:43:49.540 INFO:tasks.ceph.osd.5.smithi040.stderr:2023-10-08T11:43:49.534+0000 7f5dfedf1700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45010) UID: 0 2023-10-08T11:43:49.540 INFO:tasks.ceph.osd.4.smithi040.stderr:2023-10-08T11:43:49.534+0000 7ff0fd263700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45010) UID: 0 2023-10-08T11:43:49.540 INFO:tasks.ceph.osd.6.smithi040.stderr:2023-10-08T11:43:49.534+0000 7f1be92f5700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45010) UID: 0 2023-10-08T11:43:49.541 INFO:tasks.ceph.osd.7.smithi040.stderr:2023-10-08T11:43:49.534+0000 7f410cbd5700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45010) UID: 0 2023-10-08T11:46:05.724 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:46:05.727 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:46:35.779 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:46:35.782 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:47:05.836 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:47:05.839 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:47:35.879 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:47:35.882 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:48:05.935 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:48:05.938 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:48:36.010 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:48:36.013 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:49:06.073 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:49:06.076 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:49:36.128 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:49:36.131 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:50:06.194 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:50:06.196 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:50:36.246 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:50:36.249 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:51:06.301 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:51:06.304 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:51:36.352 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:51:36.355 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:52:06.543 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:52:06.546 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:52:36.588 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:52:36.591 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:53:06.646 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:53:06.648 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:53:06.691 INFO:tasks.ceph.osd.0.smithi032.stderr:2023-10-08T11:53:06.685+0000 7f519f0f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 383783) UID: 0 2023-10-08T11:53:06.691 INFO:tasks.ceph.osd.1.smithi032.stderr:2023-10-08T11:53:06.685+0000 7efe8aecf700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 383783) UID: 0 2023-10-08T11:53:06.692 INFO:tasks.ceph.osd.3.smithi032.stderr:2023-10-08T11:53:06.685+0000 7ff6419ae700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 383783) UID: 0 2023-10-08T11:53:06.692 INFO:tasks.ceph.osd.2.smithi032.stderr:2023-10-08T11:53:06.685+0000 7fe8a3511700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 383783) UID: 0 2023-10-08T11:55:25.757 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:55:25.760 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:55:55.854 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:55:55.857 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:56:25.924 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:56:25.927 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:56:55.979 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:56:55.982 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:57:26.025 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:57:26.028 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:57:56.075 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:57:56.078 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:58:26.132 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:58:26.135 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:58:56.205 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:58:56.212 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:59:26.259 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:59:26.261 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:59:56.306 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T11:59:56.309 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:00:26.357 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:00:26.360 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:00:56.401 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:00:56.404 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:01:26.473 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:01:26.476 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:01:56.521 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:01:56.524 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:02:26.585 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:02:26.588 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:02:56.641 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:02:56.644 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:03:26.704 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:03:26.706 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:03:56.776 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:03:56.779 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:04:27.093 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:04:27.096 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:04:57.153 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:04:57.156 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:05:27.208 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:05:27.211 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:05:57.264 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:05:57.267 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:06:27.335 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:06:27.338 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:06:57.395 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:06:57.398 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:07:27.446 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:07:27.449 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:07:43.092 INFO:teuthology.orchestra.run.smithi032.stdout:generic/538 4304s 2023-10-08T12:07:43.105 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/538 2023-10-08T12:07:43.106 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T12:07:43.107 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:07:43.122 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T12:07:43.123 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/539) 2023-10-08T12:07:43.464 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T12:07:43.474 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T12:07:43.474 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:07:46.993 INFO:teuthology.orchestra.run.smithi032.stdout:generic/539 3s 2023-10-08T12:07:47.007 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/539 2023-10-08T12:07:47.007 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T12:07:47.013 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:07:47.032 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T12:07:47.032 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/540) 2023-10-08T12:07:47.351 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T12:07:47.361 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T12:07:47.361 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:07:47.638 INFO:teuthology.orchestra.run.smithi032.stdout:generic/540 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T12:07:47.645 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/540 2023-10-08T12:07:47.645 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/540 2023-10-08T12:07:47.646 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T12:07:47.651 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:07:47.668 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T12:07:47.668 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/541) 2023-10-08T12:07:47.987 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T12:07:47.997 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T12:07:47.997 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:07:48.252 INFO:teuthology.orchestra.run.smithi032.stdout:generic/541 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T12:07:48.261 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/541 2023-10-08T12:07:48.261 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/541 2023-10-08T12:07:48.262 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T12:07:48.266 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:07:48.282 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T12:07:48.282 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/542) 2023-10-08T12:07:48.599 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T12:07:48.610 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T12:07:48.610 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:07:48.861 INFO:teuthology.orchestra.run.smithi032.stdout:generic/542 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T12:07:48.871 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/542 2023-10-08T12:07:48.871 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/542 2023-10-08T12:07:48.871 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T12:07:48.876 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:07:48.892 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T12:07:48.893 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/543) 2023-10-08T12:07:49.227 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T12:07:49.237 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T12:07:49.237 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:07:49.491 INFO:teuthology.orchestra.run.smithi032.stdout:generic/543 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T12:07:49.500 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/543 2023-10-08T12:07:49.500 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/543 2023-10-08T12:07:49.500 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T12:07:49.506 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:07:49.523 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T12:07:49.523 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/544) 2023-10-08T12:07:49.838 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T12:07:49.848 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T12:07:49.848 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:07:50.091 INFO:teuthology.orchestra.run.smithi032.stdout:generic/544 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T12:07:50.099 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/544 2023-10-08T12:07:50.099 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/544 2023-10-08T12:07:50.100 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T12:07:50.104 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:07:50.119 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T12:07:50.119 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/545) 2023-10-08T12:07:50.445 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T12:07:50.454 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T12:07:50.454 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:07:50.827 INFO:teuthology.orchestra.run.smithi032.stdout:generic/545 [not run] file system doesn't support chattr +i 2023-10-08T12:07:50.834 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/545 2023-10-08T12:07:50.834 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/545 2023-10-08T12:07:50.835 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T12:07:50.837 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:07:50.851 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T12:07:50.852 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/546) 2023-10-08T12:07:51.183 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T12:07:51.193 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T12:07:51.193 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:07:51.580 INFO:teuthology.orchestra.run.smithi032.stdout:generic/546 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T12:07:51.589 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/546 2023-10-08T12:07:51.589 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/546 2023-10-08T12:07:51.589 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T12:07:51.595 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:07:51.613 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T12:07:51.614 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/547) 2023-10-08T12:07:51.938 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T12:07:51.947 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T12:07:51.947 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:07:52.227 INFO:teuthology.orchestra.run.smithi032.stdout:generic/547 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T12:07:52.236 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/547 2023-10-08T12:07:52.236 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/547 2023-10-08T12:07:52.236 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T12:07:52.243 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:07:52.261 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T12:07:52.261 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/548) 2023-10-08T12:07:52.586 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T12:07:52.593 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T12:07:52.593 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:07:52.916 INFO:teuthology.orchestra.run.smithi032.stdout:generic/548 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T12:07:52.926 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/548 2023-10-08T12:07:52.926 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/548 2023-10-08T12:07:52.926 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T12:07:52.932 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:07:52.949 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T12:07:52.949 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/549) 2023-10-08T12:07:53.279 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T12:07:53.288 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T12:07:53.288 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:07:53.612 INFO:teuthology.orchestra.run.smithi032.stdout:generic/549 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T12:07:53.621 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/549 2023-10-08T12:07:53.621 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/549 2023-10-08T12:07:53.621 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T12:07:53.626 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:07:53.645 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T12:07:53.645 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/550) 2023-10-08T12:07:53.981 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T12:07:53.990 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T12:07:53.990 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:07:54.308 INFO:teuthology.orchestra.run.smithi032.stdout:generic/550 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T12:07:54.317 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/550 2023-10-08T12:07:54.317 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/550 2023-10-08T12:07:54.317 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T12:07:54.323 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:07:54.342 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T12:07:54.342 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/551) 2023-10-08T12:07:54.668 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T12:07:54.677 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T12:07:54.677 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:07:54.926 INFO:teuthology.orchestra.run.smithi032.stdout:generic/551 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T12:07:54.934 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/551 2023-10-08T12:07:54.935 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/551 2023-10-08T12:07:54.935 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T12:07:54.940 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:07:54.957 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T12:07:54.957 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/552) 2023-10-08T12:07:55.291 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T12:07:55.301 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T12:07:55.301 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:07:55.578 INFO:teuthology.orchestra.run.smithi032.stdout:generic/552 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T12:07:55.587 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/552 2023-10-08T12:07:55.587 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/552 2023-10-08T12:07:55.587 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T12:07:55.593 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:07:55.610 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T12:07:55.610 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/553) 2023-10-08T12:07:55.922 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T12:07:55.931 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T12:07:55.931 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:07:56.386 INFO:teuthology.orchestra.run.smithi032.stdout:generic/553 [not run] xfs_io chattr +i failed (old kernel/wrong fs/bad args?) 2023-10-08T12:07:56.395 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/553 2023-10-08T12:07:56.395 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/553 2023-10-08T12:07:56.395 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T12:07:56.401 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:07:56.418 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T12:07:56.419 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/554) 2023-10-08T12:07:56.739 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T12:07:56.748 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T12:07:56.748 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:07:56.995 INFO:teuthology.orchestra.run.smithi032.stdout:generic/554 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T12:07:57.002 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/554 2023-10-08T12:07:57.002 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/554 2023-10-08T12:07:57.003 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T12:07:57.008 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:07:57.024 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T12:07:57.025 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/555) 2023-10-08T12:07:57.344 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T12:07:57.353 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T12:07:57.354 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:07:57.501 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:07:57.503 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:07:57.732 INFO:teuthology.orchestra.run.smithi032.stdout:generic/555 [not run] xfs_io chattr +ia failed (old kernel/wrong fs/bad args?) 2023-10-08T12:07:57.742 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/555 2023-10-08T12:07:57.742 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/555 2023-10-08T12:07:57.742 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T12:07:57.748 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:07:57.768 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T12:07:57.768 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/556) 2023-10-08T12:07:58.100 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T12:07:58.109 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T12:07:58.109 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:07:58.362 INFO:teuthology.orchestra.run.smithi032.stdout:generic/556 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T12:07:58.370 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/556 2023-10-08T12:07:58.371 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/556 2023-10-08T12:07:58.371 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T12:07:58.376 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:07:58.394 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T12:07:58.394 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/557) 2023-10-08T12:07:58.717 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T12:07:58.727 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T12:07:58.727 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:07:59.011 INFO:teuthology.orchestra.run.smithi032.stdout:generic/557 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T12:07:59.020 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/557 2023-10-08T12:07:59.020 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/557 2023-10-08T12:07:59.020 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T12:07:59.027 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:07:59.044 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T12:07:59.044 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/558) 2023-10-08T12:07:59.368 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T12:07:59.377 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T12:07:59.377 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:07:59.655 INFO:teuthology.orchestra.run.smithi032.stdout:generic/558 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T12:07:59.664 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/558 2023-10-08T12:07:59.664 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/558 2023-10-08T12:07:59.664 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T12:07:59.670 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:07:59.689 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T12:07:59.689 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/559) 2023-10-08T12:08:00.022 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T12:08:00.031 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T12:08:00.031 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:08:00.279 INFO:teuthology.orchestra.run.smithi032.stdout:generic/559 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T12:08:00.287 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/559 2023-10-08T12:08:00.287 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/559 2023-10-08T12:08:00.287 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T12:08:00.294 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:08:00.310 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T12:08:00.310 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/560) 2023-10-08T12:08:00.628 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T12:08:00.637 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T12:08:00.637 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:08:00.890 INFO:teuthology.orchestra.run.smithi032.stdout:generic/560 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T12:08:00.898 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/560 2023-10-08T12:08:00.898 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/560 2023-10-08T12:08:00.898 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T12:08:00.904 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:08:00.921 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T12:08:00.921 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/561) 2023-10-08T12:08:01.244 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T12:08:01.252 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T12:08:01.252 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:08:01.504 INFO:teuthology.orchestra.run.smithi032.stdout:generic/561 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T12:08:01.513 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/561 2023-10-08T12:08:01.513 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/561 2023-10-08T12:08:01.513 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T12:08:01.519 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:08:01.538 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T12:08:01.538 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/562) 2023-10-08T12:08:01.866 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T12:08:01.876 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T12:08:01.876 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:08:02.135 INFO:teuthology.orchestra.run.smithi032.stdout:generic/562 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T12:08:02.144 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/562 2023-10-08T12:08:02.144 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/562 2023-10-08T12:08:02.144 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T12:08:02.149 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:08:02.167 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T12:08:02.167 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/563) 2023-10-08T12:08:02.483 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T12:08:02.494 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T12:08:02.494 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:08:02.811 INFO:teuthology.orchestra.run.smithi032.stdout:generic/563 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T12:08:02.820 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/563 2023-10-08T12:08:02.820 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/563 2023-10-08T12:08:02.820 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T12:08:02.826 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:08:02.845 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T12:08:02.845 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/564) 2023-10-08T12:08:03.173 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T12:08:03.182 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T12:08:03.183 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:08:04.183 INFO:teuthology.orchestra.run.smithi032.stdout:generic/564 1s 2023-10-08T12:08:04.196 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/564 2023-10-08T12:08:04.196 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T12:08:04.202 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:08:04.219 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T12:08:04.219 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/565) 2023-10-08T12:08:04.549 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T12:08:04.559 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T12:08:04.559 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:08:04.816 INFO:teuthology.orchestra.run.smithi032.stdout:generic/565 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T12:08:04.824 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/565 2023-10-08T12:08:04.825 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/565 2023-10-08T12:08:04.825 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T12:08:04.833 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:08:04.849 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T12:08:04.849 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/566) 2023-10-08T12:08:05.165 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T12:08:05.177 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T12:08:05.177 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:08:05.433 INFO:teuthology.orchestra.run.smithi032.stdout:generic/566 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T12:08:05.441 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/566 2023-10-08T12:08:05.442 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/566 2023-10-08T12:08:05.442 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T12:08:05.447 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:08:05.466 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T12:08:05.466 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/567) 2023-10-08T12:08:05.798 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T12:08:05.808 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T12:08:05.808 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:08:06.053 INFO:teuthology.orchestra.run.smithi032.stdout:generic/567 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T12:08:06.061 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/567 2023-10-08T12:08:06.061 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/567 2023-10-08T12:08:06.061 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T12:08:06.066 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:08:06.084 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T12:08:06.085 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/568) 2023-10-08T12:08:06.418 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T12:08:06.428 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T12:08:06.428 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:08:06.811 INFO:teuthology.orchestra.run.smithi032.stdout:generic/568 0s 2023-10-08T12:08:06.824 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/568 2023-10-08T12:08:06.824 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T12:08:06.828 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:08:06.843 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T12:08:06.843 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/569) 2023-10-08T12:08:07.172 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T12:08:07.182 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T12:08:07.182 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:08:07.506 INFO:teuthology.orchestra.run.smithi032.stdout:generic/569 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T12:08:07.516 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/569 2023-10-08T12:08:07.516 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/569 2023-10-08T12:08:07.516 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T12:08:07.522 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:08:07.541 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T12:08:07.541 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/570) 2023-10-08T12:08:07.870 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T12:08:07.879 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T12:08:07.879 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:08:08.127 INFO:teuthology.orchestra.run.smithi032.stdout:generic/570 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T12:08:08.139 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/570 2023-10-08T12:08:08.139 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/570 2023-10-08T12:08:08.139 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T12:08:08.142 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:08:08.162 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T12:08:08.162 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/571) 2023-10-08T12:08:08.499 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T12:08:08.508 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T12:08:08.508 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:08:14.976 INFO:teuthology.orchestra.run.smithi032.stdout:generic/571 6s 2023-10-08T12:08:14.987 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/571 2023-10-08T12:08:14.988 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T12:08:14.994 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:08:15.010 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T12:08:15.010 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/572) 2023-10-08T12:08:15.323 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T12:08:15.332 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T12:08:15.332 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:08:15.592 INFO:teuthology.orchestra.run.smithi032.stdout:generic/572 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T12:08:15.601 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/572 2023-10-08T12:08:15.601 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/572 2023-10-08T12:08:15.601 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T12:08:15.610 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:08:15.627 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T12:08:15.627 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/573) 2023-10-08T12:08:15.952 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T12:08:15.961 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T12:08:15.961 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:08:16.214 INFO:teuthology.orchestra.run.smithi032.stdout:generic/573 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T12:08:16.223 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/573 2023-10-08T12:08:16.223 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/573 2023-10-08T12:08:16.223 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T12:08:16.228 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:08:16.246 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T12:08:16.246 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/574) 2023-10-08T12:08:16.572 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T12:08:16.582 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T12:08:16.582 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:08:16.944 INFO:teuthology.orchestra.run.smithi032.stdout:generic/574 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T12:08:16.953 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/574 2023-10-08T12:08:16.953 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/574 2023-10-08T12:08:16.954 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T12:08:16.959 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:08:16.976 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T12:08:16.976 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/575) 2023-10-08T12:08:17.300 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T12:08:17.309 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T12:08:17.309 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:08:17.554 INFO:teuthology.orchestra.run.smithi032.stdout:generic/575 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T12:08:17.562 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/575 2023-10-08T12:08:17.562 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/575 2023-10-08T12:08:17.562 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T12:08:17.568 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:08:17.585 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T12:08:17.586 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/576) 2023-10-08T12:08:17.908 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T12:08:17.917 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T12:08:17.917 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:08:18.238 INFO:teuthology.orchestra.run.smithi032.stdout:generic/576 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T12:08:18.246 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/576 2023-10-08T12:08:18.246 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/576 2023-10-08T12:08:18.246 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T12:08:18.251 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:08:18.270 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T12:08:18.270 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/577) 2023-10-08T12:08:18.593 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T12:08:18.602 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T12:08:18.602 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:08:18.859 INFO:teuthology.orchestra.run.smithi032.stdout:generic/577 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T12:08:18.867 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/577 2023-10-08T12:08:18.867 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/577 2023-10-08T12:08:18.867 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T12:08:18.873 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:08:18.891 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T12:08:18.891 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/578) 2023-10-08T12:08:19.215 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T12:08:19.224 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T12:08:19.225 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:08:19.567 INFO:teuthology.orchestra.run.smithi032.stdout:generic/578 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-10-08T12:08:19.576 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/578 2023-10-08T12:08:19.576 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/578 2023-10-08T12:08:19.576 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T12:08:19.582 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:08:19.600 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T12:08:19.600 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/579) 2023-10-08T12:08:19.930 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T12:08:19.940 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T12:08:19.940 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:08:20.197 INFO:teuthology.orchestra.run.smithi032.stdout:generic/579 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T12:08:20.206 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/579 2023-10-08T12:08:20.206 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/579 2023-10-08T12:08:20.207 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T12:08:20.212 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:08:20.230 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T12:08:20.230 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/580) 2023-10-08T12:08:20.560 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T12:08:20.570 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T12:08:20.570 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:08:20.888 INFO:teuthology.orchestra.run.smithi032.stdout:generic/580 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T12:08:20.896 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/580 2023-10-08T12:08:20.897 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/580 2023-10-08T12:08:20.897 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T12:08:20.902 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:08:20.919 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T12:08:20.920 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/581) 2023-10-08T12:08:21.247 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T12:08:21.255 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T12:08:21.255 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:08:21.934 INFO:teuthology.orchestra.run.smithi032.stdout:generic/581 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T12:08:21.940 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/581 2023-10-08T12:08:21.941 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/581 2023-10-08T12:08:21.941 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T12:08:21.945 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:08:21.962 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T12:08:21.962 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/582) 2023-10-08T12:08:22.274 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T12:08:22.283 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T12:08:22.283 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:08:22.611 INFO:teuthology.orchestra.run.smithi032.stdout:generic/582 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T12:08:22.620 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/582 2023-10-08T12:08:22.620 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/582 2023-10-08T12:08:22.620 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T12:08:22.626 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:08:22.644 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T12:08:22.645 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/583) 2023-10-08T12:08:22.965 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T12:08:22.974 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T12:08:22.974 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:08:23.300 INFO:teuthology.orchestra.run.smithi032.stdout:generic/583 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T12:08:23.309 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/583 2023-10-08T12:08:23.309 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/583 2023-10-08T12:08:23.309 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T12:08:23.314 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:08:23.330 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T12:08:23.330 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/584) 2023-10-08T12:08:23.667 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T12:08:23.678 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T12:08:23.678 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:08:24.002 INFO:teuthology.orchestra.run.smithi032.stdout:generic/584 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T12:08:24.011 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/584 2023-10-08T12:08:24.011 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/584 2023-10-08T12:08:24.011 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T12:08:24.017 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:08:24.034 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T12:08:24.034 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/585) 2023-10-08T12:08:24.357 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T12:08:24.367 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T12:08:24.367 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:08:24.624 INFO:teuthology.orchestra.run.smithi032.stdout:generic/585 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T12:08:24.633 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/585 2023-10-08T12:08:24.633 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/585 2023-10-08T12:08:24.633 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T12:08:24.639 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:08:24.657 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T12:08:24.657 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/586) 2023-10-08T12:08:24.980 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T12:08:24.990 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T12:08:24.990 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:08:27.597 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:08:27.600 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:08:57.672 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:08:57.675 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:09:01.011 INFO:teuthology.orchestra.run.smithi032.stdout:generic/586 36s 2023-10-08T12:09:01.023 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/586 2023-10-08T12:09:01.023 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T12:09:01.029 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:09:01.046 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T12:09:01.046 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/587) 2023-10-08T12:09:01.368 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T12:09:01.378 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T12:09:01.378 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:09:01.745 INFO:teuthology.orchestra.run.smithi032.stdout:generic/587 [not run] disk quotas not supported by this filesystem type: ceph-fuse 2023-10-08T12:09:01.750 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/587 2023-10-08T12:09:01.751 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/587 2023-10-08T12:09:01.751 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T12:09:01.755 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:09:01.770 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T12:09:01.771 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/588) 2023-10-08T12:09:02.094 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T12:09:02.104 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T12:09:02.104 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:09:02.386 INFO:teuthology.orchestra.run.smithi032.stdout:generic/588 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T12:09:02.394 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/588 2023-10-08T12:09:02.395 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/588 2023-10-08T12:09:02.395 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T12:09:02.401 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:09:02.419 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T12:09:02.420 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/589) 2023-10-08T12:09:02.742 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T12:09:02.753 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T12:09:02.753 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:09:03.016 INFO:teuthology.orchestra.run.smithi032.stdout:generic/589 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T12:09:03.025 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/589 2023-10-08T12:09:03.025 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/589 2023-10-08T12:09:03.025 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T12:09:03.031 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:09:03.047 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T12:09:03.048 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/590) 2023-10-08T12:09:03.378 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T12:09:03.389 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T12:09:03.389 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:09:03.644 INFO:teuthology.orchestra.run.smithi032.stdout:generic/590 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T12:09:03.653 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/590 2023-10-08T12:09:03.653 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/590 2023-10-08T12:09:03.653 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T12:09:03.658 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:09:03.676 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T12:09:03.676 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/591) 2023-10-08T12:09:04.011 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T12:09:04.021 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T12:09:04.021 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:09:04.588 INFO:teuthology.orchestra.run.smithi032.stdout:generic/591 0s 2023-10-08T12:09:04.601 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/591 2023-10-08T12:09:04.601 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T12:09:04.607 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:09:04.620 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T12:09:04.620 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/592) 2023-10-08T12:09:04.942 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T12:09:04.952 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T12:09:04.952 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:09:05.269 INFO:teuthology.orchestra.run.smithi032.stdout:generic/592 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T12:09:05.278 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/592 2023-10-08T12:09:05.278 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/592 2023-10-08T12:09:05.278 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T12:09:05.284 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:09:05.304 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T12:09:05.304 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/593) 2023-10-08T12:09:05.630 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T12:09:05.639 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T12:09:05.639 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:09:05.947 INFO:teuthology.orchestra.run.smithi032.stdout:generic/593 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T12:09:05.954 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/593 2023-10-08T12:09:05.954 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/593 2023-10-08T12:09:05.954 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T12:09:05.959 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:09:05.975 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T12:09:05.975 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/594) 2023-10-08T12:09:06.314 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T12:09:06.323 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T12:09:06.323 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:09:06.572 INFO:teuthology.orchestra.run.smithi032.stdout:generic/594 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T12:09:06.580 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/594 2023-10-08T12:09:06.581 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/594 2023-10-08T12:09:06.581 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T12:09:06.586 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:09:06.603 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T12:09:06.603 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/595) 2023-10-08T12:09:06.924 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T12:09:06.934 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T12:09:06.934 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:09:07.256 INFO:teuthology.orchestra.run.smithi032.stdout:generic/595 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T12:09:07.266 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/595 2023-10-08T12:09:07.266 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/595 2023-10-08T12:09:07.266 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T12:09:07.272 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:09:07.290 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T12:09:07.290 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/596) 2023-10-08T12:09:07.609 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T12:09:07.618 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T12:09:07.619 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:09:07.875 INFO:teuthology.orchestra.run.smithi032.stdout:generic/596 [not run] accton utility required, skipped this test 2023-10-08T12:09:07.884 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/596 2023-10-08T12:09:07.885 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/596 2023-10-08T12:09:07.885 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T12:09:07.890 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:09:07.907 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T12:09:07.907 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/597) 2023-10-08T12:09:08.228 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T12:09:08.239 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T12:09:08.239 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:09:09.075 INFO:teuthology.orchestra.run.smithi032.stdout:generic/597 - output mismatch (see /tmp/tmp.p8vAuQqzIgxfstests-dev/results//generic/597.out.bad) 2023-10-08T12:09:09.079 INFO:teuthology.orchestra.run.smithi032.stdout: --- tests/generic/597.out 2023-10-08 06:10:44.435318453 +0000 2023-10-08T12:09:09.079 INFO:teuthology.orchestra.run.smithi032.stdout: +++ /tmp/tmp.p8vAuQqzIgxfstests-dev/results//generic/597.out.bad 2023-10-08 12:09:09.070820284 +0000 2023-10-08T12:09:09.079 INFO:teuthology.orchestra.run.smithi032.stdout: @@ -4,11 +4,11 @@ 2023-10-08T12:09:09.080 INFO:teuthology.orchestra.run.smithi032.stdout: fs.protected_symlinks = 0 2023-10-08T12:09:09.080 INFO:teuthology.orchestra.run.smithi032.stdout: successfully followed symlink 2023-10-08T12:09:09.080 INFO:teuthology.orchestra.run.smithi032.stdout: fs.protected_symlinks = 1 2023-10-08T12:09:09.080 INFO:teuthology.orchestra.run.smithi032.stdout: -Permission denied 2023-10-08T12:09:09.080 INFO:teuthology.orchestra.run.smithi032.stdout: +successfully followed symlink 2023-10-08T12:09:09.080 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:09:09.080 INFO:teuthology.orchestra.run.smithi032.stdout: == Test hardlink create protection when 2023-10-08T12:09:09.080 INFO:teuthology.orchestra.run.smithi032.stdout: == process != target owner and process cannot read target 2023-10-08T12:09:09.080 INFO:teuthology.orchestra.run.smithi032.stdout: fs.protected_hardlinks = 0 2023-10-08T12:09:09.081 INFO:teuthology.orchestra.run.smithi032.stdout: -successfully created hardlink 2023-10-08T12:09:09.081 INFO:teuthology.orchestra.run.smithi032.stdout: +Permission denied 2023-10-08T12:09:09.081 INFO:teuthology.orchestra.run.smithi032.stdout: fs.protected_hardlinks = 1 2023-10-08T12:09:09.081 INFO:teuthology.orchestra.run.smithi032.stdout: -ln: failed to create hard link 'TEST_DIR/597/sticky_dir/hardlink' => 'TEST_DIR/597/target': Operation not permitted 2023-10-08T12:09:09.081 INFO:teuthology.orchestra.run.smithi032.stdout: +Permission denied 2023-10-08T12:09:09.084 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/597 2023-10-08T12:09:09.084 INFO:teuthology.orchestra.run.smithi032.stdout:Failures: generic/597 2023-10-08T12:09:09.084 INFO:teuthology.orchestra.run.smithi032.stdout:Failed 1 of 1 tests 2023-10-08T12:09:09.089 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:09:09.107 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T12:09:09.108 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-10-08T12:09:09.108 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-10-08T12:09:09.108 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/598) 2023-10-08T12:09:09.423 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T12:09:09.432 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T12:09:09.432 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:09:10.355 INFO:teuthology.orchestra.run.smithi032.stdout:generic/598 - output mismatch (see /tmp/tmp.p8vAuQqzIgxfstests-dev/results//generic/598.out.bad) 2023-10-08T12:09:10.360 INFO:teuthology.orchestra.run.smithi032.stdout: --- tests/generic/598.out 2023-10-08 06:10:44.435318453 +0000 2023-10-08T12:09:10.360 INFO:teuthology.orchestra.run.smithi032.stdout: +++ /tmp/tmp.p8vAuQqzIgxfstests-dev/results//generic/598.out.bad 2023-10-08 12:09:10.350794853 +0000 2023-10-08T12:09:10.360 INFO:teuthology.orchestra.run.smithi032.stdout: @@ -5,13 +5,10 @@ 2023-10-08T12:09:10.360 INFO:teuthology.orchestra.run.smithi032.stdout: = only group writable dir 2023-10-08T12:09:10.360 INFO:teuthology.orchestra.run.smithi032.stdout: fs.protected_regular = 1 2023-10-08T12:09:10.360 INFO:teuthology.orchestra.run.smithi032.stdout: = group & world writable dir 2023-10-08T12:09:10.360 INFO:teuthology.orchestra.run.smithi032.stdout: -Permission denied 2023-10-08T12:09:10.361 INFO:teuthology.orchestra.run.smithi032.stdout: = only group writable dir 2023-10-08T12:09:10.361 INFO:teuthology.orchestra.run.smithi032.stdout: fs.protected_regular = 2 2023-10-08T12:09:10.361 INFO:teuthology.orchestra.run.smithi032.stdout: = group & world writable dir 2023-10-08T12:09:10.361 INFO:teuthology.orchestra.run.smithi032.stdout: -Permission denied 2023-10-08T12:09:10.361 INFO:teuthology.orchestra.run.smithi032.stdout: = only group writable dir 2023-10-08T12:09:10.361 INFO:teuthology.orchestra.run.smithi032.stdout: -Permission denied 2023-10-08T12:09:10.361 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:09:10.361 INFO:teuthology.orchestra.run.smithi032.stdout: == Test fifo open when owned by another and fifo owner != dir owner 2023-10-08T12:09:10.361 INFO:teuthology.orchestra.run.smithi032.stdout: fs.protected_fifos = 0 2023-10-08T12:09:10.361 INFO:teuthology.orchestra.run.smithi032.stdout: @@ -19,10 +16,7 @@ 2023-10-08T12:09:10.361 INFO:teuthology.orchestra.run.smithi032.stdout: = only group writable dir 2023-10-08T12:09:10.362 INFO:teuthology.orchestra.run.smithi032.stdout: fs.protected_fifos = 1 2023-10-08T12:09:10.362 INFO:teuthology.orchestra.run.smithi032.stdout: = group & world writable dir 2023-10-08T12:09:10.362 INFO:teuthology.orchestra.run.smithi032.stdout: -Permission denied 2023-10-08T12:09:10.362 INFO:teuthology.orchestra.run.smithi032.stdout: = only group writable dir 2023-10-08T12:09:10.362 INFO:teuthology.orchestra.run.smithi032.stdout: fs.protected_fifos = 2 2023-10-08T12:09:10.362 INFO:teuthology.orchestra.run.smithi032.stdout: = group & world writable dir 2023-10-08T12:09:10.362 INFO:teuthology.orchestra.run.smithi032.stdout: -Permission denied 2023-10-08T12:09:10.362 INFO:teuthology.orchestra.run.smithi032.stdout: = only group writable dir 2023-10-08T12:09:10.362 INFO:teuthology.orchestra.run.smithi032.stdout: -Permission denied 2023-10-08T12:09:10.368 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/598 2023-10-08T12:09:10.368 INFO:teuthology.orchestra.run.smithi032.stdout:Failures: generic/598 2023-10-08T12:09:10.368 INFO:teuthology.orchestra.run.smithi032.stdout:Failed 1 of 1 tests 2023-10-08T12:09:10.373 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:09:10.389 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T12:09:10.390 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-10-08T12:09:10.390 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-10-08T12:09:10.391 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/599) 2023-10-08T12:09:10.699 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T12:09:10.705 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T12:09:10.706 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:09:10.953 INFO:teuthology.orchestra.run.smithi032.stdout:generic/599 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T12:09:10.962 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/599 2023-10-08T12:09:10.962 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/599 2023-10-08T12:09:10.962 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T12:09:10.968 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:09:10.987 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T12:09:10.987 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/600) 2023-10-08T12:09:11.316 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T12:09:11.325 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T12:09:11.325 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:09:11.575 INFO:teuthology.orchestra.run.smithi032.stdout:generic/600 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T12:09:11.583 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/600 2023-10-08T12:09:11.583 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/600 2023-10-08T12:09:11.583 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T12:09:11.588 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:09:11.607 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T12:09:11.607 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/601) 2023-10-08T12:09:11.931 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T12:09:11.941 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T12:09:11.941 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:09:12.193 INFO:teuthology.orchestra.run.smithi032.stdout:generic/601 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T12:09:12.202 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/601 2023-10-08T12:09:12.202 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/601 2023-10-08T12:09:12.202 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T12:09:12.208 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:09:12.226 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T12:09:12.226 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/602) 2023-10-08T12:09:12.556 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T12:09:12.567 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T12:09:12.567 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:09:12.884 INFO:teuthology.orchestra.run.smithi032.stdout:generic/602 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T12:09:12.894 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/602 2023-10-08T12:09:12.894 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/602 2023-10-08T12:09:12.894 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T12:09:12.900 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:09:12.916 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T12:09:12.916 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/603) 2023-10-08T12:09:13.241 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T12:09:13.250 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T12:09:13.250 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:09:13.509 INFO:teuthology.orchestra.run.smithi032.stdout:generic/603 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T12:09:13.517 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/603 2023-10-08T12:09:13.517 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/603 2023-10-08T12:09:13.517 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T12:09:13.523 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:09:13.542 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T12:09:13.542 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/604) 2023-10-08T12:09:13.869 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T12:09:13.878 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T12:09:13.878 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:09:14.129 INFO:teuthology.orchestra.run.smithi032.stdout:generic/604 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T12:09:14.137 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/604 2023-10-08T12:09:14.137 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/604 2023-10-08T12:09:14.137 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T12:09:14.143 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:09:14.162 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T12:09:14.162 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/605) 2023-10-08T12:09:14.487 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T12:09:14.497 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T12:09:14.497 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:09:14.746 INFO:teuthology.orchestra.run.smithi032.stdout:generic/605 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T12:09:14.754 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/605 2023-10-08T12:09:14.754 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/605 2023-10-08T12:09:14.755 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T12:09:14.761 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:09:14.777 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T12:09:14.778 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/606) 2023-10-08T12:09:15.103 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T12:09:15.112 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T12:09:15.113 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:09:15.368 INFO:teuthology.orchestra.run.smithi032.stdout:generic/606 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T12:09:15.377 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/606 2023-10-08T12:09:15.377 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/606 2023-10-08T12:09:15.377 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T12:09:15.383 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:09:15.400 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T12:09:15.400 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/607) 2023-10-08T12:09:15.720 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T12:09:15.730 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T12:09:15.730 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:09:15.990 INFO:teuthology.orchestra.run.smithi032.stdout:generic/607 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T12:09:15.998 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/607 2023-10-08T12:09:15.999 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/607 2023-10-08T12:09:15.999 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T12:09:16.003 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:09:16.019 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T12:09:16.019 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/608) 2023-10-08T12:09:16.344 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T12:09:16.353 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T12:09:16.354 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:09:16.612 INFO:teuthology.orchestra.run.smithi032.stdout:generic/608 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T12:09:16.621 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/608 2023-10-08T12:09:16.623 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/608 2023-10-08T12:09:16.623 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T12:09:16.627 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:09:16.647 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T12:09:16.647 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/609) 2023-10-08T12:09:16.982 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T12:09:16.991 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T12:09:16.991 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:09:17.826 INFO:teuthology.orchestra.run.smithi032.stdout:generic/609 0s 2023-10-08T12:09:17.839 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/609 2023-10-08T12:09:17.841 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T12:09:17.846 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:09:17.862 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T12:09:17.863 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/610) 2023-10-08T12:09:18.189 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T12:09:18.198 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T12:09:18.198 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:09:18.450 INFO:teuthology.orchestra.run.smithi032.stdout:generic/610 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T12:09:18.459 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/610 2023-10-08T12:09:18.459 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/610 2023-10-08T12:09:18.459 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T12:09:18.464 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:09:18.482 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T12:09:18.482 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/611) 2023-10-08T12:09:18.810 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T12:09:18.820 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T12:09:18.821 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:09:19.071 INFO:teuthology.orchestra.run.smithi032.stdout:generic/611 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T12:09:19.080 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/611 2023-10-08T12:09:19.080 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/611 2023-10-08T12:09:19.080 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T12:09:19.085 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:09:19.104 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T12:09:19.104 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/612) 2023-10-08T12:09:19.432 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T12:09:19.442 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T12:09:19.442 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:09:19.830 INFO:teuthology.orchestra.run.smithi032.stdout:generic/612 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-10-08T12:09:19.839 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/612 2023-10-08T12:09:19.839 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/612 2023-10-08T12:09:19.839 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T12:09:19.843 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:09:19.854 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T12:09:19.854 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/613) 2023-10-08T12:09:20.159 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T12:09:20.169 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T12:09:20.169 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:09:20.482 INFO:teuthology.orchestra.run.smithi032.stdout:generic/613 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T12:09:20.489 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/613 2023-10-08T12:09:20.489 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/613 2023-10-08T12:09:20.490 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T12:09:20.494 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:09:20.510 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T12:09:20.511 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/614) 2023-10-08T12:09:20.816 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T12:09:20.825 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T12:09:20.825 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:09:21.088 INFO:teuthology.orchestra.run.smithi032.stdout:generic/614 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T12:09:21.097 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/614 2023-10-08T12:09:21.098 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/614 2023-10-08T12:09:21.098 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T12:09:21.105 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:09:21.122 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T12:09:21.122 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/615) 2023-10-08T12:09:21.461 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T12:09:21.471 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T12:09:21.471 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:09:21.714 INFO:teuthology.orchestra.run.smithi032.stdout:generic/615 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T12:09:21.723 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/615 2023-10-08T12:09:21.723 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/615 2023-10-08T12:09:21.724 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T12:09:21.730 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:09:21.746 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T12:09:21.746 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/616) 2023-10-08T12:09:22.073 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T12:09:22.083 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T12:09:22.083 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:09:22.342 INFO:teuthology.orchestra.run.smithi032.stdout:generic/616 [not run] kernel does not support IO_URING 2023-10-08T12:09:22.351 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/616 2023-10-08T12:09:22.351 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/616 2023-10-08T12:09:22.352 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T12:09:22.357 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:09:22.377 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T12:09:22.378 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/617) 2023-10-08T12:09:22.697 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T12:09:22.707 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T12:09:22.707 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:09:23.061 INFO:teuthology.orchestra.run.smithi032.stdout:generic/617 [not run] kernel does not support IO_URING 2023-10-08T12:09:23.071 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/617 2023-10-08T12:09:23.071 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/617 2023-10-08T12:09:23.071 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T12:09:23.077 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:09:23.095 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T12:09:23.096 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/618) 2023-10-08T12:09:23.419 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T12:09:23.427 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T12:09:23.428 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:09:23.676 INFO:teuthology.orchestra.run.smithi032.stdout:generic/618 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T12:09:23.683 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/618 2023-10-08T12:09:23.684 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/618 2023-10-08T12:09:23.684 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T12:09:23.689 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:09:23.719 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T12:09:23.719 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/619) 2023-10-08T12:09:24.047 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T12:09:24.056 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T12:09:24.057 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:09:24.308 INFO:teuthology.orchestra.run.smithi032.stdout:generic/619 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T12:09:24.316 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/619 2023-10-08T12:09:24.317 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/619 2023-10-08T12:09:24.317 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T12:09:24.321 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:09:24.339 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T12:09:24.339 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/620) 2023-10-08T12:09:24.666 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T12:09:24.675 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T12:09:24.676 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:09:24.986 INFO:teuthology.orchestra.run.smithi032.stdout:generic/620 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T12:09:24.996 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/620 2023-10-08T12:09:24.996 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/620 2023-10-08T12:09:24.996 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T12:09:25.002 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:09:25.018 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T12:09:25.018 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/621) 2023-10-08T12:09:25.351 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T12:09:25.360 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T12:09:25.360 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:09:25.683 INFO:teuthology.orchestra.run.smithi032.stdout:generic/621 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T12:09:25.692 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/621 2023-10-08T12:09:25.693 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/621 2023-10-08T12:09:25.693 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T12:09:25.698 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:09:25.716 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T12:09:25.716 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/622) 2023-10-08T12:09:26.033 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T12:09:26.041 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T12:09:26.041 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:09:26.300 INFO:teuthology.orchestra.run.smithi032.stdout:generic/622 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T12:09:26.309 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/622 2023-10-08T12:09:26.309 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/622 2023-10-08T12:09:26.309 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T12:09:26.315 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:09:26.334 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T12:09:26.334 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/623) 2023-10-08T12:09:26.666 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T12:09:26.675 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T12:09:26.676 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:09:26.929 INFO:teuthology.orchestra.run.smithi032.stdout:generic/623 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T12:09:26.937 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/623 2023-10-08T12:09:26.937 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/623 2023-10-08T12:09:26.938 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T12:09:26.943 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:09:26.961 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T12:09:26.962 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/624) 2023-10-08T12:09:27.279 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T12:09:27.288 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T12:09:27.289 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:09:27.534 INFO:teuthology.orchestra.run.smithi032.stdout:generic/624 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T12:09:27.543 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/624 2023-10-08T12:09:27.544 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/624 2023-10-08T12:09:27.544 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T12:09:27.549 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:09:27.567 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T12:09:27.568 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/625) 2023-10-08T12:09:27.730 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:09:27.733 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:09:27.888 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T12:09:27.898 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T12:09:27.898 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:09:28.147 INFO:teuthology.orchestra.run.smithi032.stdout:generic/625 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T12:09:28.155 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/625 2023-10-08T12:09:28.155 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/625 2023-10-08T12:09:28.155 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T12:09:28.159 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:09:28.177 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T12:09:28.177 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/626) 2023-10-08T12:09:28.511 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T12:09:28.521 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T12:09:28.522 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:09:28.814 INFO:teuthology.orchestra.run.smithi032.stdout:generic/626 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T12:09:28.822 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/626 2023-10-08T12:09:28.822 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/626 2023-10-08T12:09:28.822 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T12:09:28.827 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:09:28.842 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T12:09:28.843 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/627) 2023-10-08T12:09:29.166 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T12:09:29.174 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T12:09:29.175 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:09:29.428 INFO:teuthology.orchestra.run.smithi032.stdout:generic/627 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T12:09:29.437 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/627 2023-10-08T12:09:29.437 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/627 2023-10-08T12:09:29.438 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T12:09:29.443 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:09:29.462 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T12:09:29.462 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/628) 2023-10-08T12:09:29.795 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T12:09:29.804 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T12:09:29.804 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:09:30.110 INFO:teuthology.orchestra.run.smithi032.stdout:generic/628 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T12:09:30.119 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/628 2023-10-08T12:09:30.119 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/628 2023-10-08T12:09:30.119 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T12:09:30.125 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:09:30.144 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T12:09:30.144 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/629) 2023-10-08T12:09:30.477 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T12:09:30.485 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T12:09:30.485 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:09:30.769 INFO:teuthology.orchestra.run.smithi032.stdout:generic/629 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T12:09:30.778 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/629 2023-10-08T12:09:30.778 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/629 2023-10-08T12:09:30.778 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T12:09:30.784 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:09:30.800 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T12:09:30.800 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/630) 2023-10-08T12:09:31.133 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T12:09:31.143 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T12:09:31.143 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:09:31.388 INFO:teuthology.orchestra.run.smithi032.stdout:generic/630 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T12:09:31.397 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/630 2023-10-08T12:09:31.397 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/630 2023-10-08T12:09:31.397 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T12:09:31.402 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:09:31.421 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T12:09:31.421 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/631) 2023-10-08T12:09:31.749 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T12:09:31.758 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T12:09:31.758 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:09:32.006 INFO:teuthology.orchestra.run.smithi032.stdout:generic/631 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T12:09:32.015 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/631 2023-10-08T12:09:32.015 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/631 2023-10-08T12:09:32.015 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T12:09:32.021 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:09:32.039 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T12:09:32.039 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/632) 2023-10-08T12:09:32.366 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T12:09:32.375 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T12:09:32.375 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:09:36.422 INFO:teuthology.orchestra.run.smithi032.stdout:generic/632 4s 2023-10-08T12:09:36.434 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/632 2023-10-08T12:09:36.434 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T12:09:36.439 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:09:36.454 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T12:09:36.455 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/633) 2023-10-08T12:09:36.766 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T12:09:36.776 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T12:09:36.777 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:09:37.544 INFO:teuthology.orchestra.run.smithi032.stdout:generic/633 [failed, exit status 1]- output mismatch (see /tmp/tmp.p8vAuQqzIgxfstests-dev/results//generic/633.out.bad) 2023-10-08T12:09:37.549 INFO:teuthology.orchestra.run.smithi032.stdout: --- tests/generic/633.out 2023-10-08 06:10:44.435318453 +0000 2023-10-08T12:09:37.549 INFO:teuthology.orchestra.run.smithi032.stdout: +++ /tmp/tmp.p8vAuQqzIgxfstests-dev/results//generic/633.out.bad 2023-10-08 12:09:37.538254686 +0000 2023-10-08T12:09:37.550 INFO:teuthology.orchestra.run.smithi032.stdout: @@ -1,2 +1,3 @@ 2023-10-08T12:09:37.550 INFO:teuthology.orchestra.run.smithi032.stdout: QA output created by 633 2023-10-08T12:09:37.550 INFO:teuthology.orchestra.run.smithi032.stdout: Silence is golden 2023-10-08T12:09:37.550 INFO:teuthology.orchestra.run.smithi032.stdout: +vfstest.c: 2418: run_test - Success - failure: setid binaries on regular mounts 2023-10-08T12:09:37.556 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/633 2023-10-08T12:09:37.556 INFO:teuthology.orchestra.run.smithi032.stdout:Failures: generic/633 2023-10-08T12:09:37.557 INFO:teuthology.orchestra.run.smithi032.stdout:Failed 1 of 1 tests 2023-10-08T12:09:37.561 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:09:37.573 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T12:09:37.574 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-10-08T12:09:37.574 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-10-08T12:09:37.574 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/634) 2023-10-08T12:09:37.908 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T12:09:37.918 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T12:09:37.918 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:09:38.155 INFO:teuthology.orchestra.run.smithi032.stdout:generic/634 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T12:09:38.163 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/634 2023-10-08T12:09:38.164 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/634 2023-10-08T12:09:38.164 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T12:09:38.170 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:09:38.187 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T12:09:38.187 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/635) 2023-10-08T12:09:38.508 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T12:09:38.516 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T12:09:38.516 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:09:38.761 INFO:teuthology.orchestra.run.smithi032.stdout:generic/635 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T12:09:38.769 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/635 2023-10-08T12:09:38.770 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/635 2023-10-08T12:09:38.770 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T12:09:38.775 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:09:38.794 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T12:09:38.794 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/636) 2023-10-08T12:09:39.120 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T12:09:39.129 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T12:09:39.129 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:09:39.385 INFO:teuthology.orchestra.run.smithi032.stdout:generic/636 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T12:09:39.394 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/636 2023-10-08T12:09:39.394 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/636 2023-10-08T12:09:39.394 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T12:09:39.400 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:09:39.417 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T12:09:39.417 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/637) 2023-10-08T12:09:39.740 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T12:09:39.749 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T12:09:39.749 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:09:42.258 INFO:teuthology.orchestra.run.smithi032.stdout:generic/637 3s 2023-10-08T12:09:42.270 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/637 2023-10-08T12:09:42.270 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T12:09:42.275 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:09:42.293 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T12:09:42.294 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/638) 2023-10-08T12:09:42.608 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T12:09:42.617 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T12:09:42.617 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:09:42.949 INFO:teuthology.orchestra.run.smithi032.stdout:generic/638 0s 2023-10-08T12:09:42.960 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/638 2023-10-08T12:09:42.960 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T12:09:42.966 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:09:42.981 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T12:09:42.982 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/639) 2023-10-08T12:09:43.311 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T12:09:43.320 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T12:09:43.320 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:09:45.020 INFO:teuthology.orchestra.run.smithi032.stdout:generic/639 2s 2023-10-08T12:09:45.033 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/639 2023-10-08T12:09:45.033 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T12:09:45.039 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:09:45.058 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T12:09:45.058 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/640) 2023-10-08T12:09:45.384 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T12:09:45.394 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T12:09:45.394 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:09:45.657 INFO:teuthology.orchestra.run.smithi032.stdout:generic/640 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T12:09:45.665 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/640 2023-10-08T12:09:45.665 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/640 2023-10-08T12:09:45.665 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T12:09:45.671 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:09:45.687 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T12:09:45.688 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/641) 2023-10-08T12:09:46.016 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T12:09:46.026 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T12:09:46.026 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:09:46.284 INFO:teuthology.orchestra.run.smithi032.stdout:generic/641 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T12:09:46.292 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/641 2023-10-08T12:09:46.292 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/641 2023-10-08T12:09:46.292 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T12:09:46.297 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:09:46.315 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T12:09:46.315 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/642) 2023-10-08T12:09:46.639 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T12:09:46.650 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T12:09:46.650 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:09:46.910 INFO:teuthology.orchestra.run.smithi032.stdout:generic/642 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T12:09:46.918 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/642 2023-10-08T12:09:46.918 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/642 2023-10-08T12:09:46.918 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T12:09:46.924 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:09:46.943 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T12:09:46.943 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/643) 2023-10-08T12:09:47.262 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T12:09:47.271 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T12:09:47.271 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:09:47.524 INFO:teuthology.orchestra.run.smithi032.stdout:generic/643 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T12:09:47.533 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/643 2023-10-08T12:09:47.533 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/643 2023-10-08T12:09:47.533 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T12:09:47.539 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:09:47.558 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T12:09:47.558 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/644) 2023-10-08T12:09:47.891 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T12:09:47.899 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T12:09:47.900 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:09:48.149 INFO:teuthology.orchestra.run.smithi032.stdout:generic/644 [not run] kernel does not support mount_setattr syscall 2023-10-08T12:09:48.157 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/644 2023-10-08T12:09:48.157 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/644 2023-10-08T12:09:48.157 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T12:09:48.165 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:09:48.180 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T12:09:48.180 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/645) 2023-10-08T12:09:48.507 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T12:09:48.516 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T12:09:48.516 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:09:48.769 INFO:teuthology.orchestra.run.smithi032.stdout:generic/645 [not run] kernel does not support mount_setattr syscall 2023-10-08T12:09:48.777 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/645 2023-10-08T12:09:48.778 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/645 2023-10-08T12:09:48.778 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T12:09:48.784 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:09:48.803 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T12:09:48.804 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/646) 2023-10-08T12:09:49.124 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T12:09:49.134 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T12:09:49.135 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:09:49.390 INFO:teuthology.orchestra.run.smithi032.stdout:generic/646 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T12:09:49.398 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/646 2023-10-08T12:09:49.398 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/646 2023-10-08T12:09:49.398 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T12:09:49.404 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:09:49.423 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T12:09:49.423 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/647) 2023-10-08T12:09:49.753 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T12:09:49.763 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T12:09:49.763 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:09:50.354 INFO:teuthology.orchestra.run.smithi032.stdout:generic/647 1s 2023-10-08T12:09:50.369 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/647 2023-10-08T12:09:50.369 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T12:09:50.373 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:09:50.387 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T12:09:50.387 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/648) 2023-10-08T12:09:50.710 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T12:09:50.717 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T12:09:50.717 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:09:50.994 INFO:teuthology.orchestra.run.smithi032.stdout:generic/648 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T12:09:51.003 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/648 2023-10-08T12:09:51.003 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/648 2023-10-08T12:09:51.003 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T12:09:51.009 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:09:51.030 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T12:09:51.030 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/649) 2023-10-08T12:09:51.367 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T12:09:51.376 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T12:09:51.376 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:09:51.755 INFO:teuthology.orchestra.run.smithi032.stdout:generic/649 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-10-08T12:09:51.763 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/649 2023-10-08T12:09:51.763 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/649 2023-10-08T12:09:51.764 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T12:09:51.769 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:09:51.787 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T12:09:51.788 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/650) 2023-10-08T12:09:52.116 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T12:09:52.126 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T12:09:52.126 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T12:09:57.784 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:09:57.786 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:10:27.962 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:10:27.964 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:10:28.091 INFO:tasks.ceph.osd.0.smithi032.stderr:2023-10-08T12:10:28.085+0000 7f519f0f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 432839) UID: 0 2023-10-08T12:10:28.091 INFO:tasks.ceph.osd.1.smithi032.stderr:2023-10-08T12:10:28.089+0000 7efe8aecf700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 432839) UID: 0 2023-10-08T12:10:28.092 INFO:tasks.ceph.osd.2.smithi032.stderr:2023-10-08T12:10:28.089+0000 7fe8a3511700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 432839) UID: 0 2023-10-08T12:10:28.094 INFO:tasks.ceph.osd.3.smithi032.stderr:2023-10-08T12:10:28.089+0000 7ff6419ae700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 432839) UID: 0 2023-10-08T12:16:10.108 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:16:10.110 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:16:40.190 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:16:40.192 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:17:10.322 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:17:10.325 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:17:40.409 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:17:40.412 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:18:10.528 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:18:10.530 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:18:40.568 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:18:40.571 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:19:10.728 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:19:10.731 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:19:40.942 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:19:40.945 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:20:11.144 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:20:11.147 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:20:41.201 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:20:41.204 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:21:11.514 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:21:11.517 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:21:41.733 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:21:41.735 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:22:11.825 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:22:11.828 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:22:42.031 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:22:42.033 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:22:42.059 INFO:tasks.ceph.mds.d.smithi040.stderr:2023-10-08T12:22:42.055+0000 7fa77bedd700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 45242) UID: 0 2023-10-08T12:22:42.060 INFO:tasks.ceph.mds.b.smithi040.stderr:2023-10-08T12:22:42.055+0000 7f4c7640d700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 45242) UID: 0 2023-10-08T12:26:07.362 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:26:07.365 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:26:07.436 INFO:tasks.ceph.osd.0.smithi032.stderr:2023-10-08T12:26:07.430+0000 7f519f0f9700 -1 Fail to open '/proc/435436/cmdline' error = (2) No such file or directory 2023-10-08T12:26:07.436 INFO:tasks.ceph.osd.0.smithi032.stderr:2023-10-08T12:26:07.430+0000 7f519f0f9700 -1 received signal: Hangup from (PID: 435436) UID: 0 2023-10-08T12:26:07.436 INFO:tasks.ceph.osd.2.smithi032.stderr:2023-10-08T12:26:07.434+0000 7fe8a3511700 -1 Fail to open '/proc/435436/cmdline' error = (2) No such file or directory 2023-10-08T12:26:07.437 INFO:tasks.ceph.osd.2.smithi032.stderr:2023-10-08T12:26:07.434+0000 7fe8a3511700 -1 received signal: Hangup from (PID: 435436) UID: 0 2023-10-08T12:26:07.437 INFO:tasks.ceph.osd.3.smithi032.stderr:2023-10-08T12:26:07.434+0000 7ff6419ae700 -1 Fail to open '/proc/435436/cmdline' error = (2) No such file or directory 2023-10-08T12:26:07.437 INFO:tasks.ceph.osd.3.smithi032.stderr:2023-10-08T12:26:07.434+0000 7ff6419ae700 -1 received signal: Hangup from (PID: 435436) UID: 0 2023-10-08T12:26:07.439 INFO:tasks.ceph.osd.1.smithi032.stderr:2023-10-08T12:26:07.434+0000 7efe8aecf700 -1 Fail to open '/proc/435436/cmdline' error = (2) No such file or directory 2023-10-08T12:26:07.439 INFO:tasks.ceph.osd.1.smithi032.stderr:2023-10-08T12:26:07.434+0000 7efe8aecf700 -1 received signal: Hangup from (PID: 435436) UID: 0 2023-10-08T12:32:30.097 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:32:30.100 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:32:30.146 INFO:tasks.ceph.osd.1.smithi032.stderr:2023-10-08T12:32:30.142+0000 7efe8aecf700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 436257) UID: 0 2023-10-08T12:32:30.146 INFO:tasks.ceph.osd.0.smithi032.stderr:2023-10-08T12:32:30.142+0000 7f519f0f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 436257) UID: 0 2023-10-08T12:32:30.146 INFO:tasks.ceph.osd.2.smithi032.stderr:2023-10-08T12:32:30.142+0000 7fe8a3511700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 436257) UID: 0 2023-10-08T12:32:30.147 INFO:tasks.ceph.osd.3.smithi032.stderr:2023-10-08T12:32:30.142+0000 7ff6419ae700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 436257) UID: 0 2023-10-08T12:32:30.190 INFO:tasks.ceph.osd.5.smithi040.stderr:2023-10-08T12:32:30.171+0000 7f5dfedf1700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45278) UID: 0 2023-10-08T12:32:30.191 INFO:tasks.ceph.osd.7.smithi040.stderr:2023-10-08T12:32:30.171+0000 7f410cbd5700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45278) UID: 0 2023-10-08T12:32:30.211 INFO:tasks.ceph.osd.6.smithi040.stderr:2023-10-08T12:32:30.171+0000 7f1be92f5700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45278) UID: 0 2023-10-08T12:32:30.212 INFO:tasks.ceph.osd.4.smithi040.stderr:2023-10-08T12:32:30.171+0000 7ff0fd263700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45278) UID: 0 2023-10-08T12:38:06.768 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:38:06.771 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:38:36.853 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:38:36.855 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:39:07.245 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:39:07.248 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:39:37.434 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:39:37.436 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:40:07.576 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:40:07.579 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:40:37.709 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:40:37.711 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:41:07.799 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:41:07.801 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:41:38.102 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:41:38.104 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:41:38.196 INFO:tasks.ceph.mds.d.smithi040.stderr:2023-10-08T12:41:38.192+0000 7fa77bedd700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 45323) UID: 0 2023-10-08T12:41:38.196 INFO:tasks.ceph.mds.b.smithi040.stderr:2023-10-08T12:41:38.192+0000 7f4c7640d700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 45323) UID: 0 2023-10-08T12:44:47.927 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:44:47.930 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:45:18.198 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:45:18.201 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:45:48.659 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:45:48.662 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:46:18.767 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:46:18.769 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:46:48.931 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:46:48.934 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:47:19.112 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:47:19.115 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:47:49.165 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:47:49.167 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:48:19.220 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:48:19.223 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:48:49.279 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:48:49.281 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:49:19.349 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:49:19.352 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:49:49.446 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:49:49.450 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:50:19.565 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:50:19.567 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:50:49.981 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:50:49.985 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:51:20.086 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:51:20.088 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:51:50.333 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:51:50.336 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:52:20.497 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:52:20.500 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:52:50.548 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:52:50.550 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:53:20.817 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:53:20.819 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:53:51.004 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:53:52.673 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:54:23.310 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:54:23.312 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:54:53.882 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:54:53.884 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:55:24.053 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:55:24.057 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:55:54.126 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:55:54.130 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:56:24.216 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:56:24.219 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:56:54.372 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:56:54.375 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:57:24.888 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:57:24.890 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:57:55.099 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:57:55.101 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:58:25.186 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:58:25.189 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:58:55.508 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:58:55.514 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:59:25.644 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:59:25.646 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:59:55.804 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T12:59:55.807 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:00:25.968 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:00:25.971 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:00:26.004 INFO:tasks.ceph.mds.b.smithi040.stderr:2023-10-08T13:00:26.001+0000 7f4c7640d700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 45473) UID: 0 2023-10-08T13:00:26.005 INFO:tasks.ceph.mds.d.smithi040.stderr:2023-10-08T13:00:26.001+0000 7fa77bedd700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 45473) UID: 0 2023-10-08T13:03:49.617 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:03:49.619 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:04:19.848 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:04:19.850 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:04:19.866 INFO:tasks.ceph.osd.4.smithi040.stderr:2023-10-08T13:04:19.858+0000 7ff0fd263700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45494) UID: 0 2023-10-08T13:04:19.867 INFO:tasks.ceph.osd.6.smithi040.stderr:2023-10-08T13:04:19.858+0000 7f1be92f5700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45494) UID: 0 2023-10-08T13:04:19.867 INFO:tasks.ceph.osd.5.smithi040.stderr:2023-10-08T13:04:19.858+0000 7f5dfedf1700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45494) UID: 0 2023-10-08T13:04:19.867 INFO:tasks.ceph.osd.7.smithi040.stderr:2023-10-08T13:04:19.858+0000 7f410cbd5700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45494) UID: 0 2023-10-08T13:07:30.709 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:07:30.711 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:07:30.851 INFO:tasks.ceph.osd.6.smithi040.stderr:2023-10-08T13:07:30.843+0000 7f1be92f5700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45507) UID: 0 2023-10-08T13:07:30.852 INFO:tasks.ceph.osd.5.smithi040.stderr:2023-10-08T13:07:30.847+0000 7f5dfedf1700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45507) UID: 0 2023-10-08T13:07:30.852 INFO:tasks.ceph.osd.4.smithi040.stderr:2023-10-08T13:07:30.843+0000 7ff0fd263700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45507) UID: 0 2023-10-08T13:07:30.852 INFO:tasks.ceph.osd.7.smithi040.stderr:2023-10-08T13:07:30.847+0000 7f410cbd5700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45507) UID: 0 2023-10-08T13:10:03.915 INFO:teuthology.orchestra.run.smithi032.stdout:generic/650 3611s 2023-10-08T13:10:03.974 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/650 2023-10-08T13:10:03.974 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T13:10:03.999 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T13:10:04.012 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:10:04.013 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/651) 2023-10-08T13:10:04.574 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T13:10:04.581 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T13:10:04.581 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T13:10:04.929 INFO:teuthology.orchestra.run.smithi032.stdout:generic/651 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T13:10:04.934 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/651 2023-10-08T13:10:04.934 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/651 2023-10-08T13:10:04.934 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T13:10:04.945 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T13:10:04.966 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:10:04.966 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/652) 2023-10-08T13:10:05.385 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T13:10:05.392 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T13:10:05.392 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T13:10:05.671 INFO:teuthology.orchestra.run.smithi032.stdout:generic/652 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T13:10:05.681 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/652 2023-10-08T13:10:05.681 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/652 2023-10-08T13:10:05.681 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T13:10:05.684 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T13:10:05.695 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:10:05.695 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/653) 2023-10-08T13:10:06.115 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T13:10:06.141 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T13:10:06.141 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T13:10:06.450 INFO:teuthology.orchestra.run.smithi032.stdout:generic/653 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T13:10:06.455 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/653 2023-10-08T13:10:06.455 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/653 2023-10-08T13:10:06.455 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T13:10:06.458 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T13:10:06.482 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:10:06.483 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/654) 2023-10-08T13:10:06.877 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T13:10:06.896 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T13:10:06.896 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T13:10:07.176 INFO:teuthology.orchestra.run.smithi032.stdout:generic/654 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T13:10:07.186 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/654 2023-10-08T13:10:07.186 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/654 2023-10-08T13:10:07.186 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T13:10:07.190 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T13:10:07.206 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:10:07.206 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/655) 2023-10-08T13:10:07.631 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T13:10:07.644 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T13:10:07.644 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T13:10:07.893 INFO:teuthology.orchestra.run.smithi032.stdout:generic/655 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T13:10:07.910 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/655 2023-10-08T13:10:07.911 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/655 2023-10-08T13:10:07.911 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T13:10:07.918 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T13:10:07.941 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:10:07.941 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/656) 2023-10-08T13:10:08.315 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T13:10:08.330 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T13:10:08.331 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T13:10:08.682 INFO:teuthology.orchestra.run.smithi032.stdout:generic/656 [not run] kernel does not support mount_setattr syscall 2023-10-08T13:10:08.686 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/656 2023-10-08T13:10:08.686 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/656 2023-10-08T13:10:08.686 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T13:10:08.694 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T13:10:08.719 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:10:08.719 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/657) 2023-10-08T13:10:09.107 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T13:10:09.130 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T13:10:09.131 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T13:10:09.450 INFO:teuthology.orchestra.run.smithi032.stdout:generic/657 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T13:10:09.470 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/657 2023-10-08T13:10:09.470 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/657 2023-10-08T13:10:09.470 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T13:10:09.483 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T13:10:09.494 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:10:09.495 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/658) 2023-10-08T13:10:09.899 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T13:10:09.914 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T13:10:09.914 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T13:10:10.458 INFO:teuthology.orchestra.run.smithi032.stdout:generic/658 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T13:10:10.471 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/658 2023-10-08T13:10:10.472 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/658 2023-10-08T13:10:10.472 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T13:10:10.478 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T13:10:10.494 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:10:10.494 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/659) 2023-10-08T13:10:10.913 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T13:10:10.920 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T13:10:10.920 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T13:10:11.194 INFO:teuthology.orchestra.run.smithi032.stdout:generic/659 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T13:10:11.208 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/659 2023-10-08T13:10:11.208 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/659 2023-10-08T13:10:11.208 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T13:10:11.218 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T13:10:11.238 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:10:11.238 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/660) 2023-10-08T13:10:11.617 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T13:10:11.622 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T13:10:11.623 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T13:10:11.890 INFO:teuthology.orchestra.run.smithi032.stdout:generic/660 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T13:10:11.895 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/660 2023-10-08T13:10:11.895 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/660 2023-10-08T13:10:11.896 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T13:10:11.898 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T13:10:11.940 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:10:11.940 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/661) 2023-10-08T13:10:12.338 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T13:10:12.343 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T13:10:12.343 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T13:10:12.612 INFO:teuthology.orchestra.run.smithi032.stdout:generic/661 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T13:10:12.618 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/661 2023-10-08T13:10:12.619 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/661 2023-10-08T13:10:12.619 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T13:10:12.623 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T13:10:12.647 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:10:12.647 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/662) 2023-10-08T13:10:13.049 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T13:10:13.073 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T13:10:13.074 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T13:10:13.354 INFO:teuthology.orchestra.run.smithi032.stdout:generic/662 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T13:10:13.359 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/662 2023-10-08T13:10:13.359 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/662 2023-10-08T13:10:13.360 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T13:10:13.365 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T13:10:13.383 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:10:13.383 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/663) 2023-10-08T13:10:13.804 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T13:10:13.811 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T13:10:13.811 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T13:10:14.089 INFO:teuthology.orchestra.run.smithi032.stdout:generic/663 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T13:10:14.094 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/663 2023-10-08T13:10:14.094 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/663 2023-10-08T13:10:14.094 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T13:10:14.097 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T13:10:14.119 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:10:14.119 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/664) 2023-10-08T13:10:14.522 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T13:10:14.532 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T13:10:14.532 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T13:10:14.787 INFO:teuthology.orchestra.run.smithi032.stdout:generic/664 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T13:10:14.806 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/664 2023-10-08T13:10:14.806 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/664 2023-10-08T13:10:14.806 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T13:10:14.818 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T13:10:14.847 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:10:14.847 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/665) 2023-10-08T13:10:15.240 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T13:10:15.252 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T13:10:15.253 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T13:10:15.542 INFO:teuthology.orchestra.run.smithi032.stdout:generic/665 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T13:10:15.555 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/665 2023-10-08T13:10:15.555 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/665 2023-10-08T13:10:15.555 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T13:10:15.558 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T13:10:15.571 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:10:15.571 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/666) 2023-10-08T13:10:15.944 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T13:10:15.961 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T13:10:15.961 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T13:10:16.232 INFO:teuthology.orchestra.run.smithi032.stdout:generic/666 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T13:10:16.237 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/666 2023-10-08T13:10:16.237 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/666 2023-10-08T13:10:16.237 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T13:10:16.241 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T13:10:16.258 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:10:16.259 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/667) 2023-10-08T13:10:16.652 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T13:10:16.662 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T13:10:16.662 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T13:10:16.968 INFO:teuthology.orchestra.run.smithi032.stdout:generic/667 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T13:10:16.977 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/667 2023-10-08T13:10:16.977 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/667 2023-10-08T13:10:16.977 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T13:10:16.989 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T13:10:17.019 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:10:17.020 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/668) 2023-10-08T13:10:17.420 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T13:10:17.426 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T13:10:17.426 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T13:10:17.702 INFO:teuthology.orchestra.run.smithi032.stdout:generic/668 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T13:10:17.717 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/668 2023-10-08T13:10:17.718 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/668 2023-10-08T13:10:17.718 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T13:10:17.720 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T13:10:17.753 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:10:17.753 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/669) 2023-10-08T13:10:18.200 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T13:10:18.211 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T13:10:18.211 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T13:10:18.463 INFO:teuthology.orchestra.run.smithi032.stdout:generic/669 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T13:10:18.473 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/669 2023-10-08T13:10:18.473 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/669 2023-10-08T13:10:18.473 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T13:10:18.476 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T13:10:18.488 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:10:18.488 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/670) 2023-10-08T13:10:18.907 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T13:10:18.913 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T13:10:18.913 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T13:10:19.158 INFO:teuthology.orchestra.run.smithi032.stdout:generic/670 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T13:10:19.175 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/670 2023-10-08T13:10:19.175 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/670 2023-10-08T13:10:19.175 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T13:10:19.178 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T13:10:19.190 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:10:19.190 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/671) 2023-10-08T13:10:19.591 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T13:10:19.598 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T13:10:19.598 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T13:10:19.907 INFO:teuthology.orchestra.run.smithi032.stdout:generic/671 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T13:10:19.912 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/671 2023-10-08T13:10:19.912 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/671 2023-10-08T13:10:19.913 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T13:10:19.922 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T13:10:19.936 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:10:19.936 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/672) 2023-10-08T13:10:20.372 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T13:10:20.388 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T13:10:20.388 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T13:10:20.669 INFO:teuthology.orchestra.run.smithi032.stdout:generic/672 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T13:10:20.674 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/672 2023-10-08T13:10:20.674 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/672 2023-10-08T13:10:20.674 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T13:10:20.677 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T13:10:20.701 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:10:20.701 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/673) 2023-10-08T13:10:21.140 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T13:10:21.145 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T13:10:21.146 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T13:10:21.877 INFO:teuthology.orchestra.run.smithi032.stdout:generic/673 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T13:10:21.882 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/673 2023-10-08T13:10:21.882 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/673 2023-10-08T13:10:21.882 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T13:10:21.884 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T13:10:21.901 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:10:21.902 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/674) 2023-10-08T13:10:22.281 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T13:10:22.288 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T13:10:22.288 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T13:10:22.603 INFO:teuthology.orchestra.run.smithi032.stdout:generic/674 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T13:10:22.614 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/674 2023-10-08T13:10:22.614 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/674 2023-10-08T13:10:22.614 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T13:10:22.623 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T13:10:22.639 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:10:22.639 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/675) 2023-10-08T13:10:23.034 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T13:10:23.056 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T13:10:23.056 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T13:10:23.405 INFO:teuthology.orchestra.run.smithi032.stdout:generic/675 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T13:10:23.418 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/675 2023-10-08T13:10:23.419 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/675 2023-10-08T13:10:23.419 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T13:10:23.427 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T13:10:23.445 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:10:23.446 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/676) 2023-10-08T13:10:23.839 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T13:10:23.849 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T13:10:23.849 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T13:11:13.887 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:11:13.890 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:11:13.918 INFO:tasks.ceph.osd.1.smithi032.stderr:2023-10-08T13:11:13.916+0000 7efe8aecf700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 451429) UID: 0 2023-10-08T13:11:13.919 INFO:tasks.ceph.osd.0.smithi032.stderr:2023-10-08T13:11:13.916+0000 7f519f0f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 451429) UID: 0 2023-10-08T13:11:13.919 INFO:tasks.ceph.osd.3.smithi032.stderr:2023-10-08T13:11:13.916+0000 7ff6419ae700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 451429) UID: 0 2023-10-08T13:11:13.919 INFO:tasks.ceph.osd.2.smithi032.stderr:2023-10-08T13:11:13.916+0000 7fe8a3511700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 451429) UID: 0 2023-10-08T13:15:53.375 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:15:53.378 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:15:53.396 INFO:tasks.ceph.osd.0.smithi032.stderr:2023-10-08T13:15:53.390+0000 7f519f0f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 451447) UID: 0 2023-10-08T13:15:53.396 INFO:tasks.ceph.osd.3.smithi032.stderr:2023-10-08T13:15:53.390+0000 7ff6419ae700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 451447) UID: 0 2023-10-08T13:15:53.397 INFO:tasks.ceph.osd.1.smithi032.stderr:2023-10-08T13:15:53.390+0000 7efe8aecf700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 451447) UID: 0 2023-10-08T13:15:53.397 INFO:tasks.ceph.osd.2.smithi032.stderr:2023-10-08T13:15:53.390+0000 7fe8a3511700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 451447) UID: 0 2023-10-08T13:15:53.482 INFO:tasks.ceph.mds.d.smithi040.stderr:2023-10-08T13:15:53.477+0000 7fa77bedd700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 45532) UID: 0 2023-10-08T13:15:53.483 INFO:tasks.ceph.mds.b.smithi040.stderr:2023-10-08T13:15:53.477+0000 7f4c7640d700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 45532) UID: 0 2023-10-08T13:20:38.072 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:20:38.075 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:21:08.242 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:21:08.244 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:21:38.316 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:21:38.319 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:22:08.398 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:22:08.402 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:22:38.659 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:22:38.662 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:23:08.716 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:23:08.726 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:23:39.178 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:23:39.180 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:24:09.224 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:24:09.227 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:24:09.253 INFO:tasks.ceph.mds.d.smithi040.stderr:2023-10-08T13:24:09.246+0000 7fa77bedd700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 45568) UID: 0 2023-10-08T13:24:09.257 INFO:tasks.ceph.mds.b.smithi040.stderr:2023-10-08T13:24:09.246+0000 7f4c7640d700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 45568) UID: 0 2023-10-08T13:27:05.297 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:27:05.300 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:27:35.365 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:27:35.368 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:28:05.430 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:28:05.432 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:28:35.875 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:28:35.882 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:29:05.933 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:29:05.935 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:29:35.982 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:29:35.985 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:30:06.040 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:30:06.042 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:30:36.321 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:30:36.324 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:31:06.649 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:31:06.652 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:31:37.109 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:31:37.112 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:32:07.515 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:32:07.518 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:32:07.537 INFO:tasks.ceph.mds.d.smithi040.stderr:2023-10-08T13:32:07.532+0000 7fa77bedd700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 45610) UID: 0 2023-10-08T13:32:07.537 INFO:tasks.ceph.mds.b.smithi040.stderr:2023-10-08T13:32:07.532+0000 7f4c7640d700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 45610) UID: 0 2023-10-08T13:35:01.415 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:35:01.417 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:35:31.475 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:35:31.477 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:36:01.702 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:36:01.704 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:36:31.758 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:36:31.761 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:37:01.803 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:37:01.806 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:37:01.855 INFO:tasks.ceph.osd.4.smithi040.stderr:2023-10-08T13:37:01.848+0000 7ff0fd263700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45636) UID: 0 2023-10-08T13:37:01.856 INFO:tasks.ceph.osd.5.smithi040.stderr:2023-10-08T13:37:01.848+0000 7f5dfedf1700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45636) UID: 0 2023-10-08T13:37:01.856 INFO:tasks.ceph.osd.7.smithi040.stderr:2023-10-08T13:37:01.852+0000 7f410cbd5700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45636) UID: 0 2023-10-08T13:37:01.856 INFO:tasks.ceph.osd.6.smithi040.stderr:2023-10-08T13:37:01.852+0000 7f1be92f5700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45636) UID: 0 2023-10-08T13:40:35.752 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:40:35.754 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:40:35.780 INFO:tasks.ceph.mds.b.smithi040.stderr:2023-10-08T13:40:35.774+0000 7f4c7640d700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 45644) UID: 0 2023-10-08T13:40:35.781 INFO:tasks.ceph.mds.d.smithi040.stderr:2023-10-08T13:40:35.774+0000 7fa77bedd700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 45644) UID: 0 2023-10-08T13:42:34.498 INFO:teuthology.orchestra.run.smithi032.stdout:generic/676 1931s 2023-10-08T13:42:34.584 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/676 2023-10-08T13:42:34.584 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T13:42:34.590 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T13:42:34.612 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:42:34.612 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/677) 2023-10-08T13:42:35.543 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T13:42:35.559 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T13:42:35.559 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T13:42:35.948 INFO:teuthology.orchestra.run.smithi032.stdout:generic/677 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T13:42:35.953 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/677 2023-10-08T13:42:35.954 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/677 2023-10-08T13:42:35.954 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T13:42:35.971 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T13:42:35.989 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:42:35.989 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/678) 2023-10-08T13:42:36.394 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T13:42:36.399 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T13:42:36.400 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T13:42:36.783 INFO:teuthology.orchestra.run.smithi032.stdout:generic/678 [not run] kernel does not support IO_URING 2023-10-08T13:42:36.796 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/678 2023-10-08T13:42:36.796 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/678 2023-10-08T13:42:36.796 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T13:42:36.798 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T13:42:36.813 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:42:36.813 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/679) 2023-10-08T13:42:37.242 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T13:42:37.267 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T13:42:37.267 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T13:42:37.552 INFO:teuthology.orchestra.run.smithi032.stdout:generic/679 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T13:42:37.557 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/679 2023-10-08T13:42:37.557 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/679 2023-10-08T13:42:37.557 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T13:42:37.573 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T13:42:37.582 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:42:37.582 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/680) 2023-10-08T13:42:37.979 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T13:42:37.984 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T13:42:37.984 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T13:42:40.964 INFO:teuthology.orchestra.run.smithi032.stdout:generic/680 2s 2023-10-08T13:42:40.978 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/680 2023-10-08T13:42:40.979 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T13:42:40.992 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T13:42:41.018 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:42:41.018 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/681) 2023-10-08T13:42:41.410 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T13:42:41.423 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T13:42:41.423 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T13:42:41.739 INFO:teuthology.orchestra.run.smithi032.stdout:generic/681 [not run] disk quotas not supported by this filesystem type: ceph-fuse 2023-10-08T13:42:41.748 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/681 2023-10-08T13:42:41.749 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/681 2023-10-08T13:42:41.749 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T13:42:41.752 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T13:42:41.764 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:42:41.765 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/682) 2023-10-08T13:42:42.174 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T13:42:42.181 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T13:42:42.181 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T13:42:42.479 INFO:teuthology.orchestra.run.smithi032.stdout:generic/682 [not run] disk quotas not supported by this filesystem type: ceph-fuse 2023-10-08T13:42:42.485 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/682 2023-10-08T13:42:42.485 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/682 2023-10-08T13:42:42.485 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T13:42:42.494 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T13:42:42.521 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:42:42.521 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/683) 2023-10-08T13:42:42.911 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T13:42:42.933 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T13:42:42.933 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T13:42:43.353 INFO:teuthology.orchestra.run.smithi032.stdout:generic/683 [not run] /tmp/tmp.t2WBfhO8BYtest: file alloc unit 4194304 larger than op length 65536 2023-10-08T13:42:43.366 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/683 2023-10-08T13:42:43.366 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/683 2023-10-08T13:42:43.366 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T13:42:43.372 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T13:42:43.389 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:42:43.389 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/684) 2023-10-08T13:42:43.808 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T13:42:43.825 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T13:42:43.825 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T13:42:45.602 INFO:teuthology.orchestra.run.smithi032.stdout:generic/684 [not run] /tmp/tmp.t2WBfhO8BYtest: file alloc unit 4194304 larger than op length 65536 2023-10-08T13:42:45.618 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/684 2023-10-08T13:42:45.618 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/684 2023-10-08T13:42:45.618 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T13:42:45.624 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T13:42:45.638 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:42:45.638 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/685) 2023-10-08T13:42:46.141 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T13:42:46.157 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T13:42:46.157 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T13:42:47.981 INFO:teuthology.orchestra.run.smithi032.stdout:generic/685 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-10-08T13:42:48.000 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/685 2023-10-08T13:42:48.000 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/685 2023-10-08T13:42:48.000 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T13:42:48.010 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T13:42:48.037 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:42:48.037 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/686) 2023-10-08T13:42:48.481 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T13:42:48.487 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T13:42:48.487 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T13:42:50.220 INFO:teuthology.orchestra.run.smithi032.stdout:generic/686 [not run] xfs_io finsert failed (old kernel/wrong fs?) 2023-10-08T13:42:50.228 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/686 2023-10-08T13:42:50.229 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/686 2023-10-08T13:42:50.229 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T13:42:50.233 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T13:42:50.250 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:42:50.251 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/687) 2023-10-08T13:42:50.679 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T13:42:50.685 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T13:42:50.685 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T13:42:52.371 INFO:teuthology.orchestra.run.smithi032.stdout:generic/687 [not run] xfs_io fcollapse failed (old kernel/wrong fs?) 2023-10-08T13:42:52.382 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/687 2023-10-08T13:42:52.382 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/687 2023-10-08T13:42:52.382 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T13:42:52.384 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T13:42:52.409 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:42:52.410 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/688) 2023-10-08T13:42:52.887 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T13:42:52.903 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T13:42:52.903 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T13:42:53.355 INFO:teuthology.orchestra.run.smithi032.stdout:generic/688 [not run] /tmp/tmp.t2WBfhO8BYtest: file alloc unit 4194304 larger than op length 65536 2023-10-08T13:42:53.365 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/688 2023-10-08T13:42:53.365 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/688 2023-10-08T13:42:53.365 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T13:42:53.367 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T13:42:53.384 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:42:53.385 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/689) 2023-10-08T13:42:53.819 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T13:42:53.834 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T13:42:53.834 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T13:42:54.117 INFO:teuthology.orchestra.run.smithi032.stdout:generic/689 [not run] kernel does not support mount_setattr syscall 2023-10-08T13:42:54.128 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/689 2023-10-08T13:42:54.128 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/689 2023-10-08T13:42:54.128 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T13:42:54.130 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T13:42:54.167 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:42:54.168 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/690) 2023-10-08T13:42:54.631 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T13:42:54.643 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T13:42:54.643 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T13:42:54.945 INFO:teuthology.orchestra.run.smithi032.stdout:generic/690 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T13:42:54.957 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/690 2023-10-08T13:42:54.957 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/690 2023-10-08T13:42:54.957 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T13:42:54.965 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T13:42:54.991 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:42:54.991 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/691) 2023-10-08T13:42:55.389 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T13:42:55.393 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T13:42:55.393 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T13:42:55.680 INFO:teuthology.orchestra.run.smithi032.stdout:generic/691 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T13:42:55.686 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/691 2023-10-08T13:42:55.686 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/691 2023-10-08T13:42:55.686 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T13:42:55.689 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T13:42:55.702 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:42:55.702 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/692) 2023-10-08T13:42:56.106 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T13:42:56.112 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T13:42:56.112 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T13:42:56.413 INFO:teuthology.orchestra.run.smithi032.stdout:generic/692 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T13:42:56.430 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/692 2023-10-08T13:42:56.430 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/692 2023-10-08T13:42:56.430 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T13:42:56.439 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T13:42:56.459 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:42:56.459 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/693) 2023-10-08T13:42:56.876 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T13:42:56.897 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T13:42:56.897 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T13:42:57.260 INFO:teuthology.orchestra.run.smithi032.stdout:generic/693 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T13:42:57.276 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/693 2023-10-08T13:42:57.276 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/693 2023-10-08T13:42:57.277 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T13:42:57.281 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T13:42:57.292 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:42:57.292 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/694) 2023-10-08T13:42:57.734 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T13:42:57.749 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T13:42:57.749 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T13:42:58.308 INFO:teuthology.orchestra.run.smithi032.stdout:generic/694 1s 2023-10-08T13:42:58.336 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/694 2023-10-08T13:42:58.336 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T13:42:58.339 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T13:42:58.358 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:42:58.359 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/695) 2023-10-08T13:42:58.773 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T13:42:58.788 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T13:42:58.788 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T13:42:59.074 INFO:teuthology.orchestra.run.smithi032.stdout:generic/695 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T13:42:59.088 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/695 2023-10-08T13:42:59.088 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/695 2023-10-08T13:42:59.088 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T13:42:59.094 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T13:42:59.110 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:42:59.110 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/696) 2023-10-08T13:42:59.542 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T13:42:59.548 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T13:42:59.548 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T13:42:59.861 INFO:teuthology.orchestra.run.smithi032.stdout:generic/696 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T13:42:59.869 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/696 2023-10-08T13:42:59.869 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/696 2023-10-08T13:42:59.869 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T13:42:59.872 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T13:42:59.892 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:42:59.892 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/697) 2023-10-08T13:43:00.285 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T13:43:00.290 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T13:43:00.290 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T13:43:00.623 INFO:teuthology.orchestra.run.smithi032.stdout:generic/697 [not run] ACLs not supported by this filesystem type: ceph-fuse 2023-10-08T13:43:00.642 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/697 2023-10-08T13:43:00.642 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/697 2023-10-08T13:43:00.642 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T13:43:00.650 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T13:43:00.661 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:43:00.661 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/698) 2023-10-08T13:43:01.065 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T13:43:01.078 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T13:43:01.078 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T13:43:01.390 INFO:teuthology.orchestra.run.smithi032.stdout:generic/698 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T13:43:01.399 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/698 2023-10-08T13:43:01.399 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/698 2023-10-08T13:43:01.400 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T13:43:01.407 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T13:43:01.422 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:43:01.422 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/699) 2023-10-08T13:43:01.809 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T13:43:01.824 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T13:43:01.824 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T13:43:02.884 INFO:teuthology.orchestra.run.smithi032.stdout:generic/699 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T13:43:02.892 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/699 2023-10-08T13:43:02.892 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/699 2023-10-08T13:43:02.893 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T13:43:02.907 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T13:43:02.928 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:43:02.929 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/700) 2023-10-08T13:43:03.347 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T13:43:03.354 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T13:43:03.354 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T13:43:03.677 INFO:teuthology.orchestra.run.smithi032.stdout:generic/700 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T13:43:03.691 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/700 2023-10-08T13:43:03.691 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/700 2023-10-08T13:43:03.691 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T13:43:03.700 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T13:43:03.713 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:43:03.714 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/701) 2023-10-08T13:43:04.073 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T13:43:04.079 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T13:43:04.079 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T13:43:04.809 INFO:teuthology.orchestra.run.smithi032.stdout:generic/701 0s 2023-10-08T13:43:04.836 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/701 2023-10-08T13:43:04.836 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T13:43:04.841 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T13:43:04.852 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:43:04.853 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/702) 2023-10-08T13:43:05.272 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T13:43:05.282 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T13:43:05.282 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T13:43:05.567 INFO:teuthology.orchestra.run.smithi032.stdout:generic/702 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T13:43:05.587 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/702 2023-10-08T13:43:05.587 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/702 2023-10-08T13:43:05.587 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T13:43:05.597 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T13:43:05.631 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:43:05.631 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/703) 2023-10-08T13:43:06.057 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T13:43:06.064 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T13:43:06.064 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T13:43:06.395 INFO:teuthology.orchestra.run.smithi032.stdout:generic/703 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T13:43:06.399 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/703 2023-10-08T13:43:06.399 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/703 2023-10-08T13:43:06.400 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T13:43:06.402 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T13:43:06.428 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:43:06.429 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/704) 2023-10-08T13:43:06.850 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T13:43:06.878 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T13:43:06.878 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T13:43:07.529 INFO:teuthology.orchestra.run.smithi032.stdout:generic/704 [not run] require ceph-fuse to be valid block disk 2023-10-08T13:43:07.545 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/704 2023-10-08T13:43:07.545 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/704 2023-10-08T13:43:07.545 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T13:43:07.553 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T13:43:07.567 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:43:07.567 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/705) 2023-10-08T13:43:07.957 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T13:43:07.968 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T13:43:07.968 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T13:43:08.211 INFO:teuthology.orchestra.run.smithi032.stdout:generic/705 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T13:43:08.234 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/705 2023-10-08T13:43:08.235 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/705 2023-10-08T13:43:08.235 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T13:43:08.238 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T13:43:08.268 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:43:08.268 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/706) 2023-10-08T13:43:08.721 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T13:43:08.734 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T13:43:08.734 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T13:43:11.482 INFO:teuthology.orchestra.run.smithi032.stdout:generic/706 3s 2023-10-08T13:43:11.498 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/706 2023-10-08T13:43:11.499 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T13:43:11.502 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T13:43:11.524 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:43:11.525 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/707) 2023-10-08T13:43:11.911 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T13:43:11.924 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T13:43:11.924 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T13:43:12.199 INFO:teuthology.orchestra.run.smithi032.stdout:generic/707 [not run] this test requires a valid $SCRATCH_DEV 2023-10-08T13:43:12.214 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/707 2023-10-08T13:43:12.214 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/707 2023-10-08T13:43:12.215 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T13:43:12.217 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T13:43:12.226 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:43:12.227 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/708) 2023-10-08T13:43:12.672 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T13:43:12.686 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T13:43:12.687 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T13:43:13.603 INFO:teuthology.orchestra.run.smithi032.stdout:generic/708 1s 2023-10-08T13:43:13.615 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/708 2023-10-08T13:43:13.615 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T13:43:13.617 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T13:43:13.636 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:43:13.637 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/709) 2023-10-08T13:43:14.028 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T13:43:14.039 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T13:43:14.040 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T13:43:14.417 INFO:teuthology.orchestra.run.smithi032.stdout:generic/709 [not run] xfs_io swapext -v vfs not supported on ceph-fuse 2023-10-08T13:43:14.425 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/709 2023-10-08T13:43:14.426 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/709 2023-10-08T13:43:14.426 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T13:43:14.429 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T13:43:14.459 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:43:14.459 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/710) 2023-10-08T13:43:14.855 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T13:43:14.868 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T13:43:14.868 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T13:43:15.244 INFO:teuthology.orchestra.run.smithi032.stdout:generic/710 [not run] xfs_io swapext -v vfs not supported on ceph-fuse 2023-10-08T13:43:15.250 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/710 2023-10-08T13:43:15.250 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/710 2023-10-08T13:43:15.250 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T13:43:15.265 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T13:43:15.286 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:43:15.286 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/711) 2023-10-08T13:43:15.670 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T13:43:15.685 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T13:43:15.685 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T13:43:16.039 INFO:teuthology.orchestra.run.smithi032.stdout:generic/711 [not run] xfs_io swapext -v vfs not supported on ceph-fuse 2023-10-08T13:43:16.047 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/711 2023-10-08T13:43:16.047 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/711 2023-10-08T13:43:16.048 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T13:43:16.051 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T13:43:16.068 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:43:16.068 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/712) 2023-10-08T13:43:16.538 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T13:43:16.554 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T13:43:16.554 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T13:43:16.950 INFO:teuthology.orchestra.run.smithi032.stdout:generic/712 [not run] xfs_io swapext -v vfs not supported on ceph-fuse 2023-10-08T13:43:16.956 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/712 2023-10-08T13:43:16.956 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/712 2023-10-08T13:43:16.956 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T13:43:16.964 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T13:43:16.987 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:43:16.988 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/713) 2023-10-08T13:43:17.402 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T13:43:17.407 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T13:43:17.407 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T13:43:17.784 INFO:teuthology.orchestra.run.smithi032.stdout:generic/713 [not run] xfs_io swapext -v vfs -s 64k -l 64k not supported on ceph-fuse 2023-10-08T13:43:17.789 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/713 2023-10-08T13:43:17.789 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/713 2023-10-08T13:43:17.789 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T13:43:17.795 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T13:43:17.814 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:43:17.814 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/714) 2023-10-08T13:43:18.219 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T13:43:18.227 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T13:43:18.227 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T13:43:18.619 INFO:teuthology.orchestra.run.smithi032.stdout:generic/714 [not run] xfs_io swapext -v vfs not supported on ceph-fuse 2023-10-08T13:43:18.631 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/714 2023-10-08T13:43:18.631 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/714 2023-10-08T13:43:18.631 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T13:43:18.637 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T13:43:18.659 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:43:18.659 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/715) 2023-10-08T13:43:19.115 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T13:43:19.124 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T13:43:19.125 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T13:43:19.503 INFO:teuthology.orchestra.run.smithi032.stdout:generic/715 [not run] xfs_io swapext -v vfs -s 64k -l 64k not supported on ceph-fuse 2023-10-08T13:43:19.508 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/715 2023-10-08T13:43:19.508 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/715 2023-10-08T13:43:19.508 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T13:43:19.518 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T13:43:19.533 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:43:19.533 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/716) 2023-10-08T13:43:19.979 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T13:43:19.989 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T13:43:19.989 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T13:43:20.362 INFO:teuthology.orchestra.run.smithi032.stdout:generic/716 [not run] xfs_io swapext -v vfs not supported on ceph-fuse 2023-10-08T13:43:20.372 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/716 2023-10-08T13:43:20.372 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/716 2023-10-08T13:43:20.372 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T13:43:20.375 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T13:43:20.386 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:43:20.387 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/717) 2023-10-08T13:43:20.781 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T13:43:20.789 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T13:43:20.789 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T13:43:21.185 INFO:teuthology.orchestra.run.smithi032.stdout:generic/717 [not run] xfs_io swapext -v vfs not supported on ceph-fuse 2023-10-08T13:43:21.192 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/717 2023-10-08T13:43:21.193 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/717 2023-10-08T13:43:21.193 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T13:43:21.198 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T13:43:21.216 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:43:21.216 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/718) 2023-10-08T13:43:21.622 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T13:43:21.646 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T13:43:21.647 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T13:43:22.003 INFO:teuthology.orchestra.run.smithi032.stdout:generic/718 [not run] xfs_io swapext -v vfs not supported on ceph-fuse 2023-10-08T13:43:22.009 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/718 2023-10-08T13:43:22.009 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/718 2023-10-08T13:43:22.009 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T13:43:22.018 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T13:43:22.036 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:43:22.036 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/719) 2023-10-08T13:43:22.441 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T13:43:22.457 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T13:43:22.457 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T13:43:22.873 INFO:teuthology.orchestra.run.smithi032.stdout:generic/719 [not run] xfs_io swapext -v vfs not supported on ceph-fuse 2023-10-08T13:43:22.889 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/719 2023-10-08T13:43:22.889 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/719 2023-10-08T13:43:22.889 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T13:43:22.895 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T13:43:22.912 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:43:22.912 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/720) 2023-10-08T13:43:23.335 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T13:43:23.340 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T13:43:23.340 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T13:43:23.722 INFO:teuthology.orchestra.run.smithi032.stdout:generic/720 [not run] xfs_io swapext -v vfs not supported on ceph-fuse 2023-10-08T13:43:23.729 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/720 2023-10-08T13:43:23.730 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/720 2023-10-08T13:43:23.730 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T13:43:23.732 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T13:43:23.755 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:43:23.756 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/721) 2023-10-08T13:43:24.147 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T13:43:24.156 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T13:43:24.156 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T13:43:24.569 INFO:teuthology.orchestra.run.smithi032.stdout:generic/721 [not run] xfs_io startupdate support is missing 2023-10-08T13:43:24.574 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/721 2023-10-08T13:43:24.574 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/721 2023-10-08T13:43:24.574 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T13:43:24.576 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T13:43:24.606 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:43:24.606 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/722) 2023-10-08T13:43:24.982 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T13:43:24.994 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T13:43:24.994 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T13:43:25.359 INFO:teuthology.orchestra.run.smithi032.stdout:generic/722 [not run] xfs_io swapext -v vfs -a not supported on ceph-fuse 2023-10-08T13:43:25.363 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/722 2023-10-08T13:43:25.363 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/722 2023-10-08T13:43:25.363 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T13:43:25.370 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T13:43:25.400 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:43:25.400 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/723) 2023-10-08T13:43:25.805 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T13:43:25.810 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T13:43:25.810 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T13:43:26.244 INFO:teuthology.orchestra.run.smithi032.stdout:generic/723 [not run] xfs_io swapext -v vfs not supported on ceph-fuse 2023-10-08T13:43:26.249 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/723 2023-10-08T13:43:26.249 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/723 2023-10-08T13:43:26.249 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T13:43:26.258 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T13:43:26.289 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:43:26.289 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/724) 2023-10-08T13:43:26.670 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T13:43:26.686 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T13:43:26.687 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T13:43:27.052 INFO:teuthology.orchestra.run.smithi032.stdout:generic/724 [not run] xfs_io swapext -v vfs -a not supported on ceph-fuse 2023-10-08T13:43:27.060 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/724 2023-10-08T13:43:27.060 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/724 2023-10-08T13:43:27.060 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T13:43:27.069 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T13:43:27.091 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:43:27.091 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/725) 2023-10-08T13:43:27.482 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T13:43:27.496 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T13:43:27.496 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T13:43:27.890 INFO:teuthology.orchestra.run.smithi032.stdout:generic/725 [not run] xfs_io swapext -v vfs -a not supported on ceph-fuse 2023-10-08T13:43:27.903 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/725 2023-10-08T13:43:27.903 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/725 2023-10-08T13:43:27.903 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T13:43:27.905 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T13:43:27.916 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:43:27.916 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/726) 2023-10-08T13:43:28.332 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T13:43:28.341 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T13:43:28.341 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T13:43:29.052 INFO:teuthology.orchestra.run.smithi032.stdout:generic/726 [not run] xfs_io swapext -v vfs -a not supported on ceph-fuse 2023-10-08T13:43:29.060 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/726 2023-10-08T13:43:29.060 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/726 2023-10-08T13:43:29.060 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T13:43:29.062 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T13:43:29.079 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:43:29.080 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/727) 2023-10-08T13:43:29.446 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T13:43:29.459 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T13:43:29.459 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T13:43:29.878 INFO:teuthology.orchestra.run.smithi032.stdout:generic/727 [not run] xfs_io swapext -v vfs -a not supported on ceph-fuse 2023-10-08T13:43:29.895 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/727 2023-10-08T13:43:29.895 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/727 2023-10-08T13:43:29.895 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T13:43:29.901 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T13:43:29.928 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:43:29.929 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/728) 2023-10-08T13:43:30.400 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T13:43:30.414 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T13:43:30.414 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T13:43:34.969 INFO:teuthology.orchestra.run.smithi032.stdout:generic/728 4s 2023-10-08T13:43:35.011 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/728 2023-10-08T13:43:35.011 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T13:43:35.019 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T13:43:35.031 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:43:35.031 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/729) 2023-10-08T13:43:35.421 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T13:43:35.427 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T13:43:35.427 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T13:43:36.549 INFO:teuthology.orchestra.run.smithi032.stdout:generic/729 1s 2023-10-08T13:43:36.556 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/729 2023-10-08T13:43:36.556 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T13:43:36.559 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T13:43:36.584 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:43:36.585 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/730) 2023-10-08T13:43:36.980 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T13:43:36.994 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T13:43:36.994 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T13:43:37.313 INFO:teuthology.orchestra.run.smithi032.stdout:generic/730 [not run] require ceph-fuse to be valid block disk 2023-10-08T13:43:37.318 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/730 2023-10-08T13:43:37.318 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/730 2023-10-08T13:43:37.318 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T13:43:37.321 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T13:43:37.331 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:43:37.331 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.p8vAuQqzIgxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/731) 2023-10-08T13:43:37.738 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph-fuse 2023-10-08T13:43:37.751 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 5.4.0-164-generic #181-Ubuntu SMP Fri Sep 1 13:41:22 UTC 2023 2023-10-08T13:43:37.751 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T13:43:38.043 INFO:teuthology.orchestra.run.smithi032.stdout:generic/731 [not run] require ceph-fuse to be valid block disk 2023-10-08T13:43:38.056 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/731 2023-10-08T13:43:38.056 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/731 2023-10-08T13:43:38.056 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-10-08T13:43:38.059 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T13:43:38.079 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-08T13:43:38.080 INFO:tasks.cephfs.xfstests_dev:=========================================================Total number of tests failed = 16========================================================= 2023-10-08T13:43:38.080 DEBUG:teuthology.orchestra.run.smithi032:> sudo userdel --force --remove fsgqa 2023-10-08T13:43:38.169 INFO:teuthology.orchestra.run.smithi032.stderr:userdel: user fsgqa is currently used by process 472713 2023-10-08T13:43:38.187 INFO:teuthology.orchestra.run.smithi032.stderr:userdel: fsgqa mail spool (/var/mail/fsgqa) not found 2023-10-08T13:43:38.711 DEBUG:teuthology.orchestra.run.smithi032:> sudo userdel --force --remove 123456-fsgqa 2023-10-08T13:43:38.735 INFO:teuthology.orchestra.run.smithi032.stderr:userdel: 123456-fsgqa mail spool (/var/mail/123456-fsgqa) not found 2023-10-08T13:43:38.736 INFO:teuthology.orchestra.run.smithi032.stderr:userdel: 123456-fsgqa home directory (/home/123456-fsgqa) not found 2023-10-08T13:43:39.157 DEBUG:teuthology.orchestra.run.smithi032:> sudo groupdel fsgqa 2023-10-08T13:43:39.221 INFO:teuthology.orchestra.run.smithi032.stderr:groupdel: group 'fsgqa' does not exist 2023-10-08T13:43:39.222 DEBUG:teuthology.orchestra.run:got remote process result: 6 2023-10-08T13:43:39.222 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T13:43:39.223 DEBUG:teuthology.orchestra.run.smithi032:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo stat /tmp/tmp.p8vAuQqzIgxfstests-dev/results) 2023-10-08T13:43:39.238 INFO:teuthology.orchestra.run.smithi032.stderr:bash: line 0: cd: /home/ubuntu/cephtest/mnt.0: Permission denied 2023-10-08T13:43:39.239 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T13:43:39.239 INFO:tasks.cephfs.xfstests_dev:xfstests-dev repo contains not directory named "results". repo location: /tmp/tmp.p8vAuQqzIgxfstests-dev 2023-10-08T13:43:39.239 DEBUG:teuthology.orchestra.run.smithi032:> sudo rm -rf /tmp/tmp.p8vAuQqzIgxfstests-dev 2023-10-08T13:43:39.492 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-08T13:43:39.492 DEBUG:teuthology.orchestra.run.smithi032:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-08T13:43:39.594 DEBUG:teuthology.orchestra.run.smithi040:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-08T13:43:39.722 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-08T13:43:39.723 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2023-10-08T13:43:39.723 DEBUG:teuthology.orchestra.run.smithi032:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-08T13:43:39.755 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16349460k,nr_inodes=4087365,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276124k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 none /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18877 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276120k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276124k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 tmpfs /run/user/10101 tmpfs rw,nosuid,nodev,relatime,size=3276120k,mode=700,uid=10101,gid=10101 0 0 2023-10-08T13:43:39.755 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi032.front.sepia.ceph.com 2023-10-08T13:43:39.755 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T13:43:39.755 DEBUG:teuthology.orchestra.run.smithi032:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-08T13:43:39.808 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-10-08T13:43:39.809 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-08T13:43:39.830 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16349468k,nr_inodes=4087367,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276124k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 none /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=12874 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276120k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276124k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-10-08T13:43:39.831 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi040.front.sepia.ceph.com 2023-10-08T13:43:39.831 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T13:43:39.831 DEBUG:teuthology.orchestra.run.smithi040:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-08T13:43:39.854 INFO:teuthology.orchestra.run.smithi040.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2023-10-08T13:43:39.855 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T13:43:39.856 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2023-10-08T13:43:39.856 DEBUG:teuthology.orchestra.run.smithi032:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-08T13:43:39.861 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16349460k,nr_inodes=4087365,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276124k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 none /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18877 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276120k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276124k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 tmpfs /run/user/10101 tmpfs rw,nosuid,nodev,relatime,size=3276120k,mode=700,uid=10101,gid=10101 0 0 2023-10-08T13:43:39.861 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi032.front.sepia.ceph.com 2023-10-08T13:43:39.861 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T13:43:39.862 DEBUG:teuthology.orchestra.run.smithi032:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-10-08T13:43:39.909 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T13:43:39.910 INFO:teuthology.orchestra.run.smithi032.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-10-08T13:43:39.911 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-10-08T13:43:39.911 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-08T13:43:39.919 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16349468k,nr_inodes=4087367,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276124k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 none /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=12874 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276120k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276124k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-10-08T13:43:39.920 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi040.front.sepia.ceph.com 2023-10-08T13:43:39.920 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T13:43:39.921 DEBUG:teuthology.orchestra.run.smithi040:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-10-08T13:43:39.930 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T13:43:39.931 INFO:teuthology.orchestra.run.smithi040.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-10-08T13:43:39.931 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T13:43:40.567 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:40.561+0000 7f2cc7fff700 1 Processor -- start 2023-10-08T13:43:40.567 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:40.561+0000 7f2cc7fff700 1 -- start start 2023-10-08T13:43:40.572 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:40.561+0000 7f2cc7fff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2cc0050050 0x7f2cc0006830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:43:40.572 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:40.561+0000 7f2cc7fff700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2cc0007180 con 0x7f2cc00508f0 2023-10-08T13:43:40.572 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:40.561+0000 7f2cc7fff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2cc00e0450 con 0x7f2cc0006d70 2023-10-08T13:43:40.572 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:40.561+0000 7f2cc7fff700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cc00d6c90 con 0x7f2cc0050050 2023-10-08T13:43:40.572 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:40.561+0000 7f2cc6ffd700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f2cc00508f0 0x7f2cc00dfd40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:38244/0 (socket says 172.21.15.32:38244) 2023-10-08T13:43:40.573 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:40.561+0000 7f2cc6ffd700 1 -- 172.21.15.32:0/3045492052 learned_addr learned my addr 172.21.15.32:0/3045492052 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-08T13:43:40.573 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:40.561+0000 7f2cc67fc700 1 --2- 172.21.15.32:0/3045492052 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2cc0050050 0x7f2cc0006830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:43:40.573 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:40.561+0000 7f2cc5ffb700 1 -- 172.21.15.32:0/3045492052 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 689501009 0 0) 0x7f2cc0007180 con 0x7f2cc00508f0 2023-10-08T13:43:40.573 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:40.561+0000 7f2cc5ffb700 1 -- 172.21.15.32:0/3045492052 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2cb00046e0 con 0x7f2cc00508f0 2023-10-08T13:43:40.573 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:40.561+0000 7f2cc5ffb700 1 -- 172.21.15.32:0/3045492052 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 843186004 0 0) 0x7f2cb00046e0 con 0x7f2cc00508f0 2023-10-08T13:43:40.573 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:40.561+0000 7f2cc5ffb700 1 -- 172.21.15.32:0/3045492052 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2cc0050050 msgr2=0x7f2cc0006830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:43:40.573 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:40.561+0000 7f2cc5ffb700 1 --2- 172.21.15.32:0/3045492052 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2cc0050050 0x7f2cc0006830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:40.574 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:40.561+0000 7f2cc5ffb700 1 -- 172.21.15.32:0/3045492052 >> v1:172.21.15.40:6789/0 conn(0x7f2cc0006d70 legacy=0x7f2cc00336e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:43:40.574 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:40.561+0000 7f2cc5ffb700 1 -- 172.21.15.32:0/3045492052 --> v1:172.21.15.32:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cc00e0720 con 0x7f2cc00508f0 2023-10-08T13:43:40.574 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:40.561+0000 7f2cc5ffb700 1 -- 172.21.15.32:0/3045492052 <== mon.0 v1:172.21.15.32:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2364763317 0 0) 0x7f2cb8001670 con 0x7f2cc00508f0 2023-10-08T13:43:40.574 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:40.561+0000 7f2cc5ffb700 1 -- 172.21.15.32:0/3045492052 >> v1:172.21.15.32:6789/0 conn(0x7f2cc00508f0 legacy=0x7f2cc00dfd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:43:40.574 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:40.561+0000 7f2cc5ffb700 1 --2- 172.21.15.32:0/3045492052 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2cb0004b60 0x7f2cb0004f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:43:40.574 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:40.561+0000 7f2cc5ffb700 1 --2- 172.21.15.32:0/3045492052 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2cc0050050 0x7f2cb0005980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:43:40.574 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:40.561+0000 7f2cc5ffb700 1 --2- 172.21.15.32:0/3045492052 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2cb0005ec0 0x7f2cb0006340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:43:40.575 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:40.561+0000 7f2cc5ffb700 1 -- 172.21.15.32:0/3045492052 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cc00d6c90 con 0x7f2cb0005ec0 2023-10-08T13:43:40.575 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:40.561+0000 7f2cc5ffb700 1 -- 172.21.15.32:0/3045492052 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cb000cbf0 con 0x7f2cb0004b60 2023-10-08T13:43:40.575 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:40.561+0000 7f2cc5ffb700 1 -- 172.21.15.32:0/3045492052 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cb0003520 con 0x7f2cc0050050 2023-10-08T13:43:40.575 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:40.561+0000 7f2cc77fe700 1 --2- 172.21.15.32:0/3045492052 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2cb0005ec0 0x7f2cb0006340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:43:40.575 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:40.561+0000 7f2cc67fc700 1 --2- 172.21.15.32:0/3045492052 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2cc0050050 0x7f2cb0005980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:43:40.575 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:40.561+0000 7f2cc77fe700 1 -- 172.21.15.32:0/3045492052 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2cc0050050 msgr2=0x7f2cb0005980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:43:40.575 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:40.561+0000 7f2cc77fe700 1 --2- 172.21.15.32:0/3045492052 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2cc0050050 0x7f2cb0005980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:40.576 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:40.561+0000 7f2cc77fe700 1 -- 172.21.15.32:0/3045492052 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2cb0004b60 msgr2=0x7f2cb0004f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:43:40.576 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:40.561+0000 7f2cc77fe700 1 --2- 172.21.15.32:0/3045492052 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2cb0004b60 0x7f2cb0004f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:40.576 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:40.561+0000 7f2cc77fe700 1 -- 172.21.15.32:0/3045492052 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cb00046e0 con 0x7f2cb0005ec0 2023-10-08T13:43:40.576 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:40.565+0000 7f2cc77fe700 1 --2- 172.21.15.32:0/3045492052 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2cb0005ec0 0x7f2cb0006340 secure :-1 s=READY pgs=1872 cs=0 l=1 rev1=1 crypto rx=0x7f2cc8069b60 tx=0x7f2cb00069b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b0cfcf8d736e527 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:43:40.576 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:40.565+0000 7f2cc5ffb700 1 -- 172.21.15.32:0/3045492052 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cc804ef60 con 0x7f2cb0005ec0 2023-10-08T13:43:40.576 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:40.565+0000 7f2cc5ffb700 1 -- 172.21.15.32:0/3045492052 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cc8068250 con 0x7f2cb0005ec0 2023-10-08T13:43:40.576 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:40.565+0000 7f2cc5ffb700 1 -- 172.21.15.32:0/3045492052 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cc8068640 con 0x7f2cb0005ec0 2023-10-08T13:43:40.576 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:40.565+0000 7f2cc7fff700 1 -- 172.21.15.32:0/3045492052 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2cb0005ec0 msgr2=0x7f2cb0006340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:43:40.577 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:40.565+0000 7f2cc7fff700 1 --2- 172.21.15.32:0/3045492052 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2cb0005ec0 0x7f2cb0006340 secure :-1 s=READY pgs=1872 cs=0 l=1 rev1=1 crypto rx=0x7f2cc8069b60 tx=0x7f2cb00069b0 comp rx=0 tx=0).stop 2023-10-08T13:43:40.577 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:40.565+0000 7f2cc77fe700 1 -- 172.21.15.32:0/3045492052 reap_dead start 2023-10-08T13:43:40.577 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:40.565+0000 7f2cc7fff700 1 -- 172.21.15.32:0/3045492052 shutdown_connections 2023-10-08T13:43:40.577 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:40.565+0000 7f2cc7fff700 1 -- 172.21.15.32:0/3045492052 >> 172.21.15.32:0/3045492052 conn(0x7f2cc0054c90 msgr2=0x7f2cc00550a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:43:40.577 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:40.565+0000 7f2cc7fff700 1 -- 172.21.15.32:0/3045492052 shutdown_connections 2023-10-08T13:43:40.577 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:40.565+0000 7f2cc7fff700 1 -- 172.21.15.32:0/3045492052 wait complete. 2023-10-08T13:43:40.577 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:40.565+0000 7f2cc7fff700 1 Processor -- start 2023-10-08T13:43:40.578 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:40.565+0000 7f2cc7fff700 1 -- start start 2023-10-08T13:43:40.581 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:40.565+0000 7f2cc7fff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2cb0005ec0 0x7f2cc0165d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:43:40.581 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:40.565+0000 7f2cc7fff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2cc0169990 0x7f2cc0168110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:43:40.581 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:40.565+0000 7f2cc7fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2cc0047390 0x7f2cc0053100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:43:40.581 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:40.565+0000 7f2cc7fff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cc00e0ce0 con 0x7f2cc0047390 2023-10-08T13:43:40.582 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:40.565+0000 7f2cc7fff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cc0174830 con 0x7f2cb0005ec0 2023-10-08T13:43:40.582 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:40.565+0000 7f2cc7fff700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cc0169500 con 0x7f2cc0169990 2023-10-08T13:43:40.582 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:40.565+0000 7f2cc77fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2cc0047390 0x7f2cc0053100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:43:40.582 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:40.565+0000 7f2cc77fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2cc0047390 0x7f2cc0053100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:49120/0 (socket says 172.21.15.32:49120) 2023-10-08T13:43:40.582 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:40.565+0000 7f2cc77fe700 1 -- 172.21.15.32:0/3816263203 learned_addr learned my addr 172.21.15.32:0/3816263203 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T13:43:40.582 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:40.565+0000 7f2cc6ffd700 1 --2- 172.21.15.32:0/3816263203 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2cb0005ec0 0x7f2cc0165d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:43:40.582 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:40.565+0000 7f2cc67fc700 1 --2- 172.21.15.32:0/3816263203 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2cc0169990 0x7f2cc0168110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:43:40.583 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:40.565+0000 7f2cc77fe700 1 -- 172.21.15.32:0/3816263203 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2cc0169990 msgr2=0x7f2cc0168110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:43:40.583 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:40.565+0000 7f2cc77fe700 1 --2- 172.21.15.32:0/3816263203 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2cc0169990 0x7f2cc0168110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:40.583 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:40.565+0000 7f2cc77fe700 1 -- 172.21.15.32:0/3816263203 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2cb0005ec0 msgr2=0x7f2cc0165d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:43:40.583 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:40.565+0000 7f2cc77fe700 1 --2- 172.21.15.32:0/3816263203 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2cb0005ec0 0x7f2cc0165d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:40.583 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:40.565+0000 7f2cc77fe700 1 -- 172.21.15.32:0/3816263203 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cc0168650 con 0x7f2cc0047390 2023-10-08T13:43:40.583 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:40.569+0000 7f2cc77fe700 1 --2- 172.21.15.32:0/3816263203 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2cc0047390 0x7f2cc0053100 secure :-1 s=READY pgs=1873 cs=0 l=1 rev1=1 crypto rx=0x7f2cc8068190 tx=0x7f2cc806a080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:43:40.583 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:40.569+0000 7f2caf7fe700 1 -- 172.21.15.32:0/3816263203 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cc80685c0 con 0x7f2cc0047390 2023-10-08T13:43:40.584 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:40.569+0000 7f2caf7fe700 1 -- 172.21.15.32:0/3816263203 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cc8068760 con 0x7f2cc0047390 2023-10-08T13:43:40.584 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:40.569+0000 7f2cc7fff700 1 -- 172.21.15.32:0/3816263203 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2cc01688f0 con 0x7f2cc0047390 2023-10-08T13:43:40.584 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:40.569+0000 7f2caf7fe700 1 -- 172.21.15.32:0/3816263203 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cc8072390 con 0x7f2cc0047390 2023-10-08T13:43:40.584 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:40.569+0000 7f2cc7fff700 1 -- 172.21.15.32:0/3816263203 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cc0168eb0 con 0x7f2cc0047390 2023-10-08T13:43:40.584 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:40.569+0000 7f2caf7fe700 1 -- 172.21.15.32:0/3816263203 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f2cc8090020 con 0x7f2cc0047390 2023-10-08T13:43:40.584 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:40.569+0000 7f2caf7fe700 1 --2- 172.21.15.32:0/3816263203 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f2cb406a950 0x7f2cb406ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:43:40.584 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:40.569+0000 7f2caf7fe700 1 -- 172.21.15.32:0/3816263203 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2cc80fe020 con 0x7f2cc0047390 2023-10-08T13:43:40.585 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:40.569+0000 7f2cc6ffd700 1 --2- 172.21.15.32:0/3816263203 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f2cb406a950 0x7f2cb406ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:43:40.585 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:40.569+0000 7f2cc6ffd700 1 --2- 172.21.15.32:0/3816263203 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f2cb406a950 0x7f2cb406ce10 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f2cb8000f60 tx=0x7f2cb8001b30 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:43:40.586 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:40.581+0000 7f2cc7fff700 1 -- 172.21.15.32:0/3816263203 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2cc0169690 con 0x7f2cc0047390 2023-10-08T13:43:40.591 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:40.585+0000 7f2caf7fe700 1 -- 172.21.15.32:0/3816263203 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f2cc80cb530 con 0x7f2cc0047390 2023-10-08T13:43:40.891 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:40.885+0000 7f2cc7fff700 1 -- 172.21.15.32:0/3816263203 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2cc0005460 con 0x7f2cc0047390 2023-10-08T13:43:40.894 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:40.889+0000 7f2caf7fe700 1 -- 172.21.15.32:0/3816263203 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+4909 (secure 0 0 0) 0x7f2cc80a1070 con 0x7f2cc0047390 2023-10-08T13:43:40.897 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T13:43:40.897 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":14,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5232,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6835/1178250724","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6834","nonce":1178250724},{"type":"v1","addr":"172.21.15.32:6835","nonce":1178250724}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10},{"gid":5238,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6837/2723596589","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6836","nonce":2723596589},{"type":"v1","addr":"172.21.15.32:6837","nonce":2723596589}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10},{"gid":5323,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6833/3107673350","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":3107673350},{"type":"v1","addr":"172.21.15.40:6833","nonce":3107673350}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T06:10:35.216976+0000","modified":"2023-10-08T06:10:38.240290+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5326},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5326":{"gid":5326,"name":"b","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.40:6835/500201668","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":500201668},{"type":"v1","addr":"172.21.15.40:6835","nonce":500201668}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-10-08T13:43:40.901 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:40.897+0000 7f2cc7fff700 1 -- 172.21.15.32:0/3816263203 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f2cb406a950 msgr2=0x7f2cb406ce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:43:40.901 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:40.897+0000 7f2cc7fff700 1 --2- 172.21.15.32:0/3816263203 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f2cb406a950 0x7f2cb406ce10 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f2cb8000f60 tx=0x7f2cb8001b30 comp rx=0 tx=0).stop 2023-10-08T13:43:40.902 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:40.897+0000 7f2cc7fff700 1 -- 172.21.15.32:0/3816263203 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2cc0047390 msgr2=0x7f2cc0053100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:43:40.902 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:40.897+0000 7f2cc7fff700 1 --2- 172.21.15.32:0/3816263203 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2cc0047390 0x7f2cc0053100 secure :-1 s=READY pgs=1873 cs=0 l=1 rev1=1 crypto rx=0x7f2cc8068190 tx=0x7f2cc806a080 comp rx=0 tx=0).stop 2023-10-08T13:43:40.908 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:40.901+0000 7f2cc7fff700 1 -- 172.21.15.32:0/3816263203 shutdown_connections 2023-10-08T13:43:40.908 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:40.901+0000 7f2cc7fff700 1 --2- 172.21.15.32:0/3816263203 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f2cb406a950 0x7f2cb406ce10 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:40.908 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:40.901+0000 7f2cc7fff700 1 --2- 172.21.15.32:0/3816263203 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2cc0047390 0x7f2cc0053100 unknown :-1 s=CLOSED pgs=1873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:40.908 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:40.901+0000 7f2cc7fff700 1 --2- 172.21.15.32:0/3816263203 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2cc0169990 0x7f2cc0168110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:40.909 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:40.901+0000 7f2cc7fff700 1 --2- 172.21.15.32:0/3816263203 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2cb0005ec0 0x7f2cc0165d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:40.909 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:40.901+0000 7f2cc7fff700 1 -- 172.21.15.32:0/3816263203 >> 172.21.15.32:0/3816263203 conn(0x7f2cc0054c90 msgr2=0x7f2cc004cef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:43:40.909 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:40.901+0000 7f2cc7fff700 1 -- 172.21.15.32:0/3816263203 shutdown_connections 2023-10-08T13:43:40.909 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:40.901+0000 7f2cc7fff700 1 -- 172.21.15.32:0/3816263203 wait complete. 2023-10-08T13:43:40.909 INFO:teuthology.orchestra.run.smithi032.stderr:dumped fsmap epoch 14 2023-10-08T13:43:40.924 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T13:43:41.064 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:41.057+0000 7f467b1e4700 1 Processor -- start 2023-10-08T13:43:41.064 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:41.057+0000 7f467b1e4700 1 -- start start 2023-10-08T13:43:41.065 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:41.057+0000 7f467b1e4700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f467415d490 0x7f46740b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:43:41.066 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:41.057+0000 7f467b1e4700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f46740d13d0 0x7f46740cddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:43:41.066 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:41.057+0000 7f467b1e4700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f46740ce310 0x7f46740b4a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:43:41.066 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:41.057+0000 7f467b1e4700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46740ce770 con 0x7f46740d13d0 2023-10-08T13:43:41.066 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:41.057+0000 7f467b1e4700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46740d1bb0 con 0x7f46740ce310 2023-10-08T13:43:41.066 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:41.057+0000 7f467b1e4700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46740d1e90 con 0x7f467415d490 2023-10-08T13:43:41.066 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:41.057+0000 7f46799e1700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f46740d13d0 0x7f46740cddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:43:41.066 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:41.057+0000 7f46799e1700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f46740d13d0 0x7f46740cddd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:49130/0 (socket says 172.21.15.32:49130) 2023-10-08T13:43:41.066 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:41.057+0000 7f46799e1700 1 -- 172.21.15.32:0/3713670841 learned_addr learned my addr 172.21.15.32:0/3713670841 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T13:43:41.066 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:41.057+0000 7f467a1e2700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f467415d490 0x7f46740b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:43:41.066 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:41.057+0000 7f467a9e3700 1 --2- 172.21.15.32:0/3713670841 >> v2:172.21.15.40:3300/0 conn(0x7f46740ce310 0x7f46740b4a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:43:41.067 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:41.057+0000 7f46799e1700 1 -- 172.21.15.32:0/3713670841 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f467415d490 msgr2=0x7f46740b8bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:43:41.067 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:41.057+0000 7f46799e1700 1 --2- 172.21.15.32:0/3713670841 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f467415d490 0x7f46740b8bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:41.067 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:41.057+0000 7f46799e1700 1 -- 172.21.15.32:0/3713670841 >> v2:172.21.15.40:3300/0 conn(0x7f46740ce310 msgr2=0x7f46740b4a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:43:41.067 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:41.057+0000 7f46799e1700 1 --2- 172.21.15.32:0/3713670841 >> v2:172.21.15.40:3300/0 conn(0x7f46740ce310 0x7f46740b4a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:41.067 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:41.057+0000 7f46799e1700 1 -- 172.21.15.32:0/3713670841 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46740d2170 con 0x7f46740d13d0 2023-10-08T13:43:41.067 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:41.061+0000 7f46799e1700 1 --2- 172.21.15.32:0/3713670841 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f46740d13d0 0x7f46740cddd0 secure :-1 s=READY pgs=1874 cs=0 l=1 rev1=1 crypto rx=0x7f467406d550 tx=0x7f4664009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ef23b5166603b74 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:43:41.067 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:41.061+0000 7f46791e0700 1 -- 172.21.15.32:0/3713670841 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4664011830 con 0x7f46740d13d0 2023-10-08T13:43:41.067 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:41.061+0000 7f46791e0700 1 -- 172.21.15.32:0/3713670841 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4664011990 con 0x7f46740d13d0 2023-10-08T13:43:41.067 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:41.061+0000 7f46791e0700 1 -- 172.21.15.32:0/3713670841 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4664011d20 con 0x7f46740d13d0 2023-10-08T13:43:41.068 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:41.061+0000 7f467b1e4700 1 -- 172.21.15.32:0/3713670841 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f46740d13d0 msgr2=0x7f46740cddd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:43:41.068 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:41.061+0000 7f467b1e4700 1 --2- 172.21.15.32:0/3713670841 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f46740d13d0 0x7f46740cddd0 secure :-1 s=READY pgs=1874 cs=0 l=1 rev1=1 crypto rx=0x7f467406d550 tx=0x7f4664009bf0 comp rx=0 tx=0).stop 2023-10-08T13:43:41.068 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:41.061+0000 7f467b1e4700 1 -- 172.21.15.32:0/3713670841 shutdown_connections 2023-10-08T13:43:41.069 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:41.061+0000 7f467b1e4700 1 --2- 172.21.15.32:0/3713670841 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f46740d13d0 0x7f46740cddd0 unknown :-1 s=CLOSED pgs=1874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:41.069 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:41.061+0000 7f467b1e4700 1 --2- 172.21.15.32:0/3713670841 >> v2:172.21.15.40:3300/0 conn(0x7f46740ce310 0x7f46740b4a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:41.069 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:41.061+0000 7f467b1e4700 1 --2- 172.21.15.32:0/3713670841 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f467415d490 0x7f46740b8bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:41.069 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:41.061+0000 7f467b1e4700 1 -- 172.21.15.32:0/3713670841 >> 172.21.15.32:0/3713670841 conn(0x7f467406ab40 msgr2=0x7f467406af20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:43:41.069 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:41.061+0000 7f467b1e4700 1 -- 172.21.15.32:0/3713670841 shutdown_connections 2023-10-08T13:43:41.069 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:41.061+0000 7f467b1e4700 1 -- 172.21.15.32:0/3713670841 wait complete. 2023-10-08T13:43:41.069 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:41.061+0000 7f467b1e4700 1 Processor -- start 2023-10-08T13:43:41.071 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:41.061+0000 7f467b1e4700 1 -- start start 2023-10-08T13:43:41.072 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:41.061+0000 7f467b1e4700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f46740ce310 0x7f46741519d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:43:41.072 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:41.061+0000 7f467b1e4700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f46740d13d0 0x7f467415e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:43:41.072 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:41.061+0000 7f467b1e4700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f467415d490 0x7f467415ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:43:41.072 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:41.061+0000 7f467b1e4700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4674157c10 con 0x7f467415d490 2023-10-08T13:43:41.072 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:41.061+0000 7f467b1e4700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f467415f430 con 0x7f46740ce310 2023-10-08T13:43:41.072 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:41.061+0000 7f467b1e4700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f467415f710 con 0x7f46740d13d0 2023-10-08T13:43:41.072 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:41.065+0000 7f46799e1700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f46740d13d0 0x7f467415e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:43:41.072 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:41.065+0000 7f467a9e3700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f467415d490 0x7f467415ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:43:41.072 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:41.065+0000 7f46799e1700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f46740d13d0 0x7f467415e8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.32:46716/0 (socket says 172.21.15.32:46716) 2023-10-08T13:43:41.073 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:41.065+0000 7f46799e1700 1 -- 172.21.15.32:0/3192509729 learned_addr learned my addr 172.21.15.32:0/3192509729 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T13:43:41.073 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:41.065+0000 7f467a1e2700 1 --2- 172.21.15.32:0/3192509729 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f46740ce310 0x7f46741519d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:43:41.073 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:41.065+0000 7f467a9e3700 1 -- 172.21.15.32:0/3192509729 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f46740d13d0 msgr2=0x7f467415e8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:43:41.073 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:41.065+0000 7f467a9e3700 1 --2- 172.21.15.32:0/3192509729 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f46740d13d0 0x7f467415e8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:41.073 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:41.065+0000 7f467a9e3700 1 -- 172.21.15.32:0/3192509729 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f46740ce310 msgr2=0x7f46741519d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:43:41.073 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:41.065+0000 7f467a9e3700 1 --2- 172.21.15.32:0/3192509729 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f46740ce310 0x7f46741519d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:41.073 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:41.065+0000 7f467a9e3700 1 -- 172.21.15.32:0/3192509729 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4664009570 con 0x7f467415d490 2023-10-08T13:43:41.073 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:41.065+0000 7f467a9e3700 1 --2- 172.21.15.32:0/3192509729 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f467415d490 0x7f467415ee00 secure :-1 s=READY pgs=1875 cs=0 l=1 rev1=1 crypto rx=0x7f466c00eab0 tx=0x7f466c00edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:43:41.074 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:41.069+0000 7f466affd700 1 -- 172.21.15.32:0/3192509729 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f466c017d50 con 0x7f467415d490 2023-10-08T13:43:41.074 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:41.069+0000 7f466affd700 1 -- 172.21.15.32:0/3192509729 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f466c00b520 con 0x7f467415d490 2023-10-08T13:43:41.074 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:41.069+0000 7f466affd700 1 -- 172.21.15.32:0/3192509729 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f466c00b8d0 con 0x7f467415d490 2023-10-08T13:43:41.074 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:41.069+0000 7f467b1e4700 1 -- 172.21.15.32:0/3192509729 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f467415f9f0 con 0x7f467415d490 2023-10-08T13:43:41.074 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:41.069+0000 7f467b1e4700 1 -- 172.21.15.32:0/3192509729 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f467415ffb0 con 0x7f467415d490 2023-10-08T13:43:41.077 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:41.073+0000 7f467b1e4700 1 -- 172.21.15.32:0/3192509729 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46741601d0 con 0x7f467415d490 2023-10-08T13:43:41.078 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:41.073+0000 7f466affd700 1 -- 172.21.15.32:0/3192509729 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f466c00ba30 con 0x7f467415d490 2023-10-08T13:43:41.079 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:41.073+0000 7f466affd700 1 --2- 172.21.15.32:0/3192509729 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f4658066560 0x7f4658068a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:43:41.079 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:41.073+0000 7f466affd700 1 -- 172.21.15.32:0/3192509729 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f466c08ca20 con 0x7f467415d490 2023-10-08T13:43:41.079 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:41.073+0000 7f467a1e2700 1 --2- 172.21.15.32:0/3192509729 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f4658066560 0x7f4658068a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:43:41.080 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:41.073+0000 7f467a1e2700 1 --2- 172.21.15.32:0/3192509729 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f4658066560 0x7f4658068a20 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f4670009b80 tx=0x7f4670008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:43:41.084 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:41.077+0000 7f466affd700 1 -- 172.21.15.32:0/3192509729 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f466c059e80 con 0x7f467415d490 2023-10-08T13:43:41.325 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:41.317+0000 7f467b1e4700 1 -- 172.21.15.32:0/3192509729 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4674073f00 con 0x7f467415d490 2023-10-08T13:43:41.329 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:41.325+0000 7f466affd700 1 -- 172.21.15.32:0/3192509729 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) v1 ==== 74+0+16509 (secure 0 0 0) 0x7f466c024020 con 0x7f467415d490 2023-10-08T13:43:41.330 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T13:43:41.330 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":35,"fsid":"ac672d87-96ae-41e0-9314-623ba2cdbbba","created":"2023-10-08T06:09:11.175626+0000","modified":"2023-10-08T06:10:36.862351+0000","last_up_change":"2023-10-08T06:09:22.744643+0000","last_in_change":"2023-10-08T06:09:14.131580+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T06:09:23.307843+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-10-08T06:10:33.777525+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-10-08T06:10:34.202152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"43433f0c-9592-4874-92d7-10f8f4acf07f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":587888964},{"type":"v1","addr":"172.21.15.32:6801","nonce":587888964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":587888964},{"type":"v1","addr":"172.21.15.32:6803","nonce":587888964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":587888964},{"type":"v1","addr":"172.21.15.32:6810","nonce":587888964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6805","nonce":587888964},{"type":"v1","addr":"172.21.15.32:6807","nonce":587888964}]},"public_addr":"172.21.15.32:6801/587888964","cluster_addr":"172.21.15.32:6803/587888964","heartbeat_back_addr":"172.21.15.32:6810/587888964","heartbeat_front_addr":"172.21.15.32:6807/587888964","state":["exists","up"]},{"osd":1,"uuid":"2ecb1008-b987-4ce7-b646-6cded55fc8d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":990576767},{"type":"v1","addr":"172.21.15.32:6817","nonce":990576767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":990576767},{"type":"v1","addr":"172.21.15.32:6819","nonce":990576767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":990576767},{"type":"v1","addr":"172.21.15.32:6823","nonce":990576767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":990576767},{"type":"v1","addr":"172.21.15.32:6821","nonce":990576767}]},"public_addr":"172.21.15.32:6817/990576767","cluster_addr":"172.21.15.32:6819/990576767","heartbeat_back_addr":"172.21.15.32:6823/990576767","heartbeat_front_addr":"172.21.15.32:6821/990576767","state":["exists","up"]},{"osd":2,"uuid":"1b131c94-c09b-4e80-8746-bf1b7bac362d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6824","nonce":1566874440},{"type":"v1","addr":"172.21.15.32:6825","nonce":1566874440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":1566874440},{"type":"v1","addr":"172.21.15.32:6827","nonce":1566874440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":1566874440},{"type":"v1","addr":"172.21.15.32:6831","nonce":1566874440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":1566874440},{"type":"v1","addr":"172.21.15.32:6829","nonce":1566874440}]},"public_addr":"172.21.15.32:6825/1566874440","cluster_addr":"172.21.15.32:6827/1566874440","heartbeat_back_addr":"172.21.15.32:6831/1566874440","heartbeat_front_addr":"172.21.15.32:6829/1566874440","state":["exists","up"]},{"osd":3,"uuid":"ad655af2-1f6f-4689-b21d-b07bbaeb68b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":3672614802},{"type":"v1","addr":"172.21.15.32:6806","nonce":3672614802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6809","nonce":3672614802},{"type":"v1","addr":"172.21.15.32:6811","nonce":3672614802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":3672614802},{"type":"v1","addr":"172.21.15.32:6815","nonce":3672614802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":3672614802},{"type":"v1","addr":"172.21.15.32:6813","nonce":3672614802}]},"public_addr":"172.21.15.32:6806/3672614802","cluster_addr":"172.21.15.32:6811/3672614802","heartbeat_back_addr":"172.21.15.32:6815/3672614802","heartbeat_front_addr":"172.21.15.32:6813/3672614802","state":["exists","up"]},{"osd":4,"uuid":"64a543a1-8c4f-458e-9aba-b35c1cd7dd03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":3369928244},{"type":"v1","addr":"172.21.15.40:6801","nonce":3369928244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":3369928244},{"type":"v1","addr":"172.21.15.40:6803","nonce":3369928244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":3369928244},{"type":"v1","addr":"172.21.15.40:6807","nonce":3369928244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":3369928244},{"type":"v1","addr":"172.21.15.40:6805","nonce":3369928244}]},"public_addr":"172.21.15.40:6801/3369928244","cluster_addr":"172.21.15.40:6803/3369928244","heartbeat_back_addr":"172.21.15.40:6807/3369928244","heartbeat_front_addr":"172.21.15.40:6805/3369928244","state":["exists","up"]},{"osd":5,"uuid":"0fef3e54-edb4-4678-878e-944663c51638","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":2395850297},{"type":"v1","addr":"172.21.15.40:6825","nonce":2395850297}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":2395850297},{"type":"v1","addr":"172.21.15.40:6827","nonce":2395850297}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":2395850297},{"type":"v1","addr":"172.21.15.40:6831","nonce":2395850297}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":2395850297},{"type":"v1","addr":"172.21.15.40:6829","nonce":2395850297}]},"public_addr":"172.21.15.40:6825/2395850297","cluster_addr":"172.21.15.40:6827/2395850297","heartbeat_back_addr":"172.21.15.40:6831/2395850297","heartbeat_front_addr":"172.21.15.40:6829/2395850297","state":["exists","up"]},{"osd":6,"uuid":"2eeb0472-6096-469d-9b2c-cab4bf41c31a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":4145283410},{"type":"v1","addr":"172.21.15.40:6809","nonce":4145283410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":4145283410},{"type":"v1","addr":"172.21.15.40:6811","nonce":4145283410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":4145283410},{"type":"v1","addr":"172.21.15.40:6815","nonce":4145283410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":4145283410},{"type":"v1","addr":"172.21.15.40:6813","nonce":4145283410}]},"public_addr":"172.21.15.40:6809/4145283410","cluster_addr":"172.21.15.40:6811/4145283410","heartbeat_back_addr":"172.21.15.40:6815/4145283410","heartbeat_front_addr":"172.21.15.40:6813/4145283410","state":["exists","up"]},{"osd":7,"uuid":"cf76e4c7-96a6-401f-a280-91aad4641940","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":2943297416},{"type":"v1","addr":"172.21.15.40:6817","nonce":2943297416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":2943297416},{"type":"v1","addr":"172.21.15.40:6819","nonce":2943297416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":2943297416},{"type":"v1","addr":"172.21.15.40:6823","nonce":2943297416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":2943297416},{"type":"v1","addr":"172.21.15.40:6821","nonce":2943297416}]},"public_addr":"172.21.15.40:6817/2943297416","cluster_addr":"172.21.15.40:6819/2943297416","heartbeat_back_addr":"172.21.15.40:6823/2943297416","heartbeat_front_addr":"172.21.15.40:6821/2943297416","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.411475+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.628841+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.599055+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.166100+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.384135+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.488403+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.307648+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.363541+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T13:43:41.333 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:41.325+0000 7f467b1e4700 1 -- 172.21.15.32:0/3192509729 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f4658066560 msgr2=0x7f4658068a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:43:41.333 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:41.325+0000 7f467b1e4700 1 --2- 172.21.15.32:0/3192509729 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f4658066560 0x7f4658068a20 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f4670009b80 tx=0x7f4670008040 comp rx=0 tx=0).stop 2023-10-08T13:43:41.333 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:41.325+0000 7f467b1e4700 1 -- 172.21.15.32:0/3192509729 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f467415d490 msgr2=0x7f467415ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:43:41.333 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:41.325+0000 7f467b1e4700 1 --2- 172.21.15.32:0/3192509729 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f467415d490 0x7f467415ee00 secure :-1 s=READY pgs=1875 cs=0 l=1 rev1=1 crypto rx=0x7f466c00eab0 tx=0x7f466c00edc0 comp rx=0 tx=0).stop 2023-10-08T13:43:41.333 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:41.325+0000 7f467b1e4700 1 -- 172.21.15.32:0/3192509729 shutdown_connections 2023-10-08T13:43:41.333 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:41.325+0000 7f467b1e4700 1 --2- 172.21.15.32:0/3192509729 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f4658066560 0x7f4658068a20 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:41.333 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:41.325+0000 7f467b1e4700 1 --2- 172.21.15.32:0/3192509729 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f467415d490 0x7f467415ee00 unknown :-1 s=CLOSED pgs=1875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:41.333 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:41.325+0000 7f467b1e4700 1 --2- 172.21.15.32:0/3192509729 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f46740d13d0 0x7f467415e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:41.334 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:41.325+0000 7f467b1e4700 1 --2- 172.21.15.32:0/3192509729 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f46740ce310 0x7f46741519d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:41.334 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:41.325+0000 7f467b1e4700 1 -- 172.21.15.32:0/3192509729 >> 172.21.15.32:0/3192509729 conn(0x7f467406ab40 msgr2=0x7f46740b7a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:43:41.334 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:41.325+0000 7f467b1e4700 1 -- 172.21.15.32:0/3192509729 shutdown_connections 2023-10-08T13:43:41.334 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:41.325+0000 7f467b1e4700 1 -- 172.21.15.32:0/3192509729 wait complete. 2023-10-08T13:43:41.345 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T06:09:23.307843+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-08T06:10:33.777525+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '34', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2023-10-08T06:10:34.202152+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '35', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-08T13:43:41.346 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T13:43:41.492 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:41.485+0000 7fb7cac70700 1 Processor -- start 2023-10-08T13:43:41.504 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:41.493+0000 7fb7cac70700 1 -- start start 2023-10-08T13:43:41.504 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:41.493+0000 7fb7cac70700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fb7c4159c90 0x7fb7c40b4b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:43:41.504 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:41.493+0000 7fb7cac70700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb7c40b50c0 0x7fb7c40cd380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:43:41.505 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:41.493+0000 7fb7cac70700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7c40b4130 con 0x7fb7c40cd8c0 2023-10-08T13:43:41.505 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:41.493+0000 7fb7cac70700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7c40cdd30 con 0x7fb7c4159c90 2023-10-08T13:43:41.505 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:41.493+0000 7fb7cac70700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7c40b0940 con 0x7fb7c40b50c0 2023-10-08T13:43:41.505 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:41.493+0000 7fb7ca46f700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fb7c40cd8c0 0x7fb7c40cf3f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:38256/0 (socket says 172.21.15.32:38256) 2023-10-08T13:43:41.505 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:41.493+0000 7fb7ca46f700 1 -- 172.21.15.32:0/2825802097 learned_addr learned my addr 172.21.15.32:0/2825802097 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-08T13:43:41.506 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:41.493+0000 7fb7c9c6e700 1 --2- 172.21.15.32:0/2825802097 >> v2:172.21.15.32:3300/0 conn(0x7fb7c4159c90 0x7fb7c40b4b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:43:41.506 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:41.493+0000 7fb7c946d700 1 --2- 172.21.15.32:0/2825802097 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb7c40b50c0 0x7fb7c40cd380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:43:41.506 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:41.493+0000 7fb7c8c6c700 1 -- 172.21.15.32:0/2825802097 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3498576903 0 0) 0x7fb7c40b4130 con 0x7fb7c40cd8c0 2023-10-08T13:43:41.506 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:41.493+0000 7fb7c8c6c700 1 -- 172.21.15.32:0/2825802097 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb7b00035d0 con 0x7fb7c40cd8c0 2023-10-08T13:43:41.506 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:41.493+0000 7fb7c9c6e700 1 -- 172.21.15.32:0/2825802097 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb7c40b50c0 msgr2=0x7fb7c40cd380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:43:41.506 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:41.493+0000 7fb7c9c6e700 1 --2- 172.21.15.32:0/2825802097 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb7c40b50c0 0x7fb7c40cd380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:41.507 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:41.493+0000 7fb7c9c6e700 1 -- 172.21.15.32:0/2825802097 >> v1:172.21.15.32:6789/0 conn(0x7fb7c40cd8c0 legacy=0x7fb7c40cf3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:43:41.507 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:41.493+0000 7fb7c9c6e700 1 -- 172.21.15.32:0/2825802097 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7c40b0c20 con 0x7fb7c4159c90 2023-10-08T13:43:41.507 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:41.497+0000 7fb7c9c6e700 1 --2- 172.21.15.32:0/2825802097 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb7c4159c90 0x7fb7c40b4b80 secure :-1 s=READY pgs=1877 cs=0 l=1 rev1=1 crypto rx=0x7fb7b4009840 tx=0x7fb7b4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a32dc84a98bcb99b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:43:41.507 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:41.497+0000 7fb7c8c6c700 1 -- 172.21.15.32:0/2825802097 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7b4004230 con 0x7fb7c4159c90 2023-10-08T13:43:41.507 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:41.497+0000 7fb7c8c6c700 1 -- 172.21.15.32:0/2825802097 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7b4004390 con 0x7fb7c4159c90 2023-10-08T13:43:41.508 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:41.497+0000 7fb7c8c6c700 1 -- 172.21.15.32:0/2825802097 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7b40036c0 con 0x7fb7c4159c90 2023-10-08T13:43:41.508 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:41.497+0000 7fb7cac70700 1 -- 172.21.15.32:0/2825802097 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb7c4159c90 msgr2=0x7fb7c40b4b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:43:41.508 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:41.497+0000 7fb7cac70700 1 --2- 172.21.15.32:0/2825802097 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb7c4159c90 0x7fb7c40b4b80 secure :-1 s=READY pgs=1877 cs=0 l=1 rev1=1 crypto rx=0x7fb7b4009840 tx=0x7fb7b4009b50 comp rx=0 tx=0).stop 2023-10-08T13:43:41.508 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:41.497+0000 7fb7cac70700 1 -- 172.21.15.32:0/2825802097 shutdown_connections 2023-10-08T13:43:41.508 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:41.497+0000 7fb7cac70700 1 --2- 172.21.15.32:0/2825802097 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb7c40b50c0 0x7fb7c40cd380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:41.508 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:41.497+0000 7fb7cac70700 1 --2- 172.21.15.32:0/2825802097 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb7c4159c90 0x7fb7c40b4b80 unknown :-1 s=CLOSED pgs=1877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:41.509 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:41.497+0000 7fb7cac70700 1 -- 172.21.15.32:0/2825802097 >> 172.21.15.32:0/2825802097 conn(0x7fb7c40718a0 msgr2=0x7fb7c4071cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:43:41.509 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:41.501+0000 7fb7cac70700 1 -- 172.21.15.32:0/2825802097 shutdown_connections 2023-10-08T13:43:41.511 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:41.505+0000 7fb7cac70700 1 -- 172.21.15.32:0/2825802097 wait complete. 2023-10-08T13:43:41.513 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:41.505+0000 7fb7cac70700 1 Processor -- start 2023-10-08T13:43:41.513 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:41.505+0000 7fb7cac70700 1 -- start start 2023-10-08T13:43:41.514 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:41.509+0000 7fb7cac70700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb7c40cd8c0 0x7fb7c4158ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:43:41.514 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:41.509+0000 7fb7cac70700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb7c4159c90 0x7fb7c415af90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:43:41.514 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:41.509+0000 7fb7cac70700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb7c40c4100 0x7fb7c40c4590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:43:41.514 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:41.509+0000 7fb7cac70700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7c4159430 con 0x7fb7c4159c90 2023-10-08T13:43:41.515 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:41.509+0000 7fb7cac70700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7c40c4ad0 con 0x7fb7c40c4100 2023-10-08T13:43:41.515 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:41.509+0000 7fb7cac70700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7c41f2a50 con 0x7fb7c40cd8c0 2023-10-08T13:43:41.515 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:41.509+0000 7fb7c946d700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb7c4159c90 0x7fb7c415af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:43:41.515 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:41.509+0000 7fb7c946d700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb7c4159c90 0x7fb7c415af90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:49158/0 (socket says 172.21.15.32:49158) 2023-10-08T13:43:41.515 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:41.509+0000 7fb7c946d700 1 -- 172.21.15.32:0/1350779472 learned_addr learned my addr 172.21.15.32:0/1350779472 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T13:43:41.515 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:41.509+0000 7fb7c9c6e700 1 --2- 172.21.15.32:0/1350779472 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb7c40cd8c0 0x7fb7c4158ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:43:41.516 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:41.509+0000 7fb7c946d700 1 -- 172.21.15.32:0/1350779472 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb7c40cd8c0 msgr2=0x7fb7c4158ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:43:41.516 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:41.509+0000 7fb7c946d700 1 --2- 172.21.15.32:0/1350779472 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb7c40cd8c0 0x7fb7c4158ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:41.516 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:41.509+0000 7fb7c946d700 1 -- 172.21.15.32:0/1350779472 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb7c40c4100 msgr2=0x7fb7c40c4590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T13:43:41.516 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:41.509+0000 7fb7c946d700 1 --2- 172.21.15.32:0/1350779472 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb7c40c4100 0x7fb7c40c4590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:41.516 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:41.509+0000 7fb7c946d700 1 -- 172.21.15.32:0/1350779472 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7b4009450 con 0x7fb7c4159c90 2023-10-08T13:43:41.516 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:41.509+0000 7fb7c946d700 1 --2- 172.21.15.32:0/1350779472 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb7c4159c90 0x7fb7c415af90 secure :-1 s=READY pgs=1878 cs=0 l=1 rev1=1 crypto rx=0x7fb7c000f980 tx=0x7fb7c000fc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:43:41.516 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:41.509+0000 7fb7ba7fc700 1 -- 172.21.15.32:0/1350779472 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7c000c070 con 0x7fb7c4159c90 2023-10-08T13:43:41.516 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:41.509+0000 7fb7ba7fc700 1 -- 172.21.15.32:0/1350779472 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7c000db60 con 0x7fb7c4159c90 2023-10-08T13:43:41.517 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:41.509+0000 7fb7cac70700 1 -- 172.21.15.32:0/1350779472 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7c415b900 con 0x7fb7c4159c90 2023-10-08T13:43:41.517 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:41.509+0000 7fb7ba7fc700 1 -- 172.21.15.32:0/1350779472 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7c000fe70 con 0x7fb7c4159c90 2023-10-08T13:43:41.517 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:41.509+0000 7fb7cac70700 1 -- 172.21.15.32:0/1350779472 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7c415bec0 con 0x7fb7c4159c90 2023-10-08T13:43:41.525 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:41.517+0000 7fb7cac70700 1 -- 172.21.15.32:0/1350779472 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7ac005310 con 0x7fb7c4159c90 2023-10-08T13:43:41.525 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:41.517+0000 7fb7ba7fc700 1 -- 172.21.15.32:0/1350779472 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fb7c0012460 con 0x7fb7c4159c90 2023-10-08T13:43:41.525 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:41.517+0000 7fb7ba7fc700 1 --2- 172.21.15.32:0/1350779472 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fb7b00669a0 0x7fb7b0068e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:43:41.525 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:41.517+0000 7fb7ba7fc700 1 -- 172.21.15.32:0/1350779472 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb7c0083ce0 con 0x7fb7c4159c90 2023-10-08T13:43:41.526 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:41.521+0000 7fb7c9c6e700 1 --2- 172.21.15.32:0/1350779472 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fb7b00669a0 0x7fb7b0068e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:43:41.526 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:41.521+0000 7fb7c9c6e700 1 --2- 172.21.15.32:0/1350779472 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fb7b00669a0 0x7fb7b0068e60 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7fb7b4009840 tx=0x7fb7b4010000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:43:41.531 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:41.525+0000 7fb7ba7fc700 1 -- 172.21.15.32:0/1350779472 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fb7c0051150 con 0x7fb7c4159c90 2023-10-08T13:43:41.771 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:41.765+0000 7fb7cac70700 1 -- 172.21.15.32:0/1350779472 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb7ac005b40 con 0x7fb7c4159c90 2023-10-08T13:43:41.771 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:41.765+0000 7fb7ba7fc700 1 -- 172.21.15.32:0/1350779472 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v35) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb7c00210a0 con 0x7fb7c4159c90 2023-10-08T13:43:41.772 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 1 2023-10-08T13:43:41.774 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:41.769+0000 7fb7cac70700 1 -- 172.21.15.32:0/1350779472 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fb7b00669a0 msgr2=0x7fb7b0068e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:43:41.774 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:41.769+0000 7fb7cac70700 1 --2- 172.21.15.32:0/1350779472 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fb7b00669a0 0x7fb7b0068e60 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7fb7b4009840 tx=0x7fb7b4010000 comp rx=0 tx=0).stop 2023-10-08T13:43:41.774 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:41.769+0000 7fb7cac70700 1 -- 172.21.15.32:0/1350779472 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb7c4159c90 msgr2=0x7fb7c415af90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:43:41.774 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:41.769+0000 7fb7cac70700 1 --2- 172.21.15.32:0/1350779472 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb7c4159c90 0x7fb7c415af90 secure :-1 s=READY pgs=1878 cs=0 l=1 rev1=1 crypto rx=0x7fb7c000f980 tx=0x7fb7c000fc90 comp rx=0 tx=0).stop 2023-10-08T13:43:41.774 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:41.769+0000 7fb7cac70700 1 -- 172.21.15.32:0/1350779472 shutdown_connections 2023-10-08T13:43:41.774 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:41.769+0000 7fb7cac70700 1 --2- 172.21.15.32:0/1350779472 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fb7b00669a0 0x7fb7b0068e60 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:41.774 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:41.769+0000 7fb7cac70700 1 --2- 172.21.15.32:0/1350779472 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb7c4159c90 0x7fb7c415af90 unknown :-1 s=CLOSED pgs=1878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:41.775 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:41.769+0000 7fb7cac70700 1 --2- 172.21.15.32:0/1350779472 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb7c40c4100 0x7fb7c40c4590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:41.775 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:41.769+0000 7fb7cac70700 1 --2- 172.21.15.32:0/1350779472 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb7c40cd8c0 0x7fb7c4158ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:41.775 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:41.769+0000 7fb7cac70700 1 -- 172.21.15.32:0/1350779472 >> 172.21.15.32:0/1350779472 conn(0x7fb7c40718a0 msgr2=0x7fb7c40cbe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:43:41.775 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:41.769+0000 7fb7cac70700 1 -- 172.21.15.32:0/1350779472 shutdown_connections 2023-10-08T13:43:41.775 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:41.769+0000 7fb7cac70700 1 -- 172.21.15.32:0/1350779472 wait complete. 2023-10-08T13:43:41.790 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-08T13:43:41.939 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:41.933+0000 7f74a359e700 1 Processor -- start 2023-10-08T13:43:41.939 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:41.933+0000 7f74a359e700 1 -- start start 2023-10-08T13:43:41.941 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:41.933+0000 7f74a359e700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f74a4159ed0 0x7f74a40ca9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:43:41.941 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:41.933+0000 7f74a359e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f74a40c98c0 0x7f74a40cb510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:43:41.941 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:41.933+0000 7f74a359e700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74a40cca40 con 0x7f74a415a2b0 2023-10-08T13:43:41.941 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:41.933+0000 7f74a359e700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74a40ccdb0 con 0x7f74a4159ed0 2023-10-08T13:43:41.941 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:41.933+0000 7f74a359e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74a40caef0 con 0x7f74a40c98c0 2023-10-08T13:43:41.941 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:41.933+0000 7f749bfff700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f74a415a2b0 0x7f74a40706f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.32:33036/0 (socket says 172.21.15.32:33036) 2023-10-08T13:43:41.941 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:41.933+0000 7f749bfff700 1 -- 172.21.15.32:0/2728166183 learned_addr learned my addr 172.21.15.32:0/2728166183 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-08T13:43:41.941 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:41.933+0000 7f74a259c700 1 --2- 172.21.15.32:0/2728166183 >> v2:172.21.15.32:3300/0 conn(0x7f74a4159ed0 0x7f74a40ca9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:43:41.942 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:41.933+0000 7f74a259c700 1 -- 172.21.15.32:0/2728166183 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f74a40c98c0 msgr2=0x7f74a40cb510 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-08T13:43:41.942 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:41.933+0000 7f74a259c700 1 --2- 172.21.15.32:0/2728166183 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f74a40c98c0 0x7f74a40cb510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:41.942 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:41.933+0000 7f74a259c700 1 -- 172.21.15.32:0/2728166183 >> v1:172.21.15.40:6789/0 conn(0x7f74a415a2b0 legacy=0x7f74a40706f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:43:41.942 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:41.937+0000 7f74a259c700 1 -- 172.21.15.32:0/2728166183 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74a40cdf60 con 0x7f74a4159ed0 2023-10-08T13:43:41.943 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:41.937+0000 7f74a259c700 1 --2- 172.21.15.32:0/2728166183 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f74a4159ed0 0x7f74a40ca9b0 secure :-1 s=READY pgs=1879 cs=0 l=1 rev1=1 crypto rx=0x7f749400b050 tx=0x7f749400b360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ceb176250ec47a33 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:43:41.944 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:41.937+0000 7f74a1d9b700 1 -- 172.21.15.32:0/2728166183 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f749400e070 con 0x7f74a4159ed0 2023-10-08T13:43:41.944 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:41.937+0000 7f74a1d9b700 1 -- 172.21.15.32:0/2728166183 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7494003a40 con 0x7f74a4159ed0 2023-10-08T13:43:41.945 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:41.937+0000 7f74a359e700 1 -- 172.21.15.32:0/2728166183 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f74a4159ed0 msgr2=0x7f74a40ca9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:43:41.945 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:41.937+0000 7f74a359e700 1 --2- 172.21.15.32:0/2728166183 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f74a4159ed0 0x7f74a40ca9b0 secure :-1 s=READY pgs=1879 cs=0 l=1 rev1=1 crypto rx=0x7f749400b050 tx=0x7f749400b360 comp rx=0 tx=0).stop 2023-10-08T13:43:41.946 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:41.937+0000 7f74a359e700 1 -- 172.21.15.32:0/2728166183 shutdown_connections 2023-10-08T13:43:41.946 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:41.937+0000 7f74a359e700 1 --2- 172.21.15.32:0/2728166183 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f74a40c98c0 0x7f74a40cb510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:41.946 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:41.937+0000 7f74a359e700 1 --2- 172.21.15.32:0/2728166183 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f74a4159ed0 0x7f74a40ca9b0 unknown :-1 s=CLOSED pgs=1879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:41.946 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:41.937+0000 7f74a359e700 1 -- 172.21.15.32:0/2728166183 >> 172.21.15.32:0/2728166183 conn(0x7f74a40b0900 msgr2=0x7f74a40b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:43:41.946 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:41.941+0000 7f74a359e700 1 -- 172.21.15.32:0/2728166183 shutdown_connections 2023-10-08T13:43:41.946 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:41.941+0000 7f74a359e700 1 -- 172.21.15.32:0/2728166183 wait complete. 2023-10-08T13:43:41.947 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:41.941+0000 7f74a359e700 1 Processor -- start 2023-10-08T13:43:41.947 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:41.941+0000 7f74a359e700 1 -- start start 2023-10-08T13:43:41.949 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:41.941+0000 7f74a359e700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f74a40c98c0 0x7f74a40c4510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:43:41.949 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:41.941+0000 7f74a359e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f74a4159ed0 0x7f74a4158c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:43:41.949 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:41.941+0000 7f74a359e700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f74a415a2b0 0x7f74a40b38e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:43:41.949 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:41.941+0000 7f74a359e700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74a41596c0 con 0x7f74a40c98c0 2023-10-08T13:43:41.949 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:41.941+0000 7f74a359e700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74a40c4080 con 0x7f74a415a2b0 2023-10-08T13:43:41.949 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:41.941+0000 7f74a359e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74a4159140 con 0x7f74a4159ed0 2023-10-08T13:43:41.949 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:41.941+0000 7f74a2d9d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f74a415a2b0 0x7f74a40b38e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:43:41.949 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:41.941+0000 7f749bfff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f74a4159ed0 0x7f74a4158c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:43:41.949 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:41.941+0000 7f74a2d9d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f74a415a2b0 0x7f74a40b38e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.32:50858/0 (socket says 172.21.15.32:50858) 2023-10-08T13:43:41.950 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:41.941+0000 7f74a2d9d700 1 -- 172.21.15.32:0/549916020 learned_addr learned my addr 172.21.15.32:0/549916020 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T13:43:41.950 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:41.941+0000 7f74a2d9d700 1 -- 172.21.15.32:0/549916020 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f74a4159ed0 msgr2=0x7f74a4158c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:43:41.951 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:41.941+0000 7f74a2d9d700 1 --2- 172.21.15.32:0/549916020 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f74a4159ed0 0x7f74a4158c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:41.951 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:41.941+0000 7f74a2d9d700 1 -- 172.21.15.32:0/549916020 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f74a40c98c0 msgr2=0x7f74a40c4510 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T13:43:41.951 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:41.941+0000 7f74a2d9d700 1 --2- 172.21.15.32:0/549916020 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f74a40c98c0 0x7f74a40c4510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:41.951 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:41.941+0000 7f74a2d9d700 1 -- 172.21.15.32:0/549916020 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7494009a70 con 0x7f74a415a2b0 2023-10-08T13:43:41.951 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:41.945+0000 7f74a2d9d700 1 --2- 172.21.15.32:0/549916020 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f74a415a2b0 0x7f74a40b38e0 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f749c00b440 tx=0x7f749c00b750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:43:41.958 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:41.953+0000 7f749affd700 1 -- 172.21.15.32:0/549916020 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f749c011830 con 0x7f74a415a2b0 2023-10-08T13:43:41.958 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:41.953+0000 7f749affd700 1 -- 172.21.15.32:0/549916020 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f749c0119b0 con 0x7f74a415a2b0 2023-10-08T13:43:41.958 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:41.953+0000 7f74a359e700 1 -- 172.21.15.32:0/549916020 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74a40c5960 con 0x7f74a415a2b0 2023-10-08T13:43:41.958 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:41.953+0000 7f749affd700 1 -- 172.21.15.32:0/549916020 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f749c011d60 con 0x7f74a415a2b0 2023-10-08T13:43:41.959 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:41.953+0000 7f74a359e700 1 -- 172.21.15.32:0/549916020 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74a40c3a30 con 0x7f74a415a2b0 2023-10-08T13:43:41.959 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:41.953+0000 7f74a359e700 1 -- 172.21.15.32:0/549916020 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7488005310 con 0x7f74a415a2b0 2023-10-08T13:43:41.962 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:41.957+0000 7f749affd700 1 -- 172.21.15.32:0/549916020 <== mon.1 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f749c01a400 con 0x7f74a415a2b0 2023-10-08T13:43:41.963 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:41.957+0000 7f749affd700 1 --2- 172.21.15.32:0/549916020 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f7484066510 0x7f74840689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:43:41.963 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:41.957+0000 7f749affd700 1 -- 172.21.15.32:0/549916020 <== mon.1 v2:172.21.15.40:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f749c0841e0 con 0x7f74a415a2b0 2023-10-08T13:43:41.963 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:41.957+0000 7f74a259c700 1 --2- 172.21.15.32:0/549916020 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f7484066510 0x7f74840689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:43:41.964 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:41.957+0000 7f74a259c700 1 --2- 172.21.15.32:0/549916020 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f7484066510 0x7f74840689d0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f74a40b4460 tx=0x7f7494011000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:43:41.967 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:41.961+0000 7f749affd700 1 -- 172.21.15.32:0/549916020 <== mon.1 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f749c051880 con 0x7f74a415a2b0 2023-10-08T13:43:42.218 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:42.205+0000 7f74a359e700 1 -- 172.21.15.32:0/549916020 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7488005b40 con 0x7f74a415a2b0 2023-10-08T13:43:42.219 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:42.213+0000 7f749affd700 1 -- 172.21.15.32:0/549916020 <== mon.1 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v35) v1 ==== 104+0+11 (secure 0 0 0) 0x7f749c054ea0 con 0x7f74a415a2b0 2023-10-08T13:43:42.219 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 32 2023-10-08T13:43:42.222 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:42.217+0000 7f74a359e700 1 -- 172.21.15.32:0/549916020 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f7484066510 msgr2=0x7f74840689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:43:42.223 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:42.217+0000 7f74a359e700 1 --2- 172.21.15.32:0/549916020 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f7484066510 0x7f74840689d0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f74a40b4460 tx=0x7f7494011000 comp rx=0 tx=0).stop 2023-10-08T13:43:42.223 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:42.217+0000 7f74a359e700 1 -- 172.21.15.32:0/549916020 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f74a415a2b0 msgr2=0x7f74a40b38e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:43:42.223 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:42.217+0000 7f74a359e700 1 --2- 172.21.15.32:0/549916020 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f74a415a2b0 0x7f74a40b38e0 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f749c00b440 tx=0x7f749c00b750 comp rx=0 tx=0).stop 2023-10-08T13:43:42.223 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:42.217+0000 7f74a359e700 1 -- 172.21.15.32:0/549916020 shutdown_connections 2023-10-08T13:43:42.223 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:42.217+0000 7f74a359e700 1 --2- 172.21.15.32:0/549916020 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f7484066510 0x7f74840689d0 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:42.224 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:42.217+0000 7f74a359e700 1 --2- 172.21.15.32:0/549916020 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f74a415a2b0 0x7f74a40b38e0 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:42.224 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:42.217+0000 7f74a359e700 1 --2- 172.21.15.32:0/549916020 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f74a4159ed0 0x7f74a4158c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:42.224 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:42.217+0000 7f74a359e700 1 --2- 172.21.15.32:0/549916020 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f74a40c98c0 0x7f74a40c4510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:42.224 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:42.217+0000 7f74a359e700 1 -- 172.21.15.32:0/549916020 >> 172.21.15.32:0/549916020 conn(0x7f74a40b0900 msgr2=0x7f74a40af6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:43:42.225 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:42.217+0000 7f74a359e700 1 -- 172.21.15.32:0/549916020 shutdown_connections 2023-10-08T13:43:42.225 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:42.217+0000 7f74a359e700 1 -- 172.21.15.32:0/549916020 wait complete. 2023-10-08T13:43:42.239 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-08T13:43:42.364 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:42.357+0000 7f9c53fff700 1 Processor -- start 2023-10-08T13:43:42.365 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:42.357+0000 7f9c53fff700 1 -- start start 2023-10-08T13:43:42.366 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:42.361+0000 7f9c53fff700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f9c540ce600 0x7f9c541684a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:43:42.367 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:42.361+0000 7f9c53fff700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c540d1620 con 0x7f9c5415d4b0 2023-10-08T13:43:42.367 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:42.361+0000 7f9c53fff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c540d1320 con 0x7f9c540b8b20 2023-10-08T13:43:42.367 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:42.361+0000 7f9c53fff700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c541619f0 con 0x7f9c540ce600 2023-10-08T13:43:42.367 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:42.361+0000 7f9c537fe700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f9c540ce600 0x7f9c541684a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:43:42.367 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:42.361+0000 7f9c52ffd700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f9c5415d4b0 0x7f9c54161110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:38270/0 (socket says 172.21.15.32:38270) 2023-10-08T13:43:42.367 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:42.361+0000 7f9c52ffd700 1 -- 172.21.15.32:0/108448205 learned_addr learned my addr 172.21.15.32:0/108448205 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-08T13:43:42.367 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:42.361+0000 7f9c51ffb700 1 -- 172.21.15.32:0/108448205 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3364553209 0 0) 0x7f9c540d1620 con 0x7f9c5415d4b0 2023-10-08T13:43:42.367 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:42.361+0000 7f9c51ffb700 1 -- 172.21.15.32:0/108448205 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9c3c0035d0 con 0x7f9c5415d4b0 2023-10-08T13:43:42.367 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:42.361+0000 7f9c51ffb700 1 -- 172.21.15.32:0/108448205 <== mon.1 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1173008831 0 0) 0x7f9c540d1320 con 0x7f9c540b8b20 2023-10-08T13:43:42.367 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:42.361+0000 7f9c537fe700 1 -- 172.21.15.32:0/108448205 >> v1:172.21.15.40:6789/0 conn(0x7f9c540b8b20 legacy=0x7f9c540cdef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:43:42.367 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:42.361+0000 7f9c537fe700 1 -- 172.21.15.32:0/108448205 >> v1:172.21.15.32:6789/0 conn(0x7f9c5415d4b0 legacy=0x7f9c54161110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:43:42.368 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:42.361+0000 7f9c537fe700 1 -- 172.21.15.32:0/108448205 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c54161cd0 con 0x7f9c540ce600 2023-10-08T13:43:42.368 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:42.361+0000 7f9c537fe700 1 --2- 172.21.15.32:0/108448205 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9c540ce600 0x7f9c541684a0 secure :-1 s=READY pgs=1881 cs=0 l=1 rev1=1 crypto rx=0x7f9c4c009d90 tx=0x7f9c4c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa47d33299d9f89b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:43:42.368 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:42.361+0000 7f9c51ffb700 1 -- 172.21.15.32:0/108448205 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c4c00e070 con 0x7f9c540ce600 2023-10-08T13:43:42.368 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:42.361+0000 7f9c51ffb700 1 -- 172.21.15.32:0/108448205 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c4c00bb20 con 0x7f9c540ce600 2023-10-08T13:43:42.368 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:42.361+0000 7f9c51ffb700 1 -- 172.21.15.32:0/108448205 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c4c00beb0 con 0x7f9c540ce600 2023-10-08T13:43:42.368 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:42.361+0000 7f9c53fff700 1 -- 172.21.15.32:0/108448205 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9c540ce600 msgr2=0x7f9c541684a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:43:42.368 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:42.361+0000 7f9c53fff700 1 --2- 172.21.15.32:0/108448205 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9c540ce600 0x7f9c541684a0 secure :-1 s=READY pgs=1881 cs=0 l=1 rev1=1 crypto rx=0x7f9c4c009d90 tx=0x7f9c4c00b330 comp rx=0 tx=0).stop 2023-10-08T13:43:42.369 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:42.365+0000 7f9c53fff700 1 -- 172.21.15.32:0/108448205 shutdown_connections 2023-10-08T13:43:42.370 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:42.365+0000 7f9c53fff700 1 --2- 172.21.15.32:0/108448205 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9c540ce600 0x7f9c541684a0 unknown :-1 s=CLOSED pgs=1881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:42.370 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:42.365+0000 7f9c53fff700 1 -- 172.21.15.32:0/108448205 >> 172.21.15.32:0/108448205 conn(0x7f9c5406ac60 msgr2=0x7f9c5406b070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:43:42.370 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:42.365+0000 7f9c53fff700 1 -- 172.21.15.32:0/108448205 shutdown_connections 2023-10-08T13:43:42.370 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:42.365+0000 7f9c53fff700 1 -- 172.21.15.32:0/108448205 wait complete. 2023-10-08T13:43:42.371 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:42.365+0000 7f9c53fff700 1 Processor -- start 2023-10-08T13:43:42.371 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:42.365+0000 7f9c53fff700 1 -- start start 2023-10-08T13:43:42.372 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:42.365+0000 7f9c53fff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9c540b8b20 0x7f9c541f3e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:43:42.372 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:42.365+0000 7f9c53fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9c540ce600 0x7f9c541f5a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:43:42.372 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:42.365+0000 7f9c53fff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9c5415d4b0 0x7f9c540c8dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:43:42.372 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:42.365+0000 7f9c53fff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c540cc0e0 con 0x7f9c540ce600 2023-10-08T13:43:42.373 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:42.365+0000 7f9c53fff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c541f5fd0 con 0x7f9c540b8b20 2023-10-08T13:43:42.373 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:42.365+0000 7f9c53fff700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c540b4080 con 0x7f9c5415d4b0 2023-10-08T13:43:42.373 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:42.365+0000 7f9c527fc700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9c540ce600 0x7f9c541f5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:43:42.373 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:42.365+0000 7f9c527fc700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9c540ce600 0x7f9c541f5a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:49188/0 (socket says 172.21.15.32:49188) 2023-10-08T13:43:42.373 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:42.365+0000 7f9c527fc700 1 -- 172.21.15.32:0/123756973 learned_addr learned my addr 172.21.15.32:0/123756973 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T13:43:42.373 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:42.365+0000 7f9c537fe700 1 --2- 172.21.15.32:0/123756973 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9c5415d4b0 0x7f9c540c8dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:43:42.373 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:42.365+0000 7f9c52ffd700 1 --2- 172.21.15.32:0/123756973 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9c540b8b20 0x7f9c541f3e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:43:42.374 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:42.365+0000 7f9c527fc700 1 -- 172.21.15.32:0/123756973 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9c5415d4b0 msgr2=0x7f9c540c8dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:43:42.374 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:42.365+0000 7f9c527fc700 1 --2- 172.21.15.32:0/123756973 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9c5415d4b0 0x7f9c540c8dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:42.374 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:42.365+0000 7f9c527fc700 1 -- 172.21.15.32:0/123756973 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9c540b8b20 msgr2=0x7f9c541f3e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:43:42.374 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:42.365+0000 7f9c527fc700 1 --2- 172.21.15.32:0/123756973 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9c540b8b20 0x7f9c541f3e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:42.374 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:42.365+0000 7f9c527fc700 1 -- 172.21.15.32:0/123756973 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c4c009a70 con 0x7f9c540ce600 2023-10-08T13:43:42.374 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:42.365+0000 7f9c527fc700 1 --2- 172.21.15.32:0/123756973 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9c540ce600 0x7f9c541f5a90 secure :-1 s=READY pgs=1882 cs=0 l=1 rev1=1 crypto rx=0x7f9c4400c520 tx=0x7f9c4400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:43:42.377 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:42.365+0000 7f9c437fe700 1 -- 172.21.15.32:0/123756973 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c440054e0 con 0x7f9c540ce600 2023-10-08T13:43:42.377 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:42.365+0000 7f9c437fe700 1 -- 172.21.15.32:0/123756973 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c440036a0 con 0x7f9c540ce600 2023-10-08T13:43:42.377 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:42.365+0000 7f9c53fff700 1 -- 172.21.15.32:0/123756973 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c540cba90 con 0x7f9c540ce600 2023-10-08T13:43:42.377 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:42.365+0000 7f9c437fe700 1 -- 172.21.15.32:0/123756973 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c44003a10 con 0x7f9c540ce600 2023-10-08T13:43:42.377 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:42.365+0000 7f9c53fff700 1 -- 172.21.15.32:0/123756973 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c540b4360 con 0x7f9c540ce600 2023-10-08T13:43:42.377 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:42.369+0000 7f9c53fff700 1 -- 172.21.15.32:0/123756973 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c54073f00 con 0x7f9c540ce600 2023-10-08T13:43:42.377 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:42.369+0000 7f9c437fe700 1 -- 172.21.15.32:0/123756973 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f9c44003b70 con 0x7f9c540ce600 2023-10-08T13:43:42.377 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:42.369+0000 7f9c437fe700 1 --2- 172.21.15.32:0/123756973 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f9c38066510 0x7f9c380689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:43:42.377 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:42.369+0000 7f9c437fe700 1 -- 172.21.15.32:0/123756973 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9c440831b0 con 0x7f9c540ce600 2023-10-08T13:43:42.377 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:42.369+0000 7f9c52ffd700 1 --2- 172.21.15.32:0/123756973 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f9c38066510 0x7f9c380689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:43:42.378 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:42.369+0000 7f9c52ffd700 1 --2- 172.21.15.32:0/123756973 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f9c38066510 0x7f9c380689d0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f9c48007fd0 tx=0x7f9c48007de0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:43:42.380 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:42.373+0000 7f9c437fe700 1 -- 172.21.15.32:0/123756973 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f9c44050640 con 0x7f9c540ce600 2023-10-08T13:43:42.397 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:43:42.399 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:43:42.629 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:42.625+0000 7f9c53fff700 1 -- 172.21.15.32:0/123756973 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f9c540d0e30 con 0x7f9c540ce600 2023-10-08T13:43:42.630 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:42.625+0000 7f9c437fe700 1 -- 172.21.15.32:0/123756973 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v35) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9c44017020 con 0x7f9c540ce600 2023-10-08T13:43:42.630 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 64 2023-10-08T13:43:42.634 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:42.629+0000 7f9c53fff700 1 -- 172.21.15.32:0/123756973 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f9c38066510 msgr2=0x7f9c380689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:43:42.634 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:42.629+0000 7f9c53fff700 1 --2- 172.21.15.32:0/123756973 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f9c38066510 0x7f9c380689d0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f9c48007fd0 tx=0x7f9c48007de0 comp rx=0 tx=0).stop 2023-10-08T13:43:42.634 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:42.629+0000 7f9c53fff700 1 -- 172.21.15.32:0/123756973 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9c540ce600 msgr2=0x7f9c541f5a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:43:42.634 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:42.629+0000 7f9c53fff700 1 --2- 172.21.15.32:0/123756973 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9c540ce600 0x7f9c541f5a90 secure :-1 s=READY pgs=1882 cs=0 l=1 rev1=1 crypto rx=0x7f9c4400c520 tx=0x7f9c4400c830 comp rx=0 tx=0).stop 2023-10-08T13:43:42.634 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:42.629+0000 7f9c53fff700 1 -- 172.21.15.32:0/123756973 shutdown_connections 2023-10-08T13:43:42.634 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:42.629+0000 7f9c53fff700 1 --2- 172.21.15.32:0/123756973 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f9c38066510 0x7f9c380689d0 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:42.634 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:42.629+0000 7f9c53fff700 1 --2- 172.21.15.32:0/123756973 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9c540ce600 0x7f9c541f5a90 unknown :-1 s=CLOSED pgs=1882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:42.634 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:42.629+0000 7f9c53fff700 1 --2- 172.21.15.32:0/123756973 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9c5415d4b0 0x7f9c540c8dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:42.635 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:42.629+0000 7f9c53fff700 1 --2- 172.21.15.32:0/123756973 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9c540b8b20 0x7f9c541f3e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:42.635 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:42.629+0000 7f9c53fff700 1 -- 172.21.15.32:0/123756973 >> 172.21.15.32:0/123756973 conn(0x7f9c5406ac60 msgr2=0x7f9c540d2220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:43:42.635 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:42.629+0000 7f9c53fff700 1 -- 172.21.15.32:0/123756973 shutdown_connections 2023-10-08T13:43:42.635 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:42.629+0000 7f9c53fff700 1 -- 172.21.15.32:0/123756973 wait complete. 2023-10-08T13:43:42.656 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T13:43:42.782 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:42.777+0000 7f76ed154700 1 Processor -- start 2023-10-08T13:43:42.782 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:42.777+0000 7f76ed154700 1 -- start start 2023-10-08T13:43:42.783 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:42.777+0000 7f76ed154700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f76e815b210 0x7f76e815f540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:43:42.783 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:42.777+0000 7f76ed154700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f76e806d490 0x7f76e8070d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:43:42.783 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:42.777+0000 7f76ed154700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76e80cbd70 con 0x7f76e80ca3a0 2023-10-08T13:43:42.783 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:42.777+0000 7f76ed154700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76e806c2f0 con 0x7f76e806d490 2023-10-08T13:43:42.783 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:42.777+0000 7f76ed154700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76e815fa80 con 0x7f76e815b210 2023-10-08T13:43:42.784 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:42.777+0000 7f76e7fff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f76e815b210 0x7f76e815f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:43:42.784 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:42.777+0000 7f76e77fe700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f76e80ca3a0 0x7f76e806cd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.32:33060/0 (socket says 172.21.15.32:33060) 2023-10-08T13:43:42.785 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:42.777+0000 7f76e77fe700 1 -- 172.21.15.32:0/3696721992 learned_addr learned my addr 172.21.15.32:0/3696721992 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-08T13:43:42.785 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:42.777+0000 7f76ec953700 1 --2- 172.21.15.32:0/3696721992 >> v2:172.21.15.40:3300/0 conn(0x7f76e806d490 0x7f76e8070d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:43:42.785 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:42.777+0000 7f76e7fff700 1 -- 172.21.15.32:0/3696721992 >> v2:172.21.15.40:3300/0 conn(0x7f76e806d490 msgr2=0x7f76e8070d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:43:42.785 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:42.777+0000 7f76e7fff700 1 --2- 172.21.15.32:0/3696721992 >> v2:172.21.15.40:3300/0 conn(0x7f76e806d490 0x7f76e8070d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:42.785 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:42.777+0000 7f76e7fff700 1 -- 172.21.15.32:0/3696721992 >> v1:172.21.15.40:6789/0 conn(0x7f76e80ca3a0 legacy=0x7f76e806cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:43:42.785 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:42.777+0000 7f76e6ffd700 1 -- 172.21.15.32:0/3696721992 <== mon.1 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3648104901 0 0) 0x7f76e80cbd70 con 0x7f76e80ca3a0 2023-10-08T13:43:42.785 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:42.777+0000 7f76e7fff700 1 -- 172.21.15.32:0/3696721992 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76e80cc310 con 0x7f76e815b210 2023-10-08T13:43:42.785 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:42.777+0000 7f76e7fff700 1 --2- 172.21.15.32:0/3696721992 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f76e815b210 0x7f76e815f540 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f76dc009850 tx=0x7f76dc009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7234808fe0f89704 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:43:42.785 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:42.777+0000 7f76e6ffd700 1 -- 172.21.15.32:0/3696721992 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76dc011830 con 0x7f76e815b210 2023-10-08T13:43:42.785 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:42.777+0000 7f76e6ffd700 1 -- 172.21.15.32:0/3696721992 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76dc011990 con 0x7f76e815b210 2023-10-08T13:43:42.786 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:42.777+0000 7f76e6ffd700 1 -- 172.21.15.32:0/3696721992 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76dc011d40 con 0x7f76e815b210 2023-10-08T13:43:42.787 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:42.777+0000 7f76ed154700 1 -- 172.21.15.32:0/3696721992 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f76e815b210 msgr2=0x7f76e815f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:43:42.787 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:42.777+0000 7f76ed154700 1 --2- 172.21.15.32:0/3696721992 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f76e815b210 0x7f76e815f540 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f76dc009850 tx=0x7f76dc009b60 comp rx=0 tx=0).stop 2023-10-08T13:43:42.787 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:42.777+0000 7f76ed154700 1 -- 172.21.15.32:0/3696721992 shutdown_connections 2023-10-08T13:43:42.787 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:42.777+0000 7f76ed154700 1 --2- 172.21.15.32:0/3696721992 >> v2:172.21.15.40:3300/0 conn(0x7f76e806d490 0x7f76e8070d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:42.787 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:42.777+0000 7f76ed154700 1 --2- 172.21.15.32:0/3696721992 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f76e815b210 0x7f76e815f540 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:42.787 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:42.777+0000 7f76ed154700 1 -- 172.21.15.32:0/3696721992 >> 172.21.15.32:0/3696721992 conn(0x7f76e80cc7d0 msgr2=0x7f76e80ccbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:43:42.787 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:42.777+0000 7f76ed154700 1 -- 172.21.15.32:0/3696721992 shutdown_connections 2023-10-08T13:43:42.787 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:42.777+0000 7f76ed154700 1 -- 172.21.15.32:0/3696721992 wait complete. 2023-10-08T13:43:42.788 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:42.781+0000 7f76ed154700 1 Processor -- start 2023-10-08T13:43:42.788 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:42.781+0000 7f76ed154700 1 -- start start 2023-10-08T13:43:42.790 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:42.781+0000 7f76ed154700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f76e806d490 0x7f76e8145af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:43:42.790 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:42.781+0000 7f76ed154700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f76e80ca3a0 0x7f76e815ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:43:42.790 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:42.781+0000 7f76ed154700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f76e815b210 0x7f76e80c9660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:43:42.790 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:42.781+0000 7f76ed154700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76e80c70b0 con 0x7f76e815b210 2023-10-08T13:43:42.790 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:42.781+0000 7f76ed154700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76e80c88a0 con 0x7f76e80ca3a0 2023-10-08T13:43:42.791 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:42.781+0000 7f76ed154700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76e80c8b80 con 0x7f76e806d490 2023-10-08T13:43:42.791 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:42.785+0000 7f76ec953700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f76e815b210 0x7f76e80c9660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:43:42.791 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:42.785+0000 7f76ec953700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f76e815b210 0x7f76e80c9660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:49198/0 (socket says 172.21.15.32:49198) 2023-10-08T13:43:42.791 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:42.785+0000 7f76ec953700 1 -- 172.21.15.32:0/1162621425 learned_addr learned my addr 172.21.15.32:0/1162621425 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T13:43:42.791 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:42.785+0000 7f76e7fff700 1 --2- 172.21.15.32:0/1162621425 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f76e806d490 0x7f76e8145af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:43:42.792 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:42.785+0000 7f76ec953700 1 -- 172.21.15.32:0/1162621425 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f76e806d490 msgr2=0x7f76e8145af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:43:42.792 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:42.785+0000 7f76ec953700 1 --2- 172.21.15.32:0/1162621425 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f76e806d490 0x7f76e8145af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:42.792 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:42.785+0000 7f76ec953700 1 -- 172.21.15.32:0/1162621425 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f76e80ca3a0 msgr2=0x7f76e815ddf0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T13:43:42.792 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:42.785+0000 7f76ec953700 1 --2- 172.21.15.32:0/1162621425 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f76e80ca3a0 0x7f76e815ddf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:42.792 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:42.785+0000 7f76ec953700 1 -- 172.21.15.32:0/1162621425 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76dc0094b0 con 0x7f76e815b210 2023-10-08T13:43:42.792 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:42.785+0000 7f76ec953700 1 --2- 172.21.15.32:0/1162621425 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f76e815b210 0x7f76e80c9660 secure :-1 s=READY pgs=1883 cs=0 l=1 rev1=1 crypto rx=0x7f76e000ef90 tx=0x7f76e0009f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:43:42.805 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:42.789+0000 7f76e4ff9700 1 -- 172.21.15.32:0/1162621425 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76e0009b20 con 0x7f76e815b210 2023-10-08T13:43:42.806 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:42.789+0000 7f76e4ff9700 1 -- 172.21.15.32:0/1162621425 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76e000f040 con 0x7f76e815b210 2023-10-08T13:43:42.806 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:42.789+0000 7f76e4ff9700 1 -- 172.21.15.32:0/1162621425 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76e000cd40 con 0x7f76e815b210 2023-10-08T13:43:42.806 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:42.789+0000 7f76ed154700 1 -- 172.21.15.32:0/1162621425 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76e80c8e60 con 0x7f76e815b210 2023-10-08T13:43:42.806 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:42.789+0000 7f76ed154700 1 -- 172.21.15.32:0/1162621425 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76e80c84c0 con 0x7f76e815b210 2023-10-08T13:43:42.806 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:42.789+0000 7f76ed154700 1 -- 172.21.15.32:0/1162621425 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76e80c9380 con 0x7f76e815b210 2023-10-08T13:43:42.806 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:42.789+0000 7f76e4ff9700 1 -- 172.21.15.32:0/1162621425 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f76e0014480 con 0x7f76e815b210 2023-10-08T13:43:42.806 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:42.793+0000 7f76e4ff9700 1 --2- 172.21.15.32:0/1162621425 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f76d4066560 0x7f76d4068a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:43:42.806 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:42.793+0000 7f76e4ff9700 1 -- 172.21.15.32:0/1162621425 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f76e00847a0 con 0x7f76e815b210 2023-10-08T13:43:42.807 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:42.793+0000 7f76e7fff700 1 --2- 172.21.15.32:0/1162621425 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f76d4066560 0x7f76d4068a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:43:42.807 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:42.793+0000 7f76e7fff700 1 --2- 172.21.15.32:0/1162621425 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f76d4066560 0x7f76d4068a20 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f76dc009ba0 tx=0x7f76dc008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:43:42.807 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:42.797+0000 7f76e4ff9700 1 -- 172.21.15.32:0/1162621425 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f76e80c9380 con 0x7f76e815b210 2023-10-08T13:43:43.100 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:43.093+0000 7f76ed154700 1 -- 172.21.15.32:0/1162621425 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f76e80c9380 con 0x7f76e815b210 2023-10-08T13:43:43.101 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:43.097+0000 7f76e4ff9700 1 -- 172.21.15.32:0/1162621425 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+4909 (secure 0 0 0) 0x7f76e80c9380 con 0x7f76e815b210 2023-10-08T13:43:43.101 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T13:43:43.102 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":14,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5232,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6835/1178250724","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6834","nonce":1178250724},{"type":"v1","addr":"172.21.15.32:6835","nonce":1178250724}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10},{"gid":5238,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6837/2723596589","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6836","nonce":2723596589},{"type":"v1","addr":"172.21.15.32:6837","nonce":2723596589}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10},{"gid":5323,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6833/3107673350","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":3107673350},{"type":"v1","addr":"172.21.15.40:6833","nonce":3107673350}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T06:10:35.216976+0000","modified":"2023-10-08T06:10:38.240290+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5326},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5326":{"gid":5326,"name":"b","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.40:6835/500201668","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":500201668},{"type":"v1","addr":"172.21.15.40:6835","nonce":500201668}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-10-08T13:43:43.105 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:43.097+0000 7f76ed154700 1 -- 172.21.15.32:0/1162621425 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f76d4066560 msgr2=0x7f76d4068a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:43:43.105 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:43.097+0000 7f76ed154700 1 --2- 172.21.15.32:0/1162621425 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f76d4066560 0x7f76d4068a20 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f76dc009ba0 tx=0x7f76dc008030 comp rx=0 tx=0).stop 2023-10-08T13:43:43.105 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:43.097+0000 7f76ed154700 1 -- 172.21.15.32:0/1162621425 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f76e815b210 msgr2=0x7f76e80c9660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:43:43.105 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:43.097+0000 7f76ed154700 1 --2- 172.21.15.32:0/1162621425 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f76e815b210 0x7f76e80c9660 secure :-1 s=READY pgs=1883 cs=0 l=1 rev1=1 crypto rx=0x7f76e000ef90 tx=0x7f76e0009f60 comp rx=0 tx=0).stop 2023-10-08T13:43:43.105 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:43.097+0000 7f76ed154700 1 -- 172.21.15.32:0/1162621425 shutdown_connections 2023-10-08T13:43:43.105 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:43.097+0000 7f76ed154700 1 --2- 172.21.15.32:0/1162621425 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f76d4066560 0x7f76d4068a20 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:43.106 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:43.097+0000 7f76ed154700 1 --2- 172.21.15.32:0/1162621425 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f76e815b210 0x7f76e80c9660 unknown :-1 s=CLOSED pgs=1883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:43.106 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:43.097+0000 7f76ed154700 1 --2- 172.21.15.32:0/1162621425 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f76e80ca3a0 0x7f76e815ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:43.106 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:43.097+0000 7f76ed154700 1 --2- 172.21.15.32:0/1162621425 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f76e806d490 0x7f76e8145af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:43.106 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:43.097+0000 7f76ed154700 1 -- 172.21.15.32:0/1162621425 >> 172.21.15.32:0/1162621425 conn(0x7f76e80cc7d0 msgr2=0x7f76e80cd900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:43:43.106 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:43.097+0000 7f76ed154700 1 -- 172.21.15.32:0/1162621425 shutdown_connections 2023-10-08T13:43:43.106 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:43.097+0000 7f76ed154700 1 -- 172.21.15.32:0/1162621425 wait complete. 2023-10-08T13:43:43.106 INFO:teuthology.orchestra.run.smithi032.stderr:dumped fsmap epoch 14 2023-10-08T13:43:43.119 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T13:43:43.265 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:43.253+0000 7f60c0523700 1 Processor -- start 2023-10-08T13:43:43.265 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:43.257+0000 7f60c0523700 1 -- start start 2023-10-08T13:43:43.265 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:43.257+0000 7f60c0523700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f60b8159590 0x7f60b80c9410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:43:43.265 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:43.257+0000 7f60c0523700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f60b80c9950 0x7f60b80b0840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:43:43.265 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:43.257+0000 7f60c0523700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f60b80cc360 0x7f60b80b0d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:43:43.265 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:43.257+0000 7f60c0523700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60b80ca140 con 0x7f60b80cc360 2023-10-08T13:43:43.265 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:43.257+0000 7f60c0523700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60b8159970 con 0x7f60b8159590 2023-10-08T13:43:43.266 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:43.257+0000 7f60c0523700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60b80c9e60 con 0x7f60b80c9950 2023-10-08T13:43:43.266 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:43.257+0000 7f60beac0700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f60b80cc360 0x7f60b80b0d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:43:43.266 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:43.257+0000 7f60beac0700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f60b80cc360 0x7f60b80b0d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:49206/0 (socket says 172.21.15.32:49206) 2023-10-08T13:43:43.266 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:43.257+0000 7f60be2bf700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f60b8159590 0x7f60b80c9410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:43:43.266 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:43.257+0000 7f60beac0700 1 -- 172.21.15.32:0/3518524714 learned_addr learned my addr 172.21.15.32:0/3518524714 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T13:43:43.266 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:43.257+0000 7f60beac0700 1 -- 172.21.15.32:0/3518524714 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f60b80c9950 msgr2=0x7f60b80b0840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:43:43.266 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:43.257+0000 7f60beac0700 1 --2- 172.21.15.32:0/3518524714 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f60b80c9950 0x7f60b80b0840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:43.266 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:43.257+0000 7f60beac0700 1 -- 172.21.15.32:0/3518524714 >> v2:172.21.15.40:3300/0 conn(0x7f60b8159590 msgr2=0x7f60b80c9410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:43:43.266 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:43.257+0000 7f60beac0700 1 --2- 172.21.15.32:0/3518524714 >> v2:172.21.15.40:3300/0 conn(0x7f60b8159590 0x7f60b80c9410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:43.267 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:43.257+0000 7f60beac0700 1 -- 172.21.15.32:0/3518524714 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60b806bf60 con 0x7f60b80cc360 2023-10-08T13:43:43.267 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:43.257+0000 7f60beac0700 1 --2- 172.21.15.32:0/3518524714 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f60b80cc360 0x7f60b80b0d80 secure :-1 s=READY pgs=1884 cs=0 l=1 rev1=1 crypto rx=0x7f60b806f5c0 tx=0x7f60a8009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f803e9e0b1d38e94 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:43:43.267 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:43.257+0000 7f60bd2bd700 1 -- 172.21.15.32:0/3518524714 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60a8011830 con 0x7f60b80cc360 2023-10-08T13:43:43.267 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:43.257+0000 7f60bd2bd700 1 -- 172.21.15.32:0/3518524714 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60a8011990 con 0x7f60b80cc360 2023-10-08T13:43:43.267 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:43.257+0000 7f60bd2bd700 1 -- 172.21.15.32:0/3518524714 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60a8011d20 con 0x7f60b80cc360 2023-10-08T13:43:43.267 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:43.257+0000 7f60c0523700 1 -- 172.21.15.32:0/3518524714 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f60b80cc360 msgr2=0x7f60b80b0d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:43:43.267 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:43.257+0000 7f60c0523700 1 --2- 172.21.15.32:0/3518524714 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f60b80cc360 0x7f60b80b0d80 secure :-1 s=READY pgs=1884 cs=0 l=1 rev1=1 crypto rx=0x7f60b806f5c0 tx=0x7f60a8009bf0 comp rx=0 tx=0).stop 2023-10-08T13:43:43.270 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:43.261+0000 7f60c0523700 1 -- 172.21.15.32:0/3518524714 shutdown_connections 2023-10-08T13:43:43.270 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:43.261+0000 7f60c0523700 1 --2- 172.21.15.32:0/3518524714 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f60b80cc360 0x7f60b80b0d80 unknown :-1 s=CLOSED pgs=1884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:43.272 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:43.261+0000 7f60c0523700 1 --2- 172.21.15.32:0/3518524714 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f60b80c9950 0x7f60b80b0840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:43.272 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:43.261+0000 7f60c0523700 1 --2- 172.21.15.32:0/3518524714 >> v2:172.21.15.40:3300/0 conn(0x7f60b8159590 0x7f60b80c9410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:43.272 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:43.261+0000 7f60c0523700 1 -- 172.21.15.32:0/3518524714 >> 172.21.15.32:0/3518524714 conn(0x7f60b80cb840 msgr2=0x7f60b80cbc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:43:43.272 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:43.261+0000 7f60c0523700 1 -- 172.21.15.32:0/3518524714 shutdown_connections 2023-10-08T13:43:43.272 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:43.261+0000 7f60c0523700 1 -- 172.21.15.32:0/3518524714 wait complete. 2023-10-08T13:43:43.272 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:43.261+0000 7f60c0523700 1 Processor -- start 2023-10-08T13:43:43.272 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:43.261+0000 7f60c0523700 1 -- start start 2023-10-08T13:43:43.272 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:43.261+0000 7f60c0523700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f60b80c9950 0x7f60b80c5e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:43:43.273 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:43.261+0000 7f60c0523700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f60b80cc360 0x7f60b80c1980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:43:43.273 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:43.261+0000 7f60c0523700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f60b8159590 0x7f60b8145e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:43:43.273 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:43.261+0000 7f60c0523700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60b80c6470 con 0x7f60b80c9950 2023-10-08T13:43:43.273 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:43.261+0000 7f60c0523700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60b80c6750 con 0x7f60b8159590 2023-10-08T13:43:43.273 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:43.261+0000 7f60c0523700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60b80c6a30 con 0x7f60b80cc360 2023-10-08T13:43:43.273 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:43.261+0000 7f60be2bf700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f60b80c9950 0x7f60b80c5e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:43:43.273 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:43.261+0000 7f60bdabe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f60b80cc360 0x7f60b80c1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:43:43.273 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:43.261+0000 7f60be2bf700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f60b80c9950 0x7f60b80c5e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:49208/0 (socket says 172.21.15.32:49208) 2023-10-08T13:43:43.273 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:43.261+0000 7f60be2bf700 1 -- 172.21.15.32:0/3997537804 learned_addr learned my addr 172.21.15.32:0/3997537804 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T13:43:43.273 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:43.261+0000 7f60beac0700 1 --2- 172.21.15.32:0/3997537804 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f60b8159590 0x7f60b8145e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:43:43.274 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:43.261+0000 7f60be2bf700 1 -- 172.21.15.32:0/3997537804 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f60b80cc360 msgr2=0x7f60b80c1980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:43:43.274 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:43.261+0000 7f60be2bf700 1 --2- 172.21.15.32:0/3997537804 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f60b80cc360 0x7f60b80c1980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:43.274 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:43.261+0000 7f60be2bf700 1 -- 172.21.15.32:0/3997537804 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f60b8159590 msgr2=0x7f60b8145e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:43:43.274 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:43.261+0000 7f60be2bf700 1 --2- 172.21.15.32:0/3997537804 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f60b8159590 0x7f60b8145e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:43.274 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:43.261+0000 7f60be2bf700 1 -- 172.21.15.32:0/3997537804 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60a8009570 con 0x7f60b80c9950 2023-10-08T13:43:43.274 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:43.261+0000 7f60beac0700 1 --2- 172.21.15.32:0/3997537804 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f60b8159590 0x7f60b8145e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T13:43:43.274 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:43.261+0000 7f60be2bf700 1 --2- 172.21.15.32:0/3997537804 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f60b80c9950 0x7f60b80c5e90 secure :-1 s=READY pgs=1885 cs=0 l=1 rev1=1 crypto rx=0x7f60b400f980 tx=0x7f60b400fc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:43:43.274 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:43.261+0000 7f60aeffd700 1 -- 172.21.15.32:0/3997537804 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60b400a740 con 0x7f60b80c9950 2023-10-08T13:43:43.275 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:43.261+0000 7f60aeffd700 1 -- 172.21.15.32:0/3997537804 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60b400db60 con 0x7f60b80c9950 2023-10-08T13:43:43.275 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:43.261+0000 7f60c0523700 1 -- 172.21.15.32:0/3997537804 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60b80c6d10 con 0x7f60b80c9950 2023-10-08T13:43:43.275 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:43.261+0000 7f60aeffd700 1 -- 172.21.15.32:0/3997537804 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60b400fe70 con 0x7f60b80c9950 2023-10-08T13:43:43.275 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:43.261+0000 7f60c0523700 1 -- 172.21.15.32:0/3997537804 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60b80c1ec0 con 0x7f60b80c9950 2023-10-08T13:43:43.276 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:43.265+0000 7f60aeffd700 1 -- 172.21.15.32:0/3997537804 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f60b4012460 con 0x7f60b80c9950 2023-10-08T13:43:43.276 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:43.265+0000 7f60aeffd700 1 --2- 172.21.15.32:0/3997537804 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f609c066510 0x7f609c0689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:43:43.276 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:43.265+0000 7f60aeffd700 1 -- 172.21.15.32:0/3997537804 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f60b40850a0 con 0x7f60b80c9950 2023-10-08T13:43:43.276 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:43.265+0000 7f60bdabe700 1 --2- 172.21.15.32:0/3997537804 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f609c066510 0x7f609c0689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:43:43.276 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:43.265+0000 7f60bdabe700 1 --2- 172.21.15.32:0/3997537804 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f609c066510 0x7f609c0689d0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f60b8153cc0 tx=0x7f60b000d040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:43:43.277 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:43.269+0000 7f60c0523700 1 -- 172.21.15.32:0/3997537804 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60a0005310 con 0x7f60b80c9950 2023-10-08T13:43:43.293 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:43.281+0000 7f60aeffd700 1 -- 172.21.15.32:0/3997537804 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f60b40524a0 con 0x7f60b80c9950 2023-10-08T13:43:43.528 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:43.521+0000 7f60c0523700 1 -- 172.21.15.32:0/3997537804 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f60a0005890 con 0x7f60b80c9950 2023-10-08T13:43:43.530 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:43.525+0000 7f60aeffd700 1 -- 172.21.15.32:0/3997537804 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) v1 ==== 74+0+16509 (secure 0 0 0) 0x7f60b4020020 con 0x7f60b80c9950 2023-10-08T13:43:43.530 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T13:43:43.530 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":35,"fsid":"ac672d87-96ae-41e0-9314-623ba2cdbbba","created":"2023-10-08T06:09:11.175626+0000","modified":"2023-10-08T06:10:36.862351+0000","last_up_change":"2023-10-08T06:09:22.744643+0000","last_in_change":"2023-10-08T06:09:14.131580+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T06:09:23.307843+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-10-08T06:10:33.777525+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-10-08T06:10:34.202152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"43433f0c-9592-4874-92d7-10f8f4acf07f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":587888964},{"type":"v1","addr":"172.21.15.32:6801","nonce":587888964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":587888964},{"type":"v1","addr":"172.21.15.32:6803","nonce":587888964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":587888964},{"type":"v1","addr":"172.21.15.32:6810","nonce":587888964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6805","nonce":587888964},{"type":"v1","addr":"172.21.15.32:6807","nonce":587888964}]},"public_addr":"172.21.15.32:6801/587888964","cluster_addr":"172.21.15.32:6803/587888964","heartbeat_back_addr":"172.21.15.32:6810/587888964","heartbeat_front_addr":"172.21.15.32:6807/587888964","state":["exists","up"]},{"osd":1,"uuid":"2ecb1008-b987-4ce7-b646-6cded55fc8d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":990576767},{"type":"v1","addr":"172.21.15.32:6817","nonce":990576767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":990576767},{"type":"v1","addr":"172.21.15.32:6819","nonce":990576767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":990576767},{"type":"v1","addr":"172.21.15.32:6823","nonce":990576767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":990576767},{"type":"v1","addr":"172.21.15.32:6821","nonce":990576767}]},"public_addr":"172.21.15.32:6817/990576767","cluster_addr":"172.21.15.32:6819/990576767","heartbeat_back_addr":"172.21.15.32:6823/990576767","heartbeat_front_addr":"172.21.15.32:6821/990576767","state":["exists","up"]},{"osd":2,"uuid":"1b131c94-c09b-4e80-8746-bf1b7bac362d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6824","nonce":1566874440},{"type":"v1","addr":"172.21.15.32:6825","nonce":1566874440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":1566874440},{"type":"v1","addr":"172.21.15.32:6827","nonce":1566874440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":1566874440},{"type":"v1","addr":"172.21.15.32:6831","nonce":1566874440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":1566874440},{"type":"v1","addr":"172.21.15.32:6829","nonce":1566874440}]},"public_addr":"172.21.15.32:6825/1566874440","cluster_addr":"172.21.15.32:6827/1566874440","heartbeat_back_addr":"172.21.15.32:6831/1566874440","heartbeat_front_addr":"172.21.15.32:6829/1566874440","state":["exists","up"]},{"osd":3,"uuid":"ad655af2-1f6f-4689-b21d-b07bbaeb68b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":3672614802},{"type":"v1","addr":"172.21.15.32:6806","nonce":3672614802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6809","nonce":3672614802},{"type":"v1","addr":"172.21.15.32:6811","nonce":3672614802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":3672614802},{"type":"v1","addr":"172.21.15.32:6815","nonce":3672614802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":3672614802},{"type":"v1","addr":"172.21.15.32:6813","nonce":3672614802}]},"public_addr":"172.21.15.32:6806/3672614802","cluster_addr":"172.21.15.32:6811/3672614802","heartbeat_back_addr":"172.21.15.32:6815/3672614802","heartbeat_front_addr":"172.21.15.32:6813/3672614802","state":["exists","up"]},{"osd":4,"uuid":"64a543a1-8c4f-458e-9aba-b35c1cd7dd03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":3369928244},{"type":"v1","addr":"172.21.15.40:6801","nonce":3369928244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":3369928244},{"type":"v1","addr":"172.21.15.40:6803","nonce":3369928244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":3369928244},{"type":"v1","addr":"172.21.15.40:6807","nonce":3369928244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":3369928244},{"type":"v1","addr":"172.21.15.40:6805","nonce":3369928244}]},"public_addr":"172.21.15.40:6801/3369928244","cluster_addr":"172.21.15.40:6803/3369928244","heartbeat_back_addr":"172.21.15.40:6807/3369928244","heartbeat_front_addr":"172.21.15.40:6805/3369928244","state":["exists","up"]},{"osd":5,"uuid":"0fef3e54-edb4-4678-878e-944663c51638","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":2395850297},{"type":"v1","addr":"172.21.15.40:6825","nonce":2395850297}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":2395850297},{"type":"v1","addr":"172.21.15.40:6827","nonce":2395850297}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":2395850297},{"type":"v1","addr":"172.21.15.40:6831","nonce":2395850297}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":2395850297},{"type":"v1","addr":"172.21.15.40:6829","nonce":2395850297}]},"public_addr":"172.21.15.40:6825/2395850297","cluster_addr":"172.21.15.40:6827/2395850297","heartbeat_back_addr":"172.21.15.40:6831/2395850297","heartbeat_front_addr":"172.21.15.40:6829/2395850297","state":["exists","up"]},{"osd":6,"uuid":"2eeb0472-6096-469d-9b2c-cab4bf41c31a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":4145283410},{"type":"v1","addr":"172.21.15.40:6809","nonce":4145283410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":4145283410},{"type":"v1","addr":"172.21.15.40:6811","nonce":4145283410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":4145283410},{"type":"v1","addr":"172.21.15.40:6815","nonce":4145283410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":4145283410},{"type":"v1","addr":"172.21.15.40:6813","nonce":4145283410}]},"public_addr":"172.21.15.40:6809/4145283410","cluster_addr":"172.21.15.40:6811/4145283410","heartbeat_back_addr":"172.21.15.40:6815/4145283410","heartbeat_front_addr":"172.21.15.40:6813/4145283410","state":["exists","up"]},{"osd":7,"uuid":"cf76e4c7-96a6-401f-a280-91aad4641940","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":2943297416},{"type":"v1","addr":"172.21.15.40:6817","nonce":2943297416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":2943297416},{"type":"v1","addr":"172.21.15.40:6819","nonce":2943297416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":2943297416},{"type":"v1","addr":"172.21.15.40:6823","nonce":2943297416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":2943297416},{"type":"v1","addr":"172.21.15.40:6821","nonce":2943297416}]},"public_addr":"172.21.15.40:6817/2943297416","cluster_addr":"172.21.15.40:6819/2943297416","heartbeat_back_addr":"172.21.15.40:6823/2943297416","heartbeat_front_addr":"172.21.15.40:6821/2943297416","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.411475+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.628841+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.599055+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.166100+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.384135+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.488403+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.307648+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.363541+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T13:43:43.533 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:43.525+0000 7f60c0523700 1 -- 172.21.15.32:0/3997537804 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f609c066510 msgr2=0x7f609c0689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:43:43.533 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:43.525+0000 7f60c0523700 1 --2- 172.21.15.32:0/3997537804 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f609c066510 0x7f609c0689d0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f60b8153cc0 tx=0x7f60b000d040 comp rx=0 tx=0).stop 2023-10-08T13:43:43.533 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:43.525+0000 7f60c0523700 1 -- 172.21.15.32:0/3997537804 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f60b80c9950 msgr2=0x7f60b80c5e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:43:43.533 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:43.525+0000 7f60c0523700 1 --2- 172.21.15.32:0/3997537804 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f60b80c9950 0x7f60b80c5e90 secure :-1 s=READY pgs=1885 cs=0 l=1 rev1=1 crypto rx=0x7f60b400f980 tx=0x7f60b400fc90 comp rx=0 tx=0).stop 2023-10-08T13:43:43.533 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:43.525+0000 7f60c0523700 1 -- 172.21.15.32:0/3997537804 shutdown_connections 2023-10-08T13:43:43.533 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:43.525+0000 7f60c0523700 1 --2- 172.21.15.32:0/3997537804 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f609c066510 0x7f609c0689d0 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:43.533 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:43.525+0000 7f60c0523700 1 --2- 172.21.15.32:0/3997537804 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f60b8159590 0x7f60b8145e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:43.534 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:43.525+0000 7f60c0523700 1 --2- 172.21.15.32:0/3997537804 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f60b80cc360 0x7f60b80c1980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:43.534 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:43.525+0000 7f60c0523700 1 --2- 172.21.15.32:0/3997537804 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f60b80c9950 0x7f60b80c5e90 unknown :-1 s=CLOSED pgs=1885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:43.534 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:43.525+0000 7f60c0523700 1 -- 172.21.15.32:0/3997537804 >> 172.21.15.32:0/3997537804 conn(0x7f60b80cb840 msgr2=0x7f60b806fd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:43:43.534 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:43.525+0000 7f60c0523700 1 -- 172.21.15.32:0/3997537804 shutdown_connections 2023-10-08T13:43:43.534 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:43.525+0000 7f60c0523700 1 -- 172.21.15.32:0/3997537804 wait complete. 2023-10-08T13:43:43.551 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-08T13:43:43.551 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T13:43:43.695 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:43.689+0000 7f58ea3d2700 1 Processor -- start 2023-10-08T13:43:43.695 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:43.689+0000 7f58ea3d2700 1 -- start start 2023-10-08T13:43:43.697 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:43.689+0000 7f58ea3d2700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f58e415d100 0x7f58e40cb6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:43:43.697 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:43.689+0000 7f58ea3d2700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f58e40ce260 0x7f58e40ce940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:43:43.697 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:43.689+0000 7f58ea3d2700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f58e40cee80 0x7f58e40cd040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:43:43.697 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:43.689+0000 7f58ea3d2700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58e406a2a0 con 0x7f58e415d100 2023-10-08T13:43:43.697 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:43.689+0000 7f58ea3d2700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58e40cf310 con 0x7f58e40ce260 2023-10-08T13:43:43.698 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:43.689+0000 7f58ea3d2700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58e40c9ac0 con 0x7f58e40cee80 2023-10-08T13:43:43.698 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:43.689+0000 7f58e93d0700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f58e415d100 0x7f58e40cb6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:43:43.698 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:43.689+0000 7f58e93d0700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f58e415d100 0x7f58e40cb6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:49210/0 (socket says 172.21.15.32:49210) 2023-10-08T13:43:43.698 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:43.689+0000 7f58e93d0700 1 -- 172.21.15.32:0/3157976911 learned_addr learned my addr 172.21.15.32:0/3157976911 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T13:43:43.698 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:43.689+0000 7f58e9bd1700 1 --2- 172.21.15.32:0/3157976911 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f58e40cee80 0x7f58e40cd040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:43:43.698 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:43.689+0000 7f58e8bcf700 1 --2- 172.21.15.32:0/3157976911 >> v2:172.21.15.40:3300/0 conn(0x7f58e40ce260 0x7f58e40ce940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:43:43.698 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:43.689+0000 7f58e93d0700 1 -- 172.21.15.32:0/3157976911 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f58e40cee80 msgr2=0x7f58e40cd040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:43:43.698 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:43.689+0000 7f58e93d0700 1 --2- 172.21.15.32:0/3157976911 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f58e40cee80 0x7f58e40cd040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:43.698 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:43.689+0000 7f58e93d0700 1 -- 172.21.15.32:0/3157976911 >> v2:172.21.15.40:3300/0 conn(0x7f58e40ce260 msgr2=0x7f58e40ce940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:43:43.698 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:43.689+0000 7f58e93d0700 1 --2- 172.21.15.32:0/3157976911 >> v2:172.21.15.40:3300/0 conn(0x7f58e40ce260 0x7f58e40ce940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:43.698 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:43.689+0000 7f58e93d0700 1 -- 172.21.15.32:0/3157976911 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58e4161a80 con 0x7f58e415d100 2023-10-08T13:43:43.699 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:43.689+0000 7f58e93d0700 1 --2- 172.21.15.32:0/3157976911 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f58e415d100 0x7f58e40cb6c0 secure :-1 s=READY pgs=1886 cs=0 l=1 rev1=1 crypto rx=0x7f58e4067660 tx=0x7f58e0009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbefa4c1749878fe server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:43:43.699 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:43.689+0000 7f58dbfff700 1 -- 172.21.15.32:0/3157976911 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58e0011830 con 0x7f58e415d100 2023-10-08T13:43:43.699 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:43.689+0000 7f58dbfff700 1 -- 172.21.15.32:0/3157976911 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58e0011990 con 0x7f58e415d100 2023-10-08T13:43:43.699 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:43.689+0000 7f58dbfff700 1 -- 172.21.15.32:0/3157976911 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58e0011d20 con 0x7f58e415d100 2023-10-08T13:43:43.699 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:43.693+0000 7f58ea3d2700 1 -- 172.21.15.32:0/3157976911 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f58e415d100 msgr2=0x7f58e40cb6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:43:43.700 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:43.693+0000 7f58ea3d2700 1 --2- 172.21.15.32:0/3157976911 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f58e415d100 0x7f58e40cb6c0 secure :-1 s=READY pgs=1886 cs=0 l=1 rev1=1 crypto rx=0x7f58e4067660 tx=0x7f58e0009bf0 comp rx=0 tx=0).stop 2023-10-08T13:43:43.700 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:43.693+0000 7f58ea3d2700 1 -- 172.21.15.32:0/3157976911 shutdown_connections 2023-10-08T13:43:43.700 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:43.693+0000 7f58ea3d2700 1 --2- 172.21.15.32:0/3157976911 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f58e40cee80 0x7f58e40cd040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:43.700 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:43.693+0000 7f58ea3d2700 1 --2- 172.21.15.32:0/3157976911 >> v2:172.21.15.40:3300/0 conn(0x7f58e40ce260 0x7f58e40ce940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:43.700 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:43.693+0000 7f58ea3d2700 1 --2- 172.21.15.32:0/3157976911 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f58e415d100 0x7f58e40cb6c0 unknown :-1 s=CLOSED pgs=1886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:43.700 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:43.693+0000 7f58ea3d2700 1 -- 172.21.15.32:0/3157976911 >> 172.21.15.32:0/3157976911 conn(0x7f58e40cf470 msgr2=0x7f58e40cf880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:43:43.705 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:43.697+0000 7f58ea3d2700 1 -- 172.21.15.32:0/3157976911 shutdown_connections 2023-10-08T13:43:43.708 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:43.701+0000 7f58ea3d2700 1 -- 172.21.15.32:0/3157976911 wait complete. 2023-10-08T13:43:43.710 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:43.705+0000 7f58ea3d2700 1 Processor -- start 2023-10-08T13:43:43.710 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:43.705+0000 7f58ea3d2700 1 -- start start 2023-10-08T13:43:43.711 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:43.705+0000 7f58ea3d2700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f58e40ce260 0x7f58e415e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:43:43.712 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:43.705+0000 7f58ea3d2700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f58e40cee80 0x7f58e40b4510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:43:43.712 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:43.705+0000 7f58ea3d2700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f58e415d100 0x7f58e40c7100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:43:43.712 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:43.705+0000 7f58ea3d2700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58e415ed20 con 0x7f58e415d100 2023-10-08T13:43:43.712 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:43.705+0000 7f58ea3d2700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58e41f6d70 con 0x7f58e40ce260 2023-10-08T13:43:43.712 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:43.705+0000 7f58ea3d2700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58e41f61f0 con 0x7f58e40cee80 2023-10-08T13:43:43.721 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:43.705+0000 7f58e93d0700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f58e40ce260 0x7f58e415e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:43:43.721 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:43.705+0000 7f58e8bcf700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f58e40cee80 0x7f58e40b4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:43:43.721 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:43.705+0000 7f58e93d0700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f58e40ce260 0x7f58e415e7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.32:50892/0 (socket says 172.21.15.32:50892) 2023-10-08T13:43:43.722 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:43.705+0000 7f58e93d0700 1 -- 172.21.15.32:0/4266085660 learned_addr learned my addr 172.21.15.32:0/4266085660 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T13:43:43.722 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:43.705+0000 7f58e8bcf700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f58e40cee80 0x7f58e40b4510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.32:46812/0 (socket says 172.21.15.32:46812) 2023-10-08T13:43:43.722 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:43.705+0000 7f58e93d0700 1 -- 172.21.15.32:0/4266085660 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f58e40cee80 msgr2=0x7f58e40b4510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:43:43.722 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:43.705+0000 7f58e93d0700 1 --2- 172.21.15.32:0/4266085660 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f58e40cee80 0x7f58e40b4510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:43.722 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:43.705+0000 7f58e93d0700 1 -- 172.21.15.32:0/4266085660 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f58e415d100 msgr2=0x7f58e40c7100 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T13:43:43.722 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:43.705+0000 7f58e93d0700 1 --2- 172.21.15.32:0/4266085660 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f58e415d100 0x7f58e40c7100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:43.722 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:43.705+0000 7f58e93d0700 1 -- 172.21.15.32:0/4266085660 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58e0009570 con 0x7f58e40ce260 2023-10-08T13:43:43.722 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:43.705+0000 7f58e8bcf700 1 --2- 172.21.15.32:0/4266085660 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f58e40cee80 0x7f58e40b4510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:43:43.722 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:43.705+0000 7f58e93d0700 1 --2- 172.21.15.32:0/4266085660 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f58e40ce260 0x7f58e415e7e0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f58e0000c00 tx=0x7f58e0004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:43:43.722 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:43.705+0000 7f58d9ffb700 1 -- 172.21.15.32:0/4266085660 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58e0004450 con 0x7f58e40ce260 2023-10-08T13:43:43.723 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:43.705+0000 7f58d9ffb700 1 -- 172.21.15.32:0/4266085660 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58e001e070 con 0x7f58e40ce260 2023-10-08T13:43:43.723 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:43.705+0000 7f58ea3d2700 1 -- 172.21.15.32:0/4266085660 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58e41f64d0 con 0x7f58e40ce260 2023-10-08T13:43:43.723 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:43.709+0000 7f58d9ffb700 1 -- 172.21.15.32:0/4266085660 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58e0003900 con 0x7f58e40ce260 2023-10-08T13:43:43.723 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:43.709+0000 7f58ea3d2700 1 -- 172.21.15.32:0/4266085660 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58e41f6a90 con 0x7f58e40ce260 2023-10-08T13:43:43.723 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:43.709+0000 7f58d9ffb700 1 -- 172.21.15.32:0/4266085660 <== mon.1 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f58e0003a60 con 0x7f58e40ce260 2023-10-08T13:43:43.723 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:43.709+0000 7f58d9ffb700 1 --2- 172.21.15.32:0/4266085660 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f58c8077520 0x7f58c80799e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:43:43.723 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:43.709+0000 7f58d9ffb700 1 -- 172.21.15.32:0/4266085660 <== mon.1 v2:172.21.15.40:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f58e0086dc0 con 0x7f58e40ce260 2023-10-08T13:43:43.723 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:43.709+0000 7f58e8bcf700 1 --2- 172.21.15.32:0/4266085660 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f58c8077520 0x7f58c80799e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:43:43.723 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:43.713+0000 7f58e8bcf700 1 --2- 172.21.15.32:0/4266085660 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f58c8077520 0x7f58c80799e0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f58e415e730 tx=0x7f58d4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:43:43.729 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:43.717+0000 7f58ea3d2700 1 -- 172.21.15.32:0/4266085660 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58e40686a0 con 0x7f58e40ce260 2023-10-08T13:43:43.735 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:43.729+0000 7f58d9ffb700 1 -- 172.21.15.32:0/4266085660 <== mon.1 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f58e008a060 con 0x7f58e40ce260 2023-10-08T13:43:44.015 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:44.009+0000 7f58ea3d2700 1 -- 172.21.15.32:0/4266085660 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f58e40cd690 con 0x7f58e40ce260 2023-10-08T13:43:44.016 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:44.009+0000 7f58d9ffb700 1 -- 172.21.15.32:0/4266085660 <== mon.1 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+4909 (secure 0 0 0) 0x7f58e0020090 con 0x7f58e40ce260 2023-10-08T13:43:44.016 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T13:43:44.016 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":14,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5232,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6835/1178250724","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6834","nonce":1178250724},{"type":"v1","addr":"172.21.15.32:6835","nonce":1178250724}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10},{"gid":5238,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6837/2723596589","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6836","nonce":2723596589},{"type":"v1","addr":"172.21.15.32:6837","nonce":2723596589}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10},{"gid":5323,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6833/3107673350","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":3107673350},{"type":"v1","addr":"172.21.15.40:6833","nonce":3107673350}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T06:10:35.216976+0000","modified":"2023-10-08T06:10:38.240290+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5326},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5326":{"gid":5326,"name":"b","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.40:6835/500201668","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":500201668},{"type":"v1","addr":"172.21.15.40:6835","nonce":500201668}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-10-08T13:43:44.018 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:44.013+0000 7f58ea3d2700 1 -- 172.21.15.32:0/4266085660 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f58c8077520 msgr2=0x7f58c80799e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:43:44.018 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:44.013+0000 7f58ea3d2700 1 --2- 172.21.15.32:0/4266085660 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f58c8077520 0x7f58c80799e0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f58e415e730 tx=0x7f58d4008040 comp rx=0 tx=0).stop 2023-10-08T13:43:44.018 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:44.013+0000 7f58ea3d2700 1 -- 172.21.15.32:0/4266085660 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f58e40ce260 msgr2=0x7f58e415e7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:43:44.018 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:44.013+0000 7f58ea3d2700 1 --2- 172.21.15.32:0/4266085660 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f58e40ce260 0x7f58e415e7e0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f58e0000c00 tx=0x7f58e0004770 comp rx=0 tx=0).stop 2023-10-08T13:43:44.018 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:44.013+0000 7f58ea3d2700 1 -- 172.21.15.32:0/4266085660 shutdown_connections 2023-10-08T13:43:44.018 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:44.013+0000 7f58ea3d2700 1 --2- 172.21.15.32:0/4266085660 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f58c8077520 0x7f58c80799e0 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:44.019 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:44.013+0000 7f58ea3d2700 1 --2- 172.21.15.32:0/4266085660 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f58e415d100 0x7f58e40c7100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:44.019 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:44.013+0000 7f58ea3d2700 1 --2- 172.21.15.32:0/4266085660 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f58e40cee80 0x7f58e40b4510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:44.019 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:44.013+0000 7f58ea3d2700 1 --2- 172.21.15.32:0/4266085660 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f58e40ce260 0x7f58e415e7e0 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:44.019 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:44.013+0000 7f58ea3d2700 1 -- 172.21.15.32:0/4266085660 >> 172.21.15.32:0/4266085660 conn(0x7f58e40cf470 msgr2=0x7f58e40aefe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:43:44.019 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:44.013+0000 7f58ea3d2700 1 -- 172.21.15.32:0/4266085660 shutdown_connections 2023-10-08T13:43:44.019 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:44.013+0000 7f58ea3d2700 1 -- 172.21.15.32:0/4266085660 wait complete. 2023-10-08T13:43:44.019 INFO:teuthology.orchestra.run.smithi032.stderr:dumped fsmap epoch 14 2023-10-08T13:43:44.031 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T13:43:44.154 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:44.149+0000 7f195e4bd700 1 Processor -- start 2023-10-08T13:43:44.154 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:44.149+0000 7f195e4bd700 1 -- start start 2023-10-08T13:43:44.155 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:44.149+0000 7f195e4bd700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f195815d3c0 0x7f195806bec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:43:44.155 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:44.149+0000 7f195e4bd700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f195806bc70 con 0x7f195806b7e0 2023-10-08T13:43:44.155 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:44.149+0000 7f195e4bd700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19580ce030 con 0x7f195806cd80 2023-10-08T13:43:44.156 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:44.149+0000 7f195e4bd700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f195815d7a0 con 0x7f195815d3c0 2023-10-08T13:43:44.156 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:44.149+0000 7f195ccba700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f195806b7e0 0x7f19580cd920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:38286/0 (socket says 172.21.15.32:38286) 2023-10-08T13:43:44.156 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:44.149+0000 7f195ccba700 1 -- 172.21.15.32:0/2091151040 learned_addr learned my addr 172.21.15.32:0/2091151040 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-08T13:43:44.156 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:44.149+0000 7f195d4bb700 1 --2- 172.21.15.32:0/2091151040 >> v2:172.21.15.40:3300/0 conn(0x7f195815d3c0 0x7f195806bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:43:44.157 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:44.149+0000 7f194ffff700 1 -- 172.21.15.32:0/2091151040 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 467583311 0 0) 0x7f195806bc70 con 0x7f195806b7e0 2023-10-08T13:43:44.157 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:44.149+0000 7f194ffff700 1 -- 172.21.15.32:0/2091151040 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f19440035d0 con 0x7f195806b7e0 2023-10-08T13:43:44.157 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:44.149+0000 7f194ffff700 1 -- 172.21.15.32:0/2091151040 <== mon.1 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 384991050 0 0) 0x7f19580ce030 con 0x7f195806cd80 2023-10-08T13:43:44.157 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:44.149+0000 7f194ffff700 1 -- 172.21.15.32:0/2091151040 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f195806bc70 con 0x7f195806cd80 2023-10-08T13:43:44.157 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:44.149+0000 7f195d4bb700 1 -- 172.21.15.32:0/2091151040 >> v1:172.21.15.40:6789/0 conn(0x7f195806cd80 legacy=0x7f195806d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:43:44.157 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:44.149+0000 7f195d4bb700 1 -- 172.21.15.32:0/2091151040 >> v1:172.21.15.32:6789/0 conn(0x7f195806b7e0 legacy=0x7f19580cd920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:43:44.157 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:44.149+0000 7f195d4bb700 1 -- 172.21.15.32:0/2091151040 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1958161910 con 0x7f195815d3c0 2023-10-08T13:43:44.158 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:44.149+0000 7f195d4bb700 1 --2- 172.21.15.32:0/2091151040 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f195815d3c0 0x7f195806bec0 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f1948009850 tx=0x7f1948009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7714b58484e10831 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:43:44.160 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:44.153+0000 7f194ffff700 1 -- 172.21.15.32:0/2091151040 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1948011830 con 0x7f195815d3c0 2023-10-08T13:43:44.160 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:44.153+0000 7f194ffff700 1 -- 172.21.15.32:0/2091151040 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1948011990 con 0x7f195815d3c0 2023-10-08T13:43:44.162 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:44.153+0000 7f194ffff700 1 -- 172.21.15.32:0/2091151040 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1948011d20 con 0x7f195815d3c0 2023-10-08T13:43:44.162 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:44.153+0000 7f195e4bd700 1 -- 172.21.15.32:0/2091151040 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f195815d3c0 msgr2=0x7f195806bec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:43:44.162 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:44.153+0000 7f195e4bd700 1 --2- 172.21.15.32:0/2091151040 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f195815d3c0 0x7f195806bec0 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f1948009850 tx=0x7f1948009b60 comp rx=0 tx=0).stop 2023-10-08T13:43:44.162 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:44.153+0000 7f195e4bd700 1 -- 172.21.15.32:0/2091151040 shutdown_connections 2023-10-08T13:43:44.162 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:44.153+0000 7f195e4bd700 1 --2- 172.21.15.32:0/2091151040 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f195815d3c0 0x7f195806bec0 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:44.162 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:44.153+0000 7f195e4bd700 1 -- 172.21.15.32:0/2091151040 >> 172.21.15.32:0/2091151040 conn(0x7f19580cc7d0 msgr2=0x7f19580ccbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:43:44.163 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:44.157+0000 7f195e4bd700 1 -- 172.21.15.32:0/2091151040 shutdown_connections 2023-10-08T13:43:44.164 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:44.157+0000 7f195e4bd700 1 -- 172.21.15.32:0/2091151040 wait complete. 2023-10-08T13:43:44.166 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:44.161+0000 7f195e4bd700 1 Processor -- start 2023-10-08T13:43:44.166 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:44.161+0000 7f195e4bd700 1 -- start start 2023-10-08T13:43:44.167 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:44.161+0000 7f195e4bd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f195806cd80 0x7f195815a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:43:44.168 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:44.161+0000 7f195e4bd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f195815d3c0 0x7f19580c6e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:43:44.168 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:44.161+0000 7f195e4bd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f19580c7360 0x7f195814b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:43:44.168 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:44.161+0000 7f195e4bd700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19580c77e0 con 0x7f19580c7360 2023-10-08T13:43:44.168 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:44.161+0000 7f195e4bd700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1958148a40 con 0x7f195806cd80 2023-10-08T13:43:44.168 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:44.161+0000 7f195e4bd700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1958148ce0 con 0x7f195815d3c0 2023-10-08T13:43:44.168 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:44.161+0000 7f195dcbc700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f19580c7360 0x7f195814b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:43:44.168 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:44.161+0000 7f195d4bb700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f195806cd80 0x7f195815a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:43:44.168 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:44.161+0000 7f195dcbc700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f19580c7360 0x7f195814b0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:49220/0 (socket says 172.21.15.32:49220) 2023-10-08T13:43:44.168 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:44.161+0000 7f195dcbc700 1 -- 172.21.15.32:0/2299660464 learned_addr learned my addr 172.21.15.32:0/2299660464 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T13:43:44.169 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:44.161+0000 7f195dcbc700 1 -- 172.21.15.32:0/2299660464 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f195815d3c0 msgr2=0x7f19580c6e20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T13:43:44.169 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:44.161+0000 7f195dcbc700 1 --2- 172.21.15.32:0/2299660464 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f195815d3c0 0x7f19580c6e20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:44.170 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:44.161+0000 7f195dcbc700 1 -- 172.21.15.32:0/2299660464 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f195806cd80 msgr2=0x7f195815a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:43:44.170 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:44.161+0000 7f195dcbc700 1 --2- 172.21.15.32:0/2299660464 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f195806cd80 0x7f195815a660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:44.170 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:44.161+0000 7f195dcbc700 1 -- 172.21.15.32:0/2299660464 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19480094b0 con 0x7f19580c7360 2023-10-08T13:43:44.170 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:44.161+0000 7f195dcbc700 1 --2- 172.21.15.32:0/2299660464 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f19580c7360 0x7f195814b0f0 secure :-1 s=READY pgs=1888 cs=0 l=1 rev1=1 crypto rx=0x7f195000cbf0 tx=0x7f195000cf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:43:44.170 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:44.161+0000 7f194dffb700 1 -- 172.21.15.32:0/2299660464 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1950003c20 con 0x7f19580c7360 2023-10-08T13:43:44.170 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:44.161+0000 7f195e4bd700 1 -- 172.21.15.32:0/2299660464 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f195815ae90 con 0x7f19580c7360 2023-10-08T13:43:44.170 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:44.161+0000 7f195e4bd700 1 -- 172.21.15.32:0/2299660464 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1958148f30 con 0x7f19580c7360 2023-10-08T13:43:44.170 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:44.161+0000 7f194dffb700 1 -- 172.21.15.32:0/2299660464 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1950003d80 con 0x7f19580c7360 2023-10-08T13:43:44.170 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:44.161+0000 7f194dffb700 1 -- 172.21.15.32:0/2299660464 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f195000aaf0 con 0x7f19580c7360 2023-10-08T13:43:44.171 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:44.165+0000 7f195e4bd700 1 -- 172.21.15.32:0/2299660464 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1958149140 con 0x7f19580c7360 2023-10-08T13:43:44.171 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:44.165+0000 7f194dffb700 1 -- 172.21.15.32:0/2299660464 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f195000ac50 con 0x7f19580c7360 2023-10-08T13:43:44.179 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:44.173+0000 7f194dffb700 1 --2- 172.21.15.32:0/2299660464 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f193c066510 0x7f193c0689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:43:44.179 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:44.173+0000 7f195d4bb700 1 --2- 172.21.15.32:0/2299660464 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f193c066510 0x7f193c0689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:43:44.185 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:44.177+0000 7f194dffb700 1 -- 172.21.15.32:0/2299660464 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1950083df0 con 0x7f19580c7360 2023-10-08T13:43:44.185 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:44.177+0000 7f195d4bb700 1 --2- 172.21.15.32:0/2299660464 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f193c066510 0x7f193c0689d0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f19480090b0 tx=0x7f1948008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:43:44.185 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:44.177+0000 7f194dffb700 1 -- 172.21.15.32:0/2299660464 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f1950088460 con 0x7f19580c7360 2023-10-08T13:43:44.494 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:44.489+0000 7f195e4bd700 1 -- 172.21.15.32:0/2299660464 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f19580686a0 con 0x7f19580c7360 2023-10-08T13:43:44.494 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:44.489+0000 7f194dffb700 1 -- 172.21.15.32:0/2299660464 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+4909 (secure 0 0 0) 0x7f1950051270 con 0x7f19580c7360 2023-10-08T13:43:44.501 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T13:43:44.501 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":14,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5232,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6835/1178250724","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6834","nonce":1178250724},{"type":"v1","addr":"172.21.15.32:6835","nonce":1178250724}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10},{"gid":5238,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6837/2723596589","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6836","nonce":2723596589},{"type":"v1","addr":"172.21.15.32:6837","nonce":2723596589}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10},{"gid":5323,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6833/3107673350","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":3107673350},{"type":"v1","addr":"172.21.15.40:6833","nonce":3107673350}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T06:10:35.216976+0000","modified":"2023-10-08T06:10:38.240290+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5326},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5326":{"gid":5326,"name":"b","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.40:6835/500201668","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":500201668},{"type":"v1","addr":"172.21.15.40:6835","nonce":500201668}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-10-08T13:43:44.504 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:44.497+0000 7f195e4bd700 1 -- 172.21.15.32:0/2299660464 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f193c066510 msgr2=0x7f193c0689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:43:44.504 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:44.497+0000 7f195e4bd700 1 --2- 172.21.15.32:0/2299660464 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f193c066510 0x7f193c0689d0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f19480090b0 tx=0x7f1948008030 comp rx=0 tx=0).stop 2023-10-08T13:43:44.505 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:44.497+0000 7f195e4bd700 1 -- 172.21.15.32:0/2299660464 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f19580c7360 msgr2=0x7f195814b0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:43:44.505 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:44.497+0000 7f195e4bd700 1 --2- 172.21.15.32:0/2299660464 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f19580c7360 0x7f195814b0f0 secure :-1 s=READY pgs=1888 cs=0 l=1 rev1=1 crypto rx=0x7f195000cbf0 tx=0x7f195000cf00 comp rx=0 tx=0).stop 2023-10-08T13:43:44.505 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:44.497+0000 7f195e4bd700 1 -- 172.21.15.32:0/2299660464 shutdown_connections 2023-10-08T13:43:44.505 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:44.497+0000 7f195e4bd700 1 --2- 172.21.15.32:0/2299660464 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f193c066510 0x7f193c0689d0 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:44.505 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:44.497+0000 7f195e4bd700 1 --2- 172.21.15.32:0/2299660464 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f19580c7360 0x7f195814b0f0 unknown :-1 s=CLOSED pgs=1888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:44.505 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:44.497+0000 7f195e4bd700 1 --2- 172.21.15.32:0/2299660464 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f195815d3c0 0x7f19580c6e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:44.505 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:44.497+0000 7f195e4bd700 1 --2- 172.21.15.32:0/2299660464 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f195806cd80 0x7f195815a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:44.505 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:44.497+0000 7f195e4bd700 1 -- 172.21.15.32:0/2299660464 >> 172.21.15.32:0/2299660464 conn(0x7f19580cc7d0 msgr2=0x7f19580aedb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:43:44.505 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:44.497+0000 7f195e4bd700 1 -- 172.21.15.32:0/2299660464 shutdown_connections 2023-10-08T13:43:44.505 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:44.497+0000 7f195e4bd700 1 -- 172.21.15.32:0/2299660464 wait complete. 2023-10-08T13:43:44.506 INFO:teuthology.orchestra.run.smithi032.stderr:dumped fsmap epoch 14 2023-10-08T13:43:44.523 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T13:43:44.668 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:44.661+0000 7fe75b3bb700 1 Processor -- start 2023-10-08T13:43:44.668 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:44.661+0000 7fe75b3bb700 1 -- start start 2023-10-08T13:43:44.668 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:44.661+0000 7fe75b3bb700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe7540cf050 0x7fe7540cb6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:43:44.668 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:44.661+0000 7fe75b3bb700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe7540ce260 0x7fe75406a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:43:44.668 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:44.661+0000 7fe75b3bb700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe754161a80 con 0x7fe75415d100 2023-10-08T13:43:44.669 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:44.661+0000 7fe75b3bb700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe75406a2a0 con 0x7fe7540ce260 2023-10-08T13:43:44.669 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:44.661+0000 7fe75b3bb700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7540c9ac0 con 0x7fe7540cf050 2023-10-08T13:43:44.669 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:44.661+0000 7fe75a3b9700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fe75415d100 0x7fe7540ce940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:38290/0 (socket says 172.21.15.32:38290) 2023-10-08T13:43:44.669 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:44.661+0000 7fe75a3b9700 1 -- 172.21.15.32:0/98564236 learned_addr learned my addr 172.21.15.32:0/98564236 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-08T13:43:44.669 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:44.661+0000 7fe75abba700 1 --2- 172.21.15.32:0/98564236 >> v2:172.21.15.40:3300/0 conn(0x7fe7540ce260 0x7fe75406a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:43:44.670 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:44.661+0000 7fe75abba700 1 -- 172.21.15.32:0/98564236 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe7540cf050 msgr2=0x7fe7540cb6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:43:44.671 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:44.661+0000 7fe75abba700 1 --2- 172.21.15.32:0/98564236 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe7540cf050 0x7fe7540cb6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:44.671 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:44.661+0000 7fe75abba700 1 -- 172.21.15.32:0/98564236 >> v1:172.21.15.32:6789/0 conn(0x7fe75415d100 legacy=0x7fe7540ce940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:43:44.671 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:44.661+0000 7fe75abba700 1 -- 172.21.15.32:0/98564236 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7540c9cd0 con 0x7fe7540ce260 2023-10-08T13:43:44.671 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:44.661+0000 7fe75abba700 1 --2- 172.21.15.32:0/98564236 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe7540ce260 0x7fe75406a6c0 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7fe74c009d90 tx=0x7fe74c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d535248d53146497 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:43:44.671 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:44.665+0000 7fe7593b7700 1 -- 172.21.15.32:0/98564236 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe74c00e070 con 0x7fe7540ce260 2023-10-08T13:43:44.671 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:44.665+0000 7fe7593b7700 1 -- 172.21.15.32:0/98564236 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe74c00bad0 con 0x7fe7540ce260 2023-10-08T13:43:44.671 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:44.665+0000 7fe7593b7700 1 -- 172.21.15.32:0/98564236 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe74c00be80 con 0x7fe7540ce260 2023-10-08T13:43:44.671 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:44.665+0000 7fe75b3bb700 1 -- 172.21.15.32:0/98564236 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe7540ce260 msgr2=0x7fe75406a6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:43:44.671 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:44.665+0000 7fe75b3bb700 1 --2- 172.21.15.32:0/98564236 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe7540ce260 0x7fe75406a6c0 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7fe74c009d90 tx=0x7fe74c00b330 comp rx=0 tx=0).stop 2023-10-08T13:43:44.671 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:44.665+0000 7fe75b3bb700 1 -- 172.21.15.32:0/98564236 shutdown_connections 2023-10-08T13:43:44.672 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:44.665+0000 7fe75b3bb700 1 --2- 172.21.15.32:0/98564236 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe7540ce260 0x7fe75406a6c0 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:44.672 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:44.665+0000 7fe75b3bb700 1 --2- 172.21.15.32:0/98564236 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe7540cf050 0x7fe7540cb6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:44.672 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:44.665+0000 7fe75b3bb700 1 -- 172.21.15.32:0/98564236 >> 172.21.15.32:0/98564236 conn(0x7fe7540cf470 msgr2=0x7fe7540cf880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:43:44.672 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:44.665+0000 7fe75b3bb700 1 -- 172.21.15.32:0/98564236 shutdown_connections 2023-10-08T13:43:44.672 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:44.665+0000 7fe75b3bb700 1 -- 172.21.15.32:0/98564236 wait complete. 2023-10-08T13:43:44.674 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:44.665+0000 7fe75b3bb700 1 Processor -- start 2023-10-08T13:43:44.674 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:44.665+0000 7fe75b3bb700 1 -- start start 2023-10-08T13:43:44.674 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:44.665+0000 7fe75b3bb700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe7540ce260 0x7fe754070c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:43:44.674 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:44.665+0000 7fe75b3bb700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe7540cf050 0x7fe754157a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:43:44.674 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:44.665+0000 7fe75b3bb700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe75415d100 0x7fe7541594e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:43:44.674 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:44.665+0000 7fe75b3bb700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7540b3600 con 0x7fe75415d100 2023-10-08T13:43:44.675 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:44.665+0000 7fe75b3bb700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe754157f60 con 0x7fe7540cf050 2023-10-08T13:43:44.675 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:44.665+0000 7fe75b3bb700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7541f3500 con 0x7fe7540ce260 2023-10-08T13:43:44.675 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:44.665+0000 7fe75abba700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe75415d100 0x7fe7541594e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:43:44.675 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:44.665+0000 7fe75abba700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe75415d100 0x7fe7541594e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:49226/0 (socket says 172.21.15.32:49226) 2023-10-08T13:43:44.675 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:44.665+0000 7fe75abba700 1 -- 172.21.15.32:0/3352232299 learned_addr learned my addr 172.21.15.32:0/3352232299 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T13:43:44.675 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:44.665+0000 7fe759bb8700 1 --2- 172.21.15.32:0/3352232299 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe7540cf050 0x7fe754157a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:43:44.675 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:44.665+0000 7fe75abba700 1 -- 172.21.15.32:0/3352232299 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe7540ce260 msgr2=0x7fe754070c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:43:44.675 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:44.665+0000 7fe75abba700 1 --2- 172.21.15.32:0/3352232299 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe7540ce260 0x7fe754070c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:44.675 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:44.665+0000 7fe75abba700 1 -- 172.21.15.32:0/3352232299 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe7540cf050 msgr2=0x7fe754157a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:43:44.676 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:44.665+0000 7fe75abba700 1 --2- 172.21.15.32:0/3352232299 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe7540cf050 0x7fe754157a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:44.676 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:44.665+0000 7fe75abba700 1 -- 172.21.15.32:0/3352232299 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe74c009a70 con 0x7fe75415d100 2023-10-08T13:43:44.676 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:44.665+0000 7fe75abba700 1 --2- 172.21.15.32:0/3352232299 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe75415d100 0x7fe7541594e0 secure :-1 s=READY pgs=1890 cs=0 l=1 rev1=1 crypto rx=0x7fe74c004000 tx=0x7fe74c004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:43:44.676 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:44.665+0000 7fe74affd700 1 -- 172.21.15.32:0/3352232299 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe74c004820 con 0x7fe75415d100 2023-10-08T13:43:44.676 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:44.669+0000 7fe75b3bb700 1 -- 172.21.15.32:0/3352232299 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe754161850 con 0x7fe75415d100 2023-10-08T13:43:44.676 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:44.669+0000 7fe74affd700 1 -- 172.21.15.32:0/3352232299 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe74c004980 con 0x7fe75415d100 2023-10-08T13:43:44.677 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:44.669+0000 7fe74affd700 1 -- 172.21.15.32:0/3352232299 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe74c012670 con 0x7fe75415d100 2023-10-08T13:43:44.677 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:44.669+0000 7fe75b3bb700 1 -- 172.21.15.32:0/3352232299 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7540b4d90 con 0x7fe75415d100 2023-10-08T13:43:44.678 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:44.669+0000 7fe75b3bb700 1 -- 172.21.15.32:0/3352232299 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7540686a0 con 0x7fe75415d100 2023-10-08T13:43:44.678 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:44.669+0000 7fe74affd700 1 -- 172.21.15.32:0/3352232299 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fe74c0127d0 con 0x7fe75415d100 2023-10-08T13:43:44.678 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:44.669+0000 7fe74affd700 1 --2- 172.21.15.32:0/3352232299 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fe738066510 0x7fe7380689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:43:44.678 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:44.669+0000 7fe74affd700 1 -- 172.21.15.32:0/3352232299 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe74c085f50 con 0x7fe75415d100 2023-10-08T13:43:44.678 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:44.673+0000 7fe75a3b9700 1 --2- 172.21.15.32:0/3352232299 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fe738066510 0x7fe7380689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:43:44.678 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:44.673+0000 7fe75a3b9700 1 --2- 172.21.15.32:0/3352232299 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fe738066510 0x7fe7380689d0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7fe750000f60 tx=0x7fe750007a90 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:43:44.685 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:44.681+0000 7fe74affd700 1 -- 172.21.15.32:0/3352232299 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fe74c0535c0 con 0x7fe75415d100 2023-10-08T13:43:44.913 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:44.909+0000 7fe75b3bb700 1 -- 172.21.15.32:0/3352232299 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe7540b3740 con 0x7fe75415d100 2023-10-08T13:43:44.915 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:44.909+0000 7fe74affd700 1 -- 172.21.15.32:0/3352232299 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) v1 ==== 74+0+16509 (secure 0 0 0) 0x7fe74c056be0 con 0x7fe75415d100 2023-10-08T13:43:44.916 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T13:43:44.916 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":35,"fsid":"ac672d87-96ae-41e0-9314-623ba2cdbbba","created":"2023-10-08T06:09:11.175626+0000","modified":"2023-10-08T06:10:36.862351+0000","last_up_change":"2023-10-08T06:09:22.744643+0000","last_in_change":"2023-10-08T06:09:14.131580+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T06:09:23.307843+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-10-08T06:10:33.777525+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-10-08T06:10:34.202152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"43433f0c-9592-4874-92d7-10f8f4acf07f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":587888964},{"type":"v1","addr":"172.21.15.32:6801","nonce":587888964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":587888964},{"type":"v1","addr":"172.21.15.32:6803","nonce":587888964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":587888964},{"type":"v1","addr":"172.21.15.32:6810","nonce":587888964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6805","nonce":587888964},{"type":"v1","addr":"172.21.15.32:6807","nonce":587888964}]},"public_addr":"172.21.15.32:6801/587888964","cluster_addr":"172.21.15.32:6803/587888964","heartbeat_back_addr":"172.21.15.32:6810/587888964","heartbeat_front_addr":"172.21.15.32:6807/587888964","state":["exists","up"]},{"osd":1,"uuid":"2ecb1008-b987-4ce7-b646-6cded55fc8d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":990576767},{"type":"v1","addr":"172.21.15.32:6817","nonce":990576767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":990576767},{"type":"v1","addr":"172.21.15.32:6819","nonce":990576767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":990576767},{"type":"v1","addr":"172.21.15.32:6823","nonce":990576767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":990576767},{"type":"v1","addr":"172.21.15.32:6821","nonce":990576767}]},"public_addr":"172.21.15.32:6817/990576767","cluster_addr":"172.21.15.32:6819/990576767","heartbeat_back_addr":"172.21.15.32:6823/990576767","heartbeat_front_addr":"172.21.15.32:6821/990576767","state":["exists","up"]},{"osd":2,"uuid":"1b131c94-c09b-4e80-8746-bf1b7bac362d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6824","nonce":1566874440},{"type":"v1","addr":"172.21.15.32:6825","nonce":1566874440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":1566874440},{"type":"v1","addr":"172.21.15.32:6827","nonce":1566874440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":1566874440},{"type":"v1","addr":"172.21.15.32:6831","nonce":1566874440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":1566874440},{"type":"v1","addr":"172.21.15.32:6829","nonce":1566874440}]},"public_addr":"172.21.15.32:6825/1566874440","cluster_addr":"172.21.15.32:6827/1566874440","heartbeat_back_addr":"172.21.15.32:6831/1566874440","heartbeat_front_addr":"172.21.15.32:6829/1566874440","state":["exists","up"]},{"osd":3,"uuid":"ad655af2-1f6f-4689-b21d-b07bbaeb68b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":3672614802},{"type":"v1","addr":"172.21.15.32:6806","nonce":3672614802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6809","nonce":3672614802},{"type":"v1","addr":"172.21.15.32:6811","nonce":3672614802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":3672614802},{"type":"v1","addr":"172.21.15.32:6815","nonce":3672614802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":3672614802},{"type":"v1","addr":"172.21.15.32:6813","nonce":3672614802}]},"public_addr":"172.21.15.32:6806/3672614802","cluster_addr":"172.21.15.32:6811/3672614802","heartbeat_back_addr":"172.21.15.32:6815/3672614802","heartbeat_front_addr":"172.21.15.32:6813/3672614802","state":["exists","up"]},{"osd":4,"uuid":"64a543a1-8c4f-458e-9aba-b35c1cd7dd03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":3369928244},{"type":"v1","addr":"172.21.15.40:6801","nonce":3369928244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":3369928244},{"type":"v1","addr":"172.21.15.40:6803","nonce":3369928244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":3369928244},{"type":"v1","addr":"172.21.15.40:6807","nonce":3369928244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":3369928244},{"type":"v1","addr":"172.21.15.40:6805","nonce":3369928244}]},"public_addr":"172.21.15.40:6801/3369928244","cluster_addr":"172.21.15.40:6803/3369928244","heartbeat_back_addr":"172.21.15.40:6807/3369928244","heartbeat_front_addr":"172.21.15.40:6805/3369928244","state":["exists","up"]},{"osd":5,"uuid":"0fef3e54-edb4-4678-878e-944663c51638","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":2395850297},{"type":"v1","addr":"172.21.15.40:6825","nonce":2395850297}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":2395850297},{"type":"v1","addr":"172.21.15.40:6827","nonce":2395850297}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":2395850297},{"type":"v1","addr":"172.21.15.40:6831","nonce":2395850297}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":2395850297},{"type":"v1","addr":"172.21.15.40:6829","nonce":2395850297}]},"public_addr":"172.21.15.40:6825/2395850297","cluster_addr":"172.21.15.40:6827/2395850297","heartbeat_back_addr":"172.21.15.40:6831/2395850297","heartbeat_front_addr":"172.21.15.40:6829/2395850297","state":["exists","up"]},{"osd":6,"uuid":"2eeb0472-6096-469d-9b2c-cab4bf41c31a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":4145283410},{"type":"v1","addr":"172.21.15.40:6809","nonce":4145283410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":4145283410},{"type":"v1","addr":"172.21.15.40:6811","nonce":4145283410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":4145283410},{"type":"v1","addr":"172.21.15.40:6815","nonce":4145283410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":4145283410},{"type":"v1","addr":"172.21.15.40:6813","nonce":4145283410}]},"public_addr":"172.21.15.40:6809/4145283410","cluster_addr":"172.21.15.40:6811/4145283410","heartbeat_back_addr":"172.21.15.40:6815/4145283410","heartbeat_front_addr":"172.21.15.40:6813/4145283410","state":["exists","up"]},{"osd":7,"uuid":"cf76e4c7-96a6-401f-a280-91aad4641940","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":2943297416},{"type":"v1","addr":"172.21.15.40:6817","nonce":2943297416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":2943297416},{"type":"v1","addr":"172.21.15.40:6819","nonce":2943297416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":2943297416},{"type":"v1","addr":"172.21.15.40:6823","nonce":2943297416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":2943297416},{"type":"v1","addr":"172.21.15.40:6821","nonce":2943297416}]},"public_addr":"172.21.15.40:6817/2943297416","cluster_addr":"172.21.15.40:6819/2943297416","heartbeat_back_addr":"172.21.15.40:6823/2943297416","heartbeat_front_addr":"172.21.15.40:6821/2943297416","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.411475+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.628841+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.599055+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.166100+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.384135+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.488403+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.307648+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.363541+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T13:43:44.919 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:44.913+0000 7fe75b3bb700 1 -- 172.21.15.32:0/3352232299 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fe738066510 msgr2=0x7fe7380689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:43:44.920 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:44.913+0000 7fe75b3bb700 1 --2- 172.21.15.32:0/3352232299 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fe738066510 0x7fe7380689d0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7fe750000f60 tx=0x7fe750007a90 comp rx=0 tx=0).stop 2023-10-08T13:43:44.920 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:44.913+0000 7fe75b3bb700 1 -- 172.21.15.32:0/3352232299 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe75415d100 msgr2=0x7fe7541594e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:43:44.920 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:44.913+0000 7fe75b3bb700 1 --2- 172.21.15.32:0/3352232299 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe75415d100 0x7fe7541594e0 secure :-1 s=READY pgs=1890 cs=0 l=1 rev1=1 crypto rx=0x7fe74c004000 tx=0x7fe74c004af0 comp rx=0 tx=0).stop 2023-10-08T13:43:44.921 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:44.913+0000 7fe75b3bb700 1 -- 172.21.15.32:0/3352232299 shutdown_connections 2023-10-08T13:43:44.921 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:44.913+0000 7fe75b3bb700 1 --2- 172.21.15.32:0/3352232299 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fe738066510 0x7fe7380689d0 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:44.921 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:44.913+0000 7fe75b3bb700 1 --2- 172.21.15.32:0/3352232299 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe75415d100 0x7fe7541594e0 unknown :-1 s=CLOSED pgs=1890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:44.922 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:44.913+0000 7fe75b3bb700 1 --2- 172.21.15.32:0/3352232299 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe7540cf050 0x7fe754157a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:44.923 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:44.913+0000 7fe75b3bb700 1 --2- 172.21.15.32:0/3352232299 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe7540ce260 0x7fe754070c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:44.923 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:44.913+0000 7fe75b3bb700 1 -- 172.21.15.32:0/3352232299 >> 172.21.15.32:0/3352232299 conn(0x7fe7540cf470 msgr2=0x7fe7540ce920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:43:44.923 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:44.913+0000 7fe75b3bb700 1 -- 172.21.15.32:0/3352232299 shutdown_connections 2023-10-08T13:43:44.924 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:44.913+0000 7fe75b3bb700 1 -- 172.21.15.32:0/3352232299 wait complete. 2023-10-08T13:43:44.934 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-08T13:43:45.068 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:45.061+0000 7fc1aef7d700 1 Processor -- start 2023-10-08T13:43:45.069 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:45.061+0000 7fc1aef7d700 1 -- start start 2023-10-08T13:43:45.071 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:45.065+0000 7fc1aef7d700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc1a815e190 0x7fc1a815aa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:43:45.071 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:45.065+0000 7fc1aef7d700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1a815e940 con 0x7fc1a806d990 2023-10-08T13:43:45.071 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:45.065+0000 7fc1aef7d700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1a80ce8a0 con 0x7fc1a806b3b0 2023-10-08T13:43:45.073 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:45.065+0000 7fc1aef7d700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1a815a830 con 0x7fc1a815e190 2023-10-08T13:43:45.073 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:45.065+0000 7fc1ad77a700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fc1a806d990 0x7fc1a815da80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:38306/0 (socket says 172.21.15.32:38306) 2023-10-08T13:43:45.073 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:45.065+0000 7fc1ae77c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc1a815e190 0x7fc1a815aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:43:45.073 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:45.065+0000 7fc1adf7b700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fc1a806b3b0 0x7fc1a806b790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.32:33070/0 (socket says 172.21.15.32:33070) 2023-10-08T13:43:45.073 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:45.065+0000 7fc1ad77a700 1 -- 172.21.15.32:0/1147052950 learned_addr learned my addr 172.21.15.32:0/1147052950 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-08T13:43:45.074 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:45.065+0000 7fc1acf79700 1 -- 172.21.15.32:0/1147052950 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 420461004 0 0) 0x7fc1a815e940 con 0x7fc1a806d990 2023-10-08T13:43:45.074 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:45.065+0000 7fc1acf79700 1 -- 172.21.15.32:0/1147052950 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc1940035d0 con 0x7fc1a806d990 2023-10-08T13:43:45.074 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:45.065+0000 7fc1acf79700 1 -- 172.21.15.32:0/1147052950 <== mon.1 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1356675193 0 0) 0x7fc1a80ce8a0 con 0x7fc1a806b3b0 2023-10-08T13:43:45.074 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:45.065+0000 7fc1acf79700 1 -- 172.21.15.32:0/1147052950 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc1a815e940 con 0x7fc1a806b3b0 2023-10-08T13:43:45.074 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:45.065+0000 7fc1ae77c700 1 -- 172.21.15.32:0/1147052950 >> v1:172.21.15.40:6789/0 conn(0x7fc1a806b3b0 legacy=0x7fc1a806b790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:43:45.074 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:45.065+0000 7fc1acf79700 1 -- 172.21.15.32:0/1147052950 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1001935734 0 0) 0x7fc1940035d0 con 0x7fc1a806d990 2023-10-08T13:43:45.074 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:45.065+0000 7fc1ae77c700 1 -- 172.21.15.32:0/1147052950 >> v1:172.21.15.32:6789/0 conn(0x7fc1a806d990 legacy=0x7fc1a815da80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:43:45.075 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:45.065+0000 7fc1ae77c700 1 -- 172.21.15.32:0/1147052950 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1a815e660 con 0x7fc1a815e190 2023-10-08T13:43:45.075 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:45.065+0000 7fc1ae77c700 1 --2- 172.21.15.32:0/1147052950 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc1a815e190 0x7fc1a815aa10 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7fc1a0009d90 tx=0x7fc1a000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e1b3ce35408273f8 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:43:45.075 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:45.065+0000 7fc1acf79700 1 -- 172.21.15.32:0/1147052950 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1a000e070 con 0x7fc1a815e190 2023-10-08T13:43:45.075 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:45.065+0000 7fc1acf79700 1 -- 172.21.15.32:0/1147052950 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1a0003a40 con 0x7fc1a815e190 2023-10-08T13:43:45.075 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:45.065+0000 7fc1acf79700 1 -- 172.21.15.32:0/1147052950 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc198001670 con 0x7fc1a815e190 2023-10-08T13:43:45.085 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:45.073+0000 7fc1aef7d700 1 -- 172.21.15.32:0/1147052950 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc1a815e190 msgr2=0x7fc1a815aa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:43:45.085 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:45.073+0000 7fc1aef7d700 1 --2- 172.21.15.32:0/1147052950 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc1a815e190 0x7fc1a815aa10 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7fc1a0009d90 tx=0x7fc1a000b330 comp rx=0 tx=0).stop 2023-10-08T13:43:45.085 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:45.073+0000 7fc1aef7d700 1 -- 172.21.15.32:0/1147052950 shutdown_connections 2023-10-08T13:43:45.086 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:45.073+0000 7fc1aef7d700 1 --2- 172.21.15.32:0/1147052950 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc1a815e190 0x7fc1a815aa10 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:45.086 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:45.073+0000 7fc1aef7d700 1 -- 172.21.15.32:0/1147052950 >> 172.21.15.32:0/1147052950 conn(0x7fc1a80cc7d0 msgr2=0x7fc1a80ccbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:43:45.091 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:45.085+0000 7fc1aef7d700 1 -- 172.21.15.32:0/1147052950 shutdown_connections 2023-10-08T13:43:45.092 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:45.085+0000 7fc1aef7d700 1 -- 172.21.15.32:0/1147052950 wait complete. 2023-10-08T13:43:45.093 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:45.085+0000 7fc1aef7d700 1 Processor -- start 2023-10-08T13:43:45.093 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:45.085+0000 7fc1aef7d700 1 -- start start 2023-10-08T13:43:45.095 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:45.089+0000 7fc1aef7d700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc1a806b3b0 0x7fc1a8151b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:43:45.096 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:45.089+0000 7fc1aef7d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc1a806d990 0x7fc1a80ac8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:43:45.096 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:45.089+0000 7fc1aef7d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc1a815e190 0x7fc1a815aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:43:45.096 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:45.089+0000 7fc1aef7d700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1a81520d0 con 0x7fc1a806b3b0 2023-10-08T13:43:45.096 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:45.089+0000 7fc1aef7d700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1a815b580 con 0x7fc1a806d990 2023-10-08T13:43:45.096 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:45.089+0000 7fc1aef7d700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1a815b860 con 0x7fc1a815e190 2023-10-08T13:43:45.097 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:45.089+0000 7fc1adf7b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc1a806b3b0 0x7fc1a8151b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:43:45.097 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:45.089+0000 7fc1adf7b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc1a806b3b0 0x7fc1a8151b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:49236/0 (socket says 172.21.15.32:49236) 2023-10-08T13:43:45.097 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:45.089+0000 7fc1adf7b700 1 -- 172.21.15.32:0/2847308646 learned_addr learned my addr 172.21.15.32:0/2847308646 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T13:43:45.097 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:45.089+0000 7fc1ae77c700 1 --2- 172.21.15.32:0/2847308646 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc1a815e190 0x7fc1a815aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:43:45.097 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:45.089+0000 7fc1ad77a700 1 --2- 172.21.15.32:0/2847308646 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc1a806d990 0x7fc1a80ac8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:43:45.098 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:45.089+0000 7fc1adf7b700 1 -- 172.21.15.32:0/2847308646 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc1a815e190 msgr2=0x7fc1a815aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:43:45.098 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:45.089+0000 7fc1adf7b700 1 --2- 172.21.15.32:0/2847308646 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc1a815e190 0x7fc1a815aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:45.098 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:45.089+0000 7fc1adf7b700 1 -- 172.21.15.32:0/2847308646 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc1a806d990 msgr2=0x7fc1a80ac8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:43:45.098 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:45.089+0000 7fc1adf7b700 1 --2- 172.21.15.32:0/2847308646 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc1a806d990 0x7fc1a80ac8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:45.098 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:45.089+0000 7fc1adf7b700 1 -- 172.21.15.32:0/2847308646 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1a0009a70 con 0x7fc1a806b3b0 2023-10-08T13:43:45.099 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:45.089+0000 7fc1adf7b700 1 --2- 172.21.15.32:0/2847308646 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc1a806b3b0 0x7fc1a8151b90 secure :-1 s=READY pgs=1892 cs=0 l=1 rev1=1 crypto rx=0x7fc1a400c4d0 tx=0x7fc1a400c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:43:45.099 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:45.089+0000 7fc19e7fc700 1 -- 172.21.15.32:0/2847308646 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1a4005cd0 con 0x7fc1a806b3b0 2023-10-08T13:43:45.099 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:45.089+0000 7fc1aef7d700 1 -- 172.21.15.32:0/2847308646 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1a815bb40 con 0x7fc1a806b3b0 2023-10-08T13:43:45.099 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:45.089+0000 7fc19e7fc700 1 -- 172.21.15.32:0/2847308646 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1a4005e30 con 0x7fc1a806b3b0 2023-10-08T13:43:45.100 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:45.089+0000 7fc1aef7d700 1 -- 172.21.15.32:0/2847308646 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1a815c850 con 0x7fc1a806b3b0 2023-10-08T13:43:45.100 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:45.089+0000 7fc19e7fc700 1 -- 172.21.15.32:0/2847308646 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1a40072f0 con 0x7fc1a806b3b0 2023-10-08T13:43:45.102 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:45.089+0000 7fc1aef7d700 1 -- 172.21.15.32:0/2847308646 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1a80b4340 con 0x7fc1a806b3b0 2023-10-08T13:43:45.102 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:45.089+0000 7fc19e7fc700 1 -- 172.21.15.32:0/2847308646 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fc1a4007450 con 0x7fc1a806b3b0 2023-10-08T13:43:45.103 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:45.093+0000 7fc19e7fc700 1 --2- 172.21.15.32:0/2847308646 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fc18c066510 0x7fc18c0689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:43:45.103 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:45.093+0000 7fc19e7fc700 1 -- 172.21.15.32:0/2847308646 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc1a4083170 con 0x7fc1a806b3b0 2023-10-08T13:43:45.103 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:45.093+0000 7fc1ad77a700 1 --2- 172.21.15.32:0/2847308646 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fc18c066510 0x7fc18c0689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:43:45.104 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:45.093+0000 7fc1ad77a700 1 --2- 172.21.15.32:0/2847308646 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fc18c066510 0x7fc18c0689d0 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7fc198001eb0 tx=0x7fc198001d60 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:43:45.107 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:45.101+0000 7fc19e7fc700 1 -- 172.21.15.32:0/2847308646 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fc1a80b4340 con 0x7fc1a806b3b0 2023-10-08T13:43:45.415 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:45.409+0000 7fc1aef7d700 1 -- 172.21.15.32:0/2847308646 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fc1a80b4340 con 0x7fc1a806b3b0 2023-10-08T13:43:45.431 INFO:tasks.ceph.mon.a.smithi032.stderr:2023-10-08T13:43:45.425+0000 7ff282a67700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-08T13:43:45.433 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:45.425+0000 7fc19e7fc700 1 -- 172.21.15.32:0/2847308646 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v15) v1 ==== 161+0+0 (secure 0 0 0) 0x7fc1a80b4340 con 0x7fc1a806b3b0 2023-10-08T13:43:45.438 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:45.433+0000 7fc1aef7d700 1 -- 172.21.15.32:0/2847308646 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fc18c066510 msgr2=0x7fc18c0689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:43:45.438 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:45.433+0000 7fc1aef7d700 1 --2- 172.21.15.32:0/2847308646 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fc18c066510 0x7fc18c0689d0 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7fc198001eb0 tx=0x7fc198001d60 comp rx=0 tx=0).stop 2023-10-08T13:43:45.439 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:45.433+0000 7fc1aef7d700 1 -- 172.21.15.32:0/2847308646 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc1a806b3b0 msgr2=0x7fc1a8151b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:43:45.439 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:45.433+0000 7fc1aef7d700 1 --2- 172.21.15.32:0/2847308646 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc1a806b3b0 0x7fc1a8151b90 secure :-1 s=READY pgs=1892 cs=0 l=1 rev1=1 crypto rx=0x7fc1a400c4d0 tx=0x7fc1a400c7e0 comp rx=0 tx=0).stop 2023-10-08T13:43:45.439 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:45.433+0000 7fc1aef7d700 1 -- 172.21.15.32:0/2847308646 shutdown_connections 2023-10-08T13:43:45.440 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:45.433+0000 7fc1aef7d700 1 --2- 172.21.15.32:0/2847308646 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fc18c066510 0x7fc18c0689d0 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:45.440 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:45.433+0000 7fc1aef7d700 1 --2- 172.21.15.32:0/2847308646 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc1a815e190 0x7fc1a815aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:45.440 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:45.433+0000 7fc1aef7d700 1 --2- 172.21.15.32:0/2847308646 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc1a806d990 0x7fc1a80ac8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:45.440 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:45.433+0000 7fc1aef7d700 1 --2- 172.21.15.32:0/2847308646 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc1a806b3b0 0x7fc1a8151b90 unknown :-1 s=CLOSED pgs=1892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:45.441 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:45.433+0000 7fc1aef7d700 1 -- 172.21.15.32:0/2847308646 >> 172.21.15.32:0/2847308646 conn(0x7fc1a80cc7d0 msgr2=0x7fc1a80d06b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:43:45.441 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:45.433+0000 7fc1aef7d700 1 -- 172.21.15.32:0/2847308646 shutdown_connections 2023-10-08T13:43:45.441 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:45.433+0000 7fc1aef7d700 1 -- 172.21.15.32:0/2847308646 wait complete. 2023-10-08T13:43:45.446 INFO:teuthology.orchestra.run.smithi032.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-08T13:43:45.461 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-08T13:43:45.562 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:45.557+0000 7f4d3d370700 1 Processor -- start 2023-10-08T13:43:45.562 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:45.557+0000 7f4d3d370700 1 -- start start 2023-10-08T13:43:45.564 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:45.557+0000 7f4d3d370700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f4d380cd960 0x7f4d3806bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:43:45.564 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:45.557+0000 7f4d3d370700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f4d380cdd40 0x7f4d380d0730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:43:45.564 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:45.557+0000 7f4d3d370700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d380d0c70 con 0x7f4d380cea20 2023-10-08T13:43:45.564 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:45.557+0000 7f4d3d370700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d3806cf40 con 0x7f4d380cdd40 2023-10-08T13:43:45.564 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:45.557+0000 7f4d3d370700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d3806d1e0 con 0x7f4d380cd960 2023-10-08T13:43:45.564 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:45.557+0000 7f4d377fe700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f4d380cdd40 0x7f4d380d0730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:43:45.565 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:45.557+0000 7f4d377fe700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f4d380cdd40 0x7f4d380d0730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:49242/0 (socket says 172.21.15.32:49242) 2023-10-08T13:43:45.565 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:45.557+0000 7f4d377fe700 1 -- 172.21.15.32:0/3233601460 learned_addr learned my addr 172.21.15.32:0/3233601460 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T13:43:45.565 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:45.557+0000 7f4d37fff700 1 --2- 172.21.15.32:0/3233601460 >> v2:172.21.15.40:3300/0 conn(0x7f4d380cd960 0x7f4d3806bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:43:45.565 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:45.557+0000 7f4d377fe700 1 -- 172.21.15.32:0/3233601460 >> v2:172.21.15.40:3300/0 conn(0x7f4d380cd960 msgr2=0x7f4d3806bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:43:45.565 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:45.557+0000 7f4d377fe700 1 --2- 172.21.15.32:0/3233601460 >> v2:172.21.15.40:3300/0 conn(0x7f4d380cd960 0x7f4d3806bde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:45.565 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:45.557+0000 7f4d377fe700 1 -- 172.21.15.32:0/3233601460 >> v1:172.21.15.40:6789/0 conn(0x7f4d380cea20 legacy=0x7f4d380cc4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:43:45.565 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:45.557+0000 7f4d377fe700 1 -- 172.21.15.32:0/3233601460 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d380703c0 con 0x7f4d380cdd40 2023-10-08T13:43:45.565 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:45.557+0000 7f4d377fe700 1 --2- 172.21.15.32:0/3233601460 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4d380cdd40 0x7f4d380d0730 secure :-1 s=READY pgs=1893 cs=0 l=1 rev1=1 crypto rx=0x7f4d380b39e0 tx=0x7f4d2c009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a548694bd4f3ddc server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:43:45.566 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:45.557+0000 7f4d36ffd700 1 -- 172.21.15.32:0/3233601460 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d2c00b8a0 con 0x7f4d380cdd40 2023-10-08T13:43:45.566 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:45.557+0000 7f4d36ffd700 1 -- 172.21.15.32:0/3233601460 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d2c00ba00 con 0x7f4d380cdd40 2023-10-08T13:43:45.566 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:45.557+0000 7f4d36ffd700 1 -- 172.21.15.32:0/3233601460 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d2c00bd90 con 0x7f4d380cdd40 2023-10-08T13:43:45.567 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:45.561+0000 7f4d3d370700 1 -- 172.21.15.32:0/3233601460 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4d380cdd40 msgr2=0x7f4d380d0730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:43:45.567 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:45.561+0000 7f4d3d370700 1 --2- 172.21.15.32:0/3233601460 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4d380cdd40 0x7f4d380d0730 secure :-1 s=READY pgs=1893 cs=0 l=1 rev1=1 crypto rx=0x7f4d380b39e0 tx=0x7f4d2c009bf0 comp rx=0 tx=0).stop 2023-10-08T13:43:45.567 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:45.561+0000 7f4d3d370700 1 -- 172.21.15.32:0/3233601460 shutdown_connections 2023-10-08T13:43:45.567 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:45.561+0000 7f4d3d370700 1 --2- 172.21.15.32:0/3233601460 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4d380cdd40 0x7f4d380d0730 unknown :-1 s=CLOSED pgs=1893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:45.567 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:45.561+0000 7f4d3d370700 1 --2- 172.21.15.32:0/3233601460 >> v2:172.21.15.40:3300/0 conn(0x7f4d380cd960 0x7f4d3806bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:45.567 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:45.561+0000 7f4d3d370700 1 -- 172.21.15.32:0/3233601460 >> 172.21.15.32:0/3233601460 conn(0x7f4d3806de60 msgr2=0x7f4d3806e240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:43:45.567 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:45.561+0000 7f4d3d370700 1 -- 172.21.15.32:0/3233601460 shutdown_connections 2023-10-08T13:43:45.567 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:45.561+0000 7f4d3d370700 1 -- 172.21.15.32:0/3233601460 wait complete. 2023-10-08T13:43:45.568 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:45.561+0000 7f4d3d370700 1 Processor -- start 2023-10-08T13:43:45.568 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:45.561+0000 7f4d3d370700 1 -- start start 2023-10-08T13:43:45.570 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:45.561+0000 7f4d3d370700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4d380cd960 0x7f4d380c56e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:43:45.570 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:45.561+0000 7f4d3d370700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4d380cdd40 0x7f4d380ca630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:43:45.570 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:45.561+0000 7f4d3d370700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4d380cea20 0x7f4d38157c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:43:45.570 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:45.561+0000 7f4d3d370700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d380c5c20 con 0x7f4d380cd960 2023-10-08T13:43:45.570 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:45.561+0000 7f4d3d370700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d381f7130 con 0x7f4d380cea20 2023-10-08T13:43:45.570 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:45.561+0000 7f4d3d370700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d380c7f20 con 0x7f4d380cdd40 2023-10-08T13:43:45.570 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:45.561+0000 7f4d37fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4d380cd960 0x7f4d380c56e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:43:45.570 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:45.561+0000 7f4d37fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4d380cd960 0x7f4d380c56e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:49250/0 (socket says 172.21.15.32:49250) 2023-10-08T13:43:45.571 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:45.561+0000 7f4d37fff700 1 -- 172.21.15.32:0/4028072450 learned_addr learned my addr 172.21.15.32:0/4028072450 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T13:43:45.571 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:45.565+0000 7f4d377fe700 1 --2- 172.21.15.32:0/4028072450 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4d380cdd40 0x7f4d380ca630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:43:45.571 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:45.565+0000 7f4d3cb6f700 1 --2- 172.21.15.32:0/4028072450 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4d380cea20 0x7f4d38157c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:43:45.571 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:45.565+0000 7f4d37fff700 1 -- 172.21.15.32:0/4028072450 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4d380cdd40 msgr2=0x7f4d380ca630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:43:45.571 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:45.565+0000 7f4d37fff700 1 --2- 172.21.15.32:0/4028072450 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4d380cdd40 0x7f4d380ca630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:45.571 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:45.565+0000 7f4d37fff700 1 -- 172.21.15.32:0/4028072450 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4d380cea20 msgr2=0x7f4d38157c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:43:45.571 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:45.565+0000 7f4d37fff700 1 --2- 172.21.15.32:0/4028072450 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4d380cea20 0x7f4d38157c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:45.571 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:45.565+0000 7f4d37fff700 1 -- 172.21.15.32:0/4028072450 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d2c009570 con 0x7f4d380cd960 2023-10-08T13:43:45.571 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:45.565+0000 7f4d37fff700 1 --2- 172.21.15.32:0/4028072450 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4d380cd960 0x7f4d380c56e0 secure :-1 s=READY pgs=1894 cs=0 l=1 rev1=1 crypto rx=0x7f4d2800e810 tx=0x7f4d2800eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:43:45.572 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:45.565+0000 7f4d34ff9700 1 -- 172.21.15.32:0/4028072450 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d2800c070 con 0x7f4d380cd960 2023-10-08T13:43:45.572 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:45.565+0000 7f4d34ff9700 1 -- 172.21.15.32:0/4028072450 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d28013610 con 0x7f4d380cd960 2023-10-08T13:43:45.572 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:45.565+0000 7f4d3d370700 1 -- 172.21.15.32:0/4028072450 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d380c8200 con 0x7f4d380cd960 2023-10-08T13:43:45.572 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:45.565+0000 7f4d34ff9700 1 -- 172.21.15.32:0/4028072450 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d280139c0 con 0x7f4d380cd960 2023-10-08T13:43:45.573 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:45.565+0000 7f4d3d370700 1 -- 172.21.15.32:0/4028072450 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d380c87c0 con 0x7f4d380cd960 2023-10-08T13:43:45.573 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:45.565+0000 7f4d3d370700 1 -- 172.21.15.32:0/4028072450 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d38073f00 con 0x7f4d380cd960 2023-10-08T13:43:45.573 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:45.565+0000 7f4d34ff9700 1 -- 172.21.15.32:0/4028072450 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f4d28013b20 con 0x7f4d380cd960 2023-10-08T13:43:45.573 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:45.565+0000 7f4d34ff9700 1 --2- 172.21.15.32:0/4028072450 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f4d24066510 0x7f4d240689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:43:45.573 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:45.569+0000 7f4d34ff9700 1 -- 172.21.15.32:0/4028072450 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f4d28083bf0 con 0x7f4d380cd960 2023-10-08T13:43:45.573 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:45.569+0000 7f4d377fe700 1 --2- 172.21.15.32:0/4028072450 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f4d24066510 0x7f4d240689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:43:45.574 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:45.569+0000 7f4d377fe700 1 --2- 172.21.15.32:0/4028072450 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f4d24066510 0x7f4d240689d0 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f4d2c000c00 tx=0x7f4d2c008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:43:45.581 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:45.573+0000 7f4d34ff9700 1 -- 172.21.15.32:0/4028072450 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f4d28051020 con 0x7f4d380cd960 2023-10-08T13:43:45.786 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:45.781+0000 7f4d3d370700 1 -- 172.21.15.32:0/4028072450 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f4d3806fdd0 con 0x7f4d380cd960 2023-10-08T13:43:45.845 INFO:tasks.ceph.mds.b.smithi040.stdout:starting mds.b at 2023-10-08T13:43:46.439 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:46.433+0000 7f4d34ff9700 1 -- 172.21.15.32:0/4028072450 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v16) v1 ==== 104+0+0 (secure 0 0 0) 0x7f4d28054640 con 0x7f4d380cd960 2023-10-08T13:43:46.444 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:46.437+0000 7f4d3d370700 1 -- 172.21.15.32:0/4028072450 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f4d24066510 msgr2=0x7f4d240689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:43:46.444 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:46.437+0000 7f4d3d370700 1 --2- 172.21.15.32:0/4028072450 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f4d24066510 0x7f4d240689d0 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f4d2c000c00 tx=0x7f4d2c008030 comp rx=0 tx=0).stop 2023-10-08T13:43:46.444 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:46.437+0000 7f4d3d370700 1 -- 172.21.15.32:0/4028072450 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4d380cd960 msgr2=0x7f4d380c56e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:43:46.444 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:46.437+0000 7f4d3d370700 1 --2- 172.21.15.32:0/4028072450 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4d380cd960 0x7f4d380c56e0 secure :-1 s=READY pgs=1894 cs=0 l=1 rev1=1 crypto rx=0x7f4d2800e810 tx=0x7f4d2800eb20 comp rx=0 tx=0).stop 2023-10-08T13:43:46.444 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:46.437+0000 7f4d3d370700 1 -- 172.21.15.32:0/4028072450 shutdown_connections 2023-10-08T13:43:46.444 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:46.437+0000 7f4d3d370700 1 --2- 172.21.15.32:0/4028072450 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f4d24066510 0x7f4d240689d0 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:46.444 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:46.437+0000 7f4d3d370700 1 --2- 172.21.15.32:0/4028072450 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4d380cea20 0x7f4d38157c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:46.445 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:46.437+0000 7f4d3d370700 1 --2- 172.21.15.32:0/4028072450 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4d380cdd40 0x7f4d380ca630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:46.445 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:46.437+0000 7f4d3d370700 1 --2- 172.21.15.32:0/4028072450 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4d380cd960 0x7f4d380c56e0 unknown :-1 s=CLOSED pgs=1894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:46.445 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:46.437+0000 7f4d3d370700 1 -- 172.21.15.32:0/4028072450 >> 172.21.15.32:0/4028072450 conn(0x7f4d3806de60 msgr2=0x7f4d3815e930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:43:46.445 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:46.437+0000 7f4d3d370700 1 -- 172.21.15.32:0/4028072450 shutdown_connections 2023-10-08T13:43:46.445 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:46.437+0000 7f4d3d370700 1 -- 172.21.15.32:0/4028072450 wait complete. 2023-10-08T13:43:46.463 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-08T13:43:46.595 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:46.589+0000 7f2157fff700 1 Processor -- start 2023-10-08T13:43:46.595 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:46.589+0000 7f2157fff700 1 -- start start 2023-10-08T13:43:46.597 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:46.589+0000 7f2157fff700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f215806b3b0 0x7f215806b860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:43:46.597 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:46.589+0000 7f2157fff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f215806cea0 0x7f215806d330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:43:46.597 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:46.589+0000 7f2157fff700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2158071650 con 0x7f215815b190 2023-10-08T13:43:46.598 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:46.589+0000 7f2157fff700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f215806bda0 con 0x7f215806b3b0 2023-10-08T13:43:46.598 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:46.589+0000 7f2157fff700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2158070d60 con 0x7f215806cea0 2023-10-08T13:43:46.598 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:46.589+0000 7f2156ffd700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f215815b190 0x7f2158071ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:38308/0 (socket says 172.21.15.32:38308) 2023-10-08T13:43:46.598 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:46.589+0000 7f2156ffd700 1 -- 172.21.15.32:0/4121453912 learned_addr learned my addr 172.21.15.32:0/4121453912 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-08T13:43:46.598 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:46.589+0000 7f21567fc700 1 --2- 172.21.15.32:0/4121453912 >> v2:172.21.15.32:3300/0 conn(0x7f215806b3b0 0x7f215806b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:43:46.598 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:46.589+0000 7f21577fe700 1 --2- 172.21.15.32:0/4121453912 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f215806cea0 0x7f215806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:43:46.598 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:46.589+0000 7f21567fc700 1 -- 172.21.15.32:0/4121453912 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f215806cea0 msgr2=0x7f215806d330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:43:46.598 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:46.589+0000 7f21567fc700 1 --2- 172.21.15.32:0/4121453912 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f215806cea0 0x7f215806d330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:46.598 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:46.589+0000 7f21567fc700 1 -- 172.21.15.32:0/4121453912 >> v1:172.21.15.32:6789/0 conn(0x7f215815b190 legacy=0x7f2158071ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:43:46.599 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:46.589+0000 7f21567fc700 1 -- 172.21.15.32:0/4121453912 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f215806dc00 con 0x7f215806b3b0 2023-10-08T13:43:46.599 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:46.593+0000 7f21567fc700 1 --2- 172.21.15.32:0/4121453912 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f215806b3b0 0x7f215806b860 secure :-1 s=READY pgs=1896 cs=0 l=1 rev1=1 crypto rx=0x7f2148009850 tx=0x7f2148009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9a50ab83e34a083 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:43:46.600 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:46.593+0000 7f2155ffb700 1 -- 172.21.15.32:0/4121453912 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f214800f8a0 con 0x7f215806b3b0 2023-10-08T13:43:46.600 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:46.593+0000 7f2155ffb700 1 -- 172.21.15.32:0/4121453912 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f214800fa00 con 0x7f215806b3b0 2023-10-08T13:43:46.600 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:46.593+0000 7f2155ffb700 1 -- 172.21.15.32:0/4121453912 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f214800fd90 con 0x7f215806b3b0 2023-10-08T13:43:46.600 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:46.593+0000 7f2157fff700 1 -- 172.21.15.32:0/4121453912 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f215806b3b0 msgr2=0x7f215806b860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:43:46.600 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:46.593+0000 7f2157fff700 1 --2- 172.21.15.32:0/4121453912 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f215806b3b0 0x7f215806b860 secure :-1 s=READY pgs=1896 cs=0 l=1 rev1=1 crypto rx=0x7f2148009850 tx=0x7f2148009b60 comp rx=0 tx=0).stop 2023-10-08T13:43:46.600 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:46.593+0000 7f2157fff700 1 -- 172.21.15.32:0/4121453912 shutdown_connections 2023-10-08T13:43:46.600 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:46.593+0000 7f2157fff700 1 --2- 172.21.15.32:0/4121453912 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f215806cea0 0x7f215806d330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:46.600 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:46.593+0000 7f2157fff700 1 --2- 172.21.15.32:0/4121453912 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f215806b3b0 0x7f215806b860 unknown :-1 s=CLOSED pgs=1896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:46.601 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:46.593+0000 7f2157fff700 1 -- 172.21.15.32:0/4121453912 >> 172.21.15.32:0/4121453912 conn(0x7f21580cc7d0 msgr2=0x7f21580ccbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:43:46.601 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:46.593+0000 7f2157fff700 1 -- 172.21.15.32:0/4121453912 shutdown_connections 2023-10-08T13:43:46.601 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:46.593+0000 7f2157fff700 1 -- 172.21.15.32:0/4121453912 wait complete. 2023-10-08T13:43:46.601 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:46.593+0000 7f2157fff700 1 Processor -- start 2023-10-08T13:43:46.601 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:46.597+0000 7f2157fff700 1 -- start start 2023-10-08T13:43:46.604 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:46.597+0000 7f2157fff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f215806b3b0 0x7f21580af6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:43:46.605 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:46.597+0000 7f2157fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f215806cea0 0x7f21580c8e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:43:46.605 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:46.597+0000 7f2157fff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f215815b190 0x7f21581f1db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:43:46.605 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:46.597+0000 7f2157fff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21580afdc0 con 0x7f215806cea0 2023-10-08T13:43:46.605 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:46.597+0000 7f2157fff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21580b00a0 con 0x7f215815b190 2023-10-08T13:43:46.605 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:46.597+0000 7f2157fff700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21580b0380 con 0x7f215806b3b0 2023-10-08T13:43:46.605 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:46.597+0000 7f21567fc700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f215806cea0 0x7f21580c8e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:43:46.605 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:46.597+0000 7f21567fc700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f215806cea0 0x7f21580c8e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:49268/0 (socket says 172.21.15.32:49268) 2023-10-08T13:43:46.605 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:46.597+0000 7f21567fc700 1 -- 172.21.15.32:0/94269266 learned_addr learned my addr 172.21.15.32:0/94269266 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T13:43:46.605 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:46.597+0000 7f2156ffd700 1 --2- 172.21.15.32:0/94269266 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f215806b3b0 0x7f21580af6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:43:46.606 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:46.597+0000 7f21577fe700 1 --2- 172.21.15.32:0/94269266 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f215815b190 0x7f21581f1db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:43:46.606 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:46.597+0000 7f21567fc700 1 -- 172.21.15.32:0/94269266 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f215806b3b0 msgr2=0x7f21580af6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:43:46.606 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:46.597+0000 7f21567fc700 1 --2- 172.21.15.32:0/94269266 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f215806b3b0 0x7f21580af6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:46.606 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:46.597+0000 7f21567fc700 1 -- 172.21.15.32:0/94269266 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f215815b190 msgr2=0x7f21581f1db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:43:46.606 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:46.597+0000 7f21567fc700 1 --2- 172.21.15.32:0/94269266 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f215815b190 0x7f21581f1db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:46.606 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:46.597+0000 7f21567fc700 1 -- 172.21.15.32:0/94269266 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21480094b0 con 0x7f215806cea0 2023-10-08T13:43:46.606 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:46.597+0000 7f2156ffd700 1 --2- 172.21.15.32:0/94269266 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f215806b3b0 0x7f21580af6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T13:43:46.606 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:46.597+0000 7f21577fe700 1 --2- 172.21.15.32:0/94269266 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f215815b190 0x7f21581f1db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T13:43:46.606 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:46.597+0000 7f21567fc700 1 --2- 172.21.15.32:0/94269266 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f215806cea0 0x7f21580c8e40 secure :-1 s=READY pgs=1897 cs=0 l=1 rev1=1 crypto rx=0x7f2148009fd0 tx=0x7f2148004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:43:46.606 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:46.597+0000 7f214ffff700 1 -- 172.21.15.32:0/94269266 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21480038d0 con 0x7f215806cea0 2023-10-08T13:43:46.607 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:46.597+0000 7f214ffff700 1 -- 172.21.15.32:0/94269266 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2148003a50 con 0x7f215806cea0 2023-10-08T13:43:46.607 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:46.597+0000 7f2157fff700 1 -- 172.21.15.32:0/94269266 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21580c6ec0 con 0x7f215806cea0 2023-10-08T13:43:46.607 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:46.597+0000 7f214ffff700 1 -- 172.21.15.32:0/94269266 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2148003e00 con 0x7f215806cea0 2023-10-08T13:43:46.607 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:46.597+0000 7f2157fff700 1 -- 172.21.15.32:0/94269266 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21580b0660 con 0x7f215806cea0 2023-10-08T13:43:46.607 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:46.601+0000 7f2157fff700 1 -- 172.21.15.32:0/94269266 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21580c70d0 con 0x7f215806cea0 2023-10-08T13:43:46.608 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:46.601+0000 7f214ffff700 1 -- 172.21.15.32:0/94269266 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f214802c440 con 0x7f215806cea0 2023-10-08T13:43:46.608 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:46.601+0000 7f214ffff700 1 --2- 172.21.15.32:0/94269266 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f2138066510 0x7f21380689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:43:46.609 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:46.601+0000 7f214ffff700 1 -- 172.21.15.32:0/94269266 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f2148085470 con 0x7f215806cea0 2023-10-08T13:43:46.609 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:46.601+0000 7f2156ffd700 1 --2- 172.21.15.32:0/94269266 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f2138066510 0x7f21380689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:43:46.609 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:46.605+0000 7f2156ffd700 1 --2- 172.21.15.32:0/94269266 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f2138066510 0x7f21380689d0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f21500012e0 tx=0x7f2150009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:43:46.615 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:46.609+0000 7f214ffff700 1 -- 172.21.15.32:0/94269266 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f2148052880 con 0x7f215806cea0 2023-10-08T13:43:46.782 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:46.777+0000 7f2157fff700 1 -- 172.21.15.32:0/94269266 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f21580686a0 con 0x7f215806cea0 2023-10-08T13:43:47.453 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:47.449+0000 7f214ffff700 1 -- 172.21.15.32:0/94269266 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v37) v1 ==== 181+0+0 (secure 0 0 0) 0x7f2148055ea0 con 0x7f215806cea0 2023-10-08T13:43:47.458 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:47.453+0000 7f2157fff700 1 -- 172.21.15.32:0/94269266 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f2138066510 msgr2=0x7f21380689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:43:47.458 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:47.453+0000 7f2157fff700 1 --2- 172.21.15.32:0/94269266 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f2138066510 0x7f21380689d0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f21500012e0 tx=0x7f2150009040 comp rx=0 tx=0).stop 2023-10-08T13:43:47.458 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:47.453+0000 7f2157fff700 1 -- 172.21.15.32:0/94269266 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f215806cea0 msgr2=0x7f21580c8e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:43:47.459 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:47.453+0000 7f2157fff700 1 --2- 172.21.15.32:0/94269266 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f215806cea0 0x7f21580c8e40 secure :-1 s=READY pgs=1897 cs=0 l=1 rev1=1 crypto rx=0x7f2148009fd0 tx=0x7f2148004770 comp rx=0 tx=0).stop 2023-10-08T13:43:47.460 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:47.453+0000 7f2157fff700 1 -- 172.21.15.32:0/94269266 shutdown_connections 2023-10-08T13:43:47.460 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:47.453+0000 7f2157fff700 1 --2- 172.21.15.32:0/94269266 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f2138066510 0x7f21380689d0 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:47.460 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:47.453+0000 7f2157fff700 1 --2- 172.21.15.32:0/94269266 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f215806cea0 0x7f21580c8e40 unknown :-1 s=CLOSED pgs=1897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:47.460 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:47.453+0000 7f2157fff700 1 --2- 172.21.15.32:0/94269266 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f215815b190 0x7f21581f1db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:47.460 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:47.453+0000 7f2157fff700 1 --2- 172.21.15.32:0/94269266 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f215806b3b0 0x7f21580af6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:47.461 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:47.453+0000 7f2157fff700 1 -- 172.21.15.32:0/94269266 >> 172.21.15.32:0/94269266 conn(0x7f21580cc7d0 msgr2=0x7f2158071ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:43:47.461 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:47.453+0000 7f2157fff700 1 -- 172.21.15.32:0/94269266 shutdown_connections 2023-10-08T13:43:47.461 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:47.453+0000 7f2157fff700 1 -- 172.21.15.32:0/94269266 wait complete. 2023-10-08T13:43:47.463 INFO:teuthology.orchestra.run.smithi032.stderr:pool 'cephfs_metadata' removed 2023-10-08T13:43:47.481 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-08T13:43:47.589 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:47.581+0000 7f53be4dd700 1 Processor -- start 2023-10-08T13:43:47.589 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:47.581+0000 7f53be4dd700 1 -- start start 2023-10-08T13:43:47.591 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:47.585+0000 7f53be4dd700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f53b815d230 0x7f53b806d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:43:47.591 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:47.585+0000 7f53be4dd700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f53b80cf870 0x7f53b8070d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:43:47.591 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:47.585+0000 7f53be4dd700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53b806aeb0 con 0x7f53b80cf410 2023-10-08T13:43:47.591 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:47.585+0000 7f53be4dd700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53b80ca3a0 con 0x7f53b80cf870 2023-10-08T13:43:47.591 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:47.585+0000 7f53be4dd700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53b815d610 con 0x7f53b815d230 2023-10-08T13:43:47.591 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:47.585+0000 7f53bccda700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f53b80cf410 0x7f53b806b670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:38320/0 (socket says 172.21.15.32:38320) 2023-10-08T13:43:47.592 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:47.585+0000 7f53bccda700 1 -- 172.21.15.32:0/3560510193 learned_addr learned my addr 172.21.15.32:0/3560510193 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-08T13:43:47.592 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:47.585+0000 7f53bdcdc700 1 --2- 172.21.15.32:0/3560510193 >> v2:172.21.15.32:3300/0 conn(0x7f53b80cf870 0x7f53b8070d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:43:47.592 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:47.585+0000 7f53bd4db700 1 --2- 172.21.15.32:0/3560510193 >> v2:172.21.15.40:3300/0 conn(0x7f53b815d230 0x7f53b806d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:43:47.592 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:47.585+0000 7f53bdcdc700 1 -- 172.21.15.32:0/3560510193 >> v2:172.21.15.40:3300/0 conn(0x7f53b815d230 msgr2=0x7f53b806d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:43:47.592 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:47.585+0000 7f53bdcdc700 1 --2- 172.21.15.32:0/3560510193 >> v2:172.21.15.40:3300/0 conn(0x7f53b815d230 0x7f53b806d7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:47.592 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:47.585+0000 7f53bdcdc700 1 -- 172.21.15.32:0/3560510193 >> v1:172.21.15.32:6789/0 conn(0x7f53b80cf410 legacy=0x7f53b806b670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:43:47.592 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:47.585+0000 7f53bdcdc700 1 -- 172.21.15.32:0/3560510193 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53b806a2a0 con 0x7f53b80cf870 2023-10-08T13:43:47.593 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:47.585+0000 7f53bdcdc700 1 --2- 172.21.15.32:0/3560510193 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f53b80cf870 0x7f53b8070d60 secure :-1 s=READY pgs=1899 cs=0 l=1 rev1=1 crypto rx=0x7f53b8067f30 tx=0x7f53b000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54ca0ac3e5ebcce server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:43:47.593 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:47.585+0000 7f53affff700 1 -- 172.21.15.32:0/3560510193 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53b000e070 con 0x7f53b80cf870 2023-10-08T13:43:47.593 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:47.585+0000 7f53affff700 1 -- 172.21.15.32:0/3560510193 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53b000bb20 con 0x7f53b80cf870 2023-10-08T13:43:47.593 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:47.585+0000 7f53affff700 1 -- 172.21.15.32:0/3560510193 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53b0012430 con 0x7f53b80cf870 2023-10-08T13:43:47.593 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:47.585+0000 7f53be4dd700 1 -- 172.21.15.32:0/3560510193 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f53b80cf870 msgr2=0x7f53b8070d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:43:47.594 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:47.585+0000 7f53be4dd700 1 --2- 172.21.15.32:0/3560510193 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f53b80cf870 0x7f53b8070d60 secure :-1 s=READY pgs=1899 cs=0 l=1 rev1=1 crypto rx=0x7f53b8067f30 tx=0x7f53b000b330 comp rx=0 tx=0).stop 2023-10-08T13:43:47.594 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:47.585+0000 7f53be4dd700 1 -- 172.21.15.32:0/3560510193 shutdown_connections 2023-10-08T13:43:47.594 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:47.585+0000 7f53be4dd700 1 --2- 172.21.15.32:0/3560510193 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f53b80cf870 0x7f53b8070d60 unknown :-1 s=CLOSED pgs=1899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:47.594 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:47.585+0000 7f53be4dd700 1 --2- 172.21.15.32:0/3560510193 >> v2:172.21.15.40:3300/0 conn(0x7f53b815d230 0x7f53b806d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:47.594 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:47.585+0000 7f53be4dd700 1 -- 172.21.15.32:0/3560510193 >> 172.21.15.32:0/3560510193 conn(0x7f53b80cc7d0 msgr2=0x7f53b80ccbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:43:47.594 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:47.585+0000 7f53be4dd700 1 -- 172.21.15.32:0/3560510193 shutdown_connections 2023-10-08T13:43:47.594 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:47.585+0000 7f53be4dd700 1 -- 172.21.15.32:0/3560510193 wait complete. 2023-10-08T13:43:47.595 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:47.589+0000 7f53be4dd700 1 Processor -- start 2023-10-08T13:43:47.595 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:47.589+0000 7f53be4dd700 1 -- start start 2023-10-08T13:43:47.598 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:47.589+0000 7f53be4dd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f53b80cf410 0x7f53b8152280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:43:47.598 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:47.589+0000 7f53be4dd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f53b80cf870 0x7f53b80c6e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:43:47.598 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:47.589+0000 7f53be4dd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f53b815d230 0x7f53b80ad940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:43:47.598 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:47.589+0000 7f53be4dd700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53b815e490 con 0x7f53b80cf410 2023-10-08T13:43:47.598 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:47.589+0000 7f53be4dd700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53b815e770 con 0x7f53b815d230 2023-10-08T13:43:47.598 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:47.589+0000 7f53be4dd700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53b815f190 con 0x7f53b80cf870 2023-10-08T13:43:47.598 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:47.589+0000 7f53bd4db700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f53b80cf410 0x7f53b8152280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:43:47.598 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:47.589+0000 7f53bd4db700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f53b80cf410 0x7f53b8152280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:49276/0 (socket says 172.21.15.32:49276) 2023-10-08T13:43:47.598 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:47.589+0000 7f53bd4db700 1 -- 172.21.15.32:0/2156957749 learned_addr learned my addr 172.21.15.32:0/2156957749 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T13:43:47.598 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:47.589+0000 7f53bccda700 1 --2- 172.21.15.32:0/2156957749 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f53b80cf870 0x7f53b80c6e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:43:47.599 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:47.589+0000 7f53bdcdc700 1 --2- 172.21.15.32:0/2156957749 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f53b815d230 0x7f53b80ad940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:43:47.599 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:47.589+0000 7f53bd4db700 1 -- 172.21.15.32:0/2156957749 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f53b80cf870 msgr2=0x7f53b80c6e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:43:47.599 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:47.589+0000 7f53bd4db700 1 --2- 172.21.15.32:0/2156957749 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f53b80cf870 0x7f53b80c6e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:47.599 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:47.589+0000 7f53bd4db700 1 -- 172.21.15.32:0/2156957749 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f53b815d230 msgr2=0x7f53b80ad940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:43:47.599 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:47.589+0000 7f53bd4db700 1 --2- 172.21.15.32:0/2156957749 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f53b815d230 0x7f53b80ad940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:47.599 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:47.589+0000 7f53bd4db700 1 -- 172.21.15.32:0/2156957749 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53b0009a70 con 0x7f53b80cf410 2023-10-08T13:43:47.599 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:47.589+0000 7f53bd4db700 1 --2- 172.21.15.32:0/2156957749 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f53b80cf410 0x7f53b8152280 secure :-1 s=READY pgs=1900 cs=0 l=1 rev1=1 crypto rx=0x7f53b400e9d0 tx=0x7f53b400ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:43:47.599 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:47.593+0000 7f53adffb700 1 -- 172.21.15.32:0/2156957749 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53b4009720 con 0x7f53b80cf410 2023-10-08T13:43:47.599 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:47.593+0000 7f53adffb700 1 -- 172.21.15.32:0/2156957749 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53b400ee70 con 0x7f53b80cf410 2023-10-08T13:43:47.599 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:47.593+0000 7f53be4dd700 1 -- 172.21.15.32:0/2156957749 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53b815f470 con 0x7f53b80cf410 2023-10-08T13:43:47.599 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:47.593+0000 7f53adffb700 1 -- 172.21.15.32:0/2156957749 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53b400ca50 con 0x7f53b80cf410 2023-10-08T13:43:47.600 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:47.593+0000 7f53be4dd700 1 -- 172.21.15.32:0/2156957749 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53b81527c0 con 0x7f53b80cf410 2023-10-08T13:43:47.600 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:47.593+0000 7f53be4dd700 1 -- 172.21.15.32:0/2156957749 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53b806ab00 con 0x7f53b80cf410 2023-10-08T13:43:47.600 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:47.593+0000 7f53adffb700 1 -- 172.21.15.32:0/2156957749 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f53b400cbb0 con 0x7f53b80cf410 2023-10-08T13:43:47.600 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:47.593+0000 7f53adffb700 1 --2- 172.21.15.32:0/2156957749 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f539c066510 0x7f539c0689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:43:47.600 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:47.593+0000 7f53adffb700 1 -- 172.21.15.32:0/2156957749 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5357+0+0 (secure 0 0 0) 0x7f53b4083ca0 con 0x7f53b80cf410 2023-10-08T13:43:47.601 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:47.597+0000 7f53bccda700 1 --2- 172.21.15.32:0/2156957749 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f539c066510 0x7f539c0689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:43:47.602 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:47.597+0000 7f53bccda700 1 --2- 172.21.15.32:0/2156957749 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f539c066510 0x7f539c0689d0 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f53b80c9dc0 tx=0x7f53a8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:43:47.605 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:47.597+0000 7f53adffb700 1 -- 172.21.15.32:0/2156957749 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f53b4051310 con 0x7f53b80cf410 2023-10-08T13:43:47.767 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:47.761+0000 7f53be4dd700 1 -- 172.21.15.32:0/2156957749 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f53b80686a0 con 0x7f53b80cf410 2023-10-08T13:43:48.457 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:48.449+0000 7f53adffb700 1 -- 172.21.15.32:0/2156957749 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v38) v1 ==== 169+0+0 (secure 0 0 0) 0x7f53b4059e60 con 0x7f53b80cf410 2023-10-08T13:43:48.462 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:48.457+0000 7f53be4dd700 1 -- 172.21.15.32:0/2156957749 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f539c066510 msgr2=0x7f539c0689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:43:48.462 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:48.457+0000 7f53be4dd700 1 --2- 172.21.15.32:0/2156957749 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f539c066510 0x7f539c0689d0 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f53b80c9dc0 tx=0x7f53a8009040 comp rx=0 tx=0).stop 2023-10-08T13:43:48.462 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:48.457+0000 7f53be4dd700 1 -- 172.21.15.32:0/2156957749 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f53b80cf410 msgr2=0x7f53b8152280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:43:48.463 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:48.457+0000 7f53be4dd700 1 --2- 172.21.15.32:0/2156957749 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f53b80cf410 0x7f53b8152280 secure :-1 s=READY pgs=1900 cs=0 l=1 rev1=1 crypto rx=0x7f53b400e9d0 tx=0x7f53b400ece0 comp rx=0 tx=0).stop 2023-10-08T13:43:48.463 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:48.457+0000 7f53be4dd700 1 -- 172.21.15.32:0/2156957749 shutdown_connections 2023-10-08T13:43:48.463 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:48.457+0000 7f53be4dd700 1 --2- 172.21.15.32:0/2156957749 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f539c066510 0x7f539c0689d0 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:48.463 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:48.457+0000 7f53be4dd700 1 --2- 172.21.15.32:0/2156957749 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f53b815d230 0x7f53b80ad940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:48.463 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:48.457+0000 7f53be4dd700 1 --2- 172.21.15.32:0/2156957749 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f53b80cf870 0x7f53b80c6e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:48.463 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:48.457+0000 7f53be4dd700 1 --2- 172.21.15.32:0/2156957749 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f53b80cf410 0x7f53b8152280 unknown :-1 s=CLOSED pgs=1900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:48.463 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:48.457+0000 7f53be4dd700 1 -- 172.21.15.32:0/2156957749 >> 172.21.15.32:0/2156957749 conn(0x7f53b80cc7d0 msgr2=0x7f53b815c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:43:48.469 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:48.457+0000 7f53be4dd700 1 -- 172.21.15.32:0/2156957749 shutdown_connections 2023-10-08T13:43:48.470 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:48.457+0000 7f53be4dd700 1 -- 172.21.15.32:0/2156957749 wait complete. 2023-10-08T13:43:48.473 INFO:teuthology.orchestra.run.smithi032.stderr:pool 'cephfs_data' removed 2023-10-08T13:43:48.495 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-08T13:43:48.718 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:48.709+0000 7fd9becae700 1 Processor -- start 2023-10-08T13:43:48.718 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:48.709+0000 7fd9becae700 1 -- start start 2023-10-08T13:43:48.723 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:48.709+0000 7fd9becae700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fd9b816a210 0x7fd9b816b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:43:48.723 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:48.709+0000 7fd9becae700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9b816a5f0 con 0x7fd9b808a640 2023-10-08T13:43:48.723 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:48.709+0000 7fd9becae700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9b80ce5c0 con 0x7fd9b8070660 2023-10-08T13:43:48.723 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:48.709+0000 7fd9becae700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9b80cd9b0 con 0x7fd9b816a210 2023-10-08T13:43:48.723 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:48.709+0000 7fd9bd4ab700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fd9b808a640 0x7fd9b806ff50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:38326/0 (socket says 172.21.15.32:38326) 2023-10-08T13:43:48.723 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:48.709+0000 7fd9be4ad700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fd9b8070660 0x7fd9b816ba90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.32:33086/0 (socket says 172.21.15.32:33086) 2023-10-08T13:43:48.723 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:48.709+0000 7fd9bd4ab700 1 -- 172.21.15.32:0/327064016 learned_addr learned my addr 172.21.15.32:0/327064016 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-08T13:43:48.723 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:48.709+0000 7fd9bdcac700 1 --2- 172.21.15.32:0/327064016 >> v2:172.21.15.32:3300/0 conn(0x7fd9b816a210 0x7fd9b816b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:43:48.723 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:48.713+0000 7fd9bccaa700 1 -- 172.21.15.32:0/327064016 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 514063285 0 0) 0x7fd9b4001110 con 0x7fd9b808a640 2023-10-08T13:43:48.723 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:48.713+0000 7fd9bccaa700 1 -- 172.21.15.32:0/327064016 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd9a40035b0 con 0x7fd9b808a640 2023-10-08T13:43:48.723 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:48.713+0000 7fd9bccaa700 1 -- 172.21.15.32:0/327064016 <== mon.1 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1502939290 0 0) 0x7fd9b80ce5c0 con 0x7fd9b8070660 2023-10-08T13:43:48.724 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:48.713+0000 7fd9bccaa700 1 -- 172.21.15.32:0/327064016 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd9b4001110 con 0x7fd9b8070660 2023-10-08T13:43:48.724 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:48.713+0000 7fd9bccaa700 1 -- 172.21.15.32:0/327064016 <== mon.1 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3660239489 0 0) 0x7fd9b4001110 con 0x7fd9b8070660 2023-10-08T13:43:48.724 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:48.713+0000 7fd9bccaa700 1 -- 172.21.15.32:0/327064016 >> v2:172.21.15.32:3300/0 conn(0x7fd9b816a210 msgr2=0x7fd9b816b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:43:48.724 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:48.713+0000 7fd9bccaa700 1 --2- 172.21.15.32:0/327064016 >> v2:172.21.15.32:3300/0 conn(0x7fd9b816a210 0x7fd9b816b1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:48.724 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:48.713+0000 7fd9bccaa700 1 -- 172.21.15.32:0/327064016 >> v1:172.21.15.32:6789/0 conn(0x7fd9b808a640 legacy=0x7fd9b806ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:43:48.724 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:48.713+0000 7fd9bccaa700 1 -- 172.21.15.32:0/327064016 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9b80cdc90 con 0x7fd9b8070660 2023-10-08T13:43:48.724 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:48.713+0000 7fd9bccaa700 1 -- 172.21.15.32:0/327064016 <== mon.1 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2364763317 0 0) 0x7fd9b00018a0 con 0x7fd9b8070660 2023-10-08T13:43:48.724 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:48.713+0000 7fd9bccaa700 1 -- 172.21.15.32:0/327064016 >> v1:172.21.15.40:6789/0 conn(0x7fd9b8070660 legacy=0x7fd9b816ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:43:48.724 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:48.713+0000 7fd9bccaa700 1 --2- 172.21.15.32:0/327064016 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd9a4003e30 0x7fd9a4006610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:43:48.724 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:48.713+0000 7fd9bccaa700 1 --2- 172.21.15.32:0/327064016 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd9a4006b50 0x7fd9a4008fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:43:48.724 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:48.713+0000 7fd9bccaa700 1 --2- 172.21.15.32:0/327064016 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd9a4009520 0x7fd9a400b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:43:48.724 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:48.713+0000 7fd9bccaa700 1 -- 172.21.15.32:0/327064016 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9b40013c0 con 0x7fd9a4006b50 2023-10-08T13:43:48.724 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:48.713+0000 7fd9bccaa700 1 -- 172.21.15.32:0/327064016 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9b80cd9b0 con 0x7fd9a4003e30 2023-10-08T13:43:48.725 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:48.713+0000 7fd9bccaa700 1 -- 172.21.15.32:0/327064016 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9a400c280 con 0x7fd9a4009520 2023-10-08T13:43:48.725 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:48.713+0000 7fd9bd4ab700 1 --2- 172.21.15.32:0/327064016 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd9a4006b50 0x7fd9a4008fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:43:48.725 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:48.713+0000 7fd9bd4ab700 1 -- 172.21.15.32:0/327064016 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd9a4009520 msgr2=0x7fd9a400b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:43:48.725 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:48.713+0000 7fd9be4ad700 1 --2- 172.21.15.32:0/327064016 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd9a4009520 0x7fd9a400b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:43:48.725 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:48.713+0000 7fd9bd4ab700 1 --2- 172.21.15.32:0/327064016 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd9a4009520 0x7fd9a400b9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:48.725 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:48.713+0000 7fd9bd4ab700 1 -- 172.21.15.32:0/327064016 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd9a4003e30 msgr2=0x7fd9a4006610 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-08T13:43:48.725 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:48.713+0000 7fd9bd4ab700 1 --2- 172.21.15.32:0/327064016 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd9a4003e30 0x7fd9a4006610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:48.725 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:48.713+0000 7fd9bd4ab700 1 -- 172.21.15.32:0/327064016 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9b4001110 con 0x7fd9a4006b50 2023-10-08T13:43:48.725 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:48.713+0000 7fd9be4ad700 1 --2- 172.21.15.32:0/327064016 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd9a4009520 0x7fd9a400b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T13:43:48.725 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:48.713+0000 7fd9be4ad700 1 -- 172.21.15.32:0/327064016 reap_dead start 2023-10-08T13:43:48.725 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:48.713+0000 7fd9bd4ab700 1 --2- 172.21.15.32:0/327064016 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd9a4006b50 0x7fd9a4008fe0 secure :-1 s=READY pgs=1902 cs=0 l=1 rev1=1 crypto rx=0x7fd9b4007de0 tx=0x7fd9a4003860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9e8fff65858a12d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:43:48.725 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:48.713+0000 7fd9bccaa700 1 -- 172.21.15.32:0/327064016 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9b4007c40 con 0x7fd9a4006b50 2023-10-08T13:43:48.726 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:48.713+0000 7fd9bccaa700 1 -- 172.21.15.32:0/327064016 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9b400cac0 con 0x7fd9a4006b50 2023-10-08T13:43:48.726 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:48.713+0000 7fd9bccaa700 1 -- 172.21.15.32:0/327064016 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9b400ce50 con 0x7fd9a4006b50 2023-10-08T13:43:48.726 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:48.717+0000 7fd9becae700 1 -- 172.21.15.32:0/327064016 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd9a4006b50 msgr2=0x7fd9a4008fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:43:48.726 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:48.717+0000 7fd9becae700 1 --2- 172.21.15.32:0/327064016 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd9a4006b50 0x7fd9a4008fe0 secure :-1 s=READY pgs=1902 cs=0 l=1 rev1=1 crypto rx=0x7fd9b4007de0 tx=0x7fd9a4003860 comp rx=0 tx=0).stop 2023-10-08T13:43:48.726 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:48.717+0000 7fd9becae700 1 -- 172.21.15.32:0/327064016 shutdown_connections 2023-10-08T13:43:48.726 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:48.717+0000 7fd9becae700 1 --2- 172.21.15.32:0/327064016 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd9a4006b50 0x7fd9a4008fe0 unknown :-1 s=CLOSED pgs=1902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:48.727 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:48.717+0000 7fd9becae700 1 -- 172.21.15.32:0/327064016 >> 172.21.15.32:0/327064016 conn(0x7fd9b80cb850 msgr2=0x7fd9b80cbc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:43:48.731 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:48.725+0000 7fd9becae700 1 -- 172.21.15.32:0/327064016 shutdown_connections 2023-10-08T13:43:48.731 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:48.725+0000 7fd9becae700 1 -- 172.21.15.32:0/327064016 wait complete. 2023-10-08T13:43:48.732 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:48.725+0000 7fd9becae700 1 Processor -- start 2023-10-08T13:43:48.732 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:48.725+0000 7fd9becae700 1 -- start start 2023-10-08T13:43:48.733 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:48.725+0000 7fd9becae700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd9a4006b50 0x7fd9b81febe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:43:48.733 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:48.725+0000 7fd9becae700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd9b80c3310 0x7fd9b80b3d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:43:48.733 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:48.725+0000 7fd9becae700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd9b80c4f80 0x7fd9b80c5400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:43:48.733 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:48.725+0000 7fd9becae700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9b80c5940 con 0x7fd9b80c4f80 2023-10-08T13:43:48.733 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:48.725+0000 7fd9becae700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9b80c71c0 con 0x7fd9b80c3310 2023-10-08T13:43:48.734 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:48.725+0000 7fd9becae700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9b80c3880 con 0x7fd9a4006b50 2023-10-08T13:43:48.735 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:48.729+0000 7fd9be4ad700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd9b80c4f80 0x7fd9b80c5400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:43:48.736 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:48.729+0000 7fd9bd4ab700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd9b80c3310 0x7fd9b80b3d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:43:48.736 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:48.729+0000 7fd9be4ad700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd9b80c4f80 0x7fd9b80c5400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:49310/0 (socket says 172.21.15.32:49310) 2023-10-08T13:43:48.736 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:48.729+0000 7fd9bd4ab700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd9b80c3310 0x7fd9b80b3d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.32:50960/0 (socket says 172.21.15.32:50960) 2023-10-08T13:43:48.736 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:48.729+0000 7fd9be4ad700 1 -- 172.21.15.32:0/1405419763 learned_addr learned my addr 172.21.15.32:0/1405419763 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T13:43:48.736 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:48.729+0000 7fd9bd4ab700 1 -- 172.21.15.32:0/1405419763 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd9a4006b50 msgr2=0x7fd9b81febe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:43:48.736 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:48.729+0000 7fd9bd4ab700 1 --2- 172.21.15.32:0/1405419763 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd9a4006b50 0x7fd9b81febe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:48.736 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:48.729+0000 7fd9bd4ab700 1 -- 172.21.15.32:0/1405419763 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd9b80c4f80 msgr2=0x7fd9b80c5400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:43:48.736 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:48.729+0000 7fd9bd4ab700 1 --2- 172.21.15.32:0/1405419763 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd9b80c4f80 0x7fd9b80c5400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:48.736 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:48.729+0000 7fd9bd4ab700 1 -- 172.21.15.32:0/1405419763 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9b80c3b60 con 0x7fd9b80c3310 2023-10-08T13:43:48.736 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:48.729+0000 7fd9bd4ab700 1 --2- 172.21.15.32:0/1405419763 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd9b80c3310 0x7fd9b80b3d00 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7fd9b400c160 tx=0x7fd9b40018e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:43:48.737 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:48.729+0000 7fd9ae7fc700 1 -- 172.21.15.32:0/1405419763 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9b4004ca0 con 0x7fd9b80c3310 2023-10-08T13:43:48.737 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:48.729+0000 7fd9ae7fc700 1 -- 172.21.15.32:0/1405419763 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9b4004e00 con 0x7fd9b80c3310 2023-10-08T13:43:48.737 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:48.729+0000 7fd9ae7fc700 1 -- 172.21.15.32:0/1405419763 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9b40072d0 con 0x7fd9b80c3310 2023-10-08T13:43:48.737 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:48.729+0000 7fd9becae700 1 -- 172.21.15.32:0/1405419763 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9b80c3e40 con 0x7fd9b80c3310 2023-10-08T13:43:48.737 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:48.729+0000 7fd9becae700 1 -- 172.21.15.32:0/1405419763 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9b81ff120 con 0x7fd9b80c3310 2023-10-08T13:43:48.738 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:48.733+0000 7fd9a3fff700 1 -- 172.21.15.32:0/1405419763 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd998005310 con 0x7fd9b80c3310 2023-10-08T13:43:48.738 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:48.733+0000 7fd9ae7fc700 1 -- 172.21.15.32:0/1405419763 <== mon.1 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fd9b4007430 con 0x7fd9b80c3310 2023-10-08T13:43:48.738 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:48.733+0000 7fd9ae7fc700 1 --2- 172.21.15.32:0/1405419763 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fd99c066610 0x7fd99c068ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:43:48.739 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:48.733+0000 7fd9ae7fc700 1 -- 172.21.15.32:0/1405419763 <== mon.1 v2:172.21.15.40:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fd9b40a6a30 con 0x7fd9b80c3310 2023-10-08T13:43:48.739 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:48.733+0000 7fd9bdcac700 1 --2- 172.21.15.32:0/1405419763 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fd99c066610 0x7fd99c068ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:43:48.739 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:48.733+0000 7fd9bdcac700 1 --2- 172.21.15.32:0/1405419763 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fd99c066610 0x7fd99c068ad0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7fd9a8006d90 tx=0x7fd9a8006c80 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:43:48.750 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:48.745+0000 7fd9ae7fc700 1 -- 172.21.15.32:0/1405419763 <== mon.1 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fd9b40741a0 con 0x7fd9b80c3310 2023-10-08T13:43:49.250 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:49.245+0000 7fd9a3fff700 1 -- 172.21.15.32:0/1405419763 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fd998005b40 con 0x7fd9b80c3310 2023-10-08T13:43:49.268 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:49.261+0000 7fd9ae7fc700 1 -- 172.21.15.32:0/1405419763 <== mon.1 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7fd9b40777c0 con 0x7fd9b80c3310 2023-10-08T13:43:49.282 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:49.277+0000 7fd9becae700 1 -- 172.21.15.32:0/1405419763 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fd99c066610 msgr2=0x7fd99c068ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:43:49.282 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:49.277+0000 7fd9becae700 1 --2- 172.21.15.32:0/1405419763 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fd99c066610 0x7fd99c068ad0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7fd9a8006d90 tx=0x7fd9a8006c80 comp rx=0 tx=0).stop 2023-10-08T13:43:49.282 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:49.277+0000 7fd9becae700 1 -- 172.21.15.32:0/1405419763 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd9b80c3310 msgr2=0x7fd9b80b3d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:43:49.282 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:49.277+0000 7fd9becae700 1 --2- 172.21.15.32:0/1405419763 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd9b80c3310 0x7fd9b80b3d00 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7fd9b400c160 tx=0x7fd9b40018e0 comp rx=0 tx=0).stop 2023-10-08T13:43:49.282 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:49.277+0000 7fd9becae700 1 -- 172.21.15.32:0/1405419763 shutdown_connections 2023-10-08T13:43:49.282 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:49.277+0000 7fd9becae700 1 --2- 172.21.15.32:0/1405419763 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fd99c066610 0x7fd99c068ad0 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:49.282 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:49.277+0000 7fd9becae700 1 --2- 172.21.15.32:0/1405419763 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd9b80c4f80 0x7fd9b80c5400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:49.282 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:49.277+0000 7fd9becae700 1 --2- 172.21.15.32:0/1405419763 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd9b80c3310 0x7fd9b80b3d00 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:49.283 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:49.277+0000 7fd9becae700 1 --2- 172.21.15.32:0/1405419763 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd9a4006b50 0x7fd9b81febe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:49.283 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:49.277+0000 7fd9becae700 1 -- 172.21.15.32:0/1405419763 >> 172.21.15.32:0/1405419763 conn(0x7fd9b80cb850 msgr2=0x7fd9b80cbc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:43:49.283 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:49.277+0000 7fd9becae700 1 -- 172.21.15.32:0/1405419763 shutdown_connections 2023-10-08T13:43:49.283 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:49.277+0000 7fd9becae700 1 -- 172.21.15.32:0/1405419763 wait complete. 2023-10-08T13:43:49.302 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic' 2023-10-08T13:43:50.008 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:49.993+0000 7f634de56700 1 Processor -- start 2023-10-08T13:43:50.008 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:49.993+0000 7f634de56700 1 -- start start 2023-10-08T13:43:50.008 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:49.997+0000 7f634de56700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6348161e50 0x7f6348162230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:43:50.009 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:49.997+0000 7f634de56700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f63480705a0 0x7f6348070a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:43:50.009 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:49.997+0000 7f634de56700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6348163150 con 0x7f6348165350 2023-10-08T13:43:50.009 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:49.997+0000 7f634de56700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63480c2680 con 0x7f6348161e50 2023-10-08T13:43:50.009 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:49.997+0000 7f634de56700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6348161c40 con 0x7f63480705a0 2023-10-08T13:43:50.009 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:49.997+0000 7f6347fff700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f6348165350 0x7f63481657c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.32:33100/0 (socket says 172.21.15.32:33100) 2023-10-08T13:43:50.009 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:49.997+0000 7f6347fff700 1 -- 172.21.15.32:0/3451996549 learned_addr learned my addr 172.21.15.32:0/3451996549 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-08T13:43:50.009 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:50.001+0000 7f6346ffd700 1 --2- 172.21.15.32:0/3451996549 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f63480705a0 0x7f6348070a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:43:50.019 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:50.013+0000 7f63477fe700 1 --2- 172.21.15.32:0/3451996549 >> v2:172.21.15.40:3300/0 conn(0x7f6348161e50 0x7f6348162230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:43:50.020 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:50.013+0000 7f6346ffd700 1 -- 172.21.15.32:0/3451996549 >> v2:172.21.15.40:3300/0 conn(0x7f6348161e50 msgr2=0x7f6348162230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:43:50.020 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:50.013+0000 7f6346ffd700 1 --2- 172.21.15.32:0/3451996549 >> v2:172.21.15.40:3300/0 conn(0x7f6348161e50 0x7f6348162230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:50.020 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:50.013+0000 7f6346ffd700 1 -- 172.21.15.32:0/3451996549 >> v1:172.21.15.40:6789/0 conn(0x7f6348165350 legacy=0x7f63481657c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:43:50.020 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:50.013+0000 7f6346ffd700 1 -- 172.21.15.32:0/3451996549 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6348162770 con 0x7f63480705a0 2023-10-08T13:43:50.022 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:50.017+0000 7f6346ffd700 1 --2- 172.21.15.32:0/3451996549 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f63480705a0 0x7f6348070a00 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f633c009850 tx=0x7f633c009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=398c39cf641ea2cf server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:43:50.025 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:50.017+0000 7f63467fc700 1 -- 172.21.15.32:0/3451996549 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f633c011830 con 0x7f63480705a0 2023-10-08T13:43:50.025 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:50.017+0000 7f63467fc700 1 -- 172.21.15.32:0/3451996549 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f633c011990 con 0x7f63480705a0 2023-10-08T13:43:50.025 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:50.017+0000 7f63467fc700 1 -- 172.21.15.32:0/3451996549 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f633c011d20 con 0x7f63480705a0 2023-10-08T13:43:50.026 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:50.021+0000 7f634de56700 1 -- 172.21.15.32:0/3451996549 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f63480705a0 msgr2=0x7f6348070a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:43:50.026 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:50.021+0000 7f634de56700 1 --2- 172.21.15.32:0/3451996549 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f63480705a0 0x7f6348070a00 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f633c009850 tx=0x7f633c009b60 comp rx=0 tx=0).stop 2023-10-08T13:43:50.026 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:50.021+0000 7f634de56700 1 -- 172.21.15.32:0/3451996549 shutdown_connections 2023-10-08T13:43:50.026 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:50.021+0000 7f634de56700 1 --2- 172.21.15.32:0/3451996549 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f63480705a0 0x7f6348070a00 secure :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f633c009850 tx=0x7f633c009b60 comp rx=0 tx=0).stop 2023-10-08T13:43:50.026 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:50.021+0000 7f634de56700 1 --2- 172.21.15.32:0/3451996549 >> v2:172.21.15.40:3300/0 conn(0x7f6348161e50 0x7f6348162230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:50.027 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:50.021+0000 7f634de56700 1 -- 172.21.15.32:0/3451996549 >> 172.21.15.32:0/3451996549 conn(0x7f63480cb850 msgr2=0x7f63480cbc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:43:50.027 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:50.021+0000 7f634de56700 1 -- 172.21.15.32:0/3451996549 shutdown_connections 2023-10-08T13:43:50.028 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:50.021+0000 7f634de56700 1 -- 172.21.15.32:0/3451996549 wait complete. 2023-10-08T13:43:50.028 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:50.021+0000 7f634de56700 1 Processor -- start 2023-10-08T13:43:50.028 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:50.021+0000 7f634de56700 1 -- start start 2023-10-08T13:43:50.032 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:50.025+0000 7f634de56700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6348161e50 0x7f63480c35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:43:50.033 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:50.025+0000 7f634de56700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6348165350 0x7f63480c60b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:43:50.033 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:50.025+0000 7f634de56700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f63480aec50 0x7f634814a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:43:50.033 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:50.025+0000 7f634de56700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63480c69e0 con 0x7f63480aec50 2023-10-08T13:43:50.033 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:50.025+0000 7f634de56700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63480c6cc0 con 0x7f6348161e50 2023-10-08T13:43:50.033 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:50.025+0000 7f634de56700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63480c6fa0 con 0x7f6348165350 2023-10-08T13:43:50.033 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:50.025+0000 7f6347fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f63480aec50 0x7f634814a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:43:50.033 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:50.025+0000 7f6347fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f63480aec50 0x7f634814a940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:49312/0 (socket says 172.21.15.32:49312) 2023-10-08T13:43:50.033 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:50.025+0000 7f6347fff700 1 -- 172.21.15.32:0/96235827 learned_addr learned my addr 172.21.15.32:0/96235827 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T13:43:50.033 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:50.025+0000 7f6347fff700 1 -- 172.21.15.32:0/96235827 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6348165350 msgr2=0x7f63480c60b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T13:43:50.033 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:50.025+0000 7f6347fff700 1 --2- 172.21.15.32:0/96235827 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6348165350 0x7f63480c60b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:50.034 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:50.025+0000 7f6347fff700 1 -- 172.21.15.32:0/96235827 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6348161e50 msgr2=0x7f63480c35d0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-08T13:43:50.034 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:50.025+0000 7f6347fff700 1 --2- 172.21.15.32:0/96235827 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6348161e50 0x7f63480c35d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:50.034 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:50.025+0000 7f6347fff700 1 -- 172.21.15.32:0/96235827 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f633c0094b0 con 0x7f63480aec50 2023-10-08T13:43:50.034 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:50.025+0000 7f6347fff700 1 --2- 172.21.15.32:0/96235827 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f63480aec50 0x7f634814a940 secure :-1 s=READY pgs=1903 cs=0 l=1 rev1=1 crypto rx=0x7f634000ca80 tx=0x7f634000cb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:43:50.036 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:50.029+0000 7f632ffff700 1 -- 172.21.15.32:0/96235827 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f634000a7b0 con 0x7f63480aec50 2023-10-08T13:43:50.057 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:50.049+0000 7f632ffff700 1 -- 172.21.15.32:0/96235827 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f634000a910 con 0x7f63480aec50 2023-10-08T13:43:50.057 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:50.049+0000 7f634de56700 1 -- 172.21.15.32:0/96235827 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63480c7280 con 0x7f63480aec50 2023-10-08T13:43:50.057 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:50.049+0000 7f634de56700 1 -- 172.21.15.32:0/96235827 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63480c65f0 con 0x7f63480aec50 2023-10-08T13:43:50.059 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:50.053+0000 7f632ffff700 1 -- 172.21.15.32:0/96235827 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f634000ac80 con 0x7f63480aec50 2023-10-08T13:43:50.059 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:50.053+0000 7f632ffff700 1 -- 172.21.15.32:0/96235827 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f6340012400 con 0x7f63480aec50 2023-10-08T13:43:50.060 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:50.053+0000 7f632ffff700 1 --2- 172.21.15.32:0/96235827 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f63340665e0 0x7f6334068aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:43:50.061 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:50.057+0000 7f63477fe700 1 --2- 172.21.15.32:0/96235827 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f63340665e0 0x7f6334068aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:43:50.064 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:50.057+0000 7f634de56700 1 -- 172.21.15.32:0/96235827 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6328005310 con 0x7f63480aec50 2023-10-08T13:43:50.069 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:50.065+0000 7f632ffff700 1 -- 172.21.15.32:0/96235827 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f6340083460 con 0x7f63480aec50 2023-10-08T13:43:50.069 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:50.065+0000 7f63477fe700 1 --2- 172.21.15.32:0/96235827 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f63340665e0 0x7f6334068aa0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f63481522c0 tx=0x7f6338008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:43:50.074 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:50.069+0000 7f632ffff700 1 -- 172.21.15.32:0/96235827 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f6340050d70 con 0x7f63480aec50 2023-10-08T13:43:51.267 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:51.261+0000 7f634de56700 1 -- 172.21.15.32:0/96235827 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]} v 0) v1 -- 0x7f63280055c0 con 0x7f63480aec50 2023-10-08T13:43:51.495 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:51.489+0000 7f632ffff700 1 -- 172.21.15.32:0/96235827 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]}]=0 v13709) v1 ==== 144+0+0 (secure 0 0 0) 0x7f634000ae60 con 0x7f63480aec50 2023-10-08T13:43:51.506 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:51.501+0000 7f634de56700 1 -- 172.21.15.32:0/96235827 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f63340665e0 msgr2=0x7f6334068aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:43:51.507 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:51.501+0000 7f634de56700 1 --2- 172.21.15.32:0/96235827 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f63340665e0 0x7f6334068aa0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f63481522c0 tx=0x7f6338008040 comp rx=0 tx=0).stop 2023-10-08T13:43:51.507 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:51.501+0000 7f634de56700 1 -- 172.21.15.32:0/96235827 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f63480aec50 msgr2=0x7f634814a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:43:51.507 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:51.501+0000 7f634de56700 1 --2- 172.21.15.32:0/96235827 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f63480aec50 0x7f634814a940 secure :-1 s=READY pgs=1903 cs=0 l=1 rev1=1 crypto rx=0x7f634000ca80 tx=0x7f634000cb60 comp rx=0 tx=0).stop 2023-10-08T13:43:51.507 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:51.501+0000 7f634de56700 1 -- 172.21.15.32:0/96235827 shutdown_connections 2023-10-08T13:43:51.507 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:51.501+0000 7f634de56700 1 --2- 172.21.15.32:0/96235827 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f63340665e0 0x7f6334068aa0 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:51.507 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:51.501+0000 7f634de56700 1 --2- 172.21.15.32:0/96235827 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f63480aec50 0x7f634814a940 unknown :-1 s=CLOSED pgs=1903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:51.512 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:51.505+0000 7f634de56700 1 --2- 172.21.15.32:0/96235827 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6348165350 0x7f63480c60b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:51.513 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:51.505+0000 7f634de56700 1 --2- 172.21.15.32:0/96235827 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6348161e50 0x7f63480c35d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:51.513 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:51.505+0000 7f634de56700 1 -- 172.21.15.32:0/96235827 >> 172.21.15.32:0/96235827 conn(0x7f63480cb850 msgr2=0x7f63481649d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:43:51.513 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:51.505+0000 7f634de56700 1 -- 172.21.15.32:0/96235827 shutdown_connections 2023-10-08T13:43:51.513 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:51.505+0000 7f634de56700 1 -- 172.21.15.32:0/96235827 wait complete. 2023-10-08T13:43:51.560 INFO:tasks.cephfs_test_runner:test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) ... FAIL 2023-10-08T13:43:51.560 INFO:tasks.cephfs_test_runner: 2023-10-08T13:43:51.561 INFO:tasks.cephfs_test_runner:====================================================================== 2023-10-08T13:43:51.561 INFO:tasks.cephfs_test_runner:FAIL: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2023-10-08T13:43:51.561 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-10-08T13:43:51.561 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-10-08T13:43:51.561 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_9725b08fd801c82987c737f7e6d354878f036ee8/qa/tasks/cephfs/tests_from_xfstests_dev.py", line 12, in test_generic 2023-10-08T13:43:51.561 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_9725b08fd801c82987c737f7e6d354878f036ee8/qa/tasks/cephfs/xfstests_dev.py", line 387, in run_generic_tests 2023-10-08T13:43:51.561 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_9725b08fd801c82987c737f7e6d354878f036ee8/qa/tasks/cephfs/xfstests_dev.py", line 379, in run_testdir 2023-10-08T13:43:51.561 INFO:tasks.cephfs_test_runner:AssertionError: 16 != 0 2023-10-08T13:43:51.561 INFO:tasks.cephfs_test_runner: 2023-10-08T13:43:51.561 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-10-08T13:43:51.561 INFO:tasks.cephfs_test_runner:Ran 1 test in 27225.653s 2023-10-08T13:43:51.562 INFO:tasks.cephfs_test_runner: 2023-10-08T13:43:51.562 INFO:tasks.cephfs_test_runner:FAILED (failures=1) 2023-10-08T13:43:51.562 INFO:tasks.cephfs_test_runner: 2023-10-08T13:43:51.562 INFO:tasks.cephfs_test_runner:====================================================================== 2023-10-08T13:43:51.562 INFO:tasks.cephfs_test_runner:FAIL: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2023-10-08T13:43:51.562 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-10-08T13:43:51.562 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-10-08T13:43:51.562 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_9725b08fd801c82987c737f7e6d354878f036ee8/qa/tasks/cephfs/tests_from_xfstests_dev.py", line 12, in test_generic 2023-10-08T13:43:51.562 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_9725b08fd801c82987c737f7e6d354878f036ee8/qa/tasks/cephfs/xfstests_dev.py", line 387, in run_generic_tests 2023-10-08T13:43:51.562 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_9725b08fd801c82987c737f7e6d354878f036ee8/qa/tasks/cephfs/xfstests_dev.py", line 379, in run_testdir 2023-10-08T13:43:51.563 INFO:tasks.cephfs_test_runner:AssertionError: 16 != 0 2023-10-08T13:43:51.563 INFO:tasks.cephfs_test_runner: 2023-10-08T13:43:51.563 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_9725b08fd801c82987c737f7e6d354878f036ee8/qa/tasks/cephfs_test_runner.py", line 211, in task RuntimeError: Test failure: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2023-10-08T13:43:51.629 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=a03117dfe4c3476fb55570305733c8ce Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_9725b08fd801c82987c737f7e6d354878f036ee8/qa/tasks/cephfs_test_runner.py", line 211, in task RuntimeError: Test failure: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2023-10-08T13:43:51.631 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2023-10-08T13:43:51.648 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2023-10-08T13:43:51.692 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2023-10-08T13:43:51.692 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2023-10-08T13:43:51.692 DEBUG:teuthology.orchestra.run.smithi032:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-08T13:43:51.764 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16349460k,nr_inodes=4087365,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276124k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 none /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18877 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276120k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276124k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-10-08T13:43:51.764 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2023-10-08T13:43:51.764 DEBUG:teuthology.orchestra.run.smithi032:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-08T13:43:51.822 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16349460k,nr_inodes=4087365,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276124k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 none /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18877 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276120k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276124k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-10-08T13:43:51.823 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-10-08T13:43:51.823 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-08T13:43:51.881 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16349468k,nr_inodes=4087367,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276124k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 none /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=12874 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276120k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276124k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-10-08T13:43:51.881 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-10-08T13:43:51.881 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-08T13:43:51.957 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16349468k,nr_inodes=4087367,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276124k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 none /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=12874 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276120k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276124k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-10-08T13:43:51.958 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T13:43:51.958 DEBUG:teuthology.orchestra.run.smithi040:> ip netns list 2023-10-08T13:43:51.981 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-08T13:43:51.982 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-08T13:43:51.988 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T13:43:51.988 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-08T13:43:52.064 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T13:43:52.065 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-08T13:43:52.149 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T13:43:52.149 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip link delete ceph-brx 2023-10-08T13:43:52.429 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T13:43:52.429 DEBUG:teuthology.orchestra.run.smithi032:> ip netns list 2023-10-08T13:43:52.452 INFO:teuthology.orchestra.run.smithi032.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-08T13:43:52.452 INFO:teuthology.orchestra.run.smithi032.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-08T13:43:52.453 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T13:43:52.453 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-08T13:43:52.488 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T13:43:52.488 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-08T13:43:52.575 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T13:43:52.575 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip link delete ceph-brx 2023-10-08T13:43:52.767 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-10-08T13:43:52.778 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-10-08T13:43:52.778 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T13:43:53.088 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:53.081+0000 7fd278c6a700 1 Processor -- start 2023-10-08T13:43:53.090 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:53.081+0000 7fd278c6a700 1 -- start start 2023-10-08T13:43:53.090 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:53.085+0000 7fd278c6a700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd27415a440 0x7fd2740cd9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:43:53.091 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:53.085+0000 7fd278c6a700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fd2741599e0 0x7fd274070380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:43:53.091 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:53.085+0000 7fd278c6a700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2740ce100 con 0x7fd2740708c0 2023-10-08T13:43:53.091 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:53.085+0000 7fd278c6a700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd274071160 con 0x7fd2741599e0 2023-10-08T13:43:53.091 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:53.085+0000 7fd278c6a700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2740cec80 con 0x7fd27415a440 2023-10-08T13:43:53.091 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:53.085+0000 7fd273fff700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fd2740708c0 0x7fd27415cfb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.32:47352/0 (socket says 172.21.15.32:47352) 2023-10-08T13:43:53.091 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:53.085+0000 7fd273fff700 1 -- 172.21.15.32:0/1673795555 learned_addr learned my addr 172.21.15.32:0/1673795555 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-08T13:43:53.091 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:53.085+0000 7fd2737fe700 1 --2- 172.21.15.32:0/1673795555 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd27415a440 0x7fd2740cd9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:43:53.092 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:53.085+0000 7fd272ffd700 1 --2- 172.21.15.32:0/1673795555 >> v2:172.21.15.32:3300/0 conn(0x7fd2741599e0 0x7fd274070380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:43:53.092 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:53.085+0000 7fd2737fe700 1 -- 172.21.15.32:0/1673795555 >> v2:172.21.15.32:3300/0 conn(0x7fd2741599e0 msgr2=0x7fd274070380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:43:53.092 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:53.085+0000 7fd2737fe700 1 --2- 172.21.15.32:0/1673795555 >> v2:172.21.15.32:3300/0 conn(0x7fd2741599e0 0x7fd274070380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:53.092 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:53.085+0000 7fd2737fe700 1 -- 172.21.15.32:0/1673795555 >> v1:172.21.15.40:6789/0 conn(0x7fd2740708c0 legacy=0x7fd27415cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:43:53.092 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:53.085+0000 7fd2737fe700 1 -- 172.21.15.32:0/1673795555 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2740ce3e0 con 0x7fd27415a440 2023-10-08T13:43:53.093 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:53.085+0000 7fd2737fe700 1 --2- 172.21.15.32:0/1673795555 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd27415a440 0x7fd2740cd9b0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fd264009850 tx=0x7fd264009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2de18b4fad7ca5d7 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:43:53.097 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:53.093+0000 7fd2727fc700 1 -- 172.21.15.32:0/1673795555 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd264004230 con 0x7fd27415a440 2023-10-08T13:43:53.098 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:53.093+0000 7fd2727fc700 1 -- 172.21.15.32:0/1673795555 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd264004390 con 0x7fd27415a440 2023-10-08T13:43:53.098 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:53.093+0000 7fd278c6a700 1 -- 172.21.15.32:0/1673795555 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd27415a440 msgr2=0x7fd2740cd9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:43:53.099 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:53.093+0000 7fd278c6a700 1 --2- 172.21.15.32:0/1673795555 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd27415a440 0x7fd2740cd9b0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fd264009850 tx=0x7fd264009b60 comp rx=0 tx=0).stop 2023-10-08T13:43:53.105 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:53.101+0000 7fd278c6a700 1 -- 172.21.15.32:0/1673795555 shutdown_connections 2023-10-08T13:43:53.106 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:53.101+0000 7fd278c6a700 1 --2- 172.21.15.32:0/1673795555 >> v2:172.21.15.32:3300/0 conn(0x7fd2741599e0 0x7fd274070380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:53.106 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:53.101+0000 7fd278c6a700 1 --2- 172.21.15.32:0/1673795555 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd27415a440 0x7fd2740cd9b0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:53.106 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:53.101+0000 7fd278c6a700 1 -- 172.21.15.32:0/1673795555 >> 172.21.15.32:0/1673795555 conn(0x7fd2740cb850 msgr2=0x7fd2740cbc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:43:53.106 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:53.101+0000 7fd278c6a700 1 -- 172.21.15.32:0/1673795555 shutdown_connections 2023-10-08T13:43:53.107 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:53.101+0000 7fd278c6a700 1 -- 172.21.15.32:0/1673795555 wait complete. 2023-10-08T13:43:53.107 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:53.101+0000 7fd278c6a700 1 Processor -- start 2023-10-08T13:43:53.107 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:53.101+0000 7fd278c6a700 1 -- start start 2023-10-08T13:43:53.109 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:53.101+0000 7fd278c6a700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd2740708c0 0x7fd27414df30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:43:53.109 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:53.101+0000 7fd278c6a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd2741599e0 0x7fd2741655f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:43:53.109 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:53.101+0000 7fd278c6a700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd27415a440 0x7fd274164340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:43:53.110 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:53.101+0000 7fd278c6a700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2740b1c70 con 0x7fd27415a440 2023-10-08T13:43:53.110 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:53.101+0000 7fd278c6a700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd27414e470 con 0x7fd2741599e0 2023-10-08T13:43:53.110 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:53.101+0000 7fd278c6a700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd274165ef0 con 0x7fd2740708c0 2023-10-08T13:43:53.111 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:53.101+0000 7fd273fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd27415a440 0x7fd274164340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:43:53.111 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:53.101+0000 7fd273fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd27415a440 0x7fd274164340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:52976/0 (socket says 172.21.15.32:52976) 2023-10-08T13:43:53.112 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:53.101+0000 7fd273fff700 1 -- 172.21.15.32:0/194900316 learned_addr learned my addr 172.21.15.32:0/194900316 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T13:43:53.112 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:53.101+0000 7fd2737fe700 1 --2- 172.21.15.32:0/194900316 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd2740708c0 0x7fd27414df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:43:53.114 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:53.105+0000 7fd273fff700 1 -- 172.21.15.32:0/194900316 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd2740708c0 msgr2=0x7fd27414df30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:43:53.114 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:53.105+0000 7fd273fff700 1 --2- 172.21.15.32:0/194900316 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd2740708c0 0x7fd27414df30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:53.115 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:53.105+0000 7fd273fff700 1 -- 172.21.15.32:0/194900316 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd2741599e0 msgr2=0x7fd2741655f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T13:43:53.115 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:53.105+0000 7fd273fff700 1 --2- 172.21.15.32:0/194900316 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd2741599e0 0x7fd2741655f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:53.116 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:53.105+0000 7fd273fff700 1 -- 172.21.15.32:0/194900316 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2640094b0 con 0x7fd27415a440 2023-10-08T13:43:53.117 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:53.105+0000 7fd273fff700 1 --2- 172.21.15.32:0/194900316 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd27415a440 0x7fd274164340 secure :-1 s=READY pgs=1904 cs=0 l=1 rev1=1 crypto rx=0x7fd26c00ca80 tx=0x7fd26c00cd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:43:53.140 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:53.133+0000 7fd25bfff700 1 -- 172.21.15.32:0/194900316 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd26c00a940 con 0x7fd27415a440 2023-10-08T13:43:53.146 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:53.141+0000 7fd278c6a700 1 -- 172.21.15.32:0/194900316 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2740ad8e0 con 0x7fd27415a440 2023-10-08T13:43:53.146 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:53.141+0000 7fd278c6a700 1 -- 172.21.15.32:0/194900316 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd274166140 con 0x7fd27415a440 2023-10-08T13:43:53.148 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:53.141+0000 7fd25bfff700 1 -- 172.21.15.32:0/194900316 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd26c00aaa0 con 0x7fd27415a440 2023-10-08T13:43:53.148 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:53.141+0000 7fd25bfff700 1 -- 172.21.15.32:0/194900316 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd26c00ae50 con 0x7fd27415a440 2023-10-08T13:43:53.148 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:53.141+0000 7fd25bfff700 1 -- 172.21.15.32:0/194900316 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fd26c01c3b0 con 0x7fd27415a440 2023-10-08T13:43:53.149 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:53.141+0000 7fd25bfff700 1 --2- 172.21.15.32:0/194900316 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fd2600665e0 0x7fd260068aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:43:53.153 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:53.145+0000 7fd278c6a700 1 -- 172.21.15.32:0/194900316 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd254005310 con 0x7fd27415a440 2023-10-08T13:43:53.161 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:53.149+0000 7fd2737fe700 1 --2- 172.21.15.32:0/194900316 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fd2600665e0 0x7fd260068aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:43:53.161 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:53.149+0000 7fd25bfff700 1 -- 172.21.15.32:0/194900316 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fd26c0834a0 con 0x7fd27415a440 2023-10-08T13:43:53.161 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:53.149+0000 7fd2737fe700 1 --2- 172.21.15.32:0/194900316 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fd2600665e0 0x7fd260068aa0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7fd264004740 tx=0x7fd264010000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:43:53.162 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:53.157+0000 7fd25bfff700 1 -- 172.21.15.32:0/194900316 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fd26c050e50 con 0x7fd27415a440 2023-10-08T13:43:53.717 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:53.713+0000 7fd278c6a700 1 -- 172.21.15.32:0/194900316 --> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd254000bc0 con 0x7fd2600665e0 2023-10-08T13:43:53.721 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:53.717+0000 7fd25bfff700 1 -- 172.21.15.32:0/194900316 <== mgr.4107 v2:172.21.15.32:6832/2601628338 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+49551 (secure 0 0 0) 0x7fd254000bc0 con 0x7fd2600665e0 2023-10-08T13:43:53.724 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T13:43:53.724 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:53.717+0000 7fd278c6a700 1 -- 172.21.15.32:0/194900316 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fd2600665e0 msgr2=0x7fd260068aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:43:53.725 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:53.717+0000 7fd278c6a700 1 --2- 172.21.15.32:0/194900316 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fd2600665e0 0x7fd260068aa0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7fd264004740 tx=0x7fd264010000 comp rx=0 tx=0).stop 2023-10-08T13:43:53.725 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:53.717+0000 7fd278c6a700 1 -- 172.21.15.32:0/194900316 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd27415a440 msgr2=0x7fd274164340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:43:53.725 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:53.717+0000 7fd278c6a700 1 --2- 172.21.15.32:0/194900316 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd27415a440 0x7fd274164340 secure :-1 s=READY pgs=1904 cs=0 l=1 rev1=1 crypto rx=0x7fd26c00ca80 tx=0x7fd26c00cd90 comp rx=0 tx=0).stop 2023-10-08T13:43:53.731 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:53.725+0000 7fd278c6a700 1 -- 172.21.15.32:0/194900316 shutdown_connections 2023-10-08T13:43:53.732 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:53.725+0000 7fd278c6a700 1 --2- 172.21.15.32:0/194900316 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fd2600665e0 0x7fd260068aa0 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:53.732 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:53.725+0000 7fd278c6a700 1 --2- 172.21.15.32:0/194900316 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd27415a440 0x7fd274164340 unknown :-1 s=CLOSED pgs=1904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:53.732 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:53.725+0000 7fd278c6a700 1 --2- 172.21.15.32:0/194900316 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd2741599e0 0x7fd2741655f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:53.732 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:53.725+0000 7fd278c6a700 1 --2- 172.21.15.32:0/194900316 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd2740708c0 0x7fd27414df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:53.732 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:53.725+0000 7fd278c6a700 1 -- 172.21.15.32:0/194900316 >> 172.21.15.32:0/194900316 conn(0x7fd2740cb850 msgr2=0x7fd2740ccd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:43:53.732 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:53.725+0000 7fd278c6a700 1 -- 172.21.15.32:0/194900316 shutdown_connections 2023-10-08T13:43:53.732 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:53.725+0000 7fd278c6a700 1 -- 172.21.15.32:0/194900316 wait complete. 2023-10-08T13:43:53.733 INFO:teuthology.orchestra.run.smithi032.stderr:dumped all 2023-10-08T13:43:53.746 INFO:teuthology.orchestra.run.smithi032.stdout:{"pg_ready":true,"pg_map":{"version":13662,"stamp":"2023-10-08T13:43:52.950845+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":53025860,"kb_used_data":40289180,"kb_used_omap":4346,"kb_used_meta":12524357,"kb_avail":701948860,"statfs":{"total":773094113280,"available":718795632640,"internally_reserved":0,"allocated":41256120320,"data_stored":41170877503,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4451158,"internal_metadata":12824941738},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,1,1,3,3],"upper_bound":32},"perf_stat":{"commit_latency_ms":132,"apply_latency_ms":132,"commit_latency_ns":132000000,"apply_latency_ns":132000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-42501861584,"num_objects":-35195,"num_object_clones":0,"num_object_copies":-70390,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-35195,"num_whiteouts":0,"num_read":-1718250,"num_read_kb":-122478048,"num_write":-7500803,"num_write_kb":-162332357,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-2520,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.513674"},"pg_stats":[{"pgid":"1.0","version":"18'117","reported_seq":404,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-08T13:43:45.440473+0000","last_change":"2023-10-08T06:09:24.811692+0000","last_active":"2023-10-08T13:43:45.440473+0000","last_peered":"2023-10-08T13:43:45.440473+0000","last_clean":"2023-10-08T13:43:45.440473+0000","last_became_active":"2023-10-08T06:09:24.809788+0000","last_became_peered":"2023-10-08T06:09:24.809788+0000","last_unstale":"2023-10-08T13:43:45.440473+0000","last_undegraded":"2023-10-08T13:43:45.440473+0000","last_fullsized":"2023-10-08T13:43:45.440473+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:23.748736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:23.748736+0000","last_clean_scrub_stamp":"2023-10-08T06:09:23.748736+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:39:45.599458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424514894,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7189700,"kb_used_data":5727928,"kb_used_omap":148,"kb_used_meta":1461611,"kb_avail":87182140,"statfs":{"total":96636764160,"available":89274511360,"internally_reserved":0,"allocated":5865398272,"data_stored":5853276085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":152224,"internal_metadata":1496690016},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1],"upper_bound":8},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 13:42:58 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.69299999999999995,"15min":0.78100000000000003},"min":{"1min":0.29299999999999998,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":2.6720000000000002,"5min":5.484,"15min":11.773},"last":0.47799999999999998},{"interface":"front","average":{"1min":1.5549999999999999,"5min":1.1830000000000001,"15min":1.141},"min":{"1min":0.315,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":8.8859999999999992,"5min":8.8859999999999992,"15min":8.8859999999999992},"last":0.504}]},{"osd":1,"last update":"Sun Oct 8 13:42:58 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.90500000000000003,"15min":0.94299999999999995},"min":{"1min":0.29799999999999999,"5min":0.29299999999999998,"15min":0.27500000000000002},"max":{"1min":2.6989999999999998,"5min":6.8970000000000002,"15min":11.943},"last":0.42299999999999999},{"interface":"front","average":{"1min":1.611,"5min":1.2410000000000001,"15min":1.218},"min":{"1min":0.378,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":8.7330000000000005,"5min":8.7330000000000005,"15min":8.7330000000000005},"last":0.45700000000000002}]},{"osd":2,"last update":"Sun Oct 8 13:42:58 2023","interfaces":[{"interface":"back","average":{"1min":1.976,"5min":1.4510000000000001,"15min":1.2729999999999999},"min":{"1min":0.41299999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":8.8559999999999999,"5min":8.8559999999999999,"15min":8.8559999999999999},"last":0.39700000000000002},{"interface":"front","average":{"1min":1.7729999999999999,"5min":1.1859999999999999,"15min":1.2929999999999999},"min":{"1min":0.35999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":9,"5min":9,"15min":9},"last":0.625}]},{"osd":3,"last update":"Sun Oct 8 13:42:58 2023","interfaces":[{"interface":"back","average":{"1min":4.181,"5min":1.8480000000000001,"15min":1.3740000000000001},"min":{"1min":0.40200000000000002,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":32.707000000000001,"5min":32.707000000000001,"15min":32.707000000000001},"last":0.55600000000000005},{"interface":"front","average":{"1min":3.5870000000000002,"5min":2.1040000000000001,"15min":1.6519999999999999},"min":{"1min":0.438,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":30.983000000000001,"5min":30.983000000000001,"15min":30.983000000000001},"last":0.57199999999999995}]},{"osd":4,"last update":"Sun Oct 8 13:42:58 2023","interfaces":[{"interface":"back","average":{"1min":1.357,"5min":1.1519999999999999,"15min":1.3240000000000001},"min":{"1min":0.32200000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":8.9220000000000006,"5min":9.3499999999999996,"15min":11.516},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.86799999999999999,"15min":1.177},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":2.6000000000000001,"5min":5.6820000000000004,"15min":11.907},"last":0.59399999999999997}]},{"osd":5,"last update":"Sun Oct 8 13:42:58 2023","interfaces":[{"interface":"back","average":{"1min":1.663,"5min":1.2609999999999999,"15min":1.3260000000000001},"min":{"1min":0.41599999999999998,"5min":0.379,"15min":0.32700000000000001},"max":{"1min":8.8239999999999998,"5min":13.045999999999999,"15min":13.045999999999999},"last":0.871},{"interface":"front","average":{"1min":1.9199999999999999,"5min":1.3260000000000001,"15min":1.4810000000000001},"min":{"1min":0.38600000000000001,"5min":0.373,"15min":0.36799999999999999},"max":{"1min":9.0299999999999994,"5min":9.0299999999999994,"15min":11.547000000000001},"last":0.90600000000000003}]},{"osd":6,"last update":"Sun Oct 8 13:42:58 2023","interfaces":[{"interface":"back","average":{"1min":1.909,"5min":1.3799999999999999,"15min":1.536},"min":{"1min":0.42599999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":8.9629999999999992,"5min":8.9629999999999992,"15min":11.567},"last":0.94799999999999995},{"interface":"front","average":{"1min":1.2470000000000001,"5min":1.0669999999999999,"15min":1.1779999999999999},"min":{"1min":0.45100000000000001,"5min":0.41399999999999998,"15min":0.33600000000000002},"max":{"1min":4.9939999999999998,"5min":6.5910000000000002,"15min":11.827},"last":0.66200000000000003}]}]},{"osd":6,"up_from":15,"seq":64424514897,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4982688,"kb_used_data":3172532,"kb_used_omap":546,"kb_used_meta":1712221,"kb_avail":89389152,"statfs":{"total":96636764160,"available":91534491648,"internally_reserved":0,"allocated":3248672768,"data_stored":3242027103,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":559457,"internal_metadata":1753314975},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":79,"apply_latency_ms":79,"commit_latency_ns":79000000,"apply_latency_ns":79000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 13:43:41 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.59199999999999997,"15min":0.77600000000000002},"min":{"1min":0.34499999999999997,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.79300000000000004,"5min":6.5910000000000002,"15min":8.3569999999999993},"last":1.196},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.82299999999999995,"15min":0.95099999999999996},"min":{"1min":0.35399999999999998,"5min":0.318,"15min":0.28199999999999997},"max":{"1min":0.872,"5min":6.5789999999999997,"15min":8.5980000000000008},"last":1.0820000000000001}]},{"osd":1,"last update":"Sun Oct 8 13:43:41 2023","interfaces":[{"interface":"back","average":{"1min":1.077,"5min":1.127,"15min":1.24},"min":{"1min":0.34200000000000003,"5min":0.29299999999999998,"15min":0.28699999999999998},"max":{"1min":4.2110000000000003,"5min":6.4029999999999996,"15min":8.8900000000000006},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.83999999999999997,"15min":0.93000000000000005},"min":{"1min":0.34399999999999997,"5min":0.29699999999999999,"15min":0.27700000000000002},"max":{"1min":1.0269999999999999,"5min":7.1260000000000003,"15min":8.4120000000000008},"last":1.103}]},{"osd":2,"last update":"Sun Oct 8 13:43:41 2023","interfaces":[{"interface":"back","average":{"1min":1.038,"5min":1.169,"15min":1.1319999999999999},"min":{"1min":0.40300000000000002,"5min":0.39800000000000002,"15min":0.318},"max":{"1min":4.0060000000000002,"5min":7.5510000000000002,"15min":8.4469999999999992},"last":1.046},{"interface":"front","average":{"1min":1.083,"5min":1.2330000000000001,"15min":1.2829999999999999},"min":{"1min":0.38,"5min":0.38,"15min":0.34899999999999998},"max":{"1min":7.6200000000000001,"5min":7.6200000000000001,"15min":8.3759999999999994},"last":0.88}]},{"osd":3,"last update":"Sun Oct 8 13:43:41 2023","interfaces":[{"interface":"back","average":{"1min":1.0940000000000001,"5min":1.498,"15min":1.3520000000000001},"min":{"1min":0.41399999999999998,"5min":0.40799999999999997,"15min":0.36599999999999999},"max":{"1min":7.673,"5min":11.715999999999999,"15min":11.715999999999999},"last":1.129},{"interface":"front","average":{"1min":1.3009999999999999,"5min":1.504,"15min":1.52},"min":{"1min":0.51800000000000002,"5min":0.373,"15min":0.35299999999999998},"max":{"1min":4.3079999999999998,"5min":10.132999999999999,"15min":10.369},"last":0.85599999999999998}]},{"osd":4,"last update":"Sun Oct 8 13:43:41 2023","interfaces":[{"interface":"back","average":{"1min":1.415,"5min":0.96099999999999997,"15min":1.0840000000000001},"min":{"1min":0.47499999999999998,"5min":0.34399999999999997,"15min":0.33800000000000002},"max":{"1min":6.46,"5min":6.7249999999999996,"15min":9.5},"last":1.329},{"interface":"front","average":{"1min":1.0600000000000001,"5min":1.1899999999999999,"15min":1.153},"min":{"1min":0.42999999999999999,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":6.3819999999999997,"5min":6.3819999999999997,"15min":8.2940000000000005},"last":0.98799999999999999}]},{"osd":5,"last update":"Sun Oct 8 13:43:41 2023","interfaces":[{"interface":"back","average":{"1min":1.9099999999999999,"5min":1.4770000000000001,"15min":1.4710000000000001},"min":{"1min":0.40300000000000002,"5min":0.32200000000000001,"15min":0.317},"max":{"1min":5.5339999999999998,"5min":6.3840000000000003,"15min":9.3930000000000007},"last":0.94899999999999995},{"interface":"front","average":{"1min":0.95699999999999996,"5min":0.89200000000000002,"15min":1.087},"min":{"1min":0.45800000000000002,"5min":0.376,"15min":0.376},"max":{"1min":3.4399999999999999,"5min":6.7560000000000002,"15min":10.087999999999999},"last":1.276}]},{"osd":7,"last update":"Sun Oct 8 13:43:41 2023","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":1.119,"15min":1.2649999999999999},"min":{"1min":0.54400000000000004,"5min":0.41599999999999998,"15min":0.39400000000000002},"max":{"1min":1.6719999999999999,"5min":6.0010000000000003,"15min":14.177},"last":1.244},{"interface":"front","average":{"1min":1.3620000000000001,"5min":1.3500000000000001,"15min":1.5860000000000001},"min":{"1min":0.58399999999999996,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":4.2859999999999996,"5min":6.6239999999999997,"15min":9.7579999999999991},"last":1.165}]}]},{"osd":5,"up_from":15,"seq":64424514893,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7666620,"kb_used_data":5837940,"kb_used_omap":249,"kb_used_meta":1803206,"kb_avail":86705220,"statfs":{"total":96636764160,"available":88786145280,"internally_reserved":0,"allocated":5978050560,"data_stored":5965948087,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":255902,"internal_metadata":1846483042},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 13:42:46 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.81000000000000005,"15min":0.80500000000000005},"min":{"1min":0.27300000000000002,"5min":0.26200000000000001,"15min":0.25900000000000001},"max":{"1min":2.081,"5min":5.2309999999999999,"15min":7.0830000000000002},"last":0.98199999999999998},{"interface":"front","average":{"1min":1.6639999999999999,"5min":1.024,"15min":0.83699999999999997},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":11.331,"5min":11.331,"15min":11.331},"last":1.042}]},{"osd":1,"last update":"Sun Oct 8 13:42:46 2023","interfaces":[{"interface":"back","average":{"1min":1.0720000000000001,"5min":0.96999999999999997,"15min":1.0189999999999999},"min":{"1min":0.28699999999999998,"5min":0.28399999999999997,"15min":0.27600000000000002},"max":{"1min":4.5019999999999998,"5min":5.2670000000000003,"15min":10.523999999999999},"last":0.78000000000000003},{"interface":"front","average":{"1min":1.7390000000000001,"5min":1.198,"15min":1.0109999999999999},"min":{"1min":0.42799999999999999,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":11.425000000000001,"5min":11.425000000000001,"15min":11.425000000000001},"last":0.74099999999999999}]},{"osd":2,"last update":"Sun Oct 8 13:42:46 2023","interfaces":[{"interface":"back","average":{"1min":1.3859999999999999,"5min":1.262,"15min":1.236},"min":{"1min":0.32100000000000001,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":8.6069999999999993,"5min":12.236000000000001,"15min":12.236000000000001},"last":1.0940000000000001},{"interface":"front","average":{"1min":1.056,"5min":1.3380000000000001,"15min":1.226},"min":{"1min":0.41899999999999998,"5min":0.309,"15min":0.309},"max":{"1min":3.569,"5min":8.7119999999999997,"15min":10.577},"last":1.147}]},{"osd":3,"last update":"Sun Oct 8 13:42:46 2023","interfaces":[{"interface":"back","average":{"1min":1.7589999999999999,"5min":1.171,"15min":1.2569999999999999},"min":{"1min":0.38200000000000001,"5min":0.34100000000000003,"15min":0.313},"max":{"1min":11.49,"5min":11.49,"15min":11.49},"last":0.90300000000000002},{"interface":"front","average":{"1min":1.4890000000000001,"5min":1.462,"15min":1.2989999999999999},"min":{"1min":0.41699999999999998,"5min":0.34399999999999997,"15min":0.34200000000000003},"max":{"1min":8.641,"5min":12.289999999999999,"15min":12.289999999999999},"last":1.2430000000000001}]},{"osd":4,"last update":"Sun Oct 8 13:42:46 2023","interfaces":[{"interface":"back","average":{"1min":1.1160000000000001,"5min":1.0589999999999999,"15min":0.91400000000000003},"min":{"1min":0.33100000000000002,"5min":0.32500000000000001,"15min":0.30599999999999999},"max":{"1min":5.3789999999999996,"5min":5.3789999999999996,"15min":7.1520000000000001},"last":1.304},{"interface":"front","average":{"1min":2.1909999999999998,"5min":1.4399999999999999,"15min":1.071},"min":{"1min":0.439,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":11.457000000000001,"5min":11.457000000000001,"15min":11.457000000000001},"last":1.1919999999999999}]},{"osd":6,"last update":"Sun Oct 8 13:42:46 2023","interfaces":[{"interface":"back","average":{"1min":1.4510000000000001,"5min":1.605,"15min":1.3320000000000001},"min":{"1min":0.435,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":8.5600000000000005,"5min":12.329000000000001,"15min":12.329000000000001},"last":0.94099999999999995},{"interface":"front","average":{"1min":1.034,"5min":1.1359999999999999,"15min":1.1419999999999999},"min":{"1min":0.40400000000000003,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":3.0030000000000001,"5min":6.6799999999999997,"15min":7.5259999999999998},"last":1.385}]},{"osd":7,"last update":"Sun Oct 8 13:42:46 2023","interfaces":[{"interface":"back","average":{"1min":2.2879999999999998,"5min":1.399,"15min":1.232},"min":{"1min":0.40200000000000002,"5min":0.39300000000000002,"15min":0.38200000000000001},"max":{"1min":11.388999999999999,"5min":11.388999999999999,"15min":11.388999999999999},"last":1.3480000000000001},{"interface":"front","average":{"1min":1.359,"5min":1.673,"15min":1.4410000000000001},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":8.7460000000000004,"5min":17.481999999999999,"15min":17.481999999999999},"last":1.413}]}]},{"osd":4,"up_from":15,"seq":64424514894,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":6688996,"kb_used_data":4849964,"kb_used_omap":353,"kb_used_meta":1753374,"kb_avail":87682844,"statfs":{"total":96636764160,"available":89787232256,"internally_reserved":0,"allocated":4966363136,"data_stored":4955163299,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":361854,"internal_metadata":1795455618},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 13:43:22 2023","interfaces":[{"interface":"back","average":{"1min":1.28,"5min":1.3140000000000001,"15min":1.2410000000000001},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":5.5220000000000002,"5min":6.585,"15min":6.585},"last":11.233000000000001},{"interface":"front","average":{"1min":1.0580000000000001,"5min":1.2450000000000001,"15min":0.95499999999999996},"min":{"1min":0.33800000000000002,"5min":0.30499999999999999,"15min":0.26100000000000001},"max":{"1min":5.3949999999999996,"5min":7.6559999999999997,"15min":7.6559999999999997},"last":11.061}]},{"osd":1,"last update":"Sun Oct 8 13:43:22 2023","interfaces":[{"interface":"back","average":{"1min":1.1910000000000001,"5min":1.1419999999999999,"15min":1.2},"min":{"1min":0.28599999999999998,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":5.0640000000000001,"5min":6.9219999999999997,"15min":10.321},"last":0.77700000000000002},{"interface":"front","average":{"1min":1.429,"5min":1.4530000000000001,"15min":1.45},"min":{"1min":0.42199999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":5.5659999999999998,"5min":7.0579999999999998,"15min":7.7009999999999996},"last":11.372}]},{"osd":2,"last update":"Sun Oct 8 13:43:22 2023","interfaces":[{"interface":"back","average":{"1min":1.075,"5min":1.8029999999999999,"15min":1.5149999999999999},"min":{"1min":0.33800000000000002,"5min":0.316,"15min":0.316},"max":{"1min":4.2080000000000002,"5min":42.488,"15min":42.488},"last":0.83299999999999996},{"interface":"front","average":{"1min":1.3600000000000001,"5min":1.855,"15min":1.6699999999999999},"min":{"1min":0.34100000000000003,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":5.5949999999999998,"5min":43.997999999999998,"15min":43.997999999999998},"last":11.282}]},{"osd":3,"last update":"Sun Oct 8 13:43:22 2023","interfaces":[{"interface":"back","average":{"1min":1.536,"5min":1.605,"15min":1.3520000000000001},"min":{"1min":0.374,"5min":0.35999999999999999,"15min":0.35899999999999999},"max":{"1min":5.4320000000000004,"5min":8.4339999999999993,"15min":8.4339999999999993},"last":11.214},{"interface":"front","average":{"1min":1.704,"5min":1.4550000000000001,"15min":1.4139999999999999},"min":{"1min":0.42799999999999999,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":5.2389999999999999,"5min":6.8380000000000001,"15min":10.433999999999999},"last":11.493}]},{"osd":5,"last update":"Sun Oct 8 13:43:22 2023","interfaces":[{"interface":"back","average":{"1min":1.75,"5min":1.3680000000000001,"15min":1.2549999999999999},"min":{"1min":0.38100000000000001,"5min":0.30499999999999999,"15min":0.29199999999999998},"max":{"1min":6.069,"5min":12.226000000000001,"15min":12.226000000000001},"last":11.460000000000001},{"interface":"front","average":{"1min":1.266,"5min":1.2350000000000001,"15min":1.0680000000000001},"min":{"1min":0.36099999999999999,"5min":0.32900000000000001,"15min":0.32600000000000001},"max":{"1min":5.3029999999999999,"5min":6.6769999999999996,"15min":6.6769999999999996},"last":11.17}]},{"osd":6,"last update":"Sun Oct 8 13:43:22 2023","interfaces":[{"interface":"back","average":{"1min":1.0740000000000001,"5min":1.222,"15min":1.304},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.36399999999999999},"max":{"1min":4.0110000000000001,"5min":5.8650000000000002,"15min":10.470000000000001},"last":0.89700000000000002},{"interface":"front","average":{"1min":1.5449999999999999,"5min":1.472,"15min":1.5029999999999999},"min":{"1min":0.44700000000000001,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":6.1180000000000003,"5min":9.4529999999999994,"15min":9.4529999999999994},"last":11.406000000000001}]},{"osd":7,"last update":"Sun Oct 8 13:43:22 2023","interfaces":[{"interface":"back","average":{"1min":1.2130000000000001,"5min":1.423,"15min":1.3220000000000001},"min":{"1min":0.37,"5min":0.37,"15min":0.34399999999999997},"max":{"1min":5.3570000000000002,"5min":11.946999999999999,"15min":11.946999999999999},"last":0.96099999999999997},{"interface":"front","average":{"1min":1.0920000000000001,"5min":1.208,"15min":1.395},"min":{"1min":0.51400000000000001,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":4.0970000000000004,"5min":5.7329999999999997,"15min":10.802},"last":0.871}]}]},{"osd":2,"up_from":15,"seq":64424514888,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5144728,"kb_used_data":3529740,"kb_used_omap":345,"kb_used_meta":1614630,"kb_avail":89227112,"statfs":{"total":96636764160,"available":91368562688,"internally_reserved":0,"allocated":3614453760,"data_stored":3607014900,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":354112,"internal_metadata":1653381312},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,0,0,2],"upper_bound":32},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 13:43:08 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.81200000000000006,"15min":0.73599999999999999},"min":{"1min":0.23999999999999999,"5min":0.221,"15min":0.221},"max":{"1min":2.4049999999999998,"5min":10.901,"15min":10.901},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.97299999999999998,"5min":0.89100000000000001,"15min":0.93100000000000005},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":4.0789999999999997,"5min":5.9340000000000002,"15min":13.784000000000001},"last":0.32200000000000001}]},{"osd":1,"last update":"Sun Oct 8 13:43:08 2023","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.625,"15min":1.0109999999999999},"min":{"1min":0.30199999999999999,"5min":0.25800000000000001,"15min":0.252},"max":{"1min":0.89100000000000001,"5min":4.1950000000000003,"15min":24.826000000000001},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.753,"5min":1.0149999999999999,"15min":1.302},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":2.4820000000000002,"5min":9.0609999999999999,"15min":34.645000000000003},"last":0.42999999999999999}]},{"osd":3,"last update":"Sun Oct 8 13:43:08 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.81999999999999995,"15min":1.1539999999999999},"min":{"1min":0.30399999999999999,"5min":0.29399999999999998,"15min":0.28299999999999997},"max":{"1min":1.042,"5min":5.0800000000000001,"15min":24.867000000000001},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.98199999999999998,"5min":1.2589999999999999,"15min":1.288},"min":{"1min":0.35599999999999998,"5min":0.29599999999999999,"15min":0.27200000000000002},"max":{"1min":3.9169999999999998,"5min":9.1880000000000006,"15min":25.219000000000001},"last":0.66800000000000004}]},{"osd":4,"last update":"Sun Oct 8 13:43:08 2023","interfaces":[{"interface":"back","average":{"1min":1.351,"5min":1.2470000000000001,"15min":1.196},"min":{"1min":0.40500000000000003,"5min":0.35099999999999998,"15min":0.33700000000000002},"max":{"1min":6.9779999999999998,"5min":10.451000000000001,"15min":10.451000000000001},"last":3.1269999999999998},{"interface":"front","average":{"1min":0.71499999999999997,"5min":1.1220000000000001,"15min":1.087},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36199999999999999},"max":{"1min":2.5270000000000001,"5min":7.4429999999999996,"15min":8.4789999999999992},"last":5.0270000000000001}]},{"osd":5,"last update":"Sun Oct 8 13:43:08 2023","interfaces":[{"interface":"back","average":{"1min":1.323,"5min":1.4159999999999999,"15min":1.284},"min":{"1min":0.38400000000000001,"5min":0.376,"15min":0.376},"max":{"1min":6.258,"5min":11.327999999999999,"15min":11.327999999999999},"last":3.1419999999999999},{"interface":"front","average":{"1min":1.0149999999999999,"5min":1.159,"15min":1.2130000000000001},"min":{"1min":0.45200000000000001,"5min":0.39000000000000001,"15min":0.377},"max":{"1min":4.0209999999999999,"5min":11.901999999999999,"15min":13.888999999999999},"last":0.63300000000000001}]},{"osd":6,"last update":"Sun Oct 8 13:43:08 2023","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.84399999999999997,"15min":1.3},"min":{"1min":0.44500000000000001,"5min":0.436,"15min":0.41099999999999998},"max":{"1min":3.976,"5min":5.8150000000000004,"15min":13.939},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.78400000000000003,"5min":1.538,"15min":1.448},"min":{"1min":0.44,"5min":0.39500000000000002,"15min":0.373},"max":{"1min":2.6970000000000001,"5min":11.553000000000001,"15min":12.218999999999999},"last":0.76700000000000002}]},{"osd":7,"last update":"Sun Oct 8 13:43:08 2023","interfaces":[{"interface":"back","average":{"1min":1.0609999999999999,"5min":1.3180000000000001,"15min":1.3080000000000001},"min":{"1min":0.436,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":4.3739999999999997,"5min":8.8740000000000006,"15min":8.8740000000000006},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.88300000000000001,"5min":1.2010000000000001,"15min":1.3979999999999999},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.439},"max":{"1min":4.0519999999999996,"5min":7.8220000000000001,"15min":13.997},"last":0.74099999999999999}]}]},{"osd":1,"up_from":15,"seq":64424514887,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7907892,"kb_used_data":6382888,"kb_used_omap":1388,"kb_used_meta":1523603,"kb_avail":86463948,"statfs":{"total":96636764160,"available":88539082752,"internally_reserved":0,"allocated":6536077312,"data_stored":6522589839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1421431,"internal_metadata":1560170377},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1],"upper_bound":4},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 13:43:12 2023","interfaces":[{"interface":"back","average":{"1min":1.4850000000000001,"5min":0.78300000000000003,"15min":0.82299999999999995},"min":{"1min":0.25800000000000001,"5min":0.24099999999999999,"15min":0.217},"max":{"1min":7.1760000000000002,"5min":7.1760000000000002,"15min":13.361000000000001},"last":0.41099999999999998},{"interface":"front","average":{"1min":1.4099999999999999,"5min":0.84699999999999998,"15min":1.002},"min":{"1min":0.34899999999999998,"5min":0.26300000000000001,"15min":0.25600000000000001},"max":{"1min":5.734,"5min":6.173,"15min":9.2110000000000003},"last":0.29099999999999998}]},{"osd":2,"last update":"Sun Oct 8 13:43:12 2023","interfaces":[{"interface":"back","average":{"1min":1.728,"5min":0.97999999999999998,"15min":0.94599999999999995},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.23799999999999999},"max":{"1min":10,"5min":10,"15min":13.401},"last":0.46800000000000003},{"interface":"front","average":{"1min":2.0609999999999999,"5min":1.075,"15min":1.0960000000000001},"min":{"1min":0.27200000000000002,"5min":0.254,"15min":0.252},"max":{"1min":7.1189999999999998,"5min":7.1189999999999998,"15min":9.327},"last":0.38300000000000001}]},{"osd":3,"last update":"Sun Oct 8 13:43:12 2023","interfaces":[{"interface":"back","average":{"1min":1.4019999999999999,"5min":0.873,"15min":1.079},"min":{"1min":0.316,"5min":0.29499999999999998,"15min":0.27300000000000002},"max":{"1min":6.2329999999999997,"5min":6.2359999999999998,"15min":9.2750000000000004},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.92600000000000005,"5min":1.0760000000000001,"15min":1.1419999999999999},"min":{"1min":0.39300000000000002,"5min":0.27100000000000002,"15min":0.26800000000000002},"max":{"1min":4.6139999999999999,"5min":6.0590000000000002,"15min":13.012},"last":0.71799999999999997}]},{"osd":4,"last update":"Sun Oct 8 13:43:12 2023","interfaces":[{"interface":"back","average":{"1min":1.6910000000000001,"5min":1.3100000000000001,"15min":1.252},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.32400000000000001},"max":{"1min":7.2649999999999997,"5min":7.2649999999999997,"15min":13.443},"last":0.70199999999999996},{"interface":"front","average":{"1min":1.546,"5min":1.1799999999999999,"15min":1.2010000000000001},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38400000000000001},"max":{"1min":5.8479999999999999,"5min":6.3159999999999998,"15min":9.3859999999999992},"last":0.44500000000000001}]},{"osd":5,"last update":"Sun Oct 8 13:43:12 2023","interfaces":[{"interface":"back","average":{"1min":1.583,"5min":1.2829999999999999,"15min":1.242},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":5.3490000000000002,"5min":6.1109999999999998,"15min":6.1109999999999998},"last":0.81000000000000005},{"interface":"front","average":{"1min":1.8240000000000001,"5min":1.2090000000000001,"15min":1.3260000000000001},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.35299999999999998},"max":{"1min":7.2409999999999997,"5min":7.2409999999999997,"15min":13.468},"last":0.79600000000000004}]},{"osd":6,"last update":"Sun Oct 8 13:43:12 2023","interfaces":[{"interface":"back","average":{"1min":1.036,"5min":1.518,"15min":1.492},"min":{"1min":0.47299999999999998,"5min":0.40799999999999997,"15min":0.39200000000000002},"max":{"1min":4.7400000000000002,"5min":10.125,"15min":12.266},"last":4.2510000000000003},{"interface":"front","average":{"1min":2.3439999999999999,"5min":1.573,"15min":1.476},"min":{"1min":0.47799999999999998,"5min":0.40899999999999997,"15min":0.40200000000000002},"max":{"1min":7.2850000000000001,"5min":7.2850000000000001,"15min":13.489000000000001},"last":0.745}]},{"osd":7,"last update":"Sun Oct 8 13:43:12 2023","interfaces":[{"interface":"back","average":{"1min":1.605,"5min":1.2310000000000001,"15min":1.413},"min":{"1min":0.54900000000000004,"5min":0.441,"15min":0.36199999999999999},"max":{"1min":5.8920000000000003,"5min":6.3780000000000001,"15min":9.4870000000000001},"last":0.51500000000000001},{"interface":"front","average":{"1min":1.054,"5min":1.5640000000000001,"15min":1.6040000000000001},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.437},"max":{"1min":4.7750000000000004,"5min":7.9260000000000002,"15min":12.263999999999999},"last":0.84999999999999998}]}]},{"osd":0,"up_from":15,"seq":64424514892,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5680708,"kb_used_data":4256376,"kb_used_omap":266,"kb_used_meta":1424053,"kb_avail":88691132,"statfs":{"total":96636764160,"available":90819719168,"internally_reserved":0,"allocated":4358529024,"data_stored":4349893931,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":272932,"internal_metadata":1458230748},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,1,1],"upper_bound":32},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 13:43:40 2023","interfaces":[{"interface":"back","average":{"1min":1.0680000000000001,"5min":1.0409999999999999,"15min":0.93400000000000005},"min":{"1min":0.25800000000000001,"5min":0.249,"15min":0.218},"max":{"1min":5.3979999999999997,"5min":8.1850000000000005,"15min":8.1850000000000005},"last":0.33000000000000002},{"interface":"front","average":{"1min":1.1259999999999999,"5min":1.0049999999999999,"15min":0.99399999999999999},"min":{"1min":0.27600000000000002,"5min":0.22,"15min":0.22},"max":{"1min":4.5419999999999998,"5min":11.153,"15min":11.153},"last":0.38900000000000001}]},{"osd":2,"last update":"Sun Oct 8 13:43:40 2023","interfaces":[{"interface":"back","average":{"1min":1.2370000000000001,"5min":1.0509999999999999,"15min":0.96099999999999997},"min":{"1min":0.31,"5min":0.25600000000000001,"15min":0.248},"max":{"1min":7.5670000000000002,"5min":8.891,"15min":10.115},"last":0.374},{"interface":"front","average":{"1min":1.5860000000000001,"5min":1.1910000000000001,"15min":1.0820000000000001},"min":{"1min":0.30099999999999999,"5min":0.25900000000000001,"15min":0.245},"max":{"1min":8.5069999999999997,"5min":8.5069999999999997,"15min":8.5069999999999997},"last":0.44800000000000001}]},{"osd":3,"last update":"Sun Oct 8 13:43:40 2023","interfaces":[{"interface":"back","average":{"1min":1.4670000000000001,"5min":1,"15min":1.1919999999999999},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.26200000000000001},"max":{"1min":6.9420000000000002,"5min":7.4400000000000004,"15min":7.4400000000000004},"last":0.85099999999999998},{"interface":"front","average":{"1min":1.9630000000000001,"5min":1.391,"15min":1.097},"min":{"1min":0.41299999999999998,"5min":0.33800000000000002,"15min":0.26900000000000002},"max":{"1min":7.4370000000000003,"5min":10.798,"15min":10.798},"last":0.72399999999999998}]},{"osd":4,"last update":"Sun Oct 8 13:43:40 2023","interfaces":[{"interface":"back","average":{"1min":1.349,"5min":1.111,"15min":1.2490000000000001},"min":{"1min":0.36099999999999999,"5min":0.34999999999999998,"15min":0.34399999999999997},"max":{"1min":6.9889999999999999,"5min":7.4930000000000003,"15min":7.4930000000000003},"last":0.65000000000000002},{"interface":"front","average":{"1min":1.6259999999999999,"5min":1.228,"15min":1.077},"min":{"1min":0.504,"5min":0.38700000000000001,"15min":0.35299999999999998},"max":{"1min":5.3460000000000001,"5min":8.077,"15min":8.077},"last":0.79500000000000004}]},{"osd":5,"last update":"Sun Oct 8 13:43:40 2023","interfaces":[{"interface":"back","average":{"1min":1.232,"5min":1.157,"15min":1.115},"min":{"1min":0.40100000000000002,"5min":0.37,"15min":0.36099999999999999},"max":{"1min":4.6340000000000003,"5min":5.5229999999999997,"15min":7.3940000000000001},"last":0.53400000000000003},{"interface":"front","average":{"1min":1.2629999999999999,"5min":1.1899999999999999,"15min":1.3049999999999999},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.377},"max":{"1min":7.0650000000000004,"5min":8.2750000000000004,"15min":8.2750000000000004},"last":0.69199999999999995}]},{"osd":6,"last update":"Sun Oct 8 13:43:40 2023","interfaces":[{"interface":"back","average":{"1min":2.375,"5min":1.6499999999999999,"15min":1.339},"min":{"1min":0.55900000000000005,"5min":0.42499999999999999,"15min":0.36499999999999999},"max":{"1min":7.5739999999999998,"5min":8.0289999999999999,"15min":8.0289999999999999},"last":0.76400000000000001},{"interface":"front","average":{"1min":1.2589999999999999,"5min":1.2130000000000001,"15min":1.196},"min":{"1min":0.44400000000000001,"5min":0.42999999999999999,"15min":0.40799999999999997},"max":{"1min":4.6689999999999996,"5min":5.8419999999999996,"15min":10.696},"last":0.73799999999999999}]},{"osd":7,"last update":"Sun Oct 8 13:43:40 2023","interfaces":[{"interface":"back","average":{"1min":1.706,"5min":1.1990000000000001,"15min":1.161},"min":{"1min":0.47299999999999998,"5min":0.42899999999999999,"15min":0.40500000000000003},"max":{"1min":7.4420000000000002,"5min":7.4420000000000002,"15min":7.4420000000000002},"last":0.77900000000000003},{"interface":"front","average":{"1min":1.5249999999999999,"5min":1.323,"15min":1.4239999999999999},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":7.0270000000000001,"5min":7.5549999999999997,"15min":9.298},"last":0.81299999999999994}]}]},{"osd":3,"up_from":14,"seq":60129547586,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7764528,"kb_used_data":6531812,"kb_used_omap":1048,"kb_used_meta":1231655,"kb_avail":86607312,"statfs":{"total":96636764160,"available":88685887488,"internally_reserved":0,"allocated":6688575488,"data_stored":6674964259,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1073246,"internal_metadata":1261215650},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,2],"upper_bound":16},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 13:43:18 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.72199999999999998,"15min":0.72899999999999998},"min":{"1min":0.26300000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":4.3200000000000003,"5min":6.8760000000000003,"15min":10.003},"last":2.5369999999999999},{"interface":"front","average":{"1min":1.343,"5min":1.0740000000000001,"15min":0.96599999999999997},"min":{"1min":0.26400000000000001,"5min":0.245,"15min":0.245},"max":{"1min":8.5559999999999992,"5min":8.5559999999999992,"15min":10.115},"last":0.29999999999999999}]},{"osd":1,"last update":"Sun Oct 8 13:43:18 2023","interfaces":[{"interface":"back","average":{"1min":1.1000000000000001,"5min":1.052,"15min":1.0269999999999999},"min":{"1min":0.315,"5min":0.26500000000000001,"15min":0.251},"max":{"1min":9.7219999999999995,"5min":10.757,"15min":10.757},"last":2.6110000000000002},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.99399999999999999,"15min":0.93100000000000005},"min":{"1min":0.29399999999999998,"5min":0.27300000000000002,"15min":0.26000000000000001},"max":{"1min":3.9289999999999998,"5min":6.8280000000000003,"15min":6.9560000000000004},"last":0.627}]},{"osd":2,"last update":"Sun Oct 8 13:43:18 2023","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":1.2050000000000001,"15min":1.0860000000000001},"min":{"1min":0.29499999999999998,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":4.7930000000000001,"5min":10.813000000000001,"15min":10.813000000000001},"last":3.2999999999999998},{"interface":"front","average":{"1min":0.626,"5min":1.0389999999999999,"15min":0.94799999999999995},"min":{"1min":0.32300000000000001,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":1.496,"5min":7.1760000000000002,"15min":7.1760000000000002},"last":0.40300000000000002}]},{"osd":4,"last update":"Sun Oct 8 13:43:18 2023","interfaces":[{"interface":"back","average":{"1min":1.288,"5min":0.99299999999999999,"15min":1.087},"min":{"1min":0.375,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":4.5579999999999998,"5min":5.1449999999999996,"15min":10.182},"last":0.42299999999999999},{"interface":"front","average":{"1min":1.4019999999999999,"5min":1.2689999999999999,"15min":1.1819999999999999},"min":{"1min":0.42099999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":5.9989999999999997,"5min":10.851000000000001,"15min":10.851000000000001},"last":2.6640000000000001}]},{"osd":5,"last update":"Sun Oct 8 13:43:18 2023","interfaces":[{"interface":"back","average":{"1min":1.474,"5min":1.413,"15min":1.292},"min":{"1min":0.38800000000000001,"5min":0.36899999999999999,"15min":0.35899999999999999},"max":{"1min":6.7880000000000003,"5min":10.885,"15min":10.885},"last":2.706},{"interface":"front","average":{"1min":1.111,"5min":1.1479999999999999,"15min":1.1659999999999999},"min":{"1min":0.38400000000000001,"5min":0.376,"15min":0.376},"max":{"1min":4.2000000000000002,"5min":6.9210000000000003,"15min":10.173999999999999},"last":0.68400000000000005}]},{"osd":6,"last update":"Sun Oct 8 13:43:18 2023","interfaces":[{"interface":"back","average":{"1min":1.2230000000000001,"5min":1.228,"15min":1.2310000000000001},"min":{"1min":0.46000000000000002,"5min":0.43099999999999999,"15min":0.42899999999999999},"max":{"1min":8.0519999999999996,"5min":8.0519999999999996,"15min":8.0519999999999996},"last":0.65700000000000003},{"interface":"front","average":{"1min":1.7350000000000001,"5min":1.1060000000000001,"15min":1.2589999999999999},"min":{"1min":0.48399999999999999,"5min":0.39600000000000002,"15min":0.379},"max":{"1min":7.8879999999999999,"5min":7.8879999999999999,"15min":12.263999999999999},"last":0.48499999999999999}]},{"osd":7,"last update":"Sun Oct 8 13:43:18 2023","interfaces":[{"interface":"back","average":{"1min":1.6240000000000001,"5min":1.2430000000000001,"15min":1.3029999999999999},"min":{"1min":0.49099999999999999,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":6.5010000000000003,"5min":7.5220000000000002,"15min":10.202999999999999},"last":0.53000000000000003},{"interface":"front","average":{"1min":1.413,"5min":1.3660000000000001,"15min":1.3109999999999999},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.42799999999999999},"max":{"1min":4.8319999999999999,"5min":10.952,"15min":10.952},"last":2.7469999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T13:43:53.749 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T13:43:54.162 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:54.157+0000 7f1581d20700 1 Processor -- start 2023-10-08T13:43:54.173 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:54.169+0000 7f1581d20700 1 -- start start 2023-10-08T13:43:54.175 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:54.169+0000 7f1581d20700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f157c0703c0 0x7f157c0ce0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:43:54.175 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:54.169+0000 7f1581d20700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f157c06dfc0 con 0x7f157c0adfc0 2023-10-08T13:43:54.176 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:54.169+0000 7f1581d20700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f157c15e800 con 0x7f157c15d600 2023-10-08T13:43:54.176 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:54.169+0000 7f1581d20700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f157c0ade50 con 0x7f157c0703c0 2023-10-08T13:43:54.176 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:54.169+0000 7f157affd700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f157c0703c0 0x7f157c0ce0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:43:54.176 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:54.169+0000 7f157affd700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f157c0703c0 0x7f157c0ce0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:52980/0 (socket says 172.21.15.32:52980) 2023-10-08T13:43:54.176 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:54.169+0000 7f157affd700 1 -- 172.21.15.32:0/4075152905 learned_addr learned my addr 172.21.15.32:0/4075152905 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T13:43:54.177 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:54.169+0000 7f157affd700 1 -- 172.21.15.32:0/4075152905 >> v1:172.21.15.40:6789/0 conn(0x7f157c15d600 legacy=0x7f157c0cd9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:43:54.177 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:54.169+0000 7f157affd700 1 -- 172.21.15.32:0/4075152905 >> v1:172.21.15.32:6789/0 conn(0x7f157c0adfc0 legacy=0x7f157c0ac8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:43:54.177 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:54.169+0000 7f157affd700 1 -- 172.21.15.32:0/4075152905 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f157c06e260 con 0x7f157c0703c0 2023-10-08T13:43:54.177 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:54.169+0000 7f157affd700 1 --2- 172.21.15.32:0/4075152905 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f157c0703c0 0x7f157c0ce0c0 secure :-1 s=READY pgs=1906 cs=0 l=1 rev1=1 crypto rx=0x7f156c009910 tx=0x7f156c009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55e00742f67ac10d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:43:54.189 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:54.185+0000 7f157a7fc700 1 -- 172.21.15.32:0/4075152905 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f156c00ba60 con 0x7f157c0703c0 2023-10-08T13:43:54.190 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:54.185+0000 7f157a7fc700 1 -- 172.21.15.32:0/4075152905 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f156c00bbc0 con 0x7f157c0703c0 2023-10-08T13:43:54.190 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:54.185+0000 7f1581d20700 1 -- 172.21.15.32:0/4075152905 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f157c0703c0 msgr2=0x7f157c0ce0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:43:54.191 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:54.185+0000 7f1581d20700 1 --2- 172.21.15.32:0/4075152905 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f157c0703c0 0x7f157c0ce0c0 secure :-1 s=READY pgs=1906 cs=0 l=1 rev1=1 crypto rx=0x7f156c009910 tx=0x7f156c009c20 comp rx=0 tx=0).stop 2023-10-08T13:43:54.191 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:54.185+0000 7f1581d20700 1 -- 172.21.15.32:0/4075152905 shutdown_connections 2023-10-08T13:43:54.191 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:54.185+0000 7f1581d20700 1 --2- 172.21.15.32:0/4075152905 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f157c0703c0 0x7f157c0ce0c0 unknown :-1 s=CLOSED pgs=1906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:54.191 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:54.185+0000 7f1581d20700 1 -- 172.21.15.32:0/4075152905 >> 172.21.15.32:0/4075152905 conn(0x7f157c0cb850 msgr2=0x7f157c0cbc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:43:54.191 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:54.185+0000 7f1581d20700 1 -- 172.21.15.32:0/4075152905 shutdown_connections 2023-10-08T13:43:54.192 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:54.185+0000 7f1581d20700 1 -- 172.21.15.32:0/4075152905 wait complete. 2023-10-08T13:43:54.193 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:54.185+0000 7f1581d20700 1 Processor -- start 2023-10-08T13:43:54.194 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:54.185+0000 7f1581d20700 1 -- start start 2023-10-08T13:43:54.194 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:54.189+0000 7f1581d20700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f157c0703c0 0x7f157c0b2950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:43:54.194 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:54.189+0000 7f1581d20700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f157c0adfc0 0x7f157c0b2e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:43:54.195 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:54.189+0000 7f1581d20700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f157c15d600 0x7f157c1ff290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:43:54.195 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:54.189+0000 7f1581d20700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f157c0b36f0 con 0x7f157c15d600 2023-10-08T13:43:54.195 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:54.189+0000 7f1581d20700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f157c0b39d0 con 0x7f157c0adfc0 2023-10-08T13:43:54.195 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:54.189+0000 7f1581d20700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f157c2005f0 con 0x7f157c0703c0 2023-10-08T13:43:54.196 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:54.189+0000 7f157bfff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f157c15d600 0x7f157c1ff290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:43:54.196 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:54.189+0000 7f157bfff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f157c15d600 0x7f157c1ff290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:52986/0 (socket says 172.21.15.32:52986) 2023-10-08T13:43:54.196 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:54.189+0000 7f157bfff700 1 -- 172.21.15.32:0/3193981159 learned_addr learned my addr 172.21.15.32:0/3193981159 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T13:43:54.196 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:54.189+0000 7f157affd700 1 --2- 172.21.15.32:0/3193981159 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f157c0adfc0 0x7f157c0b2e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:43:54.196 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:54.189+0000 7f157bfff700 1 -- 172.21.15.32:0/3193981159 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f157c0703c0 msgr2=0x7f157c0b2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:43:54.196 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:54.189+0000 7f157bfff700 1 --2- 172.21.15.32:0/3193981159 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f157c0703c0 0x7f157c0b2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:54.197 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:54.189+0000 7f157bfff700 1 -- 172.21.15.32:0/3193981159 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f157c0adfc0 msgr2=0x7f157c0b2e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:43:54.197 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:54.189+0000 7f157bfff700 1 --2- 172.21.15.32:0/3193981159 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f157c0adfc0 0x7f157c0b2e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:54.197 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:54.189+0000 7f157bfff700 1 -- 172.21.15.32:0/3193981159 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f156c009570 con 0x7f157c15d600 2023-10-08T13:43:54.197 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:54.189+0000 7f157bfff700 1 --2- 172.21.15.32:0/3193981159 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f157c15d600 0x7f157c1ff290 secure :-1 s=READY pgs=1907 cs=0 l=1 rev1=1 crypto rx=0x7f157000c480 tx=0x7f157000c790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:43:54.202 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:54.197+0000 7f1563fff700 1 -- 172.21.15.32:0/3193981159 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15700052d0 con 0x7f157c15d600 2023-10-08T13:43:54.203 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:54.197+0000 7f1581d20700 1 -- 172.21.15.32:0/3193981159 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f157c2008d0 con 0x7f157c15d600 2023-10-08T13:43:54.203 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:54.197+0000 7f1581d20700 1 -- 172.21.15.32:0/3193981159 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f157c0b33d0 con 0x7f157c15d600 2023-10-08T13:43:54.203 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:54.197+0000 7f1563fff700 1 -- 172.21.15.32:0/3193981159 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1570005430 con 0x7f157c15d600 2023-10-08T13:43:54.203 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:54.197+0000 7f1563fff700 1 -- 172.21.15.32:0/3193981159 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15700055a0 con 0x7f157c15d600 2023-10-08T13:43:54.205 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:54.197+0000 7f1563fff700 1 -- 172.21.15.32:0/3193981159 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f15700038e0 con 0x7f157c15d600 2023-10-08T13:43:54.205 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:54.201+0000 7f1563fff700 1 --2- 172.21.15.32:0/3193981159 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f1568066590 0x7f1568068a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:43:54.206 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:54.201+0000 7f157b7fe700 1 --2- 172.21.15.32:0/3193981159 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f1568066590 0x7f1568068a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:43:54.206 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:54.201+0000 7f1563fff700 1 -- 172.21.15.32:0/3193981159 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f1570082e40 con 0x7f157c15d600 2023-10-08T13:43:54.206 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:54.201+0000 7f157b7fe700 1 --2- 172.21.15.32:0/3193981159 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f1568066590 0x7f1568068a50 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f157c15c8c0 tx=0x7f1574001700 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:43:54.218 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:54.213+0000 7f1581d20700 1 -- 172.21.15.32:0/3193981159 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f155c005310 con 0x7f157c15d600 2023-10-08T13:43:54.236 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:54.229+0000 7f1563fff700 1 -- 172.21.15.32:0/3193981159 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f1570050760 con 0x7f157c15d600 2023-10-08T13:43:54.893 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:54.889+0000 7f1581d20700 1 -- 172.21.15.32:0/3193981159 --> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f155c000bc0 con 0x7f1568066590 2023-10-08T13:43:54.897 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:54.893+0000 7f1563fff700 1 -- 172.21.15.32:0/3193981159 <== mgr.4107 v2:172.21.15.32:6832/2601628338 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+49551 (secure 0 0 0) 0x7f155c000bc0 con 0x7f1568066590 2023-10-08T13:43:54.898 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T13:43:54.926 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:54.917+0000 7f1581d20700 1 -- 172.21.15.32:0/3193981159 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f1568066590 msgr2=0x7f1568068a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:43:54.926 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:54.917+0000 7f1581d20700 1 --2- 172.21.15.32:0/3193981159 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f1568066590 0x7f1568068a50 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f157c15c8c0 tx=0x7f1574001700 comp rx=0 tx=0).stop 2023-10-08T13:43:54.927 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:54.917+0000 7f1581d20700 1 -- 172.21.15.32:0/3193981159 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f157c15d600 msgr2=0x7f157c1ff290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:43:54.927 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:54.917+0000 7f1581d20700 1 --2- 172.21.15.32:0/3193981159 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f157c15d600 0x7f157c1ff290 secure :-1 s=READY pgs=1907 cs=0 l=1 rev1=1 crypto rx=0x7f157000c480 tx=0x7f157000c790 comp rx=0 tx=0).stop 2023-10-08T13:43:54.927 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:54.917+0000 7f1581d20700 1 -- 172.21.15.32:0/3193981159 shutdown_connections 2023-10-08T13:43:54.927 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:54.917+0000 7f1581d20700 1 --2- 172.21.15.32:0/3193981159 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f1568066590 0x7f1568068a50 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:54.927 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:54.917+0000 7f1581d20700 1 --2- 172.21.15.32:0/3193981159 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f157c15d600 0x7f157c1ff290 unknown :-1 s=CLOSED pgs=1907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:54.927 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:54.917+0000 7f1581d20700 1 --2- 172.21.15.32:0/3193981159 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f157c0adfc0 0x7f157c0b2e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:54.928 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:54.917+0000 7f1581d20700 1 --2- 172.21.15.32:0/3193981159 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f157c0703c0 0x7f157c0b2950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:54.928 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:54.917+0000 7f1581d20700 1 -- 172.21.15.32:0/3193981159 >> 172.21.15.32:0/3193981159 conn(0x7f157c0cb850 msgr2=0x7f157c06d710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:43:54.928 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:54.917+0000 7f1581d20700 1 -- 172.21.15.32:0/3193981159 shutdown_connections 2023-10-08T13:43:54.928 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:54.917+0000 7f1581d20700 1 -- 172.21.15.32:0/3193981159 wait complete. 2023-10-08T13:43:54.928 INFO:teuthology.orchestra.run.smithi032.stderr:dumped all 2023-10-08T13:43:54.936 INFO:teuthology.orchestra.run.smithi032.stdout:{"pg_ready":true,"pg_map":{"version":13662,"stamp":"2023-10-08T13:43:52.950845+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":53025860,"kb_used_data":40289180,"kb_used_omap":4346,"kb_used_meta":12524357,"kb_avail":701948860,"statfs":{"total":773094113280,"available":718795632640,"internally_reserved":0,"allocated":41256120320,"data_stored":41170877503,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4451158,"internal_metadata":12824941738},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,1,1,3,3],"upper_bound":32},"perf_stat":{"commit_latency_ms":132,"apply_latency_ms":132,"commit_latency_ns":132000000,"apply_latency_ns":132000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-42501861584,"num_objects":-35195,"num_object_clones":0,"num_object_copies":-70390,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-35195,"num_whiteouts":0,"num_read":-1718250,"num_read_kb":-122478048,"num_write":-7500803,"num_write_kb":-162332357,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-2520,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.513674"},"pg_stats":[{"pgid":"1.0","version":"18'117","reported_seq":404,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-08T13:43:45.440473+0000","last_change":"2023-10-08T06:09:24.811692+0000","last_active":"2023-10-08T13:43:45.440473+0000","last_peered":"2023-10-08T13:43:45.440473+0000","last_clean":"2023-10-08T13:43:45.440473+0000","last_became_active":"2023-10-08T06:09:24.809788+0000","last_became_peered":"2023-10-08T06:09:24.809788+0000","last_unstale":"2023-10-08T13:43:45.440473+0000","last_undegraded":"2023-10-08T13:43:45.440473+0000","last_fullsized":"2023-10-08T13:43:45.440473+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:23.748736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:23.748736+0000","last_clean_scrub_stamp":"2023-10-08T06:09:23.748736+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:39:45.599458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424514894,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7189700,"kb_used_data":5727928,"kb_used_omap":148,"kb_used_meta":1461611,"kb_avail":87182140,"statfs":{"total":96636764160,"available":89274511360,"internally_reserved":0,"allocated":5865398272,"data_stored":5853276085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":152224,"internal_metadata":1496690016},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1],"upper_bound":8},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 13:42:58 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.69299999999999995,"15min":0.78100000000000003},"min":{"1min":0.29299999999999998,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":2.6720000000000002,"5min":5.484,"15min":11.773},"last":0.47799999999999998},{"interface":"front","average":{"1min":1.5549999999999999,"5min":1.1830000000000001,"15min":1.141},"min":{"1min":0.315,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":8.8859999999999992,"5min":8.8859999999999992,"15min":8.8859999999999992},"last":0.504}]},{"osd":1,"last update":"Sun Oct 8 13:42:58 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.90500000000000003,"15min":0.94299999999999995},"min":{"1min":0.29799999999999999,"5min":0.29299999999999998,"15min":0.27500000000000002},"max":{"1min":2.6989999999999998,"5min":6.8970000000000002,"15min":11.943},"last":0.42299999999999999},{"interface":"front","average":{"1min":1.611,"5min":1.2410000000000001,"15min":1.218},"min":{"1min":0.378,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":8.7330000000000005,"5min":8.7330000000000005,"15min":8.7330000000000005},"last":0.45700000000000002}]},{"osd":2,"last update":"Sun Oct 8 13:42:58 2023","interfaces":[{"interface":"back","average":{"1min":1.976,"5min":1.4510000000000001,"15min":1.2729999999999999},"min":{"1min":0.41299999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":8.8559999999999999,"5min":8.8559999999999999,"15min":8.8559999999999999},"last":0.39700000000000002},{"interface":"front","average":{"1min":1.7729999999999999,"5min":1.1859999999999999,"15min":1.2929999999999999},"min":{"1min":0.35999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":9,"5min":9,"15min":9},"last":0.625}]},{"osd":3,"last update":"Sun Oct 8 13:42:58 2023","interfaces":[{"interface":"back","average":{"1min":4.181,"5min":1.8480000000000001,"15min":1.3740000000000001},"min":{"1min":0.40200000000000002,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":32.707000000000001,"5min":32.707000000000001,"15min":32.707000000000001},"last":0.55600000000000005},{"interface":"front","average":{"1min":3.5870000000000002,"5min":2.1040000000000001,"15min":1.6519999999999999},"min":{"1min":0.438,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":30.983000000000001,"5min":30.983000000000001,"15min":30.983000000000001},"last":0.57199999999999995}]},{"osd":4,"last update":"Sun Oct 8 13:42:58 2023","interfaces":[{"interface":"back","average":{"1min":1.357,"5min":1.1519999999999999,"15min":1.3240000000000001},"min":{"1min":0.32200000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":8.9220000000000006,"5min":9.3499999999999996,"15min":11.516},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.86799999999999999,"15min":1.177},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":2.6000000000000001,"5min":5.6820000000000004,"15min":11.907},"last":0.59399999999999997}]},{"osd":5,"last update":"Sun Oct 8 13:42:58 2023","interfaces":[{"interface":"back","average":{"1min":1.663,"5min":1.2609999999999999,"15min":1.3260000000000001},"min":{"1min":0.41599999999999998,"5min":0.379,"15min":0.32700000000000001},"max":{"1min":8.8239999999999998,"5min":13.045999999999999,"15min":13.045999999999999},"last":0.871},{"interface":"front","average":{"1min":1.9199999999999999,"5min":1.3260000000000001,"15min":1.4810000000000001},"min":{"1min":0.38600000000000001,"5min":0.373,"15min":0.36799999999999999},"max":{"1min":9.0299999999999994,"5min":9.0299999999999994,"15min":11.547000000000001},"last":0.90600000000000003}]},{"osd":6,"last update":"Sun Oct 8 13:42:58 2023","interfaces":[{"interface":"back","average":{"1min":1.909,"5min":1.3799999999999999,"15min":1.536},"min":{"1min":0.42599999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":8.9629999999999992,"5min":8.9629999999999992,"15min":11.567},"last":0.94799999999999995},{"interface":"front","average":{"1min":1.2470000000000001,"5min":1.0669999999999999,"15min":1.1779999999999999},"min":{"1min":0.45100000000000001,"5min":0.41399999999999998,"15min":0.33600000000000002},"max":{"1min":4.9939999999999998,"5min":6.5910000000000002,"15min":11.827},"last":0.66200000000000003}]}]},{"osd":6,"up_from":15,"seq":64424514897,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4982688,"kb_used_data":3172532,"kb_used_omap":546,"kb_used_meta":1712221,"kb_avail":89389152,"statfs":{"total":96636764160,"available":91534491648,"internally_reserved":0,"allocated":3248672768,"data_stored":3242027103,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":559457,"internal_metadata":1753314975},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":79,"apply_latency_ms":79,"commit_latency_ns":79000000,"apply_latency_ns":79000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 13:43:41 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.59199999999999997,"15min":0.77600000000000002},"min":{"1min":0.34499999999999997,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.79300000000000004,"5min":6.5910000000000002,"15min":8.3569999999999993},"last":1.196},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.82299999999999995,"15min":0.95099999999999996},"min":{"1min":0.35399999999999998,"5min":0.318,"15min":0.28199999999999997},"max":{"1min":0.872,"5min":6.5789999999999997,"15min":8.5980000000000008},"last":1.0820000000000001}]},{"osd":1,"last update":"Sun Oct 8 13:43:41 2023","interfaces":[{"interface":"back","average":{"1min":1.077,"5min":1.127,"15min":1.24},"min":{"1min":0.34200000000000003,"5min":0.29299999999999998,"15min":0.28699999999999998},"max":{"1min":4.2110000000000003,"5min":6.4029999999999996,"15min":8.8900000000000006},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.83999999999999997,"15min":0.93000000000000005},"min":{"1min":0.34399999999999997,"5min":0.29699999999999999,"15min":0.27700000000000002},"max":{"1min":1.0269999999999999,"5min":7.1260000000000003,"15min":8.4120000000000008},"last":1.103}]},{"osd":2,"last update":"Sun Oct 8 13:43:41 2023","interfaces":[{"interface":"back","average":{"1min":1.038,"5min":1.169,"15min":1.1319999999999999},"min":{"1min":0.40300000000000002,"5min":0.39800000000000002,"15min":0.318},"max":{"1min":4.0060000000000002,"5min":7.5510000000000002,"15min":8.4469999999999992},"last":1.046},{"interface":"front","average":{"1min":1.083,"5min":1.2330000000000001,"15min":1.2829999999999999},"min":{"1min":0.38,"5min":0.38,"15min":0.34899999999999998},"max":{"1min":7.6200000000000001,"5min":7.6200000000000001,"15min":8.3759999999999994},"last":0.88}]},{"osd":3,"last update":"Sun Oct 8 13:43:41 2023","interfaces":[{"interface":"back","average":{"1min":1.0940000000000001,"5min":1.498,"15min":1.3520000000000001},"min":{"1min":0.41399999999999998,"5min":0.40799999999999997,"15min":0.36599999999999999},"max":{"1min":7.673,"5min":11.715999999999999,"15min":11.715999999999999},"last":1.129},{"interface":"front","average":{"1min":1.3009999999999999,"5min":1.504,"15min":1.52},"min":{"1min":0.51800000000000002,"5min":0.373,"15min":0.35299999999999998},"max":{"1min":4.3079999999999998,"5min":10.132999999999999,"15min":10.369},"last":0.85599999999999998}]},{"osd":4,"last update":"Sun Oct 8 13:43:41 2023","interfaces":[{"interface":"back","average":{"1min":1.415,"5min":0.96099999999999997,"15min":1.0840000000000001},"min":{"1min":0.47499999999999998,"5min":0.34399999999999997,"15min":0.33800000000000002},"max":{"1min":6.46,"5min":6.7249999999999996,"15min":9.5},"last":1.329},{"interface":"front","average":{"1min":1.0600000000000001,"5min":1.1899999999999999,"15min":1.153},"min":{"1min":0.42999999999999999,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":6.3819999999999997,"5min":6.3819999999999997,"15min":8.2940000000000005},"last":0.98799999999999999}]},{"osd":5,"last update":"Sun Oct 8 13:43:41 2023","interfaces":[{"interface":"back","average":{"1min":1.9099999999999999,"5min":1.4770000000000001,"15min":1.4710000000000001},"min":{"1min":0.40300000000000002,"5min":0.32200000000000001,"15min":0.317},"max":{"1min":5.5339999999999998,"5min":6.3840000000000003,"15min":9.3930000000000007},"last":0.94899999999999995},{"interface":"front","average":{"1min":0.95699999999999996,"5min":0.89200000000000002,"15min":1.087},"min":{"1min":0.45800000000000002,"5min":0.376,"15min":0.376},"max":{"1min":3.4399999999999999,"5min":6.7560000000000002,"15min":10.087999999999999},"last":1.276}]},{"osd":7,"last update":"Sun Oct 8 13:43:41 2023","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":1.119,"15min":1.2649999999999999},"min":{"1min":0.54400000000000004,"5min":0.41599999999999998,"15min":0.39400000000000002},"max":{"1min":1.6719999999999999,"5min":6.0010000000000003,"15min":14.177},"last":1.244},{"interface":"front","average":{"1min":1.3620000000000001,"5min":1.3500000000000001,"15min":1.5860000000000001},"min":{"1min":0.58399999999999996,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":4.2859999999999996,"5min":6.6239999999999997,"15min":9.7579999999999991},"last":1.165}]}]},{"osd":5,"up_from":15,"seq":64424514893,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7666620,"kb_used_data":5837940,"kb_used_omap":249,"kb_used_meta":1803206,"kb_avail":86705220,"statfs":{"total":96636764160,"available":88786145280,"internally_reserved":0,"allocated":5978050560,"data_stored":5965948087,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":255902,"internal_metadata":1846483042},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 13:42:46 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.81000000000000005,"15min":0.80500000000000005},"min":{"1min":0.27300000000000002,"5min":0.26200000000000001,"15min":0.25900000000000001},"max":{"1min":2.081,"5min":5.2309999999999999,"15min":7.0830000000000002},"last":0.98199999999999998},{"interface":"front","average":{"1min":1.6639999999999999,"5min":1.024,"15min":0.83699999999999997},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":11.331,"5min":11.331,"15min":11.331},"last":1.042}]},{"osd":1,"last update":"Sun Oct 8 13:42:46 2023","interfaces":[{"interface":"back","average":{"1min":1.0720000000000001,"5min":0.96999999999999997,"15min":1.0189999999999999},"min":{"1min":0.28699999999999998,"5min":0.28399999999999997,"15min":0.27600000000000002},"max":{"1min":4.5019999999999998,"5min":5.2670000000000003,"15min":10.523999999999999},"last":0.78000000000000003},{"interface":"front","average":{"1min":1.7390000000000001,"5min":1.198,"15min":1.0109999999999999},"min":{"1min":0.42799999999999999,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":11.425000000000001,"5min":11.425000000000001,"15min":11.425000000000001},"last":0.74099999999999999}]},{"osd":2,"last update":"Sun Oct 8 13:42:46 2023","interfaces":[{"interface":"back","average":{"1min":1.3859999999999999,"5min":1.262,"15min":1.236},"min":{"1min":0.32100000000000001,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":8.6069999999999993,"5min":12.236000000000001,"15min":12.236000000000001},"last":1.0940000000000001},{"interface":"front","average":{"1min":1.056,"5min":1.3380000000000001,"15min":1.226},"min":{"1min":0.41899999999999998,"5min":0.309,"15min":0.309},"max":{"1min":3.569,"5min":8.7119999999999997,"15min":10.577},"last":1.147}]},{"osd":3,"last update":"Sun Oct 8 13:42:46 2023","interfaces":[{"interface":"back","average":{"1min":1.7589999999999999,"5min":1.171,"15min":1.2569999999999999},"min":{"1min":0.38200000000000001,"5min":0.34100000000000003,"15min":0.313},"max":{"1min":11.49,"5min":11.49,"15min":11.49},"last":0.90300000000000002},{"interface":"front","average":{"1min":1.4890000000000001,"5min":1.462,"15min":1.2989999999999999},"min":{"1min":0.41699999999999998,"5min":0.34399999999999997,"15min":0.34200000000000003},"max":{"1min":8.641,"5min":12.289999999999999,"15min":12.289999999999999},"last":1.2430000000000001}]},{"osd":4,"last update":"Sun Oct 8 13:42:46 2023","interfaces":[{"interface":"back","average":{"1min":1.1160000000000001,"5min":1.0589999999999999,"15min":0.91400000000000003},"min":{"1min":0.33100000000000002,"5min":0.32500000000000001,"15min":0.30599999999999999},"max":{"1min":5.3789999999999996,"5min":5.3789999999999996,"15min":7.1520000000000001},"last":1.304},{"interface":"front","average":{"1min":2.1909999999999998,"5min":1.4399999999999999,"15min":1.071},"min":{"1min":0.439,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":11.457000000000001,"5min":11.457000000000001,"15min":11.457000000000001},"last":1.1919999999999999}]},{"osd":6,"last update":"Sun Oct 8 13:42:46 2023","interfaces":[{"interface":"back","average":{"1min":1.4510000000000001,"5min":1.605,"15min":1.3320000000000001},"min":{"1min":0.435,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":8.5600000000000005,"5min":12.329000000000001,"15min":12.329000000000001},"last":0.94099999999999995},{"interface":"front","average":{"1min":1.034,"5min":1.1359999999999999,"15min":1.1419999999999999},"min":{"1min":0.40400000000000003,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":3.0030000000000001,"5min":6.6799999999999997,"15min":7.5259999999999998},"last":1.385}]},{"osd":7,"last update":"Sun Oct 8 13:42:46 2023","interfaces":[{"interface":"back","average":{"1min":2.2879999999999998,"5min":1.399,"15min":1.232},"min":{"1min":0.40200000000000002,"5min":0.39300000000000002,"15min":0.38200000000000001},"max":{"1min":11.388999999999999,"5min":11.388999999999999,"15min":11.388999999999999},"last":1.3480000000000001},{"interface":"front","average":{"1min":1.359,"5min":1.673,"15min":1.4410000000000001},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":8.7460000000000004,"5min":17.481999999999999,"15min":17.481999999999999},"last":1.413}]}]},{"osd":4,"up_from":15,"seq":64424514894,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":6688996,"kb_used_data":4849964,"kb_used_omap":353,"kb_used_meta":1753374,"kb_avail":87682844,"statfs":{"total":96636764160,"available":89787232256,"internally_reserved":0,"allocated":4966363136,"data_stored":4955163299,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":361854,"internal_metadata":1795455618},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 13:43:22 2023","interfaces":[{"interface":"back","average":{"1min":1.28,"5min":1.3140000000000001,"15min":1.2410000000000001},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":5.5220000000000002,"5min":6.585,"15min":6.585},"last":11.233000000000001},{"interface":"front","average":{"1min":1.0580000000000001,"5min":1.2450000000000001,"15min":0.95499999999999996},"min":{"1min":0.33800000000000002,"5min":0.30499999999999999,"15min":0.26100000000000001},"max":{"1min":5.3949999999999996,"5min":7.6559999999999997,"15min":7.6559999999999997},"last":11.061}]},{"osd":1,"last update":"Sun Oct 8 13:43:22 2023","interfaces":[{"interface":"back","average":{"1min":1.1910000000000001,"5min":1.1419999999999999,"15min":1.2},"min":{"1min":0.28599999999999998,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":5.0640000000000001,"5min":6.9219999999999997,"15min":10.321},"last":0.77700000000000002},{"interface":"front","average":{"1min":1.429,"5min":1.4530000000000001,"15min":1.45},"min":{"1min":0.42199999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":5.5659999999999998,"5min":7.0579999999999998,"15min":7.7009999999999996},"last":11.372}]},{"osd":2,"last update":"Sun Oct 8 13:43:22 2023","interfaces":[{"interface":"back","average":{"1min":1.075,"5min":1.8029999999999999,"15min":1.5149999999999999},"min":{"1min":0.33800000000000002,"5min":0.316,"15min":0.316},"max":{"1min":4.2080000000000002,"5min":42.488,"15min":42.488},"last":0.83299999999999996},{"interface":"front","average":{"1min":1.3600000000000001,"5min":1.855,"15min":1.6699999999999999},"min":{"1min":0.34100000000000003,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":5.5949999999999998,"5min":43.997999999999998,"15min":43.997999999999998},"last":11.282}]},{"osd":3,"last update":"Sun Oct 8 13:43:22 2023","interfaces":[{"interface":"back","average":{"1min":1.536,"5min":1.605,"15min":1.3520000000000001},"min":{"1min":0.374,"5min":0.35999999999999999,"15min":0.35899999999999999},"max":{"1min":5.4320000000000004,"5min":8.4339999999999993,"15min":8.4339999999999993},"last":11.214},{"interface":"front","average":{"1min":1.704,"5min":1.4550000000000001,"15min":1.4139999999999999},"min":{"1min":0.42799999999999999,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":5.2389999999999999,"5min":6.8380000000000001,"15min":10.433999999999999},"last":11.493}]},{"osd":5,"last update":"Sun Oct 8 13:43:22 2023","interfaces":[{"interface":"back","average":{"1min":1.75,"5min":1.3680000000000001,"15min":1.2549999999999999},"min":{"1min":0.38100000000000001,"5min":0.30499999999999999,"15min":0.29199999999999998},"max":{"1min":6.069,"5min":12.226000000000001,"15min":12.226000000000001},"last":11.460000000000001},{"interface":"front","average":{"1min":1.266,"5min":1.2350000000000001,"15min":1.0680000000000001},"min":{"1min":0.36099999999999999,"5min":0.32900000000000001,"15min":0.32600000000000001},"max":{"1min":5.3029999999999999,"5min":6.6769999999999996,"15min":6.6769999999999996},"last":11.17}]},{"osd":6,"last update":"Sun Oct 8 13:43:22 2023","interfaces":[{"interface":"back","average":{"1min":1.0740000000000001,"5min":1.222,"15min":1.304},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.36399999999999999},"max":{"1min":4.0110000000000001,"5min":5.8650000000000002,"15min":10.470000000000001},"last":0.89700000000000002},{"interface":"front","average":{"1min":1.5449999999999999,"5min":1.472,"15min":1.5029999999999999},"min":{"1min":0.44700000000000001,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":6.1180000000000003,"5min":9.4529999999999994,"15min":9.4529999999999994},"last":11.406000000000001}]},{"osd":7,"last update":"Sun Oct 8 13:43:22 2023","interfaces":[{"interface":"back","average":{"1min":1.2130000000000001,"5min":1.423,"15min":1.3220000000000001},"min":{"1min":0.37,"5min":0.37,"15min":0.34399999999999997},"max":{"1min":5.3570000000000002,"5min":11.946999999999999,"15min":11.946999999999999},"last":0.96099999999999997},{"interface":"front","average":{"1min":1.0920000000000001,"5min":1.208,"15min":1.395},"min":{"1min":0.51400000000000001,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":4.0970000000000004,"5min":5.7329999999999997,"15min":10.802},"last":0.871}]}]},{"osd":2,"up_from":15,"seq":64424514888,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5144728,"kb_used_data":3529740,"kb_used_omap":345,"kb_used_meta":1614630,"kb_avail":89227112,"statfs":{"total":96636764160,"available":91368562688,"internally_reserved":0,"allocated":3614453760,"data_stored":3607014900,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":354112,"internal_metadata":1653381312},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,0,0,2],"upper_bound":32},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 13:43:08 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.81200000000000006,"15min":0.73599999999999999},"min":{"1min":0.23999999999999999,"5min":0.221,"15min":0.221},"max":{"1min":2.4049999999999998,"5min":10.901,"15min":10.901},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.97299999999999998,"5min":0.89100000000000001,"15min":0.93100000000000005},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":4.0789999999999997,"5min":5.9340000000000002,"15min":13.784000000000001},"last":0.32200000000000001}]},{"osd":1,"last update":"Sun Oct 8 13:43:08 2023","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.625,"15min":1.0109999999999999},"min":{"1min":0.30199999999999999,"5min":0.25800000000000001,"15min":0.252},"max":{"1min":0.89100000000000001,"5min":4.1950000000000003,"15min":24.826000000000001},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.753,"5min":1.0149999999999999,"15min":1.302},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":2.4820000000000002,"5min":9.0609999999999999,"15min":34.645000000000003},"last":0.42999999999999999}]},{"osd":3,"last update":"Sun Oct 8 13:43:08 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.81999999999999995,"15min":1.1539999999999999},"min":{"1min":0.30399999999999999,"5min":0.29399999999999998,"15min":0.28299999999999997},"max":{"1min":1.042,"5min":5.0800000000000001,"15min":24.867000000000001},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.98199999999999998,"5min":1.2589999999999999,"15min":1.288},"min":{"1min":0.35599999999999998,"5min":0.29599999999999999,"15min":0.27200000000000002},"max":{"1min":3.9169999999999998,"5min":9.1880000000000006,"15min":25.219000000000001},"last":0.66800000000000004}]},{"osd":4,"last update":"Sun Oct 8 13:43:08 2023","interfaces":[{"interface":"back","average":{"1min":1.351,"5min":1.2470000000000001,"15min":1.196},"min":{"1min":0.40500000000000003,"5min":0.35099999999999998,"15min":0.33700000000000002},"max":{"1min":6.9779999999999998,"5min":10.451000000000001,"15min":10.451000000000001},"last":3.1269999999999998},{"interface":"front","average":{"1min":0.71499999999999997,"5min":1.1220000000000001,"15min":1.087},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36199999999999999},"max":{"1min":2.5270000000000001,"5min":7.4429999999999996,"15min":8.4789999999999992},"last":5.0270000000000001}]},{"osd":5,"last update":"Sun Oct 8 13:43:08 2023","interfaces":[{"interface":"back","average":{"1min":1.323,"5min":1.4159999999999999,"15min":1.284},"min":{"1min":0.38400000000000001,"5min":0.376,"15min":0.376},"max":{"1min":6.258,"5min":11.327999999999999,"15min":11.327999999999999},"last":3.1419999999999999},{"interface":"front","average":{"1min":1.0149999999999999,"5min":1.159,"15min":1.2130000000000001},"min":{"1min":0.45200000000000001,"5min":0.39000000000000001,"15min":0.377},"max":{"1min":4.0209999999999999,"5min":11.901999999999999,"15min":13.888999999999999},"last":0.63300000000000001}]},{"osd":6,"last update":"Sun Oct 8 13:43:08 2023","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.84399999999999997,"15min":1.3},"min":{"1min":0.44500000000000001,"5min":0.436,"15min":0.41099999999999998},"max":{"1min":3.976,"5min":5.8150000000000004,"15min":13.939},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.78400000000000003,"5min":1.538,"15min":1.448},"min":{"1min":0.44,"5min":0.39500000000000002,"15min":0.373},"max":{"1min":2.6970000000000001,"5min":11.553000000000001,"15min":12.218999999999999},"last":0.76700000000000002}]},{"osd":7,"last update":"Sun Oct 8 13:43:08 2023","interfaces":[{"interface":"back","average":{"1min":1.0609999999999999,"5min":1.3180000000000001,"15min":1.3080000000000001},"min":{"1min":0.436,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":4.3739999999999997,"5min":8.8740000000000006,"15min":8.8740000000000006},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.88300000000000001,"5min":1.2010000000000001,"15min":1.3979999999999999},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.439},"max":{"1min":4.0519999999999996,"5min":7.8220000000000001,"15min":13.997},"last":0.74099999999999999}]}]},{"osd":1,"up_from":15,"seq":64424514887,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7907892,"kb_used_data":6382888,"kb_used_omap":1388,"kb_used_meta":1523603,"kb_avail":86463948,"statfs":{"total":96636764160,"available":88539082752,"internally_reserved":0,"allocated":6536077312,"data_stored":6522589839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1421431,"internal_metadata":1560170377},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1],"upper_bound":4},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 13:43:12 2023","interfaces":[{"interface":"back","average":{"1min":1.4850000000000001,"5min":0.78300000000000003,"15min":0.82299999999999995},"min":{"1min":0.25800000000000001,"5min":0.24099999999999999,"15min":0.217},"max":{"1min":7.1760000000000002,"5min":7.1760000000000002,"15min":13.361000000000001},"last":0.41099999999999998},{"interface":"front","average":{"1min":1.4099999999999999,"5min":0.84699999999999998,"15min":1.002},"min":{"1min":0.34899999999999998,"5min":0.26300000000000001,"15min":0.25600000000000001},"max":{"1min":5.734,"5min":6.173,"15min":9.2110000000000003},"last":0.29099999999999998}]},{"osd":2,"last update":"Sun Oct 8 13:43:12 2023","interfaces":[{"interface":"back","average":{"1min":1.728,"5min":0.97999999999999998,"15min":0.94599999999999995},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.23799999999999999},"max":{"1min":10,"5min":10,"15min":13.401},"last":0.46800000000000003},{"interface":"front","average":{"1min":2.0609999999999999,"5min":1.075,"15min":1.0960000000000001},"min":{"1min":0.27200000000000002,"5min":0.254,"15min":0.252},"max":{"1min":7.1189999999999998,"5min":7.1189999999999998,"15min":9.327},"last":0.38300000000000001}]},{"osd":3,"last update":"Sun Oct 8 13:43:12 2023","interfaces":[{"interface":"back","average":{"1min":1.4019999999999999,"5min":0.873,"15min":1.079},"min":{"1min":0.316,"5min":0.29499999999999998,"15min":0.27300000000000002},"max":{"1min":6.2329999999999997,"5min":6.2359999999999998,"15min":9.2750000000000004},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.92600000000000005,"5min":1.0760000000000001,"15min":1.1419999999999999},"min":{"1min":0.39300000000000002,"5min":0.27100000000000002,"15min":0.26800000000000002},"max":{"1min":4.6139999999999999,"5min":6.0590000000000002,"15min":13.012},"last":0.71799999999999997}]},{"osd":4,"last update":"Sun Oct 8 13:43:12 2023","interfaces":[{"interface":"back","average":{"1min":1.6910000000000001,"5min":1.3100000000000001,"15min":1.252},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.32400000000000001},"max":{"1min":7.2649999999999997,"5min":7.2649999999999997,"15min":13.443},"last":0.70199999999999996},{"interface":"front","average":{"1min":1.546,"5min":1.1799999999999999,"15min":1.2010000000000001},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38400000000000001},"max":{"1min":5.8479999999999999,"5min":6.3159999999999998,"15min":9.3859999999999992},"last":0.44500000000000001}]},{"osd":5,"last update":"Sun Oct 8 13:43:12 2023","interfaces":[{"interface":"back","average":{"1min":1.583,"5min":1.2829999999999999,"15min":1.242},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":5.3490000000000002,"5min":6.1109999999999998,"15min":6.1109999999999998},"last":0.81000000000000005},{"interface":"front","average":{"1min":1.8240000000000001,"5min":1.2090000000000001,"15min":1.3260000000000001},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.35299999999999998},"max":{"1min":7.2409999999999997,"5min":7.2409999999999997,"15min":13.468},"last":0.79600000000000004}]},{"osd":6,"last update":"Sun Oct 8 13:43:12 2023","interfaces":[{"interface":"back","average":{"1min":1.036,"5min":1.518,"15min":1.492},"min":{"1min":0.47299999999999998,"5min":0.40799999999999997,"15min":0.39200000000000002},"max":{"1min":4.7400000000000002,"5min":10.125,"15min":12.266},"last":4.2510000000000003},{"interface":"front","average":{"1min":2.3439999999999999,"5min":1.573,"15min":1.476},"min":{"1min":0.47799999999999998,"5min":0.40899999999999997,"15min":0.40200000000000002},"max":{"1min":7.2850000000000001,"5min":7.2850000000000001,"15min":13.489000000000001},"last":0.745}]},{"osd":7,"last update":"Sun Oct 8 13:43:12 2023","interfaces":[{"interface":"back","average":{"1min":1.605,"5min":1.2310000000000001,"15min":1.413},"min":{"1min":0.54900000000000004,"5min":0.441,"15min":0.36199999999999999},"max":{"1min":5.8920000000000003,"5min":6.3780000000000001,"15min":9.4870000000000001},"last":0.51500000000000001},{"interface":"front","average":{"1min":1.054,"5min":1.5640000000000001,"15min":1.6040000000000001},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.437},"max":{"1min":4.7750000000000004,"5min":7.9260000000000002,"15min":12.263999999999999},"last":0.84999999999999998}]}]},{"osd":0,"up_from":15,"seq":64424514892,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5680708,"kb_used_data":4256376,"kb_used_omap":266,"kb_used_meta":1424053,"kb_avail":88691132,"statfs":{"total":96636764160,"available":90819719168,"internally_reserved":0,"allocated":4358529024,"data_stored":4349893931,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":272932,"internal_metadata":1458230748},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,1,1],"upper_bound":32},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 13:43:40 2023","interfaces":[{"interface":"back","average":{"1min":1.0680000000000001,"5min":1.0409999999999999,"15min":0.93400000000000005},"min":{"1min":0.25800000000000001,"5min":0.249,"15min":0.218},"max":{"1min":5.3979999999999997,"5min":8.1850000000000005,"15min":8.1850000000000005},"last":0.33000000000000002},{"interface":"front","average":{"1min":1.1259999999999999,"5min":1.0049999999999999,"15min":0.99399999999999999},"min":{"1min":0.27600000000000002,"5min":0.22,"15min":0.22},"max":{"1min":4.5419999999999998,"5min":11.153,"15min":11.153},"last":0.38900000000000001}]},{"osd":2,"last update":"Sun Oct 8 13:43:40 2023","interfaces":[{"interface":"back","average":{"1min":1.2370000000000001,"5min":1.0509999999999999,"15min":0.96099999999999997},"min":{"1min":0.31,"5min":0.25600000000000001,"15min":0.248},"max":{"1min":7.5670000000000002,"5min":8.891,"15min":10.115},"last":0.374},{"interface":"front","average":{"1min":1.5860000000000001,"5min":1.1910000000000001,"15min":1.0820000000000001},"min":{"1min":0.30099999999999999,"5min":0.25900000000000001,"15min":0.245},"max":{"1min":8.5069999999999997,"5min":8.5069999999999997,"15min":8.5069999999999997},"last":0.44800000000000001}]},{"osd":3,"last update":"Sun Oct 8 13:43:40 2023","interfaces":[{"interface":"back","average":{"1min":1.4670000000000001,"5min":1,"15min":1.1919999999999999},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.26200000000000001},"max":{"1min":6.9420000000000002,"5min":7.4400000000000004,"15min":7.4400000000000004},"last":0.85099999999999998},{"interface":"front","average":{"1min":1.9630000000000001,"5min":1.391,"15min":1.097},"min":{"1min":0.41299999999999998,"5min":0.33800000000000002,"15min":0.26900000000000002},"max":{"1min":7.4370000000000003,"5min":10.798,"15min":10.798},"last":0.72399999999999998}]},{"osd":4,"last update":"Sun Oct 8 13:43:40 2023","interfaces":[{"interface":"back","average":{"1min":1.349,"5min":1.111,"15min":1.2490000000000001},"min":{"1min":0.36099999999999999,"5min":0.34999999999999998,"15min":0.34399999999999997},"max":{"1min":6.9889999999999999,"5min":7.4930000000000003,"15min":7.4930000000000003},"last":0.65000000000000002},{"interface":"front","average":{"1min":1.6259999999999999,"5min":1.228,"15min":1.077},"min":{"1min":0.504,"5min":0.38700000000000001,"15min":0.35299999999999998},"max":{"1min":5.3460000000000001,"5min":8.077,"15min":8.077},"last":0.79500000000000004}]},{"osd":5,"last update":"Sun Oct 8 13:43:40 2023","interfaces":[{"interface":"back","average":{"1min":1.232,"5min":1.157,"15min":1.115},"min":{"1min":0.40100000000000002,"5min":0.37,"15min":0.36099999999999999},"max":{"1min":4.6340000000000003,"5min":5.5229999999999997,"15min":7.3940000000000001},"last":0.53400000000000003},{"interface":"front","average":{"1min":1.2629999999999999,"5min":1.1899999999999999,"15min":1.3049999999999999},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.377},"max":{"1min":7.0650000000000004,"5min":8.2750000000000004,"15min":8.2750000000000004},"last":0.69199999999999995}]},{"osd":6,"last update":"Sun Oct 8 13:43:40 2023","interfaces":[{"interface":"back","average":{"1min":2.375,"5min":1.6499999999999999,"15min":1.339},"min":{"1min":0.55900000000000005,"5min":0.42499999999999999,"15min":0.36499999999999999},"max":{"1min":7.5739999999999998,"5min":8.0289999999999999,"15min":8.0289999999999999},"last":0.76400000000000001},{"interface":"front","average":{"1min":1.2589999999999999,"5min":1.2130000000000001,"15min":1.196},"min":{"1min":0.44400000000000001,"5min":0.42999999999999999,"15min":0.40799999999999997},"max":{"1min":4.6689999999999996,"5min":5.8419999999999996,"15min":10.696},"last":0.73799999999999999}]},{"osd":7,"last update":"Sun Oct 8 13:43:40 2023","interfaces":[{"interface":"back","average":{"1min":1.706,"5min":1.1990000000000001,"15min":1.161},"min":{"1min":0.47299999999999998,"5min":0.42899999999999999,"15min":0.40500000000000003},"max":{"1min":7.4420000000000002,"5min":7.4420000000000002,"15min":7.4420000000000002},"last":0.77900000000000003},{"interface":"front","average":{"1min":1.5249999999999999,"5min":1.323,"15min":1.4239999999999999},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":7.0270000000000001,"5min":7.5549999999999997,"15min":9.298},"last":0.81299999999999994}]}]},{"osd":3,"up_from":14,"seq":60129547586,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7764528,"kb_used_data":6531812,"kb_used_omap":1048,"kb_used_meta":1231655,"kb_avail":86607312,"statfs":{"total":96636764160,"available":88685887488,"internally_reserved":0,"allocated":6688575488,"data_stored":6674964259,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1073246,"internal_metadata":1261215650},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,2],"upper_bound":16},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 13:43:18 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.72199999999999998,"15min":0.72899999999999998},"min":{"1min":0.26300000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":4.3200000000000003,"5min":6.8760000000000003,"15min":10.003},"last":2.5369999999999999},{"interface":"front","average":{"1min":1.343,"5min":1.0740000000000001,"15min":0.96599999999999997},"min":{"1min":0.26400000000000001,"5min":0.245,"15min":0.245},"max":{"1min":8.5559999999999992,"5min":8.5559999999999992,"15min":10.115},"last":0.29999999999999999}]},{"osd":1,"last update":"Sun Oct 8 13:43:18 2023","interfaces":[{"interface":"back","average":{"1min":1.1000000000000001,"5min":1.052,"15min":1.0269999999999999},"min":{"1min":0.315,"5min":0.26500000000000001,"15min":0.251},"max":{"1min":9.7219999999999995,"5min":10.757,"15min":10.757},"last":2.6110000000000002},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.99399999999999999,"15min":0.93100000000000005},"min":{"1min":0.29399999999999998,"5min":0.27300000000000002,"15min":0.26000000000000001},"max":{"1min":3.9289999999999998,"5min":6.8280000000000003,"15min":6.9560000000000004},"last":0.627}]},{"osd":2,"last update":"Sun Oct 8 13:43:18 2023","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":1.2050000000000001,"15min":1.0860000000000001},"min":{"1min":0.29499999999999998,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":4.7930000000000001,"5min":10.813000000000001,"15min":10.813000000000001},"last":3.2999999999999998},{"interface":"front","average":{"1min":0.626,"5min":1.0389999999999999,"15min":0.94799999999999995},"min":{"1min":0.32300000000000001,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":1.496,"5min":7.1760000000000002,"15min":7.1760000000000002},"last":0.40300000000000002}]},{"osd":4,"last update":"Sun Oct 8 13:43:18 2023","interfaces":[{"interface":"back","average":{"1min":1.288,"5min":0.99299999999999999,"15min":1.087},"min":{"1min":0.375,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":4.5579999999999998,"5min":5.1449999999999996,"15min":10.182},"last":0.42299999999999999},{"interface":"front","average":{"1min":1.4019999999999999,"5min":1.2689999999999999,"15min":1.1819999999999999},"min":{"1min":0.42099999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":5.9989999999999997,"5min":10.851000000000001,"15min":10.851000000000001},"last":2.6640000000000001}]},{"osd":5,"last update":"Sun Oct 8 13:43:18 2023","interfaces":[{"interface":"back","average":{"1min":1.474,"5min":1.413,"15min":1.292},"min":{"1min":0.38800000000000001,"5min":0.36899999999999999,"15min":0.35899999999999999},"max":{"1min":6.7880000000000003,"5min":10.885,"15min":10.885},"last":2.706},{"interface":"front","average":{"1min":1.111,"5min":1.1479999999999999,"15min":1.1659999999999999},"min":{"1min":0.38400000000000001,"5min":0.376,"15min":0.376},"max":{"1min":4.2000000000000002,"5min":6.9210000000000003,"15min":10.173999999999999},"last":0.68400000000000005}]},{"osd":6,"last update":"Sun Oct 8 13:43:18 2023","interfaces":[{"interface":"back","average":{"1min":1.2230000000000001,"5min":1.228,"15min":1.2310000000000001},"min":{"1min":0.46000000000000002,"5min":0.43099999999999999,"15min":0.42899999999999999},"max":{"1min":8.0519999999999996,"5min":8.0519999999999996,"15min":8.0519999999999996},"last":0.65700000000000003},{"interface":"front","average":{"1min":1.7350000000000001,"5min":1.1060000000000001,"15min":1.2589999999999999},"min":{"1min":0.48399999999999999,"5min":0.39600000000000002,"15min":0.379},"max":{"1min":7.8879999999999999,"5min":7.8879999999999999,"15min":12.263999999999999},"last":0.48499999999999999}]},{"osd":7,"last update":"Sun Oct 8 13:43:18 2023","interfaces":[{"interface":"back","average":{"1min":1.6240000000000001,"5min":1.2430000000000001,"15min":1.3029999999999999},"min":{"1min":0.49099999999999999,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":6.5010000000000003,"5min":7.5220000000000002,"15min":10.202999999999999},"last":0.53000000000000003},{"interface":"front","average":{"1min":1.413,"5min":1.3660000000000001,"15min":1.3109999999999999},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.42799999999999999},"max":{"1min":4.8319999999999999,"5min":10.952,"15min":10.952},"last":2.7469999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T13:43:54.938 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-10-08T13:43:54.939 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T13:43:55.278 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:55.273+0000 7f105759e700 1 Processor -- start 2023-10-08T13:43:55.285 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:55.281+0000 7f105759e700 1 -- start start 2023-10-08T13:43:55.286 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:55.281+0000 7f105759e700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f10580703c0 0x7f10580ce0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:43:55.287 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:55.281+0000 7f105759e700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f105806dfc0 con 0x7f10580adfc0 2023-10-08T13:43:55.287 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:55.281+0000 7f105759e700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f105815e800 con 0x7f105815d600 2023-10-08T13:43:55.287 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:55.281+0000 7f105759e700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10580ade50 con 0x7f10580703c0 2023-10-08T13:43:55.288 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:55.281+0000 7f1056d9d700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f10580adfc0 0x7f10580ac8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:37662/0 (socket says 172.21.15.32:37662) 2023-10-08T13:43:55.288 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:55.281+0000 7f1056d9d700 1 -- 172.21.15.32:0/3857829586 learned_addr learned my addr 172.21.15.32:0/3857829586 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-08T13:43:55.288 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:55.281+0000 7f1055d9b700 1 --2- 172.21.15.32:0/3857829586 >> v2:172.21.15.32:3300/0 conn(0x7f10580703c0 0x7f10580ce0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:43:55.288 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:55.281+0000 7f1055d9b700 1 -- 172.21.15.32:0/3857829586 >> v1:172.21.15.40:6789/0 conn(0x7f105815d600 legacy=0x7f10580cd9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:43:55.288 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:55.281+0000 7f1055d9b700 1 -- 172.21.15.32:0/3857829586 >> v1:172.21.15.32:6789/0 conn(0x7f10580adfc0 legacy=0x7f10580ac8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:43:55.288 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:55.281+0000 7f1055d9b700 1 -- 172.21.15.32:0/3857829586 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f105806e260 con 0x7f10580703c0 2023-10-08T13:43:55.289 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:55.281+0000 7f1055d9b700 1 --2- 172.21.15.32:0/3857829586 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f10580703c0 0x7f10580ce0c0 secure :-1 s=READY pgs=1909 cs=0 l=1 rev1=1 crypto rx=0x7f1048009850 tx=0x7f1048009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aca2b9a32c0ad063 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:43:55.293 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:55.289+0000 7f105559a700 1 -- 172.21.15.32:0/3857829586 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1048010790 con 0x7f10580703c0 2023-10-08T13:43:55.294 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:55.289+0000 7f105559a700 1 -- 172.21.15.32:0/3857829586 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10480108f0 con 0x7f10580703c0 2023-10-08T13:43:55.294 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:55.289+0000 7f105559a700 1 -- 172.21.15.32:0/3857829586 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1048010ca0 con 0x7f10580703c0 2023-10-08T13:43:55.294 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:55.289+0000 7f105759e700 1 -- 172.21.15.32:0/3857829586 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f10580703c0 msgr2=0x7f10580ce0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:43:55.294 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:55.289+0000 7f105759e700 1 --2- 172.21.15.32:0/3857829586 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f10580703c0 0x7f10580ce0c0 secure :-1 s=READY pgs=1909 cs=0 l=1 rev1=1 crypto rx=0x7f1048009850 tx=0x7f1048009b60 comp rx=0 tx=0).stop 2023-10-08T13:43:55.295 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:55.289+0000 7f105759e700 1 -- 172.21.15.32:0/3857829586 shutdown_connections 2023-10-08T13:43:55.295 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:55.289+0000 7f105759e700 1 --2- 172.21.15.32:0/3857829586 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f10580703c0 0x7f10580ce0c0 unknown :-1 s=CLOSED pgs=1909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:55.296 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:55.289+0000 7f105759e700 1 -- 172.21.15.32:0/3857829586 >> 172.21.15.32:0/3857829586 conn(0x7f10580cb850 msgr2=0x7f10580cbc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:43:55.305 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:55.301+0000 7f105759e700 1 -- 172.21.15.32:0/3857829586 shutdown_connections 2023-10-08T13:43:55.306 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:55.301+0000 7f105759e700 1 -- 172.21.15.32:0/3857829586 wait complete. 2023-10-08T13:43:55.307 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:55.301+0000 7f105759e700 1 Processor -- start 2023-10-08T13:43:55.309 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:55.305+0000 7f105759e700 1 -- start start 2023-10-08T13:43:55.311 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:55.305+0000 7f105759e700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f10580703c0 0x7f1058157bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:43:55.311 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:55.305+0000 7f105759e700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f10580adfc0 0x7f1058155c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:43:55.311 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:55.305+0000 7f105759e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f105815d600 0x7f1058158940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:43:55.311 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:55.305+0000 7f105759e700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10580c5160 con 0x7f10580adfc0 2023-10-08T13:43:55.312 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:55.305+0000 7f105759e700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10580c4cd0 con 0x7f10580703c0 2023-10-08T13:43:55.312 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:55.305+0000 7f105759e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10581581b0 con 0x7f105815d600 2023-10-08T13:43:55.312 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:55.305+0000 7f1055d9b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f10580adfc0 0x7f1058155c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:43:55.312 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:55.305+0000 7f1055d9b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f10580adfc0 0x7f1058155c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:52994/0 (socket says 172.21.15.32:52994) 2023-10-08T13:43:55.312 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:55.305+0000 7f1055d9b700 1 -- 172.21.15.32:0/2702004886 learned_addr learned my addr 172.21.15.32:0/2702004886 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T13:43:55.313 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:55.305+0000 7f1055d9b700 1 -- 172.21.15.32:0/2702004886 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f105815d600 msgr2=0x7f1058158940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:43:55.313 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:55.305+0000 7f1055d9b700 1 --2- 172.21.15.32:0/2702004886 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f105815d600 0x7f1058158940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:55.313 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:55.305+0000 7f1055d9b700 1 -- 172.21.15.32:0/2702004886 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f10580703c0 msgr2=0x7f1058157bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:43:55.313 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:55.305+0000 7f1055d9b700 1 --2- 172.21.15.32:0/2702004886 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f10580703c0 0x7f1058157bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:55.314 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:55.305+0000 7f1055d9b700 1 -- 172.21.15.32:0/2702004886 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10480094b0 con 0x7f10580adfc0 2023-10-08T13:43:55.314 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:55.305+0000 7f1055d9b700 1 --2- 172.21.15.32:0/2702004886 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f10580adfc0 0x7f1058155c60 secure :-1 s=READY pgs=1910 cs=0 l=1 rev1=1 crypto rx=0x7f1048012000 tx=0x7f1048004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:43:55.317 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:55.313+0000 7f1046ffd700 1 -- 172.21.15.32:0/2702004886 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1048004240 con 0x7f10580adfc0 2023-10-08T13:43:55.318 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:55.313+0000 7f105759e700 1 -- 172.21.15.32:0/2702004886 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10580c4680 con 0x7f10580adfc0 2023-10-08T13:43:55.318 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:55.313+0000 7f105759e700 1 -- 172.21.15.32:0/2702004886 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1058158e80 con 0x7f10580adfc0 2023-10-08T13:43:55.319 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:55.313+0000 7f1046ffd700 1 -- 172.21.15.32:0/2702004886 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f104801f070 con 0x7f10580adfc0 2023-10-08T13:43:55.319 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:55.313+0000 7f1046ffd700 1 -- 172.21.15.32:0/2702004886 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1048004600 con 0x7f10580adfc0 2023-10-08T13:43:55.325 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:55.321+0000 7f1046ffd700 1 -- 172.21.15.32:0/2702004886 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f1048021030 con 0x7f10580adfc0 2023-10-08T13:43:55.326 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:55.321+0000 7f1046ffd700 1 --2- 172.21.15.32:0/2702004886 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f1040066770 0x7f1040068c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:43:55.326 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:55.321+0000 7f105659c700 1 --2- 172.21.15.32:0/2702004886 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f1040066770 0x7f1040068c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:43:55.327 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:55.321+0000 7f1046ffd700 1 -- 172.21.15.32:0/2702004886 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f10480853c0 con 0x7f10580adfc0 2023-10-08T13:43:55.327 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:55.321+0000 7f105659c700 1 --2- 172.21.15.32:0/2702004886 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f1040066770 0x7f1040068c30 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f10500012e0 tx=0x7f1050001850 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:43:55.341 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:55.333+0000 7f105759e700 1 -- 172.21.15.32:0/2702004886 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f103c005310 con 0x7f10580adfc0 2023-10-08T13:43:55.350 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:55.345+0000 7f1046ffd700 1 -- 172.21.15.32:0/2702004886 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f1048051cf0 con 0x7f10580adfc0 2023-10-08T13:43:55.740 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:55.733+0000 7f105759e700 1 -- 172.21.15.32:0/2702004886 --> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f103c005310 con 0x7f1040066770 2023-10-08T13:43:55.749 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:55.737+0000 7f1046ffd700 1 -- 172.21.15.32:0/2702004886 <== mgr.4107 v2:172.21.15.32:6832/2601628338 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+49549 (secure 0 0 0) 0x7f103c005310 con 0x7f1040066770 2023-10-08T13:43:55.752 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T13:43:55.758 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:55.741+0000 7f1044ff9700 1 -- 172.21.15.32:0/2702004886 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f1040066770 msgr2=0x7f1040068c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:43:55.759 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:55.741+0000 7f1044ff9700 1 --2- 172.21.15.32:0/2702004886 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f1040066770 0x7f1040068c30 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f10500012e0 tx=0x7f1050001850 comp rx=0 tx=0).stop 2023-10-08T13:43:55.759 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:55.741+0000 7f1044ff9700 1 -- 172.21.15.32:0/2702004886 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f10580adfc0 msgr2=0x7f1058155c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:43:55.759 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:55.741+0000 7f1044ff9700 1 --2- 172.21.15.32:0/2702004886 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f10580adfc0 0x7f1058155c60 secure :-1 s=READY pgs=1910 cs=0 l=1 rev1=1 crypto rx=0x7f1048012000 tx=0x7f1048004770 comp rx=0 tx=0).stop 2023-10-08T13:43:55.759 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:55.741+0000 7f1044ff9700 1 -- 172.21.15.32:0/2702004886 shutdown_connections 2023-10-08T13:43:55.759 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:55.741+0000 7f1044ff9700 1 --2- 172.21.15.32:0/2702004886 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f1040066770 0x7f1040068c30 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:55.760 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:55.741+0000 7f1044ff9700 1 --2- 172.21.15.32:0/2702004886 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f10580adfc0 0x7f1058155c60 secure :-1 s=CLOSED pgs=1910 cs=0 l=1 rev1=1 crypto rx=0x7f1048012000 tx=0x7f1048004770 comp rx=0 tx=0).stop 2023-10-08T13:43:55.760 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:55.741+0000 7f1044ff9700 1 --2- 172.21.15.32:0/2702004886 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f105815d600 0x7f1058158940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:55.760 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:55.741+0000 7f1044ff9700 1 --2- 172.21.15.32:0/2702004886 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f10580703c0 0x7f1058157bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:55.760 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:55.741+0000 7f1044ff9700 1 -- 172.21.15.32:0/2702004886 >> 172.21.15.32:0/2702004886 conn(0x7f10580cb850 msgr2=0x7f10580ccd20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:43:55.760 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:55.741+0000 7f1044ff9700 1 -- 172.21.15.32:0/2702004886 shutdown_connections 2023-10-08T13:43:55.761 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:55.741+0000 7f1044ff9700 1 -- 172.21.15.32:0/2702004886 wait complete. 2023-10-08T13:43:55.761 INFO:teuthology.orchestra.run.smithi032.stderr:dumped all 2023-10-08T13:43:55.772 INFO:teuthology.orchestra.run.smithi032.stdout:{"pg_ready":true,"pg_map":{"version":13663,"stamp":"2023-10-08T13:43:54.951177+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":191,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":48224436,"kb_used_data":35307920,"kb_used_omap":4346,"kb_used_meta":12507717,"kb_avail":706750284,"statfs":{"total":773094113280,"available":723712290816,"internally_reserved":0,"allocated":36155310080,"data_stored":36080288503,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4451158,"internal_metadata":12807902378},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,1,3,3],"upper_bound":32},"perf_stat":{"commit_latency_ms":295,"apply_latency_ms":295,"commit_latency_ns":295000000,"apply_latency_ns":295000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-42501861584,"num_objects":-35195,"num_object_clones":0,"num_object_copies":-70390,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-35195,"num_whiteouts":0,"num_read":-1718250,"num_read_kb":-122478048,"num_write":-7500803,"num_write_kb":-162332357,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-2520,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001534"},"pg_stats":[{"pgid":"1.0","version":"18'117","reported_seq":404,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-08T13:43:45.440473+0000","last_change":"2023-10-08T06:09:24.811692+0000","last_active":"2023-10-08T13:43:45.440473+0000","last_peered":"2023-10-08T13:43:45.440473+0000","last_clean":"2023-10-08T13:43:45.440473+0000","last_became_active":"2023-10-08T06:09:24.809788+0000","last_became_peered":"2023-10-08T06:09:24.809788+0000","last_unstale":"2023-10-08T13:43:45.440473+0000","last_undegraded":"2023-10-08T13:43:45.440473+0000","last_fullsized":"2023-10-08T13:43:45.440473+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:23.748736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:23.748736+0000","last_clean_scrub_stamp":"2023-10-08T06:09:23.748736+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:39:45.599458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424514894,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7189700,"kb_used_data":5727928,"kb_used_omap":148,"kb_used_meta":1461611,"kb_avail":87182140,"statfs":{"total":96636764160,"available":89274511360,"internally_reserved":0,"allocated":5865398272,"data_stored":5853276085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":152224,"internal_metadata":1496690016},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1],"upper_bound":8},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 13:42:58 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.69299999999999995,"15min":0.78100000000000003},"min":{"1min":0.29299999999999998,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":2.6720000000000002,"5min":5.484,"15min":11.773},"last":0.47799999999999998},{"interface":"front","average":{"1min":1.5549999999999999,"5min":1.1830000000000001,"15min":1.141},"min":{"1min":0.315,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":8.8859999999999992,"5min":8.8859999999999992,"15min":8.8859999999999992},"last":0.504}]},{"osd":1,"last update":"Sun Oct 8 13:42:58 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.90500000000000003,"15min":0.94299999999999995},"min":{"1min":0.29799999999999999,"5min":0.29299999999999998,"15min":0.27500000000000002},"max":{"1min":2.6989999999999998,"5min":6.8970000000000002,"15min":11.943},"last":0.42299999999999999},{"interface":"front","average":{"1min":1.611,"5min":1.2410000000000001,"15min":1.218},"min":{"1min":0.378,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":8.7330000000000005,"5min":8.7330000000000005,"15min":8.7330000000000005},"last":0.45700000000000002}]},{"osd":2,"last update":"Sun Oct 8 13:42:58 2023","interfaces":[{"interface":"back","average":{"1min":1.976,"5min":1.4510000000000001,"15min":1.2729999999999999},"min":{"1min":0.41299999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":8.8559999999999999,"5min":8.8559999999999999,"15min":8.8559999999999999},"last":0.39700000000000002},{"interface":"front","average":{"1min":1.7729999999999999,"5min":1.1859999999999999,"15min":1.2929999999999999},"min":{"1min":0.35999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":9,"5min":9,"15min":9},"last":0.625}]},{"osd":3,"last update":"Sun Oct 8 13:42:58 2023","interfaces":[{"interface":"back","average":{"1min":4.181,"5min":1.8480000000000001,"15min":1.3740000000000001},"min":{"1min":0.40200000000000002,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":32.707000000000001,"5min":32.707000000000001,"15min":32.707000000000001},"last":0.55600000000000005},{"interface":"front","average":{"1min":3.5870000000000002,"5min":2.1040000000000001,"15min":1.6519999999999999},"min":{"1min":0.438,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":30.983000000000001,"5min":30.983000000000001,"15min":30.983000000000001},"last":0.57199999999999995}]},{"osd":4,"last update":"Sun Oct 8 13:42:58 2023","interfaces":[{"interface":"back","average":{"1min":1.357,"5min":1.1519999999999999,"15min":1.3240000000000001},"min":{"1min":0.32200000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":8.9220000000000006,"5min":9.3499999999999996,"15min":11.516},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.86799999999999999,"15min":1.177},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":2.6000000000000001,"5min":5.6820000000000004,"15min":11.907},"last":0.59399999999999997}]},{"osd":5,"last update":"Sun Oct 8 13:42:58 2023","interfaces":[{"interface":"back","average":{"1min":1.663,"5min":1.2609999999999999,"15min":1.3260000000000001},"min":{"1min":0.41599999999999998,"5min":0.379,"15min":0.32700000000000001},"max":{"1min":8.8239999999999998,"5min":13.045999999999999,"15min":13.045999999999999},"last":0.871},{"interface":"front","average":{"1min":1.9199999999999999,"5min":1.3260000000000001,"15min":1.4810000000000001},"min":{"1min":0.38600000000000001,"5min":0.373,"15min":0.36799999999999999},"max":{"1min":9.0299999999999994,"5min":9.0299999999999994,"15min":11.547000000000001},"last":0.90600000000000003}]},{"osd":6,"last update":"Sun Oct 8 13:42:58 2023","interfaces":[{"interface":"back","average":{"1min":1.909,"5min":1.3799999999999999,"15min":1.536},"min":{"1min":0.42599999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":8.9629999999999992,"5min":8.9629999999999992,"15min":11.567},"last":0.94799999999999995},{"interface":"front","average":{"1min":1.2470000000000001,"5min":1.0669999999999999,"15min":1.1779999999999999},"min":{"1min":0.45100000000000001,"5min":0.41399999999999998,"15min":0.33600000000000002},"max":{"1min":4.9939999999999998,"5min":6.5910000000000002,"15min":11.827},"last":0.66200000000000003}]}]},{"osd":6,"up_from":15,"seq":64424514897,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4982688,"kb_used_data":3172532,"kb_used_omap":546,"kb_used_meta":1712221,"kb_avail":89389152,"statfs":{"total":96636764160,"available":91534491648,"internally_reserved":0,"allocated":3248672768,"data_stored":3242027103,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":559457,"internal_metadata":1753314975},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":79,"apply_latency_ms":79,"commit_latency_ns":79000000,"apply_latency_ns":79000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 13:43:41 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.59199999999999997,"15min":0.77600000000000002},"min":{"1min":0.34499999999999997,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.79300000000000004,"5min":6.5910000000000002,"15min":8.3569999999999993},"last":1.196},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.82299999999999995,"15min":0.95099999999999996},"min":{"1min":0.35399999999999998,"5min":0.318,"15min":0.28199999999999997},"max":{"1min":0.872,"5min":6.5789999999999997,"15min":8.5980000000000008},"last":1.0820000000000001}]},{"osd":1,"last update":"Sun Oct 8 13:43:41 2023","interfaces":[{"interface":"back","average":{"1min":1.077,"5min":1.127,"15min":1.24},"min":{"1min":0.34200000000000003,"5min":0.29299999999999998,"15min":0.28699999999999998},"max":{"1min":4.2110000000000003,"5min":6.4029999999999996,"15min":8.8900000000000006},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.83999999999999997,"15min":0.93000000000000005},"min":{"1min":0.34399999999999997,"5min":0.29699999999999999,"15min":0.27700000000000002},"max":{"1min":1.0269999999999999,"5min":7.1260000000000003,"15min":8.4120000000000008},"last":1.103}]},{"osd":2,"last update":"Sun Oct 8 13:43:41 2023","interfaces":[{"interface":"back","average":{"1min":1.038,"5min":1.169,"15min":1.1319999999999999},"min":{"1min":0.40300000000000002,"5min":0.39800000000000002,"15min":0.318},"max":{"1min":4.0060000000000002,"5min":7.5510000000000002,"15min":8.4469999999999992},"last":1.046},{"interface":"front","average":{"1min":1.083,"5min":1.2330000000000001,"15min":1.2829999999999999},"min":{"1min":0.38,"5min":0.38,"15min":0.34899999999999998},"max":{"1min":7.6200000000000001,"5min":7.6200000000000001,"15min":8.3759999999999994},"last":0.88}]},{"osd":3,"last update":"Sun Oct 8 13:43:41 2023","interfaces":[{"interface":"back","average":{"1min":1.0940000000000001,"5min":1.498,"15min":1.3520000000000001},"min":{"1min":0.41399999999999998,"5min":0.40799999999999997,"15min":0.36599999999999999},"max":{"1min":7.673,"5min":11.715999999999999,"15min":11.715999999999999},"last":1.129},{"interface":"front","average":{"1min":1.3009999999999999,"5min":1.504,"15min":1.52},"min":{"1min":0.51800000000000002,"5min":0.373,"15min":0.35299999999999998},"max":{"1min":4.3079999999999998,"5min":10.132999999999999,"15min":10.369},"last":0.85599999999999998}]},{"osd":4,"last update":"Sun Oct 8 13:43:41 2023","interfaces":[{"interface":"back","average":{"1min":1.415,"5min":0.96099999999999997,"15min":1.0840000000000001},"min":{"1min":0.47499999999999998,"5min":0.34399999999999997,"15min":0.33800000000000002},"max":{"1min":6.46,"5min":6.7249999999999996,"15min":9.5},"last":1.329},{"interface":"front","average":{"1min":1.0600000000000001,"5min":1.1899999999999999,"15min":1.153},"min":{"1min":0.42999999999999999,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":6.3819999999999997,"5min":6.3819999999999997,"15min":8.2940000000000005},"last":0.98799999999999999}]},{"osd":5,"last update":"Sun Oct 8 13:43:41 2023","interfaces":[{"interface":"back","average":{"1min":1.9099999999999999,"5min":1.4770000000000001,"15min":1.4710000000000001},"min":{"1min":0.40300000000000002,"5min":0.32200000000000001,"15min":0.317},"max":{"1min":5.5339999999999998,"5min":6.3840000000000003,"15min":9.3930000000000007},"last":0.94899999999999995},{"interface":"front","average":{"1min":0.95699999999999996,"5min":0.89200000000000002,"15min":1.087},"min":{"1min":0.45800000000000002,"5min":0.376,"15min":0.376},"max":{"1min":3.4399999999999999,"5min":6.7560000000000002,"15min":10.087999999999999},"last":1.276}]},{"osd":7,"last update":"Sun Oct 8 13:43:41 2023","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":1.119,"15min":1.2649999999999999},"min":{"1min":0.54400000000000004,"5min":0.41599999999999998,"15min":0.39400000000000002},"max":{"1min":1.6719999999999999,"5min":6.0010000000000003,"15min":14.177},"last":1.244},{"interface":"front","average":{"1min":1.3620000000000001,"5min":1.3500000000000001,"15min":1.5860000000000001},"min":{"1min":0.58399999999999996,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":4.2859999999999996,"5min":6.6239999999999997,"15min":9.7579999999999991},"last":1.165}]}]},{"osd":5,"up_from":15,"seq":64424514893,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7666620,"kb_used_data":5837940,"kb_used_omap":249,"kb_used_meta":1803206,"kb_avail":86705220,"statfs":{"total":96636764160,"available":88786145280,"internally_reserved":0,"allocated":5978050560,"data_stored":5965948087,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":255902,"internal_metadata":1846483042},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 13:42:46 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.81000000000000005,"15min":0.80500000000000005},"min":{"1min":0.27300000000000002,"5min":0.26200000000000001,"15min":0.25900000000000001},"max":{"1min":2.081,"5min":5.2309999999999999,"15min":7.0830000000000002},"last":0.98199999999999998},{"interface":"front","average":{"1min":1.6639999999999999,"5min":1.024,"15min":0.83699999999999997},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":11.331,"5min":11.331,"15min":11.331},"last":1.042}]},{"osd":1,"last update":"Sun Oct 8 13:42:46 2023","interfaces":[{"interface":"back","average":{"1min":1.0720000000000001,"5min":0.96999999999999997,"15min":1.0189999999999999},"min":{"1min":0.28699999999999998,"5min":0.28399999999999997,"15min":0.27600000000000002},"max":{"1min":4.5019999999999998,"5min":5.2670000000000003,"15min":10.523999999999999},"last":0.78000000000000003},{"interface":"front","average":{"1min":1.7390000000000001,"5min":1.198,"15min":1.0109999999999999},"min":{"1min":0.42799999999999999,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":11.425000000000001,"5min":11.425000000000001,"15min":11.425000000000001},"last":0.74099999999999999}]},{"osd":2,"last update":"Sun Oct 8 13:42:46 2023","interfaces":[{"interface":"back","average":{"1min":1.3859999999999999,"5min":1.262,"15min":1.236},"min":{"1min":0.32100000000000001,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":8.6069999999999993,"5min":12.236000000000001,"15min":12.236000000000001},"last":1.0940000000000001},{"interface":"front","average":{"1min":1.056,"5min":1.3380000000000001,"15min":1.226},"min":{"1min":0.41899999999999998,"5min":0.309,"15min":0.309},"max":{"1min":3.569,"5min":8.7119999999999997,"15min":10.577},"last":1.147}]},{"osd":3,"last update":"Sun Oct 8 13:42:46 2023","interfaces":[{"interface":"back","average":{"1min":1.7589999999999999,"5min":1.171,"15min":1.2569999999999999},"min":{"1min":0.38200000000000001,"5min":0.34100000000000003,"15min":0.313},"max":{"1min":11.49,"5min":11.49,"15min":11.49},"last":0.90300000000000002},{"interface":"front","average":{"1min":1.4890000000000001,"5min":1.462,"15min":1.2989999999999999},"min":{"1min":0.41699999999999998,"5min":0.34399999999999997,"15min":0.34200000000000003},"max":{"1min":8.641,"5min":12.289999999999999,"15min":12.289999999999999},"last":1.2430000000000001}]},{"osd":4,"last update":"Sun Oct 8 13:42:46 2023","interfaces":[{"interface":"back","average":{"1min":1.1160000000000001,"5min":1.0589999999999999,"15min":0.91400000000000003},"min":{"1min":0.33100000000000002,"5min":0.32500000000000001,"15min":0.30599999999999999},"max":{"1min":5.3789999999999996,"5min":5.3789999999999996,"15min":7.1520000000000001},"last":1.304},{"interface":"front","average":{"1min":2.1909999999999998,"5min":1.4399999999999999,"15min":1.071},"min":{"1min":0.439,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":11.457000000000001,"5min":11.457000000000001,"15min":11.457000000000001},"last":1.1919999999999999}]},{"osd":6,"last update":"Sun Oct 8 13:42:46 2023","interfaces":[{"interface":"back","average":{"1min":1.4510000000000001,"5min":1.605,"15min":1.3320000000000001},"min":{"1min":0.435,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":8.5600000000000005,"5min":12.329000000000001,"15min":12.329000000000001},"last":0.94099999999999995},{"interface":"front","average":{"1min":1.034,"5min":1.1359999999999999,"15min":1.1419999999999999},"min":{"1min":0.40400000000000003,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":3.0030000000000001,"5min":6.6799999999999997,"15min":7.5259999999999998},"last":1.385}]},{"osd":7,"last update":"Sun Oct 8 13:42:46 2023","interfaces":[{"interface":"back","average":{"1min":2.2879999999999998,"5min":1.399,"15min":1.232},"min":{"1min":0.40200000000000002,"5min":0.39300000000000002,"15min":0.38200000000000001},"max":{"1min":11.388999999999999,"5min":11.388999999999999,"15min":11.388999999999999},"last":1.3480000000000001},{"interface":"front","average":{"1min":1.359,"5min":1.673,"15min":1.4410000000000001},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":8.7460000000000004,"5min":17.481999999999999,"15min":17.481999999999999},"last":1.413}]}]},{"osd":4,"up_from":15,"seq":64424514894,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":6688996,"kb_used_data":4849964,"kb_used_omap":353,"kb_used_meta":1753374,"kb_avail":87682844,"statfs":{"total":96636764160,"available":89787232256,"internally_reserved":0,"allocated":4966363136,"data_stored":4955163299,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":361854,"internal_metadata":1795455618},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 13:43:22 2023","interfaces":[{"interface":"back","average":{"1min":1.28,"5min":1.3140000000000001,"15min":1.2410000000000001},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":5.5220000000000002,"5min":6.585,"15min":6.585},"last":11.233000000000001},{"interface":"front","average":{"1min":1.0580000000000001,"5min":1.2450000000000001,"15min":0.95499999999999996},"min":{"1min":0.33800000000000002,"5min":0.30499999999999999,"15min":0.26100000000000001},"max":{"1min":5.3949999999999996,"5min":7.6559999999999997,"15min":7.6559999999999997},"last":11.061}]},{"osd":1,"last update":"Sun Oct 8 13:43:22 2023","interfaces":[{"interface":"back","average":{"1min":1.1910000000000001,"5min":1.1419999999999999,"15min":1.2},"min":{"1min":0.28599999999999998,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":5.0640000000000001,"5min":6.9219999999999997,"15min":10.321},"last":0.77700000000000002},{"interface":"front","average":{"1min":1.429,"5min":1.4530000000000001,"15min":1.45},"min":{"1min":0.42199999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":5.5659999999999998,"5min":7.0579999999999998,"15min":7.7009999999999996},"last":11.372}]},{"osd":2,"last update":"Sun Oct 8 13:43:22 2023","interfaces":[{"interface":"back","average":{"1min":1.075,"5min":1.8029999999999999,"15min":1.5149999999999999},"min":{"1min":0.33800000000000002,"5min":0.316,"15min":0.316},"max":{"1min":4.2080000000000002,"5min":42.488,"15min":42.488},"last":0.83299999999999996},{"interface":"front","average":{"1min":1.3600000000000001,"5min":1.855,"15min":1.6699999999999999},"min":{"1min":0.34100000000000003,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":5.5949999999999998,"5min":43.997999999999998,"15min":43.997999999999998},"last":11.282}]},{"osd":3,"last update":"Sun Oct 8 13:43:22 2023","interfaces":[{"interface":"back","average":{"1min":1.536,"5min":1.605,"15min":1.3520000000000001},"min":{"1min":0.374,"5min":0.35999999999999999,"15min":0.35899999999999999},"max":{"1min":5.4320000000000004,"5min":8.4339999999999993,"15min":8.4339999999999993},"last":11.214},{"interface":"front","average":{"1min":1.704,"5min":1.4550000000000001,"15min":1.4139999999999999},"min":{"1min":0.42799999999999999,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":5.2389999999999999,"5min":6.8380000000000001,"15min":10.433999999999999},"last":11.493}]},{"osd":5,"last update":"Sun Oct 8 13:43:22 2023","interfaces":[{"interface":"back","average":{"1min":1.75,"5min":1.3680000000000001,"15min":1.2549999999999999},"min":{"1min":0.38100000000000001,"5min":0.30499999999999999,"15min":0.29199999999999998},"max":{"1min":6.069,"5min":12.226000000000001,"15min":12.226000000000001},"last":11.460000000000001},{"interface":"front","average":{"1min":1.266,"5min":1.2350000000000001,"15min":1.0680000000000001},"min":{"1min":0.36099999999999999,"5min":0.32900000000000001,"15min":0.32600000000000001},"max":{"1min":5.3029999999999999,"5min":6.6769999999999996,"15min":6.6769999999999996},"last":11.17}]},{"osd":6,"last update":"Sun Oct 8 13:43:22 2023","interfaces":[{"interface":"back","average":{"1min":1.0740000000000001,"5min":1.222,"15min":1.304},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.36399999999999999},"max":{"1min":4.0110000000000001,"5min":5.8650000000000002,"15min":10.470000000000001},"last":0.89700000000000002},{"interface":"front","average":{"1min":1.5449999999999999,"5min":1.472,"15min":1.5029999999999999},"min":{"1min":0.44700000000000001,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":6.1180000000000003,"5min":9.4529999999999994,"15min":9.4529999999999994},"last":11.406000000000001}]},{"osd":7,"last update":"Sun Oct 8 13:43:22 2023","interfaces":[{"interface":"back","average":{"1min":1.2130000000000001,"5min":1.423,"15min":1.3220000000000001},"min":{"1min":0.37,"5min":0.37,"15min":0.34399999999999997},"max":{"1min":5.3570000000000002,"5min":11.946999999999999,"15min":11.946999999999999},"last":0.96099999999999997},{"interface":"front","average":{"1min":1.0920000000000001,"5min":1.208,"15min":1.395},"min":{"1min":0.51400000000000001,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":4.0970000000000004,"5min":5.7329999999999997,"15min":10.802},"last":0.871}]}]},{"osd":2,"up_from":15,"seq":64424514888,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5144728,"kb_used_data":3529740,"kb_used_omap":345,"kb_used_meta":1614630,"kb_avail":89227112,"statfs":{"total":96636764160,"available":91368562688,"internally_reserved":0,"allocated":3614453760,"data_stored":3607014900,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":354112,"internal_metadata":1653381312},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,0,0,2],"upper_bound":32},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 13:43:08 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.81200000000000006,"15min":0.73599999999999999},"min":{"1min":0.23999999999999999,"5min":0.221,"15min":0.221},"max":{"1min":2.4049999999999998,"5min":10.901,"15min":10.901},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.97299999999999998,"5min":0.89100000000000001,"15min":0.93100000000000005},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":4.0789999999999997,"5min":5.9340000000000002,"15min":13.784000000000001},"last":0.32200000000000001}]},{"osd":1,"last update":"Sun Oct 8 13:43:08 2023","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.625,"15min":1.0109999999999999},"min":{"1min":0.30199999999999999,"5min":0.25800000000000001,"15min":0.252},"max":{"1min":0.89100000000000001,"5min":4.1950000000000003,"15min":24.826000000000001},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.753,"5min":1.0149999999999999,"15min":1.302},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":2.4820000000000002,"5min":9.0609999999999999,"15min":34.645000000000003},"last":0.42999999999999999}]},{"osd":3,"last update":"Sun Oct 8 13:43:08 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.81999999999999995,"15min":1.1539999999999999},"min":{"1min":0.30399999999999999,"5min":0.29399999999999998,"15min":0.28299999999999997},"max":{"1min":1.042,"5min":5.0800000000000001,"15min":24.867000000000001},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.98199999999999998,"5min":1.2589999999999999,"15min":1.288},"min":{"1min":0.35599999999999998,"5min":0.29599999999999999,"15min":0.27200000000000002},"max":{"1min":3.9169999999999998,"5min":9.1880000000000006,"15min":25.219000000000001},"last":0.66800000000000004}]},{"osd":4,"last update":"Sun Oct 8 13:43:08 2023","interfaces":[{"interface":"back","average":{"1min":1.351,"5min":1.2470000000000001,"15min":1.196},"min":{"1min":0.40500000000000003,"5min":0.35099999999999998,"15min":0.33700000000000002},"max":{"1min":6.9779999999999998,"5min":10.451000000000001,"15min":10.451000000000001},"last":3.1269999999999998},{"interface":"front","average":{"1min":0.71499999999999997,"5min":1.1220000000000001,"15min":1.087},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36199999999999999},"max":{"1min":2.5270000000000001,"5min":7.4429999999999996,"15min":8.4789999999999992},"last":5.0270000000000001}]},{"osd":5,"last update":"Sun Oct 8 13:43:08 2023","interfaces":[{"interface":"back","average":{"1min":1.323,"5min":1.4159999999999999,"15min":1.284},"min":{"1min":0.38400000000000001,"5min":0.376,"15min":0.376},"max":{"1min":6.258,"5min":11.327999999999999,"15min":11.327999999999999},"last":3.1419999999999999},{"interface":"front","average":{"1min":1.0149999999999999,"5min":1.159,"15min":1.2130000000000001},"min":{"1min":0.45200000000000001,"5min":0.39000000000000001,"15min":0.377},"max":{"1min":4.0209999999999999,"5min":11.901999999999999,"15min":13.888999999999999},"last":0.63300000000000001}]},{"osd":6,"last update":"Sun Oct 8 13:43:08 2023","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.84399999999999997,"15min":1.3},"min":{"1min":0.44500000000000001,"5min":0.436,"15min":0.41099999999999998},"max":{"1min":3.976,"5min":5.8150000000000004,"15min":13.939},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.78400000000000003,"5min":1.538,"15min":1.448},"min":{"1min":0.44,"5min":0.39500000000000002,"15min":0.373},"max":{"1min":2.6970000000000001,"5min":11.553000000000001,"15min":12.218999999999999},"last":0.76700000000000002}]},{"osd":7,"last update":"Sun Oct 8 13:43:08 2023","interfaces":[{"interface":"back","average":{"1min":1.0609999999999999,"5min":1.3180000000000001,"15min":1.3080000000000001},"min":{"1min":0.436,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":4.3739999999999997,"5min":8.8740000000000006,"15min":8.8740000000000006},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.88300000000000001,"5min":1.2010000000000001,"15min":1.3979999999999999},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.439},"max":{"1min":4.0519999999999996,"5min":7.8220000000000001,"15min":13.997},"last":0.74099999999999999}]}]},{"osd":1,"up_from":15,"seq":64424514888,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":3106468,"kb_used_data":1401628,"kb_used_omap":1388,"kb_used_meta":1506963,"kb_avail":91265372,"statfs":{"total":96636764160,"available":93455740928,"internally_reserved":0,"allocated":1435267072,"data_stored":1432000839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1421431,"internal_metadata":1543131017},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":163,"apply_latency_ms":163,"commit_latency_ns":163000000,"apply_latency_ns":163000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 13:43:12 2023","interfaces":[{"interface":"back","average":{"1min":1.4850000000000001,"5min":0.78300000000000003,"15min":0.82299999999999995},"min":{"1min":0.25800000000000001,"5min":0.24099999999999999,"15min":0.217},"max":{"1min":7.1760000000000002,"5min":7.1760000000000002,"15min":13.361000000000001},"last":0.625},{"interface":"front","average":{"1min":1.4099999999999999,"5min":0.84699999999999998,"15min":1.002},"min":{"1min":0.34899999999999998,"5min":0.26300000000000001,"15min":0.25600000000000001},"max":{"1min":5.734,"5min":6.173,"15min":9.2110000000000003},"last":5.3849999999999998}]},{"osd":2,"last update":"Sun Oct 8 13:43:12 2023","interfaces":[{"interface":"back","average":{"1min":1.728,"5min":0.97999999999999998,"15min":0.94599999999999995},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.23799999999999999},"max":{"1min":10,"5min":10,"15min":13.401},"last":0.84799999999999998},{"interface":"front","average":{"1min":2.0609999999999999,"5min":1.075,"15min":1.0960000000000001},"min":{"1min":0.27200000000000002,"5min":0.254,"15min":0.252},"max":{"1min":7.1189999999999998,"5min":7.1189999999999998,"15min":9.327},"last":5.4249999999999998}]},{"osd":3,"last update":"Sun Oct 8 13:43:12 2023","interfaces":[{"interface":"back","average":{"1min":1.4019999999999999,"5min":0.873,"15min":1.079},"min":{"1min":0.316,"5min":0.29499999999999998,"15min":0.27300000000000002},"max":{"1min":6.2329999999999997,"5min":6.2359999999999998,"15min":9.2750000000000004},"last":5.46},{"interface":"front","average":{"1min":0.92600000000000005,"5min":1.0760000000000001,"15min":1.1419999999999999},"min":{"1min":0.39300000000000002,"5min":0.27100000000000002,"15min":0.26800000000000002},"max":{"1min":4.6139999999999999,"5min":6.0590000000000002,"15min":13.012},"last":0.68100000000000005}]},{"osd":4,"last update":"Sun Oct 8 13:43:12 2023","interfaces":[{"interface":"back","average":{"1min":1.6910000000000001,"5min":1.3100000000000001,"15min":1.252},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.32400000000000001},"max":{"1min":7.2649999999999997,"5min":7.2649999999999997,"15min":13.443},"last":23.466999999999999},{"interface":"front","average":{"1min":1.546,"5min":1.1799999999999999,"15min":1.2010000000000001},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38400000000000001},"max":{"1min":5.8479999999999999,"5min":6.3159999999999998,"15min":9.3859999999999992},"last":5.4939999999999998}]},{"osd":5,"last update":"Sun Oct 8 13:43:12 2023","interfaces":[{"interface":"back","average":{"1min":1.583,"5min":1.2829999999999999,"15min":1.242},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":5.3490000000000002,"5min":6.1109999999999998,"15min":6.1109999999999998},"last":0.57299999999999995},{"interface":"front","average":{"1min":1.8240000000000001,"5min":1.2090000000000001,"15min":1.3260000000000001},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.35299999999999998},"max":{"1min":7.2409999999999997,"5min":7.2409999999999997,"15min":13.468},"last":0.98699999999999999}]},{"osd":6,"last update":"Sun Oct 8 13:43:12 2023","interfaces":[{"interface":"back","average":{"1min":1.036,"5min":1.518,"15min":1.492},"min":{"1min":0.47299999999999998,"5min":0.40799999999999997,"15min":0.39200000000000002},"max":{"1min":4.7400000000000002,"5min":10.125,"15min":12.266},"last":0.61499999999999999},{"interface":"front","average":{"1min":2.3439999999999999,"5min":1.573,"15min":1.476},"min":{"1min":0.47799999999999998,"5min":0.40899999999999997,"15min":0.40200000000000002},"max":{"1min":7.2850000000000001,"5min":7.2850000000000001,"15min":13.489000000000001},"last":0.90000000000000002}]},{"osd":7,"last update":"Sun Oct 8 13:43:12 2023","interfaces":[{"interface":"back","average":{"1min":1.605,"5min":1.2310000000000001,"15min":1.413},"min":{"1min":0.54900000000000004,"5min":0.441,"15min":0.36199999999999999},"max":{"1min":5.8920000000000003,"5min":6.3780000000000001,"15min":9.4870000000000001},"last":5.5270000000000001},{"interface":"front","average":{"1min":1.054,"5min":1.5640000000000001,"15min":1.6040000000000001},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.437},"max":{"1min":4.7750000000000004,"5min":7.9260000000000002,"15min":12.263999999999999},"last":0.64700000000000002}]}]},{"osd":0,"up_from":15,"seq":64424514892,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5680708,"kb_used_data":4256376,"kb_used_omap":266,"kb_used_meta":1424053,"kb_avail":88691132,"statfs":{"total":96636764160,"available":90819719168,"internally_reserved":0,"allocated":4358529024,"data_stored":4349893931,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":272932,"internal_metadata":1458230748},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,1,1],"upper_bound":32},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 13:43:40 2023","interfaces":[{"interface":"back","average":{"1min":1.0680000000000001,"5min":1.0409999999999999,"15min":0.93400000000000005},"min":{"1min":0.25800000000000001,"5min":0.249,"15min":0.218},"max":{"1min":5.3979999999999997,"5min":8.1850000000000005,"15min":8.1850000000000005},"last":0.33000000000000002},{"interface":"front","average":{"1min":1.1259999999999999,"5min":1.0049999999999999,"15min":0.99399999999999999},"min":{"1min":0.27600000000000002,"5min":0.22,"15min":0.22},"max":{"1min":4.5419999999999998,"5min":11.153,"15min":11.153},"last":0.38900000000000001}]},{"osd":2,"last update":"Sun Oct 8 13:43:40 2023","interfaces":[{"interface":"back","average":{"1min":1.2370000000000001,"5min":1.0509999999999999,"15min":0.96099999999999997},"min":{"1min":0.31,"5min":0.25600000000000001,"15min":0.248},"max":{"1min":7.5670000000000002,"5min":8.891,"15min":10.115},"last":0.374},{"interface":"front","average":{"1min":1.5860000000000001,"5min":1.1910000000000001,"15min":1.0820000000000001},"min":{"1min":0.30099999999999999,"5min":0.25900000000000001,"15min":0.245},"max":{"1min":8.5069999999999997,"5min":8.5069999999999997,"15min":8.5069999999999997},"last":0.44800000000000001}]},{"osd":3,"last update":"Sun Oct 8 13:43:40 2023","interfaces":[{"interface":"back","average":{"1min":1.4670000000000001,"5min":1,"15min":1.1919999999999999},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.26200000000000001},"max":{"1min":6.9420000000000002,"5min":7.4400000000000004,"15min":7.4400000000000004},"last":0.85099999999999998},{"interface":"front","average":{"1min":1.9630000000000001,"5min":1.391,"15min":1.097},"min":{"1min":0.41299999999999998,"5min":0.33800000000000002,"15min":0.26900000000000002},"max":{"1min":7.4370000000000003,"5min":10.798,"15min":10.798},"last":0.72399999999999998}]},{"osd":4,"last update":"Sun Oct 8 13:43:40 2023","interfaces":[{"interface":"back","average":{"1min":1.349,"5min":1.111,"15min":1.2490000000000001},"min":{"1min":0.36099999999999999,"5min":0.34999999999999998,"15min":0.34399999999999997},"max":{"1min":6.9889999999999999,"5min":7.4930000000000003,"15min":7.4930000000000003},"last":0.65000000000000002},{"interface":"front","average":{"1min":1.6259999999999999,"5min":1.228,"15min":1.077},"min":{"1min":0.504,"5min":0.38700000000000001,"15min":0.35299999999999998},"max":{"1min":5.3460000000000001,"5min":8.077,"15min":8.077},"last":0.79500000000000004}]},{"osd":5,"last update":"Sun Oct 8 13:43:40 2023","interfaces":[{"interface":"back","average":{"1min":1.232,"5min":1.157,"15min":1.115},"min":{"1min":0.40100000000000002,"5min":0.37,"15min":0.36099999999999999},"max":{"1min":4.6340000000000003,"5min":5.5229999999999997,"15min":7.3940000000000001},"last":0.53400000000000003},{"interface":"front","average":{"1min":1.2629999999999999,"5min":1.1899999999999999,"15min":1.3049999999999999},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.377},"max":{"1min":7.0650000000000004,"5min":8.2750000000000004,"15min":8.2750000000000004},"last":0.69199999999999995}]},{"osd":6,"last update":"Sun Oct 8 13:43:40 2023","interfaces":[{"interface":"back","average":{"1min":2.375,"5min":1.6499999999999999,"15min":1.339},"min":{"1min":0.55900000000000005,"5min":0.42499999999999999,"15min":0.36499999999999999},"max":{"1min":7.5739999999999998,"5min":8.0289999999999999,"15min":8.0289999999999999},"last":0.76400000000000001},{"interface":"front","average":{"1min":1.2589999999999999,"5min":1.2130000000000001,"15min":1.196},"min":{"1min":0.44400000000000001,"5min":0.42999999999999999,"15min":0.40799999999999997},"max":{"1min":4.6689999999999996,"5min":5.8419999999999996,"15min":10.696},"last":0.73799999999999999}]},{"osd":7,"last update":"Sun Oct 8 13:43:40 2023","interfaces":[{"interface":"back","average":{"1min":1.706,"5min":1.1990000000000001,"15min":1.161},"min":{"1min":0.47299999999999998,"5min":0.42899999999999999,"15min":0.40500000000000003},"max":{"1min":7.4420000000000002,"5min":7.4420000000000002,"15min":7.4420000000000002},"last":0.77900000000000003},{"interface":"front","average":{"1min":1.5249999999999999,"5min":1.323,"15min":1.4239999999999999},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":7.0270000000000001,"5min":7.5549999999999997,"15min":9.298},"last":0.81299999999999994}]}]},{"osd":3,"up_from":14,"seq":60129547586,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7764528,"kb_used_data":6531812,"kb_used_omap":1048,"kb_used_meta":1231655,"kb_avail":86607312,"statfs":{"total":96636764160,"available":88685887488,"internally_reserved":0,"allocated":6688575488,"data_stored":6674964259,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1073246,"internal_metadata":1261215650},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,2],"upper_bound":16},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 13:43:18 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.72199999999999998,"15min":0.72899999999999998},"min":{"1min":0.26300000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":4.3200000000000003,"5min":6.8760000000000003,"15min":10.003},"last":2.5369999999999999},{"interface":"front","average":{"1min":1.343,"5min":1.0740000000000001,"15min":0.96599999999999997},"min":{"1min":0.26400000000000001,"5min":0.245,"15min":0.245},"max":{"1min":8.5559999999999992,"5min":8.5559999999999992,"15min":10.115},"last":0.29999999999999999}]},{"osd":1,"last update":"Sun Oct 8 13:43:18 2023","interfaces":[{"interface":"back","average":{"1min":1.1000000000000001,"5min":1.052,"15min":1.0269999999999999},"min":{"1min":0.315,"5min":0.26500000000000001,"15min":0.251},"max":{"1min":9.7219999999999995,"5min":10.757,"15min":10.757},"last":2.6110000000000002},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.99399999999999999,"15min":0.93100000000000005},"min":{"1min":0.29399999999999998,"5min":0.27300000000000002,"15min":0.26000000000000001},"max":{"1min":3.9289999999999998,"5min":6.8280000000000003,"15min":6.9560000000000004},"last":0.627}]},{"osd":2,"last update":"Sun Oct 8 13:43:18 2023","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":1.2050000000000001,"15min":1.0860000000000001},"min":{"1min":0.29499999999999998,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":4.7930000000000001,"5min":10.813000000000001,"15min":10.813000000000001},"last":3.2999999999999998},{"interface":"front","average":{"1min":0.626,"5min":1.0389999999999999,"15min":0.94799999999999995},"min":{"1min":0.32300000000000001,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":1.496,"5min":7.1760000000000002,"15min":7.1760000000000002},"last":0.40300000000000002}]},{"osd":4,"last update":"Sun Oct 8 13:43:18 2023","interfaces":[{"interface":"back","average":{"1min":1.288,"5min":0.99299999999999999,"15min":1.087},"min":{"1min":0.375,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":4.5579999999999998,"5min":5.1449999999999996,"15min":10.182},"last":0.42299999999999999},{"interface":"front","average":{"1min":1.4019999999999999,"5min":1.2689999999999999,"15min":1.1819999999999999},"min":{"1min":0.42099999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":5.9989999999999997,"5min":10.851000000000001,"15min":10.851000000000001},"last":2.6640000000000001}]},{"osd":5,"last update":"Sun Oct 8 13:43:18 2023","interfaces":[{"interface":"back","average":{"1min":1.474,"5min":1.413,"15min":1.292},"min":{"1min":0.38800000000000001,"5min":0.36899999999999999,"15min":0.35899999999999999},"max":{"1min":6.7880000000000003,"5min":10.885,"15min":10.885},"last":2.706},{"interface":"front","average":{"1min":1.111,"5min":1.1479999999999999,"15min":1.1659999999999999},"min":{"1min":0.38400000000000001,"5min":0.376,"15min":0.376},"max":{"1min":4.2000000000000002,"5min":6.9210000000000003,"15min":10.173999999999999},"last":0.68400000000000005}]},{"osd":6,"last update":"Sun Oct 8 13:43:18 2023","interfaces":[{"interface":"back","average":{"1min":1.2230000000000001,"5min":1.228,"15min":1.2310000000000001},"min":{"1min":0.46000000000000002,"5min":0.43099999999999999,"15min":0.42899999999999999},"max":{"1min":8.0519999999999996,"5min":8.0519999999999996,"15min":8.0519999999999996},"last":0.65700000000000003},{"interface":"front","average":{"1min":1.7350000000000001,"5min":1.1060000000000001,"15min":1.2589999999999999},"min":{"1min":0.48399999999999999,"5min":0.39600000000000002,"15min":0.379},"max":{"1min":7.8879999999999999,"5min":7.8879999999999999,"15min":12.263999999999999},"last":0.48499999999999999}]},{"osd":7,"last update":"Sun Oct 8 13:43:18 2023","interfaces":[{"interface":"back","average":{"1min":1.6240000000000001,"5min":1.2430000000000001,"15min":1.3029999999999999},"min":{"1min":0.49099999999999999,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":6.5010000000000003,"5min":7.5220000000000002,"15min":10.202999999999999},"last":0.53000000000000003},{"interface":"front","average":{"1min":1.413,"5min":1.3660000000000001,"15min":1.3109999999999999},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.42799999999999999},"max":{"1min":4.8319999999999999,"5min":10.952,"15min":10.952},"last":2.7469999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T13:43:55.776 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T13:43:56.111 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:56.105+0000 7f634c95f700 1 Processor -- start 2023-10-08T13:43:56.112 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:56.105+0000 7f634c95f700 1 -- start start 2023-10-08T13:43:56.112 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:56.105+0000 7f634c95f700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f634815b200 0x7f634806c020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:43:56.113 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:56.105+0000 7f634c95f700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63480cda50 con 0x7f634815b5e0 2023-10-08T13:43:56.113 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:56.105+0000 7f634c95f700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f634806dfd0 con 0x7f63480cc370 2023-10-08T13:43:56.114 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:56.105+0000 7f634c95f700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63480b2a40 con 0x7f634815b200 2023-10-08T13:43:56.114 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:56.105+0000 7f6347fff700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f634815b5e0 0x7f63480b2330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:37678/0 (socket says 172.21.15.32:37678) 2023-10-08T13:43:56.114 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:56.105+0000 7f6347fff700 1 -- 172.21.15.32:0/2787877010 learned_addr learned my addr 172.21.15.32:0/2787877010 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-08T13:43:56.115 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:56.105+0000 7f63477fe700 1 --2- 172.21.15.32:0/2787877010 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f634815b200 0x7f634806c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:43:56.116 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:56.105+0000 7f63477fe700 1 -- 172.21.15.32:0/2787877010 >> v1:172.21.15.40:6789/0 conn(0x7f63480cc370 legacy=0x7f63480b1c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:43:56.116 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:56.105+0000 7f63477fe700 1 -- 172.21.15.32:0/2787877010 >> v1:172.21.15.32:6789/0 conn(0x7f634815b5e0 legacy=0x7f63480b2330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:43:56.117 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:56.105+0000 7f63477fe700 1 -- 172.21.15.32:0/2787877010 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f634806e270 con 0x7f634815b200 2023-10-08T13:43:56.117 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:56.105+0000 7f63477fe700 1 --2- 172.21.15.32:0/2787877010 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f634815b200 0x7f634806c020 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f6338009880 tx=0x7f6338009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=db887048c6e941c7 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:43:56.119 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:56.113+0000 7f63467fc700 1 -- 172.21.15.32:0/2787877010 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6338010790 con 0x7f634815b200 2023-10-08T13:43:56.120 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:56.113+0000 7f63467fc700 1 -- 172.21.15.32:0/2787877010 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63380108f0 con 0x7f634815b200 2023-10-08T13:43:56.121 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:56.113+0000 7f63467fc700 1 -- 172.21.15.32:0/2787877010 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6338010ca0 con 0x7f634815b200 2023-10-08T13:43:56.121 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:56.113+0000 7f634c95f700 1 -- 172.21.15.32:0/2787877010 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f634815b200 msgr2=0x7f634806c020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:43:56.121 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:56.113+0000 7f634c95f700 1 --2- 172.21.15.32:0/2787877010 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f634815b200 0x7f634806c020 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f6338009880 tx=0x7f6338009b90 comp rx=0 tx=0).stop 2023-10-08T13:43:56.122 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:56.117+0000 7f634c95f700 1 -- 172.21.15.32:0/2787877010 shutdown_connections 2023-10-08T13:43:56.123 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:56.117+0000 7f634c95f700 1 --2- 172.21.15.32:0/2787877010 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f634815b200 0x7f634806c020 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:56.123 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:56.117+0000 7f634c95f700 1 -- 172.21.15.32:0/2787877010 >> 172.21.15.32:0/2787877010 conn(0x7f63480cb850 msgr2=0x7f63480cbc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:43:56.123 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:56.117+0000 7f634c95f700 1 -- 172.21.15.32:0/2787877010 shutdown_connections 2023-10-08T13:43:56.123 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:56.117+0000 7f634c95f700 1 -- 172.21.15.32:0/2787877010 wait complete. 2023-10-08T13:43:56.124 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:56.117+0000 7f634c95f700 1 Processor -- start 2023-10-08T13:43:56.125 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:56.117+0000 7f634c95f700 1 -- start start 2023-10-08T13:43:56.126 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:56.121+0000 7f634c95f700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f634815b200 0x7f6348070cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:43:56.126 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:56.121+0000 7f634c95f700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f634815b5e0 0x7f63481e6810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:43:56.126 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:56.121+0000 7f634c95f700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f63480c4900 0x7f63480c4db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:43:56.126 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:56.121+0000 7f634c95f700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63480c8d60 con 0x7f634815b200 2023-10-08T13:43:56.127 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:56.121+0000 7f634c95f700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63480c4470 con 0x7f634815b5e0 2023-10-08T13:43:56.127 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:56.121+0000 7f634c95f700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6348071350 con 0x7f63480c4900 2023-10-08T13:43:56.127 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:56.121+0000 7f63477fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f634815b200 0x7f6348070cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:43:56.127 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:56.121+0000 7f63477fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f634815b200 0x7f6348070cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:53004/0 (socket says 172.21.15.32:53004) 2023-10-08T13:43:56.127 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:56.121+0000 7f63477fe700 1 -- 172.21.15.32:0/3296228680 learned_addr learned my addr 172.21.15.32:0/3296228680 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T13:43:56.127 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:56.121+0000 7f6347fff700 1 --2- 172.21.15.32:0/3296228680 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f63480c4900 0x7f63480c4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:43:56.127 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:56.121+0000 7f6346ffd700 1 --2- 172.21.15.32:0/3296228680 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f634815b5e0 0x7f63481e6810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:43:56.128 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:56.121+0000 7f6347fff700 1 -- 172.21.15.32:0/3296228680 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f634815b5e0 msgr2=0x7f63481e6810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:43:56.128 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:56.121+0000 7f6347fff700 1 --2- 172.21.15.32:0/3296228680 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f634815b5e0 0x7f63481e6810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:56.128 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:56.121+0000 7f6347fff700 1 -- 172.21.15.32:0/3296228680 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f634815b200 msgr2=0x7f6348070cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:43:56.129 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:56.121+0000 7f6347fff700 1 --2- 172.21.15.32:0/3296228680 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f634815b200 0x7f6348070cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:56.129 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:56.121+0000 7f6347fff700 1 -- 172.21.15.32:0/3296228680 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63380094b0 con 0x7f63480c4900 2023-10-08T13:43:56.129 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:56.121+0000 7f6346ffd700 1 --2- 172.21.15.32:0/3296228680 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f634815b5e0 0x7f63481e6810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:43:56.129 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:56.121+0000 7f6347fff700 1 --2- 172.21.15.32:0/3296228680 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f63480c4900 0x7f63480c4db0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f63480c93d0 tx=0x7f633c00c800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:43:56.137 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:56.133+0000 7f632ffff700 1 -- 172.21.15.32:0/3296228680 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f633c004ca0 con 0x7f63480c4900 2023-10-08T13:43:56.138 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:56.133+0000 7f634c95f700 1 -- 172.21.15.32:0/3296228680 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6348071630 con 0x7f63480c4900 2023-10-08T13:43:56.138 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:56.133+0000 7f634c95f700 1 -- 172.21.15.32:0/3296228680 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63481f28f0 con 0x7f63480c4900 2023-10-08T13:43:56.138 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:56.133+0000 7f632ffff700 1 -- 172.21.15.32:0/3296228680 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f633c004e00 con 0x7f63480c4900 2023-10-08T13:43:56.139 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:56.133+0000 7f632ffff700 1 -- 172.21.15.32:0/3296228680 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f633c007310 con 0x7f63480c4900 2023-10-08T13:43:56.145 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:56.133+0000 7f632ffff700 1 -- 172.21.15.32:0/3296228680 <== mon.2 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f633c007470 con 0x7f63480c4900 2023-10-08T13:43:56.145 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:56.133+0000 7f632ffff700 1 --2- 172.21.15.32:0/3296228680 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f63300666f0 0x7f6330068bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:43:56.147 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:56.133+0000 7f632ffff700 1 -- 172.21.15.32:0/3296228680 <== mon.2 v2:172.21.15.40:3301/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f633c083570 con 0x7f63480c4900 2023-10-08T13:43:56.147 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:56.133+0000 7f63477fe700 1 --2- 172.21.15.32:0/3296228680 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f63300666f0 0x7f6330068bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:43:56.147 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:56.133+0000 7f634c95f700 1 -- 172.21.15.32:0/3296228680 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6328005310 con 0x7f63480c4900 2023-10-08T13:43:56.147 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:56.133+0000 7f63477fe700 1 --2- 172.21.15.32:0/3296228680 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f63300666f0 0x7f6330068bb0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f6338009bd0 tx=0x7f6338008000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:43:56.153 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:56.145+0000 7f632ffff700 1 -- 172.21.15.32:0/3296228680 <== mon.2 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f633c050e60 con 0x7f63480c4900 2023-10-08T13:43:56.688 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:56.681+0000 7f634c95f700 1 -- 172.21.15.32:0/3296228680 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6328005890 con 0x7f63480c4900 2023-10-08T13:43:56.690 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:56.685+0000 7f632ffff700 1 -- 172.21.15.32:0/3296228680 <== mon.2 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+12924 (secure 0 0 0) 0x7f633c054480 con 0x7f63480c4900 2023-10-08T13:43:56.690 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T13:43:56.690 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":38,"fsid":"ac672d87-96ae-41e0-9314-623ba2cdbbba","created":"2023-10-08T06:09:11.175626+0000","modified":"2023-10-08T13:43:48.451904+0000","last_up_change":"2023-10-08T06:09:22.744643+0000","last_in_change":"2023-10-08T06:09:14.131580+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T06:09:23.307843+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"43433f0c-9592-4874-92d7-10f8f4acf07f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":587888964},{"type":"v1","addr":"172.21.15.32:6801","nonce":587888964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":587888964},{"type":"v1","addr":"172.21.15.32:6803","nonce":587888964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":587888964},{"type":"v1","addr":"172.21.15.32:6810","nonce":587888964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6805","nonce":587888964},{"type":"v1","addr":"172.21.15.32:6807","nonce":587888964}]},"public_addr":"172.21.15.32:6801/587888964","cluster_addr":"172.21.15.32:6803/587888964","heartbeat_back_addr":"172.21.15.32:6810/587888964","heartbeat_front_addr":"172.21.15.32:6807/587888964","state":["exists","up"]},{"osd":1,"uuid":"2ecb1008-b987-4ce7-b646-6cded55fc8d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":990576767},{"type":"v1","addr":"172.21.15.32:6817","nonce":990576767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":990576767},{"type":"v1","addr":"172.21.15.32:6819","nonce":990576767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":990576767},{"type":"v1","addr":"172.21.15.32:6823","nonce":990576767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":990576767},{"type":"v1","addr":"172.21.15.32:6821","nonce":990576767}]},"public_addr":"172.21.15.32:6817/990576767","cluster_addr":"172.21.15.32:6819/990576767","heartbeat_back_addr":"172.21.15.32:6823/990576767","heartbeat_front_addr":"172.21.15.32:6821/990576767","state":["exists","up"]},{"osd":2,"uuid":"1b131c94-c09b-4e80-8746-bf1b7bac362d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6824","nonce":1566874440},{"type":"v1","addr":"172.21.15.32:6825","nonce":1566874440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":1566874440},{"type":"v1","addr":"172.21.15.32:6827","nonce":1566874440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":1566874440},{"type":"v1","addr":"172.21.15.32:6831","nonce":1566874440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":1566874440},{"type":"v1","addr":"172.21.15.32:6829","nonce":1566874440}]},"public_addr":"172.21.15.32:6825/1566874440","cluster_addr":"172.21.15.32:6827/1566874440","heartbeat_back_addr":"172.21.15.32:6831/1566874440","heartbeat_front_addr":"172.21.15.32:6829/1566874440","state":["exists","up"]},{"osd":3,"uuid":"ad655af2-1f6f-4689-b21d-b07bbaeb68b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":3672614802},{"type":"v1","addr":"172.21.15.32:6806","nonce":3672614802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6809","nonce":3672614802},{"type":"v1","addr":"172.21.15.32:6811","nonce":3672614802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":3672614802},{"type":"v1","addr":"172.21.15.32:6815","nonce":3672614802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":3672614802},{"type":"v1","addr":"172.21.15.32:6813","nonce":3672614802}]},"public_addr":"172.21.15.32:6806/3672614802","cluster_addr":"172.21.15.32:6811/3672614802","heartbeat_back_addr":"172.21.15.32:6815/3672614802","heartbeat_front_addr":"172.21.15.32:6813/3672614802","state":["exists","up"]},{"osd":4,"uuid":"64a543a1-8c4f-458e-9aba-b35c1cd7dd03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":3369928244},{"type":"v1","addr":"172.21.15.40:6801","nonce":3369928244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":3369928244},{"type":"v1","addr":"172.21.15.40:6803","nonce":3369928244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":3369928244},{"type":"v1","addr":"172.21.15.40:6807","nonce":3369928244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":3369928244},{"type":"v1","addr":"172.21.15.40:6805","nonce":3369928244}]},"public_addr":"172.21.15.40:6801/3369928244","cluster_addr":"172.21.15.40:6803/3369928244","heartbeat_back_addr":"172.21.15.40:6807/3369928244","heartbeat_front_addr":"172.21.15.40:6805/3369928244","state":["exists","up"]},{"osd":5,"uuid":"0fef3e54-edb4-4678-878e-944663c51638","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":2395850297},{"type":"v1","addr":"172.21.15.40:6825","nonce":2395850297}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":2395850297},{"type":"v1","addr":"172.21.15.40:6827","nonce":2395850297}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":2395850297},{"type":"v1","addr":"172.21.15.40:6831","nonce":2395850297}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":2395850297},{"type":"v1","addr":"172.21.15.40:6829","nonce":2395850297}]},"public_addr":"172.21.15.40:6825/2395850297","cluster_addr":"172.21.15.40:6827/2395850297","heartbeat_back_addr":"172.21.15.40:6831/2395850297","heartbeat_front_addr":"172.21.15.40:6829/2395850297","state":["exists","up"]},{"osd":6,"uuid":"2eeb0472-6096-469d-9b2c-cab4bf41c31a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":4145283410},{"type":"v1","addr":"172.21.15.40:6809","nonce":4145283410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":4145283410},{"type":"v1","addr":"172.21.15.40:6811","nonce":4145283410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":4145283410},{"type":"v1","addr":"172.21.15.40:6815","nonce":4145283410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":4145283410},{"type":"v1","addr":"172.21.15.40:6813","nonce":4145283410}]},"public_addr":"172.21.15.40:6809/4145283410","cluster_addr":"172.21.15.40:6811/4145283410","heartbeat_back_addr":"172.21.15.40:6815/4145283410","heartbeat_front_addr":"172.21.15.40:6813/4145283410","state":["exists","up"]},{"osd":7,"uuid":"cf76e4c7-96a6-401f-a280-91aad4641940","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":2943297416},{"type":"v1","addr":"172.21.15.40:6817","nonce":2943297416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":2943297416},{"type":"v1","addr":"172.21.15.40:6819","nonce":2943297416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":2943297416},{"type":"v1","addr":"172.21.15.40:6823","nonce":2943297416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":2943297416},{"type":"v1","addr":"172.21.15.40:6821","nonce":2943297416}]},"public_addr":"172.21.15.40:6817/2943297416","cluster_addr":"172.21.15.40:6819/2943297416","heartbeat_back_addr":"172.21.15.40:6823/2943297416","heartbeat_front_addr":"172.21.15.40:6821/2943297416","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.411475+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.628841+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.599055+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.166100+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.384135+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.488403+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.307648+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T06:09:19.363541+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.40:6835/500201668":"2023-10-09T13:43:45.419440+0000","172.21.15.40:6834/500201668":"2023-10-09T13:43:45.419440+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T13:43:56.698 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:56.693+0000 7f634c95f700 1 -- 172.21.15.32:0/3296228680 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f63300666f0 msgr2=0x7f6330068bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:43:56.698 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:56.693+0000 7f634c95f700 1 --2- 172.21.15.32:0/3296228680 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f63300666f0 0x7f6330068bb0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f6338009bd0 tx=0x7f6338008000 comp rx=0 tx=0).stop 2023-10-08T13:43:56.699 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:56.693+0000 7f634c95f700 1 -- 172.21.15.32:0/3296228680 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f63480c4900 msgr2=0x7f63480c4db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:43:56.699 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:56.693+0000 7f634c95f700 1 --2- 172.21.15.32:0/3296228680 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f63480c4900 0x7f63480c4db0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f63480c93d0 tx=0x7f633c00c800 comp rx=0 tx=0).stop 2023-10-08T13:43:56.701 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:56.693+0000 7f634c95f700 1 -- 172.21.15.32:0/3296228680 shutdown_connections 2023-10-08T13:43:56.703 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:56.693+0000 7f634c95f700 1 --2- 172.21.15.32:0/3296228680 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f63300666f0 0x7f6330068bb0 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:56.704 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:56.697+0000 7f634c95f700 1 --2- 172.21.15.32:0/3296228680 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f63480c4900 0x7f63480c4db0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:56.704 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:56.697+0000 7f634c95f700 1 --2- 172.21.15.32:0/3296228680 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f634815b5e0 0x7f63481e6810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:56.704 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:56.697+0000 7f634c95f700 1 --2- 172.21.15.32:0/3296228680 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f634815b200 0x7f6348070cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:56.704 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:56.697+0000 7f634c95f700 1 -- 172.21.15.32:0/3296228680 >> 172.21.15.32:0/3296228680 conn(0x7f63480cb850 msgr2=0x7f63480b21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:43:56.704 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:56.697+0000 7f634c95f700 1 -- 172.21.15.32:0/3296228680 shutdown_connections 2023-10-08T13:43:56.704 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:56.697+0000 7f634c95f700 1 -- 172.21.15.32:0/3296228680 wait complete. 2023-10-08T13:43:57.720 INFO:tasks.ceph:Scrubbing osd.0 2023-10-08T13:43:57.720 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2023-10-08T13:43:57.922 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:57.917+0000 7f1a6359e700 1 Processor -- start 2023-10-08T13:43:57.923 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:57.917+0000 7f1a6359e700 1 -- start start 2023-10-08T13:43:57.923 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:57.917+0000 7f1a6359e700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f1a640c9610 0x7f1a640c99f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:43:57.924 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:57.917+0000 7f1a6359e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1a640cc8f0 0x7f1a640ccda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:43:57.924 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:57.917+0000 7f1a6359e700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a6415a890 con 0x7f1a6415ce90 2023-10-08T13:43:57.924 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:57.917+0000 7f1a6359e700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a6406b680 con 0x7f1a640c9610 2023-10-08T13:43:57.924 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:57.917+0000 7f1a6359e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a64159bf0 con 0x7f1a640cc8f0 2023-10-08T13:43:57.924 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:57.917+0000 7f1a62d9d700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f1a6415ce90 0x7f1a6415d2e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:37686/0 (socket says 172.21.15.32:37686) 2023-10-08T13:43:57.924 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:57.917+0000 7f1a62d9d700 1 -- 172.21.15.32:0/2043168863 learned_addr learned my addr 172.21.15.32:0/2043168863 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-08T13:43:57.925 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:57.917+0000 7f1a6259c700 1 --2- 172.21.15.32:0/2043168863 >> v2:172.21.15.40:3300/0 conn(0x7f1a640c9610 0x7f1a640c99f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:43:57.925 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:57.917+0000 7f1a61d9b700 1 --2- 172.21.15.32:0/2043168863 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1a640cc8f0 0x7f1a640ccda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:43:57.925 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:57.917+0000 7f1a61d9b700 1 -- 172.21.15.32:0/2043168863 >> v2:172.21.15.40:3300/0 conn(0x7f1a640c9610 msgr2=0x7f1a640c99f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:43:57.925 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:57.917+0000 7f1a61d9b700 1 --2- 172.21.15.32:0/2043168863 >> v2:172.21.15.40:3300/0 conn(0x7f1a640c9610 0x7f1a640c99f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:57.925 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:57.917+0000 7f1a61d9b700 1 -- 172.21.15.32:0/2043168863 >> v1:172.21.15.32:6789/0 conn(0x7f1a6415ce90 legacy=0x7f1a6415d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:43:57.926 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:57.917+0000 7f1a61d9b700 1 -- 172.21.15.32:0/2043168863 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a640c9f30 con 0x7f1a640cc8f0 2023-10-08T13:43:57.926 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:57.917+0000 7f1a61d9b700 1 --2- 172.21.15.32:0/2043168863 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1a640cc8f0 0x7f1a640ccda0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f1a54009260 tx=0x7f1a54009570 comp rx=0 tx=0).ready entity=mon.2 client_cookie=46d759922d16e977 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:43:57.933 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:57.925+0000 7f1a6159a700 1 -- 172.21.15.32:0/2043168863 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a54004230 con 0x7f1a640cc8f0 2023-10-08T13:43:57.934 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:57.925+0000 7f1a6159a700 1 -- 172.21.15.32:0/2043168863 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a54004390 con 0x7f1a640cc8f0 2023-10-08T13:43:57.934 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:57.925+0000 7f1a6159a700 1 -- 172.21.15.32:0/2043168863 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a540036c0 con 0x7f1a640cc8f0 2023-10-08T13:43:57.934 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:57.929+0000 7f1a6359e700 1 -- 172.21.15.32:0/2043168863 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1a640cc8f0 msgr2=0x7f1a640ccda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:43:57.935 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:57.929+0000 7f1a6359e700 1 --2- 172.21.15.32:0/2043168863 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1a640cc8f0 0x7f1a640ccda0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f1a54009260 tx=0x7f1a54009570 comp rx=0 tx=0).stop 2023-10-08T13:43:57.935 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:57.929+0000 7f1a6359e700 1 -- 172.21.15.32:0/2043168863 shutdown_connections 2023-10-08T13:43:57.935 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:57.929+0000 7f1a6359e700 1 --2- 172.21.15.32:0/2043168863 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1a640cc8f0 0x7f1a640ccda0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:57.935 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:57.929+0000 7f1a6359e700 1 --2- 172.21.15.32:0/2043168863 >> v2:172.21.15.40:3300/0 conn(0x7f1a640c9610 0x7f1a640c99f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:57.935 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:57.929+0000 7f1a6359e700 1 -- 172.21.15.32:0/2043168863 >> 172.21.15.32:0/2043168863 conn(0x7f1a640ced20 msgr2=0x7f1a640cf100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:43:57.935 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:57.929+0000 7f1a6359e700 1 -- 172.21.15.32:0/2043168863 shutdown_connections 2023-10-08T13:43:57.937 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:57.929+0000 7f1a6359e700 1 -- 172.21.15.32:0/2043168863 wait complete. 2023-10-08T13:43:57.937 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:57.929+0000 7f1a6359e700 1 Processor -- start 2023-10-08T13:43:57.939 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:57.929+0000 7f1a6359e700 1 -- start start 2023-10-08T13:43:57.939 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:57.933+0000 7f1a6359e700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1a640c9610 0x7f1a641ff6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:43:57.939 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:57.933+0000 7f1a6359e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1a640cc8f0 0x7f1a641e7880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:43:57.939 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:57.933+0000 7f1a6359e700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1a6415ce90 0x7f1a640c85d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:43:57.939 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:57.933+0000 7f1a6359e700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a641e7dc0 con 0x7f1a6415ce90 2023-10-08T13:43:57.940 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:57.933+0000 7f1a6359e700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a641e73f0 con 0x7f1a640c9610 2023-10-08T13:43:57.940 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:57.933+0000 7f1a6359e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a641e67e0 con 0x7f1a640cc8f0 2023-10-08T13:43:57.940 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:57.933+0000 7f1a6259c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1a640c9610 0x7f1a641ff6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:43:57.940 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:57.933+0000 7f1a62d9d700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1a6415ce90 0x7f1a640c85d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:43:57.940 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:57.933+0000 7f1a6259c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1a640c9610 0x7f1a641ff6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.32:60390/0 (socket says 172.21.15.32:60390) 2023-10-08T13:43:57.940 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:57.933+0000 7f1a6259c700 1 -- 172.21.15.32:0/1057298057 learned_addr learned my addr 172.21.15.32:0/1057298057 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T13:43:57.941 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:57.933+0000 7f1a61d9b700 1 --2- 172.21.15.32:0/1057298057 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1a640cc8f0 0x7f1a641e7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:43:57.941 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:57.933+0000 7f1a6259c700 1 -- 172.21.15.32:0/1057298057 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1a640cc8f0 msgr2=0x7f1a641e7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:43:57.941 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:57.933+0000 7f1a6259c700 1 --2- 172.21.15.32:0/1057298057 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1a640cc8f0 0x7f1a641e7880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:57.941 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:57.933+0000 7f1a6259c700 1 -- 172.21.15.32:0/1057298057 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1a6415ce90 msgr2=0x7f1a640c85d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:43:57.941 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:57.933+0000 7f1a6259c700 1 --2- 172.21.15.32:0/1057298057 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1a6415ce90 0x7f1a640c85d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:57.941 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:57.933+0000 7f1a6259c700 1 -- 172.21.15.32:0/1057298057 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a54009d40 con 0x7f1a640c9610 2023-10-08T13:43:57.941 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:57.933+0000 7f1a61d9b700 1 --2- 172.21.15.32:0/1057298057 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1a640cc8f0 0x7f1a641e7880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:43:57.942 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:57.933+0000 7f1a62d9d700 1 --2- 172.21.15.32:0/1057298057 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1a6415ce90 0x7f1a640c85d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:43:57.942 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:57.933+0000 7f1a6259c700 1 --2- 172.21.15.32:0/1057298057 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1a640c9610 0x7f1a641ff6c0 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f1a5800d830 tx=0x7f1a5800db40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:43:57.970 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:57.965+0000 7f1a52ffd700 1 -- 172.21.15.32:0/1057298057 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a580125f0 con 0x7f1a640c9610 2023-10-08T13:43:57.970 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:57.965+0000 7f1a52ffd700 1 -- 172.21.15.32:0/1057298057 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a58012750 con 0x7f1a640c9610 2023-10-08T13:43:57.970 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:57.965+0000 7f1a52ffd700 1 -- 172.21.15.32:0/1057298057 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a58012b00 con 0x7f1a640c9610 2023-10-08T13:43:57.973 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:57.969+0000 7f1a6359e700 1 -- 172.21.15.32:0/1057298057 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a641e6ac0 con 0x7f1a640c9610 2023-10-08T13:43:57.973 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:57.969+0000 7f1a6359e700 1 -- 172.21.15.32:0/1057298057 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a641e7080 con 0x7f1a640c9610 2023-10-08T13:43:57.975 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:57.969+0000 7f1a52ffd700 1 -- 172.21.15.32:0/1057298057 <== mon.1 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f1a58012c60 con 0x7f1a640c9610 2023-10-08T13:43:57.976 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:57.969+0000 7f1a52ffd700 1 --2- 172.21.15.32:0/1057298057 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f1a44066560 0x7f1a44068a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:43:57.976 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:57.969+0000 7f1a61d9b700 1 --2- 172.21.15.32:0/1057298057 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f1a44066560 0x7f1a44068a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:43:57.976 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:57.969+0000 7f1a52ffd700 1 -- 172.21.15.32:0/1057298057 <== mon.1 v2:172.21.15.40:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f1a58083a80 con 0x7f1a640c9610 2023-10-08T13:43:57.977 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:57.969+0000 7f1a61d9b700 1 --2- 172.21.15.32:0/1057298057 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f1a44066560 0x7f1a44068a20 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f1a54009260 tx=0x7f1a54011000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:43:57.985 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:57.981+0000 7f1a6359e700 1 --2- 172.21.15.32:0/1057298057 >> [v2:172.21.15.32:6800/587888964,v1:172.21.15.32:6801/587888964] conn(0x7f1a640c8b10 0x7f1a640b2f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:43:57.986 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:57.981+0000 7f1a6359e700 1 -- 172.21.15.32:0/1057298057 --> [v2:172.21.15.32:6800/587888964,v1:172.21.15.32:6801/587888964] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1a640cd460 con 0x7f1a640c8b10 2023-10-08T13:43:57.986 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:57.981+0000 7f1a62d9d700 1 --2- 172.21.15.32:0/1057298057 >> [v2:172.21.15.32:6800/587888964,v1:172.21.15.32:6801/587888964] conn(0x7f1a640c8b10 0x7f1a640b2f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:43:57.987 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:57.981+0000 7f1a62d9d700 1 --2- 172.21.15.32:0/1057298057 >> [v2:172.21.15.32:6800/587888964,v1:172.21.15.32:6801/587888964] conn(0x7f1a640c8b10 0x7f1a640b2f00 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:43:57.987 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:57.981+0000 7f1a52ffd700 1 -- 172.21.15.32:0/1057298057 <== osd.0 v2:172.21.15.32:6800/587888964 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f1a5c007340 con 0x7f1a640c8b10 2023-10-08T13:43:58.046 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:58.041+0000 7f1a6359e700 1 -- 172.21.15.32:0/1057298057 --> [v2:172.21.15.32:6800/587888964,v1:172.21.15.32:6801/587888964] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f1a640cda20 con 0x7f1a640c8b10 2023-10-08T13:43:58.046 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:58.041+0000 7f1a52ffd700 1 -- 172.21.15.32:0/1057298057 <== osd.0 v2:172.21.15.32:6800/587888964 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f1a5c0077c0 con 0x7f1a640c8b10 2023-10-08T13:43:58.046 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2023-10-08T13:43:58.047 INFO:teuthology.orchestra.run.smithi032.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-08T13:43:58.047 INFO:teuthology.orchestra.run.smithi032.stdout:} 2023-10-08T13:43:58.065 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:58.061+0000 7f1a6359e700 1 -- 172.21.15.32:0/1057298057 >> [v2:172.21.15.32:6800/587888964,v1:172.21.15.32:6801/587888964] conn(0x7f1a640c8b10 msgr2=0x7f1a640b2f00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:43:58.065 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:58.061+0000 7f1a6359e700 1 --2- 172.21.15.32:0/1057298057 >> [v2:172.21.15.32:6800/587888964,v1:172.21.15.32:6801/587888964] conn(0x7f1a640c8b10 0x7f1a640b2f00 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:58.066 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:58.061+0000 7f1a6359e700 1 -- 172.21.15.32:0/1057298057 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f1a44066560 msgr2=0x7f1a44068a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:43:58.066 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:58.061+0000 7f1a6359e700 1 --2- 172.21.15.32:0/1057298057 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f1a44066560 0x7f1a44068a20 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f1a54009260 tx=0x7f1a54011000 comp rx=0 tx=0).stop 2023-10-08T13:43:58.067 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:58.061+0000 7f1a6359e700 1 -- 172.21.15.32:0/1057298057 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1a640c9610 msgr2=0x7f1a641ff6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:43:58.067 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:58.061+0000 7f1a6359e700 1 --2- 172.21.15.32:0/1057298057 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1a640c9610 0x7f1a641ff6c0 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f1a5800d830 tx=0x7f1a5800db40 comp rx=0 tx=0).stop 2023-10-08T13:43:58.067 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:58.061+0000 7f1a62d9d700 1 -- 172.21.15.32:0/1057298057 reap_dead start 2023-10-08T13:43:58.067 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:58.061+0000 7f1a6359e700 1 -- 172.21.15.32:0/1057298057 shutdown_connections 2023-10-08T13:43:58.067 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:58.061+0000 7f1a6359e700 1 -- 172.21.15.32:0/1057298057 >> 172.21.15.32:0/1057298057 conn(0x7f1a640ced20 msgr2=0x7f1a6415ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:43:58.067 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:58.061+0000 7f1a6359e700 1 -- 172.21.15.32:0/1057298057 shutdown_connections 2023-10-08T13:43:58.067 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:58.061+0000 7f1a6359e700 1 -- 172.21.15.32:0/1057298057 wait complete. 2023-10-08T13:43:58.080 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2023-10-08T13:43:58.345 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:58.337+0000 7fbfe5263700 1 Processor -- start 2023-10-08T13:43:58.346 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:58.341+0000 7fbfe5263700 1 -- start start 2023-10-08T13:43:58.347 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:58.341+0000 7fbfe5263700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fbfe00cc370 0x7fbfe00b1c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:43:58.347 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:58.341+0000 7fbfe5263700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbfe006c730 0x7fbfe00b2160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:43:58.347 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:58.341+0000 7fbfe5263700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfe00cda50 con 0x7fbfe015b200 2023-10-08T13:43:58.347 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:58.341+0000 7fbfe5263700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfe00cc800 con 0x7fbfe00cc370 2023-10-08T13:43:58.347 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:58.341+0000 7fbfe5263700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfe006dfd0 con 0x7fbfe006c730 2023-10-08T13:43:58.347 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:58.341+0000 7fbfdffff700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fbfe015b200 0x7fbfe006c020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:37690/0 (socket says 172.21.15.32:37690) 2023-10-08T13:43:58.348 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:58.341+0000 7fbfdffff700 1 -- 172.21.15.32:0/3407554398 learned_addr learned my addr 172.21.15.32:0/3407554398 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-08T13:43:58.349 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:58.341+0000 7fbfe4a62700 1 --2- 172.21.15.32:0/3407554398 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbfe006c730 0x7fbfe00b2160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:43:58.349 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:58.341+0000 7fbfdf7fe700 1 --2- 172.21.15.32:0/3407554398 >> v2:172.21.15.32:3300/0 conn(0x7fbfe00cc370 0x7fbfe00b1c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:43:58.349 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:58.341+0000 7fbfdeffd700 1 -- 172.21.15.32:0/3407554398 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3584741755 0 0) 0x7fbfe00cda50 con 0x7fbfe015b200 2023-10-08T13:43:58.350 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:58.341+0000 7fbfdeffd700 1 -- 172.21.15.32:0/3407554398 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbfc80035d0 con 0x7fbfe015b200 2023-10-08T13:43:58.350 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:58.341+0000 7fbfe4a62700 1 -- 172.21.15.32:0/3407554398 >> v2:172.21.15.32:3300/0 conn(0x7fbfe00cc370 msgr2=0x7fbfe00b1c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:43:58.350 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:58.341+0000 7fbfe4a62700 1 --2- 172.21.15.32:0/3407554398 >> v2:172.21.15.32:3300/0 conn(0x7fbfe00cc370 0x7fbfe00b1c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:58.350 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:58.341+0000 7fbfe4a62700 1 -- 172.21.15.32:0/3407554398 >> v1:172.21.15.32:6789/0 conn(0x7fbfe015b200 legacy=0x7fbfe006c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:43:58.350 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:58.341+0000 7fbfe4a62700 1 -- 172.21.15.32:0/3407554398 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfe006e270 con 0x7fbfe006c730 2023-10-08T13:43:58.351 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:58.341+0000 7fbfdf7fe700 1 --2- 172.21.15.32:0/3407554398 >> v2:172.21.15.32:3300/0 conn(0x7fbfe00cc370 0x7fbfe00b1c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:43:58.351 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:58.341+0000 7fbfe4a62700 1 --2- 172.21.15.32:0/3407554398 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbfe006c730 0x7fbfe00b2160 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fbfd8009d90 tx=0x7fbfd800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8db4a295e56c1e42 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:43:58.351 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:58.341+0000 7fbfdeffd700 1 -- 172.21.15.32:0/3407554398 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfd800e070 con 0x7fbfe006c730 2023-10-08T13:43:58.351 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:58.341+0000 7fbfdeffd700 1 -- 172.21.15.32:0/3407554398 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfd800bb20 con 0x7fbfe006c730 2023-10-08T13:43:58.351 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:58.341+0000 7fbfdeffd700 1 -- 172.21.15.32:0/3407554398 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfd8012430 con 0x7fbfe006c730 2023-10-08T13:43:58.351 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:58.341+0000 7fbfe5263700 1 -- 172.21.15.32:0/3407554398 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbfe006c730 msgr2=0x7fbfe00b2160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:43:58.352 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:58.341+0000 7fbfe5263700 1 --2- 172.21.15.32:0/3407554398 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbfe006c730 0x7fbfe00b2160 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fbfd8009d90 tx=0x7fbfd800b330 comp rx=0 tx=0).stop 2023-10-08T13:43:58.352 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:58.341+0000 7fbfe5263700 1 -- 172.21.15.32:0/3407554398 shutdown_connections 2023-10-08T13:43:58.352 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:58.341+0000 7fbfe5263700 1 --2- 172.21.15.32:0/3407554398 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbfe006c730 0x7fbfe00b2160 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:58.352 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:58.341+0000 7fbfe5263700 1 --2- 172.21.15.32:0/3407554398 >> v2:172.21.15.32:3300/0 conn(0x7fbfe00cc370 0x7fbfe00b1c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:58.352 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:58.341+0000 7fbfe5263700 1 -- 172.21.15.32:0/3407554398 >> 172.21.15.32:0/3407554398 conn(0x7fbfe00cb850 msgr2=0x7fbfe00cbc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:43:58.352 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:58.341+0000 7fbfe5263700 1 -- 172.21.15.32:0/3407554398 shutdown_connections 2023-10-08T13:43:58.352 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:58.341+0000 7fbfe5263700 1 -- 172.21.15.32:0/3407554398 wait complete. 2023-10-08T13:43:58.354 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:58.345+0000 7fbfe5263700 1 Processor -- start 2023-10-08T13:43:58.354 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:58.345+0000 7fbfe5263700 1 -- start start 2023-10-08T13:43:58.354 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:58.345+0000 7fbfe5263700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbfe006c730 0x7fbfe0071470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:43:58.354 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:58.345+0000 7fbfe5263700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbfe015b200 0x7fbfe00c45e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:43:58.354 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:58.345+0000 7fbfe5263700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbfe014ae00 0x7fbfe014b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:43:58.355 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:58.345+0000 7fbfe5263700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfe01e1950 con 0x7fbfe014ae00 2023-10-08T13:43:58.355 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:58.345+0000 7fbfe5263700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfe014b7f0 con 0x7fbfe006c730 2023-10-08T13:43:58.355 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:58.345+0000 7fbfe5263700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfe01e1d70 con 0x7fbfe015b200 2023-10-08T13:43:58.355 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:58.345+0000 7fbfe4a62700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbfe014ae00 0x7fbfe014b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:43:58.356 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:58.345+0000 7fbfdffff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbfe006c730 0x7fbfe0071470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:43:58.356 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:58.345+0000 7fbfdffff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbfe006c730 0x7fbfe0071470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.32:60402/0 (socket says 172.21.15.32:60402) 2023-10-08T13:43:58.356 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:58.345+0000 7fbfdffff700 1 -- 172.21.15.32:0/3764646016 learned_addr learned my addr 172.21.15.32:0/3764646016 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T13:43:58.356 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:58.345+0000 7fbfdf7fe700 1 --2- 172.21.15.32:0/3764646016 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbfe015b200 0x7fbfe00c45e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:43:58.357 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:58.345+0000 7fbfe4a62700 1 -- 172.21.15.32:0/3764646016 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbfe015b200 msgr2=0x7fbfe00c45e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:43:58.357 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:58.345+0000 7fbfe4a62700 1 --2- 172.21.15.32:0/3764646016 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbfe015b200 0x7fbfe00c45e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:58.357 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:58.345+0000 7fbfe4a62700 1 -- 172.21.15.32:0/3764646016 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbfe006c730 msgr2=0x7fbfe0071470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:43:58.357 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:58.345+0000 7fbfe4a62700 1 --2- 172.21.15.32:0/3764646016 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbfe006c730 0x7fbfe0071470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:58.358 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:58.345+0000 7fbfe4a62700 1 -- 172.21.15.32:0/3764646016 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfd00094b0 con 0x7fbfe014ae00 2023-10-08T13:43:58.358 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:58.345+0000 7fbfdffff700 1 --2- 172.21.15.32:0/3764646016 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbfe006c730 0x7fbfe0071470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:43:58.358 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:58.345+0000 7fbfe4a62700 1 --2- 172.21.15.32:0/3764646016 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbfe014ae00 0x7fbfe014b2b0 secure :-1 s=READY pgs=1914 cs=0 l=1 rev1=1 crypto rx=0x7fbfe004ed60 tx=0x7fbfd8004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:43:58.358 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:58.349+0000 7fbfdcff9700 1 -- 172.21.15.32:0/3764646016 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfd8012430 con 0x7fbfe014ae00 2023-10-08T13:43:58.360 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:58.349+0000 7fbfdcff9700 1 -- 172.21.15.32:0/3764646016 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfd8020070 con 0x7fbfe014ae00 2023-10-08T13:43:58.360 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:58.349+0000 7fbfe5263700 1 -- 172.21.15.32:0/3764646016 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfd8009a70 con 0x7fbfe014ae00 2023-10-08T13:43:58.361 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:58.349+0000 7fbfdcff9700 1 -- 172.21.15.32:0/3764646016 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfd80098f0 con 0x7fbfe014ae00 2023-10-08T13:43:58.361 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:58.349+0000 7fbfe5263700 1 -- 172.21.15.32:0/3764646016 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfe01e1290 con 0x7fbfe014ae00 2023-10-08T13:43:58.361 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:58.349+0000 7fbfdcff9700 1 -- 172.21.15.32:0/3764646016 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fbfd8004040 con 0x7fbfe014ae00 2023-10-08T13:43:58.362 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:58.353+0000 7fbfdcff9700 1 --2- 172.21.15.32:0/3764646016 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fbfcc066510 0x7fbfcc0689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:43:58.362 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:58.353+0000 7fbfdcff9700 1 -- 172.21.15.32:0/3764646016 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fbfd8022070 con 0x7fbfe014ae00 2023-10-08T13:43:58.362 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:58.353+0000 7fbfdffff700 1 --2- 172.21.15.32:0/3764646016 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fbfcc066510 0x7fbfcc0689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:43:58.362 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:58.353+0000 7fbfdffff700 1 --2- 172.21.15.32:0/3764646016 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fbfcc066510 0x7fbfcc0689d0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7fbfd40011e0 tx=0x7fbfd4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:43:58.363 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:58.353+0000 7fbfe5263700 1 -- 172.21.15.32:0/3764646016 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfe01e1a90 con 0x7fbfe014ae00 2023-10-08T13:43:58.368 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:58.361+0000 7fbfdcff9700 1 -- 172.21.15.32:0/3764646016 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fbfd802c080 con 0x7fbfe014ae00 2023-10-08T13:43:58.581 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:58.573+0000 7fbfe5263700 1 -- 172.21.15.32:0/3764646016 --> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7fbfe006e550 con 0x7fbfcc066510 2023-10-08T13:43:58.582 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:58.577+0000 7fbfdcff9700 1 -- 172.21.15.32:0/3764646016 <== mgr.4107 v2:172.21.15.32:6832/2601628338 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fbfd400fa20 con 0x7fbfcc066510 2023-10-08T13:43:58.583 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:58.577+0000 7fbfe5263700 1 -- 172.21.15.32:0/3764646016 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fbfcc066510 msgr2=0x7fbfcc0689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:43:58.584 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:58.577+0000 7fbfe5263700 1 --2- 172.21.15.32:0/3764646016 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fbfcc066510 0x7fbfcc0689d0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7fbfd40011e0 tx=0x7fbfd4009040 comp rx=0 tx=0).stop 2023-10-08T13:43:58.584 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:58.577+0000 7fbfe5263700 1 -- 172.21.15.32:0/3764646016 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbfe014ae00 msgr2=0x7fbfe014b2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:43:58.584 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:58.577+0000 7fbfe5263700 1 --2- 172.21.15.32:0/3764646016 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbfe014ae00 0x7fbfe014b2b0 secure :-1 s=READY pgs=1914 cs=0 l=1 rev1=1 crypto rx=0x7fbfe004ed60 tx=0x7fbfd8004af0 comp rx=0 tx=0).stop 2023-10-08T13:43:58.584 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:58.577+0000 7fbfe5263700 1 -- 172.21.15.32:0/3764646016 shutdown_connections 2023-10-08T13:43:58.584 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:58.577+0000 7fbfe5263700 1 --2- 172.21.15.32:0/3764646016 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fbfcc066510 0x7fbfcc0689d0 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:58.584 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:58.577+0000 7fbfe5263700 1 --2- 172.21.15.32:0/3764646016 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbfe014ae00 0x7fbfe014b2b0 unknown :-1 s=CLOSED pgs=1914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:58.584 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:58.577+0000 7fbfe5263700 1 --2- 172.21.15.32:0/3764646016 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbfe015b200 0x7fbfe00c45e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:58.585 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:58.577+0000 7fbfe5263700 1 --2- 172.21.15.32:0/3764646016 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbfe006c730 0x7fbfe0071470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:58.585 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:58.577+0000 7fbfe5263700 1 -- 172.21.15.32:0/3764646016 >> 172.21.15.32:0/3764646016 conn(0x7fbfe00cb850 msgr2=0x7fbfe015a130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:43:58.585 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:58.577+0000 7fbfe5263700 1 -- 172.21.15.32:0/3764646016 shutdown_connections 2023-10-08T13:43:58.585 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:58.577+0000 7fbfe5263700 1 -- 172.21.15.32:0/3764646016 wait complete. 2023-10-08T13:43:58.585 INFO:teuthology.orchestra.run.smithi032.stderr:instructed osd(s) 0 to deep-scrub 2023-10-08T13:43:58.595 INFO:tasks.ceph:Scrubbing osd.1 2023-10-08T13:43:58.597 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2023-10-08T13:43:58.742 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:58.737+0000 7f341a81c700 1 Processor -- start 2023-10-08T13:43:58.742 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:58.737+0000 7f341a81c700 1 -- start start 2023-10-08T13:43:58.744 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:58.737+0000 7f341a81c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3414160f00 0x7f34140ad300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:43:58.744 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:58.737+0000 7f341a81c700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3414161330 con 0x7f341415e590 2023-10-08T13:43:58.744 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:58.737+0000 7f341a81c700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3414161590 con 0x7f341415d1a0 2023-10-08T13:43:58.745 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:58.737+0000 7f341a81c700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3414161e30 con 0x7f3414160f00 2023-10-08T13:43:58.745 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:58.737+0000 7f34137fe700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f341415e590 0x7f34140b0f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:37698/0 (socket says 172.21.15.32:37698) 2023-10-08T13:43:58.745 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:58.737+0000 7f34137fe700 1 -- 172.21.15.32:0/526284562 learned_addr learned my addr 172.21.15.32:0/526284562 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-08T13:43:58.745 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:58.737+0000 7f3418db9700 1 --2- 172.21.15.32:0/526284562 >> v2:172.21.15.40:3300/0 conn(0x7f3414160f00 0x7f34140ad300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:43:58.746 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:58.737+0000 7f3418db9700 1 -- 172.21.15.32:0/526284562 >> v1:172.21.15.40:6789/0 conn(0x7f341415d1a0 legacy=0x7f341406bdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:43:58.746 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:58.737+0000 7f3418db9700 1 -- 172.21.15.32:0/526284562 >> v1:172.21.15.32:6789/0 conn(0x7f341415e590 legacy=0x7f34140b0f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:43:58.746 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:58.737+0000 7f3418db9700 1 -- 172.21.15.32:0/526284562 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3414161870 con 0x7f3414160f00 2023-10-08T13:43:58.746 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:58.737+0000 7f3418db9700 1 --2- 172.21.15.32:0/526284562 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3414160f00 0x7f34140ad300 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f3404009850 tx=0x7f3404009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c0c96074469493c5 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:43:58.749 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:58.745+0000 7f3412ffd700 1 -- 172.21.15.32:0/526284562 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3404010790 con 0x7f3414160f00 2023-10-08T13:43:58.751 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:58.745+0000 7f3412ffd700 1 -- 172.21.15.32:0/526284562 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34040108f0 con 0x7f3414160f00 2023-10-08T13:43:58.751 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:58.745+0000 7f3412ffd700 1 -- 172.21.15.32:0/526284562 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3404010ca0 con 0x7f3414160f00 2023-10-08T13:43:58.751 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:58.745+0000 7f341a81c700 1 -- 172.21.15.32:0/526284562 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3414160f00 msgr2=0x7f34140ad300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:43:58.751 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:58.745+0000 7f341a81c700 1 --2- 172.21.15.32:0/526284562 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3414160f00 0x7f34140ad300 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f3404009850 tx=0x7f3404009b60 comp rx=0 tx=0).stop 2023-10-08T13:43:58.751 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:58.745+0000 7f341a81c700 1 -- 172.21.15.32:0/526284562 shutdown_connections 2023-10-08T13:43:58.751 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:58.745+0000 7f341a81c700 1 --2- 172.21.15.32:0/526284562 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3414160f00 0x7f34140ad300 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:58.752 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:58.745+0000 7f341a81c700 1 -- 172.21.15.32:0/526284562 >> 172.21.15.32:0/526284562 conn(0x7f34140cb840 msgr2=0x7f34140cbc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:43:58.752 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:58.745+0000 7f341a81c700 1 -- 172.21.15.32:0/526284562 shutdown_connections 2023-10-08T13:43:58.752 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:58.745+0000 7f341a81c700 1 -- 172.21.15.32:0/526284562 wait complete. 2023-10-08T13:43:58.752 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:58.745+0000 7f341a81c700 1 Processor -- start 2023-10-08T13:43:58.753 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:58.745+0000 7f341a81c700 1 -- start start 2023-10-08T13:43:58.753 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:58.749+0000 7f341a81c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f341415d1a0 0x7f3414158ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:43:58.754 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:58.749+0000 7f341a81c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f341415e590 0x7f3414071000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:43:58.754 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:58.749+0000 7f341a81c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3414160f00 0x7f34140afa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:43:58.754 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:58.749+0000 7f341a81c700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34141f6440 con 0x7f341415e590 2023-10-08T13:43:58.754 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:58.749+0000 7f341a81c700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34141f6720 con 0x7f3414160f00 2023-10-08T13:43:58.755 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:58.749+0000 7f341a81c700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34141f6a00 con 0x7f341415d1a0 2023-10-08T13:43:58.756 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:58.749+0000 7f34137fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f341415e590 0x7f3414071000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:43:58.756 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:58.749+0000 7f34137fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f341415e590 0x7f3414071000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:53042/0 (socket says 172.21.15.32:53042) 2023-10-08T13:43:58.756 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:58.749+0000 7f34137fe700 1 -- 172.21.15.32:0/983133983 learned_addr learned my addr 172.21.15.32:0/983133983 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T13:43:58.756 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:58.749+0000 7f3413fff700 1 --2- 172.21.15.32:0/983133983 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f341415d1a0 0x7f3414158ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:43:58.757 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:58.749+0000 7f34137fe700 1 -- 172.21.15.32:0/983133983 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f341415d1a0 msgr2=0x7f3414158ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:43:58.757 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:58.749+0000 7f34137fe700 1 --2- 172.21.15.32:0/983133983 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f341415d1a0 0x7f3414158ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:58.757 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:58.749+0000 7f34137fe700 1 -- 172.21.15.32:0/983133983 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3414160f00 msgr2=0x7f34140afa00 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-08T13:43:58.757 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:58.749+0000 7f34137fe700 1 --2- 172.21.15.32:0/983133983 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3414160f00 0x7f34140afa00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:58.758 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:58.749+0000 7f34137fe700 1 -- 172.21.15.32:0/983133983 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34040094b0 con 0x7f341415e590 2023-10-08T13:43:58.758 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:58.749+0000 7f34137fe700 1 --2- 172.21.15.32:0/983133983 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f341415e590 0x7f3414071000 secure :-1 s=READY pgs=1916 cs=0 l=1 rev1=1 crypto rx=0x7f340c001f70 tx=0x7f340c001fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:43:58.760 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:58.753+0000 7f3410ff9700 1 -- 172.21.15.32:0/983133983 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f340c00a940 con 0x7f341415e590 2023-10-08T13:43:58.761 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:58.753+0000 7f3410ff9700 1 -- 172.21.15.32:0/983133983 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f340c00aac0 con 0x7f341415e590 2023-10-08T13:43:58.761 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:58.753+0000 7f341a81c700 1 -- 172.21.15.32:0/983133983 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34141f6ce0 con 0x7f341415e590 2023-10-08T13:43:58.762 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:58.753+0000 7f341a81c700 1 -- 172.21.15.32:0/983133983 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3414071b40 con 0x7f341415e590 2023-10-08T13:43:58.762 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:58.753+0000 7f3410ff9700 1 -- 172.21.15.32:0/983133983 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f340c00ae70 con 0x7f341415e590 2023-10-08T13:43:58.762 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:58.757+0000 7f3410ff9700 1 -- 172.21.15.32:0/983133983 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f340c01c3b0 con 0x7f341415e590 2023-10-08T13:43:58.763 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:58.757+0000 7f3410ff9700 1 --2- 172.21.15.32:0/983133983 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f33fc0666f0 0x7f33fc068bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:43:58.763 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:58.757+0000 7f3410ff9700 1 -- 172.21.15.32:0/983133983 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f340c083950 con 0x7f341415e590 2023-10-08T13:43:58.764 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:58.757+0000 7f3413fff700 1 --2- 172.21.15.32:0/983133983 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f33fc0666f0 0x7f33fc068bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:43:58.764 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:58.757+0000 7f3413fff700 1 --2- 172.21.15.32:0/983133983 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f33fc0666f0 0x7f33fc068bb0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f3408000f60 tx=0x7f3408009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:43:58.765 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:58.761+0000 7f341a81c700 1 --2- 172.21.15.32:0/983133983 >> [v2:172.21.15.32:6816/990576767,v1:172.21.15.32:6817/990576767] conn(0x7f34000015e0 0x7f3400003aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:43:58.766 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:58.761+0000 7f341a81c700 1 -- 172.21.15.32:0/983133983 --> [v2:172.21.15.32:6816/990576767,v1:172.21.15.32:6817/990576767] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3400006bf0 con 0x7f34000015e0 2023-10-08T13:43:58.766 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:58.761+0000 7f3418db9700 1 --2- 172.21.15.32:0/983133983 >> [v2:172.21.15.32:6816/990576767,v1:172.21.15.32:6817/990576767] conn(0x7f34000015e0 0x7f3400003aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:43:58.766 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:58.761+0000 7f3418db9700 1 --2- 172.21.15.32:0/983133983 >> [v2:172.21.15.32:6816/990576767,v1:172.21.15.32:6817/990576767] conn(0x7f34000015e0 0x7f3400003aa0 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:43:58.767 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:58.761+0000 7f3410ff9700 1 -- 172.21.15.32:0/983133983 <== osd.1 v2:172.21.15.32:6816/990576767 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f3400006bf0 con 0x7f34000015e0 2023-10-08T13:43:58.781 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:58.777+0000 7f341a81c700 1 -- 172.21.15.32:0/983133983 --> [v2:172.21.15.32:6816/990576767,v1:172.21.15.32:6817/990576767] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f33f4000fb0 con 0x7f34000015e0 2023-10-08T13:43:58.782 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:58.777+0000 7f3410ff9700 1 -- 172.21.15.32:0/983133983 <== osd.1 v2:172.21.15.32:6816/990576767 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f33f4000fb0 con 0x7f34000015e0 2023-10-08T13:43:58.782 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2023-10-08T13:43:58.782 INFO:teuthology.orchestra.run.smithi032.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-08T13:43:58.783 INFO:teuthology.orchestra.run.smithi032.stdout:} 2023-10-08T13:43:58.783 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:58.777+0000 7f341a81c700 1 -- 172.21.15.32:0/983133983 >> [v2:172.21.15.32:6816/990576767,v1:172.21.15.32:6817/990576767] conn(0x7f34000015e0 msgr2=0x7f3400003aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:43:58.784 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:58.777+0000 7f341a81c700 1 --2- 172.21.15.32:0/983133983 >> [v2:172.21.15.32:6816/990576767,v1:172.21.15.32:6817/990576767] conn(0x7f34000015e0 0x7f3400003aa0 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:58.784 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:58.777+0000 7f341a81c700 1 -- 172.21.15.32:0/983133983 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f33fc0666f0 msgr2=0x7f33fc068bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:43:58.784 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:58.777+0000 7f341a81c700 1 --2- 172.21.15.32:0/983133983 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f33fc0666f0 0x7f33fc068bb0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f3408000f60 tx=0x7f3408009040 comp rx=0 tx=0).stop 2023-10-08T13:43:58.784 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:58.777+0000 7f341a81c700 1 -- 172.21.15.32:0/983133983 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f341415e590 msgr2=0x7f3414071000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:43:58.785 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:58.777+0000 7f341a81c700 1 --2- 172.21.15.32:0/983133983 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f341415e590 0x7f3414071000 secure :-1 s=READY pgs=1916 cs=0 l=1 rev1=1 crypto rx=0x7f340c001f70 tx=0x7f340c001fa0 comp rx=0 tx=0).stop 2023-10-08T13:43:58.785 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:58.777+0000 7f3418db9700 1 -- 172.21.15.32:0/983133983 reap_dead start 2023-10-08T13:43:58.785 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:58.777+0000 7f341a81c700 1 -- 172.21.15.32:0/983133983 shutdown_connections 2023-10-08T13:43:58.785 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:58.777+0000 7f341a81c700 1 -- 172.21.15.32:0/983133983 >> 172.21.15.32:0/983133983 conn(0x7f34140cb840 msgr2=0x7f341415ea40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:43:58.785 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:58.777+0000 7f341a81c700 1 -- 172.21.15.32:0/983133983 shutdown_connections 2023-10-08T13:43:58.785 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:58.777+0000 7f341a81c700 1 -- 172.21.15.32:0/983133983 wait complete. 2023-10-08T13:43:58.794 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2023-10-08T13:43:58.909 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:58.901+0000 7f6c66eaa700 1 Processor -- start 2023-10-08T13:43:58.910 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:58.905+0000 7f6c66eaa700 1 -- start start 2023-10-08T13:43:58.910 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:58.905+0000 7f6c66eaa700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f6c60159ed0 0x7f6c600ca9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:43:58.911 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:58.905+0000 7f6c66eaa700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c600cca40 con 0x7f6c6015a2b0 2023-10-08T13:43:58.911 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:58.905+0000 7f6c66eaa700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c600cdf60 con 0x7f6c600c98c0 2023-10-08T13:43:58.911 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:58.905+0000 7f6c66eaa700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c600ccdb0 con 0x7f6c60159ed0 2023-10-08T13:43:58.912 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:58.905+0000 7f6c666a9700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f6c600c98c0 0x7f6c600cb510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.32:47394/0 (socket says 172.21.15.32:47394) 2023-10-08T13:43:58.912 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:58.905+0000 7f6c666a9700 1 -- 172.21.15.32:0/1063009151 learned_addr learned my addr 172.21.15.32:0/1063009151 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-08T13:43:58.912 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:58.905+0000 7f6c65ea8700 1 --2- 172.21.15.32:0/1063009151 >> v2:172.21.15.32:3300/0 conn(0x7f6c60159ed0 0x7f6c600ca9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:43:58.912 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:58.905+0000 7f6c656a7700 1 --1- 172.21.15.32:0/1063009151 >> v1:172.21.15.32:6789/0 conn(0x7f6c6015a2b0 0x7f6c600706f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:37704/0 (socket says 172.21.15.32:37704) 2023-10-08T13:43:58.913 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:58.905+0000 7f6c65ea8700 1 -- 172.21.15.32:0/1063009151 >> v1:172.21.15.40:6789/0 conn(0x7f6c600c98c0 legacy=0x7f6c600cb510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:43:58.913 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:58.905+0000 7f6c65ea8700 1 -- 172.21.15.32:0/1063009151 >> v1:172.21.15.32:6789/0 conn(0x7f6c6015a2b0 legacy=0x7f6c600706f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:43:58.913 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:58.905+0000 7f6c65ea8700 1 -- 172.21.15.32:0/1063009151 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c600ce240 con 0x7f6c60159ed0 2023-10-08T13:43:58.913 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:58.905+0000 7f6c65ea8700 1 --2- 172.21.15.32:0/1063009151 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6c60159ed0 0x7f6c600ca9b0 secure :-1 s=READY pgs=1918 cs=0 l=1 rev1=1 crypto rx=0x7f6c5800b050 tx=0x7f6c5800b360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc5cd62db472e5d3 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:43:58.921 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:58.913+0000 7f6c64ea6700 1 -- 172.21.15.32:0/1063009151 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c5800e070 con 0x7f6c60159ed0 2023-10-08T13:43:58.922 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:58.913+0000 7f6c64ea6700 1 -- 172.21.15.32:0/1063009151 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c58003a40 con 0x7f6c60159ed0 2023-10-08T13:43:58.922 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:58.913+0000 7f6c64ea6700 1 -- 172.21.15.32:0/1063009151 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c58003dd0 con 0x7f6c60159ed0 2023-10-08T13:43:58.922 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:58.917+0000 7f6c66eaa700 1 -- 172.21.15.32:0/1063009151 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6c60159ed0 msgr2=0x7f6c600ca9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:43:58.923 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:58.917+0000 7f6c66eaa700 1 --2- 172.21.15.32:0/1063009151 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6c60159ed0 0x7f6c600ca9b0 secure :-1 s=READY pgs=1918 cs=0 l=1 rev1=1 crypto rx=0x7f6c5800b050 tx=0x7f6c5800b360 comp rx=0 tx=0).stop 2023-10-08T13:43:58.923 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:58.917+0000 7f6c66eaa700 1 -- 172.21.15.32:0/1063009151 shutdown_connections 2023-10-08T13:43:58.923 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:58.917+0000 7f6c66eaa700 1 --2- 172.21.15.32:0/1063009151 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6c60159ed0 0x7f6c600ca9b0 unknown :-1 s=CLOSED pgs=1918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:58.923 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:58.917+0000 7f6c66eaa700 1 -- 172.21.15.32:0/1063009151 >> 172.21.15.32:0/1063009151 conn(0x7f6c600b0900 msgr2=0x7f6c600b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:43:58.923 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:58.917+0000 7f6c66eaa700 1 -- 172.21.15.32:0/1063009151 shutdown_connections 2023-10-08T13:43:58.923 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:58.917+0000 7f6c66eaa700 1 -- 172.21.15.32:0/1063009151 wait complete. 2023-10-08T13:43:58.924 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:58.917+0000 7f6c66eaa700 1 Processor -- start 2023-10-08T13:43:58.924 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:58.917+0000 7f6c66eaa700 1 -- start start 2023-10-08T13:43:58.925 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:58.917+0000 7f6c66eaa700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6c600c98c0 0x7f6c600adf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:43:58.925 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:58.917+0000 7f6c66eaa700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6c60159ed0 0x7f6c600c4970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:43:58.925 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:58.917+0000 7f6c66eaa700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6c6015a2b0 0x7f6c600c4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:43:58.926 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:58.917+0000 7f6c66eaa700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c600caef0 con 0x7f6c60159ed0 2023-10-08T13:43:58.926 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:58.917+0000 7f6c66eaa700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c600ae480 con 0x7f6c600c98c0 2023-10-08T13:43:58.926 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:58.917+0000 7f6c66eaa700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c600b2b40 con 0x7f6c6015a2b0 2023-10-08T13:43:58.927 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:58.921+0000 7f6c666a9700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6c6015a2b0 0x7f6c600c4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:43:58.927 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:58.921+0000 7f6c666a9700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6c6015a2b0 0x7f6c600c4eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.32:51186/0 (socket says 172.21.15.32:51186) 2023-10-08T13:43:58.928 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:58.921+0000 7f6c666a9700 1 -- 172.21.15.32:0/509331225 learned_addr learned my addr 172.21.15.32:0/509331225 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T13:43:58.928 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:58.921+0000 7f6c65ea8700 1 --2- 172.21.15.32:0/509331225 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6c600c98c0 0x7f6c600adf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:43:58.928 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:58.921+0000 7f6c656a7700 1 --2- 172.21.15.32:0/509331225 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6c60159ed0 0x7f6c600c4970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:43:58.928 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:58.921+0000 7f6c666a9700 1 -- 172.21.15.32:0/509331225 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6c600c98c0 msgr2=0x7f6c600adf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:43:58.929 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:58.921+0000 7f6c666a9700 1 --2- 172.21.15.32:0/509331225 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6c600c98c0 0x7f6c600adf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:58.929 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:58.921+0000 7f6c666a9700 1 -- 172.21.15.32:0/509331225 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6c60159ed0 msgr2=0x7f6c600c4970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:43:58.929 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:58.921+0000 7f6c666a9700 1 --2- 172.21.15.32:0/509331225 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6c60159ed0 0x7f6c600c4970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:58.930 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:58.921+0000 7f6c666a9700 1 -- 172.21.15.32:0/509331225 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c58009a70 con 0x7f6c6015a2b0 2023-10-08T13:43:58.930 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:58.921+0000 7f6c666a9700 1 --2- 172.21.15.32:0/509331225 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6c6015a2b0 0x7f6c600c4eb0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f6c5c00c780 tx=0x7f6c5c00ca90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:43:58.933 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:58.929+0000 7f6c567fc700 1 -- 172.21.15.32:0/509331225 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c5c004ca0 con 0x7f6c6015a2b0 2023-10-08T13:43:58.934 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:58.929+0000 7f6c66eaa700 1 -- 172.21.15.32:0/509331225 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c600b2e20 con 0x7f6c6015a2b0 2023-10-08T13:43:58.934 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:58.929+0000 7f6c66eaa700 1 -- 172.21.15.32:0/509331225 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c600b33e0 con 0x7f6c6015a2b0 2023-10-08T13:43:58.934 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:58.929+0000 7f6c567fc700 1 -- 172.21.15.32:0/509331225 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c5c004e00 con 0x7f6c6015a2b0 2023-10-08T13:43:58.934 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:58.929+0000 7f6c567fc700 1 -- 172.21.15.32:0/509331225 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c5c007310 con 0x7f6c6015a2b0 2023-10-08T13:43:58.935 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:58.929+0000 7f6c66eaa700 1 -- 172.21.15.32:0/509331225 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c48005310 con 0x7f6c6015a2b0 2023-10-08T13:43:58.936 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:58.929+0000 7f6c567fc700 1 -- 172.21.15.32:0/509331225 <== mon.2 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f6c5c007470 con 0x7f6c6015a2b0 2023-10-08T13:43:58.937 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:58.929+0000 7f6c567fc700 1 --2- 172.21.15.32:0/509331225 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f6c44066560 0x7f6c44068a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:43:58.937 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:58.929+0000 7f6c567fc700 1 -- 172.21.15.32:0/509331225 <== mon.2 v2:172.21.15.40:3301/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f6c5c0836e0 con 0x7f6c6015a2b0 2023-10-08T13:43:58.937 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:58.929+0000 7f6c65ea8700 1 --2- 172.21.15.32:0/509331225 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f6c44066560 0x7f6c44068a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:43:58.937 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:58.929+0000 7f6c65ea8700 1 --2- 172.21.15.32:0/509331225 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f6c44066560 0x7f6c44068a20 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f6c58000f80 tx=0x7f6c58011000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:43:58.944 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:58.937+0000 7f6c567fc700 1 -- 172.21.15.32:0/509331225 <== mon.2 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f6c5c050f40 con 0x7f6c6015a2b0 2023-10-08T13:43:59.126 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.121+0000 7f6c66eaa700 1 -- 172.21.15.32:0/509331225 --> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f6c48000bc0 con 0x7f6c44066560 2023-10-08T13:43:59.127 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.121+0000 7f6c567fc700 1 -- 172.21.15.32:0/509331225 <== mgr.4107 v2:172.21.15.32:6832/2601628338 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f6c48000bc0 con 0x7f6c44066560 2023-10-08T13:43:59.129 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.121+0000 7f6c66eaa700 1 -- 172.21.15.32:0/509331225 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f6c44066560 msgr2=0x7f6c44068a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:43:59.129 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.121+0000 7f6c66eaa700 1 --2- 172.21.15.32:0/509331225 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f6c44066560 0x7f6c44068a20 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f6c58000f80 tx=0x7f6c58011000 comp rx=0 tx=0).stop 2023-10-08T13:43:59.129 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.121+0000 7f6c66eaa700 1 -- 172.21.15.32:0/509331225 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6c6015a2b0 msgr2=0x7f6c600c4eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:43:59.129 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.121+0000 7f6c66eaa700 1 --2- 172.21.15.32:0/509331225 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6c6015a2b0 0x7f6c600c4eb0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f6c5c00c780 tx=0x7f6c5c00ca90 comp rx=0 tx=0).stop 2023-10-08T13:43:59.129 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.121+0000 7f6c66eaa700 1 -- 172.21.15.32:0/509331225 shutdown_connections 2023-10-08T13:43:59.129 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.121+0000 7f6c66eaa700 1 --2- 172.21.15.32:0/509331225 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f6c44066560 0x7f6c44068a20 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:59.130 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.121+0000 7f6c66eaa700 1 --2- 172.21.15.32:0/509331225 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6c60159ed0 0x7f6c600c4970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:59.130 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.121+0000 7f6c66eaa700 1 --2- 172.21.15.32:0/509331225 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6c6015a2b0 0x7f6c600c4eb0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:59.130 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.121+0000 7f6c66eaa700 1 --2- 172.21.15.32:0/509331225 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6c600c98c0 0x7f6c600adf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:59.130 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.121+0000 7f6c66eaa700 1 -- 172.21.15.32:0/509331225 >> 172.21.15.32:0/509331225 conn(0x7f6c600b0900 msgr2=0x7f6c600affd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:43:59.130 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.121+0000 7f6c66eaa700 1 -- 172.21.15.32:0/509331225 shutdown_connections 2023-10-08T13:43:59.130 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.121+0000 7f6c66eaa700 1 -- 172.21.15.32:0/509331225 wait complete. 2023-10-08T13:43:59.131 INFO:teuthology.orchestra.run.smithi032.stderr:instructed osd(s) 1 to deep-scrub 2023-10-08T13:43:59.139 INFO:tasks.ceph:Scrubbing osd.2 2023-10-08T13:43:59.140 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2023-10-08T13:43:59.260 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.253+0000 7fe342ec9700 1 Processor -- start 2023-10-08T13:43:59.260 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.253+0000 7fe342ec9700 1 -- start start 2023-10-08T13:43:59.261 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.253+0000 7fe342ec9700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe33c165250 0x7fe33c165630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:43:59.261 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.253+0000 7fe342ec9700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe33c1618c0 0x7fe33c0cce00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:43:59.261 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.253+0000 7fe342ec9700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fe33c0c1e80 0x7fe33c0cd340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:43:59.261 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.253+0000 7fe342ec9700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe33c0cb660 con 0x7fe33c0c1e80 2023-10-08T13:43:59.261 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.253+0000 7fe342ec9700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe33c166200 con 0x7fe33c1618c0 2023-10-08T13:43:59.261 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.253+0000 7fe342ec9700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe33c165f20 con 0x7fe33c165250 2023-10-08T13:43:59.261 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.253+0000 7fe341466700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fe33c0c1e80 0x7fe33c0cd340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:43:59.262 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.253+0000 7fe340c65700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe33c165250 0x7fe33c165630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:43:59.262 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.253+0000 7fe341466700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fe33c0c1e80 0x7fe33c0cd340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:53070/0 (socket says 172.21.15.32:53070) 2023-10-08T13:43:59.262 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.253+0000 7fe341466700 1 -- 172.21.15.32:0/3977528747 learned_addr learned my addr 172.21.15.32:0/3977528747 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T13:43:59.262 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.253+0000 7fe33bfff700 1 --2- 172.21.15.32:0/3977528747 >> v2:172.21.15.40:3300/0 conn(0x7fe33c1618c0 0x7fe33c0cce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:43:59.262 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.253+0000 7fe341466700 1 -- 172.21.15.32:0/3977528747 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe33c165250 msgr2=0x7fe33c165630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:43:59.262 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.253+0000 7fe341466700 1 --2- 172.21.15.32:0/3977528747 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe33c165250 0x7fe33c165630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:59.262 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.253+0000 7fe341466700 1 -- 172.21.15.32:0/3977528747 >> v2:172.21.15.40:3300/0 conn(0x7fe33c1618c0 msgr2=0x7fe33c0cce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:43:59.263 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.253+0000 7fe341466700 1 --2- 172.21.15.32:0/3977528747 >> v2:172.21.15.40:3300/0 conn(0x7fe33c1618c0 0x7fe33c0cce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:59.263 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.253+0000 7fe341466700 1 -- 172.21.15.32:0/3977528747 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe33c06b6f0 con 0x7fe33c0c1e80 2023-10-08T13:43:59.263 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.253+0000 7fe340c65700 1 --2- 172.21.15.32:0/3977528747 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe33c165250 0x7fe33c165630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:43:59.263 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.253+0000 7fe33bfff700 1 --2- 172.21.15.32:0/3977528747 >> v2:172.21.15.40:3300/0 conn(0x7fe33c1618c0 0x7fe33c0cce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T13:43:59.263 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.253+0000 7fe341466700 1 --2- 172.21.15.32:0/3977528747 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe33c0c1e80 0x7fe33c0cd340 secure :-1 s=READY pgs=1919 cs=0 l=1 rev1=1 crypto rx=0x7fe33c0cfc30 tx=0x7fe33400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=259e624aec157491 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:43:59.264 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.257+0000 7fe33b7fe700 1 -- 172.21.15.32:0/3977528747 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe33400e070 con 0x7fe33c0c1e80 2023-10-08T13:43:59.264 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.257+0000 7fe33b7fe700 1 -- 172.21.15.32:0/3977528747 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe33400b910 con 0x7fe33c0c1e80 2023-10-08T13:43:59.264 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.257+0000 7fe342ec9700 1 -- 172.21.15.32:0/3977528747 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe33c0c1e80 msgr2=0x7fe33c0cd340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:43:59.264 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.257+0000 7fe342ec9700 1 --2- 172.21.15.32:0/3977528747 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe33c0c1e80 0x7fe33c0cd340 secure :-1 s=READY pgs=1919 cs=0 l=1 rev1=1 crypto rx=0x7fe33c0cfc30 tx=0x7fe33400b330 comp rx=0 tx=0).stop 2023-10-08T13:43:59.265 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.257+0000 7fe342ec9700 1 -- 172.21.15.32:0/3977528747 shutdown_connections 2023-10-08T13:43:59.265 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.257+0000 7fe342ec9700 1 --2- 172.21.15.32:0/3977528747 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe33c0c1e80 0x7fe33c0cd340 unknown :-1 s=CLOSED pgs=1919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:59.265 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.257+0000 7fe342ec9700 1 --2- 172.21.15.32:0/3977528747 >> v2:172.21.15.40:3300/0 conn(0x7fe33c1618c0 0x7fe33c0cce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:59.265 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.257+0000 7fe342ec9700 1 --2- 172.21.15.32:0/3977528747 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe33c165250 0x7fe33c165630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:59.265 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.257+0000 7fe342ec9700 1 -- 172.21.15.32:0/3977528747 >> 172.21.15.32:0/3977528747 conn(0x7fe33c0ced20 msgr2=0x7fe33c0cf100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:43:59.265 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.257+0000 7fe342ec9700 1 -- 172.21.15.32:0/3977528747 shutdown_connections 2023-10-08T13:43:59.266 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.257+0000 7fe342ec9700 1 -- 172.21.15.32:0/3977528747 wait complete. 2023-10-08T13:43:59.267 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.257+0000 7fe342ec9700 1 Processor -- start 2023-10-08T13:43:59.267 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.257+0000 7fe342ec9700 1 -- start start 2023-10-08T13:43:59.267 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.261+0000 7fe342ec9700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe33c1618c0 0x7fe33c0c2d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:43:59.267 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.261+0000 7fe342ec9700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe33c165250 0x7fe33c0c49f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:43:59.267 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.261+0000 7fe342ec9700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe33c0c32c0 0x7fe33c0c4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:43:59.268 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.261+0000 7fe342ec9700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe33c15de80 con 0x7fe33c165250 2023-10-08T13:43:59.268 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.261+0000 7fe342ec9700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe33c0c5470 con 0x7fe33c0c32c0 2023-10-08T13:43:59.268 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.261+0000 7fe342ec9700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe33c15d200 con 0x7fe33c1618c0 2023-10-08T13:43:59.268 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.261+0000 7fe341466700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe33c0c32c0 0x7fe33c0c4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:43:59.269 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.261+0000 7fe341466700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe33c0c32c0 0x7fe33c0c4f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.32:60440/0 (socket says 172.21.15.32:60440) 2023-10-08T13:43:59.269 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.261+0000 7fe341466700 1 -- 172.21.15.32:0/1862319533 learned_addr learned my addr 172.21.15.32:0/1862319533 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T13:43:59.269 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.261+0000 7fe340c65700 1 --2- 172.21.15.32:0/1862319533 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe33c1618c0 0x7fe33c0c2d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:43:59.270 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.261+0000 7fe33bfff700 1 --2- 172.21.15.32:0/1862319533 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe33c165250 0x7fe33c0c49f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:43:59.270 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.261+0000 7fe341466700 1 -- 172.21.15.32:0/1862319533 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe33c1618c0 msgr2=0x7fe33c0c2d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:43:59.270 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.261+0000 7fe341466700 1 --2- 172.21.15.32:0/1862319533 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe33c1618c0 0x7fe33c0c2d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:59.270 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.261+0000 7fe341466700 1 -- 172.21.15.32:0/1862319533 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe33c165250 msgr2=0x7fe33c0c49f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:43:59.271 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.261+0000 7fe341466700 1 --2- 172.21.15.32:0/1862319533 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe33c165250 0x7fe33c0c49f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:59.271 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.261+0000 7fe341466700 1 -- 172.21.15.32:0/1862319533 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe32c0094b0 con 0x7fe33c0c32c0 2023-10-08T13:43:59.271 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.261+0000 7fe340c65700 1 --2- 172.21.15.32:0/1862319533 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe33c1618c0 0x7fe33c0c2d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:43:59.271 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.261+0000 7fe33bfff700 1 --2- 172.21.15.32:0/1862319533 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe33c165250 0x7fe33c0c49f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:43:59.271 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.261+0000 7fe341466700 1 --2- 172.21.15.32:0/1862319533 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe33c0c32c0 0x7fe33c0c4f30 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7fe33400b370 tx=0x7fe334004af0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:43:59.273 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.269+0000 7fe3397fa700 1 -- 172.21.15.32:0/1862319533 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe33401c640 con 0x7fe33c0c32c0 2023-10-08T13:43:59.273 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.269+0000 7fe3397fa700 1 -- 172.21.15.32:0/1862319533 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe33400b910 con 0x7fe33c0c32c0 2023-10-08T13:43:59.274 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.269+0000 7fe3397fa700 1 -- 172.21.15.32:0/1862319533 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe33401c9e0 con 0x7fe33c0c32c0 2023-10-08T13:43:59.274 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.269+0000 7fe342ec9700 1 -- 172.21.15.32:0/1862319533 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe334009b30 con 0x7fe33c0c32c0 2023-10-08T13:43:59.274 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.269+0000 7fe342ec9700 1 -- 172.21.15.32:0/1862319533 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe33c165cf0 con 0x7fe33c0c32c0 2023-10-08T13:43:59.276 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.269+0000 7fe342ec9700 1 -- 172.21.15.32:0/1862319533 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe33c165b70 con 0x7fe33c0c32c0 2023-10-08T13:43:59.276 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.269+0000 7fe3397fa700 1 -- 172.21.15.32:0/1862319533 <== mon.1 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fe33401cb40 con 0x7fe33c0c32c0 2023-10-08T13:43:59.277 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.269+0000 7fe3397fa700 1 --2- 172.21.15.32:0/1862319533 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fe328066560 0x7fe328068a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:43:59.277 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.269+0000 7fe3397fa700 1 -- 172.21.15.32:0/1862319533 <== mon.1 v2:172.21.15.40:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fe334085000 con 0x7fe33c0c32c0 2023-10-08T13:43:59.278 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.269+0000 7fe340c65700 1 --2- 172.21.15.32:0/1862319533 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fe328066560 0x7fe328068a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:43:59.278 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.269+0000 7fe3397fa700 1 --2- 172.21.15.32:0/1862319533 >> [v2:172.21.15.32:6824/1566874440,v1:172.21.15.32:6825/1566874440] conn(0x7fe32806c3c0 0x7fe32806e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:43:59.278 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.269+0000 7fe33bfff700 1 --2- 172.21.15.32:0/1862319533 >> [v2:172.21.15.32:6824/1566874440,v1:172.21.15.32:6825/1566874440] conn(0x7fe32806c3c0 0x7fe32806e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:43:59.278 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.269+0000 7fe3397fa700 1 -- 172.21.15.32:0/1862319533 --> [v2:172.21.15.32:6824/1566874440,v1:172.21.15.32:6825/1566874440] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe32806ee90 con 0x7fe32806c3c0 2023-10-08T13:43:59.279 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.269+0000 7fe3397fa700 1 -- 172.21.15.32:0/1862319533 <== mon.1 v2:172.21.15.40:3300/0 6 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe334087920 con 0x7fe33c0c32c0 2023-10-08T13:43:59.279 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.269+0000 7fe340c65700 1 --2- 172.21.15.32:0/1862319533 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fe328066560 0x7fe328068a20 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7fe33c159850 tx=0x7fe32c009240 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:43:59.279 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.269+0000 7fe33bfff700 1 --2- 172.21.15.32:0/1862319533 >> [v2:172.21.15.32:6824/1566874440,v1:172.21.15.32:6825/1566874440] conn(0x7fe32806c3c0 0x7fe32806e7e0 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:43:59.279 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.273+0000 7fe3397fa700 1 -- 172.21.15.32:0/1862319533 <== osd.2 v2:172.21.15.32:6824/1566874440 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7fe32806ee90 con 0x7fe32806c3c0 2023-10-08T13:43:59.293 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.285+0000 7fe342ec9700 1 -- 172.21.15.32:0/1862319533 --> [v2:172.21.15.32:6824/1566874440,v1:172.21.15.32:6825/1566874440] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fe33c06b9d0 con 0x7fe32806c3c0 2023-10-08T13:43:59.293 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.285+0000 7fe3397fa700 1 -- 172.21.15.32:0/1862319533 <== osd.2 v2:172.21.15.32:6824/1566874440 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fe33000a760 con 0x7fe32806c3c0 2023-10-08T13:43:59.293 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2023-10-08T13:43:59.294 INFO:teuthology.orchestra.run.smithi032.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-08T13:43:59.294 INFO:teuthology.orchestra.run.smithi032.stdout:} 2023-10-08T13:43:59.295 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.289+0000 7fe342ec9700 1 -- 172.21.15.32:0/1862319533 >> [v2:172.21.15.32:6824/1566874440,v1:172.21.15.32:6825/1566874440] conn(0x7fe32806c3c0 msgr2=0x7fe32806e7e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:43:59.295 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.289+0000 7fe342ec9700 1 --2- 172.21.15.32:0/1862319533 >> [v2:172.21.15.32:6824/1566874440,v1:172.21.15.32:6825/1566874440] conn(0x7fe32806c3c0 0x7fe32806e7e0 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:59.295 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.289+0000 7fe342ec9700 1 -- 172.21.15.32:0/1862319533 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fe328066560 msgr2=0x7fe328068a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:43:59.295 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.289+0000 7fe342ec9700 1 --2- 172.21.15.32:0/1862319533 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fe328066560 0x7fe328068a20 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7fe33c159850 tx=0x7fe32c009240 comp rx=0 tx=0).stop 2023-10-08T13:43:59.296 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.289+0000 7fe342ec9700 1 -- 172.21.15.32:0/1862319533 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe33c0c32c0 msgr2=0x7fe33c0c4f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:43:59.296 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.289+0000 7fe342ec9700 1 --2- 172.21.15.32:0/1862319533 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe33c0c32c0 0x7fe33c0c4f30 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7fe33400b370 tx=0x7fe334004af0 comp rx=0 tx=0).stop 2023-10-08T13:43:59.296 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.289+0000 7fe341466700 1 -- 172.21.15.32:0/1862319533 reap_dead start 2023-10-08T13:43:59.296 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.289+0000 7fe342ec9700 1 -- 172.21.15.32:0/1862319533 shutdown_connections 2023-10-08T13:43:59.296 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.289+0000 7fe342ec9700 1 -- 172.21.15.32:0/1862319533 >> 172.21.15.32:0/1862319533 conn(0x7fe33c0ced20 msgr2=0x7fe33c0aefe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:43:59.296 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.289+0000 7fe342ec9700 1 -- 172.21.15.32:0/1862319533 shutdown_connections 2023-10-08T13:43:59.296 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.289+0000 7fe342ec9700 1 -- 172.21.15.32:0/1862319533 wait complete. 2023-10-08T13:43:59.305 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2023-10-08T13:43:59.436 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.429+0000 7f262efe3700 1 Processor -- start 2023-10-08T13:43:59.436 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.429+0000 7f262efe3700 1 -- start start 2023-10-08T13:43:59.439 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.429+0000 7f262efe3700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f26280703c0 0x7f26280ce0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:43:59.439 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.429+0000 7f262efe3700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f26280adfc0 0x7f26280ac8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:43:59.439 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.429+0000 7f262efe3700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f262806dfc0 con 0x7f262815d600 2023-10-08T13:43:59.439 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.429+0000 7f262efe3700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26280ade50 con 0x7f26280703c0 2023-10-08T13:43:59.439 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.429+0000 7f262efe3700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f262815e800 con 0x7f26280adfc0 2023-10-08T13:43:59.440 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.429+0000 7f262dfe1700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f262815d600 0x7f26280cd9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:37716/0 (socket says 172.21.15.32:37716) 2023-10-08T13:43:59.440 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.429+0000 7f262dfe1700 1 -- 172.21.15.32:0/3545720060 learned_addr learned my addr 172.21.15.32:0/3545720060 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-08T13:43:59.440 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.429+0000 7f262d7e0700 1 --2- 172.21.15.32:0/3545720060 >> v2:172.21.15.32:3300/0 conn(0x7f26280703c0 0x7f26280ce0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:43:59.440 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.429+0000 7f262cfdf700 1 -- 172.21.15.32:0/3545720060 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2300060501 0 0) 0x7f262806dfc0 con 0x7f262815d600 2023-10-08T13:43:59.440 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.429+0000 7f262cfdf700 1 -- 172.21.15.32:0/3545720060 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f26140035d0 con 0x7f262815d600 2023-10-08T13:43:59.440 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.429+0000 7f262e7e2700 1 --2- 172.21.15.32:0/3545720060 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f26280adfc0 0x7f26280ac8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:43:59.440 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.433+0000 7f262cfdf700 1 -- 172.21.15.32:0/3545720060 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3460478187 0 0) 0x7f26140035d0 con 0x7f262815d600 2023-10-08T13:43:59.441 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.433+0000 7f262cfdf700 1 -- 172.21.15.32:0/3545720060 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f26280adfc0 msgr2=0x7f26280ac8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:43:59.441 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.433+0000 7f262cfdf700 1 --2- 172.21.15.32:0/3545720060 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f26280adfc0 0x7f26280ac8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:59.441 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.433+0000 7f262cfdf700 1 -- 172.21.15.32:0/3545720060 >> v2:172.21.15.32:3300/0 conn(0x7f26280703c0 msgr2=0x7f26280ce0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:43:59.441 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.433+0000 7f262e7e2700 1 --2- 172.21.15.32:0/3545720060 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f26280adfc0 0x7f26280ac8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T13:43:59.441 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.433+0000 7f262cfdf700 1 --2- 172.21.15.32:0/3545720060 >> v2:172.21.15.32:3300/0 conn(0x7f26280703c0 0x7f26280ce0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:59.441 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.433+0000 7f262cfdf700 1 -- 172.21.15.32:0/3545720060 --> v1:172.21.15.32:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f262806e260 con 0x7f262815d600 2023-10-08T13:43:59.442 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.433+0000 7f262cfdf700 1 -- 172.21.15.32:0/3545720060 <== mon.0 v1:172.21.15.32:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2364763317 0 0) 0x7f2624001670 con 0x7f262815d600 2023-10-08T13:43:59.442 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.433+0000 7f262cfdf700 1 -- 172.21.15.32:0/3545720060 >> v1:172.21.15.32:6789/0 conn(0x7f262815d600 legacy=0x7f26280cd9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:43:59.442 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.433+0000 7f262cfdf700 1 --2- 172.21.15.32:0/3545720060 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2614003a20 0x7f2614003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:43:59.442 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.433+0000 7f262cfdf700 1 --2- 172.21.15.32:0/3545720060 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2614004870 0x7f2614004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:43:59.442 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.433+0000 7f262cfdf700 1 --2- 172.21.15.32:0/3545720060 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f26280adfc0 0x7f2614005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:43:59.442 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.433+0000 7f262cfdf700 1 -- 172.21.15.32:0/3545720060 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26280ade50 con 0x7f2614004870 2023-10-08T13:43:59.442 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.433+0000 7f262cfdf700 1 -- 172.21.15.32:0/3545720060 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f262815e800 con 0x7f2614003a20 2023-10-08T13:43:59.443 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.433+0000 7f262cfdf700 1 -- 172.21.15.32:0/3545720060 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f261400bb10 con 0x7f26280adfc0 2023-10-08T13:43:59.443 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.433+0000 7f262d7e0700 1 --2- 172.21.15.32:0/3545720060 >> v2:172.21.15.32:3300/0 conn(0x7f26280703c0 0x7f26280ce0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:43:59.443 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.433+0000 7f262e7e2700 1 --2- 172.21.15.32:0/3545720060 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f26280adfc0 0x7f2614005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:43:59.446 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.433+0000 7f262dfe1700 1 --2- 172.21.15.32:0/3545720060 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2614003a20 0x7f2614003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:43:59.446 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.433+0000 7f262e7e2700 1 -- 172.21.15.32:0/3545720060 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2614003a20 msgr2=0x7f2614003e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:43:59.447 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.433+0000 7f262e7e2700 1 --2- 172.21.15.32:0/3545720060 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2614003a20 0x7f2614003e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:59.447 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.433+0000 7f262e7e2700 1 -- 172.21.15.32:0/3545720060 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2614004870 msgr2=0x7f2614004cf0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-08T13:43:59.447 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.433+0000 7f262d7e0700 1 --2- 172.21.15.32:0/3545720060 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2614004870 0x7f2614004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:43:59.447 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.433+0000 7f262e7e2700 1 --2- 172.21.15.32:0/3545720060 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2614004870 0x7f2614004cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:59.447 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.433+0000 7f262e7e2700 1 -- 172.21.15.32:0/3545720060 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f262806e260 con 0x7f26280adfc0 2023-10-08T13:43:59.447 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.433+0000 7f262d7e0700 1 --2- 172.21.15.32:0/3545720060 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2614004870 0x7f2614004cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T13:43:59.449 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.433+0000 7f262e7e2700 1 --2- 172.21.15.32:0/3545720060 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f26280adfc0 0x7f2614005230 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f262000a560 tx=0x7f26140058a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ce56efef21ec0c3a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:43:59.449 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.433+0000 7f262cfdf700 1 -- 172.21.15.32:0/3545720060 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f262000f070 con 0x7f26280adfc0 2023-10-08T13:43:59.450 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.433+0000 7f262cfdf700 1 -- 172.21.15.32:0/3545720060 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f262000ae40 con 0x7f26280adfc0 2023-10-08T13:43:59.450 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.433+0000 7f262cfdf700 1 -- 172.21.15.32:0/3545720060 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2620007ba0 con 0x7f26280adfc0 2023-10-08T13:43:59.450 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.433+0000 7f262efe3700 1 -- 172.21.15.32:0/3545720060 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f26280adfc0 msgr2=0x7f2614005230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:43:59.450 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.433+0000 7f262efe3700 1 --2- 172.21.15.32:0/3545720060 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f26280adfc0 0x7f2614005230 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f262000a560 tx=0x7f26140058a0 comp rx=0 tx=0).stop 2023-10-08T13:43:59.450 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.433+0000 7f262e7e2700 1 -- 172.21.15.32:0/3545720060 reap_dead start 2023-10-08T13:43:59.450 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.433+0000 7f262efe3700 1 -- 172.21.15.32:0/3545720060 shutdown_connections 2023-10-08T13:43:59.450 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.433+0000 7f262efe3700 1 -- 172.21.15.32:0/3545720060 >> 172.21.15.32:0/3545720060 conn(0x7f26280cb850 msgr2=0x7f26280cbc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:43:59.451 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.433+0000 7f262efe3700 1 -- 172.21.15.32:0/3545720060 shutdown_connections 2023-10-08T13:43:59.451 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.433+0000 7f262efe3700 1 -- 172.21.15.32:0/3545720060 wait complete. 2023-10-08T13:43:59.451 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.437+0000 7f262efe3700 1 Processor -- start 2023-10-08T13:43:59.451 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.437+0000 7f262efe3700 1 -- start start 2023-10-08T13:43:59.451 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.437+0000 7f262efe3700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2628158f50 0x7f262815b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:43:59.451 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.437+0000 7f262efe3700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2628159330 0x7f262815bb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:43:59.451 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.437+0000 7f262efe3700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f262815fcb0 0x7f2628160140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:43:59.452 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.437+0000 7f262efe3700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2628160680 con 0x7f2628158f50 2023-10-08T13:43:59.452 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.437+0000 7f262efe3700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f262815c170 con 0x7f2628159330 2023-10-08T13:43:59.452 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.437+0000 7f262efe3700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f262815c450 con 0x7f262815fcb0 2023-10-08T13:43:59.452 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.437+0000 7f262d7e0700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2628159330 0x7f262815bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:43:59.452 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.437+0000 7f262d7e0700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2628159330 0x7f262815bb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.32:60458/0 (socket says 172.21.15.32:60458) 2023-10-08T13:43:59.452 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.437+0000 7f262d7e0700 1 -- 172.21.15.32:0/3899960471 learned_addr learned my addr 172.21.15.32:0/3899960471 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T13:43:59.453 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.437+0000 7f262dfe1700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2628158f50 0x7f262815b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:43:59.453 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.437+0000 7f262d7e0700 1 -- 172.21.15.32:0/3899960471 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f262815fcb0 msgr2=0x7f2628160140 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-08T13:43:59.453 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.437+0000 7f262d7e0700 1 --2- 172.21.15.32:0/3899960471 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f262815fcb0 0x7f2628160140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:59.453 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.437+0000 7f262d7e0700 1 -- 172.21.15.32:0/3899960471 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2628158f50 msgr2=0x7f262815b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:43:59.453 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.437+0000 7f262d7e0700 1 --2- 172.21.15.32:0/3899960471 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2628158f50 0x7f262815b600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:59.453 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.437+0000 7f262d7e0700 1 -- 172.21.15.32:0/3899960471 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26280c2900 con 0x7f2628159330 2023-10-08T13:43:59.453 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.437+0000 7f262d7e0700 1 --2- 172.21.15.32:0/3899960471 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2628159330 0x7f262815bb40 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f261800f880 tx=0x7f261800fc40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:43:59.454 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.445+0000 7f261e7fc700 1 -- 172.21.15.32:0/3899960471 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f261800d850 con 0x7f2628159330 2023-10-08T13:43:59.454 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.445+0000 7f261e7fc700 1 -- 172.21.15.32:0/3899960471 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f261800c030 con 0x7f2628159330 2023-10-08T13:43:59.455 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.445+0000 7f261e7fc700 1 -- 172.21.15.32:0/3899960471 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f261800dbb0 con 0x7f2628159330 2023-10-08T13:43:59.455 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.445+0000 7f262efe3700 1 -- 172.21.15.32:0/3899960471 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26280c2be0 con 0x7f2628159330 2023-10-08T13:43:59.455 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.445+0000 7f262efe3700 1 -- 172.21.15.32:0/3899960471 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f262815cc00 con 0x7f2628159330 2023-10-08T13:43:59.455 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.449+0000 7f262efe3700 1 -- 172.21.15.32:0/3899960471 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2610005310 con 0x7f2628159330 2023-10-08T13:43:59.456 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.449+0000 7f261e7fc700 1 -- 172.21.15.32:0/3899960471 <== mon.1 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f261800dd10 con 0x7f2628159330 2023-10-08T13:43:59.456 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.449+0000 7f261e7fc700 1 --2- 172.21.15.32:0/3899960471 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f2614067900 0x7f2614069dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:43:59.456 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.449+0000 7f261e7fc700 1 -- 172.21.15.32:0/3899960471 <== mon.1 v2:172.21.15.40:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f2618083d90 con 0x7f2628159330 2023-10-08T13:43:59.457 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.449+0000 7f262dfe1700 1 --2- 172.21.15.32:0/3899960471 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f2614067900 0x7f2614069dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:43:59.457 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.449+0000 7f262dfe1700 1 --2- 172.21.15.32:0/3899960471 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f2614067900 0x7f2614069dc0 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f2624007fd0 tx=0x7f2624000ed0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:43:59.463 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.457+0000 7f261e7fc700 1 -- 172.21.15.32:0/3899960471 <== mon.1 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f26180514f0 con 0x7f2628159330 2023-10-08T13:43:59.638 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.633+0000 7f262efe3700 1 -- 172.21.15.32:0/3899960471 --> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f2610000bc0 con 0x7f2614067900 2023-10-08T13:43:59.639 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.633+0000 7f261e7fc700 1 -- 172.21.15.32:0/3899960471 <== mgr.4107 v2:172.21.15.32:6832/2601628338 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f2610000bc0 con 0x7f2614067900 2023-10-08T13:43:59.645 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.637+0000 7f262efe3700 1 -- 172.21.15.32:0/3899960471 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f2614067900 msgr2=0x7f2614069dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:43:59.645 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.637+0000 7f262efe3700 1 --2- 172.21.15.32:0/3899960471 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f2614067900 0x7f2614069dc0 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f2624007fd0 tx=0x7f2624000ed0 comp rx=0 tx=0).stop 2023-10-08T13:43:59.645 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.637+0000 7f262efe3700 1 -- 172.21.15.32:0/3899960471 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2628159330 msgr2=0x7f262815bb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:43:59.645 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.637+0000 7f262efe3700 1 --2- 172.21.15.32:0/3899960471 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2628159330 0x7f262815bb40 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f261800f880 tx=0x7f261800fc40 comp rx=0 tx=0).stop 2023-10-08T13:43:59.645 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.637+0000 7f262efe3700 1 -- 172.21.15.32:0/3899960471 shutdown_connections 2023-10-08T13:43:59.646 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.637+0000 7f262efe3700 1 --2- 172.21.15.32:0/3899960471 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f2614067900 0x7f2614069dc0 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:59.646 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.637+0000 7f262efe3700 1 --2- 172.21.15.32:0/3899960471 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f262815fcb0 0x7f2628160140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:59.646 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.637+0000 7f262efe3700 1 --2- 172.21.15.32:0/3899960471 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2628159330 0x7f262815bb40 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:59.646 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.637+0000 7f262efe3700 1 --2- 172.21.15.32:0/3899960471 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2628158f50 0x7f262815b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:59.646 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.637+0000 7f262efe3700 1 -- 172.21.15.32:0/3899960471 >> 172.21.15.32:0/3899960471 conn(0x7f26280cb850 msgr2=0x7f26280aebf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:43:59.646 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.637+0000 7f262efe3700 1 -- 172.21.15.32:0/3899960471 shutdown_connections 2023-10-08T13:43:59.646 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.637+0000 7f262efe3700 1 -- 172.21.15.32:0/3899960471 wait complete. 2023-10-08T13:43:59.647 INFO:teuthology.orchestra.run.smithi032.stderr:instructed osd(s) 2 to deep-scrub 2023-10-08T13:43:59.659 INFO:tasks.ceph:Scrubbing osd.3 2023-10-08T13:43:59.659 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2023-10-08T13:43:59.797 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.789+0000 7f6c40b24700 1 Processor -- start 2023-10-08T13:43:59.797 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.789+0000 7f6c40b24700 1 -- start start 2023-10-08T13:43:59.798 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.793+0000 7f6c40b24700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6c3c065e90 0x7f6c3c0cb8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:43:59.799 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.793+0000 7f6c40b24700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c3c0cab70 con 0x7f6c3c06a9b0 2023-10-08T13:43:59.799 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.793+0000 7f6c40b24700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c3c070600 con 0x7f6c3c15b130 2023-10-08T13:43:59.799 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.793+0000 7f6c40b24700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c3c0cae10 con 0x7f6c3c065e90 2023-10-08T13:43:59.799 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.793+0000 7f6c3bfff700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f6c3c06a9b0 0x7f6c3c0c9ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:37732/0 (socket says 172.21.15.32:37732) 2023-10-08T13:43:59.799 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.793+0000 7f6c3bfff700 1 -- 172.21.15.32:0/577854381 learned_addr learned my addr 172.21.15.32:0/577854381 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-08T13:43:59.799 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.793+0000 7f6c3affd700 1 --2- 172.21.15.32:0/577854381 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6c3c065e90 0x7f6c3c0cb8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:43:59.800 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.793+0000 7f6c3a7fc700 1 -- 172.21.15.32:0/577854381 <== mon.1 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1522466737 0 0) 0x7f6c3c070600 con 0x7f6c3c15b130 2023-10-08T13:43:59.800 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.793+0000 7f6c3a7fc700 1 -- 172.21.15.32:0/577854381 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6c240035d0 con 0x7f6c3c15b130 2023-10-08T13:43:59.800 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.793+0000 7f6c3affd700 1 -- 172.21.15.32:0/577854381 >> v1:172.21.15.40:6789/0 conn(0x7f6c3c15b130 legacy=0x7f6c3c06a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:43:59.800 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.793+0000 7f6c3affd700 1 -- 172.21.15.32:0/577854381 >> v1:172.21.15.32:6789/0 conn(0x7f6c3c06a9b0 legacy=0x7f6c3c0c9ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:43:59.800 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.793+0000 7f6c3affd700 1 -- 172.21.15.32:0/577854381 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c3c0d0260 con 0x7f6c3c065e90 2023-10-08T13:43:59.801 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.793+0000 7f6c3affd700 1 --2- 172.21.15.32:0/577854381 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6c3c065e90 0x7f6c3c0cb8b0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f6c2c009880 tx=0x7f6c2c009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8835a49d52c043a4 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:43:59.801 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.793+0000 7f6c3a7fc700 1 -- 172.21.15.32:0/577854381 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c2c011830 con 0x7f6c3c065e90 2023-10-08T13:43:59.802 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.793+0000 7f6c3a7fc700 1 -- 172.21.15.32:0/577854381 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c2c011990 con 0x7f6c3c065e90 2023-10-08T13:43:59.802 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.793+0000 7f6c3a7fc700 1 -- 172.21.15.32:0/577854381 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c2c011d00 con 0x7f6c3c065e90 2023-10-08T13:43:59.802 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.793+0000 7f6c40b24700 1 -- 172.21.15.32:0/577854381 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6c3c065e90 msgr2=0x7f6c3c0cb8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:43:59.802 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.793+0000 7f6c40b24700 1 --2- 172.21.15.32:0/577854381 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6c3c065e90 0x7f6c3c0cb8b0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f6c2c009880 tx=0x7f6c2c009b90 comp rx=0 tx=0).stop 2023-10-08T13:43:59.802 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.793+0000 7f6c40b24700 1 -- 172.21.15.32:0/577854381 shutdown_connections 2023-10-08T13:43:59.803 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.793+0000 7f6c40b24700 1 --2- 172.21.15.32:0/577854381 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6c3c065e90 0x7f6c3c0cb8b0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:59.803 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.793+0000 7f6c40b24700 1 -- 172.21.15.32:0/577854381 >> 172.21.15.32:0/577854381 conn(0x7f6c3c0cf470 msgr2=0x7f6c3c0cf880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:43:59.803 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.793+0000 7f6c40b24700 1 -- 172.21.15.32:0/577854381 shutdown_connections 2023-10-08T13:43:59.803 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.793+0000 7f6c40b24700 1 -- 172.21.15.32:0/577854381 wait complete. 2023-10-08T13:43:59.805 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.797+0000 7f6c40b24700 1 Processor -- start 2023-10-08T13:43:59.805 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.797+0000 7f6c40b24700 1 -- start start 2023-10-08T13:43:59.805 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.797+0000 7f6c40b24700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6c3c065e90 0x7f6c3c15b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:43:59.806 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.797+0000 7f6c40b24700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6c3c06a9b0 0x7f6c3c0c8cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:43:59.806 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.797+0000 7f6c40b24700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6c3c15b130 0x7f6c3c15cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:43:59.806 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.797+0000 7f6c40b24700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c3c150250 con 0x7f6c3c15b130 2023-10-08T13:43:59.806 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.797+0000 7f6c40b24700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c3c0c9210 con 0x7f6c3c06a9b0 2023-10-08T13:43:59.807 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.797+0000 7f6c40b24700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c3c15bba0 con 0x7f6c3c065e90 2023-10-08T13:43:59.807 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.797+0000 7f6c3affd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6c3c06a9b0 0x7f6c3c0c8cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:43:59.807 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.797+0000 7f6c3affd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6c3c06a9b0 0x7f6c3c0c8cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.32:60466/0 (socket says 172.21.15.32:60466) 2023-10-08T13:43:59.807 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.797+0000 7f6c3affd700 1 -- 172.21.15.32:0/4111244269 learned_addr learned my addr 172.21.15.32:0/4111244269 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T13:43:59.807 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.797+0000 7f6c3bfff700 1 --2- 172.21.15.32:0/4111244269 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6c3c15b130 0x7f6c3c15cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:43:59.807 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.797+0000 7f6c3b7fe700 1 --2- 172.21.15.32:0/4111244269 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6c3c065e90 0x7f6c3c15b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:43:59.807 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.797+0000 7f6c3affd700 1 -- 172.21.15.32:0/4111244269 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6c3c065e90 msgr2=0x7f6c3c15b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:43:59.807 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.797+0000 7f6c3affd700 1 --2- 172.21.15.32:0/4111244269 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6c3c065e90 0x7f6c3c15b510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:59.808 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.797+0000 7f6c3affd700 1 -- 172.21.15.32:0/4111244269 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6c3c15b130 msgr2=0x7f6c3c15cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:43:59.808 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.797+0000 7f6c3affd700 1 --2- 172.21.15.32:0/4111244269 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6c3c15b130 0x7f6c3c15cc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:59.808 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.797+0000 7f6c3affd700 1 -- 172.21.15.32:0/4111244269 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c2c0094b0 con 0x7f6c3c06a9b0 2023-10-08T13:43:59.808 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.797+0000 7f6c3affd700 1 --2- 172.21.15.32:0/4111244269 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6c3c06a9b0 0x7f6c3c0c8cd0 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f6c2c013040 tx=0x7f6c2c004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:43:59.808 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.797+0000 7f6c23fff700 1 -- 172.21.15.32:0/4111244269 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c2c0036c0 con 0x7f6c3c06a9b0 2023-10-08T13:43:59.808 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.797+0000 7f6c23fff700 1 -- 172.21.15.32:0/4111244269 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c2c003820 con 0x7f6c3c06a9b0 2023-10-08T13:43:59.808 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.797+0000 7f6c40b24700 1 -- 172.21.15.32:0/4111244269 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c3c15be80 con 0x7f6c3c06a9b0 2023-10-08T13:43:59.809 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.797+0000 7f6c23fff700 1 -- 172.21.15.32:0/4111244269 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c2c003b90 con 0x7f6c3c06a9b0 2023-10-08T13:43:59.809 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.797+0000 7f6c40b24700 1 -- 172.21.15.32:0/4111244269 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c3c15c440 con 0x7f6c3c06a9b0 2023-10-08T13:43:59.810 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.801+0000 7f6c23fff700 1 -- 172.21.15.32:0/4111244269 <== mon.1 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f6c2c003cf0 con 0x7f6c3c06a9b0 2023-10-08T13:43:59.810 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.801+0000 7f6c23fff700 1 --2- 172.21.15.32:0/4111244269 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f6c28066510 0x7f6c280689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:43:59.810 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.801+0000 7f6c23fff700 1 -- 172.21.15.32:0/4111244269 <== mon.1 v2:172.21.15.40:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f6c2c085080 con 0x7f6c3c06a9b0 2023-10-08T13:43:59.810 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.801+0000 7f6c3b7fe700 1 --2- 172.21.15.32:0/4111244269 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f6c28066510 0x7f6c280689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:43:59.811 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.801+0000 7f6c3b7fe700 1 --2- 172.21.15.32:0/4111244269 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f6c28066510 0x7f6c280689d0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f6c300011e0 tx=0x7f6c30009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:43:59.811 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.805+0000 7f6c40b24700 1 --2- 172.21.15.32:0/4111244269 >> [v2:172.21.15.32:6804/3672614802,v1:172.21.15.32:6806/3672614802] conn(0x7f6c3c15c5d0 0x7f6c3c0af6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:43:59.811 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.805+0000 7f6c40b24700 1 -- 172.21.15.32:0/4111244269 --> [v2:172.21.15.32:6804/3672614802,v1:172.21.15.32:6806/3672614802] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6c3c15c9b0 con 0x7f6c3c15c5d0 2023-10-08T13:43:59.811 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.805+0000 7f6c3bfff700 1 --2- 172.21.15.32:0/4111244269 >> [v2:172.21.15.32:6804/3672614802,v1:172.21.15.32:6806/3672614802] conn(0x7f6c3c15c5d0 0x7f6c3c0af6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:43:59.811 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.805+0000 7f6c3bfff700 1 --2- 172.21.15.32:0/4111244269 >> [v2:172.21.15.32:6804/3672614802,v1:172.21.15.32:6806/3672614802] conn(0x7f6c3c15c5d0 0x7f6c3c0af6c0 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:43:59.812 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.805+0000 7f6c23fff700 1 -- 172.21.15.32:0/4111244269 <== osd.3 v2:172.21.15.32:6804/3672614802 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f6c3c15c9b0 con 0x7f6c3c15c5d0 2023-10-08T13:43:59.838 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.829+0000 7f6c40b24700 1 -- 172.21.15.32:0/4111244269 --> [v2:172.21.15.32:6804/3672614802,v1:172.21.15.32:6806/3672614802] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f6c3c0cf050 con 0x7f6c3c15c5d0 2023-10-08T13:43:59.838 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.829+0000 7f6c23fff700 1 -- 172.21.15.32:0/4111244269 <== osd.3 v2:172.21.15.32:6804/3672614802 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f6c3c0cf050 con 0x7f6c3c15c5d0 2023-10-08T13:43:59.838 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2023-10-08T13:43:59.839 INFO:teuthology.orchestra.run.smithi032.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-08T13:43:59.839 INFO:teuthology.orchestra.run.smithi032.stdout:} 2023-10-08T13:43:59.840 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.829+0000 7f6c40b24700 1 -- 172.21.15.32:0/4111244269 >> [v2:172.21.15.32:6804/3672614802,v1:172.21.15.32:6806/3672614802] conn(0x7f6c3c15c5d0 msgr2=0x7f6c3c0af6c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:43:59.840 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.829+0000 7f6c40b24700 1 --2- 172.21.15.32:0/4111244269 >> [v2:172.21.15.32:6804/3672614802,v1:172.21.15.32:6806/3672614802] conn(0x7f6c3c15c5d0 0x7f6c3c0af6c0 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:59.840 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.829+0000 7f6c40b24700 1 -- 172.21.15.32:0/4111244269 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f6c28066510 msgr2=0x7f6c280689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:43:59.840 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.829+0000 7f6c40b24700 1 --2- 172.21.15.32:0/4111244269 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f6c28066510 0x7f6c280689d0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f6c300011e0 tx=0x7f6c30009040 comp rx=0 tx=0).stop 2023-10-08T13:43:59.840 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.829+0000 7f6c40b24700 1 -- 172.21.15.32:0/4111244269 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6c3c06a9b0 msgr2=0x7f6c3c0c8cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:43:59.841 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.829+0000 7f6c40b24700 1 --2- 172.21.15.32:0/4111244269 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6c3c06a9b0 0x7f6c3c0c8cd0 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f6c2c013040 tx=0x7f6c2c004770 comp rx=0 tx=0).stop 2023-10-08T13:43:59.841 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.829+0000 7f6c3bfff700 1 -- 172.21.15.32:0/4111244269 reap_dead start 2023-10-08T13:43:59.841 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.829+0000 7f6c40b24700 1 -- 172.21.15.32:0/4111244269 shutdown_connections 2023-10-08T13:43:59.841 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.829+0000 7f6c40b24700 1 -- 172.21.15.32:0/4111244269 >> 172.21.15.32:0/4111244269 conn(0x7f6c3c0cf470 msgr2=0x7f6c3c157ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:43:59.841 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.829+0000 7f6c40b24700 1 -- 172.21.15.32:0/4111244269 shutdown_connections 2023-10-08T13:43:59.841 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.829+0000 7f6c40b24700 1 -- 172.21.15.32:0/4111244269 wait complete. 2023-10-08T13:43:59.850 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2023-10-08T13:43:59.979 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.973+0000 7ff7661e2700 1 Processor -- start 2023-10-08T13:43:59.980 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.973+0000 7ff7661e2700 1 -- start start 2023-10-08T13:43:59.981 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.973+0000 7ff7661e2700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff760159940 0x7ff7600cea40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:43:59.981 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.973+0000 7ff7661e2700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff7600cef80 0x7ff7600c9cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:43:59.981 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.973+0000 7ff7661e2700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff76006ae50 con 0x7ff7600ca210 2023-10-08T13:43:59.982 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.973+0000 7ff7661e2700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7600ca6a0 con 0x7ff760159940 2023-10-08T13:43:59.982 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.973+0000 7ff7661e2700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff76006b0f0 con 0x7ff7600cef80 2023-10-08T13:43:59.982 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.973+0000 7ff7649df700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff7600cef80 0x7ff7600c9cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:43:59.982 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.973+0000 7ff7659e1700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7ff7600ca210 0x7ff7600cd630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.32:47404/0 (socket says 172.21.15.32:47404) 2023-10-08T13:43:59.982 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.973+0000 7ff7659e1700 1 -- 172.21.15.32:0/571547456 learned_addr learned my addr 172.21.15.32:0/571547456 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-08T13:43:59.982 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.973+0000 7ff7651e0700 1 --2- 172.21.15.32:0/571547456 >> v2:172.21.15.40:3300/0 conn(0x7ff760159940 0x7ff7600cea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:43:59.982 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.973+0000 7ff7649df700 1 -- 172.21.15.32:0/571547456 >> v2:172.21.15.40:3300/0 conn(0x7ff760159940 msgr2=0x7ff7600cea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:43:59.983 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.973+0000 7ff7649df700 1 --2- 172.21.15.32:0/571547456 >> v2:172.21.15.40:3300/0 conn(0x7ff760159940 0x7ff7600cea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:59.983 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.973+0000 7ff757fff700 1 -- 172.21.15.32:0/571547456 <== mon.1 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 399060157 0 0) 0x7ff76006ae50 con 0x7ff7600ca210 2023-10-08T13:43:59.983 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.973+0000 7ff7649df700 1 -- 172.21.15.32:0/571547456 >> v1:172.21.15.40:6789/0 conn(0x7ff7600ca210 legacy=0x7ff7600cd630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:43:59.983 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.973+0000 7ff7649df700 1 -- 172.21.15.32:0/571547456 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff76006b3d0 con 0x7ff7600cef80 2023-10-08T13:43:59.983 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.977+0000 7ff7649df700 1 --2- 172.21.15.32:0/571547456 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff7600cef80 0x7ff7600c9cd0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7ff75000a9f0 tx=0x7ff75000ad00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8bac2337f5ca3100 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:43:59.984 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.977+0000 7ff757fff700 1 -- 172.21.15.32:0/571547456 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff75000cb70 con 0x7ff7600cef80 2023-10-08T13:43:59.985 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.977+0000 7ff757fff700 1 -- 172.21.15.32:0/571547456 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff75000ae90 con 0x7ff7600cef80 2023-10-08T13:43:59.985 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.977+0000 7ff757fff700 1 -- 172.21.15.32:0/571547456 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff750018400 con 0x7ff7600cef80 2023-10-08T13:43:59.985 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.977+0000 7ff7661e2700 1 -- 172.21.15.32:0/571547456 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff7600cef80 msgr2=0x7ff7600c9cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:43:59.985 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.977+0000 7ff7661e2700 1 --2- 172.21.15.32:0/571547456 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff7600cef80 0x7ff7600c9cd0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7ff75000a9f0 tx=0x7ff75000ad00 comp rx=0 tx=0).stop 2023-10-08T13:43:59.985 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.977+0000 7ff7661e2700 1 -- 172.21.15.32:0/571547456 shutdown_connections 2023-10-08T13:43:59.985 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.977+0000 7ff7661e2700 1 --2- 172.21.15.32:0/571547456 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff7600cef80 0x7ff7600c9cd0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:59.985 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.977+0000 7ff7661e2700 1 --2- 172.21.15.32:0/571547456 >> v2:172.21.15.40:3300/0 conn(0x7ff760159940 0x7ff7600cea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:59.986 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.977+0000 7ff7661e2700 1 -- 172.21.15.32:0/571547456 >> 172.21.15.32:0/571547456 conn(0x7ff7600cf470 msgr2=0x7ff7600cf880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:43:59.986 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.977+0000 7ff7661e2700 1 -- 172.21.15.32:0/571547456 shutdown_connections 2023-10-08T13:43:59.986 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.977+0000 7ff7661e2700 1 -- 172.21.15.32:0/571547456 wait complete. 2023-10-08T13:43:59.986 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.977+0000 7ff7661e2700 1 Processor -- start 2023-10-08T13:43:59.986 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.977+0000 7ff7661e2700 1 -- start start 2023-10-08T13:43:59.988 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.981+0000 7ff7661e2700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff7600ca210 0x7ff7601ed870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:43:59.988 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.981+0000 7ff7661e2700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff7600cef80 0x7ff76015a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:43:59.988 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.981+0000 7ff7661e2700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff760159940 0x7ff76015ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:43:59.988 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.981+0000 7ff7661e2700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff76015c1a0 con 0x7ff7600cef80 2023-10-08T13:43:59.989 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.981+0000 7ff7661e2700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7601531f0 con 0x7ff760159940 2023-10-08T13:43:59.989 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.981+0000 7ff7661e2700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff76015bf70 con 0x7ff7600ca210 2023-10-08T13:43:59.989 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.981+0000 7ff7649df700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff7600cef80 0x7ff76015a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:43:59.989 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.981+0000 7ff7649df700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff7600cef80 0x7ff76015a8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:53134/0 (socket says 172.21.15.32:53134) 2023-10-08T13:43:59.989 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.981+0000 7ff7649df700 1 -- 172.21.15.32:0/3984443248 learned_addr learned my addr 172.21.15.32:0/3984443248 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T13:43:59.989 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.981+0000 7ff7651e0700 1 --2- 172.21.15.32:0/3984443248 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff7600ca210 0x7ff7601ed870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:43:59.989 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.981+0000 7ff7659e1700 1 --2- 172.21.15.32:0/3984443248 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff760159940 0x7ff76015ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:43:59.989 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.981+0000 7ff7649df700 1 -- 172.21.15.32:0/3984443248 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff7600ca210 msgr2=0x7ff7601ed870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:43:59.990 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.981+0000 7ff7649df700 1 --2- 172.21.15.32:0/3984443248 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff7600ca210 0x7ff7601ed870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:59.990 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.981+0000 7ff7649df700 1 -- 172.21.15.32:0/3984443248 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff760159940 msgr2=0x7ff76015ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:43:59.990 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.981+0000 7ff7649df700 1 --2- 172.21.15.32:0/3984443248 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff760159940 0x7ff76015ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:43:59.990 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.981+0000 7ff7649df700 1 -- 172.21.15.32:0/3984443248 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff75000a650 con 0x7ff7600cef80 2023-10-08T13:43:59.990 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.981+0000 7ff7649df700 1 --2- 172.21.15.32:0/3984443248 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff7600cef80 0x7ff76015a8b0 secure :-1 s=READY pgs=1922 cs=0 l=1 rev1=1 crypto rx=0x7ff76006b230 tx=0x7ff750004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:43:59.990 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.981+0000 7ff755ffb700 1 -- 172.21.15.32:0/3984443248 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff75001e070 con 0x7ff7600cef80 2023-10-08T13:43:59.990 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.981+0000 7ff755ffb700 1 -- 172.21.15.32:0/3984443248 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7500036c0 con 0x7ff7600cef80 2023-10-08T13:43:59.991 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.981+0000 7ff7661e2700 1 -- 172.21.15.32:0/3984443248 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7600c5b70 con 0x7ff7600cef80 2023-10-08T13:43:59.991 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.981+0000 7ff755ffb700 1 -- 172.21.15.32:0/3984443248 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff750003a50 con 0x7ff7600cef80 2023-10-08T13:43:59.991 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.981+0000 7ff7661e2700 1 -- 172.21.15.32:0/3984443248 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7600c5240 con 0x7ff7600cef80 2023-10-08T13:43:59.991 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.981+0000 7ff7661e2700 1 -- 172.21.15.32:0/3984443248 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff76015ae40 con 0x7ff7600cef80 2023-10-08T13:43:59.992 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.981+0000 7ff755ffb700 1 -- 172.21.15.32:0/3984443248 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7ff750003bb0 con 0x7ff7600cef80 2023-10-08T13:43:59.992 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.985+0000 7ff755ffb700 1 --2- 172.21.15.32:0/3984443248 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7ff744066540 0x7ff744068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:43:59.992 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.985+0000 7ff7651e0700 1 --2- 172.21.15.32:0/3984443248 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7ff744066540 0x7ff744068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:43:59.992 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.985+0000 7ff755ffb700 1 -- 172.21.15.32:0/3984443248 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4943+0+0 (secure 0 0 0) 0x7ff7500860a0 con 0x7ff7600cef80 2023-10-08T13:43:59.993 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.985+0000 7ff7651e0700 1 --2- 172.21.15.32:0/3984443248 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7ff744066540 0x7ff744068a00 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7ff75c009b50 tx=0x7ff75c009240 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:43:59.997 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:43:59.989+0000 7ff755ffb700 1 -- 172.21.15.32:0/3984443248 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7ff7500538a0 con 0x7ff7600cef80 2023-10-08T13:44:00.158 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.153+0000 7ff7661e2700 1 -- 172.21.15.32:0/3984443248 --> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7ff76006b990 con 0x7ff744066540 2023-10-08T13:44:00.159 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.153+0000 7ff755ffb700 1 -- 172.21.15.32:0/3984443248 <== mgr.4107 v2:172.21.15.32:6832/2601628338 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7ff75c004020 con 0x7ff744066540 2023-10-08T13:44:00.161 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.153+0000 7ff7661e2700 1 -- 172.21.15.32:0/3984443248 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7ff744066540 msgr2=0x7ff744068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:44:00.161 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.153+0000 7ff7661e2700 1 --2- 172.21.15.32:0/3984443248 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7ff744066540 0x7ff744068a00 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7ff75c009b50 tx=0x7ff75c009240 comp rx=0 tx=0).stop 2023-10-08T13:44:00.161 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.153+0000 7ff7661e2700 1 -- 172.21.15.32:0/3984443248 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff7600cef80 msgr2=0x7ff76015a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:44:00.161 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.153+0000 7ff7661e2700 1 --2- 172.21.15.32:0/3984443248 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff7600cef80 0x7ff76015a8b0 secure :-1 s=READY pgs=1922 cs=0 l=1 rev1=1 crypto rx=0x7ff76006b230 tx=0x7ff750004770 comp rx=0 tx=0).stop 2023-10-08T13:44:00.161 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.153+0000 7ff7661e2700 1 -- 172.21.15.32:0/3984443248 shutdown_connections 2023-10-08T13:44:00.162 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.153+0000 7ff7661e2700 1 --2- 172.21.15.32:0/3984443248 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7ff744066540 0x7ff744068a00 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:44:00.162 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.153+0000 7ff7661e2700 1 --2- 172.21.15.32:0/3984443248 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff7600cef80 0x7ff76015a8b0 unknown :-1 s=CLOSED pgs=1922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:44:00.162 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.153+0000 7ff7661e2700 1 --2- 172.21.15.32:0/3984443248 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff760159940 0x7ff76015ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:44:00.162 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.153+0000 7ff7661e2700 1 --2- 172.21.15.32:0/3984443248 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff7600ca210 0x7ff7601ed870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:44:00.163 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.153+0000 7ff7661e2700 1 -- 172.21.15.32:0/3984443248 >> 172.21.15.32:0/3984443248 conn(0x7ff7600cf470 msgr2=0x7ff760073300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:44:00.163 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.153+0000 7ff7661e2700 1 -- 172.21.15.32:0/3984443248 shutdown_connections 2023-10-08T13:44:00.163 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.153+0000 7ff7661e2700 1 -- 172.21.15.32:0/3984443248 wait complete. 2023-10-08T13:44:00.164 INFO:teuthology.orchestra.run.smithi032.stderr:instructed osd(s) 3 to deep-scrub 2023-10-08T13:44:00.172 INFO:tasks.ceph:Scrubbing osd.4 2023-10-08T13:44:00.172 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2023-10-08T13:44:00.292 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.285+0000 7febc0e05700 1 Processor -- start 2023-10-08T13:44:00.292 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.285+0000 7febc0e05700 1 -- start start 2023-10-08T13:44:00.294 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.285+0000 7febc0e05700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7febbc15a170 0x7febbc0cb410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:44:00.294 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.285+0000 7febc0e05700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7febbc0c9e40 0x7febbc072250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:44:00.295 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.285+0000 7febc0e05700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7febbc06b3b0 0x7febbc06b840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:44:00.295 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.285+0000 7febc0e05700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febbc06bd80 con 0x7febbc15a170 2023-10-08T13:44:00.295 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.285+0000 7febc0e05700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febbc0ca370 con 0x7febbc0c9e40 2023-10-08T13:44:00.295 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.285+0000 7febc0e05700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febbc0ca650 con 0x7febbc06b3b0 2023-10-08T13:44:00.295 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.289+0000 7febba59c700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7febbc15a170 0x7febbc0cb410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:44:00.295 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.289+0000 7febbad9d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7febbc06b3b0 0x7febbc06b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:44:00.295 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.289+0000 7febb9d9b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7febbc0c9e40 0x7febbc072250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:44:00.296 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.289+0000 7febba59c700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7febbc15a170 0x7febbc0cb410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:59774/0 (socket says 172.21.15.32:59774) 2023-10-08T13:44:00.296 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.289+0000 7febbad9d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7febbc06b3b0 0x7febbc06b840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.32:35454/0 (socket says 172.21.15.32:35454) 2023-10-08T13:44:00.296 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.289+0000 7febba59c700 1 -- 172.21.15.32:0/2932183954 learned_addr learned my addr 172.21.15.32:0/2932183954 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T13:44:00.296 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.289+0000 7febba59c700 1 -- 172.21.15.32:0/2932183954 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7febbc06b3b0 msgr2=0x7febbc06b840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:44:00.296 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.289+0000 7febba59c700 1 --2- 172.21.15.32:0/2932183954 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7febbc06b3b0 0x7febbc06b840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:44:00.296 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.289+0000 7febba59c700 1 -- 172.21.15.32:0/2932183954 >> v2:172.21.15.40:3300/0 conn(0x7febbc0c9e40 msgr2=0x7febbc072250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:44:00.296 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.289+0000 7febba59c700 1 --2- 172.21.15.32:0/2932183954 >> v2:172.21.15.40:3300/0 conn(0x7febbc0c9e40 0x7febbc072250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:44:00.297 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.289+0000 7febba59c700 1 -- 172.21.15.32:0/2932183954 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febbc0ca930 con 0x7febbc15a170 2023-10-08T13:44:00.297 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.289+0000 7febbad9d700 1 --2- 172.21.15.32:0/2932183954 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7febbc06b3b0 0x7febbc06b840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:44:00.297 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.289+0000 7febb9d9b700 1 --2- 172.21.15.32:0/2932183954 >> v2:172.21.15.40:3300/0 conn(0x7febbc0c9e40 0x7febbc072250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:44:00.297 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.289+0000 7febba59c700 1 --2- 172.21.15.32:0/2932183954 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7febbc15a170 0x7febbc0cb410 secure :-1 s=READY pgs=1923 cs=0 l=1 rev1=1 crypto rx=0x7febbc0ae900 tx=0x7febac009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df81adb3f762c7c8 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:44:00.297 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.289+0000 7febb959a700 1 -- 172.21.15.32:0/2932183954 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febac011830 con 0x7febbc15a170 2023-10-08T13:44:00.297 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.289+0000 7febb959a700 1 -- 172.21.15.32:0/2932183954 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febac011990 con 0x7febbc15a170 2023-10-08T13:44:00.298 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.289+0000 7febb959a700 1 -- 172.21.15.32:0/2932183954 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febac011d20 con 0x7febbc15a170 2023-10-08T13:44:00.301 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.289+0000 7febc0e05700 1 -- 172.21.15.32:0/2932183954 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7febbc15a170 msgr2=0x7febbc0cb410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:44:00.301 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.289+0000 7febc0e05700 1 --2- 172.21.15.32:0/2932183954 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7febbc15a170 0x7febbc0cb410 secure :-1 s=READY pgs=1923 cs=0 l=1 rev1=1 crypto rx=0x7febbc0ae900 tx=0x7febac009bf0 comp rx=0 tx=0).stop 2023-10-08T13:44:00.301 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.289+0000 7febc0e05700 1 -- 172.21.15.32:0/2932183954 shutdown_connections 2023-10-08T13:44:00.301 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.289+0000 7febc0e05700 1 --2- 172.21.15.32:0/2932183954 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7febbc06b3b0 0x7febbc06b840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:44:00.301 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.289+0000 7febc0e05700 1 --2- 172.21.15.32:0/2932183954 >> v2:172.21.15.40:3300/0 conn(0x7febbc0c9e40 0x7febbc072250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:44:00.302 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.289+0000 7febc0e05700 1 --2- 172.21.15.32:0/2932183954 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7febbc15a170 0x7febbc0cb410 unknown :-1 s=CLOSED pgs=1923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:44:00.302 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.289+0000 7febc0e05700 1 -- 172.21.15.32:0/2932183954 >> 172.21.15.32:0/2932183954 conn(0x7febbc0cf5e0 msgr2=0x7febbc0cf9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:44:00.302 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.289+0000 7febc0e05700 1 -- 172.21.15.32:0/2932183954 shutdown_connections 2023-10-08T13:44:00.302 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.289+0000 7febc0e05700 1 -- 172.21.15.32:0/2932183954 wait complete. 2023-10-08T13:44:00.302 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.289+0000 7febc0e05700 1 Processor -- start 2023-10-08T13:44:00.302 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.293+0000 7febc0e05700 1 -- start start 2023-10-08T13:44:00.303 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.293+0000 7febc0e05700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7febbc06b3b0 0x7febbc152a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:44:00.303 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.293+0000 7febc0e05700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7febbc0c9e40 0x7febbc0b3780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:44:00.303 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.293+0000 7febc0e05700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7febbc15a170 0x7febbc156200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:44:00.303 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.293+0000 7febc0e05700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febbc1f41b0 con 0x7febbc06b3b0 2023-10-08T13:44:00.303 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.293+0000 7febc0e05700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febbc1f1110 con 0x7febbc0c9e40 2023-10-08T13:44:00.303 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.293+0000 7febc0e05700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febbc1f13f0 con 0x7febbc15a170 2023-10-08T13:44:00.304 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.293+0000 7febba59c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7febbc06b3b0 0x7febbc152a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:44:00.304 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.293+0000 7febb9d9b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7febbc0c9e40 0x7febbc0b3780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:44:00.304 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.293+0000 7febba59c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7febbc06b3b0 0x7febbc152a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:59776/0 (socket says 172.21.15.32:59776) 2023-10-08T13:44:00.304 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.293+0000 7febba59c700 1 -- 172.21.15.32:0/640228772 learned_addr learned my addr 172.21.15.32:0/640228772 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T13:44:00.304 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.293+0000 7febbad9d700 1 --2- 172.21.15.32:0/640228772 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7febbc15a170 0x7febbc156200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:44:00.305 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.293+0000 7febba59c700 1 -- 172.21.15.32:0/640228772 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7febbc15a170 msgr2=0x7febbc156200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:44:00.305 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.293+0000 7febba59c700 1 --2- 172.21.15.32:0/640228772 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7febbc15a170 0x7febbc156200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:44:00.305 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.293+0000 7febba59c700 1 -- 172.21.15.32:0/640228772 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7febbc0c9e40 msgr2=0x7febbc0b3780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:44:00.305 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.293+0000 7febba59c700 1 --2- 172.21.15.32:0/640228772 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7febbc0c9e40 0x7febbc0b3780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:44:00.305 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.293+0000 7febba59c700 1 -- 172.21.15.32:0/640228772 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febb4009a70 con 0x7febbc06b3b0 2023-10-08T13:44:00.305 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.293+0000 7febb9d9b700 1 --2- 172.21.15.32:0/640228772 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7febbc0c9e40 0x7febbc0b3780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:44:00.305 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.293+0000 7febba59c700 1 --2- 172.21.15.32:0/640228772 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7febbc06b3b0 0x7febbc152a70 secure :-1 s=READY pgs=1924 cs=0 l=1 rev1=1 crypto rx=0x7febbc067490 tx=0x7febac004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:44:00.306 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.293+0000 7febaaffd700 1 -- 172.21.15.32:0/640228772 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febac004240 con 0x7febbc06b3b0 2023-10-08T13:44:00.306 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.293+0000 7febaaffd700 1 -- 172.21.15.32:0/640228772 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febac01f070 con 0x7febbc06b3b0 2023-10-08T13:44:00.306 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.293+0000 7febc0e05700 1 -- 172.21.15.32:0/640228772 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febb00094b0 con 0x7febbc06b3b0 2023-10-08T13:44:00.306 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.293+0000 7febaaffd700 1 -- 172.21.15.32:0/640228772 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febac0045e0 con 0x7febbc06b3b0 2023-10-08T13:44:00.306 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.293+0000 7febc0e05700 1 -- 172.21.15.32:0/640228772 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febac009570 con 0x7febbc06b3b0 2023-10-08T13:44:00.306 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.293+0000 7febc0e05700 1 -- 172.21.15.32:0/640228772 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7febbc0caef0 con 0x7febbc06b3b0 2023-10-08T13:44:00.308 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.297+0000 7febaaffd700 1 -- 172.21.15.32:0/640228772 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7febac021030 con 0x7febbc06b3b0 2023-10-08T13:44:00.308 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.297+0000 7febaaffd700 1 --2- 172.21.15.32:0/640228772 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7feba40666c0 0x7feba4068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:44:00.308 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.297+0000 7febaaffd700 1 -- 172.21.15.32:0/640228772 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4943+0+0 (secure 0 0 0) 0x7febac084970 con 0x7febbc06b3b0 2023-10-08T13:44:00.308 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.297+0000 7febb9d9b700 1 --2- 172.21.15.32:0/640228772 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7feba40666c0 0x7feba4068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:44:00.308 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.297+0000 7febaaffd700 1 --2- 172.21.15.32:0/640228772 >> [v2:172.21.15.40:6800/3369928244,v1:172.21.15.40:6801/3369928244] conn(0x7feba406c520 0x7feba406e940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:44:00.309 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.297+0000 7febaaffd700 1 -- 172.21.15.32:0/640228772 --> [v2:172.21.15.40:6800/3369928244,v1:172.21.15.40:6801/3369928244] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7feba406eff0 con 0x7feba406c520 2023-10-08T13:44:00.309 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.297+0000 7febaaffd700 1 -- 172.21.15.32:0/640228772 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7febac0892c0 con 0x7febbc06b3b0 2023-10-08T13:44:00.309 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.297+0000 7febbad9d700 1 --2- 172.21.15.32:0/640228772 >> [v2:172.21.15.40:6800/3369928244,v1:172.21.15.40:6801/3369928244] conn(0x7feba406c520 0x7feba406e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:44:00.309 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.297+0000 7febb9d9b700 1 --2- 172.21.15.32:0/640228772 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7feba40666c0 0x7feba4068b80 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7febbc0b4990 tx=0x7febb0009240 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:44:00.309 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.297+0000 7febbad9d700 1 --2- 172.21.15.32:0/640228772 >> [v2:172.21.15.40:6800/3369928244,v1:172.21.15.40:6801/3369928244] conn(0x7feba406c520 0x7feba406e940 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:44:00.309 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.297+0000 7febaaffd700 1 -- 172.21.15.32:0/640228772 <== osd.4 v2:172.21.15.40:6800/3369928244 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7feba406eff0 con 0x7feba406c520 2023-10-08T13:44:00.330 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.325+0000 7febc0e05700 1 -- 172.21.15.32:0/640228772 --> [v2:172.21.15.40:6800/3369928244,v1:172.21.15.40:6801/3369928244] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7febbc0cac10 con 0x7feba406c520 2023-10-08T13:44:00.331 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.325+0000 7febaaffd700 1 -- 172.21.15.32:0/640228772 <== osd.4 v2:172.21.15.40:6800/3369928244 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7febb400f040 con 0x7feba406c520 2023-10-08T13:44:00.331 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2023-10-08T13:44:00.332 INFO:teuthology.orchestra.run.smithi032.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-08T13:44:00.332 INFO:teuthology.orchestra.run.smithi032.stdout:} 2023-10-08T13:44:00.333 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.325+0000 7febc0e05700 1 -- 172.21.15.32:0/640228772 >> [v2:172.21.15.40:6800/3369928244,v1:172.21.15.40:6801/3369928244] conn(0x7feba406c520 msgr2=0x7feba406e940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:44:00.333 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.325+0000 7febc0e05700 1 --2- 172.21.15.32:0/640228772 >> [v2:172.21.15.40:6800/3369928244,v1:172.21.15.40:6801/3369928244] conn(0x7feba406c520 0x7feba406e940 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:44:00.333 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.325+0000 7febc0e05700 1 -- 172.21.15.32:0/640228772 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7feba40666c0 msgr2=0x7feba4068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:44:00.333 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.325+0000 7febc0e05700 1 --2- 172.21.15.32:0/640228772 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7feba40666c0 0x7feba4068b80 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7febbc0b4990 tx=0x7febb0009240 comp rx=0 tx=0).stop 2023-10-08T13:44:00.333 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.325+0000 7febc0e05700 1 -- 172.21.15.32:0/640228772 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7febbc06b3b0 msgr2=0x7febbc152a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:44:00.333 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.325+0000 7febc0e05700 1 --2- 172.21.15.32:0/640228772 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7febbc06b3b0 0x7febbc152a70 secure :-1 s=READY pgs=1924 cs=0 l=1 rev1=1 crypto rx=0x7febbc067490 tx=0x7febac004770 comp rx=0 tx=0).stop 2023-10-08T13:44:00.334 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.325+0000 7febbad9d700 1 -- 172.21.15.32:0/640228772 reap_dead start 2023-10-08T13:44:00.334 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.325+0000 7febc0e05700 1 -- 172.21.15.32:0/640228772 shutdown_connections 2023-10-08T13:44:00.334 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.325+0000 7febc0e05700 1 -- 172.21.15.32:0/640228772 >> 172.21.15.32:0/640228772 conn(0x7febbc0cf5e0 msgr2=0x7febbc0b0330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:44:00.334 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.325+0000 7febc0e05700 1 -- 172.21.15.32:0/640228772 shutdown_connections 2023-10-08T13:44:00.334 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.325+0000 7febc0e05700 1 -- 172.21.15.32:0/640228772 wait complete. 2023-10-08T13:44:00.345 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2023-10-08T13:44:00.452 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.445+0000 7fad8bfff700 1 Processor -- start 2023-10-08T13:44:00.454 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.445+0000 7fad8bfff700 1 -- start start 2023-10-08T13:44:00.459 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.449+0000 7fad8bfff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fad84054480 0x7fad84006c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:44:00.459 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.449+0000 7fad8bfff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fad8403ead0 0x7fad840579f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:44:00.459 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.449+0000 7fad8bfff700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad8403c090 con 0x7fad840e33b0 2023-10-08T13:44:00.460 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.449+0000 7fad8bfff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad840e47a0 con 0x7fad8403ead0 2023-10-08T13:44:00.460 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.449+0000 7fad8bfff700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad84057560 con 0x7fad84054480 2023-10-08T13:44:00.460 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.449+0000 7fad8affd700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fad840e33b0 0x7fad84053d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:38982/0 (socket says 172.21.15.32:38982) 2023-10-08T13:44:00.460 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.449+0000 7fad8affd700 1 -- 172.21.15.32:0/4205225583 learned_addr learned my addr 172.21.15.32:0/4205225583 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-08T13:44:00.460 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.449+0000 7fad8b7fe700 1 --2- 172.21.15.32:0/4205225583 >> v2:172.21.15.40:3300/0 conn(0x7fad8403ead0 0x7fad840579f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:44:00.460 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.449+0000 7fad8a7fc700 1 --2- 172.21.15.32:0/4205225583 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fad84054480 0x7fad84006c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:44:00.460 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.449+0000 7fad89ffb700 1 -- 172.21.15.32:0/4205225583 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3163230966 0 0) 0x7fad8403c090 con 0x7fad840e33b0 2023-10-08T13:44:00.461 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.449+0000 7fad89ffb700 1 -- 172.21.15.32:0/4205225583 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad740035d0 con 0x7fad840e33b0 2023-10-08T13:44:00.461 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.449+0000 7fad8b7fe700 1 -- 172.21.15.32:0/4205225583 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fad84054480 msgr2=0x7fad84006c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:44:00.461 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.449+0000 7fad8b7fe700 1 --2- 172.21.15.32:0/4205225583 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fad84054480 0x7fad84006c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:44:00.461 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.449+0000 7fad8b7fe700 1 -- 172.21.15.32:0/4205225583 >> v1:172.21.15.32:6789/0 conn(0x7fad840e33b0 legacy=0x7fad84053d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:44:00.461 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.449+0000 7fad8b7fe700 1 -- 172.21.15.32:0/4205225583 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad84007260 con 0x7fad8403ead0 2023-10-08T13:44:00.461 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.449+0000 7fad8a7fc700 1 --2- 172.21.15.32:0/4205225583 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fad84054480 0x7fad84006c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:44:00.461 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.449+0000 7fad8b7fe700 1 --2- 172.21.15.32:0/4205225583 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fad8403ead0 0x7fad840579f0 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7fad8c04e920 tx=0x7fad8c074710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9a0a8d226d47dd06 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:44:00.462 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.449+0000 7fad89ffb700 1 -- 172.21.15.32:0/4205225583 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad8c04ef60 con 0x7fad8403ead0 2023-10-08T13:44:00.462 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.449+0000 7fad89ffb700 1 -- 172.21.15.32:0/4205225583 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad8c08e070 con 0x7fad8403ead0 2023-10-08T13:44:00.462 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.449+0000 7fad89ffb700 1 -- 172.21.15.32:0/4205225583 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad8c0684b0 con 0x7fad8403ead0 2023-10-08T13:44:00.462 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.449+0000 7fad8bfff700 1 -- 172.21.15.32:0/4205225583 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fad8403ead0 msgr2=0x7fad840579f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:44:00.462 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.449+0000 7fad8bfff700 1 --2- 172.21.15.32:0/4205225583 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fad8403ead0 0x7fad840579f0 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7fad8c04e920 tx=0x7fad8c074710 comp rx=0 tx=0).stop 2023-10-08T13:44:00.462 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.449+0000 7fad8bfff700 1 -- 172.21.15.32:0/4205225583 shutdown_connections 2023-10-08T13:44:00.462 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.449+0000 7fad8bfff700 1 --2- 172.21.15.32:0/4205225583 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fad8403ead0 0x7fad840579f0 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:44:00.463 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.449+0000 7fad8bfff700 1 --2- 172.21.15.32:0/4205225583 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fad84054480 0x7fad84006c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:44:00.463 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.449+0000 7fad8bfff700 1 -- 172.21.15.32:0/4205225583 >> 172.21.15.32:0/4205225583 conn(0x7fad8400e610 msgr2=0x7fad8400e9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:44:00.463 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.449+0000 7fad8bfff700 1 -- 172.21.15.32:0/4205225583 shutdown_connections 2023-10-08T13:44:00.463 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.449+0000 7fad8bfff700 1 -- 172.21.15.32:0/4205225583 wait complete. 2023-10-08T13:44:00.463 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.449+0000 7fad8bfff700 1 Processor -- start 2023-10-08T13:44:00.464 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.449+0000 7fad8bfff700 1 -- start start 2023-10-08T13:44:00.464 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.453+0000 7fad8bfff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fad8403ead0 0x7fad84037ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:44:00.465 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.453+0000 7fad8bfff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fad84054480 0x7fad84038950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:44:00.465 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.453+0000 7fad8bfff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fad840e33b0 0x7fad84052080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:44:00.466 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.453+0000 7fad8bfff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad84038e90 con 0x7fad840e33b0 2023-10-08T13:44:00.466 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.453+0000 7fad8bfff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad8404fc80 con 0x7fad8403ead0 2023-10-08T13:44:00.467 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.453+0000 7fad8bfff700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad840390a0 con 0x7fad84054480 2023-10-08T13:44:00.467 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.453+0000 7fad8b7fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fad840e33b0 0x7fad84052080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:44:00.467 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.453+0000 7fad8a7fc700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fad84054480 0x7fad84038950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:44:00.467 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.453+0000 7fad8affd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fad8403ead0 0x7fad84037ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:44:00.468 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.453+0000 7fad8b7fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fad840e33b0 0x7fad84052080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:59782/0 (socket says 172.21.15.32:59782) 2023-10-08T13:44:00.468 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.453+0000 7fad8b7fe700 1 -- 172.21.15.32:0/598493987 learned_addr learned my addr 172.21.15.32:0/598493987 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T13:44:00.468 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.453+0000 7fad8b7fe700 1 -- 172.21.15.32:0/598493987 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fad84054480 msgr2=0x7fad84038950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:44:00.468 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.453+0000 7fad8b7fe700 1 --2- 172.21.15.32:0/598493987 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fad84054480 0x7fad84038950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:44:00.469 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.453+0000 7fad8b7fe700 1 -- 172.21.15.32:0/598493987 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fad8403ead0 msgr2=0x7fad84037ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:44:00.469 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.453+0000 7fad8b7fe700 1 --2- 172.21.15.32:0/598493987 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fad8403ead0 0x7fad84037ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:44:00.469 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.453+0000 7fad8b7fe700 1 -- 172.21.15.32:0/598493987 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad800094b0 con 0x7fad840e33b0 2023-10-08T13:44:00.469 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.453+0000 7fad8a7fc700 1 --2- 172.21.15.32:0/598493987 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fad84054480 0x7fad84038950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:44:00.470 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.453+0000 7fad8affd700 1 --2- 172.21.15.32:0/598493987 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fad8403ead0 0x7fad84037ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:44:00.470 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.453+0000 7fad8b7fe700 1 --2- 172.21.15.32:0/598493987 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fad840e33b0 0x7fad84052080 secure :-1 s=READY pgs=1926 cs=0 l=1 rev1=1 crypto rx=0x7fad8c04fb70 tx=0x7fad8c06a080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:44:00.470 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.453+0000 7fad73fff700 1 -- 172.21.15.32:0/598493987 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad8c067680 con 0x7fad840e33b0 2023-10-08T13:44:00.470 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.453+0000 7fad73fff700 1 -- 172.21.15.32:0/598493987 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad8c068700 con 0x7fad840e33b0 2023-10-08T13:44:00.470 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.453+0000 7fad8bfff700 1 -- 172.21.15.32:0/598493987 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad8c066ea0 con 0x7fad840e33b0 2023-10-08T13:44:00.471 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.453+0000 7fad73fff700 1 -- 172.21.15.32:0/598493987 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad8c072390 con 0x7fad840e33b0 2023-10-08T13:44:00.471 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.453+0000 7fad8bfff700 1 -- 172.21.15.32:0/598493987 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad84039660 con 0x7fad840e33b0 2023-10-08T13:44:00.472 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.453+0000 7fad8bfff700 1 -- 172.21.15.32:0/598493987 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad84005880 con 0x7fad840e33b0 2023-10-08T13:44:00.472 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.453+0000 7fad73fff700 1 -- 172.21.15.32:0/598493987 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fad8c0724f0 con 0x7fad840e33b0 2023-10-08T13:44:00.472 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.453+0000 7fad73fff700 1 --2- 172.21.15.32:0/598493987 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fad78066510 0x7fad780689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:44:00.473 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.457+0000 7fad73fff700 1 -- 172.21.15.32:0/598493987 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fad8c0ff3b0 con 0x7fad840e33b0 2023-10-08T13:44:00.473 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.457+0000 7fad8affd700 1 --2- 172.21.15.32:0/598493987 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fad78066510 0x7fad780689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:44:00.473 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.457+0000 7fad8affd700 1 --2- 172.21.15.32:0/598493987 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fad78066510 0x7fad780689d0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7fad7c007fd0 tx=0x7fad7c007de0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:44:00.473 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.461+0000 7fad73fff700 1 -- 172.21.15.32:0/598493987 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fad8c0ccb40 con 0x7fad840e33b0 2023-10-08T13:44:00.632 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.625+0000 7fad8bfff700 1 -- 172.21.15.32:0/598493987 --> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7fad84007820 con 0x7fad78066510 2023-10-08T13:44:00.633 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.625+0000 7fad73fff700 1 -- 172.21.15.32:0/598493987 <== mgr.4107 v2:172.21.15.32:6832/2601628338 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fad7c005900 con 0x7fad78066510 2023-10-08T13:44:00.635 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.629+0000 7fad8bfff700 1 -- 172.21.15.32:0/598493987 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fad78066510 msgr2=0x7fad780689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:44:00.636 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.629+0000 7fad8bfff700 1 --2- 172.21.15.32:0/598493987 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fad78066510 0x7fad780689d0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7fad7c007fd0 tx=0x7fad7c007de0 comp rx=0 tx=0).stop 2023-10-08T13:44:00.636 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.629+0000 7fad8bfff700 1 -- 172.21.15.32:0/598493987 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fad840e33b0 msgr2=0x7fad84052080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:44:00.636 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.629+0000 7fad8bfff700 1 --2- 172.21.15.32:0/598493987 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fad840e33b0 0x7fad84052080 secure :-1 s=READY pgs=1926 cs=0 l=1 rev1=1 crypto rx=0x7fad8c04fb70 tx=0x7fad8c06a080 comp rx=0 tx=0).stop 2023-10-08T13:44:00.636 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.629+0000 7fad8bfff700 1 -- 172.21.15.32:0/598493987 shutdown_connections 2023-10-08T13:44:00.636 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.629+0000 7fad8bfff700 1 --2- 172.21.15.32:0/598493987 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fad78066510 0x7fad780689d0 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:44:00.637 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.629+0000 7fad8bfff700 1 --2- 172.21.15.32:0/598493987 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fad840e33b0 0x7fad84052080 unknown :-1 s=CLOSED pgs=1926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:44:00.637 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.629+0000 7fad8bfff700 1 --2- 172.21.15.32:0/598493987 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fad84054480 0x7fad84038950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:44:00.637 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.629+0000 7fad8bfff700 1 --2- 172.21.15.32:0/598493987 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fad8403ead0 0x7fad84037ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:44:00.637 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.629+0000 7fad8bfff700 1 -- 172.21.15.32:0/598493987 >> 172.21.15.32:0/598493987 conn(0x7fad8400e610 msgr2=0x7fad84053820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:44:00.637 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.629+0000 7fad8bfff700 1 -- 172.21.15.32:0/598493987 shutdown_connections 2023-10-08T13:44:00.638 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.629+0000 7fad8bfff700 1 -- 172.21.15.32:0/598493987 wait complete. 2023-10-08T13:44:00.638 INFO:teuthology.orchestra.run.smithi032.stderr:instructed osd(s) 4 to deep-scrub 2023-10-08T13:44:00.654 INFO:tasks.ceph:Scrubbing osd.5 2023-10-08T13:44:00.654 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2023-10-08T13:44:00.763 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.757+0000 7ff2219a5700 1 Processor -- start 2023-10-08T13:44:00.763 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.757+0000 7ff2219a5700 1 -- start start 2023-10-08T13:44:00.765 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.757+0000 7ff2219a5700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff21c06d7b0 0x7ff21c06b670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:44:00.765 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.757+0000 7ff2219a5700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff21c06aeb0 con 0x7ff21c06bbb0 2023-10-08T13:44:00.765 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.757+0000 7ff2219a5700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff21c0ca3a0 con 0x7ff21c15d230 2023-10-08T13:44:00.766 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.757+0000 7ff2219a5700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff21c06dc10 con 0x7ff21c06d7b0 2023-10-08T13:44:00.766 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.757+0000 7ff21bfff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff21c06d7b0 0x7ff21c06b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:44:00.766 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.757+0000 7ff2211a4700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7ff21c06bbb0 0x7ff21c070d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:38994/0 (socket says 172.21.15.32:38994) 2023-10-08T13:44:00.766 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.757+0000 7ff21bfff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff21c06d7b0 0x7ff21c06b670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.32:35470/0 (socket says 172.21.15.32:35470) 2023-10-08T13:44:00.766 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.757+0000 7ff2209a3700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7ff21c15d230 0x7ff21c0cf410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.32:59558/0 (socket says 172.21.15.32:59558) 2023-10-08T13:44:00.766 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.757+0000 7ff21bfff700 1 -- 172.21.15.32:0/2111080740 learned_addr learned my addr 172.21.15.32:0/2111080740 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T13:44:00.767 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.761+0000 7ff21bfff700 1 -- 172.21.15.32:0/2111080740 >> v1:172.21.15.40:6789/0 conn(0x7ff21c15d230 legacy=0x7ff21c0cf410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:44:00.767 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.761+0000 7ff21bfff700 1 -- 172.21.15.32:0/2111080740 >> v1:172.21.15.32:6789/0 conn(0x7ff21c06bbb0 legacy=0x7ff21c070d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:44:00.767 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.761+0000 7ff21bfff700 1 -- 172.21.15.32:0/2111080740 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff21c15d610 con 0x7ff21c06d7b0 2023-10-08T13:44:00.767 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.761+0000 7ff21b7fe700 1 -- 172.21.15.32:0/2111080740 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2288628352 0 0) 0x7ff21c06aeb0 con 0x7ff21c06bbb0 2023-10-08T13:44:00.770 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.761+0000 7ff21bfff700 1 --2- 172.21.15.32:0/2111080740 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff21c06d7b0 0x7ff21c06b670 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7ff2080098c0 tx=0x7ff208009bd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8793166ef5019fb2 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:44:00.771 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.761+0000 7ff21b7fe700 1 -- 172.21.15.32:0/2111080740 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff208004230 con 0x7ff21c06d7b0 2023-10-08T13:44:00.771 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.761+0000 7ff21b7fe700 1 -- 172.21.15.32:0/2111080740 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff208004390 con 0x7ff21c06d7b0 2023-10-08T13:44:00.771 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.761+0000 7ff21b7fe700 1 -- 172.21.15.32:0/2111080740 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2080036c0 con 0x7ff21c06d7b0 2023-10-08T13:44:00.771 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.761+0000 7ff2219a5700 1 -- 172.21.15.32:0/2111080740 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff21c06d7b0 msgr2=0x7ff21c06b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:44:00.771 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.761+0000 7ff2219a5700 1 --2- 172.21.15.32:0/2111080740 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff21c06d7b0 0x7ff21c06b670 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7ff2080098c0 tx=0x7ff208009bd0 comp rx=0 tx=0).stop 2023-10-08T13:44:00.771 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.761+0000 7ff2219a5700 1 -- 172.21.15.32:0/2111080740 shutdown_connections 2023-10-08T13:44:00.772 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.761+0000 7ff2219a5700 1 --2- 172.21.15.32:0/2111080740 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff21c06d7b0 0x7ff21c06b670 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:44:00.772 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.761+0000 7ff2219a5700 1 -- 172.21.15.32:0/2111080740 >> 172.21.15.32:0/2111080740 conn(0x7ff21c0cc7d0 msgr2=0x7ff21c0ccbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:44:00.772 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.761+0000 7ff2219a5700 1 -- 172.21.15.32:0/2111080740 shutdown_connections 2023-10-08T13:44:00.772 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.761+0000 7ff2219a5700 1 -- 172.21.15.32:0/2111080740 wait complete. 2023-10-08T13:44:00.772 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.761+0000 7ff2219a5700 1 Processor -- start 2023-10-08T13:44:00.773 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.761+0000 7ff2219a5700 1 -- start start 2023-10-08T13:44:00.773 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.761+0000 7ff2219a5700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff21c06bbb0 0x7ff21c14e160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:44:00.773 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.761+0000 7ff2219a5700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff21c06d7b0 0x7ff21c0b28d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:44:00.774 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.761+0000 7ff2219a5700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff21c15d230 0x7ff21c0ae5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:44:00.774 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.761+0000 7ff2219a5700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff21c0b3340 con 0x7ff21c06bbb0 2023-10-08T13:44:00.774 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.761+0000 7ff2219a5700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff21c15fd00 con 0x7ff21c15d230 2023-10-08T13:44:00.774 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.761+0000 7ff2219a5700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff21c15ffe0 con 0x7ff21c06d7b0 2023-10-08T13:44:00.774 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.765+0000 7ff2209a3700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff21c06bbb0 0x7ff21c14e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:44:00.775 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.765+0000 7ff21bfff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff21c06d7b0 0x7ff21c0b28d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:44:00.775 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.765+0000 7ff2211a4700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff21c15d230 0x7ff21c0ae5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:44:00.775 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.765+0000 7ff21bfff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff21c06d7b0 0x7ff21c0b28d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.32:35486/0 (socket says 172.21.15.32:35486) 2023-10-08T13:44:00.775 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.765+0000 7ff21bfff700 1 -- 172.21.15.32:0/368027055 learned_addr learned my addr 172.21.15.32:0/368027055 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T13:44:00.775 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.765+0000 7ff21bfff700 1 -- 172.21.15.32:0/368027055 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff21c15d230 msgr2=0x7ff21c0ae5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:44:00.775 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.765+0000 7ff21bfff700 1 --2- 172.21.15.32:0/368027055 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff21c15d230 0x7ff21c0ae5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:44:00.775 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.765+0000 7ff21bfff700 1 -- 172.21.15.32:0/368027055 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff21c06bbb0 msgr2=0x7ff21c14e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:44:00.776 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.765+0000 7ff21bfff700 1 --2- 172.21.15.32:0/368027055 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff21c06bbb0 0x7ff21c14e160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:44:00.776 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.765+0000 7ff21bfff700 1 -- 172.21.15.32:0/368027055 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff208009570 con 0x7ff21c06d7b0 2023-10-08T13:44:00.776 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.765+0000 7ff21bfff700 1 --2- 172.21.15.32:0/368027055 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff21c06d7b0 0x7ff21c0b28d0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7ff208000c00 tx=0x7ff208004770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:44:00.776 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.765+0000 7ff2197fa700 1 -- 172.21.15.32:0/368027055 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff208011630 con 0x7ff21c06d7b0 2023-10-08T13:44:00.776 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.765+0000 7ff2197fa700 1 -- 172.21.15.32:0/368027055 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2080117b0 con 0x7ff21c06d7b0 2023-10-08T13:44:00.777 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.765+0000 7ff2197fa700 1 -- 172.21.15.32:0/368027055 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff208011b60 con 0x7ff21c06d7b0 2023-10-08T13:44:00.777 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.765+0000 7ff2219a5700 1 -- 172.21.15.32:0/368027055 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff21c1602c0 con 0x7ff21c06d7b0 2023-10-08T13:44:00.777 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.765+0000 7ff2219a5700 1 -- 172.21.15.32:0/368027055 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff21c14e6a0 con 0x7ff21c06d7b0 2023-10-08T13:44:00.779 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.765+0000 7ff2219a5700 1 -- 172.21.15.32:0/368027055 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff21c06a580 con 0x7ff21c06d7b0 2023-10-08T13:44:00.779 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.765+0000 7ff2197fa700 1 -- 172.21.15.32:0/368027055 <== mon.2 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7ff208021070 con 0x7ff21c06d7b0 2023-10-08T13:44:00.780 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.769+0000 7ff2197fa700 1 --2- 172.21.15.32:0/368027055 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7ff200066510 0x7ff2000689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:44:00.780 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.769+0000 7ff2197fa700 1 -- 172.21.15.32:0/368027055 <== mon.2 v2:172.21.15.40:3301/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4943+0+0 (secure 0 0 0) 0x7ff208085730 con 0x7ff21c06d7b0 2023-10-08T13:44:00.780 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.769+0000 7ff2209a3700 1 --2- 172.21.15.32:0/368027055 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7ff200066510 0x7ff2000689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:44:00.780 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.769+0000 7ff2197fa700 1 --2- 172.21.15.32:0/368027055 >> [v2:172.21.15.40:6824/2395850297,v1:172.21.15.40:6825/2395850297] conn(0x7ff20006c370 0x7ff20006e790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:44:00.781 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.769+0000 7ff2197fa700 1 -- 172.21.15.32:0/368027055 --> [v2:172.21.15.40:6824/2395850297,v1:172.21.15.40:6825/2395850297] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff20006ee40 con 0x7ff20006c370 2023-10-08T13:44:00.781 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.769+0000 7ff2197fa700 1 -- 172.21.15.32:0/368027055 <== mon.2 v2:172.21.15.40:3301/0 6 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff208085aa0 con 0x7ff21c06d7b0 2023-10-08T13:44:00.781 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.769+0000 7ff2211a4700 1 --2- 172.21.15.32:0/368027055 >> [v2:172.21.15.40:6824/2395850297,v1:172.21.15.40:6825/2395850297] conn(0x7ff20006c370 0x7ff20006e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:44:00.781 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.769+0000 7ff2209a3700 1 --2- 172.21.15.32:0/368027055 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7ff200066510 0x7ff2000689d0 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7ff2100013e0 tx=0x7ff210001370 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:44:00.782 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.769+0000 7ff2211a4700 1 --2- 172.21.15.32:0/368027055 >> [v2:172.21.15.40:6824/2395850297,v1:172.21.15.40:6825/2395850297] conn(0x7ff20006c370 0x7ff20006e790 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:44:00.782 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.769+0000 7ff2197fa700 1 -- 172.21.15.32:0/368027055 <== osd.5 v2:172.21.15.40:6824/2395850297 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7ff20006ee40 con 0x7ff20006c370 2023-10-08T13:44:00.794 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.789+0000 7ff2219a5700 1 -- 172.21.15.32:0/368027055 --> [v2:172.21.15.40:6824/2395850297,v1:172.21.15.40:6825/2395850297] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7ff21c06a2a0 con 0x7ff20006c370 2023-10-08T13:44:00.795 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.789+0000 7ff2197fa700 1 -- 172.21.15.32:0/368027055 <== osd.5 v2:172.21.15.40:6824/2395850297 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7ff214007140 con 0x7ff20006c370 2023-10-08T13:44:00.795 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2023-10-08T13:44:00.795 INFO:teuthology.orchestra.run.smithi032.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-08T13:44:00.795 INFO:teuthology.orchestra.run.smithi032.stdout:} 2023-10-08T13:44:00.796 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.789+0000 7ff2219a5700 1 -- 172.21.15.32:0/368027055 >> [v2:172.21.15.40:6824/2395850297,v1:172.21.15.40:6825/2395850297] conn(0x7ff20006c370 msgr2=0x7ff20006e790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:44:00.796 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.789+0000 7ff2219a5700 1 --2- 172.21.15.32:0/368027055 >> [v2:172.21.15.40:6824/2395850297,v1:172.21.15.40:6825/2395850297] conn(0x7ff20006c370 0x7ff20006e790 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:44:00.796 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.789+0000 7ff2219a5700 1 -- 172.21.15.32:0/368027055 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7ff200066510 msgr2=0x7ff2000689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:44:00.797 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.789+0000 7ff2219a5700 1 --2- 172.21.15.32:0/368027055 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7ff200066510 0x7ff2000689d0 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7ff2100013e0 tx=0x7ff210001370 comp rx=0 tx=0).stop 2023-10-08T13:44:00.797 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.789+0000 7ff2219a5700 1 -- 172.21.15.32:0/368027055 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff21c06d7b0 msgr2=0x7ff21c0b28d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:44:00.797 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.789+0000 7ff2219a5700 1 --2- 172.21.15.32:0/368027055 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff21c06d7b0 0x7ff21c0b28d0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7ff208000c00 tx=0x7ff208004770 comp rx=0 tx=0).stop 2023-10-08T13:44:00.797 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.789+0000 7ff2211a4700 1 -- 172.21.15.32:0/368027055 reap_dead start 2023-10-08T13:44:00.797 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.789+0000 7ff2219a5700 1 -- 172.21.15.32:0/368027055 shutdown_connections 2023-10-08T13:44:00.797 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.789+0000 7ff2219a5700 1 -- 172.21.15.32:0/368027055 >> 172.21.15.32:0/368027055 conn(0x7ff21c0cc7d0 msgr2=0x7ff21c0cbef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:44:00.797 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.789+0000 7ff2219a5700 1 -- 172.21.15.32:0/368027055 shutdown_connections 2023-10-08T13:44:00.797 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.789+0000 7ff2219a5700 1 -- 172.21.15.32:0/368027055 wait complete. 2023-10-08T13:44:00.811 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2023-10-08T13:44:00.914 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.909+0000 7fbd2ae0d700 1 Processor -- start 2023-10-08T13:44:00.915 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.909+0000 7fbd2ae0d700 1 -- start start 2023-10-08T13:44:00.917 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.909+0000 7fbd2ae0d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbd1c0e3420 0x7fbd1c03ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:44:00.917 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.909+0000 7fbd2ae0d700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fbd1c006c40 0x7fbd1c053de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:44:00.917 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.909+0000 7fbd2ae0d700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd1c054780 con 0x7fbd1c054320 2023-10-08T13:44:00.918 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.909+0000 7fbd2ae0d700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd1c0e3800 con 0x7fbd1c006c40 2023-10-08T13:44:00.918 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.909+0000 7fbd2ae0d700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd1c057150 con 0x7fbd1c0e3420 2023-10-08T13:44:00.918 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.909+0000 7fbd29e0b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbd1c0e3420 0x7fbd1c03ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:44:00.918 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.909+0000 7fbd2960a700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fbd1c006c40 0x7fbd1c053de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:44:00.918 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.909+0000 7fbd2a60c700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fbd1c054320 0x7fbd1c0e6e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.32:59566/0 (socket says 172.21.15.32:59566) 2023-10-08T13:44:00.919 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.909+0000 7fbd2a60c700 1 -- 172.21.15.32:0/3999799806 learned_addr learned my addr 172.21.15.32:0/3999799806 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-08T13:44:00.919 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.909+0000 7fbd28e09700 1 -- 172.21.15.32:0/3999799806 <== mon.1 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 988934849 0 0) 0x7fbd1c054780 con 0x7fbd1c054320 2023-10-08T13:44:00.919 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.909+0000 7fbd28e09700 1 -- 172.21.15.32:0/3999799806 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbd100035d0 con 0x7fbd1c054320 2023-10-08T13:44:00.919 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.909+0000 7fbd2960a700 1 -- 172.21.15.32:0/3999799806 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbd1c0e3420 msgr2=0x7fbd1c03ecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:44:00.919 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.909+0000 7fbd2960a700 1 --2- 172.21.15.32:0/3999799806 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbd1c0e3420 0x7fbd1c03ecd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:44:00.920 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.909+0000 7fbd2960a700 1 -- 172.21.15.32:0/3999799806 >> v1:172.21.15.40:6789/0 conn(0x7fbd1c054320 legacy=0x7fbd1c0e6e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:44:00.920 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.909+0000 7fbd2960a700 1 -- 172.21.15.32:0/3999799806 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd1c057430 con 0x7fbd1c006c40 2023-10-08T13:44:00.920 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.909+0000 7fbd2960a700 1 --2- 172.21.15.32:0/3999799806 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbd1c006c40 0x7fbd1c053de0 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7fbd14009850 tx=0x7fbd14009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=113c3dba4f009abe server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:44:00.920 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.909+0000 7fbd28e09700 1 -- 172.21.15.32:0/3999799806 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd14011830 con 0x7fbd1c006c40 2023-10-08T13:44:00.921 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.909+0000 7fbd28e09700 1 -- 172.21.15.32:0/3999799806 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd14011990 con 0x7fbd1c006c40 2023-10-08T13:44:00.921 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.909+0000 7fbd28e09700 1 -- 172.21.15.32:0/3999799806 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd14011d40 con 0x7fbd1c006c40 2023-10-08T13:44:00.924 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.913+0000 7fbd2ae0d700 1 -- 172.21.15.32:0/3999799806 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbd1c006c40 msgr2=0x7fbd1c053de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:44:00.925 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.913+0000 7fbd2ae0d700 1 --2- 172.21.15.32:0/3999799806 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbd1c006c40 0x7fbd1c053de0 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7fbd14009850 tx=0x7fbd14009b60 comp rx=0 tx=0).stop 2023-10-08T13:44:00.925 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.913+0000 7fbd2ae0d700 1 -- 172.21.15.32:0/3999799806 shutdown_connections 2023-10-08T13:44:00.925 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.913+0000 7fbd2ae0d700 1 --2- 172.21.15.32:0/3999799806 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbd1c006c40 0x7fbd1c053de0 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:44:00.925 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.913+0000 7fbd2ae0d700 1 --2- 172.21.15.32:0/3999799806 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbd1c0e3420 0x7fbd1c03ecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:44:00.925 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.913+0000 7fbd2ae0d700 1 -- 172.21.15.32:0/3999799806 >> 172.21.15.32:0/3999799806 conn(0x7fbd1c0590a0 msgr2=0x7fbd1c0594b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:44:00.925 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.913+0000 7fbd2ae0d700 1 -- 172.21.15.32:0/3999799806 shutdown_connections 2023-10-08T13:44:00.926 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.913+0000 7fbd2ae0d700 1 -- 172.21.15.32:0/3999799806 wait complete. 2023-10-08T13:44:00.926 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.913+0000 7fbd2ae0d700 1 Processor -- start 2023-10-08T13:44:00.926 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.913+0000 7fbd2ae0d700 1 -- start start 2023-10-08T13:44:00.926 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.913+0000 7fbd2ae0d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbd1c006c40 0x7fbd1c03b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:44:00.926 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.913+0000 7fbd2ae0d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbd1c054320 0x7fbd1c0d87c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:44:00.926 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.913+0000 7fbd2ae0d700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbd1c0e3420 0x7fbd1c17bf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:44:00.926 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.913+0000 7fbd2ae0d700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd1c052000 con 0x7fbd1c0e3420 2023-10-08T13:44:00.927 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.913+0000 7fbd2ae0d700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd1c17cd80 con 0x7fbd1c054320 2023-10-08T13:44:00.927 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.913+0000 7fbd2ae0d700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd1c03b800 con 0x7fbd1c006c40 2023-10-08T13:44:00.927 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.913+0000 7fbd2960a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbd1c054320 0x7fbd1c0d87c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:44:00.927 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.913+0000 7fbd2a60c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbd1c0e3420 0x7fbd1c17bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:44:00.927 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.913+0000 7fbd29e0b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbd1c006c40 0x7fbd1c03b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:44:00.927 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.913+0000 7fbd2960a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbd1c054320 0x7fbd1c0d87c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.32:37280/0 (socket says 172.21.15.32:37280) 2023-10-08T13:44:00.928 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.913+0000 7fbd2960a700 1 -- 172.21.15.32:0/1753641282 learned_addr learned my addr 172.21.15.32:0/1753641282 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T13:44:00.928 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.913+0000 7fbd2960a700 1 -- 172.21.15.32:0/1753641282 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbd1c006c40 msgr2=0x7fbd1c03b2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:44:00.928 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.913+0000 7fbd2960a700 1 --2- 172.21.15.32:0/1753641282 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbd1c006c40 0x7fbd1c03b2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:44:00.928 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.913+0000 7fbd2960a700 1 -- 172.21.15.32:0/1753641282 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbd1c0e3420 msgr2=0x7fbd1c17bf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:44:00.928 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.913+0000 7fbd2960a700 1 --2- 172.21.15.32:0/1753641282 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbd1c0e3420 0x7fbd1c17bf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:44:00.928 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.913+0000 7fbd2960a700 1 -- 172.21.15.32:0/1753641282 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd140094b0 con 0x7fbd1c054320 2023-10-08T13:44:00.928 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.917+0000 7fbd2960a700 1 --2- 172.21.15.32:0/1753641282 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbd1c054320 0x7fbd1c0d87c0 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7fbd14014040 tx=0x7fbd14004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:44:00.928 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.917+0000 7fbd1a7fc700 1 -- 172.21.15.32:0/1753641282 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd14004510 con 0x7fbd1c054320 2023-10-08T13:44:00.929 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.917+0000 7fbd1a7fc700 1 -- 172.21.15.32:0/1753641282 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd1401e070 con 0x7fbd1c054320 2023-10-08T13:44:00.929 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.917+0000 7fbd2ae0d700 1 -- 172.21.15.32:0/1753641282 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd1c050f60 con 0x7fbd1c054320 2023-10-08T13:44:00.930 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.917+0000 7fbd1a7fc700 1 -- 172.21.15.32:0/1753641282 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd14003900 con 0x7fbd1c054320 2023-10-08T13:44:00.930 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.917+0000 7fbd2ae0d700 1 -- 172.21.15.32:0/1753641282 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd1c051520 con 0x7fbd1c054320 2023-10-08T13:44:00.930 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.917+0000 7fbd1a7fc700 1 -- 172.21.15.32:0/1753641282 <== mon.1 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fbd14003a60 con 0x7fbd1c054320 2023-10-08T13:44:00.930 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.917+0000 7fbd2ae0d700 1 -- 172.21.15.32:0/1753641282 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd1c0058b0 con 0x7fbd1c054320 2023-10-08T13:44:00.931 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.917+0000 7fbd1a7fc700 1 --2- 172.21.15.32:0/1753641282 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fbd08066510 0x7fbd080689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:44:00.931 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.917+0000 7fbd1a7fc700 1 -- 172.21.15.32:0/1753641282 <== mon.1 v2:172.21.15.40:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fbd14020070 con 0x7fbd1c054320 2023-10-08T13:44:00.931 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.917+0000 7fbd29e0b700 1 --2- 172.21.15.32:0/1753641282 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fbd08066510 0x7fbd080689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:44:00.931 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.917+0000 7fbd29e0b700 1 --2- 172.21.15.32:0/1753641282 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fbd08066510 0x7fbd080689d0 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7fbd1c03dc50 tx=0x7fbd20009240 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:44:00.931 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:00.925+0000 7fbd1a7fc700 1 -- 172.21.15.32:0/1753641282 <== mon.1 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fbd14052690 con 0x7fbd1c054320 2023-10-08T13:44:01.096 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.089+0000 7fbd2ae0d700 1 -- 172.21.15.32:0/1753641282 --> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7fbd1c007750 con 0x7fbd08066510 2023-10-08T13:44:01.096 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.089+0000 7fbd1a7fc700 1 -- 172.21.15.32:0/1753641282 <== mgr.4107 v2:172.21.15.32:6832/2601628338 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fbd200118f0 con 0x7fbd08066510 2023-10-08T13:44:01.098 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.093+0000 7fbd2ae0d700 1 -- 172.21.15.32:0/1753641282 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fbd08066510 msgr2=0x7fbd080689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:44:01.098 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.093+0000 7fbd2ae0d700 1 --2- 172.21.15.32:0/1753641282 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fbd08066510 0x7fbd080689d0 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7fbd1c03dc50 tx=0x7fbd20009240 comp rx=0 tx=0).stop 2023-10-08T13:44:01.098 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.093+0000 7fbd2ae0d700 1 -- 172.21.15.32:0/1753641282 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbd1c054320 msgr2=0x7fbd1c0d87c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:44:01.099 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.093+0000 7fbd2ae0d700 1 --2- 172.21.15.32:0/1753641282 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbd1c054320 0x7fbd1c0d87c0 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7fbd14014040 tx=0x7fbd14004770 comp rx=0 tx=0).stop 2023-10-08T13:44:01.099 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.093+0000 7fbd2ae0d700 1 -- 172.21.15.32:0/1753641282 shutdown_connections 2023-10-08T13:44:01.099 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.093+0000 7fbd2ae0d700 1 --2- 172.21.15.32:0/1753641282 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fbd08066510 0x7fbd080689d0 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:44:01.099 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.093+0000 7fbd2ae0d700 1 --2- 172.21.15.32:0/1753641282 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbd1c0e3420 0x7fbd1c17bf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:44:01.099 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.093+0000 7fbd2ae0d700 1 --2- 172.21.15.32:0/1753641282 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbd1c054320 0x7fbd1c0d87c0 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:44:01.099 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.093+0000 7fbd2ae0d700 1 --2- 172.21.15.32:0/1753641282 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbd1c006c40 0x7fbd1c03b2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:44:01.099 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.093+0000 7fbd2ae0d700 1 -- 172.21.15.32:0/1753641282 >> 172.21.15.32:0/1753641282 conn(0x7fbd1c0590a0 msgr2=0x7fbd1c0e25f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:44:01.100 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.093+0000 7fbd2ae0d700 1 -- 172.21.15.32:0/1753641282 shutdown_connections 2023-10-08T13:44:01.100 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.093+0000 7fbd2ae0d700 1 -- 172.21.15.32:0/1753641282 wait complete. 2023-10-08T13:44:01.100 INFO:teuthology.orchestra.run.smithi032.stderr:instructed osd(s) 5 to deep-scrub 2023-10-08T13:44:01.109 INFO:tasks.ceph:Scrubbing osd.6 2023-10-08T13:44:01.109 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2023-10-08T13:44:01.221 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.217+0000 7f5b6ffff700 1 Processor -- start 2023-10-08T13:44:01.222 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.217+0000 7f5b6ffff700 1 -- start start 2023-10-08T13:44:01.224 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.217+0000 7f5b6ffff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5b7015d380 0x7f5b700cf8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:44:01.224 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.217+0000 7f5b6ffff700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f5b700d36a0 0x7f5b70166da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:44:01.224 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.217+0000 7f5b6ffff700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b700d0930 con 0x7f5b700cfdf0 2023-10-08T13:44:01.224 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.217+0000 7f5b6ffff700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b700cee50 con 0x7f5b700d36a0 2023-10-08T13:44:01.225 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.217+0000 7f5b6ffff700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b700d0370 con 0x7f5b7015d380 2023-10-08T13:44:01.225 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.217+0000 7f5b667fc700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f5b700cfdf0 0x7f5b700d2f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:38998/0 (socket says 172.21.15.32:38998) 2023-10-08T13:44:01.225 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.217+0000 7f5b667fc700 1 -- 172.21.15.32:0/1453393583 learned_addr learned my addr 172.21.15.32:0/1453393583 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-08T13:44:01.225 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.217+0000 7f5b6f7fe700 1 --2- 172.21.15.32:0/1453393583 >> v2:172.21.15.32:3300/0 conn(0x7f5b700d36a0 0x7f5b70166da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:44:01.225 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.217+0000 7f5b6effd700 1 --2- 172.21.15.32:0/1453393583 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5b7015d380 0x7f5b700cf8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:44:01.225 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.217+0000 7f5b6f7fe700 1 -- 172.21.15.32:0/1453393583 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5b7015d380 msgr2=0x7f5b700cf8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:44:01.226 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.217+0000 7f5b6f7fe700 1 --2- 172.21.15.32:0/1453393583 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5b7015d380 0x7f5b700cf8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:44:01.226 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.217+0000 7f5b6f7fe700 1 -- 172.21.15.32:0/1453393583 >> v1:172.21.15.32:6789/0 conn(0x7f5b700cfdf0 legacy=0x7f5b700d2f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:44:01.226 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.217+0000 7f5b6e7fc700 1 -- 172.21.15.32:0/1453393583 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3789924564 0 0) 0x7f5b700d0930 con 0x7f5b700cfdf0 2023-10-08T13:44:01.226 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.217+0000 7f5b6f7fe700 1 -- 172.21.15.32:0/1453393583 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b700d0650 con 0x7f5b700d36a0 2023-10-08T13:44:01.226 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.217+0000 7f5b6f7fe700 1 --2- 172.21.15.32:0/1453393583 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5b700d36a0 0x7f5b70166da0 secure :-1 s=READY pgs=1929 cs=0 l=1 rev1=1 crypto rx=0x7f5b68009d90 tx=0x7f5b6800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f22b853c45ca5df server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:44:01.229 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.217+0000 7f5b6e7fc700 1 -- 172.21.15.32:0/1453393583 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b6800e070 con 0x7f5b700d36a0 2023-10-08T13:44:01.229 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.217+0000 7f5b6e7fc700 1 -- 172.21.15.32:0/1453393583 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b6800bb20 con 0x7f5b700d36a0 2023-10-08T13:44:01.229 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.217+0000 7f5b6e7fc700 1 -- 172.21.15.32:0/1453393583 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b68012430 con 0x7f5b700d36a0 2023-10-08T13:44:01.229 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.221+0000 7f5b6ffff700 1 -- 172.21.15.32:0/1453393583 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5b700d36a0 msgr2=0x7f5b70166da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:44:01.229 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.221+0000 7f5b6ffff700 1 --2- 172.21.15.32:0/1453393583 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5b700d36a0 0x7f5b70166da0 secure :-1 s=READY pgs=1929 cs=0 l=1 rev1=1 crypto rx=0x7f5b68009d90 tx=0x7f5b6800b330 comp rx=0 tx=0).stop 2023-10-08T13:44:01.229 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.221+0000 7f5b6ffff700 1 -- 172.21.15.32:0/1453393583 shutdown_connections 2023-10-08T13:44:01.229 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.221+0000 7f5b6ffff700 1 --2- 172.21.15.32:0/1453393583 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5b700d36a0 0x7f5b70166da0 unknown :-1 s=CLOSED pgs=1929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:44:01.230 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.221+0000 7f5b6ffff700 1 --2- 172.21.15.32:0/1453393583 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5b7015d380 0x7f5b700cf8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:44:01.230 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.221+0000 7f5b6ffff700 1 -- 172.21.15.32:0/1453393583 >> 172.21.15.32:0/1453393583 conn(0x7f5b7006ab80 msgr2=0x7f5b7006af90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:44:01.230 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.221+0000 7f5b6ffff700 1 -- 172.21.15.32:0/1453393583 shutdown_connections 2023-10-08T13:44:01.230 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.221+0000 7f5b6ffff700 1 -- 172.21.15.32:0/1453393583 wait complete. 2023-10-08T13:44:01.230 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.221+0000 7f5b6ffff700 1 Processor -- start 2023-10-08T13:44:01.230 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.221+0000 7f5b6ffff700 1 -- start start 2023-10-08T13:44:01.233 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.225+0000 7f5b6ffff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5b700cfdf0 0x7f5b701590d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:44:01.233 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.225+0000 7f5b6ffff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5b700d36a0 0x7f5b70150e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:44:01.233 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.225+0000 7f5b6ffff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5b7015d380 0x7f5b7015fa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:44:01.233 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.225+0000 7f5b6ffff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b700ca720 con 0x7f5b7015d380 2023-10-08T13:44:01.233 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.225+0000 7f5b6ffff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b70159610 con 0x7f5b700cfdf0 2023-10-08T13:44:01.234 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.225+0000 7f5b6ffff700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b700ca440 con 0x7f5b700d36a0 2023-10-08T13:44:01.234 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.225+0000 7f5b6f7fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5b7015d380 0x7f5b7015fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:44:01.234 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.225+0000 7f5b6f7fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5b7015d380 0x7f5b7015fa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:59816/0 (socket says 172.21.15.32:59816) 2023-10-08T13:44:01.234 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.225+0000 7f5b6f7fe700 1 -- 172.21.15.32:0/4252950186 learned_addr learned my addr 172.21.15.32:0/4252950186 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T13:44:01.234 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.225+0000 7f5b667fc700 1 --2- 172.21.15.32:0/4252950186 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5b700d36a0 0x7f5b70150e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:44:01.234 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.225+0000 7f5b6effd700 1 --2- 172.21.15.32:0/4252950186 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5b700cfdf0 0x7f5b701590d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:44:01.234 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.225+0000 7f5b667fc700 1 -- 172.21.15.32:0/4252950186 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5b700cfdf0 msgr2=0x7f5b701590d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:44:01.235 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.225+0000 7f5b667fc700 1 --2- 172.21.15.32:0/4252950186 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5b700cfdf0 0x7f5b701590d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:44:01.235 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.225+0000 7f5b667fc700 1 -- 172.21.15.32:0/4252950186 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5b7015d380 msgr2=0x7f5b7015fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:44:01.235 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.225+0000 7f5b667fc700 1 --2- 172.21.15.32:0/4252950186 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5b7015d380 0x7f5b7015fa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:44:01.235 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.225+0000 7f5b667fc700 1 -- 172.21.15.32:0/4252950186 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b68009a70 con 0x7f5b700d36a0 2023-10-08T13:44:01.235 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.225+0000 7f5b6f7fe700 1 --2- 172.21.15.32:0/4252950186 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5b7015d380 0x7f5b7015fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:44:01.235 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.225+0000 7f5b667fc700 1 --2- 172.21.15.32:0/4252950186 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5b700d36a0 0x7f5b70150e00 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f5b5800c480 tx=0x7f5b5800c790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:44:01.235 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.225+0000 7f5b67fff700 1 -- 172.21.15.32:0/4252950186 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b58004ca0 con 0x7f5b700d36a0 2023-10-08T13:44:01.236 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.225+0000 7f5b67fff700 1 -- 172.21.15.32:0/4252950186 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b58004e00 con 0x7f5b700d36a0 2023-10-08T13:44:01.236 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.225+0000 7f5b6ffff700 1 -- 172.21.15.32:0/4252950186 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b70157fa0 con 0x7f5b700d36a0 2023-10-08T13:44:01.236 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.225+0000 7f5b67fff700 1 -- 172.21.15.32:0/4252950186 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b58007310 con 0x7f5b700d36a0 2023-10-08T13:44:01.236 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.225+0000 7f5b6ffff700 1 -- 172.21.15.32:0/4252950186 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b70158560 con 0x7f5b700d36a0 2023-10-08T13:44:01.236 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.225+0000 7f5b6ffff700 1 -- 172.21.15.32:0/4252950186 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f5b700d1500 con 0x7f5b700d36a0 2023-10-08T13:44:01.237 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.229+0000 7f5b67fff700 1 -- 172.21.15.32:0/4252950186 <== mon.2 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f5b58007470 con 0x7f5b700d36a0 2023-10-08T13:44:01.238 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.229+0000 7f5b67fff700 1 --2- 172.21.15.32:0/4252950186 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f5b50066540 0x7f5b50068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:44:01.238 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.229+0000 7f5b67fff700 1 -- 172.21.15.32:0/4252950186 <== mon.2 v2:172.21.15.40:3301/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f5b58083ed0 con 0x7f5b700d36a0 2023-10-08T13:44:01.238 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.229+0000 7f5b6effd700 1 --2- 172.21.15.32:0/4252950186 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f5b50066540 0x7f5b50068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:44:01.238 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.229+0000 7f5b67fff700 1 --2- 172.21.15.32:0/4252950186 >> [v2:172.21.15.40:6808/4145283410,v1:172.21.15.40:6809/4145283410] conn(0x7f5b5006c3a0 0x7f5b5006e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:44:01.238 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.229+0000 7f5b67fff700 1 -- 172.21.15.32:0/4252950186 --> [v2:172.21.15.40:6808/4145283410,v1:172.21.15.40:6809/4145283410] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5b5006ee70 con 0x7f5b5006c3a0 2023-10-08T13:44:01.238 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.229+0000 7f5b67fff700 1 -- 172.21.15.32:0/4252950186 <== mon.2 v2:172.21.15.40:3301/0 6 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5b58084320 con 0x7f5b700d36a0 2023-10-08T13:44:01.238 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.229+0000 7f5b6f7fe700 1 --2- 172.21.15.32:0/4252950186 >> [v2:172.21.15.40:6808/4145283410,v1:172.21.15.40:6809/4145283410] conn(0x7f5b5006c3a0 0x7f5b5006e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:44:01.239 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.229+0000 7f5b6effd700 1 --2- 172.21.15.32:0/4252950186 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f5b50066540 0x7f5b50068a00 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f5b60009bf0 tx=0x7f5b60009240 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:44:01.239 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.229+0000 7f5b6f7fe700 1 --2- 172.21.15.32:0/4252950186 >> [v2:172.21.15.40:6808/4145283410,v1:172.21.15.40:6809/4145283410] conn(0x7f5b5006c3a0 0x7f5b5006e7c0 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:44:01.239 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.233+0000 7f5b67fff700 1 -- 172.21.15.32:0/4252950186 <== osd.6 v2:172.21.15.40:6808/4145283410 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f5b5006ee70 con 0x7f5b5006c3a0 2023-10-08T13:44:01.255 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.249+0000 7f5b6ffff700 1 -- 172.21.15.32:0/4252950186 --> [v2:172.21.15.40:6808/4145283410,v1:172.21.15.40:6809/4145283410] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f5b700d1220 con 0x7f5b5006c3a0 2023-10-08T13:44:01.256 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.249+0000 7f5b67fff700 1 -- 172.21.15.32:0/4252950186 <== osd.6 v2:172.21.15.40:6808/4145283410 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f5b680098f0 con 0x7f5b5006c3a0 2023-10-08T13:44:01.256 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2023-10-08T13:44:01.256 INFO:teuthology.orchestra.run.smithi032.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-08T13:44:01.257 INFO:teuthology.orchestra.run.smithi032.stdout:} 2023-10-08T13:44:01.258 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.249+0000 7f5b6ffff700 1 -- 172.21.15.32:0/4252950186 >> [v2:172.21.15.40:6808/4145283410,v1:172.21.15.40:6809/4145283410] conn(0x7f5b5006c3a0 msgr2=0x7f5b5006e7c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:44:01.258 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.249+0000 7f5b6ffff700 1 --2- 172.21.15.32:0/4252950186 >> [v2:172.21.15.40:6808/4145283410,v1:172.21.15.40:6809/4145283410] conn(0x7f5b5006c3a0 0x7f5b5006e7c0 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:44:01.258 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.249+0000 7f5b6ffff700 1 -- 172.21.15.32:0/4252950186 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f5b50066540 msgr2=0x7f5b50068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:44:01.258 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.249+0000 7f5b6ffff700 1 --2- 172.21.15.32:0/4252950186 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f5b50066540 0x7f5b50068a00 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f5b60009bf0 tx=0x7f5b60009240 comp rx=0 tx=0).stop 2023-10-08T13:44:01.258 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.249+0000 7f5b6ffff700 1 -- 172.21.15.32:0/4252950186 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5b700d36a0 msgr2=0x7f5b70150e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:44:01.259 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.249+0000 7f5b6ffff700 1 --2- 172.21.15.32:0/4252950186 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5b700d36a0 0x7f5b70150e00 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f5b5800c480 tx=0x7f5b5800c790 comp rx=0 tx=0).stop 2023-10-08T13:44:01.259 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.249+0000 7f5b6f7fe700 1 -- 172.21.15.32:0/4252950186 reap_dead start 2023-10-08T13:44:01.259 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.249+0000 7f5b6ffff700 1 -- 172.21.15.32:0/4252950186 shutdown_connections 2023-10-08T13:44:01.259 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.249+0000 7f5b6ffff700 1 -- 172.21.15.32:0/4252950186 >> 172.21.15.32:0/4252950186 conn(0x7f5b7006ab80 msgr2=0x7f5b70153390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:44:01.259 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.249+0000 7f5b6ffff700 1 -- 172.21.15.32:0/4252950186 shutdown_connections 2023-10-08T13:44:01.259 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.249+0000 7f5b6ffff700 1 -- 172.21.15.32:0/4252950186 wait complete. 2023-10-08T13:44:01.268 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2023-10-08T13:44:01.385 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.377+0000 7fbc55038700 1 Processor -- start 2023-10-08T13:44:01.385 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.377+0000 7fbc55038700 1 -- start start 2023-10-08T13:44:01.386 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.381+0000 7fbc55038700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fbc5015d1f0 0x7fbc500cd980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:44:01.386 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.381+0000 7fbc55038700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbc500d0240 0x7fbc500d1e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:44:01.386 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.381+0000 7fbc55038700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc500ce240 con 0x7fbc5015d5d0 2023-10-08T13:44:01.386 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.381+0000 7fbc55038700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc500ce520 con 0x7fbc5015d1f0 2023-10-08T13:44:01.387 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.381+0000 7fbc55038700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc500ce800 con 0x7fbc500d0240 2023-10-08T13:44:01.387 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.381+0000 7fbc4ffff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fbc5015d1f0 0x7fbc500cd980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:44:01.387 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.381+0000 7fbc54837700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbc500d0240 0x7fbc500d1e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:44:01.387 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.381+0000 7fbc54837700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbc500d0240 0x7fbc500d1e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.32:35536/0 (socket says 172.21.15.32:35536) 2023-10-08T13:44:01.387 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.381+0000 7fbc4ffff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fbc5015d1f0 0x7fbc500cd980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.32:37300/0 (socket says 172.21.15.32:37300) 2023-10-08T13:44:01.387 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.381+0000 7fbc54837700 1 -- 172.21.15.32:0/1834879626 learned_addr learned my addr 172.21.15.32:0/1834879626 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T13:44:01.389 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.381+0000 7fbc4ffff700 1 -- 172.21.15.32:0/1834879626 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbc500d0240 msgr2=0x7fbc500d1e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:44:01.389 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.381+0000 7fbc4ffff700 1 --2- 172.21.15.32:0/1834879626 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbc500d0240 0x7fbc500d1e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:44:01.389 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.381+0000 7fbc4ffff700 1 -- 172.21.15.32:0/1834879626 >> v1:172.21.15.40:6789/0 conn(0x7fbc5015d5d0 legacy=0x7fbc500cfb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:44:01.389 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.381+0000 7fbc4ffff700 1 -- 172.21.15.32:0/1834879626 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc500d1600 con 0x7fbc5015d1f0 2023-10-08T13:44:01.390 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.381+0000 7fbc54837700 1 --2- 172.21.15.32:0/1834879626 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbc500d0240 0x7fbc500d1e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:44:01.390 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.381+0000 7fbc4ffff700 1 --2- 172.21.15.32:0/1834879626 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbc5015d1f0 0x7fbc500cd980 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7fbc38009850 tx=0x7fbc38009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f03b3e0941e293cd server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:44:01.390 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.381+0000 7fbc4effd700 1 -- 172.21.15.32:0/1834879626 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc38011830 con 0x7fbc5015d1f0 2023-10-08T13:44:01.390 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.381+0000 7fbc4effd700 1 -- 172.21.15.32:0/1834879626 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc38011990 con 0x7fbc5015d1f0 2023-10-08T13:44:01.390 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.381+0000 7fbc4effd700 1 -- 172.21.15.32:0/1834879626 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc38011d40 con 0x7fbc5015d1f0 2023-10-08T13:44:01.390 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.381+0000 7fbc55038700 1 -- 172.21.15.32:0/1834879626 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbc5015d1f0 msgr2=0x7fbc500cd980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:44:01.390 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.381+0000 7fbc55038700 1 --2- 172.21.15.32:0/1834879626 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbc5015d1f0 0x7fbc500cd980 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7fbc38009850 tx=0x7fbc38009b60 comp rx=0 tx=0).stop 2023-10-08T13:44:01.390 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.381+0000 7fbc55038700 1 -- 172.21.15.32:0/1834879626 shutdown_connections 2023-10-08T13:44:01.391 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.381+0000 7fbc55038700 1 --2- 172.21.15.32:0/1834879626 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbc500d0240 0x7fbc500d1e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:44:01.391 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.381+0000 7fbc55038700 1 --2- 172.21.15.32:0/1834879626 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbc5015d1f0 0x7fbc500cd980 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:44:01.391 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.381+0000 7fbc55038700 1 -- 172.21.15.32:0/1834879626 >> 172.21.15.32:0/1834879626 conn(0x7fbc5006ac10 msgr2=0x7fbc5006b020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:44:01.391 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.381+0000 7fbc55038700 1 -- 172.21.15.32:0/1834879626 shutdown_connections 2023-10-08T13:44:01.391 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.381+0000 7fbc55038700 1 -- 172.21.15.32:0/1834879626 wait complete. 2023-10-08T13:44:01.393 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.385+0000 7fbc55038700 1 Processor -- start 2023-10-08T13:44:01.393 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.385+0000 7fbc55038700 1 -- start start 2023-10-08T13:44:01.393 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.385+0000 7fbc55038700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbc500d0240 0x7fbc50151450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:44:01.394 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.385+0000 7fbc55038700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbc5015d1f0 0x7fbc50160f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:44:01.394 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.385+0000 7fbc55038700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbc5015d5d0 0x7fbc501614b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:44:01.394 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.385+0000 7fbc55038700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc50159a50 con 0x7fbc5015d5d0 2023-10-08T13:44:01.394 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.385+0000 7fbc55038700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc500ca7b0 con 0x7fbc500d0240 2023-10-08T13:44:01.394 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.385+0000 7fbc55038700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc50158e40 con 0x7fbc5015d1f0 2023-10-08T13:44:01.394 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.385+0000 7fbc54837700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbc5015d5d0 0x7fbc501614b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:44:01.394 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.385+0000 7fbc4f7fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbc5015d1f0 0x7fbc50160f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:44:01.395 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.385+0000 7fbc4f7fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbc5015d1f0 0x7fbc50160f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.32:35552/0 (socket says 172.21.15.32:35552) 2023-10-08T13:44:01.395 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.385+0000 7fbc4f7fe700 1 -- 172.21.15.32:0/722382806 learned_addr learned my addr 172.21.15.32:0/722382806 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T13:44:01.395 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.385+0000 7fbc4ffff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbc500d0240 0x7fbc50151450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:44:01.395 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.385+0000 7fbc4f7fe700 1 -- 172.21.15.32:0/722382806 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbc500d0240 msgr2=0x7fbc50151450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:44:01.395 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.385+0000 7fbc4f7fe700 1 --2- 172.21.15.32:0/722382806 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbc500d0240 0x7fbc50151450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:44:01.395 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.385+0000 7fbc4f7fe700 1 -- 172.21.15.32:0/722382806 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbc5015d5d0 msgr2=0x7fbc501614b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:44:01.395 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.385+0000 7fbc4f7fe700 1 --2- 172.21.15.32:0/722382806 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbc5015d5d0 0x7fbc501614b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:44:01.395 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.385+0000 7fbc4f7fe700 1 -- 172.21.15.32:0/722382806 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc48009b30 con 0x7fbc5015d1f0 2023-10-08T13:44:01.396 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.385+0000 7fbc4f7fe700 1 --2- 172.21.15.32:0/722382806 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbc5015d1f0 0x7fbc50160f70 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fbc4000c530 tx=0x7fbc4000c840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:44:01.396 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.385+0000 7fbc4cff9700 1 -- 172.21.15.32:0/722382806 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc4000cea0 con 0x7fbc5015d1f0 2023-10-08T13:44:01.396 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.385+0000 7fbc4cff9700 1 -- 172.21.15.32:0/722382806 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc400052d0 con 0x7fbc5015d1f0 2023-10-08T13:44:01.396 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.385+0000 7fbc55038700 1 -- 172.21.15.32:0/722382806 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc380094b0 con 0x7fbc5015d1f0 2023-10-08T13:44:01.396 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.385+0000 7fbc4cff9700 1 -- 172.21.15.32:0/722382806 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc400036a0 con 0x7fbc5015d1f0 2023-10-08T13:44:01.396 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.385+0000 7fbc55038700 1 -- 172.21.15.32:0/722382806 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc50159400 con 0x7fbc5015d1f0 2023-10-08T13:44:01.397 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.389+0000 7fbc55038700 1 -- 172.21.15.32:0/722382806 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc50073f00 con 0x7fbc5015d1f0 2023-10-08T13:44:01.397 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.389+0000 7fbc4cff9700 1 -- 172.21.15.32:0/722382806 <== mon.2 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fbc40003800 con 0x7fbc5015d1f0 2023-10-08T13:44:01.397 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.389+0000 7fbc4cff9700 1 --2- 172.21.15.32:0/722382806 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fbc30066510 0x7fbc300689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:44:01.398 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.389+0000 7fbc4cff9700 1 -- 172.21.15.32:0/722382806 <== mon.2 v2:172.21.15.40:3301/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fbc40082ed0 con 0x7fbc5015d1f0 2023-10-08T13:44:01.398 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.389+0000 7fbc4ffff700 1 --2- 172.21.15.32:0/722382806 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fbc30066510 0x7fbc300689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:44:01.398 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.389+0000 7fbc4ffff700 1 --2- 172.21.15.32:0/722382806 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fbc30066510 0x7fbc300689d0 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7fbc380090b0 tx=0x7fbc38008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:44:01.403 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.397+0000 7fbc4cff9700 1 -- 172.21.15.32:0/722382806 <== mon.2 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fbc400505b0 con 0x7fbc5015d1f0 2023-10-08T13:44:01.573 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.565+0000 7fbc55038700 1 -- 172.21.15.32:0/722382806 --> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7fbc500cdec0 con 0x7fbc30066510 2023-10-08T13:44:01.574 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.569+0000 7fbc4cff9700 1 -- 172.21.15.32:0/722382806 <== mgr.4107 v2:172.21.15.32:6832/2601628338 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fbc38011c00 con 0x7fbc30066510 2023-10-08T13:44:01.577 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.569+0000 7fbc55038700 1 -- 172.21.15.32:0/722382806 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fbc30066510 msgr2=0x7fbc300689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:44:01.577 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.569+0000 7fbc55038700 1 --2- 172.21.15.32:0/722382806 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fbc30066510 0x7fbc300689d0 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7fbc380090b0 tx=0x7fbc38008030 comp rx=0 tx=0).stop 2023-10-08T13:44:01.578 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.569+0000 7fbc55038700 1 -- 172.21.15.32:0/722382806 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbc5015d1f0 msgr2=0x7fbc50160f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:44:01.578 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.569+0000 7fbc55038700 1 --2- 172.21.15.32:0/722382806 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbc5015d1f0 0x7fbc50160f70 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fbc4000c530 tx=0x7fbc4000c840 comp rx=0 tx=0).stop 2023-10-08T13:44:01.578 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.569+0000 7fbc55038700 1 -- 172.21.15.32:0/722382806 shutdown_connections 2023-10-08T13:44:01.578 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.569+0000 7fbc55038700 1 --2- 172.21.15.32:0/722382806 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fbc30066510 0x7fbc300689d0 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:44:01.579 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.569+0000 7fbc55038700 1 --2- 172.21.15.32:0/722382806 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbc5015d5d0 0x7fbc501614b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:44:01.579 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.569+0000 7fbc55038700 1 --2- 172.21.15.32:0/722382806 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbc5015d1f0 0x7fbc50160f70 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:44:01.579 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.569+0000 7fbc55038700 1 --2- 172.21.15.32:0/722382806 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbc500d0240 0x7fbc50151450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:44:01.579 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.569+0000 7fbc55038700 1 -- 172.21.15.32:0/722382806 >> 172.21.15.32:0/722382806 conn(0x7fbc5006ac10 msgr2=0x7fbc500c7400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:44:01.579 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.569+0000 7fbc55038700 1 -- 172.21.15.32:0/722382806 shutdown_connections 2023-10-08T13:44:01.579 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.569+0000 7fbc55038700 1 -- 172.21.15.32:0/722382806 wait complete. 2023-10-08T13:44:01.580 INFO:teuthology.orchestra.run.smithi032.stderr:instructed osd(s) 6 to deep-scrub 2023-10-08T13:44:01.588 INFO:tasks.ceph:Scrubbing osd.7 2023-10-08T13:44:01.588 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2023-10-08T13:44:01.705 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.697+0000 7f84ab59e700 1 Processor -- start 2023-10-08T13:44:01.706 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.697+0000 7f84ab59e700 1 -- start start 2023-10-08T13:44:01.709 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.701+0000 7f84ab59e700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f84ac0caa70 0x7f84ac15c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:44:01.709 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.701+0000 7f84ab59e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f84ac151900 0x7f84ac151d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:44:01.709 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.701+0000 7f84ab59e700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84ac071c20 con 0x7f84ac06fbf0 2023-10-08T13:44:01.709 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.701+0000 7f84ab59e700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84ac070420 con 0x7f84ac0caa70 2023-10-08T13:44:01.710 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.701+0000 7f84ab59e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84ac15ec60 con 0x7f84ac151900 2023-10-08T13:44:01.710 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.701+0000 7f84aad9d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f84ac151900 0x7f84ac151d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:44:01.710 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.701+0000 7f84aad9d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f84ac151900 0x7f84ac151d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.32:35568/0 (socket says 172.21.15.32:35568) 2023-10-08T13:44:01.710 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.701+0000 7f84aad9d700 1 -- 172.21.15.32:0/266452244 learned_addr learned my addr 172.21.15.32:0/266452244 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T13:44:01.711 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.701+0000 7f84aa59c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f84ac0caa70 0x7f84ac15c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:44:01.711 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.701+0000 7f84aad9d700 1 -- 172.21.15.32:0/266452244 >> v2:172.21.15.40:3300/0 conn(0x7f84ac0caa70 msgr2=0x7f84ac15c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:44:01.711 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.701+0000 7f84aad9d700 1 --2- 172.21.15.32:0/266452244 >> v2:172.21.15.40:3300/0 conn(0x7f84ac0caa70 0x7f84ac15c0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:44:01.711 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.701+0000 7f84a959a700 1 -- 172.21.15.32:0/266452244 <== mon.1 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1349219903 0 0) 0x7f84ac071c20 con 0x7f84ac06fbf0 2023-10-08T13:44:01.711 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.701+0000 7f84aad9d700 1 -- 172.21.15.32:0/266452244 >> v1:172.21.15.40:6789/0 conn(0x7f84ac06fbf0 legacy=0x7f84ac0cae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:44:01.711 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.701+0000 7f84aad9d700 1 -- 172.21.15.32:0/266452244 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84ac15c610 con 0x7f84ac151900 2023-10-08T13:44:01.711 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.701+0000 7f84aad9d700 1 --2- 172.21.15.32:0/266452244 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f84ac151900 0x7f84ac151d70 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f84a4009910 tx=0x7f84a4009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=afbea5a2dbe10b94 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:44:01.712 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.701+0000 7f84a959a700 1 -- 172.21.15.32:0/266452244 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84a4011830 con 0x7f84ac151900 2023-10-08T13:44:01.712 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.701+0000 7f84a959a700 1 -- 172.21.15.32:0/266452244 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84a4011990 con 0x7f84ac151900 2023-10-08T13:44:01.712 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.701+0000 7f84a959a700 1 -- 172.21.15.32:0/266452244 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84a4011d40 con 0x7f84ac151900 2023-10-08T13:44:01.712 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.701+0000 7f84ab59e700 1 -- 172.21.15.32:0/266452244 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f84ac151900 msgr2=0x7f84ac151d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:44:01.712 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.701+0000 7f84ab59e700 1 --2- 172.21.15.32:0/266452244 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f84ac151900 0x7f84ac151d70 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f84a4009910 tx=0x7f84a4009c20 comp rx=0 tx=0).stop 2023-10-08T13:44:01.712 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.701+0000 7f84ab59e700 1 -- 172.21.15.32:0/266452244 shutdown_connections 2023-10-08T13:44:01.712 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.701+0000 7f84ab59e700 1 --2- 172.21.15.32:0/266452244 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f84ac151900 0x7f84ac151d70 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:44:01.712 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.701+0000 7f84ab59e700 1 --2- 172.21.15.32:0/266452244 >> v2:172.21.15.40:3300/0 conn(0x7f84ac0caa70 0x7f84ac15c0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:44:01.713 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.701+0000 7f84ab59e700 1 -- 172.21.15.32:0/266452244 >> 172.21.15.32:0/266452244 conn(0x7f84ac0ced20 msgr2=0x7f84ac0cf130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:44:01.713 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.701+0000 7f84ab59e700 1 -- 172.21.15.32:0/266452244 shutdown_connections 2023-10-08T13:44:01.713 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.701+0000 7f84ab59e700 1 -- 172.21.15.32:0/266452244 wait complete. 2023-10-08T13:44:01.716 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.705+0000 7f84ab59e700 1 Processor -- start 2023-10-08T13:44:01.716 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.705+0000 7f84ab59e700 1 -- start start 2023-10-08T13:44:01.717 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.705+0000 7f84ab59e700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f84ac06fbf0 0x7f84ac1f6750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:44:01.717 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.705+0000 7f84ab59e700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f84ac0caa70 0x7f84ac1f2090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:44:01.717 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.705+0000 7f84ab59e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f84ac151900 0x7f84ac153db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:44:01.717 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.705+0000 7f84ab59e700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84ac1f6c90 con 0x7f84ac0caa70 2023-10-08T13:44:01.717 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.705+0000 7f84ab59e700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84ac154890 con 0x7f84ac06fbf0 2023-10-08T13:44:01.717 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.705+0000 7f84ab59e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84ac154b70 con 0x7f84ac151900 2023-10-08T13:44:01.718 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.705+0000 7f84a9d9b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f84ac0caa70 0x7f84ac1f2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:44:01.718 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.705+0000 7f84a9d9b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f84ac0caa70 0x7f84ac1f2090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:59826/0 (socket says 172.21.15.32:59826) 2023-10-08T13:44:01.718 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.705+0000 7f84aad9d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f84ac151900 0x7f84ac153db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:44:01.718 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.705+0000 7f84a9d9b700 1 -- 172.21.15.32:0/308330717 learned_addr learned my addr 172.21.15.32:0/308330717 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T13:44:01.718 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.705+0000 7f84aa59c700 1 --2- 172.21.15.32:0/308330717 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f84ac06fbf0 0x7f84ac1f6750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:44:01.718 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.705+0000 7f84a9d9b700 1 -- 172.21.15.32:0/308330717 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f84ac151900 msgr2=0x7f84ac153db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:44:01.719 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.705+0000 7f84a9d9b700 1 --2- 172.21.15.32:0/308330717 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f84ac151900 0x7f84ac153db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:44:01.719 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.705+0000 7f84a9d9b700 1 -- 172.21.15.32:0/308330717 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f84ac06fbf0 msgr2=0x7f84ac1f6750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:44:01.719 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.705+0000 7f84a9d9b700 1 --2- 172.21.15.32:0/308330717 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f84ac06fbf0 0x7f84ac1f6750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:44:01.719 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.705+0000 7f84a9d9b700 1 -- 172.21.15.32:0/308330717 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84a4009570 con 0x7f84ac0caa70 2023-10-08T13:44:01.719 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.705+0000 7f84aad9d700 1 --2- 172.21.15.32:0/308330717 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f84ac151900 0x7f84ac153db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:44:01.719 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.705+0000 7f84a9d9b700 1 --2- 172.21.15.32:0/308330717 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f84ac0caa70 0x7f84ac1f2090 secure :-1 s=READY pgs=1930 cs=0 l=1 rev1=1 crypto rx=0x7f849400cc50 tx=0x7f849400cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:44:01.719 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.705+0000 7f84a2ffd700 1 -- 172.21.15.32:0/308330717 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8494003e50 con 0x7f84ac0caa70 2023-10-08T13:44:01.720 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.705+0000 7f84a2ffd700 1 -- 172.21.15.32:0/308330717 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f849400a6c0 con 0x7f84ac0caa70 2023-10-08T13:44:01.720 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.705+0000 7f84ab59e700 1 -- 172.21.15.32:0/308330717 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84ac1f5f50 con 0x7f84ac0caa70 2023-10-08T13:44:01.720 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.705+0000 7f84a2ffd700 1 -- 172.21.15.32:0/308330717 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f849400aa70 con 0x7f84ac0caa70 2023-10-08T13:44:01.720 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.705+0000 7f84ab59e700 1 -- 172.21.15.32:0/308330717 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84ac1f25d0 con 0x7f84ac0caa70 2023-10-08T13:44:01.720 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.709+0000 7f84ab59e700 1 -- 172.21.15.32:0/308330717 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f84ac15ee70 con 0x7f84ac0caa70 2023-10-08T13:44:01.720 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.709+0000 7f84a2ffd700 1 -- 172.21.15.32:0/308330717 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f849400abd0 con 0x7f84ac0caa70 2023-10-08T13:44:01.721 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.709+0000 7f84a2ffd700 1 --2- 172.21.15.32:0/308330717 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f848c066510 0x7f848c0689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:44:01.721 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.709+0000 7f84a2ffd700 1 -- 172.21.15.32:0/308330717 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f84940835c0 con 0x7f84ac0caa70 2023-10-08T13:44:01.721 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.709+0000 7f84a2ffd700 1 --2- 172.21.15.32:0/308330717 >> [v2:172.21.15.40:6816/2943297416,v1:172.21.15.40:6817/2943297416] conn(0x7f848c06c370 0x7f848c06e790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:44:01.721 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.709+0000 7f84aa59c700 1 --2- 172.21.15.32:0/308330717 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f848c066510 0x7f848c0689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:44:01.722 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.709+0000 7f84a2ffd700 1 -- 172.21.15.32:0/308330717 --> [v2:172.21.15.40:6816/2943297416,v1:172.21.15.40:6817/2943297416] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f848c06ee40 con 0x7f848c06c370 2023-10-08T13:44:01.722 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.709+0000 7f84a2ffd700 1 -- 172.21.15.32:0/308330717 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8494085c80 con 0x7f84ac0caa70 2023-10-08T13:44:01.722 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.709+0000 7f84aad9d700 1 --2- 172.21.15.32:0/308330717 >> [v2:172.21.15.40:6816/2943297416,v1:172.21.15.40:6817/2943297416] conn(0x7f848c06c370 0x7f848c06e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:44:01.722 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.709+0000 7f84aa59c700 1 --2- 172.21.15.32:0/308330717 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f848c066510 0x7f848c0689d0 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f849c009bf0 tx=0x7f849c009240 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:44:01.722 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.709+0000 7f84aad9d700 1 --2- 172.21.15.32:0/308330717 >> [v2:172.21.15.40:6816/2943297416,v1:172.21.15.40:6817/2943297416] conn(0x7f848c06c370 0x7f848c06e790 crc :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:44:01.723 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.709+0000 7f84a2ffd700 1 -- 172.21.15.32:0/308330717 <== osd.7 v2:172.21.15.40:6816/2943297416 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f848c06ee40 con 0x7f848c06c370 2023-10-08T13:44:01.734 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.729+0000 7f84ab59e700 1 -- 172.21.15.32:0/308330717 --> [v2:172.21.15.40:6816/2943297416,v1:172.21.15.40:6817/2943297416] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f84ac0701e0 con 0x7f848c06c370 2023-10-08T13:44:01.735 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.729+0000 7f84a2ffd700 1 -- 172.21.15.32:0/308330717 <== osd.7 v2:172.21.15.40:6816/2943297416 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f84a4006c80 con 0x7f848c06c370 2023-10-08T13:44:01.735 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2023-10-08T13:44:01.735 INFO:teuthology.orchestra.run.smithi032.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-08T13:44:01.735 INFO:teuthology.orchestra.run.smithi032.stdout:} 2023-10-08T13:44:01.737 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.729+0000 7f84ab59e700 1 -- 172.21.15.32:0/308330717 >> [v2:172.21.15.40:6816/2943297416,v1:172.21.15.40:6817/2943297416] conn(0x7f848c06c370 msgr2=0x7f848c06e790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:44:01.737 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.729+0000 7f84ab59e700 1 --2- 172.21.15.32:0/308330717 >> [v2:172.21.15.40:6816/2943297416,v1:172.21.15.40:6817/2943297416] conn(0x7f848c06c370 0x7f848c06e790 crc :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:44:01.737 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.729+0000 7f84ab59e700 1 -- 172.21.15.32:0/308330717 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f848c066510 msgr2=0x7f848c0689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:44:01.737 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.729+0000 7f84ab59e700 1 --2- 172.21.15.32:0/308330717 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f848c066510 0x7f848c0689d0 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f849c009bf0 tx=0x7f849c009240 comp rx=0 tx=0).stop 2023-10-08T13:44:01.737 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.729+0000 7f84ab59e700 1 -- 172.21.15.32:0/308330717 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f84ac0caa70 msgr2=0x7f84ac1f2090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:44:01.738 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.729+0000 7f84ab59e700 1 --2- 172.21.15.32:0/308330717 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f84ac0caa70 0x7f84ac1f2090 secure :-1 s=READY pgs=1930 cs=0 l=1 rev1=1 crypto rx=0x7f849400cc50 tx=0x7f849400cf60 comp rx=0 tx=0).stop 2023-10-08T13:44:01.738 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.729+0000 7f84aad9d700 1 -- 172.21.15.32:0/308330717 reap_dead start 2023-10-08T13:44:01.738 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.729+0000 7f84ab59e700 1 -- 172.21.15.32:0/308330717 shutdown_connections 2023-10-08T13:44:01.738 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.729+0000 7f84ab59e700 1 -- 172.21.15.32:0/308330717 >> 172.21.15.32:0/308330717 conn(0x7f84ac0ced20 msgr2=0x7f84ac15a990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:44:01.738 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.729+0000 7f84ab59e700 1 -- 172.21.15.32:0/308330717 shutdown_connections 2023-10-08T13:44:01.738 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.729+0000 7f84ab59e700 1 -- 172.21.15.32:0/308330717 wait complete. 2023-10-08T13:44:01.747 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2023-10-08T13:44:01.862 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.857+0000 7f285177a700 1 Processor -- start 2023-10-08T13:44:01.862 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.857+0000 7f285177a700 1 -- start start 2023-10-08T13:44:01.865 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.857+0000 7f285177a700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f284c0c21a0 0x7f284c06c690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:44:01.865 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.857+0000 7f285177a700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f284c06c200 con 0x7f284c0cbef0 2023-10-08T13:44:01.865 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.857+0000 7f285177a700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f284c165d00 con 0x7f284c1652b0 2023-10-08T13:44:01.865 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.857+0000 7f285177a700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f284c1662c0 con 0x7f284c0c21a0 2023-10-08T13:44:01.866 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.857+0000 7f2850f79700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f284c0cbef0 0x7f284c0cc9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:39006/0 (socket says 172.21.15.32:39006) 2023-10-08T13:44:01.866 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.857+0000 7f2850f79700 1 -- 172.21.15.32:0/3419839258 learned_addr learned my addr 172.21.15.32:0/3419839258 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-08T13:44:01.866 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.857+0000 7f284bfff700 1 --2- 172.21.15.32:0/3419839258 >> v2:172.21.15.40:3300/0 conn(0x7f284c0c21a0 0x7f284c06c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:44:01.866 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.857+0000 7f284affd700 1 -- 172.21.15.32:0/3419839258 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 127336275 0 0) 0x7f284c06c200 con 0x7f284c0cbef0 2023-10-08T13:44:01.866 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.857+0000 7f284affd700 1 -- 172.21.15.32:0/3419839258 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f28340035d0 con 0x7f284c0cbef0 2023-10-08T13:44:01.866 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.857+0000 7f284affd700 1 -- 172.21.15.32:0/3419839258 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2270712410 0 0) 0x7f28340035d0 con 0x7f284c0cbef0 2023-10-08T13:44:01.867 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.857+0000 7f284affd700 1 -- 172.21.15.32:0/3419839258 >> v2:172.21.15.40:3300/0 conn(0x7f284c0c21a0 msgr2=0x7f284c06c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:44:01.867 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.857+0000 7f284affd700 1 --2- 172.21.15.32:0/3419839258 >> v2:172.21.15.40:3300/0 conn(0x7f284c0c21a0 0x7f284c06c690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:44:01.867 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.857+0000 7f284affd700 1 -- 172.21.15.32:0/3419839258 >> v1:172.21.15.40:6789/0 conn(0x7f284c1652b0 legacy=0x7f284c0cb7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:44:01.867 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.857+0000 7f284affd700 1 -- 172.21.15.32:0/3419839258 --> v1:172.21.15.32:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f284c165fe0 con 0x7f284c0cbef0 2023-10-08T13:44:01.867 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.857+0000 7f284affd700 1 -- 172.21.15.32:0/3419839258 <== mon.0 v1:172.21.15.32:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2364763317 0 0) 0x7f2840001670 con 0x7f284c0cbef0 2023-10-08T13:44:01.867 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.857+0000 7f284affd700 1 -- 172.21.15.32:0/3419839258 >> v1:172.21.15.32:6789/0 conn(0x7f284c0cbef0 legacy=0x7f284c0cc9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:44:01.868 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.857+0000 7f284affd700 1 --2- 172.21.15.32:0/3419839258 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2834003a20 0x7f2834003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:44:01.868 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.857+0000 7f284affd700 1 --2- 172.21.15.32:0/3419839258 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2834004420 0x7f28340048f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:44:01.868 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.857+0000 7f284affd700 1 --2- 172.21.15.32:0/3419839258 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2834005190 0x7f283400ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:44:01.869 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.857+0000 7f284affd700 1 -- 172.21.15.32:0/3419839258 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f284c1662c0 con 0x7f2834004420 2023-10-08T13:44:01.869 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.857+0000 7f284affd700 1 -- 172.21.15.32:0/3419839258 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f283400c0d0 con 0x7f2834005190 2023-10-08T13:44:01.869 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.857+0000 7f284affd700 1 -- 172.21.15.32:0/3419839258 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f283400c290 con 0x7f2834003a20 2023-10-08T13:44:01.869 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.857+0000 7f284b7fe700 1 --2- 172.21.15.32:0/3419839258 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2834004420 0x7f28340048f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:44:01.870 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.857+0000 7f2850f79700 1 --2- 172.21.15.32:0/3419839258 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2834005190 0x7f283400ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:44:01.870 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.857+0000 7f284bfff700 1 --2- 172.21.15.32:0/3419839258 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2834003a20 0x7f2834003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:44:01.870 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.857+0000 7f284b7fe700 1 -- 172.21.15.32:0/3419839258 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2834003a20 msgr2=0x7f2834003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:44:01.870 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.857+0000 7f284b7fe700 1 --2- 172.21.15.32:0/3419839258 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2834003a20 0x7f2834003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:44:01.870 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.857+0000 7f284b7fe700 1 -- 172.21.15.32:0/3419839258 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2834005190 msgr2=0x7f283400ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:44:01.871 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.857+0000 7f284b7fe700 1 --2- 172.21.15.32:0/3419839258 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2834005190 0x7f283400ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:44:01.871 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.857+0000 7f284b7fe700 1 -- 172.21.15.32:0/3419839258 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28340035d0 con 0x7f2834004420 2023-10-08T13:44:01.871 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.857+0000 7f2850f79700 1 --2- 172.21.15.32:0/3419839258 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2834005190 0x7f283400ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:44:01.871 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.857+0000 7f2850f79700 1 -- 172.21.15.32:0/3419839258 reap_dead start 2023-10-08T13:44:01.871 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.857+0000 7f284b7fe700 1 --2- 172.21.15.32:0/3419839258 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2834004420 0x7f28340048f0 secure :-1 s=READY pgs=1932 cs=0 l=1 rev1=1 crypto rx=0x7f283c0017e0 tx=0x7f28340058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df75c6a25cb4082d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:44:01.872 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.857+0000 7f284affd700 1 -- 172.21.15.32:0/3419839258 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f283c0052d0 con 0x7f2834004420 2023-10-08T13:44:01.872 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.857+0000 7f284affd700 1 -- 172.21.15.32:0/3419839258 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f283c005450 con 0x7f2834004420 2023-10-08T13:44:01.872 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.857+0000 7f284affd700 1 -- 172.21.15.32:0/3419839258 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f283c0038e0 con 0x7f2834004420 2023-10-08T13:44:01.880 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.861+0000 7f285177a700 1 -- 172.21.15.32:0/3419839258 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2834004420 msgr2=0x7f28340048f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:44:01.880 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.861+0000 7f285177a700 1 --2- 172.21.15.32:0/3419839258 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2834004420 0x7f28340048f0 secure :-1 s=READY pgs=1932 cs=0 l=1 rev1=1 crypto rx=0x7f283c0017e0 tx=0x7f28340058a0 comp rx=0 tx=0).stop 2023-10-08T13:44:01.881 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.861+0000 7f285177a700 1 -- 172.21.15.32:0/3419839258 shutdown_connections 2023-10-08T13:44:01.882 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.861+0000 7f285177a700 1 --2- 172.21.15.32:0/3419839258 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2834004420 0x7f28340048f0 unknown :-1 s=CLOSED pgs=1932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:44:01.882 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.861+0000 7f285177a700 1 -- 172.21.15.32:0/3419839258 >> 172.21.15.32:0/3419839258 conn(0x7f284c0b0900 msgr2=0x7f284c0b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:44:01.882 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.861+0000 7f285177a700 1 -- 172.21.15.32:0/3419839258 shutdown_connections 2023-10-08T13:44:01.882 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.861+0000 7f285177a700 1 -- 172.21.15.32:0/3419839258 wait complete. 2023-10-08T13:44:01.882 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.861+0000 7f285177a700 1 Processor -- start 2023-10-08T13:44:01.883 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.861+0000 7f285177a700 1 -- start start 2023-10-08T13:44:01.883 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.861+0000 7f285177a700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f284c1f6430 0x7f284c0c88f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:44:01.883 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.861+0000 7f285177a700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f284c1f6810 0x7f284c0c4d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:44:01.883 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.861+0000 7f285177a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f284c14ba60 0x7f284c14bef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:44:01.883 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.861+0000 7f285177a700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f284c0c8e30 con 0x7f284c1f6430 2023-10-08T13:44:01.884 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.861+0000 7f285177a700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f284c14c430 con 0x7f284c14ba60 2023-10-08T13:44:01.884 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.861+0000 7f285177a700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f284c0c3c90 con 0x7f284c1f6810 2023-10-08T13:44:01.884 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.861+0000 7f284bfff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f284c1f6430 0x7f284c0c88f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:44:01.884 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.861+0000 7f284bfff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f284c1f6430 0x7f284c0c88f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:59840/0 (socket says 172.21.15.32:59840) 2023-10-08T13:44:01.884 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.861+0000 7f284bfff700 1 -- 172.21.15.32:0/3470773240 learned_addr learned my addr 172.21.15.32:0/3470773240 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T13:44:01.884 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.861+0000 7f2850f79700 1 --2- 172.21.15.32:0/3470773240 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f284c14ba60 0x7f284c14bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:44:01.884 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.861+0000 7f284b7fe700 1 --2- 172.21.15.32:0/3470773240 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f284c1f6810 0x7f284c0c4d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:44:01.885 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.861+0000 7f284bfff700 1 -- 172.21.15.32:0/3470773240 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f284c1f6810 msgr2=0x7f284c0c4d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:44:01.885 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.861+0000 7f284bfff700 1 --2- 172.21.15.32:0/3470773240 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f284c1f6810 0x7f284c0c4d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:44:01.885 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.861+0000 7f284bfff700 1 -- 172.21.15.32:0/3470773240 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f284c14ba60 msgr2=0x7f284c14bef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:44:01.885 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.861+0000 7f284bfff700 1 --2- 172.21.15.32:0/3470773240 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f284c14ba60 0x7f284c14bef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:44:01.885 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.861+0000 7f284bfff700 1 -- 172.21.15.32:0/3470773240 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f284c0c3f70 con 0x7f284c1f6430 2023-10-08T13:44:01.885 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.861+0000 7f284b7fe700 1 --2- 172.21.15.32:0/3470773240 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f284c1f6810 0x7f284c0c4d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T13:44:01.885 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.861+0000 7f284bfff700 1 --2- 172.21.15.32:0/3470773240 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f284c1f6430 0x7f284c0c88f0 secure :-1 s=READY pgs=1933 cs=0 l=1 rev1=1 crypto rx=0x7f2844009f90 tx=0x7f284400f490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:44:01.886 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.861+0000 7f2848ff9700 1 -- 172.21.15.32:0/3470773240 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f284400e040 con 0x7f284c1f6430 2023-10-08T13:44:01.886 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.861+0000 7f2848ff9700 1 -- 172.21.15.32:0/3470773240 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f284400f040 con 0x7f284c1f6430 2023-10-08T13:44:01.886 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.861+0000 7f285177a700 1 -- 172.21.15.32:0/3470773240 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f284c0c4250 con 0x7f284c1f6430 2023-10-08T13:44:01.886 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.861+0000 7f2848ff9700 1 -- 172.21.15.32:0/3470773240 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2844015670 con 0x7f284c1f6430 2023-10-08T13:44:01.886 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.861+0000 7f285177a700 1 -- 172.21.15.32:0/3470773240 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f284c0c4810 con 0x7f284c1f6430 2023-10-08T13:44:01.886 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.865+0000 7f285177a700 1 -- 172.21.15.32:0/3470773240 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f284c0c49a0 con 0x7f284c1f6430 2023-10-08T13:44:01.886 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.865+0000 7f2848ff9700 1 -- 172.21.15.32:0/3470773240 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f28440157d0 con 0x7f284c1f6430 2023-10-08T13:44:01.886 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.865+0000 7f2848ff9700 1 --2- 172.21.15.32:0/3470773240 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f2838066510 0x7f28380689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:44:01.887 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.865+0000 7f284b7fe700 1 --2- 172.21.15.32:0/3470773240 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f2838066510 0x7f28380689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:44:01.887 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.865+0000 7f2848ff9700 1 -- 172.21.15.32:0/3470773240 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f2844084720 con 0x7f284c1f6430 2023-10-08T13:44:01.887 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.865+0000 7f284b7fe700 1 --2- 172.21.15.32:0/3470773240 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f2838066510 0x7f28380689d0 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f284c04fec0 tx=0x7f283c009030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:44:01.887 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:01.873+0000 7f2848ff9700 1 -- 172.21.15.32:0/3470773240 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f2844051e90 con 0x7f284c1f6430 2023-10-08T13:44:02.046 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:02.041+0000 7f285177a700 1 -- 172.21.15.32:0/3470773240 --> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7f284c06be60 con 0x7f2838066510 2023-10-08T13:44:02.047 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:02.041+0000 7f2848ff9700 1 -- 172.21.15.32:0/3470773240 <== mgr.4107 v2:172.21.15.32:6832/2601628338 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f284c06be60 con 0x7f2838066510 2023-10-08T13:44:02.050 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:02.041+0000 7f285177a700 1 -- 172.21.15.32:0/3470773240 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f2838066510 msgr2=0x7f28380689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:44:02.050 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:02.041+0000 7f285177a700 1 --2- 172.21.15.32:0/3470773240 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f2838066510 0x7f28380689d0 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f284c04fec0 tx=0x7f283c009030 comp rx=0 tx=0).stop 2023-10-08T13:44:02.051 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:02.041+0000 7f285177a700 1 -- 172.21.15.32:0/3470773240 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f284c1f6430 msgr2=0x7f284c0c88f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:44:02.051 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:02.041+0000 7f285177a700 1 --2- 172.21.15.32:0/3470773240 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f284c1f6430 0x7f284c0c88f0 secure :-1 s=READY pgs=1933 cs=0 l=1 rev1=1 crypto rx=0x7f2844009f90 tx=0x7f284400f490 comp rx=0 tx=0).stop 2023-10-08T13:44:02.051 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:02.045+0000 7f285177a700 1 -- 172.21.15.32:0/3470773240 shutdown_connections 2023-10-08T13:44:02.051 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:02.045+0000 7f285177a700 1 --2- 172.21.15.32:0/3470773240 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f2838066510 0x7f28380689d0 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:44:02.052 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:02.045+0000 7f285177a700 1 --2- 172.21.15.32:0/3470773240 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f284c14ba60 0x7f284c14bef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:44:02.052 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:02.045+0000 7f285177a700 1 --2- 172.21.15.32:0/3470773240 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f284c1f6810 0x7f284c0c4d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:44:02.052 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:02.045+0000 7f285177a700 1 --2- 172.21.15.32:0/3470773240 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f284c1f6430 0x7f284c0c88f0 unknown :-1 s=CLOSED pgs=1933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:44:02.052 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:02.045+0000 7f285177a700 1 -- 172.21.15.32:0/3470773240 >> 172.21.15.32:0/3470773240 conn(0x7f284c0b0900 msgr2=0x7f284c0ae770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:44:02.053 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:02.045+0000 7f285177a700 1 -- 172.21.15.32:0/3470773240 shutdown_connections 2023-10-08T13:44:02.053 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:02.045+0000 7f285177a700 1 -- 172.21.15.32:0/3470773240 wait complete. 2023-10-08T13:44:02.054 INFO:teuthology.orchestra.run.smithi032.stderr:instructed osd(s) 7 to deep-scrub 2023-10-08T13:44:02.062 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T13:44:02.172 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:02.165+0000 7fbd1b59e700 1 Processor -- start 2023-10-08T13:44:02.173 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:02.165+0000 7fbd1b59e700 1 -- start start 2023-10-08T13:44:02.176 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:02.165+0000 7fbd1b59e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbd1c06b3b0 0x7fbd1c06b790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:44:02.177 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:02.169+0000 7fbd1b59e700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fbd1c15e190 0x7fbd1c15aa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:44:02.177 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:02.169+0000 7fbd1b59e700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd1c15e940 con 0x7fbd1c06d990 2023-10-08T13:44:02.177 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:02.169+0000 7fbd1b59e700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd1c15a830 con 0x7fbd1c15e190 2023-10-08T13:44:02.177 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:02.169+0000 7fbd1b59e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd1c06bcd0 con 0x7fbd1c06b3b0 2023-10-08T13:44:02.178 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:02.169+0000 7fbd1ad9d700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fbd1c15e190 0x7fbd1c15aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:44:02.178 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:02.169+0000 7fbd1ad9d700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fbd1c15e190 0x7fbd1c15aa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.32:37384/0 (socket says 172.21.15.32:37384) 2023-10-08T13:44:02.178 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:02.169+0000 7fbd1ad9d700 1 -- 172.21.15.32:0/1262880579 learned_addr learned my addr 172.21.15.32:0/1262880579 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T13:44:02.178 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:02.169+0000 7fbd1a59c700 1 --2- 172.21.15.32:0/1262880579 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbd1c06b3b0 0x7fbd1c06b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:44:02.179 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:02.169+0000 7fbd1ad9d700 1 -- 172.21.15.32:0/1262880579 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbd1c06b3b0 msgr2=0x7fbd1c06b790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:44:02.179 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:02.169+0000 7fbd1ad9d700 1 --2- 172.21.15.32:0/1262880579 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbd1c06b3b0 0x7fbd1c06b790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:44:02.179 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:02.169+0000 7fbd1ad9d700 1 -- 172.21.15.32:0/1262880579 >> v1:172.21.15.40:6789/0 conn(0x7fbd1c06d990 legacy=0x7fbd1c15da80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:44:02.180 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:02.169+0000 7fbd1ad9d700 1 -- 172.21.15.32:0/1262880579 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd1c0ce8a0 con 0x7fbd1c15e190 2023-10-08T13:44:02.180 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:02.169+0000 7fbd1a59c700 1 --2- 172.21.15.32:0/1262880579 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbd1c06b3b0 0x7fbd1c06b790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:44:02.180 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:02.169+0000 7fbd1ad9d700 1 --2- 172.21.15.32:0/1262880579 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbd1c15e190 0x7fbd1c15aa10 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7fbd14009e50 tx=0x7fbd1400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aca0e59fbc05bcde server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:44:02.180 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:02.169+0000 7fbd1959a700 1 -- 172.21.15.32:0/1262880579 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd1400e070 con 0x7fbd1c15e190 2023-10-08T13:44:02.180 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:02.169+0000 7fbd1959a700 1 -- 172.21.15.32:0/1262880579 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd1400b9c0 con 0x7fbd1c15e190 2023-10-08T13:44:02.181 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:02.169+0000 7fbd1959a700 1 -- 172.21.15.32:0/1262880579 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd1400bd70 con 0x7fbd1c15e190 2023-10-08T13:44:02.181 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:02.169+0000 7fbd1b59e700 1 -- 172.21.15.32:0/1262880579 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbd1c15e190 msgr2=0x7fbd1c15aa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:44:02.181 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:02.169+0000 7fbd1b59e700 1 --2- 172.21.15.32:0/1262880579 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbd1c15e190 0x7fbd1c15aa10 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7fbd14009e50 tx=0x7fbd1400b330 comp rx=0 tx=0).stop 2023-10-08T13:44:02.181 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:02.169+0000 7fbd1b59e700 1 -- 172.21.15.32:0/1262880579 shutdown_connections 2023-10-08T13:44:02.182 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:02.169+0000 7fbd1b59e700 1 --2- 172.21.15.32:0/1262880579 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbd1c15e190 0x7fbd1c15aa10 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:44:02.182 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:02.169+0000 7fbd1b59e700 1 --2- 172.21.15.32:0/1262880579 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbd1c06b3b0 0x7fbd1c06b790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:44:02.182 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:02.169+0000 7fbd1b59e700 1 -- 172.21.15.32:0/1262880579 >> 172.21.15.32:0/1262880579 conn(0x7fbd1c0cc7d0 msgr2=0x7fbd1c0ccbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:44:02.182 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:02.169+0000 7fbd1b59e700 1 -- 172.21.15.32:0/1262880579 shutdown_connections 2023-10-08T13:44:02.183 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:02.169+0000 7fbd1b59e700 1 -- 172.21.15.32:0/1262880579 wait complete. 2023-10-08T13:44:02.186 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:02.173+0000 7fbd1b59e700 1 Processor -- start 2023-10-08T13:44:02.186 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:02.173+0000 7fbd1b59e700 1 -- start start 2023-10-08T13:44:02.187 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:02.173+0000 7fbd1b59e700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbd1c06b3b0 0x7fbd1c1f44f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:44:02.187 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:02.173+0000 7fbd1b59e700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbd1c06d990 0x7fbd1c0c5b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:44:02.187 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:02.173+0000 7fbd1b59e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbd1c15e190 0x7fbd1c15d760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:44:02.187 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:02.173+0000 7fbd1b59e700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd1c1f4a30 con 0x7fbd1c06d990 2023-10-08T13:44:02.187 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:02.173+0000 7fbd1b59e700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd1c15c6c0 con 0x7fbd1c06b3b0 2023-10-08T13:44:02.188 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:02.173+0000 7fbd1b59e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd1c15c9a0 con 0x7fbd1c15e190 2023-10-08T13:44:02.188 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:02.173+0000 7fbd19d9b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbd1c06d990 0x7fbd1c0c5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:44:02.188 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:02.173+0000 7fbd1a59c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbd1c06b3b0 0x7fbd1c1f44f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:44:02.188 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:02.173+0000 7fbd19d9b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbd1c06d990 0x7fbd1c0c5b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:59852/0 (socket says 172.21.15.32:59852) 2023-10-08T13:44:02.188 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:02.173+0000 7fbd19d9b700 1 -- 172.21.15.32:0/2555025055 learned_addr learned my addr 172.21.15.32:0/2555025055 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T13:44:02.188 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:02.173+0000 7fbd1ad9d700 1 --2- 172.21.15.32:0/2555025055 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbd1c15e190 0x7fbd1c15d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:44:02.189 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:02.173+0000 7fbd19d9b700 1 -- 172.21.15.32:0/2555025055 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbd1c15e190 msgr2=0x7fbd1c15d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:44:02.189 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:02.173+0000 7fbd19d9b700 1 --2- 172.21.15.32:0/2555025055 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbd1c15e190 0x7fbd1c15d760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:44:02.189 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:02.173+0000 7fbd19d9b700 1 -- 172.21.15.32:0/2555025055 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbd1c06b3b0 msgr2=0x7fbd1c1f44f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:44:02.189 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:02.173+0000 7fbd19d9b700 1 --2- 172.21.15.32:0/2555025055 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbd1c06b3b0 0x7fbd1c1f44f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:44:02.190 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:02.173+0000 7fbd19d9b700 1 -- 172.21.15.32:0/2555025055 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd14009b30 con 0x7fbd1c06d990 2023-10-08T13:44:02.190 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:02.173+0000 7fbd1a59c700 1 --2- 172.21.15.32:0/2555025055 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbd1c06b3b0 0x7fbd1c1f44f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T13:44:02.190 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:02.173+0000 7fbd19d9b700 1 --2- 172.21.15.32:0/2555025055 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbd1c06d990 0x7fbd1c0c5b00 secure :-1 s=READY pgs=1934 cs=0 l=1 rev1=1 crypto rx=0x7fbd0c00c500 tx=0x7fbd0c00c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:44:02.190 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:02.173+0000 7fbd0affd700 1 -- 172.21.15.32:0/2555025055 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd0c0052d0 con 0x7fbd1c06d990 2023-10-08T13:44:02.190 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:02.173+0000 7fbd0affd700 1 -- 172.21.15.32:0/2555025055 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd0c005430 con 0x7fbd1c06d990 2023-10-08T13:44:02.191 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:02.173+0000 7fbd1b59e700 1 -- 172.21.15.32:0/2555025055 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd1c15cc80 con 0x7fbd1c06d990 2023-10-08T13:44:02.191 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:02.173+0000 7fbd0affd700 1 -- 172.21.15.32:0/2555025055 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd0c0055a0 con 0x7fbd1c06d990 2023-10-08T13:44:02.191 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:02.173+0000 7fbd1b59e700 1 -- 172.21.15.32:0/2555025055 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd1c15d240 con 0x7fbd1c06d990 2023-10-08T13:44:02.191 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:02.177+0000 7fbd1b59e700 1 -- 172.21.15.32:0/2555025055 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd1c0686a0 con 0x7fbd1c06d990 2023-10-08T13:44:02.191 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:02.177+0000 7fbd0affd700 1 -- 172.21.15.32:0/2555025055 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fbd0c0038e0 con 0x7fbd1c06d990 2023-10-08T13:44:02.191 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:02.177+0000 7fbd0affd700 1 --2- 172.21.15.32:0/2555025055 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fbcfc066510 0x7fbcfc0689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:44:02.192 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:02.177+0000 7fbd0affd700 1 -- 172.21.15.32:0/2555025055 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fbd0c082f90 con 0x7fbd1c06d990 2023-10-08T13:44:02.192 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:02.177+0000 7fbd1a59c700 1 --2- 172.21.15.32:0/2555025055 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fbcfc066510 0x7fbcfc0689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:44:02.192 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:02.177+0000 7fbd1a59c700 1 --2- 172.21.15.32:0/2555025055 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fbcfc066510 0x7fbcfc0689d0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7fbd1c0c8f80 tx=0x7fbd10008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:44:02.193 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:02.185+0000 7fbd0affd700 1 -- 172.21.15.32:0/2555025055 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fbd0c050670 con 0x7fbd1c06d990 2023-10-08T13:44:02.355 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:02.349+0000 7fbd1b59e700 1 -- 172.21.15.32:0/2555025055 --> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fbd1c06ceb0 con 0x7fbcfc066510 2023-10-08T13:44:02.361 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:02.353+0000 7fbd0affd700 1 -- 172.21.15.32:0/2555025055 <== mgr.4107 v2:172.21.15.32:6832/2601628338 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+49523 (secure 0 0 0) 0x7fbd100037a0 con 0x7fbcfc066510 2023-10-08T13:44:02.362 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T13:44:02.364 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:02.357+0000 7fbd1b59e700 1 -- 172.21.15.32:0/2555025055 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fbcfc066510 msgr2=0x7fbcfc0689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:44:02.365 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:02.357+0000 7fbd1b59e700 1 --2- 172.21.15.32:0/2555025055 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fbcfc066510 0x7fbcfc0689d0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7fbd1c0c8f80 tx=0x7fbd10008040 comp rx=0 tx=0).stop 2023-10-08T13:44:02.365 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:02.357+0000 7fbd1b59e700 1 -- 172.21.15.32:0/2555025055 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbd1c06d990 msgr2=0x7fbd1c0c5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:44:02.365 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:02.357+0000 7fbd1b59e700 1 --2- 172.21.15.32:0/2555025055 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbd1c06d990 0x7fbd1c0c5b00 secure :-1 s=READY pgs=1934 cs=0 l=1 rev1=1 crypto rx=0x7fbd0c00c500 tx=0x7fbd0c00c810 comp rx=0 tx=0).stop 2023-10-08T13:44:02.365 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:02.357+0000 7fbd1b59e700 1 -- 172.21.15.32:0/2555025055 shutdown_connections 2023-10-08T13:44:02.366 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:02.357+0000 7fbd1b59e700 1 --2- 172.21.15.32:0/2555025055 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fbcfc066510 0x7fbcfc0689d0 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:44:02.366 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:02.357+0000 7fbd1b59e700 1 --2- 172.21.15.32:0/2555025055 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbd1c06d990 0x7fbd1c0c5b00 unknown :-1 s=CLOSED pgs=1934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:44:02.366 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:02.357+0000 7fbd1b59e700 1 --2- 172.21.15.32:0/2555025055 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbd1c15e190 0x7fbd1c15d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:44:02.367 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:02.357+0000 7fbd1b59e700 1 --2- 172.21.15.32:0/2555025055 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbd1c06b3b0 0x7fbd1c1f44f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:44:02.368 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:02.357+0000 7fbd1b59e700 1 -- 172.21.15.32:0/2555025055 >> 172.21.15.32:0/2555025055 conn(0x7fbd1c0cc7d0 msgr2=0x7fbd1c06a2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:44:02.368 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:02.357+0000 7fbd1b59e700 1 -- 172.21.15.32:0/2555025055 shutdown_connections 2023-10-08T13:44:02.368 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:02.357+0000 7fbd1b59e700 1 -- 172.21.15.32:0/2555025055 wait complete. 2023-10-08T13:44:02.369 INFO:teuthology.orchestra.run.smithi032.stderr:dumped all 2023-10-08T13:44:02.377 INFO:teuthology.orchestra.run.smithi032.stdout:{"pg_ready":true,"pg_map":{"version":13666,"stamp":"2023-10-08T13:44:00.952192+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":60,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":13552236,"kb_used_data":944812,"kb_used_omap":4346,"kb_used_meta":12603013,"kb_avail":741422484,"statfs":{"total":773094113280,"available":759216623616,"internally_reserved":0,"allocated":967487488,"data_stored":963627585,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4451158,"internal_metadata":12905485482},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1682,"apply_latency_ms":1682,"commit_latency_ns":1682000000,"apply_latency_ns":1682000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002029"},"pg_stats":[{"pgid":"1.0","version":"18'117","reported_seq":405,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-08T13:43:47.461073+0000","last_change":"2023-10-08T06:09:24.811692+0000","last_active":"2023-10-08T13:43:47.461073+0000","last_peered":"2023-10-08T13:43:47.461073+0000","last_clean":"2023-10-08T13:43:47.461073+0000","last_became_active":"2023-10-08T06:09:24.809788+0000","last_became_peered":"2023-10-08T06:09:24.809788+0000","last_unstale":"2023-10-08T13:43:47.461073+0000","last_undegraded":"2023-10-08T13:43:47.461073+0000","last_fullsized":"2023-10-08T13:43:47.461073+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T06:09:23.748736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T06:09:23.748736+0000","last_clean_scrub_stamp":"2023-10-08T06:09:23.748736+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:39:45.599458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424514895,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1501668,"kb_used_data":39900,"kb_used_omap":148,"kb_used_meta":1461611,"kb_avail":92870172,"statfs":{"total":96636764160,"available":95099056128,"internally_reserved":0,"allocated":40857600,"data_stored":40482952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":152224,"internal_metadata":1496690016},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":202,"apply_latency_ms":202,"commit_latency_ns":202000000,"apply_latency_ns":202000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 13:42:58 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.69299999999999995,"15min":0.78100000000000003},"min":{"1min":0.29299999999999998,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":2.6720000000000002,"5min":5.484,"15min":11.773},"last":0.59899999999999998},{"interface":"front","average":{"1min":1.5549999999999999,"5min":1.1830000000000001,"15min":1.141},"min":{"1min":0.315,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":8.8859999999999992,"5min":8.8859999999999992,"15min":8.8859999999999992},"last":0.93200000000000005}]},{"osd":1,"last update":"Sun Oct 8 13:42:58 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.90500000000000003,"15min":0.94299999999999995},"min":{"1min":0.29799999999999999,"5min":0.29299999999999998,"15min":0.27500000000000002},"max":{"1min":2.6989999999999998,"5min":6.8970000000000002,"15min":11.943},"last":0.52000000000000002},{"interface":"front","average":{"1min":1.611,"5min":1.2410000000000001,"15min":1.218},"min":{"1min":0.378,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":8.7330000000000005,"5min":8.7330000000000005,"15min":8.7330000000000005},"last":0.90600000000000003}]},{"osd":2,"last update":"Sun Oct 8 13:42:58 2023","interfaces":[{"interface":"back","average":{"1min":1.976,"5min":1.4510000000000001,"15min":1.2729999999999999},"min":{"1min":0.41299999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":8.8559999999999999,"5min":8.8559999999999999,"15min":8.8559999999999999},"last":0.879},{"interface":"front","average":{"1min":1.7729999999999999,"5min":1.1859999999999999,"15min":1.2929999999999999},"min":{"1min":0.35999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":9,"5min":9,"15min":9},"last":0.748}]},{"osd":3,"last update":"Sun Oct 8 13:42:58 2023","interfaces":[{"interface":"back","average":{"1min":4.181,"5min":1.8480000000000001,"15min":1.3740000000000001},"min":{"1min":0.40200000000000002,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":32.707000000000001,"5min":32.707000000000001,"15min":32.707000000000001},"last":0.438},{"interface":"front","average":{"1min":3.5870000000000002,"5min":2.1040000000000001,"15min":1.6519999999999999},"min":{"1min":0.438,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":30.983000000000001,"5min":30.983000000000001,"15min":30.983000000000001},"last":0.84599999999999997}]},{"osd":4,"last update":"Sun Oct 8 13:42:58 2023","interfaces":[{"interface":"back","average":{"1min":1.357,"5min":1.1519999999999999,"15min":1.3240000000000001},"min":{"1min":0.32200000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":8.9220000000000006,"5min":9.3499999999999996,"15min":11.516},"last":1.109},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.86799999999999999,"15min":1.177},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":2.6000000000000001,"5min":5.6820000000000004,"15min":11.907},"last":0.47399999999999998}]},{"osd":5,"last update":"Sun Oct 8 13:42:58 2023","interfaces":[{"interface":"back","average":{"1min":1.663,"5min":1.2609999999999999,"15min":1.3260000000000001},"min":{"1min":0.41599999999999998,"5min":0.379,"15min":0.32700000000000001},"max":{"1min":8.8239999999999998,"5min":13.045999999999999,"15min":13.045999999999999},"last":0.96499999999999997},{"interface":"front","average":{"1min":1.9199999999999999,"5min":1.3260000000000001,"15min":1.4810000000000001},"min":{"1min":0.38600000000000001,"5min":0.373,"15min":0.36799999999999999},"max":{"1min":9.0299999999999994,"5min":9.0299999999999994,"15min":11.547000000000001},"last":0.81000000000000005}]},{"osd":6,"last update":"Sun Oct 8 13:42:58 2023","interfaces":[{"interface":"back","average":{"1min":1.909,"5min":1.3799999999999999,"15min":1.536},"min":{"1min":0.42599999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":8.9629999999999992,"5min":8.9629999999999992,"15min":11.567},"last":0.78300000000000003},{"interface":"front","average":{"1min":1.2470000000000001,"5min":1.0669999999999999,"15min":1.1779999999999999},"min":{"1min":0.45100000000000001,"5min":0.41399999999999998,"15min":0.33600000000000002},"max":{"1min":4.9939999999999998,"5min":6.5910000000000002,"15min":11.827},"last":0.98399999999999999}]}]},{"osd":6,"up_from":15,"seq":64424514898,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1734332,"kb_used_data":17396,"kb_used_omap":546,"kb_used_meta":1716381,"kb_avail":92637508,"statfs":{"total":96636764160,"available":94860808192,"internally_reserved":0,"allocated":17813504,"data_stored":17495264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":559457,"internal_metadata":1757574815},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":189,"apply_latency_ms":189,"commit_latency_ns":189000000,"apply_latency_ns":189000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 13:43:41 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.59199999999999997,"15min":0.77600000000000002},"min":{"1min":0.34499999999999997,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.79300000000000004,"5min":6.5910000000000002,"15min":8.3569999999999993},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.82299999999999995,"15min":0.95099999999999996},"min":{"1min":0.35399999999999998,"5min":0.318,"15min":0.28199999999999997},"max":{"1min":0.872,"5min":6.5789999999999997,"15min":8.5980000000000008},"last":0.46800000000000003}]},{"osd":1,"last update":"Sun Oct 8 13:43:41 2023","interfaces":[{"interface":"back","average":{"1min":1.077,"5min":1.127,"15min":1.24},"min":{"1min":0.34200000000000003,"5min":0.29299999999999998,"15min":0.28699999999999998},"max":{"1min":4.2110000000000003,"5min":6.4029999999999996,"15min":8.8900000000000006},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.83999999999999997,"15min":0.93000000000000005},"min":{"1min":0.34399999999999997,"5min":0.29699999999999999,"15min":0.27700000000000002},"max":{"1min":1.0269999999999999,"5min":7.1260000000000003,"15min":8.4120000000000008},"last":0.57699999999999996}]},{"osd":2,"last update":"Sun Oct 8 13:43:41 2023","interfaces":[{"interface":"back","average":{"1min":1.038,"5min":1.169,"15min":1.1319999999999999},"min":{"1min":0.40300000000000002,"5min":0.39800000000000002,"15min":0.318},"max":{"1min":4.0060000000000002,"5min":7.5510000000000002,"15min":8.4469999999999992},"last":0.65400000000000003},{"interface":"front","average":{"1min":1.083,"5min":1.2330000000000001,"15min":1.2829999999999999},"min":{"1min":0.38,"5min":0.38,"15min":0.34899999999999998},"max":{"1min":7.6200000000000001,"5min":7.6200000000000001,"15min":8.3759999999999994},"last":0.51400000000000001}]},{"osd":3,"last update":"Sun Oct 8 13:43:41 2023","interfaces":[{"interface":"back","average":{"1min":1.0940000000000001,"5min":1.498,"15min":1.3520000000000001},"min":{"1min":0.41399999999999998,"5min":0.40799999999999997,"15min":0.36599999999999999},"max":{"1min":7.673,"5min":11.715999999999999,"15min":11.715999999999999},"last":0.78400000000000003},{"interface":"front","average":{"1min":1.3009999999999999,"5min":1.504,"15min":1.52},"min":{"1min":0.51800000000000002,"5min":0.373,"15min":0.35299999999999998},"max":{"1min":4.3079999999999998,"5min":10.132999999999999,"15min":10.369},"last":0.76800000000000002}]},{"osd":4,"last update":"Sun Oct 8 13:43:41 2023","interfaces":[{"interface":"back","average":{"1min":1.415,"5min":0.96099999999999997,"15min":1.0840000000000001},"min":{"1min":0.47499999999999998,"5min":0.34399999999999997,"15min":0.33800000000000002},"max":{"1min":6.46,"5min":6.7249999999999996,"15min":9.5},"last":14.255000000000001},{"interface":"front","average":{"1min":1.0600000000000001,"5min":1.1899999999999999,"15min":1.153},"min":{"1min":0.42999999999999999,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":6.3819999999999997,"5min":6.3819999999999997,"15min":8.2940000000000005},"last":11.787000000000001}]},{"osd":5,"last update":"Sun Oct 8 13:43:41 2023","interfaces":[{"interface":"back","average":{"1min":1.9099999999999999,"5min":1.4770000000000001,"15min":1.4710000000000001},"min":{"1min":0.40300000000000002,"5min":0.32200000000000001,"15min":0.317},"max":{"1min":5.5339999999999998,"5min":6.3840000000000003,"15min":9.3930000000000007},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.95699999999999996,"5min":0.89200000000000002,"15min":1.087},"min":{"1min":0.45800000000000002,"5min":0.376,"15min":0.376},"max":{"1min":3.4399999999999999,"5min":6.7560000000000002,"15min":10.087999999999999},"last":0.93999999999999995}]},{"osd":7,"last update":"Sun Oct 8 13:43:41 2023","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":1.119,"15min":1.2649999999999999},"min":{"1min":0.54400000000000004,"5min":0.41599999999999998,"15min":0.39400000000000002},"max":{"1min":1.6719999999999999,"5min":6.0010000000000003,"15min":14.177},"last":0.66800000000000004},{"interface":"front","average":{"1min":1.3620000000000001,"5min":1.3500000000000001,"15min":1.5860000000000001},"min":{"1min":0.58399999999999996,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":4.2859999999999996,"5min":6.6239999999999997,"15min":9.7579999999999991},"last":0.73099999999999998}]}]},{"osd":5,"up_from":15,"seq":64424514894,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1830800,"kb_used_data":8776,"kb_used_omap":249,"kb_used_meta":1821766,"kb_avail":92541040,"statfs":{"total":96636764160,"available":94762024960,"internally_reserved":0,"allocated":8986624,"data_stored":8714124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":255902,"internal_metadata":1865488482},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":225,"apply_latency_ms":225,"commit_latency_ns":225000000,"apply_latency_ns":225000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 13:43:49 2023","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":0.85499999999999998,"15min":0.83599999999999997},"min":{"1min":0.32100000000000001,"5min":0.26200000000000001,"15min":0.25900000000000001},"max":{"1min":3.871,"5min":5.2309999999999999,"15min":7.0830000000000002},"last":0.502},{"interface":"front","average":{"1min":1.5129999999999999,"5min":1.222,"15min":0.90100000000000002},"min":{"1min":0.32100000000000001,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":7.3319999999999999,"5min":11.331,"15min":11.331},"last":0.61699999999999999}]},{"osd":1,"last update":"Sun Oct 8 13:43:49 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.97099999999999997,"15min":1.02},"min":{"1min":0.308,"5min":0.28399999999999997,"15min":0.27600000000000002},"max":{"1min":2.931,"5min":5.2670000000000003,"15min":10.523999999999999},"last":0.45700000000000002},{"interface":"front","average":{"1min":1.8069999999999999,"5min":1.383,"15min":1.0700000000000001},"min":{"1min":0.33400000000000002,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":7.367,"5min":11.425000000000001,"15min":11.425000000000001},"last":0.65500000000000003}]},{"osd":2,"last update":"Sun Oct 8 13:43:49 2023","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":1.333,"15min":1.234},"min":{"1min":0.33500000000000002,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":5.7290000000000001,"5min":12.236000000000001,"15min":12.236000000000001},"last":0.76600000000000001},{"interface":"front","average":{"1min":1.0629999999999999,"5min":1.266,"15min":1.2330000000000001},"min":{"1min":0.38800000000000001,"5min":0.309,"15min":0.309},"max":{"1min":4.2220000000000004,"5min":8.7119999999999997,"15min":10.577},"last":0.752}]},{"osd":3,"last update":"Sun Oct 8 13:43:49 2023","interfaces":[{"interface":"back","average":{"1min":1.7130000000000001,"5min":1.383,"15min":1.331},"min":{"1min":0.40000000000000002,"5min":0.34100000000000003,"15min":0.313},"max":{"1min":7.2750000000000004,"5min":11.49,"15min":11.49},"last":0.78400000000000003},{"interface":"front","average":{"1min":1.101,"5min":1.516,"15min":1.274},"min":{"1min":0.41499999999999998,"5min":0.34399999999999997,"15min":0.34200000000000003},"max":{"1min":5.593,"5min":12.289999999999999,"15min":12.289999999999999},"last":0.72399999999999998}]},{"osd":4,"last update":"Sun Oct 8 13:43:49 2023","interfaces":[{"interface":"back","average":{"1min":1.21,"5min":1.1259999999999999,"15min":0.94199999999999995},"min":{"1min":0.44,"5min":0.32500000000000001,"15min":0.30599999999999999},"max":{"1min":5.5350000000000001,"5min":5.5350000000000001,"15min":7.1520000000000001},"last":0.53700000000000003},{"interface":"front","average":{"1min":1.8240000000000001,"5min":1.53,"15min":1.141},"min":{"1min":0.41599999999999998,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":7.3890000000000002,"5min":11.457000000000001,"15min":11.457000000000001},"last":0.56299999999999994}]},{"osd":6,"last update":"Sun Oct 8 13:43:49 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":1.536,"15min":1.302},"min":{"1min":0.39500000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":3.3130000000000002,"5min":12.329000000000001,"15min":12.329000000000001},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.96299999999999997,"5min":1.1930000000000001,"15min":1.1559999999999999},"min":{"1min":0.51300000000000001,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":3.282,"5min":6.6799999999999997,"15min":7.5259999999999998},"last":0.69499999999999995}]},{"osd":7,"last update":"Sun Oct 8 13:43:49 2023","interfaces":[{"interface":"back","average":{"1min":1.7270000000000001,"5min":1.546,"15min":1.2949999999999999},"min":{"1min":0.45700000000000002,"5min":0.39300000000000002,"15min":0.38200000000000001},"max":{"1min":7.4089999999999998,"5min":11.388999999999999,"15min":11.388999999999999},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.96799999999999997,"5min":1.6120000000000001,"15min":1.4179999999999999},"min":{"1min":0.434,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":5.1619999999999999,"5min":17.481999999999999,"15min":17.481999999999999},"last":0.81200000000000006}]}]},{"osd":4,"up_from":15,"seq":64424514895,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1863448,"kb_used_data":109712,"kb_used_omap":353,"kb_used_meta":1753374,"kb_avail":92508392,"statfs":{"total":96636764160,"available":94728593408,"internally_reserved":0,"allocated":112345088,"data_stored":111921520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":361854,"internal_metadata":1795455618},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":327,"apply_latency_ms":327,"commit_latency_ns":327000000,"apply_latency_ns":327000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 13:43:22 2023","interfaces":[{"interface":"back","average":{"1min":1.28,"5min":1.3140000000000001,"15min":1.2410000000000001},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":5.5220000000000002,"5min":6.585,"15min":6.585},"last":0.49099999999999999},{"interface":"front","average":{"1min":1.0580000000000001,"5min":1.2450000000000001,"15min":0.95499999999999996},"min":{"1min":0.33800000000000002,"5min":0.30499999999999999,"15min":0.26100000000000001},"max":{"1min":5.3949999999999996,"5min":7.6559999999999997,"15min":7.6559999999999997},"last":0.316}]},{"osd":1,"last update":"Sun Oct 8 13:43:22 2023","interfaces":[{"interface":"back","average":{"1min":1.1910000000000001,"5min":1.1419999999999999,"15min":1.2},"min":{"1min":0.28599999999999998,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":5.0640000000000001,"5min":6.9219999999999997,"15min":10.321},"last":0.439},{"interface":"front","average":{"1min":1.429,"5min":1.4530000000000001,"15min":1.45},"min":{"1min":0.42199999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":5.5659999999999998,"5min":7.0579999999999998,"15min":7.7009999999999996},"last":0.41499999999999998}]},{"osd":2,"last update":"Sun Oct 8 13:43:22 2023","interfaces":[{"interface":"back","average":{"1min":1.075,"5min":1.8029999999999999,"15min":1.5149999999999999},"min":{"1min":0.33800000000000002,"5min":0.316,"15min":0.316},"max":{"1min":4.2080000000000002,"5min":42.488,"15min":42.488},"last":1.6619999999999999},{"interface":"front","average":{"1min":1.3600000000000001,"5min":1.855,"15min":1.6699999999999999},"min":{"1min":0.34100000000000003,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":5.5949999999999998,"5min":43.997999999999998,"15min":43.997999999999998},"last":1.7250000000000001}]},{"osd":3,"last update":"Sun Oct 8 13:43:22 2023","interfaces":[{"interface":"back","average":{"1min":1.536,"5min":1.605,"15min":1.3520000000000001},"min":{"1min":0.374,"5min":0.35999999999999999,"15min":0.35899999999999999},"max":{"1min":5.4320000000000004,"5min":8.4339999999999993,"15min":8.4339999999999993},"last":0.51500000000000001},{"interface":"front","average":{"1min":1.704,"5min":1.4550000000000001,"15min":1.4139999999999999},"min":{"1min":0.42799999999999999,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":5.2389999999999999,"5min":6.8380000000000001,"15min":10.433999999999999},"last":0.54000000000000004}]},{"osd":5,"last update":"Sun Oct 8 13:43:22 2023","interfaces":[{"interface":"back","average":{"1min":1.75,"5min":1.3680000000000001,"15min":1.2549999999999999},"min":{"1min":0.38100000000000001,"5min":0.30499999999999999,"15min":0.29199999999999998},"max":{"1min":6.069,"5min":12.226000000000001,"15min":12.226000000000001},"last":11.547000000000001},{"interface":"front","average":{"1min":1.266,"5min":1.2350000000000001,"15min":1.0680000000000001},"min":{"1min":0.36099999999999999,"5min":0.32900000000000001,"15min":0.32600000000000001},"max":{"1min":5.3029999999999999,"5min":6.6769999999999996,"15min":6.6769999999999996},"last":0.95499999999999996}]},{"osd":6,"last update":"Sun Oct 8 13:43:22 2023","interfaces":[{"interface":"back","average":{"1min":1.0740000000000001,"5min":1.222,"15min":1.304},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.36399999999999999},"max":{"1min":4.0110000000000001,"5min":5.8650000000000002,"15min":10.470000000000001},"last":0.79000000000000004},{"interface":"front","average":{"1min":1.5449999999999999,"5min":1.472,"15min":1.5029999999999999},"min":{"1min":0.44700000000000001,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":6.1180000000000003,"5min":9.4529999999999994,"15min":9.4529999999999994},"last":0.45800000000000002}]},{"osd":7,"last update":"Sun Oct 8 13:43:22 2023","interfaces":[{"interface":"back","average":{"1min":1.2130000000000001,"5min":1.423,"15min":1.3220000000000001},"min":{"1min":0.37,"5min":0.37,"15min":0.34399999999999997},"max":{"1min":5.3570000000000002,"5min":11.946999999999999,"15min":11.946999999999999},"last":0.55600000000000005},{"interface":"front","average":{"1min":1.0920000000000001,"5min":1.208,"15min":1.395},"min":{"1min":0.51400000000000001,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":4.0970000000000004,"5min":5.7329999999999997,"15min":10.802},"last":0.82899999999999996}]}]},{"osd":2,"up_from":15,"seq":64424514889,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1645268,"kb_used_data":30284,"kb_used_omap":345,"kb_used_meta":1614630,"kb_avail":92726572,"statfs":{"total":96636764160,"available":94952009728,"internally_reserved":0,"allocated":31010816,"data_stored":30693260,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":354112,"internal_metadata":1653381312},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":219,"apply_latency_ms":219,"commit_latency_ns":219000000,"apply_latency_ns":219000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 13:43:08 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.81200000000000006,"15min":0.73599999999999999},"min":{"1min":0.23999999999999999,"5min":0.221,"15min":0.221},"max":{"1min":2.4049999999999998,"5min":10.901,"15min":10.901},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.97299999999999998,"5min":0.89100000000000001,"15min":0.93100000000000005},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":4.0789999999999997,"5min":5.9340000000000002,"15min":13.784000000000001},"last":0.49199999999999999}]},{"osd":1,"last update":"Sun Oct 8 13:43:08 2023","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.625,"15min":1.0109999999999999},"min":{"1min":0.30199999999999999,"5min":0.25800000000000001,"15min":0.252},"max":{"1min":0.89100000000000001,"5min":4.1950000000000003,"15min":24.826000000000001},"last":0.432},{"interface":"front","average":{"1min":0.753,"5min":1.0149999999999999,"15min":1.302},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":2.4820000000000002,"5min":9.0609999999999999,"15min":34.645000000000003},"last":0.90200000000000002}]},{"osd":3,"last update":"Sun Oct 8 13:43:08 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.81999999999999995,"15min":1.1539999999999999},"min":{"1min":0.30399999999999999,"5min":0.29399999999999998,"15min":0.28299999999999997},"max":{"1min":1.042,"5min":5.0800000000000001,"15min":24.867000000000001},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.98199999999999998,"5min":1.2589999999999999,"15min":1.288},"min":{"1min":0.35599999999999998,"5min":0.29599999999999999,"15min":0.27200000000000002},"max":{"1min":3.9169999999999998,"5min":9.1880000000000006,"15min":25.219000000000001},"last":0.84299999999999997}]},{"osd":4,"last update":"Sun Oct 8 13:43:08 2023","interfaces":[{"interface":"back","average":{"1min":1.351,"5min":1.2470000000000001,"15min":1.196},"min":{"1min":0.40500000000000003,"5min":0.35099999999999998,"15min":0.33700000000000002},"max":{"1min":6.9779999999999998,"5min":10.451000000000001,"15min":10.451000000000001},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.71499999999999997,"5min":1.1220000000000001,"15min":1.087},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36199999999999999},"max":{"1min":2.5270000000000001,"5min":7.4429999999999996,"15min":8.4789999999999992},"last":0.97399999999999998}]},{"osd":5,"last update":"Sun Oct 8 13:43:08 2023","interfaces":[{"interface":"back","average":{"1min":1.323,"5min":1.4159999999999999,"15min":1.284},"min":{"1min":0.38400000000000001,"5min":0.376,"15min":0.376},"max":{"1min":6.258,"5min":11.327999999999999,"15min":11.327999999999999},"last":0.94399999999999995},{"interface":"front","average":{"1min":1.0149999999999999,"5min":1.159,"15min":1.2130000000000001},"min":{"1min":0.45200000000000001,"5min":0.39000000000000001,"15min":0.377},"max":{"1min":4.0209999999999999,"5min":11.901999999999999,"15min":13.888999999999999},"last":1.0589999999999999}]},{"osd":6,"last update":"Sun Oct 8 13:43:08 2023","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.84399999999999997,"15min":1.3},"min":{"1min":0.44500000000000001,"5min":0.436,"15min":0.41099999999999998},"max":{"1min":3.976,"5min":5.8150000000000004,"15min":13.939},"last":1.0920000000000001},{"interface":"front","average":{"1min":0.78400000000000003,"5min":1.538,"15min":1.448},"min":{"1min":0.44,"5min":0.39500000000000002,"15min":0.373},"max":{"1min":2.6970000000000001,"5min":11.553000000000001,"15min":12.218999999999999},"last":0.80800000000000005}]},{"osd":7,"last update":"Sun Oct 8 13:43:08 2023","interfaces":[{"interface":"back","average":{"1min":1.0609999999999999,"5min":1.3180000000000001,"15min":1.3080000000000001},"min":{"1min":0.436,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":4.3739999999999997,"5min":8.8740000000000006,"15min":8.8740000000000006},"last":1.206},{"interface":"front","average":{"1min":0.88300000000000001,"5min":1.2010000000000001,"15min":1.3979999999999999},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.439},"max":{"1min":4.0519999999999996,"5min":7.8220000000000001,"15min":13.997},"last":1.1220000000000001}]}]},{"osd":1,"up_from":15,"seq":64424514889,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1531276,"kb_used_data":4868,"kb_used_omap":1388,"kb_used_meta":1525011,"kb_avail":92840564,"statfs":{"total":96636764160,"available":95068737536,"internally_reserved":0,"allocated":4984832,"data_stored":4703827,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1421431,"internal_metadata":1561612169},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":228,"apply_latency_ms":228,"commit_latency_ns":228000000,"apply_latency_ns":228000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 13:43:12 2023","interfaces":[{"interface":"back","average":{"1min":1.4850000000000001,"5min":0.78300000000000003,"15min":0.82299999999999995},"min":{"1min":0.25800000000000001,"5min":0.24099999999999999,"15min":0.217},"max":{"1min":7.1760000000000002,"5min":7.1760000000000002,"15min":13.361000000000001},"last":0.55000000000000004},{"interface":"front","average":{"1min":1.4099999999999999,"5min":0.84699999999999998,"15min":1.002},"min":{"1min":0.34899999999999998,"5min":0.26300000000000001,"15min":0.25600000000000001},"max":{"1min":5.734,"5min":6.173,"15min":9.2110000000000003},"last":0.47599999999999998}]},{"osd":2,"last update":"Sun Oct 8 13:43:12 2023","interfaces":[{"interface":"back","average":{"1min":1.728,"5min":0.97999999999999998,"15min":0.94599999999999995},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.23799999999999999},"max":{"1min":10,"5min":10,"15min":13.401},"last":0.505},{"interface":"front","average":{"1min":2.0609999999999999,"5min":1.075,"15min":1.0960000000000001},"min":{"1min":0.27200000000000002,"5min":0.254,"15min":0.252},"max":{"1min":7.1189999999999998,"5min":7.1189999999999998,"15min":9.327},"last":0.57899999999999996}]},{"osd":3,"last update":"Sun Oct 8 13:43:12 2023","interfaces":[{"interface":"back","average":{"1min":1.4019999999999999,"5min":0.873,"15min":1.079},"min":{"1min":0.316,"5min":0.29499999999999998,"15min":0.27300000000000002},"max":{"1min":6.2329999999999997,"5min":6.2359999999999998,"15min":9.2750000000000004},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.92600000000000005,"5min":1.0760000000000001,"15min":1.1419999999999999},"min":{"1min":0.39300000000000002,"5min":0.27100000000000002,"15min":0.26800000000000002},"max":{"1min":4.6139999999999999,"5min":6.0590000000000002,"15min":13.012},"last":0.60999999999999999}]},{"osd":4,"last update":"Sun Oct 8 13:43:12 2023","interfaces":[{"interface":"back","average":{"1min":1.6910000000000001,"5min":1.3100000000000001,"15min":1.252},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.32400000000000001},"max":{"1min":7.2649999999999997,"5min":7.2649999999999997,"15min":13.443},"last":0.75600000000000001},{"interface":"front","average":{"1min":1.546,"5min":1.1799999999999999,"15min":1.2010000000000001},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38400000000000001},"max":{"1min":5.8479999999999999,"5min":6.3159999999999998,"15min":9.3859999999999992},"last":0.74199999999999999}]},{"osd":5,"last update":"Sun Oct 8 13:43:12 2023","interfaces":[{"interface":"back","average":{"1min":1.583,"5min":1.2829999999999999,"15min":1.242},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":5.3490000000000002,"5min":6.1109999999999998,"15min":6.1109999999999998},"last":1.1950000000000001},{"interface":"front","average":{"1min":1.8240000000000001,"5min":1.2090000000000001,"15min":1.3260000000000001},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.35299999999999998},"max":{"1min":7.2409999999999997,"5min":7.2409999999999997,"15min":13.468},"last":1.2949999999999999}]},{"osd":6,"last update":"Sun Oct 8 13:43:12 2023","interfaces":[{"interface":"back","average":{"1min":1.036,"5min":1.518,"15min":1.492},"min":{"1min":0.47299999999999998,"5min":0.40799999999999997,"15min":0.39200000000000002},"max":{"1min":4.7400000000000002,"5min":10.125,"15min":12.266},"last":0.67500000000000004},{"interface":"front","average":{"1min":2.3439999999999999,"5min":1.573,"15min":1.476},"min":{"1min":0.47799999999999998,"5min":0.40899999999999997,"15min":0.40200000000000002},"max":{"1min":7.2850000000000001,"5min":7.2850000000000001,"15min":13.489000000000001},"last":0.85699999999999998}]},{"osd":7,"last update":"Sun Oct 8 13:43:12 2023","interfaces":[{"interface":"back","average":{"1min":1.605,"5min":1.2310000000000001,"15min":1.413},"min":{"1min":0.54900000000000004,"5min":0.441,"15min":0.36199999999999999},"max":{"1min":5.8920000000000003,"5min":6.3780000000000001,"15min":9.4870000000000001},"last":0.79800000000000004},{"interface":"front","average":{"1min":1.054,"5min":1.5640000000000001,"15min":1.6040000000000001},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.437},"max":{"1min":4.7750000000000004,"5min":7.9260000000000002,"15min":12.263999999999999},"last":0.71999999999999997}]}]},{"osd":0,"up_from":15,"seq":64424514894,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1461812,"kb_used_data":1004,"kb_used_omap":266,"kb_used_meta":1460533,"kb_avail":92910028,"statfs":{"total":96636764160,"available":95139868672,"internally_reserved":0,"allocated":1028096,"data_stored":760287,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":272932,"internal_metadata":1495586268},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":86,"apply_latency_ms":86,"commit_latency_ns":86000000,"apply_latency_ns":86000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 13:43:40 2023","interfaces":[{"interface":"back","average":{"1min":1.0680000000000001,"5min":1.0409999999999999,"15min":0.93400000000000005},"min":{"1min":0.25800000000000001,"5min":0.249,"15min":0.218},"max":{"1min":5.3979999999999997,"5min":8.1850000000000005,"15min":8.1850000000000005},"last":0.71099999999999997},{"interface":"front","average":{"1min":1.1259999999999999,"5min":1.0049999999999999,"15min":0.99399999999999999},"min":{"1min":0.27600000000000002,"5min":0.22,"15min":0.22},"max":{"1min":4.5419999999999998,"5min":11.153,"15min":11.153},"last":0.68400000000000005}]},{"osd":2,"last update":"Sun Oct 8 13:43:40 2023","interfaces":[{"interface":"back","average":{"1min":1.2370000000000001,"5min":1.0509999999999999,"15min":0.96099999999999997},"min":{"1min":0.31,"5min":0.25600000000000001,"15min":0.248},"max":{"1min":7.5670000000000002,"5min":8.891,"15min":10.115},"last":0.50800000000000001},{"interface":"front","average":{"1min":1.5860000000000001,"5min":1.1910000000000001,"15min":1.0820000000000001},"min":{"1min":0.30099999999999999,"5min":0.25900000000000001,"15min":0.245},"max":{"1min":8.5069999999999997,"5min":8.5069999999999997,"15min":8.5069999999999997},"last":0.86299999999999999}]},{"osd":3,"last update":"Sun Oct 8 13:43:40 2023","interfaces":[{"interface":"back","average":{"1min":1.4670000000000001,"5min":1,"15min":1.1919999999999999},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.26200000000000001},"max":{"1min":6.9420000000000002,"5min":7.4400000000000004,"15min":7.4400000000000004},"last":0.53500000000000003},{"interface":"front","average":{"1min":1.9630000000000001,"5min":1.391,"15min":1.097},"min":{"1min":0.41299999999999998,"5min":0.33800000000000002,"15min":0.26900000000000002},"max":{"1min":7.4370000000000003,"5min":10.798,"15min":10.798},"last":0.82299999999999995}]},{"osd":4,"last update":"Sun Oct 8 13:43:40 2023","interfaces":[{"interface":"back","average":{"1min":1.349,"5min":1.111,"15min":1.2490000000000001},"min":{"1min":0.36099999999999999,"5min":0.34999999999999998,"15min":0.34399999999999997},"max":{"1min":6.9889999999999999,"5min":7.4930000000000003,"15min":7.4930000000000003},"last":0.48999999999999999},{"interface":"front","average":{"1min":1.6259999999999999,"5min":1.228,"15min":1.077},"min":{"1min":0.504,"5min":0.38700000000000001,"15min":0.35299999999999998},"max":{"1min":5.3460000000000001,"5min":8.077,"15min":8.077},"last":0.64600000000000002}]},{"osd":5,"last update":"Sun Oct 8 13:43:40 2023","interfaces":[{"interface":"back","average":{"1min":1.232,"5min":1.157,"15min":1.115},"min":{"1min":0.40100000000000002,"5min":0.37,"15min":0.36099999999999999},"max":{"1min":4.6340000000000003,"5min":5.5229999999999997,"15min":7.3940000000000001},"last":0.55000000000000004},{"interface":"front","average":{"1min":1.2629999999999999,"5min":1.1899999999999999,"15min":1.3049999999999999},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.377},"max":{"1min":7.0650000000000004,"5min":8.2750000000000004,"15min":8.2750000000000004},"last":0.62}]},{"osd":6,"last update":"Sun Oct 8 13:43:40 2023","interfaces":[{"interface":"back","average":{"1min":2.375,"5min":1.6499999999999999,"15min":1.339},"min":{"1min":0.55900000000000005,"5min":0.42499999999999999,"15min":0.36499999999999999},"max":{"1min":7.5739999999999998,"5min":8.0289999999999999,"15min":8.0289999999999999},"last":0.76700000000000002},{"interface":"front","average":{"1min":1.2589999999999999,"5min":1.2130000000000001,"15min":1.196},"min":{"1min":0.44400000000000001,"5min":0.42999999999999999,"15min":0.40799999999999997},"max":{"1min":4.6689999999999996,"5min":5.8419999999999996,"15min":10.696},"last":0.80500000000000005}]},{"osd":7,"last update":"Sun Oct 8 13:43:40 2023","interfaces":[{"interface":"back","average":{"1min":1.706,"5min":1.1990000000000001,"15min":1.161},"min":{"1min":0.47299999999999998,"5min":0.42899999999999999,"15min":0.40500000000000003},"max":{"1min":7.4420000000000002,"5min":7.4420000000000002,"15min":7.4420000000000002},"last":0.748},{"interface":"front","average":{"1min":1.5249999999999999,"5min":1.323,"15min":1.4239999999999999},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":7.0270000000000001,"5min":7.5549999999999997,"15min":9.298},"last":0.67000000000000004}]}]},{"osd":3,"up_from":14,"seq":60129547587,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1983632,"kb_used_data":732872,"kb_used_omap":1048,"kb_used_meta":1249703,"kb_avail":92388208,"statfs":{"total":96636764160,"available":94605524992,"internally_reserved":0,"allocated":750460928,"data_stored":748856351,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1073246,"internal_metadata":1279696802},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":206,"apply_latency_ms":206,"commit_latency_ns":206000000,"apply_latency_ns":206000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 13:43:18 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.72199999999999998,"15min":0.72899999999999998},"min":{"1min":0.26300000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":4.3200000000000003,"5min":6.8760000000000003,"15min":10.003},"last":0.497},{"interface":"front","average":{"1min":1.343,"5min":1.0740000000000001,"15min":0.96599999999999997},"min":{"1min":0.26400000000000001,"5min":0.245,"15min":0.245},"max":{"1min":8.5559999999999992,"5min":8.5559999999999992,"15min":10.115},"last":0.54900000000000004}]},{"osd":1,"last update":"Sun Oct 8 13:43:18 2023","interfaces":[{"interface":"back","average":{"1min":1.1000000000000001,"5min":1.052,"15min":1.0269999999999999},"min":{"1min":0.315,"5min":0.26500000000000001,"15min":0.251},"max":{"1min":9.7219999999999995,"5min":10.757,"15min":10.757},"last":1.4330000000000001},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.99399999999999999,"15min":0.93100000000000005},"min":{"1min":0.29399999999999998,"5min":0.27300000000000002,"15min":0.26000000000000001},"max":{"1min":3.9289999999999998,"5min":6.8280000000000003,"15min":6.9560000000000004},"last":0.53900000000000003}]},{"osd":2,"last update":"Sun Oct 8 13:43:18 2023","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":1.2050000000000001,"15min":1.0860000000000001},"min":{"1min":0.29499999999999998,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":4.7930000000000001,"5min":10.813000000000001,"15min":10.813000000000001},"last":1.466},{"interface":"front","average":{"1min":0.626,"5min":1.0389999999999999,"15min":0.94799999999999995},"min":{"1min":0.32300000000000001,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":1.496,"5min":7.1760000000000002,"15min":7.1760000000000002},"last":1.3169999999999999}]},{"osd":4,"last update":"Sun Oct 8 13:43:18 2023","interfaces":[{"interface":"back","average":{"1min":1.288,"5min":0.99299999999999999,"15min":1.087},"min":{"1min":0.375,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":4.5579999999999998,"5min":5.1449999999999996,"15min":10.182},"last":1.1579999999999999},{"interface":"front","average":{"1min":1.4019999999999999,"5min":1.2689999999999999,"15min":1.1819999999999999},"min":{"1min":0.42099999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":5.9989999999999997,"5min":10.851000000000001,"15min":10.851000000000001},"last":1.3700000000000001}]},{"osd":5,"last update":"Sun Oct 8 13:43:18 2023","interfaces":[{"interface":"back","average":{"1min":1.474,"5min":1.413,"15min":1.292},"min":{"1min":0.38800000000000001,"5min":0.36899999999999999,"15min":0.35899999999999999},"max":{"1min":6.7880000000000003,"5min":10.885,"15min":10.885},"last":1.3320000000000001},{"interface":"front","average":{"1min":1.111,"5min":1.1479999999999999,"15min":1.1659999999999999},"min":{"1min":0.38400000000000001,"5min":0.376,"15min":0.376},"max":{"1min":4.2000000000000002,"5min":6.9210000000000003,"15min":10.173999999999999},"last":1.28}]},{"osd":6,"last update":"Sun Oct 8 13:43:18 2023","interfaces":[{"interface":"back","average":{"1min":1.2230000000000001,"5min":1.228,"15min":1.2310000000000001},"min":{"1min":0.46000000000000002,"5min":0.43099999999999999,"15min":0.42899999999999999},"max":{"1min":8.0519999999999996,"5min":8.0519999999999996,"15min":8.0519999999999996},"last":1.242},{"interface":"front","average":{"1min":1.7350000000000001,"5min":1.1060000000000001,"15min":1.2589999999999999},"min":{"1min":0.48399999999999999,"5min":0.39600000000000002,"15min":0.379},"max":{"1min":7.8879999999999999,"5min":7.8879999999999999,"15min":12.263999999999999},"last":1.226}]},{"osd":7,"last update":"Sun Oct 8 13:43:18 2023","interfaces":[{"interface":"back","average":{"1min":1.6240000000000001,"5min":1.2430000000000001,"15min":1.3029999999999999},"min":{"1min":0.49099999999999999,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":6.5010000000000003,"5min":7.5220000000000002,"15min":10.202999999999999},"last":1.194},{"interface":"front","average":{"1min":1.413,"5min":1.3660000000000001,"15min":1.3109999999999999},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.42799999999999999},"max":{"1min":4.8319999999999999,"5min":10.952,"15min":10.952},"last":1.4019999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T13:44:02.381 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-10-08T06:09:23.748736+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=6, tm_min=9, tm_sec=23, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=13, tm_min=43, tm_sec=56, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T13:44:02.381 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-08T13:44:12.450 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:44:12.453 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:44:22.382 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T13:44:22.507 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:22.500+0000 7f74d5567700 1 Processor -- start 2023-10-08T13:44:22.508 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:22.500+0000 7f74d5567700 1 -- start start 2023-10-08T13:44:22.509 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:22.500+0000 7f74d5567700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f74d015d4b0 0x7f74d0161110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:44:22.509 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:22.500+0000 7f74d5567700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f74d00b8b20 0x7f74d00cdef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:44:22.509 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:22.500+0000 7f74d5567700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74d00d1620 con 0x7f74d00ce430 2023-10-08T13:44:22.510 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:22.500+0000 7f74d5567700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74d00ce8e0 con 0x7f74d00b8b20 2023-10-08T13:44:22.510 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:22.500+0000 7f74d5567700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74d00d1320 con 0x7f74d015d4b0 2023-10-08T13:44:22.510 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:22.500+0000 7f74cf7fe700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f74d00b8b20 0x7f74d00cdef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:44:22.510 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:22.500+0000 7f74cf7fe700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f74d00b8b20 0x7f74d00cdef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:36326/0 (socket says 172.21.15.32:36326) 2023-10-08T13:44:22.510 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:22.500+0000 7f74cf7fe700 1 -- 172.21.15.32:0/2324645475 learned_addr learned my addr 172.21.15.32:0/2324645475 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T13:44:22.510 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:22.500+0000 7f74cffff700 1 --2- 172.21.15.32:0/2324645475 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f74d015d4b0 0x7f74d0161110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:44:22.510 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:22.500+0000 7f74cf7fe700 1 -- 172.21.15.32:0/2324645475 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f74d015d4b0 msgr2=0x7f74d0161110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T13:44:22.511 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:22.500+0000 7f74cf7fe700 1 --2- 172.21.15.32:0/2324645475 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f74d015d4b0 0x7f74d0161110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:44:22.511 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:22.500+0000 7f74cf7fe700 1 -- 172.21.15.32:0/2324645475 >> v1:172.21.15.32:6789/0 conn(0x7f74d00ce430 legacy=0x7f74d00b4ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:44:22.511 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:22.500+0000 7f74cf7fe700 1 -- 172.21.15.32:0/2324645475 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74d01619f0 con 0x7f74d00b8b20 2023-10-08T13:44:22.511 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:22.500+0000 7f74cf7fe700 1 --2- 172.21.15.32:0/2324645475 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f74d00b8b20 0x7f74d00cdef0 secure :-1 s=READY pgs=1936 cs=0 l=1 rev1=1 crypto rx=0x7f74b8009910 tx=0x7f74b8009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b68fec9b6bb0bfe7 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:44:22.512 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:22.504+0000 7f74ceffd700 1 -- 172.21.15.32:0/2324645475 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74b8011830 con 0x7f74d00b8b20 2023-10-08T13:44:22.512 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:22.504+0000 7f74ceffd700 1 -- 172.21.15.32:0/2324645475 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74b8011990 con 0x7f74d00b8b20 2023-10-08T13:44:22.513 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:22.504+0000 7f74ceffd700 1 -- 172.21.15.32:0/2324645475 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74b8011d40 con 0x7f74d00b8b20 2023-10-08T13:44:22.513 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:22.504+0000 7f74d5567700 1 -- 172.21.15.32:0/2324645475 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f74d00b8b20 msgr2=0x7f74d00cdef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:44:22.513 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:22.504+0000 7f74d5567700 1 --2- 172.21.15.32:0/2324645475 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f74d00b8b20 0x7f74d00cdef0 secure :-1 s=READY pgs=1936 cs=0 l=1 rev1=1 crypto rx=0x7f74b8009910 tx=0x7f74b8009c20 comp rx=0 tx=0).stop 2023-10-08T13:44:22.513 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:22.504+0000 7f74d5567700 1 -- 172.21.15.32:0/2324645475 shutdown_connections 2023-10-08T13:44:22.513 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:22.504+0000 7f74d5567700 1 --2- 172.21.15.32:0/2324645475 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f74d00b8b20 0x7f74d00cdef0 unknown :-1 s=CLOSED pgs=1936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:44:22.513 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:22.504+0000 7f74d5567700 1 --2- 172.21.15.32:0/2324645475 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f74d015d4b0 0x7f74d0161110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:44:22.513 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:22.504+0000 7f74d5567700 1 -- 172.21.15.32:0/2324645475 >> 172.21.15.32:0/2324645475 conn(0x7f74d006ac60 msgr2=0x7f74d006b070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:44:22.513 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:22.504+0000 7f74d5567700 1 -- 172.21.15.32:0/2324645475 shutdown_connections 2023-10-08T13:44:22.514 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:22.504+0000 7f74d5567700 1 -- 172.21.15.32:0/2324645475 wait complete. 2023-10-08T13:44:22.515 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:22.504+0000 7f74d5567700 1 Processor -- start 2023-10-08T13:44:22.516 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:22.504+0000 7f74d5567700 1 -- start start 2023-10-08T13:44:22.516 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:22.508+0000 7f74d5567700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f74d00b8b20 0x7f74d00c8600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:44:22.516 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:22.508+0000 7f74d5567700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f74d00ce430 0x7f74d01f6480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:44:22.516 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:22.508+0000 7f74d5567700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f74d015d4b0 0x7f74d01f2240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:44:22.516 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:22.508+0000 7f74d5567700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74d01f4640 con 0x7f74d00ce430 2023-10-08T13:44:22.516 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:22.508+0000 7f74d5567700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74d01f4050 con 0x7f74d00b8b20 2023-10-08T13:44:22.516 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:22.508+0000 7f74d5567700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74d01f6f40 con 0x7f74d015d4b0 2023-10-08T13:44:22.517 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:22.508+0000 7f74cf7fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f74d00ce430 0x7f74d01f6480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:44:22.517 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:22.508+0000 7f74cf7fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f74d00ce430 0x7f74d01f6480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:36338/0 (socket says 172.21.15.32:36338) 2023-10-08T13:44:22.517 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:22.508+0000 7f74cf7fe700 1 -- 172.21.15.32:0/3469024503 learned_addr learned my addr 172.21.15.32:0/3469024503 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T13:44:22.517 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:22.508+0000 7f74cffff700 1 --2- 172.21.15.32:0/3469024503 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f74d00b8b20 0x7f74d00c8600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:44:22.517 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:22.508+0000 7f74d4d66700 1 --2- 172.21.15.32:0/3469024503 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f74d015d4b0 0x7f74d01f2240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:44:22.518 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:22.508+0000 7f74cf7fe700 1 -- 172.21.15.32:0/3469024503 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f74d015d4b0 msgr2=0x7f74d01f2240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:44:22.518 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:22.508+0000 7f74cf7fe700 1 --2- 172.21.15.32:0/3469024503 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f74d015d4b0 0x7f74d01f2240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:44:22.518 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:22.508+0000 7f74cf7fe700 1 -- 172.21.15.32:0/3469024503 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f74d00b8b20 msgr2=0x7f74d00c8600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:44:22.518 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:22.508+0000 7f74cf7fe700 1 --2- 172.21.15.32:0/3469024503 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f74d00b8b20 0x7f74d00c8600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:44:22.518 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:22.508+0000 7f74cf7fe700 1 -- 172.21.15.32:0/3469024503 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74b8009570 con 0x7f74d00ce430 2023-10-08T13:44:22.518 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:22.508+0000 7f74cffff700 1 --2- 172.21.15.32:0/3469024503 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f74d00b8b20 0x7f74d00c8600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T13:44:22.518 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:22.508+0000 7f74cf7fe700 1 --2- 172.21.15.32:0/3469024503 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f74d00ce430 0x7f74d01f6480 secure :-1 s=READY pgs=1937 cs=0 l=1 rev1=1 crypto rx=0x7f74b8000c00 tx=0x7f74b8004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:44:22.519 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:22.508+0000 7f74ccff9700 1 -- 172.21.15.32:0/3469024503 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74b8004610 con 0x7f74d00ce430 2023-10-08T13:44:22.519 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:22.508+0000 7f74ccff9700 1 -- 172.21.15.32:0/3469024503 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74b801e070 con 0x7f74d00ce430 2023-10-08T13:44:22.519 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:22.508+0000 7f74d5567700 1 -- 172.21.15.32:0/3469024503 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74d01f7220 con 0x7f74d00ce430 2023-10-08T13:44:22.519 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:22.508+0000 7f74ccff9700 1 -- 172.21.15.32:0/3469024503 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74b80038e0 con 0x7f74d00ce430 2023-10-08T13:44:22.519 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:22.508+0000 7f74d5567700 1 -- 172.21.15.32:0/3469024503 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74d01f31d0 con 0x7f74d00ce430 2023-10-08T13:44:22.520 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:22.512+0000 7f74d5567700 1 -- 172.21.15.32:0/3469024503 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74d01f4780 con 0x7f74d00ce430 2023-10-08T13:44:22.520 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:22.512+0000 7f74ccff9700 1 -- 172.21.15.32:0/3469024503 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f74b8003a40 con 0x7f74d00ce430 2023-10-08T13:44:22.520 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:22.512+0000 7f74ccff9700 1 --2- 172.21.15.32:0/3469024503 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f74b0066510 0x7f74b00689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:44:22.520 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:22.512+0000 7f74ccff9700 1 -- 172.21.15.32:0/3469024503 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f74b8084830 con 0x7f74d00ce430 2023-10-08T13:44:22.520 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:22.512+0000 7f74cffff700 1 --2- 172.21.15.32:0/3469024503 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f74b0066510 0x7f74b00689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:44:22.521 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:22.512+0000 7f74cffff700 1 --2- 172.21.15.32:0/3469024503 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f74b0066510 0x7f74b00689d0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f74d015c7c0 tx=0x7f74c800b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:44:22.525 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:22.516+0000 7f74ccff9700 1 -- 172.21.15.32:0/3469024503 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f74d01f4780 con 0x7f74d00ce430 2023-10-08T13:44:22.688 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:22.680+0000 7f74d5567700 1 -- 172.21.15.32:0/3469024503 --> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f74d0161fb0 con 0x7f74b0066510 2023-10-08T13:44:22.693 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:22.684+0000 7f74ccff9700 1 -- 172.21.15.32:0/3469024503 <== mgr.4107 v2:172.21.15.32:6832/2601628338 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+48563 (secure 0 0 0) 0x7f74c800f050 con 0x7f74b0066510 2023-10-08T13:44:22.695 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T13:44:22.697 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:22.688+0000 7f74d5567700 1 -- 172.21.15.32:0/3469024503 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f74b0066510 msgr2=0x7f74b00689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:44:22.697 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:22.688+0000 7f74d5567700 1 --2- 172.21.15.32:0/3469024503 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f74b0066510 0x7f74b00689d0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f74d015c7c0 tx=0x7f74c800b040 comp rx=0 tx=0).stop 2023-10-08T13:44:22.697 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:22.688+0000 7f74d5567700 1 -- 172.21.15.32:0/3469024503 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f74d00ce430 msgr2=0x7f74d01f6480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:44:22.697 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:22.688+0000 7f74d5567700 1 --2- 172.21.15.32:0/3469024503 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f74d00ce430 0x7f74d01f6480 secure :-1 s=READY pgs=1937 cs=0 l=1 rev1=1 crypto rx=0x7f74b8000c00 tx=0x7f74b8004770 comp rx=0 tx=0).stop 2023-10-08T13:44:22.698 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:22.688+0000 7f74d5567700 1 -- 172.21.15.32:0/3469024503 shutdown_connections 2023-10-08T13:44:22.698 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:22.688+0000 7f74d5567700 1 --2- 172.21.15.32:0/3469024503 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f74b0066510 0x7f74b00689d0 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:44:22.698 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:22.688+0000 7f74d5567700 1 --2- 172.21.15.32:0/3469024503 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f74d00ce430 0x7f74d01f6480 unknown :-1 s=CLOSED pgs=1937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:44:22.698 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:22.688+0000 7f74d5567700 1 --2- 172.21.15.32:0/3469024503 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f74d015d4b0 0x7f74d01f2240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:44:22.698 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:22.688+0000 7f74d5567700 1 --2- 172.21.15.32:0/3469024503 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f74d00b8b20 0x7f74d00c8600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:44:22.699 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:22.688+0000 7f74d5567700 1 -- 172.21.15.32:0/3469024503 >> 172.21.15.32:0/3469024503 conn(0x7f74d006ac60 msgr2=0x7f74d00d30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:44:22.699 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:22.688+0000 7f74d5567700 1 -- 172.21.15.32:0/3469024503 shutdown_connections 2023-10-08T13:44:22.699 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:22.688+0000 7f74d5567700 1 -- 172.21.15.32:0/3469024503 wait complete. 2023-10-08T13:44:22.699 INFO:teuthology.orchestra.run.smithi032.stderr:dumped all 2023-10-08T13:44:22.710 INFO:teuthology.orchestra.run.smithi032.stdout:{"pg_ready":true,"pg_map":{"version":13676,"stamp":"2023-10-08T13:44:20.957488+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":12684168,"kb_used_data":4552,"kb_used_omap":4346,"kb_used_meta":12675205,"kb_avail":742290552,"statfs":{"total":773094113280,"available":760105525248,"internally_reserved":0,"allocated":4661248,"data_stored":2540088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4451158,"internal_metadata":12979410090},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003278"},"pg_stats":[{"pgid":"1.0","version":"38'119","reported_seq":417,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-08T13:44:07.335626+0000","last_change":"2023-10-08T13:44:07.335733+0000","last_active":"2023-10-08T13:44:07.335626+0000","last_peered":"2023-10-08T13:44:07.335626+0000","last_clean":"2023-10-08T13:44:07.335626+0000","last_became_active":"2023-10-08T06:09:24.809788+0000","last_became_peered":"2023-10-08T06:09:24.809788+0000","last_unstale":"2023-10-08T13:44:07.335626+0000","last_undegraded":"2023-10-08T13:44:07.335626+0000","last_fullsized":"2023-10-08T13:44:07.335626+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'119","last_scrub_stamp":"2023-10-08T13:44:07.335419+0000","last_deep_scrub":"38'119","last_deep_scrub_stamp":"2023-10-08T13:44:07.335419+0000","last_clean_scrub_stamp":"2023-10-08T13:44:07.335419+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:35:43.005866+0000","scrub_duration":1.8254471639999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424514898,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1480820,"kb_used_data":1004,"kb_used_omap":148,"kb_used_meta":1479659,"kb_avail":92891020,"statfs":{"total":96636764160,"available":95120404480,"internally_reserved":0,"allocated":1028096,"data_stored":760287,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":152224,"internal_metadata":1515171168},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 13:44:01 2023","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.70499999999999996,"15min":0.80900000000000005},"min":{"1min":0.308,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":5.4470000000000001,"5min":5.484,"15min":11.773},"last":1.446},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.98099999999999998,"15min":1.0720000000000001},"min":{"1min":0.30599999999999999,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":2.1030000000000002,"5min":8.8859999999999992,"15min":8.8859999999999992},"last":0.77600000000000002}]},{"osd":1,"last update":"Sun Oct 8 13:44:01 2023","interfaces":[{"interface":"back","average":{"1min":0.93799999999999994,"5min":0.96699999999999997,"15min":0.96099999999999997},"min":{"1min":0.29899999999999999,"5min":0.29299999999999998,"15min":0.27500000000000002},"max":{"1min":5.3970000000000002,"5min":6.8970000000000002,"15min":11.943},"last":1.3400000000000001},{"interface":"front","average":{"1min":0.72799999999999998,"5min":1.129,"15min":1.155},"min":{"1min":0.374,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":2.0720000000000001,"5min":8.7330000000000005,"15min":8.7330000000000005},"last":1.099}]},{"osd":2,"last update":"Sun Oct 8 13:44:01 2023","interfaces":[{"interface":"back","average":{"1min":1.1619999999999999,"5min":1.292,"15min":1.254},"min":{"1min":0.39700000000000002,"5min":0.318,"15min":0.28599999999999998},"max":{"1min":5.335,"5min":8.8559999999999999,"15min":8.8559999999999999},"last":0.88500000000000001},{"interface":"front","average":{"1min":1.141,"5min":1.2849999999999999,"15min":1.278},"min":{"1min":0.44400000000000001,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":6.3319999999999999,"5min":9,"15min":9},"last":1.0449999999999999}]},{"osd":3,"last update":"Sun Oct 8 13:44:01 2023","interfaces":[{"interface":"back","average":{"1min":0.99199999999999999,"5min":1.8720000000000001,"15min":1.403},"min":{"1min":0.40300000000000002,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":5.4850000000000003,"5min":32.707000000000001,"15min":32.707000000000001},"last":1.3959999999999999},{"interface":"front","average":{"1min":1.0189999999999999,"5min":1.736,"15min":1.5860000000000001},"min":{"1min":0.41399999999999998,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":4.9820000000000002,"5min":30.983000000000001,"15min":30.983000000000001},"last":1.202}]},{"osd":4,"last update":"Sun Oct 8 13:44:01 2023","interfaces":[{"interface":"back","average":{"1min":1.7789999999999999,"5min":1.377,"15min":1.375},"min":{"1min":0.38500000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":7.774,"5min":9.3499999999999996,"15min":11.516},"last":0.93200000000000005},{"interface":"front","average":{"1min":1.5449999999999999,"5min":1.0269999999999999,"15min":1.2410000000000001},"min":{"1min":0.40300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":6.1689999999999996,"5min":6.1689999999999996,"15min":11.907},"last":1.544}]},{"osd":5,"last update":"Sun Oct 8 13:44:01 2023","interfaces":[{"interface":"back","average":{"1min":1.1950000000000001,"5min":1.234,"15min":1.3049999999999999},"min":{"1min":0.371,"5min":0.371,"15min":0.32700000000000001},"max":{"1min":7.6669999999999998,"5min":13.045999999999999,"15min":13.045999999999999},"last":0.98499999999999999},{"interface":"front","average":{"1min":1.55,"5min":1.4710000000000001,"15min":1.498},"min":{"1min":0.42599999999999999,"5min":0.373,"15min":0.373},"max":{"1min":6.2779999999999996,"5min":9.0299999999999994,"15min":11.547000000000001},"last":1.165}]},{"osd":6,"last update":"Sun Oct 8 13:44:01 2023","interfaces":[{"interface":"back","average":{"1min":1.26,"5min":1.4670000000000001,"15min":1.516},"min":{"1min":0.51000000000000001,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":6.4939999999999998,"5min":8.9629999999999992,"15min":11.567},"last":1.2649999999999999},{"interface":"front","average":{"1min":1.077,"5min":1.1220000000000001,"15min":1.204},"min":{"1min":0.46500000000000002,"5min":0.41399999999999998,"15min":0.33600000000000002},"max":{"1min":5.718,"5min":6.5910000000000002,"15min":11.827},"last":1.496}]}]},{"osd":6,"up_from":15,"seq":64424514902,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1735408,"kb_used_data":424,"kb_used_omap":546,"kb_used_meta":1734429,"kb_avail":92636432,"statfs":{"total":96636764160,"available":94859706368,"internally_reserved":0,"allocated":434176,"data_stored":169919,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":559457,"internal_metadata":1776055967},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 13:43:41 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.59199999999999997,"15min":0.77600000000000002},"min":{"1min":0.34499999999999997,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.79300000000000004,"5min":6.5910000000000002,"15min":8.3569999999999993},"last":1.2949999999999999},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.82299999999999995,"15min":0.95099999999999996},"min":{"1min":0.35399999999999998,"5min":0.318,"15min":0.28199999999999997},"max":{"1min":0.872,"5min":6.5789999999999997,"15min":8.5980000000000008},"last":1.3420000000000001}]},{"osd":1,"last update":"Sun Oct 8 13:43:41 2023","interfaces":[{"interface":"back","average":{"1min":1.077,"5min":1.127,"15min":1.24},"min":{"1min":0.34200000000000003,"5min":0.29299999999999998,"15min":0.28699999999999998},"max":{"1min":4.2110000000000003,"5min":6.4029999999999996,"15min":8.8900000000000006},"last":0.753},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.83999999999999997,"15min":0.93000000000000005},"min":{"1min":0.34399999999999997,"5min":0.29699999999999999,"15min":0.27700000000000002},"max":{"1min":1.0269999999999999,"5min":7.1260000000000003,"15min":8.4120000000000008},"last":1.3779999999999999}]},{"osd":2,"last update":"Sun Oct 8 13:43:41 2023","interfaces":[{"interface":"back","average":{"1min":1.038,"5min":1.169,"15min":1.1319999999999999},"min":{"1min":0.40300000000000002,"5min":0.39800000000000002,"15min":0.318},"max":{"1min":4.0060000000000002,"5min":7.5510000000000002,"15min":8.4469999999999992},"last":0.98999999999999999},{"interface":"front","average":{"1min":1.083,"5min":1.2330000000000001,"15min":1.2829999999999999},"min":{"1min":0.38,"5min":0.38,"15min":0.34899999999999998},"max":{"1min":7.6200000000000001,"5min":7.6200000000000001,"15min":8.3759999999999994},"last":1.4299999999999999}]},{"osd":3,"last update":"Sun Oct 8 13:43:41 2023","interfaces":[{"interface":"back","average":{"1min":1.0940000000000001,"5min":1.498,"15min":1.3520000000000001},"min":{"1min":0.41399999999999998,"5min":0.40799999999999997,"15min":0.36599999999999999},"max":{"1min":7.673,"5min":11.715999999999999,"15min":11.715999999999999},"last":1.0289999999999999},{"interface":"front","average":{"1min":1.3009999999999999,"5min":1.504,"15min":1.52},"min":{"1min":0.51800000000000002,"5min":0.373,"15min":0.35299999999999998},"max":{"1min":4.3079999999999998,"5min":10.132999999999999,"15min":10.369},"last":1.083}]},{"osd":4,"last update":"Sun Oct 8 13:43:41 2023","interfaces":[{"interface":"back","average":{"1min":1.415,"5min":0.96099999999999997,"15min":1.0840000000000001},"min":{"1min":0.47499999999999998,"5min":0.34399999999999997,"15min":0.33800000000000002},"max":{"1min":6.46,"5min":6.7249999999999996,"15min":9.5},"last":1.163},{"interface":"front","average":{"1min":1.0600000000000001,"5min":1.1899999999999999,"15min":1.153},"min":{"1min":0.42999999999999999,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":6.3819999999999997,"5min":6.3819999999999997,"15min":8.2940000000000005},"last":1.1319999999999999}]},{"osd":5,"last update":"Sun Oct 8 13:43:41 2023","interfaces":[{"interface":"back","average":{"1min":1.9099999999999999,"5min":1.4770000000000001,"15min":1.4710000000000001},"min":{"1min":0.40300000000000002,"5min":0.32200000000000001,"15min":0.317},"max":{"1min":5.5339999999999998,"5min":6.3840000000000003,"15min":9.3930000000000007},"last":0.94999999999999996},{"interface":"front","average":{"1min":0.95699999999999996,"5min":0.89200000000000002,"15min":1.087},"min":{"1min":0.45800000000000002,"5min":0.376,"15min":0.376},"max":{"1min":3.4399999999999999,"5min":6.7560000000000002,"15min":10.087999999999999},"last":1.4630000000000001}]},{"osd":7,"last update":"Sun Oct 8 13:43:41 2023","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":1.119,"15min":1.2649999999999999},"min":{"1min":0.54400000000000004,"5min":0.41599999999999998,"15min":0.39400000000000002},"max":{"1min":1.6719999999999999,"5min":6.0010000000000003,"15min":14.177},"last":1.2549999999999999},{"interface":"front","average":{"1min":1.3620000000000001,"5min":1.3500000000000001,"15min":1.5860000000000001},"min":{"1min":0.58399999999999996,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":4.2859999999999996,"5min":6.6239999999999997,"15min":9.7579999999999991},"last":1.2170000000000001}]}]},{"osd":5,"up_from":15,"seq":64424514898,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1822448,"kb_used_data":424,"kb_used_omap":249,"kb_used_meta":1821766,"kb_avail":92549392,"statfs":{"total":96636764160,"available":94770577408,"internally_reserved":0,"allocated":434176,"data_stored":169919,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":255902,"internal_metadata":1865488482},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 13:43:49 2023","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":0.85499999999999998,"15min":0.83599999999999997},"min":{"1min":0.32100000000000001,"5min":0.26200000000000001,"15min":0.25900000000000001},"max":{"1min":3.871,"5min":5.2309999999999999,"15min":7.0830000000000002},"last":1.079},{"interface":"front","average":{"1min":1.5129999999999999,"5min":1.222,"15min":0.90100000000000002},"min":{"1min":0.32100000000000001,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":7.3319999999999999,"5min":11.331,"15min":11.331},"last":0.92000000000000004}]},{"osd":1,"last update":"Sun Oct 8 13:43:49 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.97099999999999997,"15min":1.02},"min":{"1min":0.308,"5min":0.28399999999999997,"15min":0.27600000000000002},"max":{"1min":2.931,"5min":5.2670000000000003,"15min":10.523999999999999},"last":0.81399999999999995},{"interface":"front","average":{"1min":1.8069999999999999,"5min":1.383,"15min":1.0700000000000001},"min":{"1min":0.33400000000000002,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":7.367,"5min":11.425000000000001,"15min":11.425000000000001},"last":1.147}]},{"osd":2,"last update":"Sun Oct 8 13:43:49 2023","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":1.333,"15min":1.234},"min":{"1min":0.33500000000000002,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":5.7290000000000001,"5min":12.236000000000001,"15min":12.236000000000001},"last":0.871},{"interface":"front","average":{"1min":1.0629999999999999,"5min":1.266,"15min":1.2330000000000001},"min":{"1min":0.38800000000000001,"5min":0.309,"15min":0.309},"max":{"1min":4.2220000000000004,"5min":8.7119999999999997,"15min":10.577},"last":1.2010000000000001}]},{"osd":3,"last update":"Sun Oct 8 13:43:49 2023","interfaces":[{"interface":"back","average":{"1min":1.7130000000000001,"5min":1.383,"15min":1.331},"min":{"1min":0.40000000000000002,"5min":0.34100000000000003,"15min":0.313},"max":{"1min":7.2750000000000004,"5min":11.49,"15min":11.49},"last":1.3819999999999999},{"interface":"front","average":{"1min":1.101,"5min":1.516,"15min":1.274},"min":{"1min":0.41499999999999998,"5min":0.34399999999999997,"15min":0.34200000000000003},"max":{"1min":5.593,"5min":12.289999999999999,"15min":12.289999999999999},"last":1.0389999999999999}]},{"osd":4,"last update":"Sun Oct 8 13:43:49 2023","interfaces":[{"interface":"back","average":{"1min":1.21,"5min":1.1259999999999999,"15min":0.94199999999999995},"min":{"1min":0.44,"5min":0.32500000000000001,"15min":0.30599999999999999},"max":{"1min":5.5350000000000001,"5min":5.5350000000000001,"15min":7.1520000000000001},"last":1.3480000000000001},{"interface":"front","average":{"1min":1.8240000000000001,"5min":1.53,"15min":1.141},"min":{"1min":0.41599999999999998,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":7.3890000000000002,"5min":11.457000000000001,"15min":11.457000000000001},"last":1.458}]},{"osd":6,"last update":"Sun Oct 8 13:43:49 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":1.536,"15min":1.302},"min":{"1min":0.39500000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":3.3130000000000002,"5min":12.329000000000001,"15min":12.329000000000001},"last":1.1160000000000001},{"interface":"front","average":{"1min":0.96299999999999997,"5min":1.1930000000000001,"15min":1.1559999999999999},"min":{"1min":0.51300000000000001,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":3.282,"5min":6.6799999999999997,"15min":7.5259999999999998},"last":1.417}]},{"osd":7,"last update":"Sun Oct 8 13:43:49 2023","interfaces":[{"interface":"back","average":{"1min":1.7270000000000001,"5min":1.546,"15min":1.2949999999999999},"min":{"1min":0.45700000000000002,"5min":0.39300000000000002,"15min":0.38200000000000001},"max":{"1min":7.4089999999999998,"5min":11.388999999999999,"15min":11.388999999999999},"last":1.5149999999999999},{"interface":"front","average":{"1min":0.96799999999999997,"5min":1.6120000000000001,"15min":1.4179999999999999},"min":{"1min":0.434,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":5.1619999999999999,"5min":17.481999999999999,"15min":17.481999999999999},"last":1.3100000000000001}]}]},{"osd":4,"up_from":15,"seq":64424514899,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1772208,"kb_used_data":424,"kb_used_omap":353,"kb_used_meta":1771422,"kb_avail":92599632,"statfs":{"total":96636764160,"available":94822023168,"internally_reserved":0,"allocated":434176,"data_stored":169919,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":361854,"internal_metadata":1813936770},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 13:43:22 2023","interfaces":[{"interface":"back","average":{"1min":1.28,"5min":1.3140000000000001,"15min":1.2410000000000001},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":5.5220000000000002,"5min":6.585,"15min":6.585},"last":0.97299999999999998},{"interface":"front","average":{"1min":1.0580000000000001,"5min":1.2450000000000001,"15min":0.95499999999999996},"min":{"1min":0.33800000000000002,"5min":0.30499999999999999,"15min":0.26100000000000001},"max":{"1min":5.3949999999999996,"5min":7.6559999999999997,"15min":7.6559999999999997},"last":0.71699999999999997}]},{"osd":1,"last update":"Sun Oct 8 13:43:22 2023","interfaces":[{"interface":"back","average":{"1min":1.1910000000000001,"5min":1.1419999999999999,"15min":1.2},"min":{"1min":0.28599999999999998,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":5.0640000000000001,"5min":6.9219999999999997,"15min":10.321},"last":1.115},{"interface":"front","average":{"1min":1.429,"5min":1.4530000000000001,"15min":1.45},"min":{"1min":0.42199999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":5.5659999999999998,"5min":7.0579999999999998,"15min":7.7009999999999996},"last":0.76100000000000001}]},{"osd":2,"last update":"Sun Oct 8 13:43:22 2023","interfaces":[{"interface":"back","average":{"1min":1.075,"5min":1.8029999999999999,"15min":1.5149999999999999},"min":{"1min":0.33800000000000002,"5min":0.316,"15min":0.316},"max":{"1min":4.2080000000000002,"5min":42.488,"15min":42.488},"last":0.82799999999999996},{"interface":"front","average":{"1min":1.3600000000000001,"5min":1.855,"15min":1.6699999999999999},"min":{"1min":0.34100000000000003,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":5.5949999999999998,"5min":43.997999999999998,"15min":43.997999999999998},"last":1.079}]},{"osd":3,"last update":"Sun Oct 8 13:43:22 2023","interfaces":[{"interface":"back","average":{"1min":1.536,"5min":1.605,"15min":1.3520000000000001},"min":{"1min":0.374,"5min":0.35999999999999999,"15min":0.35899999999999999},"max":{"1min":5.4320000000000004,"5min":8.4339999999999993,"15min":8.4339999999999993},"last":1.0349999999999999},{"interface":"front","average":{"1min":1.704,"5min":1.4550000000000001,"15min":1.4139999999999999},"min":{"1min":0.42799999999999999,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":5.2389999999999999,"5min":6.8380000000000001,"15min":10.433999999999999},"last":0.93799999999999994}]},{"osd":5,"last update":"Sun Oct 8 13:43:22 2023","interfaces":[{"interface":"back","average":{"1min":1.75,"5min":1.3680000000000001,"15min":1.2549999999999999},"min":{"1min":0.38100000000000001,"5min":0.30499999999999999,"15min":0.29199999999999998},"max":{"1min":6.069,"5min":12.226000000000001,"15min":12.226000000000001},"last":0.874},{"interface":"front","average":{"1min":1.266,"5min":1.2350000000000001,"15min":1.0680000000000001},"min":{"1min":0.36099999999999999,"5min":0.32900000000000001,"15min":0.32600000000000001},"max":{"1min":5.3029999999999999,"5min":6.6769999999999996,"15min":6.6769999999999996},"last":1.151}]},{"osd":6,"last update":"Sun Oct 8 13:43:22 2023","interfaces":[{"interface":"back","average":{"1min":1.0740000000000001,"5min":1.222,"15min":1.304},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.36399999999999999},"max":{"1min":4.0110000000000001,"5min":5.8650000000000002,"15min":10.470000000000001},"last":1.2290000000000001},{"interface":"front","average":{"1min":1.5449999999999999,"5min":1.472,"15min":1.5029999999999999},"min":{"1min":0.44700000000000001,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":6.1180000000000003,"5min":9.4529999999999994,"15min":9.4529999999999994},"last":1.173}]},{"osd":7,"last update":"Sun Oct 8 13:43:22 2023","interfaces":[{"interface":"back","average":{"1min":1.2130000000000001,"5min":1.423,"15min":1.3220000000000001},"min":{"1min":0.37,"5min":0.37,"15min":0.34399999999999997},"max":{"1min":5.3570000000000002,"5min":11.946999999999999,"15min":11.946999999999999},"last":1.206},{"interface":"front","average":{"1min":1.0920000000000001,"5min":1.208,"15min":1.395},"min":{"1min":0.51400000000000001,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":4.0970000000000004,"5min":5.7329999999999997,"15min":10.802},"last":1.3120000000000001}]}]},{"osd":2,"up_from":15,"seq":64424514893,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1615408,"kb_used_data":424,"kb_used_omap":345,"kb_used_meta":1614630,"kb_avail":92756432,"statfs":{"total":96636764160,"available":94982586368,"internally_reserved":0,"allocated":434176,"data_stored":169919,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":354112,"internal_metadata":1653381312},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 13:44:10 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.748,"15min":0.73099999999999998},"min":{"1min":0.28399999999999997,"5min":0.23400000000000001,"15min":0.221},"max":{"1min":3.1709999999999998,"5min":10.901,"15min":10.901},"last":0.745},{"interface":"front","average":{"1min":1.448,"5min":0.97599999999999998,"15min":0.95399999999999996},"min":{"1min":0.32200000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":4.5410000000000004,"5min":5.9340000000000002,"15min":13.784000000000001},"last":0.98899999999999999}]},{"osd":1,"last update":"Sun Oct 8 13:44:10 2023","interfaces":[{"interface":"back","average":{"1min":1.5449999999999999,"5min":0.77000000000000002,"15min":1.0549999999999999},"min":{"1min":0.33100000000000002,"5min":0.25800000000000001,"15min":0.252},"max":{"1min":10.94,"5min":10.94,"15min":24.826000000000001},"last":0.84599999999999997},{"interface":"front","average":{"1min":1.665,"5min":1.0860000000000001,"15min":1.3049999999999999},"min":{"1min":0.311,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":10.923,"5min":10.923,"15min":34.645000000000003},"last":1.056}]},{"osd":3,"last update":"Sun Oct 8 13:44:10 2023","interfaces":[{"interface":"back","average":{"1min":1.0549999999999999,"5min":0.84299999999999997,"15min":1.1879999999999999},"min":{"1min":0.377,"5min":0.29399999999999998,"15min":0.28299999999999997},"max":{"1min":3.286,"5min":5.0800000000000001,"15min":24.867000000000001},"last":1.161},{"interface":"front","average":{"1min":1.1919999999999999,"5min":1.111,"15min":1.304},"min":{"1min":0.34100000000000003,"5min":0.29599999999999999,"15min":0.27200000000000002},"max":{"1min":5.3239999999999998,"5min":9.1880000000000006,"15min":25.219000000000001},"last":0.88800000000000001}]},{"osd":4,"last update":"Sun Oct 8 13:44:10 2023","interfaces":[{"interface":"back","average":{"1min":2.101,"5min":1.2749999999999999,"15min":1.254},"min":{"1min":0.42099999999999999,"5min":0.35099999999999998,"15min":0.33700000000000002},"max":{"1min":10.877000000000001,"5min":10.877000000000001,"15min":10.877000000000001},"last":0.96999999999999997},{"interface":"front","average":{"1min":2.1080000000000001,"5min":1.121,"15min":1.141},"min":{"1min":0.53300000000000003,"5min":0.36299999999999999,"15min":0.36199999999999999},"max":{"1min":10.849,"5min":10.849,"15min":10.849},"last":1.4650000000000001}]},{"osd":5,"last update":"Sun Oct 8 13:44:10 2023","interfaces":[{"interface":"back","average":{"1min":1.504,"5min":1.444,"15min":1.3069999999999999},"min":{"1min":0.61499999999999999,"5min":0.38400000000000001,"15min":0.376},"max":{"1min":4.4710000000000001,"5min":11.327999999999999,"15min":11.327999999999999},"last":1.3029999999999999},{"interface":"front","average":{"1min":1.181,"5min":1.155,"15min":1.2450000000000001},"min":{"1min":0.54700000000000004,"5min":0.39000000000000001,"15min":0.38700000000000001},"max":{"1min":2.6000000000000001,"5min":11.901999999999999,"15min":13.888999999999999},"last":1.4319999999999999}]},{"osd":6,"last update":"Sun Oct 8 13:44:10 2023","interfaces":[{"interface":"back","average":{"1min":1.0409999999999999,"5min":0.88400000000000001,"15min":1.2829999999999999},"min":{"1min":0.59699999999999998,"5min":0.436,"15min":0.41099999999999998},"max":{"1min":2.456,"5min":5.8150000000000004,"15min":13.939},"last":1.514},{"interface":"front","average":{"1min":1.367,"5min":1.351,"15min":1.4379999999999999},"min":{"1min":0.42699999999999999,"5min":0.39500000000000002,"15min":0.373},"max":{"1min":5.4640000000000004,"5min":11.553000000000001,"15min":12.218999999999999},"last":1.02}]},{"osd":7,"last update":"Sun Oct 8 13:44:10 2023","interfaces":[{"interface":"back","average":{"1min":1.637,"5min":1.3080000000000001,"15min":1.3400000000000001},"min":{"1min":0.59499999999999997,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":5.133,"5min":8.8740000000000006,"15min":8.8740000000000006},"last":1.5820000000000001},{"interface":"front","average":{"1min":1.0569999999999999,"5min":1.21,"15min":1.391},"min":{"1min":0.63500000000000001,"5min":0.45300000000000001,"15min":0.439},"max":{"1min":2.4009999999999998,"5min":7.8220000000000001,"15min":13.997},"last":1.653}]}]},{"osd":1,"up_from":15,"seq":64424514893,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1526832,"kb_used_data":424,"kb_used_omap":1388,"kb_used_meta":1525011,"kb_avail":92845008,"statfs":{"total":96636764160,"available":95073288192,"internally_reserved":0,"allocated":434176,"data_stored":169919,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1421431,"internal_metadata":1561612169},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 13:44:15 2023","interfaces":[{"interface":"back","average":{"1min":1.319,"5min":0.91600000000000004,"15min":0.877},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.217},"max":{"1min":14.722,"5min":14.722,"15min":14.722},"last":0.63500000000000001},{"interface":"front","average":{"1min":1.7490000000000001,"5min":1.0980000000000001,"15min":1.056},"min":{"1min":0.27100000000000002,"5min":0.26300000000000001,"15min":0.25600000000000001},"max":{"1min":13.984999999999999,"5min":13.984999999999999,"15min":13.984999999999999},"last":0.93000000000000005}]},{"osd":2,"last update":"Sun Oct 8 13:44:15 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.96999999999999997,"15min":0.96099999999999997},"min":{"1min":0.27800000000000002,"5min":0.26100000000000001,"15min":0.23799999999999999},"max":{"1min":1.8049999999999999,"5min":10,"15min":13.401},"last":0.78800000000000003},{"interface":"front","average":{"1min":1.2589999999999999,"5min":1.2310000000000001,"15min":1.117},"min":{"1min":0.28799999999999998,"5min":0.254,"15min":0.252},"max":{"1min":5.4249999999999998,"5min":7.1189999999999998,"15min":9.327},"last":0.999}]},{"osd":3,"last update":"Sun Oct 8 13:44:15 2023","interfaces":[{"interface":"back","average":{"1min":1.198,"5min":0.97199999999999998,"15min":1.069},"min":{"1min":0.36599999999999999,"5min":0.29499999999999998,"15min":0.27300000000000002},"max":{"1min":5.46,"5min":6.2359999999999998,"15min":9.2750000000000004},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.97399999999999998,"5min":1.079,"15min":1.139},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":3.4830000000000001,"5min":6.0590000000000002,"15min":13.012},"last":1.0860000000000001}]},{"osd":4,"last update":"Sun Oct 8 13:44:15 2023","interfaces":[{"interface":"back","average":{"1min":2.1179999999999999,"5min":1.444,"15min":1.304},"min":{"1min":0.37,"5min":0.36499999999999999,"15min":0.32400000000000001},"max":{"1min":23.466999999999999,"5min":23.466999999999999,"15min":23.466999999999999},"last":1.0349999999999999},{"interface":"front","average":{"1min":1.361,"5min":1.2989999999999999,"15min":1.21},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":5.4939999999999998,"5min":6.3159999999999998,"15min":9.3859999999999992},"last":1.161}]},{"osd":5,"last update":"Sun Oct 8 13:44:15 2023","interfaces":[{"interface":"back","average":{"1min":1.1779999999999999,"5min":1.3200000000000001,"15min":1.2450000000000001},"min":{"1min":0.39400000000000002,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":3.6619999999999999,"5min":6.1109999999999998,"15min":6.1109999999999998},"last":1.3320000000000001},{"interface":"front","average":{"1min":1.298,"5min":1.2350000000000001,"15min":1.3100000000000001},"min":{"1min":0.441,"5min":0.40600000000000003,"15min":0.35299999999999998},"max":{"1min":6.0140000000000002,"5min":7.2409999999999997,"15min":13.468},"last":1.1879999999999999}]},{"osd":6,"last update":"Sun Oct 8 13:44:15 2023","interfaces":[{"interface":"back","average":{"1min":1.246,"5min":1.286,"15min":1.492},"min":{"1min":0.46400000000000002,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":4.2510000000000003,"5min":6.1829999999999998,"15min":12.266},"last":1.2310000000000001},{"interface":"front","average":{"1min":1.222,"5min":1.462,"15min":1.486},"min":{"1min":0.46999999999999997,"5min":0.46200000000000002,"15min":0.40200000000000002},"max":{"1min":3.758,"5min":7.2850000000000001,"15min":13.489000000000001},"last":1.262}]},{"osd":7,"last update":"Sun Oct 8 13:44:15 2023","interfaces":[{"interface":"back","average":{"1min":1.4710000000000001,"5min":1.369,"15min":1.367},"min":{"1min":0.48599999999999999,"5min":0.441,"15min":0.36199999999999999},"max":{"1min":5.5270000000000001,"5min":6.3780000000000001,"15min":9.4870000000000001},"last":1.361},{"interface":"front","average":{"1min":1.153,"5min":1.456,"15min":1.5960000000000001},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.437},"max":{"1min":3.6459999999999999,"5min":7.9260000000000002,"15min":12.263999999999999},"last":1.698}]}]},{"osd":0,"up_from":15,"seq":64424514898,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1461812,"kb_used_data":1004,"kb_used_omap":266,"kb_used_meta":1460533,"kb_avail":92910028,"statfs":{"total":96636764160,"available":95139868672,"internally_reserved":0,"allocated":1028096,"data_stored":760287,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":272932,"internal_metadata":1495586268},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 13:43:40 2023","interfaces":[{"interface":"back","average":{"1min":1.0680000000000001,"5min":1.0409999999999999,"15min":0.93400000000000005},"min":{"1min":0.25800000000000001,"5min":0.249,"15min":0.218},"max":{"1min":5.3979999999999997,"5min":8.1850000000000005,"15min":8.1850000000000005},"last":0.75},{"interface":"front","average":{"1min":1.1259999999999999,"5min":1.0049999999999999,"15min":0.99399999999999999},"min":{"1min":0.27600000000000002,"5min":0.22,"15min":0.22},"max":{"1min":4.5419999999999998,"5min":11.153,"15min":11.153},"last":0.90700000000000003}]},{"osd":2,"last update":"Sun Oct 8 13:43:40 2023","interfaces":[{"interface":"back","average":{"1min":1.2370000000000001,"5min":1.0509999999999999,"15min":0.96099999999999997},"min":{"1min":0.31,"5min":0.25600000000000001,"15min":0.248},"max":{"1min":7.5670000000000002,"5min":8.891,"15min":10.115},"last":1.181},{"interface":"front","average":{"1min":1.5860000000000001,"5min":1.1910000000000001,"15min":1.0820000000000001},"min":{"1min":0.30099999999999999,"5min":0.25900000000000001,"15min":0.245},"max":{"1min":8.5069999999999997,"5min":8.5069999999999997,"15min":8.5069999999999997},"last":1.139}]},{"osd":3,"last update":"Sun Oct 8 13:43:40 2023","interfaces":[{"interface":"back","average":{"1min":1.4670000000000001,"5min":1,"15min":1.1919999999999999},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.26200000000000001},"max":{"1min":6.9420000000000002,"5min":7.4400000000000004,"15min":7.4400000000000004},"last":0.83199999999999996},{"interface":"front","average":{"1min":1.9630000000000001,"5min":1.391,"15min":1.097},"min":{"1min":0.41299999999999998,"5min":0.33800000000000002,"15min":0.26900000000000002},"max":{"1min":7.4370000000000003,"5min":10.798,"15min":10.798},"last":1.3600000000000001}]},{"osd":4,"last update":"Sun Oct 8 13:43:40 2023","interfaces":[{"interface":"back","average":{"1min":1.349,"5min":1.111,"15min":1.2490000000000001},"min":{"1min":0.36099999999999999,"5min":0.34999999999999998,"15min":0.34399999999999997},"max":{"1min":6.9889999999999999,"5min":7.4930000000000003,"15min":7.4930000000000003},"last":1.083},{"interface":"front","average":{"1min":1.6259999999999999,"5min":1.228,"15min":1.077},"min":{"1min":0.504,"5min":0.38700000000000001,"15min":0.35299999999999998},"max":{"1min":5.3460000000000001,"5min":8.077,"15min":8.077},"last":1.4950000000000001}]},{"osd":5,"last update":"Sun Oct 8 13:43:40 2023","interfaces":[{"interface":"back","average":{"1min":1.232,"5min":1.157,"15min":1.115},"min":{"1min":0.40100000000000002,"5min":0.37,"15min":0.36099999999999999},"max":{"1min":4.6340000000000003,"5min":5.5229999999999997,"15min":7.3940000000000001},"last":1.452},{"interface":"front","average":{"1min":1.2629999999999999,"5min":1.1899999999999999,"15min":1.3049999999999999},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.377},"max":{"1min":7.0650000000000004,"5min":8.2750000000000004,"15min":8.2750000000000004},"last":1.272}]},{"osd":6,"last update":"Sun Oct 8 13:43:40 2023","interfaces":[{"interface":"back","average":{"1min":2.375,"5min":1.6499999999999999,"15min":1.339},"min":{"1min":0.55900000000000005,"5min":0.42499999999999999,"15min":0.36499999999999999},"max":{"1min":7.5739999999999998,"5min":8.0289999999999999,"15min":8.0289999999999999},"last":1.573},{"interface":"front","average":{"1min":1.2589999999999999,"5min":1.2130000000000001,"15min":1.196},"min":{"1min":0.44400000000000001,"5min":0.42999999999999999,"15min":0.40799999999999997},"max":{"1min":4.6689999999999996,"5min":5.8419999999999996,"15min":10.696},"last":1.3240000000000001}]},{"osd":7,"last update":"Sun Oct 8 13:43:40 2023","interfaces":[{"interface":"back","average":{"1min":1.706,"5min":1.1990000000000001,"15min":1.161},"min":{"1min":0.47299999999999998,"5min":0.42899999999999999,"15min":0.40500000000000003},"max":{"1min":7.4420000000000002,"5min":7.4420000000000002,"15min":7.4420000000000002},"last":1.534},{"interface":"front","average":{"1min":1.5249999999999999,"5min":1.323,"15min":1.4239999999999999},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":7.0270000000000001,"5min":7.5549999999999997,"15min":9.298},"last":1.4119999999999999}]}]},{"osd":3,"up_from":14,"seq":60129547591,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1269232,"kb_used_data":424,"kb_used_omap":1048,"kb_used_meta":1267751,"kb_avail":93102608,"statfs":{"total":96636764160,"available":95337070592,"internally_reserved":0,"allocated":434176,"data_stored":169919,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1073246,"internal_metadata":1298177954},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 13:43:18 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.72199999999999998,"15min":0.72899999999999998},"min":{"1min":0.26300000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":4.3200000000000003,"5min":6.8760000000000003,"15min":10.003},"last":0.76300000000000001},{"interface":"front","average":{"1min":1.343,"5min":1.0740000000000001,"15min":0.96599999999999997},"min":{"1min":0.26400000000000001,"5min":0.245,"15min":0.245},"max":{"1min":8.5559999999999992,"5min":8.5559999999999992,"15min":10.115},"last":0.71499999999999997}]},{"osd":1,"last update":"Sun Oct 8 13:43:18 2023","interfaces":[{"interface":"back","average":{"1min":1.1000000000000001,"5min":1.052,"15min":1.0269999999999999},"min":{"1min":0.315,"5min":0.26500000000000001,"15min":0.251},"max":{"1min":9.7219999999999995,"5min":10.757,"15min":10.757},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.99399999999999999,"15min":0.93100000000000005},"min":{"1min":0.29399999999999998,"5min":0.27300000000000002,"15min":0.26000000000000001},"max":{"1min":3.9289999999999998,"5min":6.8280000000000003,"15min":6.9560000000000004},"last":0.876}]},{"osd":2,"last update":"Sun Oct 8 13:43:18 2023","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":1.2050000000000001,"15min":1.0860000000000001},"min":{"1min":0.29499999999999998,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":4.7930000000000001,"5min":10.813000000000001,"15min":10.813000000000001},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.626,"5min":1.0389999999999999,"15min":0.94799999999999995},"min":{"1min":0.32300000000000001,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":1.496,"5min":7.1760000000000002,"15min":7.1760000000000002},"last":0.95399999999999996}]},{"osd":4,"last update":"Sun Oct 8 13:43:18 2023","interfaces":[{"interface":"back","average":{"1min":1.288,"5min":0.99299999999999999,"15min":1.087},"min":{"1min":0.375,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":4.5579999999999998,"5min":5.1449999999999996,"15min":10.182},"last":0.82199999999999995},{"interface":"front","average":{"1min":1.4019999999999999,"5min":1.2689999999999999,"15min":1.1819999999999999},"min":{"1min":0.42099999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":5.9989999999999997,"5min":10.851000000000001,"15min":10.851000000000001},"last":1.0509999999999999}]},{"osd":5,"last update":"Sun Oct 8 13:43:18 2023","interfaces":[{"interface":"back","average":{"1min":1.474,"5min":1.413,"15min":1.292},"min":{"1min":0.38800000000000001,"5min":0.36899999999999999,"15min":0.35899999999999999},"max":{"1min":6.7880000000000003,"5min":10.885,"15min":10.885},"last":1.1299999999999999},{"interface":"front","average":{"1min":1.111,"5min":1.1479999999999999,"15min":1.1659999999999999},"min":{"1min":0.38400000000000001,"5min":0.376,"15min":0.376},"max":{"1min":4.2000000000000002,"5min":6.9210000000000003,"15min":10.173999999999999},"last":1.0800000000000001}]},{"osd":6,"last update":"Sun Oct 8 13:43:18 2023","interfaces":[{"interface":"back","average":{"1min":1.2230000000000001,"5min":1.228,"15min":1.2310000000000001},"min":{"1min":0.46000000000000002,"5min":0.43099999999999999,"15min":0.42899999999999999},"max":{"1min":8.0519999999999996,"5min":8.0519999999999996,"15min":8.0519999999999996},"last":1.0189999999999999},{"interface":"front","average":{"1min":1.7350000000000001,"5min":1.1060000000000001,"15min":1.2589999999999999},"min":{"1min":0.48399999999999999,"5min":0.39600000000000002,"15min":0.379},"max":{"1min":7.8879999999999999,"5min":7.8879999999999999,"15min":12.263999999999999},"last":1.1739999999999999}]},{"osd":7,"last update":"Sun Oct 8 13:43:18 2023","interfaces":[{"interface":"back","average":{"1min":1.6240000000000001,"5min":1.2430000000000001,"15min":1.3029999999999999},"min":{"1min":0.49099999999999999,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":6.5010000000000003,"5min":7.5220000000000002,"15min":10.202999999999999},"last":1.1020000000000001},{"interface":"front","average":{"1min":1.413,"5min":1.3660000000000001,"15min":1.3109999999999999},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.42799999999999999},"max":{"1min":4.8319999999999999,"5min":10.952,"15min":10.952},"last":1.272}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T13:44:22.715 DEBUG:teuthology.orchestra.run.smithi032:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2023-10-08T13:44:22.836 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:22.828+0000 7fe73524e700 1 Processor -- start 2023-10-08T13:44:22.837 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:22.828+0000 7fe73524e700 1 -- start start 2023-10-08T13:44:22.838 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:22.828+0000 7fe73524e700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fe7301597f0 0x7fe7300ce190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:44:22.838 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:22.828+0000 7fe73524e700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7300cd290 con 0x7fe73006c6d0 2023-10-08T13:44:22.839 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:22.828+0000 7fe73524e700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7300cec10 con 0x7fe730159bd0 2023-10-08T13:44:22.839 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:22.828+0000 7fe73524e700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7300cc9a0 con 0x7fe7301597f0 2023-10-08T13:44:22.839 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:22.832+0000 7fe734a4d700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fe73006c6d0 0x7fe7300c9b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:39148/0 (socket says 172.21.15.32:39148) 2023-10-08T13:44:22.839 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:22.832+0000 7fe734a4d700 1 -- 172.21.15.32:0/3062982237 learned_addr learned my addr 172.21.15.32:0/3062982237 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-08T13:44:22.839 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:22.832+0000 7fe72ffff700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fe7301597f0 0x7fe7300ce190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:44:22.840 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:22.832+0000 7fe72ffff700 1 -- 172.21.15.32:0/3062982237 >> v1:172.21.15.40:6789/0 conn(0x7fe730159bd0 legacy=0x7fe7300cd720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:44:22.840 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:22.832+0000 7fe72ffff700 1 -- 172.21.15.32:0/3062982237 >> v1:172.21.15.32:6789/0 conn(0x7fe73006c6d0 legacy=0x7fe7300c9b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:44:22.840 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:22.832+0000 7fe72ffff700 1 -- 172.21.15.32:0/3062982237 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe73006ce00 con 0x7fe7301597f0 2023-10-08T13:44:22.840 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:22.832+0000 7fe72ffff700 1 --2- 172.21.15.32:0/3062982237 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe7301597f0 0x7fe7300ce190 secure :-1 s=READY pgs=1939 cs=0 l=1 rev1=1 crypto rx=0x7fe724009850 tx=0x7fe724009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cbb650d32e38ab7 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:44:22.842 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:22.832+0000 7fe72effd700 1 -- 172.21.15.32:0/3062982237 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe724011830 con 0x7fe7301597f0 2023-10-08T13:44:22.842 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:22.832+0000 7fe72effd700 1 -- 172.21.15.32:0/3062982237 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe724011990 con 0x7fe7301597f0 2023-10-08T13:44:22.842 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:22.832+0000 7fe72effd700 1 -- 172.21.15.32:0/3062982237 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe724011d20 con 0x7fe7301597f0 2023-10-08T13:44:22.842 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:22.832+0000 7fe73524e700 1 -- 172.21.15.32:0/3062982237 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe7301597f0 msgr2=0x7fe7300ce190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:44:22.842 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:22.832+0000 7fe73524e700 1 --2- 172.21.15.32:0/3062982237 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe7301597f0 0x7fe7300ce190 secure :-1 s=READY pgs=1939 cs=0 l=1 rev1=1 crypto rx=0x7fe724009850 tx=0x7fe724009b60 comp rx=0 tx=0).stop 2023-10-08T13:44:22.843 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:22.832+0000 7fe73524e700 1 -- 172.21.15.32:0/3062982237 shutdown_connections 2023-10-08T13:44:22.843 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:22.832+0000 7fe73524e700 1 --2- 172.21.15.32:0/3062982237 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe7301597f0 0x7fe7300ce190 unknown :-1 s=CLOSED pgs=1939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:44:22.843 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:22.832+0000 7fe73524e700 1 -- 172.21.15.32:0/3062982237 >> 172.21.15.32:0/3062982237 conn(0x7fe7300b0900 msgr2=0x7fe7300b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:44:22.843 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:22.832+0000 7fe73524e700 1 -- 172.21.15.32:0/3062982237 shutdown_connections 2023-10-08T13:44:22.843 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:22.832+0000 7fe73524e700 1 -- 172.21.15.32:0/3062982237 wait complete. 2023-10-08T13:44:22.843 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:22.836+0000 7fe73524e700 1 Processor -- start 2023-10-08T13:44:22.843 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:22.836+0000 7fe73524e700 1 -- start start 2023-10-08T13:44:22.845 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:22.836+0000 7fe73524e700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe73006c6d0 0x7fe7300c4d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:44:22.845 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:22.836+0000 7fe73524e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe7301597f0 0x7fe730167da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:44:22.846 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:22.836+0000 7fe73524e700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe730159bd0 0x7fe7301682e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:44:22.846 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:22.836+0000 7fe73524e700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe73015c230 con 0x7fe730159bd0 2023-10-08T13:44:22.846 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:22.836+0000 7fe73524e700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7301499f0 con 0x7fe73006c6d0 2023-10-08T13:44:22.846 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:22.836+0000 7fe73524e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe73015b5b0 con 0x7fe7301597f0 2023-10-08T13:44:22.846 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:22.836+0000 7fe734a4d700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe730159bd0 0x7fe7301682e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:44:22.846 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:22.836+0000 7fe734a4d700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe730159bd0 0x7fe7301682e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:36358/0 (socket says 172.21.15.32:36358) 2023-10-08T13:44:22.847 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:22.836+0000 7fe72ffff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe73006c6d0 0x7fe7300c4d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:44:22.847 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:22.836+0000 7fe734a4d700 1 -- 172.21.15.32:0/4244208246 learned_addr learned my addr 172.21.15.32:0/4244208246 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T13:44:22.847 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:22.836+0000 7fe72f7fe700 1 --2- 172.21.15.32:0/4244208246 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe7301597f0 0x7fe730167da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:44:22.847 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:22.836+0000 7fe734a4d700 1 -- 172.21.15.32:0/4244208246 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe7301597f0 msgr2=0x7fe730167da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:44:22.847 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:22.836+0000 7fe734a4d700 1 --2- 172.21.15.32:0/4244208246 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe7301597f0 0x7fe730167da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:44:22.847 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:22.836+0000 7fe734a4d700 1 -- 172.21.15.32:0/4244208246 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe73006c6d0 msgr2=0x7fe7300c4d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:44:22.848 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:22.836+0000 7fe734a4d700 1 --2- 172.21.15.32:0/4244208246 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe73006c6d0 0x7fe7300c4d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:44:22.848 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:22.836+0000 7fe734a4d700 1 -- 172.21.15.32:0/4244208246 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7240094b0 con 0x7fe730159bd0 2023-10-08T13:44:22.848 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:22.836+0000 7fe734a4d700 1 --2- 172.21.15.32:0/4244208246 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe730159bd0 0x7fe7301682e0 secure :-1 s=READY pgs=1940 cs=0 l=1 rev1=1 crypto rx=0x7fe72800cbc0 tx=0x7fe72800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:44:22.848 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:22.836+0000 7fe72cff9700 1 -- 172.21.15.32:0/4244208246 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe728007480 con 0x7fe730159bd0 2023-10-08T13:44:22.848 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:22.836+0000 7fe72cff9700 1 -- 172.21.15.32:0/4244208246 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7280075e0 con 0x7fe730159bd0 2023-10-08T13:44:22.849 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:22.836+0000 7fe72cff9700 1 -- 172.21.15.32:0/4244208246 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe728007950 con 0x7fe730159bd0 2023-10-08T13:44:22.849 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:22.836+0000 7fe73524e700 1 -- 172.21.15.32:0/4244208246 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe73015b890 con 0x7fe730159bd0 2023-10-08T13:44:22.849 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:22.836+0000 7fe73524e700 1 -- 172.21.15.32:0/4244208246 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe73015be50 con 0x7fe730159bd0 2023-10-08T13:44:22.850 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:22.840+0000 7fe73524e700 1 -- 172.21.15.32:0/4244208246 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe73015c370 con 0x7fe730159bd0 2023-10-08T13:44:22.851 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:22.840+0000 7fe72cff9700 1 -- 172.21.15.32:0/4244208246 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fe728012400 con 0x7fe730159bd0 2023-10-08T13:44:22.851 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:22.840+0000 7fe72cff9700 1 --2- 172.21.15.32:0/4244208246 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fe71c066510 0x7fe71c0689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:44:22.851 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:22.840+0000 7fe72cff9700 1 -- 172.21.15.32:0/4244208246 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fe7280832e0 con 0x7fe730159bd0 2023-10-08T13:44:22.851 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:22.840+0000 7fe72ffff700 1 --2- 172.21.15.32:0/4244208246 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fe71c066510 0x7fe71c0689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:44:22.852 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:22.840+0000 7fe72ffff700 1 --2- 172.21.15.32:0/4244208246 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fe71c066510 0x7fe71c0689d0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7fe724009fd0 tx=0x7fe724008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:44:22.858 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:22.852+0000 7fe72cff9700 1 -- 172.21.15.32:0/4244208246 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fe728050ba0 con 0x7fe730159bd0 2023-10-08T13:44:23.022 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:23.016+0000 7fe73524e700 1 -- 172.21.15.32:0/4244208246 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7fe730073f00 con 0x7fe730159bd0 2023-10-08T13:44:23.028 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:23.020+0000 7fe72cff9700 1 -- 172.21.15.32:0/4244208246 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v12)=0 v12) v1 ==== 123+0+0 (secure 0 0 0) 0x7fe7280541c0 con 0x7fe730159bd0 2023-10-08T13:44:23.030 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:23.024+0000 7fe72cff9700 1 -- 172.21.15.32:0/4244208246 <== mon.0 v2:172.21.15.32:3300/0 8 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fe728050ba0 con 0x7fe730159bd0 2023-10-08T13:44:23.033 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:23.024+0000 7fe73524e700 1 -- 172.21.15.32:0/4244208246 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fe71c066510 msgr2=0x7fe71c0689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:44:23.033 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:23.024+0000 7fe73524e700 1 --2- 172.21.15.32:0/4244208246 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fe71c066510 0x7fe71c0689d0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7fe724009fd0 tx=0x7fe724008030 comp rx=0 tx=0).stop 2023-10-08T13:44:23.033 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:23.024+0000 7fe73524e700 1 -- 172.21.15.32:0/4244208246 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe730159bd0 msgr2=0x7fe7301682e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:44:23.034 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:23.024+0000 7fe73524e700 1 --2- 172.21.15.32:0/4244208246 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe730159bd0 0x7fe7301682e0 secure :-1 s=READY pgs=1940 cs=0 l=1 rev1=1 crypto rx=0x7fe72800cbc0 tx=0x7fe72800cbf0 comp rx=0 tx=0).stop 2023-10-08T13:44:23.034 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:23.024+0000 7fe73524e700 1 -- 172.21.15.32:0/4244208246 shutdown_connections 2023-10-08T13:44:23.034 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:23.024+0000 7fe73524e700 1 --2- 172.21.15.32:0/4244208246 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7fe71c066510 0x7fe71c0689d0 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:44:23.035 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:23.024+0000 7fe73524e700 1 --2- 172.21.15.32:0/4244208246 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe730159bd0 0x7fe7301682e0 unknown :-1 s=CLOSED pgs=1940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:44:23.035 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:23.024+0000 7fe73524e700 1 --2- 172.21.15.32:0/4244208246 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe7301597f0 0x7fe730167da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:44:23.035 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:23.024+0000 7fe73524e700 1 --2- 172.21.15.32:0/4244208246 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe73006c6d0 0x7fe7300c4d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:44:23.035 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:23.024+0000 7fe73524e700 1 -- 172.21.15.32:0/4244208246 >> 172.21.15.32:0/4244208246 conn(0x7fe7300b0900 msgr2=0x7fe73014db80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:44:23.035 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:23.024+0000 7fe73524e700 1 -- 172.21.15.32:0/4244208246 shutdown_connections 2023-10-08T13:44:23.036 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:23.024+0000 7fe73524e700 1 -- 172.21.15.32:0/4244208246 wait complete. 2023-10-08T13:44:23.048 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-08T13:44:23.049 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T13:44:23.164 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:23.156+0000 7f5290f5e700 1 Processor -- start 2023-10-08T13:44:23.164 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:23.156+0000 7f5290f5e700 1 -- start start 2023-10-08T13:44:23.166 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:23.156+0000 7f5290f5e700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f528c1597f0 0x7f528c0ce190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:44:23.167 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:23.156+0000 7f5290f5e700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f528c0cd290 con 0x7f528c06c6d0 2023-10-08T13:44:23.167 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:23.156+0000 7f5290f5e700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f528c0cec10 con 0x7f528c159bd0 2023-10-08T13:44:23.167 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:23.156+0000 7f5290f5e700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f528c0cc9a0 con 0x7f528c1597f0 2023-10-08T13:44:23.167 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:23.156+0000 7f528bfff700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f528c06c6d0 0x7f528c0c9b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:39162/0 (socket says 172.21.15.32:39162) 2023-10-08T13:44:23.167 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:23.156+0000 7f528bfff700 1 -- 172.21.15.32:0/3667762886 learned_addr learned my addr 172.21.15.32:0/3667762886 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-10-08T13:44:23.167 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:23.156+0000 7f528b7fe700 1 --2- 172.21.15.32:0/3667762886 >> v2:172.21.15.40:3300/0 conn(0x7f528c1597f0 0x7f528c0ce190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:44:23.167 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:23.160+0000 7f528affd700 1 -- 172.21.15.32:0/3667762886 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2533339406 0 0) 0x7f528c0cd290 con 0x7f528c06c6d0 2023-10-08T13:44:23.168 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:23.160+0000 7f528affd700 1 -- 172.21.15.32:0/3667762886 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f52780035d0 con 0x7f528c06c6d0 2023-10-08T13:44:23.168 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:23.160+0000 7f528affd700 1 -- 172.21.15.32:0/3667762886 <== mon.1 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2026342433 0 0) 0x7f528c0cec10 con 0x7f528c159bd0 2023-10-08T13:44:23.168 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:23.160+0000 7f528affd700 1 -- 172.21.15.32:0/3667762886 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f528c0cd290 con 0x7f528c159bd0 2023-10-08T13:44:23.168 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:23.160+0000 7f528b7fe700 1 -- 172.21.15.32:0/3667762886 >> v1:172.21.15.40:6789/0 conn(0x7f528c159bd0 legacy=0x7f528c0cd720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:44:23.168 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:23.160+0000 7f528b7fe700 1 -- 172.21.15.32:0/3667762886 >> v1:172.21.15.32:6789/0 conn(0x7f528c06c6d0 legacy=0x7f528c0c9b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:44:23.168 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:23.160+0000 7f528b7fe700 1 -- 172.21.15.32:0/3667762886 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f528c06ce00 con 0x7f528c1597f0 2023-10-08T13:44:23.168 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:23.160+0000 7f528b7fe700 1 --2- 172.21.15.32:0/3667762886 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f528c1597f0 0x7f528c0ce190 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f527c009850 tx=0x7f527c009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a017e2b7ffee6298 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:44:23.169 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:23.160+0000 7f528affd700 1 -- 172.21.15.32:0/3667762886 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f527c011830 con 0x7f528c1597f0 2023-10-08T13:44:23.170 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:23.160+0000 7f528affd700 1 -- 172.21.15.32:0/3667762886 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f527c011990 con 0x7f528c1597f0 2023-10-08T13:44:23.170 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:23.160+0000 7f528affd700 1 -- 172.21.15.32:0/3667762886 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f527c011d00 con 0x7f528c1597f0 2023-10-08T13:44:23.170 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:23.160+0000 7f5290f5e700 1 -- 172.21.15.32:0/3667762886 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f528c1597f0 msgr2=0x7f528c0ce190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:44:23.170 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:23.160+0000 7f5290f5e700 1 --2- 172.21.15.32:0/3667762886 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f528c1597f0 0x7f528c0ce190 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f527c009850 tx=0x7f527c009b60 comp rx=0 tx=0).stop 2023-10-08T13:44:23.170 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:23.160+0000 7f5290f5e700 1 -- 172.21.15.32:0/3667762886 shutdown_connections 2023-10-08T13:44:23.170 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:23.160+0000 7f5290f5e700 1 --2- 172.21.15.32:0/3667762886 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f528c1597f0 0x7f528c0ce190 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:44:23.171 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:23.160+0000 7f5290f5e700 1 -- 172.21.15.32:0/3667762886 >> 172.21.15.32:0/3667762886 conn(0x7f528c0b0900 msgr2=0x7f528c0b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:44:23.171 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:23.160+0000 7f5290f5e700 1 -- 172.21.15.32:0/3667762886 shutdown_connections 2023-10-08T13:44:23.171 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:23.160+0000 7f5290f5e700 1 -- 172.21.15.32:0/3667762886 wait complete. 2023-10-08T13:44:23.176 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:23.164+0000 7f5290f5e700 1 Processor -- start 2023-10-08T13:44:23.177 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:23.164+0000 7f5290f5e700 1 -- start start 2023-10-08T13:44:23.177 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:23.168+0000 7f5290f5e700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f528c06c6d0 0x7f528c1441c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:44:23.177 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:23.168+0000 7f5290f5e700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f528c1597f0 0x7f528c1e2c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:44:23.177 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:23.168+0000 7f5290f5e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f528c159bd0 0x7f528c1ee850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:44:23.177 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:23.168+0000 7f5290f5e700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f528c1e31d0 con 0x7f528c1597f0 2023-10-08T13:44:23.177 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:23.168+0000 7f5290f5e700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f528c1e3450 con 0x7f528c06c6d0 2023-10-08T13:44:23.177 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:23.168+0000 7f5290f5e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f528c1e3730 con 0x7f528c159bd0 2023-10-08T13:44:23.178 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:23.168+0000 7f5282ffd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f528c1597f0 0x7f528c1e2c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:44:23.178 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:23.168+0000 7f5282ffd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f528c1597f0 0x7f528c1e2c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:36370/0 (socket says 172.21.15.32:36370) 2023-10-08T13:44:23.178 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:23.168+0000 7f5282ffd700 1 -- 172.21.15.32:0/1133300763 learned_addr learned my addr 172.21.15.32:0/1133300763 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-10-08T13:44:23.178 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:23.168+0000 7f528b7fe700 1 --2- 172.21.15.32:0/1133300763 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f528c06c6d0 0x7f528c1441c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:44:23.178 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:23.168+0000 7f528bfff700 1 --2- 172.21.15.32:0/1133300763 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f528c159bd0 0x7f528c1ee850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:44:23.178 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:23.168+0000 7f5282ffd700 1 -- 172.21.15.32:0/1133300763 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f528c159bd0 msgr2=0x7f528c1ee850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:44:23.178 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:23.168+0000 7f5282ffd700 1 --2- 172.21.15.32:0/1133300763 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f528c159bd0 0x7f528c1ee850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:44:23.179 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:23.168+0000 7f5282ffd700 1 -- 172.21.15.32:0/1133300763 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f528c06c6d0 msgr2=0x7f528c1441c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:44:23.179 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:23.168+0000 7f5282ffd700 1 --2- 172.21.15.32:0/1133300763 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f528c06c6d0 0x7f528c1441c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:44:23.179 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:23.168+0000 7f5282ffd700 1 -- 172.21.15.32:0/1133300763 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f527c0094b0 con 0x7f528c1597f0 2023-10-08T13:44:23.179 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:23.168+0000 7f5282ffd700 1 --2- 172.21.15.32:0/1133300763 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f528c1597f0 0x7f528c1e2c90 secure :-1 s=READY pgs=1942 cs=0 l=1 rev1=1 crypto rx=0x7f527400c520 tx=0x7f527400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:44:23.179 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:23.168+0000 7f5288ff9700 1 -- 172.21.15.32:0/1133300763 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52740052d0 con 0x7f528c1597f0 2023-10-08T13:44:23.179 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:23.168+0000 7f5288ff9700 1 -- 172.21.15.32:0/1133300763 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f5274005450 con 0x7f528c1597f0 2023-10-08T13:44:23.179 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:23.168+0000 7f5290f5e700 1 -- 172.21.15.32:0/1133300763 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f528c1e3a10 con 0x7f528c1597f0 2023-10-08T13:44:23.179 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:23.168+0000 7f5288ff9700 1 -- 172.21.15.32:0/1133300763 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5274003900 con 0x7f528c1597f0 2023-10-08T13:44:23.180 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:23.168+0000 7f5290f5e700 1 -- 172.21.15.32:0/1133300763 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f528c1e3fd0 con 0x7f528c1597f0 2023-10-08T13:44:23.180 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:23.168+0000 7f5290f5e700 1 -- 172.21.15.32:0/1133300763 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f528c073f00 con 0x7f528c1597f0 2023-10-08T13:44:23.181 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:23.172+0000 7f5288ff9700 1 -- 172.21.15.32:0/1133300763 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f5274003a60 con 0x7f528c1597f0 2023-10-08T13:44:23.181 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:23.172+0000 7f5288ff9700 1 --2- 172.21.15.32:0/1133300763 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f526c066510 0x7f526c0689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T13:44:23.181 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:23.172+0000 7f5288ff9700 1 -- 172.21.15.32:0/1133300763 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f5274082fe0 con 0x7f528c1597f0 2023-10-08T13:44:23.181 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:23.172+0000 7f528b7fe700 1 --2- 172.21.15.32:0/1133300763 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f526c066510 0x7f526c0689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T13:44:23.181 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:23.172+0000 7f528b7fe700 1 --2- 172.21.15.32:0/1133300763 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f526c066510 0x7f526c0689d0 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f527c0090b0 tx=0x7f527c008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T13:44:23.187 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:23.180+0000 7f5288ff9700 1 -- 172.21.15.32:0/1133300763 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f5274050700 con 0x7f528c1597f0 2023-10-08T13:44:23.387 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:23.380+0000 7f5290f5e700 1 -- 172.21.15.32:0/1133300763 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f528c0ae9c0 con 0x7f528c1597f0 2023-10-08T13:44:23.388 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:23.380+0000 7f5288ff9700 1 -- 172.21.15.32:0/1133300763 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+3698 (secure 0 0 0) 0x7f5274017090 con 0x7f528c1597f0 2023-10-08T13:44:23.388 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-10-08T13:44:23.389 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":16,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5232,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6835/1178250724","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6834","nonce":1178250724},{"type":"v1","addr":"172.21.15.32:6835","nonce":1178250724}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10},{"gid":5238,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6837/2723596589","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6836","nonce":2723596589},{"type":"v1","addr":"172.21.15.32:6837","nonce":2723596589}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10},{"gid":5323,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6833/3107673350","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":3107673350},{"type":"v1","addr":"172.21.15.40:6833","nonce":3107673350}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9},{"gid":8627,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/3654500245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":3654500245},{"type":"v1","addr":"172.21.15.40:6835","nonce":3654500245}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":16}],"filesystems":[]} 2023-10-08T13:44:23.391 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:23.384+0000 7f5290f5e700 1 -- 172.21.15.32:0/1133300763 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f526c066510 msgr2=0x7f526c0689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:44:23.391 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:23.384+0000 7f5290f5e700 1 --2- 172.21.15.32:0/1133300763 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f526c066510 0x7f526c0689d0 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f527c0090b0 tx=0x7f527c008030 comp rx=0 tx=0).stop 2023-10-08T13:44:23.391 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:23.384+0000 7f5290f5e700 1 -- 172.21.15.32:0/1133300763 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f528c1597f0 msgr2=0x7f528c1e2c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T13:44:23.391 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:23.384+0000 7f5290f5e700 1 --2- 172.21.15.32:0/1133300763 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f528c1597f0 0x7f528c1e2c90 secure :-1 s=READY pgs=1942 cs=0 l=1 rev1=1 crypto rx=0x7f527400c520 tx=0x7f527400c830 comp rx=0 tx=0).stop 2023-10-08T13:44:23.392 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:23.384+0000 7f5290f5e700 1 -- 172.21.15.32:0/1133300763 shutdown_connections 2023-10-08T13:44:23.392 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:23.384+0000 7f5290f5e700 1 --2- 172.21.15.32:0/1133300763 >> [v2:172.21.15.32:6832/2601628338,v1:172.21.15.32:6833/2601628338] conn(0x7f526c066510 0x7f526c0689d0 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:44:23.392 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:23.384+0000 7f5290f5e700 1 --2- 172.21.15.32:0/1133300763 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f528c1597f0 0x7f528c1e2c90 unknown :-1 s=CLOSED pgs=1942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:44:23.392 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:23.384+0000 7f5290f5e700 1 --2- 172.21.15.32:0/1133300763 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f528c159bd0 0x7f528c1ee850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:44:23.392 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:23.384+0000 7f5290f5e700 1 --2- 172.21.15.32:0/1133300763 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f528c06c6d0 0x7f528c1441c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T13:44:23.392 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:23.384+0000 7f5290f5e700 1 -- 172.21.15.32:0/1133300763 >> 172.21.15.32:0/1133300763 conn(0x7f528c0b0900 msgr2=0x7f528c0717a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T13:44:23.393 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:23.384+0000 7f5290f5e700 1 -- 172.21.15.32:0/1133300763 shutdown_connections 2023-10-08T13:44:23.393 INFO:teuthology.orchestra.run.smithi032.stderr:2023-10-08T13:44:23.384+0000 7f5290f5e700 1 -- 172.21.15.32:0/1133300763 wait complete. 2023-10-08T13:44:23.393 INFO:teuthology.orchestra.run.smithi032.stderr:dumped fsmap epoch 16 2023-10-08T13:44:23.403 DEBUG:tasks.cephfs.filesystem:already dead... 2023-10-08T13:44:23.404 INFO:teuthology.misc:Shutting down mds daemons... 2023-10-08T13:44:23.404 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-08T13:44:23.404 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T13:44:23.416 INFO:tasks.ceph.mds.a:Stopped 2023-10-08T13:44:23.416 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-08T13:44:23.416 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T13:44:23.432 INFO:tasks.ceph.mds.c:Stopped 2023-10-08T13:44:23.432 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-08T13:44:23.432 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T13:44:23.448 INFO:tasks.ceph.mds.b:Stopped 2023-10-08T13:44:23.449 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-08T13:44:23.449 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T13:44:23.466 INFO:tasks.ceph.mds.d:Stopped 2023-10-08T13:44:23.466 INFO:teuthology.misc:Shutting down osd daemons... 2023-10-08T13:44:23.467 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-10-08T13:44:23.467 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T13:44:27.864 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~0s 2023-10-08T13:44:29.568 INFO:tasks.ceph.osd.0:Stopped 2023-10-08T13:44:29.569 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-10-08T13:44:29.569 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T13:44:33.973 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~0s 2023-10-08T13:44:33.973 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 has been restored 2023-10-08T13:44:35.671 INFO:tasks.ceph.osd.1:Stopped 2023-10-08T13:44:35.672 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-10-08T13:44:35.672 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T13:44:39.982 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2023-10-08T13:44:39.983 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 has been restored 2023-10-08T13:44:41.774 INFO:tasks.ceph.osd.2:Stopped 2023-10-08T13:44:41.775 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-10-08T13:44:41.775 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T13:44:42.508 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:44:42.510 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:44:45.890 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2023-10-08T13:44:45.891 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 has been restored 2023-10-08T13:44:47.876 INFO:tasks.ceph.osd.3:Stopped 2023-10-08T13:44:47.877 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2023-10-08T13:44:47.877 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T13:44:51.697 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~0s 2023-10-08T13:44:51.698 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 has been restored 2023-10-08T13:44:53.979 INFO:tasks.ceph.osd.4:Stopped 2023-10-08T13:44:53.980 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2023-10-08T13:44:53.980 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T13:44:57.402 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~0s 2023-10-08T13:44:57.402 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 has been restored 2023-10-08T13:45:00.082 INFO:tasks.ceph.osd.5:Stopped 2023-10-08T13:45:00.082 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2023-10-08T13:45:00.082 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T13:45:03.008 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~0s 2023-10-08T13:45:03.008 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 has been restored 2023-10-08T13:45:06.184 INFO:tasks.ceph.osd.6:Stopped 2023-10-08T13:45:06.185 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2023-10-08T13:45:06.185 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T13:45:08.513 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2023-10-08T13:45:08.513 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 has been restored 2023-10-08T13:45:12.287 INFO:tasks.ceph.osd.7:Stopped 2023-10-08T13:45:12.288 INFO:teuthology.misc:Shutting down mgr daemons... 2023-10-08T13:45:12.288 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-10-08T13:45:12.288 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T13:45:12.323 INFO:tasks.ceph.mgr.y:Stopped 2023-10-08T13:45:12.324 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-10-08T13:45:12.324 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T13:45:12.355 INFO:tasks.ceph.mgr.x:Stopped 2023-10-08T13:45:12.355 INFO:teuthology.misc:Shutting down mon daemons... 2023-10-08T13:45:12.355 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-10-08T13:45:12.355 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T13:45:12.393 INFO:tasks.ceph.mon.a:Stopped 2023-10-08T13:45:12.394 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-10-08T13:45:12.394 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T13:45:12.427 INFO:tasks.ceph.mon.b:Stopped 2023-10-08T13:45:12.428 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-10-08T13:45:12.428 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T13:45:12.460 INFO:tasks.ceph.mon.c:Stopped 2023-10-08T13:45:12.460 INFO:tasks.ceph:Checking cluster log for badness... 2023-10-08T13:45:12.461 DEBUG:teuthology.orchestra.run.smithi032:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2023-10-08T13:45:12.586 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi032.front.sepia.ceph.com 2023-10-08T13:45:12.586 DEBUG:teuthology.orchestra.run.smithi032:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-10-08T13:45:12.614 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:45:12.617 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:45:12.993 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi032.front.sepia.ceph.com 2023-10-08T13:45:12.993 DEBUG:teuthology.orchestra.run.smithi032:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-10-08T13:45:13.305 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi032.front.sepia.ceph.com 2023-10-08T13:45:13.306 DEBUG:teuthology.orchestra.run.smithi032:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-10-08T13:45:13.514 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 has been restored 2023-10-08T13:45:13.549 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi032.front.sepia.ceph.com 2023-10-08T13:45:13.549 DEBUG:teuthology.orchestra.run.smithi032:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-10-08T13:45:13.796 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi040.front.sepia.ceph.com 2023-10-08T13:45:13.797 DEBUG:teuthology.orchestra.run.smithi040:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2023-10-08T13:45:13.935 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi040.front.sepia.ceph.com 2023-10-08T13:45:13.935 DEBUG:teuthology.orchestra.run.smithi040:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2023-10-08T13:45:14.317 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi040.front.sepia.ceph.com 2023-10-08T13:45:14.317 DEBUG:teuthology.orchestra.run.smithi040:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2023-10-08T13:45:14.502 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi040.front.sepia.ceph.com 2023-10-08T13:45:14.502 DEBUG:teuthology.orchestra.run.smithi040:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2023-10-08T13:45:14.687 INFO:tasks.ceph:Archiving mon data... 2023-10-08T13:45:14.688 DEBUG:teuthology.misc:Transferring archived files from smithi032:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/yuriw-2023-10-07_14:05:27-fs-main-distro-default-smithi/7417362/data/mon.a.tgz 2023-10-08T13:45:14.689 DEBUG:teuthology.orchestra.run.smithi032:> mktemp 2023-10-08T13:45:14.696 INFO:teuthology.orchestra.run.smithi032.stdout:/tmp/tmp.St6AsR7Cyn 2023-10-08T13:45:14.697 DEBUG:teuthology.orchestra.run.smithi032:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.St6AsR7Cyn 2023-10-08T13:45:14.828 DEBUG:teuthology.orchestra.run.smithi032:> sudo chmod 0666 /tmp/tmp.St6AsR7Cyn 2023-10-08T13:45:14.934 DEBUG:teuthology.orchestra.remote:smithi032:/tmp/tmp.St6AsR7Cyn is 596KB 2023-10-08T13:45:15.003 DEBUG:teuthology.orchestra.run.smithi032:> rm -fr /tmp/tmp.St6AsR7Cyn 2023-10-08T13:45:15.127 DEBUG:teuthology.misc:Transferring archived files from smithi040:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/yuriw-2023-10-07_14:05:27-fs-main-distro-default-smithi/7417362/data/mon.b.tgz 2023-10-08T13:45:15.128 DEBUG:teuthology.orchestra.run.smithi040:> mktemp 2023-10-08T13:45:15.135 INFO:teuthology.orchestra.run.smithi040.stdout:/tmp/tmp.hfXHdiPSx5 2023-10-08T13:45:15.135 DEBUG:teuthology.orchestra.run.smithi040:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.hfXHdiPSx5 2023-10-08T13:45:15.267 DEBUG:teuthology.orchestra.run.smithi040:> sudo chmod 0666 /tmp/tmp.hfXHdiPSx5 2023-10-08T13:45:15.370 DEBUG:teuthology.orchestra.remote:smithi040:/tmp/tmp.hfXHdiPSx5 is 607KB 2023-10-08T13:45:15.438 DEBUG:teuthology.orchestra.run.smithi040:> rm -fr /tmp/tmp.hfXHdiPSx5 2023-10-08T13:45:15.445 DEBUG:teuthology.misc:Transferring archived files from smithi040:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/yuriw-2023-10-07_14:05:27-fs-main-distro-default-smithi/7417362/data/mon.c.tgz 2023-10-08T13:45:15.445 DEBUG:teuthology.orchestra.run.smithi040:> mktemp 2023-10-08T13:45:15.451 INFO:teuthology.orchestra.run.smithi040.stdout:/tmp/tmp.ZxeDRaigel 2023-10-08T13:45:15.452 DEBUG:teuthology.orchestra.run.smithi040:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.ZxeDRaigel 2023-10-08T13:45:15.616 DEBUG:teuthology.orchestra.run.smithi040:> sudo chmod 0666 /tmp/tmp.ZxeDRaigel 2023-10-08T13:45:15.636 DEBUG:teuthology.orchestra.remote:smithi040:/tmp/tmp.ZxeDRaigel is 607KB 2023-10-08T13:45:15.702 DEBUG:teuthology.orchestra.run.smithi040:> rm -fr /tmp/tmp.ZxeDRaigel 2023-10-08T13:45:15.708 INFO:tasks.ceph:Cleaning ceph cluster... 2023-10-08T13:45:15.708 DEBUG:teuthology.orchestra.run.smithi032:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-10-08T13:45:15.711 DEBUG:teuthology.orchestra.run.smithi040:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-10-08T13:45:15.741 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2023-10-08T13:45:15.742 DEBUG:teuthology.orchestra.run.smithi032:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-10-08T13:45:15.744 DEBUG:teuthology.orchestra.run.smithi040:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-10-08T13:45:15.779 INFO:teuthology.orchestra.run.smithi032.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-10-08T13:45:15.821 INFO:teuthology.orchestra.run.smithi040.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-10-08T13:45:15.830 INFO:tasks.ceph:Archiving crash dumps... 2023-10-08T13:45:15.832 DEBUG:teuthology.misc:Transferring archived files from smithi032:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-10-07_14:05:27-fs-main-distro-default-smithi/7417362/remote/smithi032/crash 2023-10-08T13:45:15.833 DEBUG:teuthology.orchestra.run.smithi032:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-10-08T13:45:15.848 DEBUG:teuthology.misc:Transferring archived files from smithi040:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-10-07_14:05:27-fs-main-distro-default-smithi/7417362/remote/smithi040/crash 2023-10-08T13:45:15.849 DEBUG:teuthology.orchestra.run.smithi040:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-10-08T13:45:15.867 INFO:tasks.ceph:Shutting down logrotate 2023-10-08T13:45:15.868 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:45:15.872 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T13:45:15.970 DEBUG:teuthology.orchestra.run.smithi032:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-10-08T13:45:16.004 DEBUG:teuthology.orchestra.run.smithi040:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-10-08T13:45:16.050 INFO:tasks.ceph:Compressing logs... 2023-10-08T13:45:16.050 DEBUG:teuthology.orchestra.run.smithi032:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-10-08T13:45:16.053 DEBUG:teuthology.orchestra.run.smithi040:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-10-08T13:45:16.073 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2023-10-08T13:45:16.074 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2023-10-08T13:45:16.074 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35986.log 2023-10-08T13:45:16.075 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2023-10-08T13:45:16.075 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35909.log 2023-10-08T13:45:16.076 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.35986.log: /var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35934.log 2023-10-08T13:45:16.076 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.35909.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2023-10-08T13:45:16.077 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2023-10-08T13:45:16.077 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.35934.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-10-08T13:45:16.078 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-mgr.x.log: /var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2023-10-08T13:45:16.079 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35959.log 2023-10-08T13:45:16.080 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.463163.log 2023-10-08T13:45:16.080 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.289428.log 2023-10-08T13:45:16.082 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36095.log 2023-10-08T13:45:16.082 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.35959.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2023-10-08T13:45:16.082 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36067.log 2023-10-08T13:45:16.083 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.463163.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40288.log 2023-10-08T13:45:16.083 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.463579.log 2023-10-08T13:45:16.083 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.289428.log: /var/log/ceph/ceph-client.admin.40288.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187335.log 2023-10-08T13:45:16.083 INFO:teuthology.orchestra.run.smithi032.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.463163.log.gz 2023-10-08T13:45:16.083 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.411231.log 2023-10-08T13:45:16.084 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.463579.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102027.log 2023-10-08T13:45:16.085 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.187335.log: /var/log/ceph/ceph-client.admin.411231.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.306092.log 2023-10-08T13:45:16.085 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.102027.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43095.log 2023-10-08T13:45:16.085 INFO:teuthology.orchestra.run.smithi032.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.463579.log.gz 2023-10-08T13:45:16.085 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.468229.log 2023-10-08T13:45:16.086 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.306092.log: /var/log/ceph/ceph-client.admin.43095.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.335269.log 2023-10-08T13:45:16.086 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.468229.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84947.log 2023-10-08T13:45:16.088 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.335269.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119077.log 2023-10-08T13:45:16.088 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.36095.log: /var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-10-08T13:45:16.089 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181391.log 2023-10-08T13:45:16.089 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.84947.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44504.log 2023-10-08T13:45:16.090 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.36067.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.35909.log.gz 2023-10-08T13:45:16.090 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36040.log 2023-10-08T13:45:16.090 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.3.41756.log 2023-10-08T13:45:16.090 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.36040.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2023-10-08T13:45:16.091 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.41642.log 2023-10-08T13:45:16.091 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.3.41756.log: /var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36013.log 2023-10-08T13:45:16.091 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2023-10-08T13:45:16.092 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.1.41642.log: 88.0%/var/log/ceph/ceph-client.admin.36013.log: -- replaced with /var/log/ceph/ceph-client.admin.35934.log.gz 2023-10-08T13:45:16.092 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.119077.log: /var/log/ceph/ceph-client.admin.181391.log: 92.5% -- replaced with /var/log/ceph/ceph-client.admin.468229.log.gz 2023-10-08T13:45:16.092 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.321703.log 2023-10-08T13:45:16.093 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 /var/log/ceph/ceph-client.admin.44504.log: --verbose -- /var/log/ceph/ceph-client.admin.461880.log 2023-10-08T13:45:16.093 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.321703.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.363661.log 2023-10-08T13:45:16.094 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.461880.log: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.461880.log.gz 2023-10-08T13:45:16.095 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.465667.log 2023-10-08T13:45:16.095 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.363661.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.351049.log 2023-10-08T13:45:16.095 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.465667.log: gzip -5 --verbose -- 80.6%/var/log/ceph/ceph-client.admin.212898.log -- replaced with /var/log/ceph/ceph-client.admin.465667.log.gz 2023-10-08T13:45:16.095 INFO:teuthology.orchestra.run.smithi032.stderr: 2023-10-08T13:45:16.095 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.291035.log 2023-10-08T13:45:16.097 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.212898.log: /var/log/ceph/ceph-client.admin.351049.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.233218.log 2023-10-08T13:45:16.097 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.291035.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190996.log 2023-10-08T13:45:16.098 INFO:teuthology.orchestra.run.smithi032.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.40288.log.gz 2023-10-08T13:45:16.098 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.233218.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.273039.log 2023-10-08T13:45:16.098 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.190996.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126936.log 2023-10-08T13:45:16.098 INFO:teuthology.orchestra.run.smithi032.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.43095.log.gz 2023-10-08T13:45:16.100 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.273039.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40261.log 2023-10-08T13:45:16.100 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127422.log 2023-10-08T13:45:16.100 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.126936.log: /var/log/ceph/ceph-client.admin.40261.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190603.log 2023-10-08T13:45:16.100 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171557.log 2023-10-08T13:45:16.100 INFO:teuthology.orchestra.run.smithi032.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.306092.log.gz 2023-10-08T13:45:16.100 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.127422.log: /var/log/ceph/ceph-client.admin.190603.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175278.log 2023-10-08T13:45:16.102 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.171557.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100829.log 2023-10-08T13:45:16.102 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.175278.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107739.log 2023-10-08T13:45:16.102 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.394541.log 2023-10-08T13:45:16.102 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.100829.log: /var/log/ceph/ceph-client.admin.107739.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.317469.log 2023-10-08T13:45:16.103 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-osd.7.log: 90.0% -- replaced with /var/log/ceph/ceph-client.1.41642.log.gz 2023-10-08T13:45:16.103 INFO:teuthology.orchestra.run.smithi040.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.3.41756.log.gz 2023-10-08T13:45:16.105 INFO:teuthology.orchestra.run.smithi032.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.187335.log.gz 2023-10-08T13:45:16.105 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.323130.log 2023-10-08T13:45:16.105 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.394541.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.475820.log 2023-10-08T13:45:16.105 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.317469.log: /var/log/ceph/ceph-client.admin.323130.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.427891.log 2023-10-08T13:45:16.105 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.475820.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44080.log 2023-10-08T13:45:16.106 INFO:teuthology.orchestra.run.smithi032.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.475820.log.gz 2023-10-08T13:45:16.106 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187738.log 2023-10-08T13:45:16.106 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.427891.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.430789.log 2023-10-08T13:45:16.106 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.44080.log: /var/log/ceph/ceph-client.admin.187738.log: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.190603.log.gz 2023-10-08T13:45:16.106 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161611.log 2023-10-08T13:45:16.107 INFO:teuthology.orchestra.run.smithi040.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.35959.log.gz 2023-10-08T13:45:16.107 INFO:teuthology.orchestra.run.smithi040.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.35986.log.gz 2023-10-08T13:45:16.109 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.430789.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152423.log 2023-10-08T13:45:16.109 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.161611.log: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.175278.log.gz 2023-10-08T13:45:16.109 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.212032.log 2023-10-08T13:45:16.109 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.152423.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.320309.log 2023-10-08T13:45:16.109 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.396268.log /var/log/ceph/ceph-client.admin.212032.log: 2023-10-08T13:45:16.109 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.320309.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.220145.log 2023-10-08T13:45:16.110 INFO:teuthology.orchestra.run.smithi032.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.187738.log.gz 2023-10-08T13:45:16.110 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.396268.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176485.log 2023-10-08T13:45:16.110 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.220145.log: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.335269.log.gz 2023-10-08T13:45:16.112 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.472467.log 2023-10-08T13:45:16.112 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.176485.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.398758.log 2023-10-08T13:45:16.112 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.224597.log 2023-10-08T13:45:16.113 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.472467.log: 78.7% -- replaced with /var/log/ceph/ceph-client.admin.212898.log.gz 2023-10-08T13:45:16.113 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.398758.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.463154.log 2023-10-08T13:45:16.113 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.224597.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.472901.log 2023-10-08T13:45:16.113 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.463154.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160766.log 2023-10-08T13:45:16.113 INFO:teuthology.orchestra.run.smithi032.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.463154.log.gz 2023-10-08T13:45:16.113 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.388604.log 2023-10-08T13:45:16.113 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.472901.log: /var/log/ceph/ceph-client.admin.160766.log: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.363661.log.gz 2023-10-08T13:45:16.114 INFO:teuthology.orchestra.run.smithi040.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.36013.log.gz 2023-10-08T13:45:16.115 INFO:teuthology.orchestra.run.smithi040.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.36040.log.gz 2023-10-08T13:45:16.115 INFO:teuthology.orchestra.run.smithi040.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.36067.log.gz 2023-10-08T13:45:16.115 INFO:teuthology.orchestra.run.smithi040.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.36095.log.gz 2023-10-08T13:45:16.119 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104452.log 2023-10-08T13:45:16.119 INFO:teuthology.orchestra.run.smithi032.stderr: 83.7% -- replaced with /var/log/ceph/ceph-client.admin.472901.log.gz 2023-10-08T13:45:16.119 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.388604.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185923.log 2023-10-08T13:45:16.119 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.104452.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.242802.log 2023-10-08T13:45:16.119 INFO:teuthology.orchestra.run.smithi032.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44504.log.gz 2023-10-08T13:45:16.120 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.185923.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.421208.log 2023-10-08T13:45:16.120 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.242802.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.293859.log 2023-10-08T13:45:16.120 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.402509.log 2023-10-08T13:45:16.120 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.421208.log: /var/log/ceph/ceph-client.admin.293859.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164685.log 2023-10-08T13:45:16.120 INFO:teuthology.orchestra.run.smithi032.stderr: 92.5% -- replaced with /var/log/ceph/ceph-client.admin.472467.log.gz 2023-10-08T13:45:16.120 INFO:teuthology.orchestra.run.smithi032.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.119077.log.gz 2023-10-08T13:45:16.120 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.402509.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121956.log 2023-10-08T13:45:16.120 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184717.log 2023-10-08T13:45:16.121 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.164685.log: /var/log/ceph/ceph-client.admin.121956.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44296.log 2023-10-08T13:45:16.121 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.184717.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.347875.log 2023-10-08T13:45:16.121 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.198303.log 2023-10-08T13:45:16.121 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.44296.log: /var/log/ceph/ceph-client.admin.347875.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.389486.log 2023-10-08T13:45:16.121 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190192.log 2023-10-08T13:45:16.121 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.198303.log: /var/log/ceph/ceph-client.admin.389486.log: 78.5% -- replaced with /var/log/ceph/ceph-client.admin.171557.log.gz 2023-10-08T13:45:16.121 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101625.log 2023-10-08T13:45:16.124 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.190192.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.434789.log 2023-10-08T13:45:16.124 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.101625.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.357119.log 2023-10-08T13:45:16.125 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180960.log 2023-10-08T13:45:16.125 INFO:teuthology.orchestra.run.smithi032.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.127422.log.gz 2023-10-08T13:45:16.125 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.434789.log: /var/log/ceph/ceph-client.admin.357119.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117788.log 2023-10-08T13:45:16.125 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.180960.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159546.log 2023-10-08T13:45:16.125 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.117788.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44356.log 2023-10-08T13:45:16.125 INFO:teuthology.orchestra.run.smithi032.stderr: 77.6% -- replaced with /var/log/ceph/ceph-client.admin.427891.log.gz 2023-10-08T13:45:16.125 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.159546.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.467803.log 2023-10-08T13:45:16.126 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188542.log 2023-10-08T13:45:16.126 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.44356.log: /var/log/ceph/ceph-client.admin.467803.log: 77.8% -- replaced with /var/log/ceph/ceph-client.admin.351049.log.gz 2023-10-08T13:45:16.127 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.199937.log 2023-10-08T13:45:16.127 INFO:teuthology.orchestra.run.smithi032.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.220145.log.gz 2023-10-08T13:45:16.127 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.188542.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83875.log 2023-10-08T13:45:16.127 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.199937.log: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.190192.log.gz 2023-10-08T13:45:16.127 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.274240.log 2023-10-08T13:45:16.128 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163401.log 2023-10-08T13:45:16.129 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.83875.log: /var/log/ceph/ceph-client.admin.274240.log: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.467803.log.gz 2023-10-08T13:45:16.129 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42071.log 2023-10-08T13:45:16.130 INFO:teuthology.orchestra.run.smithi032.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.394541.log.gz 2023-10-08T13:45:16.130 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.163401.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176494.log 2023-10-08T13:45:16.130 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.278288.log 2023-10-08T13:45:16.130 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.42071.log: /var/log/ceph/ceph-client.admin.176494.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.338232.log 2023-10-08T13:45:16.131 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.278288.log: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.273039.log.gz 2023-10-08T13:45:16.131 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188533.log 2023-10-08T13:45:16.132 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.338232.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91253.log 2023-10-08T13:45:16.132 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188533.log: /var/log/ceph/ceph-client.admin.237342.log 2023-10-08T13:45:16.133 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.400009.log 2023-10-08T13:45:16.133 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.91253.log: /var/log/ceph/ceph-client.admin.237342.log: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.102027.log.gz 2023-10-08T13:45:16.133 INFO:teuthology.orchestra.run.smithi032.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.100829.log.gz 2023-10-08T13:45:16.133 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.470759.log 2023-10-08T13:45:16.135 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126927.log 2023-10-08T13:45:16.135 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.400009.log: /var/log/ceph/ceph-client.admin.470759.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.466102.log 2023-10-08T13:45:16.135 INFO:teuthology.orchestra.run.smithi032.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.470759.log.gz 2023-10-08T13:45:16.135 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.126927.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192203.log 2023-10-08T13:45:16.135 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.430386.log 2023-10-08T13:45:16.137 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.466102.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.210074.log 2023-10-08T13:45:16.137 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.192203.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.340538.log 2023-10-08T13:45:16.137 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.430386.log: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.388604.log.gz 2023-10-08T13:45:16.137 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.210074.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119897.log 2023-10-08T13:45:16.138 INFO:teuthology.orchestra.run.smithi032.stderr: 79.5% -- replaced with /var/log/ceph/ceph-client.admin.320309.log.gz 2023-10-08T13:45:16.138 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.376430.log 2023-10-08T13:45:16.138 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.340538.log: /var/log/ceph/ceph-client.admin.119897.log: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.411231.log.gz 2023-10-08T13:45:16.139 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2023-10-08T13:45:16.139 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.376430.log: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.466102.log.gz 2023-10-08T13:45:16.140 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.400420.log 2023-10-08T13:45:16.140 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.282340.log 2023-10-08T13:45:16.141 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-mon.a.log: /var/log/ceph/ceph-client.admin.400420.log: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.421208.log.gz 2023-10-08T13:45:16.141 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130526.log 2023-10-08T13:45:16.141 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.282340.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.423228.log 2023-10-08T13:45:16.142 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.130526.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.281528.log 2023-10-08T13:45:16.143 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.423228.log: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.199937.log.gz 2023-10-08T13:45:16.143 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.422407.log 2023-10-08T13:45:16.144 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.222588.log 2023-10-08T13:45:16.144 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.281528.log: /var/log/ceph/ceph-client.admin.422407.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.298778.log 2023-10-08T13:45:16.145 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.364466.log 2023-10-08T13:45:16.145 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.222588.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.214530.log 2023-10-08T13:45:16.146 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.298778.log: 84.7% -- replaced with /var/log/ceph/ceph-client.admin.396268.log.gz 2023-10-08T13:45:16.146 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.364466.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.452144.log 2023-10-08T13:45:16.146 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.197486.log 2023-10-08T13:45:16.146 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.214530.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81705.log 2023-10-08T13:45:16.148 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.452144.log: /var/log/ceph/ceph-client.admin.197486.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43480.log 2023-10-08T13:45:16.148 INFO:teuthology.orchestra.run.smithi032.stderr: 77.6% -- replaced with /var/log/ceph/ceph-client.admin.274240.log.gz 2023-10-08T13:45:16.148 INFO:teuthology.orchestra.run.smithi032.stderr: 80.1% -- replaced with /var/log/ceph/ceph-client.admin.452144.log.gz 2023-10-08T13:45:16.148 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185932.log 2023-10-08T13:45:16.148 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.81705.log: /var/log/ceph/ceph-client.admin.43480.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106884.log 2023-10-08T13:45:16.149 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.185932.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128765.log 2023-10-08T13:45:16.150 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.464414.log 2023-10-08T13:45:16.150 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.106884.log: /var/log/ceph/ceph-client.admin.128765.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43972.log 2023-10-08T13:45:16.150 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.464414.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130958.log 2023-10-08T13:45:16.151 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.43972.log: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.464414.log.gz 2023-10-08T13:45:16.151 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.360371.log 2023-10-08T13:45:16.151 INFO:teuthology.orchestra.run.smithi032.stderr: 77.7% -- replaced with /var/log/ceph/ceph-client.admin.293859.log.gz 2023-10-08T13:45:16.151 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.130958.log: 91.6% -- replaced with /var/log/ceph/ceph-client.admin.317469.log.gz 2023-10-08T13:45:16.152 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.436305.log 2023-10-08T13:45:16.152 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153230.log 2023-10-08T13:45:16.152 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.360371.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.439240.log 2023-10-08T13:45:16.153 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.436305.log: /var/log/ceph/ceph-client.admin.153230.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177289.log 2023-10-08T13:45:16.154 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.439240.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.357110.log 2023-10-08T13:45:16.155 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177691.log 2023-10-08T13:45:16.155 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.177289.log: 78.2% -- replaced with /var/log/ceph/ceph-client.admin.190996.log.gz 2023-10-08T13:45:16.155 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.357110.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.352998.log 2023-10-08T13:45:16.156 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.177691.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162966.log 2023-10-08T13:45:16.156 INFO:teuthology.orchestra.run.smithi032.stderr: 78.9% -- replaced with /var/log/ceph/ceph-client.admin.176485.log.gz 2023-10-08T13:45:16.157 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.352998.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.348339.log 2023-10-08T13:45:16.157 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.342577.log 2023-10-08T13:45:16.158 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.162966.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.246262.log 2023-10-08T13:45:16.158 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.348339.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.428778.log 2023-10-08T13:45:16.159 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.342577.log: /var/log/ceph/ceph-client.admin.246262.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41503.log 2023-10-08T13:45:16.159 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.428778.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.247062.log 2023-10-08T13:45:16.160 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.386152.log 2023-10-08T13:45:16.160 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.41503.log: /var/log/ceph/ceph-client.admin.247062.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.369757.log 2023-10-08T13:45:16.161 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.315285.log 2023-10-08T13:45:16.161 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.386152.log: /var/log/ceph/ceph-client.admin.369757.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.342170.log 2023-10-08T13:45:16.162 INFO:teuthology.orchestra.run.smithi040.stderr: 93.6% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-10-08T13:45:16.163 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.315285.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86508.log 2023-10-08T13:45:16.163 INFO:teuthology.orchestra.run.smithi032.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.389486.log.gz 2023-10-08T13:45:16.163 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.342170.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.232015.log 2023-10-08T13:45:16.163 INFO:teuthology.orchestra.run.smithi032.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.400009.log.gz 2023-10-08T13:45:16.163 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 /var/log/ceph/ceph-client.admin.86508.log: --verbose -- /var/log/ceph/ceph-client.admin.377864.log 2023-10-08T13:45:16.165 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.232015.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.459231.log 2023-10-08T13:45:16.165 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.377864.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.235701.log 2023-10-08T13:45:16.165 INFO:teuthology.orchestra.run.smithi032.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.152423.log.gz 2023-10-08T13:45:16.165 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.459231.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.209198.log 2023-10-08T13:45:16.165 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.235701.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.227050.log 2023-10-08T13:45:16.166 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.209198.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.446278.log 2023-10-08T13:45:16.166 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.227050.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.205681.log 2023-10-08T13:45:16.167 INFO:teuthology.orchestra.run.smithi032.stderr:gzip /var/log/ceph/ceph-client.admin.446278.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.460253.log 2023-10-08T13:45:16.168 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.222172.log 2023-10-08T13:45:16.168 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.205681.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40065.log 2023-10-08T13:45:16.168 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.460253.log: /var/log/ceph/ceph-client.admin.222172.log: 79.8% -- replaced with /var/log/ceph/ceph-client.admin.460253.log.gz 2023-10-08T13:45:16.168 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.201134.log 2023-10-08T13:45:16.169 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.40065.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.365692.log 2023-10-08T13:45:16.170 INFO:teuthology.orchestra.run.smithi032.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.198303.log.gz 2023-10-08T13:45:16.170 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.201134.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.275868.log 2023-10-08T13:45:16.170 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.365692.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.208804.log 2023-10-08T13:45:16.171 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.275868.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41584.log 2023-10-08T13:45:16.171 INFO:teuthology.orchestra.run.smithi032.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.188533.log.gz 2023-10-08T13:45:16.171 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.208804.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.235274.log 2023-10-08T13:45:16.172 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.41584.log: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.188542.log.gz 2023-10-08T13:45:16.172 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.307299.log 2023-10-08T13:45:16.173 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.235274.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.356299.log 2023-10-08T13:45:16.174 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.307299.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153645.log 2023-10-08T13:45:16.175 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.356299.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.352989.log 2023-10-08T13:45:16.175 INFO:teuthology.orchestra.run.smithi032.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.184717.log.gz 2023-10-08T13:45:16.175 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.153645.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40232.log 2023-10-08T13:45:16.176 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.352989.log: 78.2% -- replaced with /var/log/ceph/ceph-client.admin.185923.log.gz 2023-10-08T13:45:16.176 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43068.log 2023-10-08T13:45:16.177 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.200331.log 2023-10-08T13:45:16.184 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.40232.log: /var/log/ceph/ceph-client.admin.43068.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.232815.log 2023-10-08T13:45:16.184 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.200331.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.419926.log 2023-10-08T13:45:16.185 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.232815.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.367712.log 2023-10-08T13:45:16.185 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.419926.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42517.log 2023-10-08T13:45:16.185 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.367712.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.418708.log 2023-10-08T13:45:16.185 INFO:teuthology.orchestra.run.smithi032.stderr: 84.4% -- replaced with /var/log/ceph/ceph-client.admin.233218.log.gz 2023-10-08T13:45:16.186 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.42517.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122363.log 2023-10-08T13:45:16.186 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.363229.log 2023-10-08T13:45:16.186 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.418708.log: /var/log/ceph/ceph-client.admin.122363.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.212460.log 2023-10-08T13:45:16.186 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.394935.log 2023-10-08T13:45:16.187 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.363229.log: /var/log/ceph/ceph-client.admin.212460.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113208.log 2023-10-08T13:45:16.187 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.394935.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.440026.log 2023-10-08T13:45:16.187 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.113208.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192212.log 2023-10-08T13:45:16.188 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.350800.log 2023-10-08T13:45:16.188 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.440026.log: gzip -5 --verbose /var/log/ceph/ceph-client.admin.192212.log: -- /var/log/ceph/ceph-client.admin.472910.log 2023-10-08T13:45:16.188 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.350800.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.202806.log 2023-10-08T13:45:16.205 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.472910.log: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.338232.log.gz 2023-10-08T13:45:16.205 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.279906.log 2023-10-08T13:45:16.206 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.202806.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162957.log 2023-10-08T13:45:16.206 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.339946.log 2023-10-08T13:45:16.206 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.279906.log: /var/log/ceph/ceph-client.admin.162957.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.378257.log 2023-10-08T13:45:16.206 INFO:teuthology.orchestra.run.smithi032.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.40261.log.gz 2023-10-08T13:45:16.210 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.339946.log: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.472910.log.gz 2023-10-08T13:45:16.210 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.417027.log 2023-10-08T13:45:16.210 INFO:teuthology.orchestra.run.smithi032.stderr: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.212032.log.gz 2023-10-08T13:45:16.211 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.378257.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.439230.log 2023-10-08T13:45:16.211 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.444670.log 2023-10-08T13:45:16.211 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.417027.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.339076.log 2023-10-08T13:45:16.211 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.439230.log: /var/log/ceph/ceph-client.admin.444670.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160757.log 2023-10-08T13:45:16.212 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.339076.log: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.227050.log.gz 2023-10-08T13:45:16.212 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181822.log 2023-10-08T13:45:16.212 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.160757.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.195281.log 2023-10-08T13:45:16.212 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.181822.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.277890.log 2023-10-08T13:45:16.213 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.195281.log: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.430789.log.gz 2023-10-08T13:45:16.213 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108185.log 2023-10-08T13:45:16.213 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93725.log 2023-10-08T13:45:16.213 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.277890.log: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.222172.log.gz 2023-10-08T13:45:16.214 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.108185.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.475901.log 2023-10-08T13:45:16.214 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165951.log 2023-10-08T13:45:16.214 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.93725.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.435517.log 2023-10-08T13:45:16.215 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.475901.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.369748.log 2023-10-08T13:45:16.215 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.165951.log: 77.6% -- replaced with /var/log/ceph/ceph-client.admin.224597.log.gz 2023-10-08T13:45:16.215 INFO:teuthology.orchestra.run.smithi032.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.475901.log.gz 2023-10-08T13:45:16.215 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.435517.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.412045.log 2023-10-08T13:45:16.216 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.369748.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.474239.log 2023-10-08T13:45:16.216 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.412045.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.471618.log 2023-10-08T13:45:16.216 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148651.log 2023-10-08T13:45:16.217 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.474239.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109474.log 2023-10-08T13:45:16.217 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.471618.log: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.289428.log.gz 2023-10-08T13:45:16.217 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.148651.log: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.474239.log.gz 2023-10-08T13:45:16.217 INFO:teuthology.orchestra.run.smithi032.stderr: 77.9%gzip -- replaced with /var/log/ceph/ceph-client.admin.278288.log.gz 2023-10-08T13:45:16.218 INFO:teuthology.orchestra.run.smithi032.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.121554.log 2023-10-08T13:45:16.218 INFO:teuthology.orchestra.run.smithi032.stderr:gzip /var/log/ceph/ceph-client.admin.109474.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.423627.log 2023-10-08T13:45:16.218 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.121554.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.317896.log 2023-10-08T13:45:16.218 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.423627.log: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.357119.log.gz 2023-10-08T13:45:16.219 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.307735.log 2023-10-08T13:45:16.219 INFO:teuthology.orchestra.run.smithi032.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.237342.log.gz 2023-10-08T13:45:16.219 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.317896.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.394944.log 2023-10-08T13:45:16.220 INFO:teuthology.orchestra.run.smithi032.stderr: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.471618.log.gz 2023-10-08T13:45:16.220 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 /var/log/ceph/ceph-client.admin.307735.log: --verbose -- /var/log/ceph/ceph-client.admin.362413.log 2023-10-08T13:45:16.220 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.472034.log 2023-10-08T13:45:16.220 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.394944.log: /var/log/ceph/ceph-client.admin.362413.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.234030.log 2023-10-08T13:45:16.220 INFO:teuthology.orchestra.run.smithi032.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.347875.log.gz 2023-10-08T13:45:16.233 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.472034.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118678.log 2023-10-08T13:45:16.233 INFO:teuthology.orchestra.run.smithi032.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.472034.log.gz 2023-10-08T13:45:16.233 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.234030.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.214118.log 2023-10-08T13:45:16.233 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.118678.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43262.log 2023-10-08T13:45:16.234 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.214118.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193530.log 2023-10-08T13:45:16.234 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.43262.log: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.275868.log.gz 2023-10-08T13:45:16.234 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.406672.log 2023-10-08T13:45:16.234 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.193530.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182243.log 2023-10-08T13:45:16.234 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.406672.log: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.176494.log.gz 2023-10-08T13:45:16.234 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83884.log 2023-10-08T13:45:16.234 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.458092.log 2023-10-08T13:45:16.235 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.182243.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.440035.log 2023-10-08T13:45:16.235 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.83884.log: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.104452.log.gz 2023-10-08T13:45:16.235 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43999.log 2023-10-08T13:45:16.235 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.458092.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169843.log 2023-10-08T13:45:16.235 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.440035.log: /var/log/ceph/ceph-client.admin.43999.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.346570.log 2023-10-08T13:45:16.235 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.244611.log 2023-10-08T13:45:16.235 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.169843.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.376430.log.gz 2023-10-08T13:45:16.235 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41746.log 2023-10-08T13:45:16.236 INFO:teuthology.orchestra.run.smithi032.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.458092.log.gz 2023-10-08T13:45:16.236 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.346570.log: /var/log/ceph/ceph-client.admin.244611.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.421199.log 2023-10-08T13:45:16.236 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.41746.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.295535.log 2023-10-08T13:45:16.236 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.403920.log 2023-10-08T13:45:16.236 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.421199.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.316158.log 2023-10-08T13:45:16.236 INFO:teuthology.orchestra.run.smithi032.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.177289.log.gz 2023-10-08T13:45:16.236 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.295535.log: /var/log/ceph/ceph-client.admin.403920.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.199535.log 2023-10-08T13:45:16.236 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.316158.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93303.log 2023-10-08T13:45:16.237 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117779.log 2023-10-08T13:45:16.237 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.199535.log: /var/log/ceph/ceph-client.admin.93303.log: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.208804.log.gz 2023-10-08T13:45:16.237 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104048.log 2023-10-08T13:45:16.237 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.117779.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.469495.log 2023-10-08T13:45:16.237 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.104048.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.397088.log 2023-10-08T13:45:16.237 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.469495.log: 78.1% -- replaced with /var/log/ceph/ceph-client.admin.469495.log.gz 2023-10-08T13:45:16.237 INFO:teuthology.orchestra.run.smithi032.stderr: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.182243.log.gz 2023-10-08T13:45:16.238 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.296341.log 2023-10-08T13:45:16.238 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.292242.log 2023-10-08T13:45:16.238 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.397088.log: /var/log/ceph/ceph-client.admin.296341.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.373536.log 2023-10-08T13:45:16.238 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.292242.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.286571.log 2023-10-08T13:45:16.238 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41260.log 2023-10-08T13:45:16.238 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.373536.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.475577.log 2023-10-08T13:45:16.238 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.286571.log: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.400420.log.gz 2023-10-08T13:45:16.238 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.41260.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177700.log 2023-10-08T13:45:16.239 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130115.log 2023-10-08T13:45:16.239 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.475577.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.313079.log 2023-10-08T13:45:16.239 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.177700.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.475577.log.gz 2023-10-08T13:45:16.239 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.130115.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151519.log 2023-10-08T13:45:16.239 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.313079.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42328.log 2023-10-08T13:45:16.239 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.432463.log 2023-10-08T13:45:16.239 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.151519.log: /var/log/ceph/ceph-client.admin.42328.log: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.402509.log.gz 2023-10-08T13:45:16.239 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2023-10-08T13:45:16.240 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.432463.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98388.log 2023-10-08T13:45:16.240 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.308151.log 2023-10-08T13:45:16.240 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-mds.c.log: /var/log/ceph/ceph-client.admin.98388.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44161.log 2023-10-08T13:45:16.240 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123721.log 2023-10-08T13:45:16.240 INFO:teuthology.orchestra.run.smithi032.stderr: 78.8% -- replaced with /var/log/ceph/ceph-client.admin.282340.log.gz 2023-10-08T13:45:16.240 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.44161.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.445474.log 2023-10-08T13:45:16.240 INFO:teuthology.orchestra.run.smithi032.stderr:gzip /var/log/ceph/ceph-client.admin.308151.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.43041.log 2023-10-08T13:45:16.241 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.123721.log: /var/log/ceph/ceph-client.admin.445474.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.292233.log 2023-10-08T13:45:16.241 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.43041.log: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.298778.log.gz 2023-10-08T13:45:16.241 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.277080.log 2023-10-08T13:45:16.241 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.292233.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102429.log 2023-10-08T13:45:16.241 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.359564.log 2023-10-08T13:45:16.241 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.277080.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40477.log 2023-10-08T13:45:16.241 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.102429.log: /var/log/ceph/ceph-client.admin.359564.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44942.log 2023-10-08T13:45:16.241 INFO:teuthology.orchestra.run.smithi032.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.352989.log.gz 2023-10-08T13:45:16.242 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.410655.log 2023-10-08T13:45:16.242 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.40477.log: /var/log/ceph/ceph-client.admin.44942.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166383.log 2023-10-08T13:45:16.242 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.410655.log: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.352998.log.gz 2023-10-08T13:45:16.242 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.417495.log 2023-10-08T13:45:16.251 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.166383.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.386960.log 2023-10-08T13:45:16.252 INFO:teuthology.orchestra.run.smithi032.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.356299.log.gz 2023-10-08T13:45:16.252 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.417495.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.359162.log 2023-10-08T13:45:16.252 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.386960.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.285776.log 2023-10-08T13:45:16.252 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.359162.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42301.log 2023-10-08T13:45:16.252 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.285776.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.413714.log 2023-10-08T13:45:16.252 INFO:teuthology.orchestra.run.smithi032.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.340538.log.gz 2023-10-08T13:45:16.252 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165117.log 2023-10-08T13:45:16.253 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.42301.log: /var/log/ceph/ceph-client.admin.413714.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.475793.log 2023-10-08T13:45:16.253 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.165117.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.313088.log 2023-10-08T13:45:16.253 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40610.log 2023-10-08T13:45:16.253 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.475793.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.461071.log 2023-10-08T13:45:16.253 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.313088.log: /var/log/ceph/ceph-client.admin.40610.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.475793.log.gz 2023-10-08T13:45:16.253 INFO:teuthology.orchestra.run.smithi032.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.412045.log.gz 2023-10-08T13:45:16.253 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.210065.log 2023-10-08T13:45:16.253 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.313958.log 2023-10-08T13:45:16.254 INFO:teuthology.orchestra.run.smithi032.stderr: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.421199.log.gz 2023-10-08T13:45:16.254 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.461071.log: /var/log/ceph/ceph-client.admin.210065.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41530.log 2023-10-08T13:45:16.254 INFO:teuthology.orchestra.run.smithi032.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.461071.log.gz 2023-10-08T13:45:16.254 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39972.log 2023-10-08T13:45:16.254 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.313958.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.236113.log 2023-10-08T13:45:16.254 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.41530.log: gzip /var/log/ceph/ceph-client.admin.39972.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.42436.log 2023-10-08T13:45:16.254 INFO:teuthology.orchestra.run.smithi032.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.423627.log.gz 2023-10-08T13:45:16.255 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43453.log 2023-10-08T13:45:16.255 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.236113.log: /var/log/ceph/ceph-client.admin.42436.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.225420.log 2023-10-08T13:45:16.255 INFO:teuthology.orchestra.run.smithi032.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.423228.log.gz 2023-10-08T13:45:16.255 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.426530.log 2023-10-08T13:45:16.255 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.43453.log: /var/log/ceph/ceph-client.admin.225420.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42709.log 2023-10-08T13:45:16.255 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.426530.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.362404.log 2023-10-08T13:45:16.255 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.372716.log 2023-10-08T13:45:16.255 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.42709.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.200742.log 2023-10-08T13:45:16.256 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.362404.log: /var/log/ceph/ceph-client.admin.372716.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.237351.log 2023-10-08T13:45:16.256 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.293868.log 2023-10-08T13:45:16.256 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.200742.log: /var/log/ceph/ceph-client.admin.237351.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.408854.log 2023-10-08T13:45:16.256 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.417897.log 2023-10-08T13:45:16.256 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.293868.log: /var/log/ceph/ceph-client.admin.408854.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43235.log 2023-10-08T13:45:16.256 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44861.log 2023-10-08T13:45:16.256 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.417897.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.450734.log 2023-10-08T13:45:16.256 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.43235.log: /var/log/ceph/ceph-client.admin.44861.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.422416.log 2023-10-08T13:45:16.257 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.450734.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.312275.log 78.4% 2023-10-08T13:45:16.257 INFO:teuthology.orchestra.run.smithi032.stderr: -- replaced with /var/log/ceph/ceph-client.admin.126927.log.gz 2023-10-08T13:45:16.257 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45050.log 2023-10-08T13:45:16.257 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.422416.log: /var/log/ceph/ceph-client.admin.312275.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.444277.log 2023-10-08T13:45:16.257 INFO:teuthology.orchestra.run.smithi032.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.128765.log.gz 2023-10-08T13:45:16.257 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.45050.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.395337.log 2023-10-08T13:45:16.262 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103636.log 2023-10-08T13:45:16.262 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.444277.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.316570.log 2023-10-08T13:45:16.262 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.395337.log: /var/log/ceph/ceph-client.admin.103636.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.334847.log 2023-10-08T13:45:16.263 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.316570.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43702.log 2023-10-08T13:45:16.263 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42817.log 2023-10-08T13:45:16.263 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.334847.log: gzip /var/log/ceph/ceph-client.admin.43702.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.475285.log 2023-10-08T13:45:16.263 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.218452.log 2023-10-08T13:45:16.263 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.42817.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44753.log 2023-10-08T13:45:16.263 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.475285.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158394.log 88.3% 2023-10-08T13:45:16.263 INFO:teuthology.orchestra.run.smithi032.stderr: -- replaced with /var/log/ceph/ceph-client.admin.475285.log.gz 2023-10-08T13:45:16.263 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.218452.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.399200.log 2023-10-08T13:45:16.264 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.44753.log: /var/log/ceph/ceph-client.admin.158394.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168972.log 2023-10-08T13:45:16.264 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.399200.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96688.log 2023-10-08T13:45:16.264 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.168972.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.351154.log 2023-10-08T13:45:16.264 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.96688.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.349587.log 2023-10-08T13:45:16.264 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.293037.log 2023-10-08T13:45:16.264 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.351154.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40093.log 2023-10-08T13:45:16.264 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159555.log 2023-10-08T13:45:16.265 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.293037.log: /var/log/ceph/ceph-client.admin.349587.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.427471.log 2023-10-08T13:45:16.265 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.40093.log: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.246262.log.gz 2023-10-08T13:45:16.265 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167254.log 2023-10-08T13:45:16.267 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.159555.log: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.444670.log.gz 2023-10-08T13:45:16.267 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.427471.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.236911.log 2023-10-08T13:45:16.268 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.167254.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149867.log 2023-10-08T13:45:16.268 INFO:teuthology.orchestra.run.smithi032.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.210065.log.gz 2023-10-08T13:45:16.268 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.236911.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.462355.log 2023-10-08T13:45:16.268 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.149867.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.244121.log 2023-10-08T13:45:16.268 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.462355.log: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.462355.log.gz 2023-10-08T13:45:16.268 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.355451.log 2023-10-08T13:45:16.268 INFO:teuthology.orchestra.run.smithi032.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.202806.log.gz 2023-10-08T13:45:16.269 INFO:teuthology.orchestra.run.smithi032.stderr:gzip /var/log/ceph/ceph-client.admin.244121.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.404856.log 2023-10-08T13:45:16.269 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.355451.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.377855.log 2023-10-08T13:45:16.270 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.404856.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118669.log 2023-10-08T13:45:16.271 INFO:teuthology.orchestra.run.smithi032.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.360371.log.gz 2023-10-08T13:45:16.271 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.470354.log 2023-10-08T13:45:16.271 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.377855.log: /var/log/ceph/ceph-client.admin.118669.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.311883.log 2023-10-08T13:45:16.271 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.470354.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41248.log 2023-10-08T13:45:16.271 INFO:teuthology.orchestra.run.smithi032.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.362413.log.gz 2023-10-08T13:45:16.271 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.311883.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.297571.log 2023-10-08T13:45:16.272 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.41248.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.357961.log 2023-10-08T13:45:16.272 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 /var/log/ceph/ceph-client.admin.297571.log: --verbose -- /var/log/ceph/ceph-mds.a.log 2023-10-08T13:45:16.273 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150276.log 2023-10-08T13:45:16.273 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.357961.log: 90.5%/var/log/ceph/ceph-mds.a.log: -- replaced with /var/log/ceph/ceph-client.admin.348339.log.gz 2023-10-08T13:45:16.273 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.295938.log 2023-10-08T13:45:16.274 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.150276.log: 94.5% -- replaced with /var/log/ceph/ceph-client.admin.470354.log.gz 2023-10-08T13:45:16.274 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.288615.log 2023-10-08T13:45:16.274 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.295938.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.417888.log 2023-10-08T13:45:16.275 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.476009.log 2023-10-08T13:45:16.275 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.288615.log: /var/log/ceph/ceph-client.admin.417888.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.318363.log 2023-10-08T13:45:16.276 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.476009.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.476009.log.gz 2023-10-08T13:45:16.276 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.277487.log 2023-10-08T13:45:16.277 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.336133.log 2023-10-08T13:45:16.277 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.318363.log: /var/log/ceph/ceph-client.admin.277487.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.475411.log 2023-10-08T13:45:16.278 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.336133.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95072.log 2023-10-08T13:45:16.278 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.475411.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.39972.log.gz 2023-10-08T13:45:16.279 INFO:teuthology.orchestra.run.smithi032.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.475411.log.gz 2023-10-08T13:45:16.279 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.280715.log 2023-10-08T13:45:16.279 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191407.log 2023-10-08T13:45:16.280 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.95072.log: /var/log/ceph/ceph-client.admin.280715.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79485.log 2023-10-08T13:45:16.280 INFO:teuthology.orchestra.run.smithi032.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.40477.log.gz 2023-10-08T13:45:16.281 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.191407.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41665.log 2023-10-08T13:45:16.281 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.202394.log 2023-10-08T13:45:16.282 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.79485.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.391672.log 2023-10-08T13:45:16.282 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.41665.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40825.log 2023-10-08T13:45:16.282 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.202394.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.454241.log 2023-10-08T13:45:16.283 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.391672.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.286973.log 2023-10-08T13:45:16.283 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.40825.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158929.log 2023-10-08T13:45:16.283 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.454241.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.213307.log 2023-10-08T13:45:16.284 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.286973.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175287.log 2023-10-08T13:45:16.284 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.158929.log: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.367712.log.gz 2023-10-08T13:45:16.284 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.458501.log /var/log/ceph/ceph-client.admin.213307.log: 2023-10-08T13:45:16.284 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.175287.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.400822.log 2023-10-08T13:45:16.285 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.458501.log: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.369757.log.gz 2023-10-08T13:45:16.285 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.364054.log 2023-10-08T13:45:16.286 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.400822.log: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.458501.log.gz 2023-10-08T13:45:16.286 INFO:teuthology.orchestra.run.smithi032.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.admin.454241.log.gz 2023-10-08T13:45:16.287 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43370.log 2023-10-08T13:45:16.287 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.364054.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.344208.log 2023-10-08T13:45:16.287 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.372725.log 2023-10-08T13:45:16.287 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.43370.log: 84.8% -- replaced with /var/log/ceph/ceph-client.admin.164685.log.gz 2023-10-08T13:45:16.287 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.344208.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.273030.log 2023-10-08T13:45:16.289 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.308554.log 2023-10-08T13:45:16.289 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.372725.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.394139.log 2023-10-08T13:45:16.289 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.273030.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.353398.log 2023-10-08T13:45:16.289 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.308554.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151080.log 2023-10-08T13:45:16.289 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.394139.log: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.101625.log.gz 2023-10-08T13:45:16.289 INFO:teuthology.orchestra.run.smithi032.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43041.log.gz 2023-10-08T13:45:16.291 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44666.log 2023-10-08T13:45:16.291 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.353398.log: /var/log/ceph/ceph-client.admin.151080.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.305215.log 2023-10-08T13:45:16.291 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.44666.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166814.log 2023-10-08T13:45:16.291 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.419524.log 2023-10-08T13:45:16.293 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.305215.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.224203.log 2023-10-08T13:45:16.293 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.166814.log: /var/log/ceph/ceph-client.admin.419524.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.43972.log.gz 2023-10-08T13:45:16.293 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82134.log 2023-10-08T13:45:16.293 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157506.log 2023-10-08T13:45:16.293 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.224203.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.453436.log 2023-10-08T13:45:16.294 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.82134.log: /var/log/ceph/ceph-client.admin.157506.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.405267.log 2023-10-08T13:45:16.294 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183522.log 2023-10-08T13:45:16.294 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.453436.log: 77.5%/var/log/ceph/ceph-client.admin.405267.log: -- replaced with /var/log/ceph/ceph-client.admin.130115.log.gz 2023-10-08T13:45:16.295 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.443875.log 2023-10-08T13:45:16.295 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.183522.log: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.453436.log.gz 2023-10-08T13:45:16.295 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.277071.log 2023-10-08T13:45:16.296 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.443875.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.297158.log 2023-10-08T13:45:16.296 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.277071.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.307726.log 2023-10-08T13:45:16.297 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.297158.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.368542.log 2023-10-08T13:45:16.298 INFO:teuthology.orchestra.run.smithi032.stderr:gzip /var/log/ceph/ceph-client.admin.307726.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.414529.log 2023-10-08T13:45:16.298 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.368542.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46131.log 2023-10-08T13:45:16.299 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.320780.log 2023-10-08T13:45:16.300 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.414529.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.375173.log 2023-10-08T13:45:16.300 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.46131.log: /var/log/ceph/ceph-client.admin.320780.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.355897.log 2023-10-08T13:45:16.300 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.278297.log 2023-10-08T13:45:16.301 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.375173.log: /var/log/ceph/ceph-client.admin.355897.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118267.log 2023-10-08T13:45:16.301 INFO:teuthology.orchestra.run.smithi032.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.199535.log.gz 2023-10-08T13:45:16.301 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.278297.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.390825.log 2023-10-08T13:45:16.302 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.375585.log 2023-10-08T13:45:16.302 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.118267.log: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.336133.log.gz 2023-10-08T13:45:16.302 INFO:teuthology.orchestra.run.smithi032.stderr: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.181822.log.gz 2023-10-08T13:45:16.303 INFO:teuthology.orchestra.run.smithi032.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.200742.log.gz 2023-10-08T13:45:16.303 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose /var/log/ceph/ceph-client.admin.390825.log: -- /var/log/ceph/ceph-client.admin.154067.log 2023-10-08T13:45:16.304 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.375585.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.234843.log 2023-10-08T13:45:16.304 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.154067.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.351145.log 2023-10-08T13:45:16.304 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.234843.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.463570.log 2023-10-08T13:45:16.305 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.351145.log: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.285776.log.gz 2023-10-08T13:45:16.306 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78893.log 2023-10-08T13:45:16.306 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.463570.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.341744.log 2023-10-08T13:45:16.306 INFO:teuthology.orchestra.run.smithi032.stderr: 84.3% -- replaced with /var/log/ceph/ceph-client.admin.463570.log.gz 2023-10-08T13:45:16.307 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.78893.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.311481.log 2023-10-08T13:45:16.308 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.341744.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40824.log 2023-10-08T13:45:16.308 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.475040.log 2023-10-08T13:45:16.308 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.311481.log: /var/log/ceph/ceph-client.admin.40824.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.425274.log 2023-10-08T13:45:16.309 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.475040.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.475040.log.gz 2023-10-08T13:45:16.309 INFO:teuthology.orchestra.run.smithi032.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.41530.log.gz 2023-10-08T13:45:16.309 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.429171.log 2023-10-08T13:45:16.309 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.425274.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.208392.log 2023-10-08T13:45:16.311 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.429171.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127869.log 2023-10-08T13:45:16.311 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.208392.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166823.log 2023-10-08T13:45:16.311 INFO:teuthology.orchestra.run.smithi032.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42071.log.gz 2023-10-08T13:45:16.311 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127869.log: /var/log/ceph/ceph-client.admin.318860.log 2023-10-08T13:45:16.312 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.166823.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42627.log 2023-10-08T13:45:16.313 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.318860.log: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.280715.log.gz 2023-10-08T13:45:16.313 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185119.log 2023-10-08T13:45:16.313 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.42627.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.426129.log 2023-10-08T13:45:16.313 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.185119.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.221361.log 2023-10-08T13:45:16.314 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.474986.log 2023-10-08T13:45:16.315 INFO:teuthology.orchestra.run.smithi032.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44080.log.gz 2023-10-08T13:45:16.315 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.426129.log: /var/log/ceph/ceph-client.admin.221361.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.203613.log 2023-10-08T13:45:16.315 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.474986.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.474986.log.gz 2023-10-08T13:45:16.315 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.425283.log 2023-10-08T13:45:16.316 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.42024.log 2023-10-08T13:45:16.316 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.203613.log: /var/log/ceph/ceph-client.admin.425283.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.475766.log 2023-10-08T13:45:16.316 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.0.42024.log: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.428778.log.gz 2023-10-08T13:45:16.317 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.389945.log 2023-10-08T13:45:16.318 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.475766.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.475766.log.gz 2023-10-08T13:45:16.318 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.405842.log 2023-10-08T13:45:16.318 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.389945.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42959.log 2023-10-08T13:45:16.318 INFO:teuthology.orchestra.run.smithi032.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.430386.log.gz 2023-10-08T13:45:16.320 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.405842.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.351194.log 2023-10-08T13:45:16.320 INFO:teuthology.orchestra.run.smithi032.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.236911.log.gz 2023-10-08T13:45:16.320 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.42959.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.427900.log 2023-10-08T13:45:16.320 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.351194.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165960.log 2023-10-08T13:45:16.321 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.427900.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.424445.log 2023-10-08T13:45:16.321 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.165960.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.432454.log 2023-10-08T13:45:16.322 INFO:teuthology.orchestra.run.smithi032.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.286973.log.gz 2023-10-08T13:45:16.322 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.424445.log: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.357110.log.gz 2023-10-08T13:45:16.322 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80302.log 2023-10-08T13:45:16.323 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.432454.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.475712.log 2023-10-08T13:45:16.323 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.80302.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170274.log 2023-10-08T13:45:16.324 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98797.log 2023-10-08T13:45:16.324 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.475712.log: /var/log/ceph/ceph-client.admin.170274.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.475712.log.gz 2023-10-08T13:45:16.324 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.281127.log 2023-10-08T13:45:16.325 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.244130.log 2023-10-08T13:45:16.325 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.98797.log: /var/log/ceph/ceph-client.admin.281127.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165528.log 2023-10-08T13:45:16.326 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122816.log 2023-10-08T13:45:16.326 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.244130.log: /var/log/ceph/ceph-client.admin.165528.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191810.log 2023-10-08T13:45:16.327 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129562.log 2023-10-08T13:45:16.328 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.122816.log: /var/log/ceph/ceph-client.admin.191810.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.287417.log 2023-10-08T13:45:16.328 INFO:teuthology.orchestra.run.smithi032.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.213307.log.gz 2023-10-08T13:45:16.328 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129562.log: /var/log/ceph/ceph-client.admin.42463.log 2023-10-08T13:45:16.329 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43316.log 2023-10-08T13:45:16.329 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.287417.log: /var/log/ceph/ceph-client.admin.42463.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.368953.log 2023-10-08T13:45:16.330 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.305224.log 2023-10-08T13:45:16.330 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.43316.log: /var/log/ceph/ceph-client.admin.368953.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149049.log 2023-10-08T13:45:16.330 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.437800.log 2023-10-08T13:45:16.331 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.305224.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.245846.log 2023-10-08T13:45:16.331 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.149049.log: /var/log/ceph/ceph-client.admin.437800.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.448289.log 2023-10-08T13:45:16.332 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.245846.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.366090.log 2023-10-08T13:45:16.333 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44215.log 2023-10-08T13:45:16.333 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.448289.log: /var/log/ceph/ceph-client.admin.366090.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40823.log 2023-10-08T13:45:16.333 INFO:teuthology.orchestra.run.smithi032.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.377864.log.gz 2023-10-08T13:45:16.333 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185530.log 2023-10-08T13:45:16.333 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.44215.log: /var/log/ceph/ceph-client.admin.40823.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40602.log 2023-10-08T13:45:16.335 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.351106.log 2023-10-08T13:45:16.335 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.185530.log: /var/log/ceph/ceph-client.admin.40602.log: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.278297.log.gz 2023-10-08T13:45:16.335 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.216844.log 2023-10-08T13:45:16.335 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.351106.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160363.log 2023-10-08T13:45:16.336 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.403461.log 2023-10-08T13:45:16.336 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.216844.log: /var/log/ceph/ceph-client.admin.160363.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94549.log 2023-10-08T13:45:16.337 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.403461.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.350398.log 2023-10-08T13:45:16.338 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.94549.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.441863.log 2023-10-08T13:45:16.338 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.350398.log: /var/log/ceph/ceph-client.admin.41045.log 2023-10-08T13:45:16.338 INFO:teuthology.orchestra.run.smithi032.stderr:gzip /var/log/ceph/ceph-client.admin.441863.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.424436.log 2023-10-08T13:45:16.338 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.41045.log: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.341744.log.gz 2023-10-08T13:45:16.340 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.364457.log 2023-10-08T13:45:16.340 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.424436.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.303354.log 2023-10-08T13:45:16.340 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.337390.log 2023-10-08T13:45:16.341 INFO:teuthology.orchestra.run.smithi032.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.192203.log.gz 2023-10-08T13:45:16.341 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.364457.log: /var/log/ceph/ceph-client.admin.303354.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175689.log 2023-10-08T13:45:16.341 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.363220.log 2023-10-08T13:45:16.341 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.337390.log: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.192212.log.gz 2023-10-08T13:45:16.341 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.175689.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.195731.log 2023-10-08T13:45:16.341 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.363220.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153221.log 2023-10-08T13:45:16.343 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.440819.log 2023-10-08T13:45:16.344 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.195731.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.311874.log 2023-10-08T13:45:16.344 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.153221.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.475258.log 2023-10-08T13:45:16.344 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.440819.log: /var/log/ceph/ceph-client.admin.311874.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.442257.log 2023-10-08T13:45:16.344 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.454672.log 2023-10-08T13:45:16.344 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.475258.log: /var/log/ceph/ceph-client.admin.442257.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.475258.log.gz 2023-10-08T13:45:16.344 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41638.log 2023-10-08T13:45:16.344 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.283251.log 2023-10-08T13:45:16.345 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.454672.log: /var/log/ceph/ceph-client.admin.41638.log: 78.6% -- replaced with /var/log/ceph/ceph-client.admin.454672.log.gz 2023-10-08T13:45:16.347 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.307290.log 2023-10-08T13:45:16.347 INFO:teuthology.orchestra.run.smithi032.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.162957.log.gz 2023-10-08T13:45:16.347 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.283251.log: gzip 90.5%-5 -- replaced with /var/log/ceph/ceph-client.admin.159555.log.gz--verbose 2023-10-08T13:45:16.347 INFO:teuthology.orchestra.run.smithi032.stderr:-- /var/log/ceph/ceph-client.admin.99614.log 2023-10-08T13:45:16.347 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.445885.log 2023-10-08T13:45:16.347 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.307290.log: /var/log/ceph/ceph-client.admin.99614.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.468220.log 2023-10-08T13:45:16.348 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.310249.log 2023-10-08T13:45:16.348 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.445885.log: /var/log/ceph/ceph-client.admin.468220.log: 79.4% -- replaced with /var/log/ceph/ceph-client.admin.121956.log.gz 2023-10-08T13:45:16.348 INFO:teuthology.orchestra.run.smithi032.stderr: 79.5% -- replaced with /var/log/ceph/ceph-client.admin.468220.log.gz 2023-10-08T13:45:16.348 INFO:teuthology.orchestra.run.smithi032.stderr:gzip 81.3%-5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.122816.log.gz-- 2023-10-08T13:45:16.348 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-mgr.y.log 2023-10-08T13:45:16.350 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.310249.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108176.log 2023-10-08T13:45:16.351 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-mgr.y.log: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.160757.log.gz 2023-10-08T13:45:16.351 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148248.log 2023-10-08T13:45:16.351 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.108176.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42790.log 2023-10-08T13:45:16.351 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.368114.log 2023-10-08T13:45:16.351 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.148248.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.357519.log 2023-10-08T13:45:16.351 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.42790.log: /var/log/ceph/ceph-client.admin.368114.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.195740.log 2023-10-08T13:45:16.351 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.369355.log 2023-10-08T13:45:16.352 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.357519.log: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.293037.log.gz 2023-10-08T13:45:16.352 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.195740.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.294726.log 2023-10-08T13:45:16.353 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.369355.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.388595.log 2023-10-08T13:45:16.354 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.294726.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.450320.log 2023-10-08T13:45:16.354 INFO:teuthology.orchestra.run.smithi032.stderr: 85.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.295938.log.gz-5 2023-10-08T13:45:16.354 INFO:teuthology.orchestra.run.smithi032.stderr:--verbose -- /var/log/ceph/ceph-client.admin.129159.log 2023-10-08T13:45:16.354 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.388595.log: /var/log/ceph/ceph-client.admin.450320.log: 78.4% -- replaced with /var/log/ceph/ceph-client.admin.297158.log.gz 2023-10-08T13:45:16.354 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.349578.log 2023-10-08T13:45:16.354 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44693.log 2023-10-08T13:45:16.356 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.129159.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.419121.log 2023-10-08T13:45:16.356 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.349578.log: 90.6% -- replaced with /var/log/ceph/ceph-client.0.42024.log.gz 2023-10-08T13:45:16.356 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.319839.log 2023-10-08T13:45:16.356 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.44693.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123285.log 2023-10-08T13:45:16.356 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.419121.log: /var/log/ceph/ceph-client.admin.319839.log: 84.3% -- replaced with /var/log/ceph/ceph-client.admin.375173.log.gz 2023-10-08T13:45:16.356 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105251.log 2023-10-08T13:45:16.357 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.123285.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.376014.log 2023-10-08T13:45:16.358 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.105251.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.208401.log 2023-10-08T13:45:16.358 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.376014.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.229189.log 2023-10-08T13:45:16.359 INFO:teuthology.orchestra.run.smithi032.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.373536.log.gz 2023-10-08T13:45:16.359 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.208401.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.304286.log 2023-10-08T13:45:16.359 INFO:teuthology.orchestra.run.smithi032.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.307290.log.gz 2023-10-08T13:45:16.359 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.229189.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41032.log 2023-10-08T13:45:16.359 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.304286.log: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.388595.log.gz 2023-10-08T13:45:16.359 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.207054.log 2023-10-08T13:45:16.361 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.41032.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.302909.log 2023-10-08T13:45:16.361 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.218041.log 2023-10-08T13:45:16.361 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.207054.log: /var/log/ceph/ceph-client.admin.302909.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.299590.log 2023-10-08T13:45:16.361 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191005.log 2023-10-08T13:45:16.362 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.218041.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.118678.log.gz 2023-10-08T13:45:16.362 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.299590.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.304277.log 2023-10-08T13:45:16.362 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.191005.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.441049.log 2023-10-08T13:45:16.363 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.304277.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.245452.log 2023-10-08T13:45:16.364 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.392922.log 2023-10-08T13:45:16.364 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.441049.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180529.log 2023-10-08T13:45:16.364 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.245452.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.426120.log 2023-10-08T13:45:16.364 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.392922.log: /var/log/ceph/ceph-client.admin.180529.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183080.log 2023-10-08T13:45:16.364 INFO:teuthology.orchestra.run.smithi032.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.129159.log.gz 2023-10-08T13:45:16.365 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.426120.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.319345.log 2023-10-08T13:45:16.366 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188140.log 2023-10-08T13:45:16.366 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.183080.log: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.185530.log.gz 2023-10-08T13:45:16.366 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.319345.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.456871.log 2023-10-08T13:45:16.366 INFO:teuthology.orchestra.run.smithi032.stderr: 77.5% -- replaced with /var/log/ceph/ceph-client.admin.404856.log.gz 2023-10-08T13:45:16.366 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.188140.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192615.log 2023-10-08T13:45:16.368 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.315739.log 2023-10-08T13:45:16.368 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.456871.log: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.350398.log.gz 2023-10-08T13:45:16.369 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.192615.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.466093.log 2023-10-08T13:45:16.369 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.315739.log: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.165117.log.gz 2023-10-08T13:45:16.369 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171998.log 2023-10-08T13:45:16.369 INFO:teuthology.orchestra.run.smithi032.stderr: 77.9% -- replaced with /var/log/ceph/ceph-client.admin.165951.log.gz 2023-10-08T13:45:16.369 INFO:teuthology.orchestra.run.smithi032.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.456871.log.gz 2023-10-08T13:45:16.369 INFO:teuthology.orchestra.run.smithi032.stderr: 78.5% -- replaced with /var/log/ceph/ceph-client.admin.166814.log.gz 2023-10-08T13:45:16.369 INFO:teuthology.orchestra.run.smithi032.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.166383.log.gz/var/log/ceph/ceph-client.admin.466093.log: 2023-10-08T13:45:16.370 INFO:teuthology.orchestra.run.smithi032.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.466093.log.gz 2023-10-08T13:45:16.370 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164253.log 2023-10-08T13:45:16.372 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.171998.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.375576.log 2023-10-08T13:45:16.372 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101223.log 2023-10-08T13:45:16.372 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.164253.log: 77.6% -- replaced with /var/log/ceph/ceph-client.admin.389945.log.gz 2023-10-08T13:45:16.372 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose /var/log/ceph/ceph-client.admin.375576.log: -- /var/log/ceph/ceph-client.admin.41692.log 2023-10-08T13:45:16.372 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.302101.log 2023-10-08T13:45:16.372 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.101223.log: /var/log/ceph/ceph-client.admin.41692.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.230808.log 2023-10-08T13:45:16.373 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.302101.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.407485.log 2023-10-08T13:45:16.373 INFO:teuthology.orchestra.run.smithi032.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.390825.log.gz 2023-10-08T13:45:16.373 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.230808.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.297973.log 2023-10-08T13:45:16.375 INFO:teuthology.orchestra.run.smithi032.stderr:gzip /var/log/ceph/ceph-client.admin.407485.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.82945.log 2023-10-08T13:45:16.375 INFO:teuthology.orchestra.run.smithi032.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.81705.log.gz 2023-10-08T13:45:16.375 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.297973.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84937.log 2023-10-08T13:45:16.375 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171989.log 2023-10-08T13:45:16.375 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.82945.log: 78.2%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.83875.log.gz--verbose 2023-10-08T13:45:16.376 INFO:teuthology.orchestra.run.smithi032.stderr:-- /var/log/ceph/ceph-client.admin.286982.log 2023-10-08T13:45:16.376 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.388171.log 2023-10-08T13:45:16.376 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.171989.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.302505.log 2023-10-08T13:45:16.376 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.286982.log: /var/log/ceph/ceph-client.admin.84937.log: /var/log/ceph/ceph-client.admin.388171.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.283675.log 2023-10-08T13:45:16.376 INFO:teuthology.orchestra.run.smithi032.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.86508.log.gz 2023-10-08T13:45:16.379 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.302505.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44475.log 2023-10-08T13:45:16.379 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.283675.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.426923.log 2023-10-08T13:45:16.379 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.44475.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.220561.log 2023-10-08T13:45:16.379 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.426923.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43426.log 2023-10-08T13:45:16.380 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.220561.log: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.442257.log.gz 2023-10-08T13:45:16.380 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.283242.log 2023-10-08T13:45:16.380 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79476.log 2023-10-08T13:45:16.380 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.43426.log: gzip -5 --verbose /var/log/ceph/ceph-client.admin.283242.log: -- /var/log/ceph/ceph-client.admin.111115.log 2023-10-08T13:45:16.380 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.79476.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86912.log 2023-10-08T13:45:16.380 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.449505.log 2023-10-08T13:45:16.380 INFO:teuthology.orchestra.run.smithi032.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.364457.log.gz 2023-10-08T13:45:16.380 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.111115.log: /var/log/ceph/ceph-client.admin.86912.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186743.log 2023-10-08T13:45:16.385 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.449505.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156610.log 2023-10-08T13:45:16.385 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.186743.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189790.log 2023-10-08T13:45:16.385 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.369346.log 2023-10-08T13:45:16.385 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.156610.log: /var/log/ceph/ceph-client.admin.189790.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128756.log 2023-10-08T13:45:16.385 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148239.log 2023-10-08T13:45:16.385 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.369346.log: /var/log/ceph/ceph-client.admin.128756.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.285374.log 2023-10-08T13:45:16.385 INFO:teuthology.orchestra.run.smithi032.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43370.log.gz 2023-10-08T13:45:16.386 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.148239.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.459222.log 2023-10-08T13:45:16.386 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.285374.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.408388.log 2023-10-08T13:45:16.386 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.459222.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.411642.log 2023-10-08T13:45:16.386 INFO:teuthology.orchestra.run.smithi032.stderr: 78.9% -- replaced with /var/log/ceph/ceph-client.admin.229189.log.gz 2023-10-08T13:45:16.386 INFO:teuthology.orchestra.run.smithi032.stderr:gzip /var/log/ceph/ceph-client.admin.408388.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.43945.log 2023-10-08T13:45:16.386 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.342568.log 2023-10-08T13:45:16.386 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.411642.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102036.log 2023-10-08T13:45:16.387 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.43945.log: /var/log/ceph/ceph-client.admin.342568.log: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.432454.log.gz 2023-10-08T13:45:16.389 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.403929.log 2023-10-08T13:45:16.389 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 /var/log/ceph/ceph-client.admin.102036.log: --verbose -- /var/log/ceph/ceph-client.admin.316167.log 2023-10-08T13:45:16.390 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.403929.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99605.log 2023-10-08T13:45:16.390 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.316167.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.274647.log 2023-10-08T13:45:16.390 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.395346.log 2023-10-08T13:45:16.390 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.99605.log: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.426120.log.gz 2023-10-08T13:45:16.390 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.274647.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.455982.log 2023-10-08T13:45:16.390 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.395346.log: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.426129.log.gz 2023-10-08T13:45:16.390 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.401288.log 2023-10-08T13:45:16.391 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.385295.log 2023-10-08T13:45:16.391 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.455982.log: /var/log/ceph/ceph-client.admin.401288.log: gzip 84.3% -- replaced with /var/log/ceph/ceph-client.admin.455982.log.gz-5 2023-10-08T13:45:16.391 INFO:teuthology.orchestra.run.smithi032.stderr:--verbose -- /var/log/ceph/ceph-client.admin.218443.log 2023-10-08T13:45:16.393 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40826.log /var/log/ceph/ceph-client.admin.385295.log: 2023-10-08T13:45:16.393 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.218443.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40531.log 2023-10-08T13:45:16.393 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 /var/log/ceph/ceph-client.admin.40826.log: --verbose -- /var/log/ceph/ceph-client.admin.100011.log 2023-10-08T13:45:16.393 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45023.log 2023-10-08T13:45:16.393 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.40531.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.314419.log /var/log/ceph/ceph-client.admin.100011.log: 2023-10-08T13:45:16.393 INFO:teuthology.orchestra.run.smithi032.stderr: 77.5% -- replaced with /var/log/ceph/ceph-client.admin.244121.log.gz 2023-10-08T13:45:16.394 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.45023.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147846.log 2023-10-08T13:45:16.394 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.314419.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.412916.log 2023-10-08T13:45:16.395 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.147846.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178095.log 2023-10-08T13:45:16.395 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.412916.log: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.339076.log.gz 2023-10-08T13:45:16.395 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.474651.log 2023-10-08T13:45:16.396 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.178095.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.215813.log 2023-10-08T13:45:16.396 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.297562.log 2023-10-08T13:45:16.396 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.474651.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43014.log 2023-10-08T13:45:16.398 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.215813.log: /var/log/ceph/ceph-client.admin.297562.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182687.log 2023-10-08T13:45:16.399 INFO:teuthology.orchestra.run.smithi032.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.474651.log.gz 2023-10-08T13:45:16.399 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.284077.log 2023-10-08T13:45:16.399 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.43014.log: /var/log/ceph/ceph-client.admin.182687.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.422014.log 2023-10-08T13:45:16.399 INFO:teuthology.orchestra.run.smithi032.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.414529.log.gz 2023-10-08T13:45:16.399 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.284077.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106060.log 2023-10-08T13:45:16.399 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.229591.log 2023-10-08T13:45:16.400 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.422014.log: /var/log/ceph/ceph-client.admin.106060.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.410129.log 2023-10-08T13:45:16.400 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.229591.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156601.log 2023-10-08T13:45:16.401 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.410129.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176887.log 2023-10-08T13:45:16.401 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.156601.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.284880.log 2023-10-08T13:45:16.402 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.176887.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168117.log 2023-10-08T13:45:16.402 INFO:teuthology.orchestra.run.smithi032.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.424436.log.gz 2023-10-08T13:45:16.403 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.284880.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86042.log 2023-10-08T13:45:16.403 INFO:teuthology.orchestra.run.smithi032.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.424445.log.gz 2023-10-08T13:45:16.403 INFO:teuthology.orchestra.run.smithi032.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.425274.log.gz 2023-10-08T13:45:16.403 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.168117.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.426521.log 2023-10-08T13:45:16.405 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.86042.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.204824.log 2023-10-08T13:45:16.405 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.426521.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.289419.log 2023-10-08T13:45:16.405 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.204824.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.455124.log 2023-10-08T13:45:16.405 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.289419.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123712.log 2023-10-08T13:45:16.406 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.423219.log 2023-10-08T13:45:16.406 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.455124.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.284086.log 2023-10-08T13:45:16.407 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.123712.log: /var/log/ceph/ceph-client.admin.423219.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.310258.log 2023-10-08T13:45:16.408 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.284086.log: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.419121.log.gz 2023-10-08T13:45:16.408 INFO:teuthology.orchestra.run.smithi032.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.419926.log.gz 2023-10-08T13:45:16.408 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.457679.log 2023-10-08T13:45:16.408 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.475312.log 2023-10-08T13:45:16.408 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.310258.log: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.207054.log.gz 2023-10-08T13:45:16.409 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.457679.log: 81.4%gzip -- replaced with /var/log/ceph/ceph-client.admin.457679.log.gz 2023-10-08T13:45:16.410 INFO:teuthology.orchestra.run.smithi032.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.378266.log 2023-10-08T13:45:16.410 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149858.log 2023-10-08T13:45:16.410 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.475312.log: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.450320.log.gz 2023-10-08T13:45:16.410 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.378266.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.475312.log.gz 2023-10-08T13:45:16.410 INFO:teuthology.orchestra.run.smithi032.stderr: 79.0% -- replaced with /var/log/ceph/ceph-client.admin.450734.log.gz 2023-10-08T13:45:16.410 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95081.log 2023-10-08T13:45:16.412 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.149858.log: 77.8% -- replaced with /var/log/ceph/ceph-client.admin.164253.log.gz 2023-10-08T13:45:16.413 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.220959.log 2023-10-08T13:45:16.413 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.95081.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.407929.log 2023-10-08T13:45:16.413 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.220959.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157914.log 2023-10-08T13:45:16.413 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.407929.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44356.log.gz 2023-10-08T13:45:16.413 INFO:teuthology.orchestra.run.smithi032.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44296.log.gz 2023-10-08T13:45:16.413 INFO:teuthology.orchestra.run.smithi032.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.41584.log.gz 2023-10-08T13:45:16.413 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.276270.log 2023-10-08T13:45:16.414 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.157914.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107323.log 2023-10-08T13:45:16.414 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.276270.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.420326.log 2023-10-08T13:45:16.414 INFO:teuthology.orchestra.run.smithi032.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.41692.log.gz 2023-10-08T13:45:16.415 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.107323.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.409733.log 2023-10-08T13:45:16.416 INFO:teuthology.orchestra.run.smithi032.stderr: 77.5% -- replaced with /var/log/ceph/ceph-client.admin.109474.log.gz 2023-10-08T13:45:16.416 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.420326.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44969.log 2023-10-08T13:45:16.416 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.409733.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43945.log.gz 2023-10-08T13:45:16.416 INFO:teuthology.orchestra.run.smithi032.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.376014.log.gz 2023-10-08T13:45:16.416 INFO:teuthology.orchestra.run.smithi032.stderr: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.82945.log.gz 2023-10-08T13:45:16.416 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.396677.log 2023-10-08T13:45:16.418 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.376023.log 2023-10-08T13:45:16.418 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.44969.log: /var/log/ceph/ceph-client.admin.396677.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44834.log 2023-10-08T13:45:16.419 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.376023.log: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.84937.log.gz 2023-10-08T13:45:16.419 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.475067.log 2023-10-08T13:45:16.419 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.398355.log 2023-10-08T13:45:16.419 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.475067.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41261.log 2023-10-08T13:45:16.419 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.44834.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.475067.log.gz 2023-10-08T13:45:16.419 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.398355.log: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.311883.log.gz 2023-10-08T13:45:16.419 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41041.log 2023-10-08T13:45:16.422 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.41261.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.221764.log 2023-10-08T13:45:16.422 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.41041.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.474959.log 2023-10-08T13:45:16.423 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.221764.log: /var/log/ceph/ceph-client.admin.40821.log 2023-10-08T13:45:16.423 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.225818.log 2023-10-08T13:45:16.423 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.474959.log: /var/log/ceph/ceph-client.admin.40821.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.474959.log.gz 2023-10-08T13:45:16.425 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.298769.log 2023-10-08T13:45:16.425 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.225818.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41800.log 2023-10-08T13:45:16.425 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.475231.log 2023-10-08T13:45:16.425 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.298769.log: /var/log/ceph/ceph-client.admin.41800.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100820.log 2023-10-08T13:45:16.426 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.475231.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.471193.log 2023-10-08T13:45:16.426 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.100820.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.475231.log.gz 2023-10-08T13:45:16.426 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168108.log 2023-10-08T13:45:16.427 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.215379.log 2023-10-08T13:45:16.427 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.471193.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.344217.log 2023-10-08T13:45:16.428 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.168108.log: /var/log/ceph/ceph-client.admin.215379.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.356706.log 2023-10-08T13:45:16.428 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.344217.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.230395.log 2023-10-08T13:45:16.429 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97937.log 2023-10-08T13:45:16.430 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.356706.log: /var/log/ceph/ceph-client.admin.230395.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.318354.log 2023-10-08T13:45:16.431 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.417486.log 2023-10-08T13:45:16.431 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.97937.log: 78.8% -- replaced with /var/log/ceph/ceph-client.admin.176887.log.gz 2023-10-08T13:45:16.431 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.390414.log 2023-10-08T13:45:16.432 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.318354.log: /var/log/ceph/ceph-client.admin.417486.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.290625.log 2023-10-08T13:45:16.432 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.391681.log 2023-10-08T13:45:16.432 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.390414.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.443062.log 2023-10-08T13:45:16.433 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.290625.log: /var/log/ceph/ceph-client.admin.391681.log: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.310249.log.gz 2023-10-08T13:45:16.433 INFO:teuthology.orchestra.run.smithi032.stderr: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.471193.log.gz 2023-10-08T13:45:16.433 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44269.log 2023-10-08T13:45:16.434 INFO:teuthology.orchestra.run.smithi032.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.310258.log.gz 2023-10-08T13:45:16.434 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.443062.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.223394.log 2023-10-08T13:45:16.435 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.44269.log: 77.9% -- replaced with /var/log/ceph/ceph-client.admin.357519.log.gz 2023-10-08T13:45:16.435 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154910.log 2023-10-08T13:45:16.436 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.354221.log 2023-10-08T13:45:16.436 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.223394.log: /var/log/ceph/ceph-client.admin.154910.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.421601.log 2023-10-08T13:45:16.437 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.354221.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.370164.log 2023-10-08T13:45:16.437 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175680.log 2023-10-08T13:45:16.439 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.370164.log: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.315739.log.gz 2023-10-08T13:45:16.439 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.421601.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.293461.log 2023-10-08T13:45:16.439 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.175680.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40174.log 2023-10-08T13:45:16.440 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.293461.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.404397.log 2023-10-08T13:45:16.440 INFO:teuthology.orchestra.run.smithi032.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.369346.log.gz 2023-10-08T13:45:16.440 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.40174.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.310668.log 2023-10-08T13:45:16.441 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.404397.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40558.log 2023-10-08T13:45:16.442 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.310668.log: gzip 86.0% -- replaced with /var/log/ceph/ceph-client.admin.408388.log.gz-5 2023-10-08T13:45:16.442 INFO:teuthology.orchestra.run.smithi032.stderr:--verbose -- /var/log/ceph/ceph-client.admin.87305.log 2023-10-08T13:45:16.442 INFO:teuthology.orchestra.run.smithi032.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.407485.log.gz 2023-10-08T13:45:16.442 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.231210.log 2023-10-08T13:45:16.444 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.40558.log: /var/log/ceph/ceph-client.admin.87305.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.359977.log 2023-10-08T13:45:16.444 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.474642.log 2023-10-08T13:45:16.445 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.231210.log: /var/log/ceph/ceph-client.admin.359977.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173668.log 2023-10-08T13:45:16.445 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39870.log 2023-10-08T13:45:16.445 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.474642.log: /var/log/ceph/ceph-client.admin.173668.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.201546.log 2023-10-08T13:45:16.445 INFO:teuthology.orchestra.run.smithi032.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.208392.log.gz 2023-10-08T13:45:16.445 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.39870.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.475984.log 2023-10-08T13:45:16.445 INFO:teuthology.orchestra.run.smithi032.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.208401.log.gz 2023-10-08T13:45:16.445 INFO:teuthology.orchestra.run.smithi032.stderr: 83.7% -- replaced with /var/log/ceph/ceph-client.admin.474642.log.gz 2023-10-08T13:45:16.446 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.201546.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.392519.log 2023-10-08T13:45:16.447 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.475984.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.475984.log.gz 2023-10-08T13:45:16.447 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.351203.log 2023-10-08T13:45:16.447 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.392519.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.230404.log 2023-10-08T13:45:16.448 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.351203.log: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.183080.log.gz 2023-10-08T13:45:16.448 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.316561.log 2023-10-08T13:45:16.448 INFO:teuthology.orchestra.run.smithi032.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.182687.log.gz 2023-10-08T13:45:16.449 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.230404.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.299599.log 2023-10-08T13:45:16.449 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.316561.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.347470.log 2023-10-08T13:45:16.449 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.299599.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.451155.log 2023-10-08T13:45:16.449 INFO:teuthology.orchestra.run.smithi032.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.188140.log.gz 2023-10-08T13:45:16.450 INFO:teuthology.orchestra.run.smithi032.stderr:gzip /var/log/ceph/ceph-client.admin.347470.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.452970.log 2023-10-08T13:45:16.451 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.451155.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.441058.log 2023-10-08T13:45:16.454 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.452970.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.475150.log 2023-10-08T13:45:16.454 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.366491.log 2023-10-08T13:45:16.455 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.441058.log: /var/log/ceph/ceph-client.admin.475150.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.306897.log 2023-10-08T13:45:16.455 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.317062.log 2023-10-08T13:45:16.455 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.366491.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.475150.log.gz 2023-10-08T13:45:16.455 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189388.log 2023-10-08T13:45:16.456 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.306897.log: /var/log/ceph/ceph-client.admin.317062.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42490.log 2023-10-08T13:45:16.456 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.189388.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110700.log 2023-10-08T13:45:16.457 INFO:teuthology.orchestra.run.smithi032.stderr: 93.0% -- replaced with /var/log/ceph/ceph-client.admin.452970.log.gz 2023-10-08T13:45:16.457 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.42490.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.415774.log 2023-10-08T13:45:16.457 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.110700.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44107.log 2023-10-08T13:45:16.458 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.415774.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.227443.log 2023-10-08T13:45:16.458 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.44107.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.409257.log 2023-10-08T13:45:16.459 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.227443.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.215804.log 2023-10-08T13:45:16.460 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.409257.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.453829.log 2023-10-08T13:45:16.460 INFO:teuthology.orchestra.run.smithi032.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.423219.log.gz 2023-10-08T13:45:16.460 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.215804.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-10-08T13:45:16.460 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.453829.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170695.log 2023-10-08T13:45:16.461 INFO:teuthology.orchestra.run.smithi032.stderr: 84.0% -- replaced with /var/log/ceph/ceph-client.admin.453829.log.gz 2023-10-08T13:45:16.462 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.284488.log 2023-10-08T13:45:16.462 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.170695.log: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.443062.log.gz 2023-10-08T13:45:16.462 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.285365.log 2023-10-08T13:45:16.462 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.284488.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.314876.log 2023-10-08T13:45:16.464 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.285365.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.459222.log.gz 2023-10-08T13:45:16.464 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.431190.log 2023-10-08T13:45:16.464 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.314876.log: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.304277.log.gz 2023-10-08T13:45:16.464 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.317460.log 2023-10-08T13:45:16.464 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.431190.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81714.log 2023-10-08T13:45:16.465 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.475204.log 2023-10-08T13:45:16.465 INFO:teuthology.orchestra.run.smithi040.stderr: 94.1% -- replaced with /var/log/ceph/ceph.log.gz 2023-10-08T13:45:16.467 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.317460.log: /var/log/ceph/ceph-client.admin.81714.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111923.log 2023-10-08T13:45:16.467 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.235265.log 2023-10-08T13:45:16.467 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.475204.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.446287.log 2023-10-08T13:45:16.467 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.111923.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.475204.log.gz 2023-10-08T13:45:16.468 INFO:teuthology.orchestra.run.smithi032.stderr:gzip /var/log/ceph/ceph-client.admin.235265.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.343804.log 2023-10-08T13:45:16.468 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.446287.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44807.log 2023-10-08T13:45:16.468 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.343804.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44134.log 2023-10-08T13:45:16.469 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.351409.log 2023-10-08T13:45:16.469 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.44807.log: /var/log/ceph/ceph-client.admin.44134.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42682.log 2023-10-08T13:45:16.469 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.351409.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.227041.log 2023-10-08T13:45:16.470 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.42682.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.432030.log 2023-10-08T13:45:16.470 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.227041.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.402105.log 2023-10-08T13:45:16.472 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.432030.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40396.log 2023-10-08T13:45:16.472 INFO:teuthology.orchestra.run.smithi032.stderr: 80.2% -- replaced with /var/log/ceph/ceph-client.admin.285365.log.gz 2023-10-08T13:45:16.472 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.402105.log: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.286571.log.gz 2023-10-08T13:45:16.473 INFO:teuthology.orchestra.run.smithi032.stderr:gzip 81.1% -- replaced with /var/log/ceph/ceph-client.admin.295535.log.gz-5 2023-10-08T13:45:16.474 INFO:teuthology.orchestra.run.smithi032.stderr:--verbose -- /var/log/ceph/ceph-client.admin.178912.log 2023-10-08T13:45:16.474 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.40396.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191398.log 2023-10-08T13:45:16.474 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.178912.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.447887.log 2023-10-08T13:45:16.476 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.191398.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.217639.log 2023-10-08T13:45:16.476 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.447887.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.469079.log 2023-10-08T13:45:16.478 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.217639.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.292644.log 2023-10-08T13:45:16.478 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.469079.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.459446.log 2023-10-08T13:45:16.478 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.292644.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.311070.log 2023-10-08T13:45:16.479 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.459446.log: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.459446.log.gz 2023-10-08T13:45:16.480 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121151.log 2023-10-08T13:45:16.481 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.311070.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.443473.log 2023-10-08T13:45:16.482 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.121151.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.206083.log 2023-10-08T13:45:16.483 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.443473.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41557.log 2023-10-08T13:45:16.483 INFO:teuthology.orchestra.run.smithi032.stderr: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.469079.log.gz 2023-10-08T13:45:16.483 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.206083.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.393737.log 2023-10-08T13:45:16.484 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.41557.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.447896.log 2023-10-08T13:45:16.484 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.393737.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99199.log 2023-10-08T13:45:16.484 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.447896.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.197092.log 2023-10-08T13:45:16.485 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.99199.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.464816.log 2023-10-08T13:45:16.487 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.197092.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.401690.log 2023-10-08T13:45:16.487 INFO:teuthology.orchestra.run.smithi032.stderr: 80.2% -- replaced with /var/log/ceph/ceph-client.admin.214118.log.gz 2023-10-08T13:45:16.488 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.464816.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162123.log 2023-10-08T13:45:16.488 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.401690.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171566.log 2023-10-08T13:45:16.489 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.162123.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104443.log 2023-10-08T13:45:16.492 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.171566.log: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.359564.log.gz 2023-10-08T13:45:16.492 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.45161.log 2023-10-08T13:45:16.493 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.104443.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.419515.log 2023-10-08T13:45:16.494 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.0.45161.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.294262.log 2023-10-08T13:45:16.495 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.419515.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109483.log 2023-10-08T13:45:16.495 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.294262.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.445483.log 2023-10-08T13:45:16.495 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.109483.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149451.log 2023-10-08T13:45:16.496 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.445483.log: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.407929.log.gz 2023-10-08T13:45:16.496 INFO:teuthology.orchestra.run.smithi032.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.409257.log.gz 2023-10-08T13:45:16.496 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.226643.log 2023-10-08T13:45:16.498 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.149451.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.207063.log 2023-10-08T13:45:16.498 INFO:teuthology.orchestra.run.smithi032.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.409733.log.gz 2023-10-08T13:45:16.498 INFO:teuthology.orchestra.run.smithi032.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.159546.log.gz 2023-10-08T13:45:16.498 INFO:teuthology.orchestra.run.smithi032.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.412916.log.gz 2023-10-08T13:45:16.498 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.226643.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44585.log 2023-10-08T13:45:16.500 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.207063.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168549.log 2023-10-08T13:45:16.500 INFO:teuthology.orchestra.run.smithi032.stderr: 78.9% -- replaced with /var/log/ceph/ceph-client.admin.170695.log.gz 2023-10-08T13:45:16.500 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.44585.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.242384.log 2023-10-08T13:45:16.501 INFO:teuthology.orchestra.run.smithi032.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.40174.log.gz 2023-10-08T13:45:16.501 INFO:teuthology.orchestra.run.smithi032.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.173668.log.gz 2023-10-08T13:45:16.501 INFO:teuthology.orchestra.run.smithi032.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.40396.log.gz 2023-10-08T13:45:16.501 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.216835.log 2023-10-08T13:45:16.501 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.168549.log: /var/log/ceph/ceph-client.admin.242384.log: 77.9% -- replaced with /var/log/ceph/ceph-client.admin.149858.log.gz 2023-10-08T13:45:16.501 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184316.log 2023-10-08T13:45:16.503 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.196244.log 2023-10-08T13:45:16.503 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.216835.log: gzip -5 --verbose /var/log/ceph/ceph-client.admin.184316.log: -- /var/log/ceph/ceph-client.admin.389009.log 2023-10-08T13:45:16.503 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40120.log 2023-10-08T13:45:16.503 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.196244.log: /var/log/ceph/ceph-client.admin.389009.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.425727.log 2023-10-08T13:45:16.503 INFO:teuthology.orchestra.run.smithi032.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44161.log.gz 2023-10-08T13:45:16.503 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.40120.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104039.log 2023-10-08T13:45:16.505 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.425727.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.367703.log 2023-10-08T13:45:16.505 INFO:teuthology.orchestra.run.smithi032.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.41557.log.gz 2023-10-08T13:45:16.505 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.104039.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.449094.log 2023-10-08T13:45:16.505 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.367703.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.232419.log 2023-10-08T13:45:16.505 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.449094.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.40558.log.gz 2023-10-08T13:45:16.507 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.424035.log 2023-10-08T13:45:16.507 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.356308.log 2023-10-08T13:45:16.507 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.232419.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.424035.log: /var/log/ceph/ceph-client.admin.367301.log 2023-10-08T13:45:16.507 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.282349.log 2023-10-08T13:45:16.508 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.356308.log: /var/log/ceph/ceph-client.admin.367301.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.232824.log 2023-10-08T13:45:16.508 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.437054.log 2023-10-08T13:45:16.509 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.282349.log: /var/log/ceph/ceph-client.admin.232824.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.41260.log.gz 2023-10-08T13:45:16.509 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.245049.log 2023-10-08T13:45:16.509 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.437054.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86903.log 2023-10-08T13:45:16.509 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.245049.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.443071.log 2023-10-08T13:45:16.511 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.86903.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.42436.log.gz 2023-10-08T13:45:16.513 INFO:teuthology.orchestra.run.smithi032.stderr: 79.7% -- replaced with /var/log/ceph/ceph-client.admin.104443.log.gz 2023-10-08T13:45:16.513 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110292.log 2023-10-08T13:45:16.514 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.443071.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.366898.log 2023-10-08T13:45:16.514 INFO:teuthology.orchestra.run.smithi032.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.99605.log.gz 2023-10-08T13:45:16.514 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.110292.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.294735.log 2023-10-08T13:45:16.514 INFO:teuthology.orchestra.run.smithi032.stderr: 79.1% -- replaced with /var/log/ceph/ceph-client.admin.100011.log.gz 2023-10-08T13:45:16.516 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.366898.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43589.log 2023-10-08T13:45:16.516 INFO:teuthology.orchestra.run.smithi032.stderr: 96.6% -- replaced with /var/log/ceph/ceph-client.admin.464816.log.gz 2023-10-08T13:45:16.516 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.462346.log 2023-10-08T13:45:16.517 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.294735.log: /var/log/ceph/ceph-client.admin.43589.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121563.log 2023-10-08T13:45:16.517 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.462346.log: 84.0% -- replaced with /var/log/ceph/ceph-client.admin.462346.log.gz 2023-10-08T13:45:16.517 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.475739.log 2023-10-08T13:45:16.517 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.121563.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.222181.log 2023-10-08T13:45:16.520 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.475739.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.475739.log.gz 2023-10-08T13:45:16.520 INFO:teuthology.orchestra.run.smithi032.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.229591.log.gz 2023-10-08T13:45:16.521 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.277881.log 2023-10-08T13:45:16.521 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.222181.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.471184.log 2023-10-08T13:45:16.521 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.277881.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.247468.log 2023-10-08T13:45:16.521 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.471184.log: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.471184.log.gz 2023-10-08T13:45:16.521 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193054.log 2023-10-08T13:45:16.521 INFO:teuthology.orchestra.run.smithi032.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.230404.log.gz 2023-10-08T13:45:16.521 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.247468.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.358760.log 2023-10-08T13:45:16.522 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.193054.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.337829.log 2023-10-08T13:45:16.522 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.358760.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.279101.log 2023-10-08T13:45:16.522 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.337829.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.355052.log 2023-10-08T13:45:16.522 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.279101.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.428371.log 2023-10-08T13:45:16.522 INFO:teuthology.orchestra.run.smithi032.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.215379.log.gz 2023-10-08T13:45:16.522 INFO:teuthology.orchestra.run.smithi032.stderr: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.215804.log.gz 2023-10-08T13:45:16.524 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.355052.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.220552.log 2023-10-08T13:45:16.524 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.428371.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44053.log 2023-10-08T13:45:16.524 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.220552.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.206092.log 2023-10-08T13:45:16.524 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.44053.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.409724.log 2023-10-08T13:45:16.525 INFO:teuthology.orchestra.run.smithi032.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.157914.log.gz 2023-10-08T13:45:16.525 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.206092.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.430780.log 2023-10-08T13:45:16.525 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.409724.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.197899.log 2023-10-08T13:45:16.525 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.430780.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.285767.log 2023-10-08T13:45:16.526 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.197899.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.420335.log 2023-10-08T13:45:16.527 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.285767.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.296745.log 2023-10-08T13:45:16.527 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.420335.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40315.log 2023-10-08T13:45:16.527 INFO:teuthology.orchestra.run.smithi032.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.392519.log.gz 2023-10-08T13:45:16.527 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.296745.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.361190.log 2023-10-08T13:45:16.528 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.40315.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.405833.log 2023-10-08T13:45:16.528 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.361190.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.353814.log 2023-10-08T13:45:16.528 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.405833.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44834.log.gz 2023-10-08T13:45:16.529 INFO:teuthology.orchestra.run.smithi032.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.402105.log.gz 2023-10-08T13:45:16.529 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.246664.log 2023-10-08T13:45:16.529 INFO:teuthology.orchestra.run.smithi032.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.149451.log.gz 2023-10-08T13:45:16.530 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.353814.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170265.log 2023-10-08T13:45:16.531 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.436295.log 2023-10-08T13:45:16.531 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.246664.log: /var/log/ceph/ceph-client.admin.170265.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.319336.log 2023-10-08T13:45:16.531 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40607.log 2023-10-08T13:45:16.531 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.436295.log: /var/log/ceph/ceph-client.admin.319336.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.407091.log 2023-10-08T13:45:16.531 INFO:teuthology.orchestra.run.smithi032.stderr: 78.4% -- replaced with /var/log/ceph/ceph-client.admin.366898.log.gz 2023-10-08T13:45:16.533 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.40607.log: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.109483.log.gz 2023-10-08T13:45:16.534 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.363652.log 2023-10-08T13:45:16.534 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.429180.log 2023-10-08T13:45:16.534 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.407091.log: /var/log/ceph/ceph-client.admin.363652.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.242393.log 2023-10-08T13:45:16.534 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.429180.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109028.log 2023-10-08T13:45:16.534 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.242393.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.454681.log 2023-10-08T13:45:16.534 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.109028.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.468654.log 2023-10-08T13:45:16.534 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.454681.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161602.log 2023-10-08T13:45:16.536 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.468654.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.217237.log 2023-10-08T13:45:16.536 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.161602.log: 78.7% -- replaced with /var/log/ceph/ceph-client.admin.405833.log.gz 2023-10-08T13:45:16.536 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158920.log 2023-10-08T13:45:16.536 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.217237.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183915.log 2023-10-08T13:45:16.536 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.158920.log: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.343804.log.gz 2023-10-08T13:45:16.537 INFO:teuthology.orchestra.run.smithi032.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.425727.log.gz 2023-10-08T13:45:16.537 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129571.log 2023-10-08T13:45:16.538 INFO:teuthology.orchestra.run.smithi032.stderr: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.468654.log.gz 2023-10-08T13:45:16.539 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.183915.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.392074.log 2023-10-08T13:45:16.539 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.129571.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.365683.log 2023-10-08T13:45:16.539 INFO:teuthology.orchestra.run.smithi032.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.426530.log.gz 2023-10-08T13:45:16.540 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.392074.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.406681.log 2023-10-08T13:45:16.540 INFO:teuthology.orchestra.run.smithi032.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.420326.log.gz 2023-10-08T13:45:16.542 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.214932.log 2023-10-08T13:45:16.542 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.365683.log: /var/log/ceph/ceph-client.admin.406681.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.396686.log 2023-10-08T13:45:16.542 INFO:teuthology.orchestra.run.smithi032.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.420335.log.gz 2023-10-08T13:45:16.542 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.410138.log 2023-10-08T13:45:16.542 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.214932.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126524.log 2023-10-08T13:45:16.542 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.396686.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.407920.log 2023-10-08T13:45:16.543 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.410138.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.291026.log 2023-10-08T13:45:16.543 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.126524.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96294.log 2023-10-08T13:45:16.543 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.407920.log: /var/log/ceph/ceph-client.admin.291026.log: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.220561.log.gz 2023-10-08T13:45:16.545 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.230799.log 2023-10-08T13:45:16.546 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.96294.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.344620.log 2023-10-08T13:45:16.546 INFO:teuthology.orchestra.run.smithi032.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.443071.log.gz 2023-10-08T13:45:16.547 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.230799.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.277478.log 2023-10-08T13:45:16.547 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.344620.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.353805.log 2023-10-08T13:45:16.548 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.277478.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87314.log 2023-10-08T13:45:16.548 INFO:teuthology.orchestra.run.smithi032.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.445483.log.gz 2023-10-08T13:45:16.548 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.353805.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.386951.log 2023-10-08T13:45:16.550 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.87314.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.466518.log 2023-10-08T13:45:16.550 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.386951.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43562.log 2023-10-08T13:45:16.550 INFO:teuthology.orchestra.run.smithi032.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.447887.log.gz 2023-10-08T13:45:16.550 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.466518.log: gzip -5 --verbose -- 83.5%/var/log/ceph/ceph-client.admin.228391.log -- replaced with /var/log/ceph/ceph-client.admin.466518.log.gz 2023-10-08T13:45:16.550 INFO:teuthology.orchestra.run.smithi032.stderr: 2023-10-08T13:45:16.550 INFO:teuthology.orchestra.run.smithi032.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.449094.log.gz 2023-10-08T13:45:16.550 INFO:teuthology.orchestra.run.smithi032.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.447896.log.gz 2023-10-08T13:45:16.552 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.43562.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.345468.log 2023-10-08T13:45:16.552 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.228391.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.202797.log 2023-10-08T13:45:16.552 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.345468.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40827.log 2023-10-08T13:45:16.552 INFO:teuthology.orchestra.run.smithi032.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.222181.log.gz 2023-10-08T13:45:16.553 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.202797.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.376421.log 2023-10-08T13:45:16.553 INFO:teuthology.orchestra.run.smithi032.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.313079.log.gz 2023-10-08T13:45:16.553 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.40827.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.453427.log 2023-10-08T13:45:16.553 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.376421.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.245855.log 2023-10-08T13:45:16.554 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.453427.log: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.453427.log.gz 2023-10-08T13:45:16.554 INFO:teuthology.orchestra.run.smithi032.stderr: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.314876.log.gz 2023-10-08T13:45:16.554 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.231201.log 2023-10-08T13:45:16.555 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.245855.log: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.277881.log.gz 2023-10-08T13:45:16.555 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163392.log 2023-10-08T13:45:16.555 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.231201.log: /var/log/ceph/ceph-client.admin.349990.log 2023-10-08T13:45:16.556 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.205259.log 2023-10-08T13:45:16.557 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.163392.log: /var/log/ceph/ceph-client.admin.349990.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.208795.log 2023-10-08T13:45:16.557 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.205259.log: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.225420.log.gz 2023-10-08T13:45:16.557 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173262.log 2023-10-08T13:45:16.557 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.208795.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.304749.log 2023-10-08T13:45:16.558 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.395745.log 2023-10-08T13:45:16.558 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.173262.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.437045.log 2023-10-08T13:45:16.558 INFO:teuthology.orchestra.run.smithi032.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.285767.log.gz 2023-10-08T13:45:16.558 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.304749.log: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.226643.log.gz 2023-10-08T13:45:16.559 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.395745.log: 79.3% -- replaced with /var/log/ceph/ceph-client.admin.235701.log.gz 2023-10-08T13:45:16.559 INFO:teuthology.orchestra.run.smithi032.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.294735.log.gz 2023-10-08T13:45:16.560 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44639.log 2023-10-08T13:45:16.561 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.437045.log: gzip -5 --verbose 90.6%-- /var/log/ceph/ceph-client.admin.305690.log -- replaced with /var/log/ceph/ceph-client.admin.406681.log.gz 2023-10-08T13:45:16.561 INFO:teuthology.orchestra.run.smithi032.stderr: 2023-10-08T13:45:16.561 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.44639.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185521.log 2023-10-08T13:45:16.562 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.305690.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.237778.log 2023-10-08T13:45:16.562 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.185521.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.230002.log 2023-10-08T13:45:16.562 INFO:teuthology.orchestra.run.smithi032.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.119897.log.gz 2023-10-08T13:45:16.562 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.237778.log: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.361190.log.gz 2023-10-08T13:45:16.563 INFO:teuthology.orchestra.run.smithi032.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.242384.log.gz 2023-10-08T13:45:16.563 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.336549.log 2023-10-08T13:45:16.564 INFO:teuthology.orchestra.run.smithi032.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.242393.log.gz 2023-10-08T13:45:16.565 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.230002.log: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.377855.log.gz 2023-10-08T13:45:16.565 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154507.log 2023-10-08T13:45:16.566 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.336549.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.425718.log 2023-10-08T13:45:16.566 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.222579.log 2023-10-08T13:45:16.567 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.154507.log: /var/log/ceph/ceph-client.admin.425718.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91710.log 2023-10-08T13:45:16.567 INFO:teuthology.orchestra.run.smithi032.stderr: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.161602.log.gz 2023-10-08T13:45:16.567 INFO:teuthology.orchestra.run.smithi032.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.173262.log.gz 2023-10-08T13:45:16.568 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.222579.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.368551.log 2023-10-08T13:45:16.568 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.91710.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.395754.log 2023-10-08T13:45:16.569 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.368551.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.456416.log 2023-10-08T13:45:16.569 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.395754.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.197495.log 2023-10-08T13:45:16.570 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.456416.log: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.456416.log.gz 2023-10-08T13:45:16.570 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.280322.log 2023-10-08T13:45:16.571 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.197495.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.360380.log 2023-10-08T13:45:16.575 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.280322.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.368105.log 2023-10-08T13:45:16.575 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108633.log 2023-10-08T13:45:16.575 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.360380.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.236920.log 2023-10-08T13:45:16.575 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.368105.log: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.410655.log.gz 2023-10-08T13:45:16.575 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.108633.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.399606.log 2023-10-08T13:45:16.576 INFO:teuthology.orchestra.run.smithi032.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.40120.log.gz 2023-10-08T13:45:16.576 INFO:teuthology.orchestra.run.smithi032.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.40607.log.gz 2023-10-08T13:45:16.576 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.236920.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.41248.log.gz 2023-10-08T13:45:16.576 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.418299.log 2023-10-08T13:45:16.576 INFO:teuthology.orchestra.run.smithi032.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43235.log.gz 2023-10-08T13:45:16.576 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.399606.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.385748.log 2023-10-08T13:45:16.576 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.418299.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.289017.log 2023-10-08T13:45:16.577 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.385748.log: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.110292.log.gz 2023-10-08T13:45:16.577 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.287813.log 2023-10-08T13:45:16.579 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107332.log 2023-10-08T13:45:16.580 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.289017.log: /var/log/ceph/ceph-client.admin.287813.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.414520.log 2023-10-08T13:45:16.580 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.107332.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.196680.log 2023-10-08T13:45:16.580 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.414520.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.272633.log 2023-10-08T13:45:16.580 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.196680.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.339067.log 2023-10-08T13:45:16.580 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.272633.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.287822.log 2023-10-08T13:45:16.580 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.339067.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170704.log 2023-10-08T13:45:16.581 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.287822.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.459844.log 2023-10-08T13:45:16.581 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.170704.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.469504.log 2023-10-08T13:45:16.582 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.459844.log: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.459844.log.gz 2023-10-08T13:45:16.582 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163831.log 2023-10-08T13:45:16.583 INFO:teuthology.orchestra.run.smithi032.stderr: 84.7% -- replaced with /var/log/ceph/ceph-client.admin.304749.log.gz 2023-10-08T13:45:16.583 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.469504.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86499.log 2023-10-08T13:45:16.583 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.163831.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102831.log 2023-10-08T13:45:16.583 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.86499.log: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.305690.log.gz 2023-10-08T13:45:16.584 INFO:teuthology.orchestra.run.smithi032.stderr: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.469504.log.gz 2023-10-08T13:45:16.585 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.348736.log 2023-10-08T13:45:16.586 INFO:teuthology.orchestra.run.smithi032.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.178912.log.gz 2023-10-08T13:45:16.586 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.102831.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109885.log 2023-10-08T13:45:16.587 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.348736.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.446681.log 2023-10-08T13:45:16.587 INFO:teuthology.orchestra.run.smithi032.stderr: 78.9% -- replaced with /var/log/ceph/ceph-client.admin.399606.log.gz 2023-10-08T13:45:16.588 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.109885.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.452558.log 2023-10-08T13:45:16.589 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.348745.log 2023-10-08T13:45:16.589 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.446681.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183924.log 2023-10-08T13:45:16.589 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.452558.log: 97.1% -- replaced with /var/log/ceph/ceph-client.admin.455124.log.gz 2023-10-08T13:45:16.591 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.348745.log: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.452558.log.gz 2023-10-08T13:45:16.591 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.362811.log 2023-10-08T13:45:16.591 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.315294.log 2023-10-08T13:45:16.591 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.183924.log: /var/log/ceph/ceph-client.admin.362811.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.361582.log 2023-10-08T13:45:16.592 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.371097.log 2023-10-08T13:45:16.592 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.315294.log: /var/log/ceph/ceph-client.admin.361582.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.455991.log 2023-10-08T13:45:16.592 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.475604.log 2023-10-08T13:45:16.592 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.371097.log: /var/log/ceph/ceph-client.admin.455991.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.414922.log 2023-10-08T13:45:16.594 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.475604.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.247071.log 2023-10-08T13:45:16.595 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.392510.log 2023-10-08T13:45:16.595 INFO:teuthology.orchestra.run.smithi032.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.475604.log.gz 2023-10-08T13:45:16.595 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.414922.log: /var/log/ceph/ceph-client.admin.247071.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.296754.log 2023-10-08T13:45:16.595 INFO:teuthology.orchestra.run.smithi032.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.185521.log.gz 2023-10-08T13:45:16.595 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.392510.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178104.log 2023-10-08T13:45:16.595 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.296754.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179307.log 2023-10-08T13:45:16.595 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.178104.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.465241.log 2023-10-08T13:45:16.596 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.179307.log: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.353805.log.gz 2023-10-08T13:45:16.596 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.280313.log 2023-10-08T13:45:16.597 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.465241.log: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.465241.log.gz 2023-10-08T13:45:16.597 INFO:teuthology.orchestra.run.smithi032.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.353814.log.gz 2023-10-08T13:45:16.597 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.422810.log 2023-10-08T13:45:16.597 INFO:teuthology.orchestra.run.smithi032.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.97937.log.gz 2023-10-08T13:45:16.597 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.280313.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36033.log 2023-10-08T13:45:16.599 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.422810.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130124.log 2023-10-08T13:45:16.599 INFO:teuthology.orchestra.run.smithi032.stderr: 79.3% -- replaced with /var/log/ceph/ceph-client.admin.319336.log.gz 2023-10-08T13:45:16.599 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.36033.log: 80.7%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.368105.log.gz--verbose -- 2023-10-08T13:45:16.599 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.43837.log 2023-10-08T13:45:16.599 INFO:teuthology.orchestra.run.smithi032.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.414520.log.gz 2023-10-08T13:45:16.599 INFO:teuthology.orchestra.run.smithi032.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.422810.log.gz 2023-10-08T13:45:16.600 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.130124.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.374772.log 2023-10-08T13:45:16.600 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.43837.log: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.437045.log.gz 2023-10-08T13:45:16.600 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.201537.log 2023-10-08T13:45:16.600 INFO:teuthology.orchestra.run.smithi032.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.222579.log.gz 2023-10-08T13:45:16.601 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.374772.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.289026.log 2023-10-08T13:45:16.602 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.201537.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.412036.log 2023-10-08T13:45:16.602 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.289026.log: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.123712.log.gz 2023-10-08T13:45:16.603 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.420794.log 2023-10-08T13:45:16.605 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.292635.log 2023-10-08T13:45:16.605 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.412036.log: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.230002.log.gz 2023-10-08T13:45:16.605 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.420794.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.393728.log 2023-10-08T13:45:16.605 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.433999.log 2023-10-08T13:45:16.605 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.292635.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.442659.log 2023-10-08T13:45:16.605 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.393728.log: /var/log/ceph/ceph-client.admin.433999.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92158.log 2023-10-08T13:45:16.606 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.442659.log: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.217237.log.gz 2023-10-08T13:45:16.606 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.475658.log 2023-10-08T13:45:16.606 INFO:teuthology.orchestra.run.smithi032.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.216835.log.gz 2023-10-08T13:45:16.606 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.92158.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107730.log 2023-10-08T13:45:16.607 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.475658.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111914.log 2023-10-08T13:45:16.607 INFO:teuthology.orchestra.run.smithi032.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.475658.log.gz 2023-10-08T13:45:16.607 INFO:teuthology.orchestra.run.smithi032.stderr: 77.4% -- replaced with /var/log/ceph/ceph-client.admin.365683.log.gz 2023-10-08T13:45:16.608 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.107730.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.398346.log 2023-10-08T13:45:16.609 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.111914.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.280724.log 2023-10-08T13:45:16.609 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111512.log 2023-10-08T13:45:16.609 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.398346.log: 90.5%/var/log/ceph/ceph-client.admin.280724.log: -- replaced with /var/log/ceph/ceph-client.admin.228391.log.gz 2023-10-08T13:45:16.609 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177298.log 2023-10-08T13:45:16.610 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.111512.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.203201.log 2023-10-08T13:45:16.610 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.177298.log: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.231201.log.gz 2023-10-08T13:45:16.610 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106476.log 2023-10-08T13:45:16.611 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.203201.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178903.log 2023-10-08T13:45:16.611 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.106476.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.318851.log 2023-10-08T13:45:16.612 INFO:teuthology.orchestra.run.smithi032.stderr: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.363229.log.gz 2023-10-08T13:45:16.612 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.178903.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.376639.log 2023-10-08T13:45:16.612 INFO:teuthology.orchestra.run.smithi032.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.277487.log.gz 2023-10-08T13:45:16.613 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.318851.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188935.log 2023-10-08T13:45:16.614 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.376639.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113217.log 2023-10-08T13:45:16.614 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.188935.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.429573.log 2023-10-08T13:45:16.615 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.113217.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.341333.log 2023-10-08T13:45:16.615 INFO:teuthology.orchestra.run.smithi032.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44585.log.gz 2023-10-08T13:45:16.615 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.429573.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.321694.log 2023-10-08T13:45:16.616 INFO:teuthology.orchestra.run.smithi032.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44639.log.gz 2023-10-08T13:45:16.617 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.341333.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108624.log 2023-10-08T13:45:16.618 INFO:teuthology.orchestra.run.smithi032.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.280313.log.gz 2023-10-08T13:45:16.619 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.321694.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.272219.log 2023-10-08T13:45:16.619 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.376300.log 2023-10-08T13:45:16.619 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.108624.log: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.280322.log.gz 2023-10-08T13:45:16.619 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.470345.log 2023-10-08T13:45:16.620 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.272219.log: /var/log/ceph/ceph-client.admin.376300.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91701.log 2023-10-08T13:45:16.621 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.470345.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.470345.log.gz 2023-10-08T13:45:16.621 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.366099.log 2023-10-08T13:45:16.621 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.91701.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.335260.log 2023-10-08T13:45:16.621 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.366099.log: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.344620.log.gz 2023-10-08T13:45:16.622 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44421.log 2023-10-08T13:45:16.622 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.335260.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.309427.log 2023-10-08T13:45:16.623 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.44421.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.204016.log 2023-10-08T13:45:16.623 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.309427.log: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.368551.log.gz 2023-10-08T13:45:16.623 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155333.log 2023-10-08T13:45:16.624 INFO:teuthology.orchestra.run.smithi032.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.202797.log.gz 2023-10-08T13:45:16.624 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.204016.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176091.log 2023-10-08T13:45:16.625 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.155333.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42571.log 2023-10-08T13:45:16.626 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39938.log 2023-10-08T13:45:16.626 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.176091.log: /var/log/ceph/ceph-client.admin.42571.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159952.log 2023-10-08T13:45:16.626 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.39938.log: 79.1% -- replaced with /var/log/ceph/ceph-client.admin.201537.log.gz 2023-10-08T13:45:16.627 INFO:teuthology.orchestra.run.smithi032.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.43562.log.gz 2023-10-08T13:45:16.627 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.312686.log 2023-10-08T13:45:16.628 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.159952.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.464405.log 2023-10-08T13:45:16.628 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.312686.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.402976.log 2023-10-08T13:45:16.629 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.464405.log: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.464405.log.gz 2023-10-08T13:45:16.629 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183513.log 2023-10-08T13:45:16.630 INFO:teuthology.orchestra.run.smithi032.stderr:gzip /var/log/ceph/ceph-client.admin.402976.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.423636.log 2023-10-08T13:45:16.630 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.183513.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.399209.log 2023-10-08T13:45:16.631 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.423636.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.432021.log 2023-10-08T13:45:16.632 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.399209.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183089.log 2023-10-08T13:45:16.632 INFO:teuthology.orchestra.run.smithi032.stderr: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.118669.log.gz 2023-10-08T13:45:16.633 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.432021.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.343395.log 2023-10-08T13:45:16.633 INFO:teuthology.orchestra.run.smithi032.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.44753.log.gz 2023-10-08T13:45:16.634 INFO:teuthology.orchestra.run.smithi032.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.118267.log.gz 2023-10-08T13:45:16.634 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.183089.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.303820.log 2023-10-08T13:45:16.635 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.343395.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.347479.log 2023-10-08T13:45:16.635 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.226634.log 2023-10-08T13:45:16.636 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.303820.log: /var/log/ceph/ceph-client.admin.347479.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.338635.log 2023-10-08T13:45:16.636 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.278691.log 2023-10-08T13:45:16.637 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.226634.log: /var/log/ceph/ceph-client.admin.338635.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.348330.log 2023-10-08T13:45:16.638 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.278691.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.431613.log 2023-10-08T13:45:16.638 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.444679.log 2023-10-08T13:45:16.639 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.348330.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.366500.log 2023-10-08T13:45:16.640 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.431613.log: gzip -5 --verbose /var/log/ceph/ceph-client.admin.444679.log: -- /var/log/ceph/ceph-client.admin.93312.log 2023-10-08T13:45:16.640 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.366500.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.274656.log 2023-10-08T13:45:16.640 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.93312.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.293046.log 2023-10-08T13:45:16.641 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.274656.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.246655.log 2023-10-08T13:45:16.641 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.293046.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171135.log 2023-10-08T13:45:16.642 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.246655.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.475685.log 2023-10-08T13:45:16.644 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.171135.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.415783.log 2023-10-08T13:45:16.646 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.475685.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.475685.log.gz 2023-10-08T13:45:16.646 INFO:teuthology.orchestra.run.smithi032.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.39938.log.gz 2023-10-08T13:45:16.646 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.362820.log 2023-10-08T13:45:16.646 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.415783.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.293452.log 2023-10-08T13:45:16.648 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.362820.log: 79.2% -- replaced with /var/log/ceph/ceph-client.admin.374772.log.gz 2023-10-08T13:45:16.648 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.311061.log 2023-10-08T13:45:16.648 INFO:teuthology.orchestra.run.smithi032.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43837.log.gz 2023-10-08T13:45:16.648 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.455548.log 2023-10-08T13:45:16.648 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.293452.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.364869.log 2023-10-08T13:45:16.648 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.311061.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147837.log 2023-10-08T13:45:16.651 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.455548.log: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.455548.log.gz 2023-10-08T13:45:16.651 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155342.log 2023-10-08T13:45:16.651 INFO:teuthology.orchestra.run.smithi032.stderr: 79.2% -- replaced with /var/log/ceph/ceph-client.admin.317460.log.gz 2023-10-08T13:45:16.651 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.147837.log: /var/log/ceph/ceph-client.admin.364869.log: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.317062.log.gz 2023-10-08T13:45:16.651 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128363.log 2023-10-08T13:45:16.652 INFO:teuthology.orchestra.run.smithi032.stderr: 77.6% -- replaced with /var/log/ceph/ceph-client.admin.318354.log.gz 2023-10-08T13:45:16.652 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.155342.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79887.log 2023-10-08T13:45:16.652 INFO:teuthology.orchestra.run.smithi032.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.86499.log.gz 2023-10-08T13:45:16.652 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.221773.log 2023-10-08T13:45:16.652 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.128363.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156175.log 2023-10-08T13:45:16.652 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.79887.log: /var/log/ceph/ceph-client.admin.221773.log: 78.2% -- replaced with /var/log/ceph/ceph-client.admin.107730.log.gz 2023-10-08T13:45:16.652 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.386556.log 2023-10-08T13:45:16.653 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.156175.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147427.log 2023-10-08T13:45:16.654 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.386556.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.279092.log 2023-10-08T13:45:16.654 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.147427.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.441461.log 2023-10-08T13:45:16.654 INFO:teuthology.orchestra.run.smithi032.stderr: 78.7% -- replaced with /var/log/ceph/ceph-client.admin.108624.log.gz 2023-10-08T13:45:16.654 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.279092.log: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.247071.log.gz 2023-10-08T13:45:16.656 INFO:teuthology.orchestra.run.smithi032.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.309427.log.gz 2023-10-08T13:45:16.656 INFO:teuthology.orchestra.run.smithi032.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.108633.log.gz 2023-10-08T13:45:16.656 INFO:teuthology.orchestra.run.smithi032.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.109885.log.gz 2023-10-08T13:45:16.656 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.299193.log 2023-10-08T13:45:16.656 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.441461.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42382.log 2023-10-08T13:45:16.656 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.299193.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2023-10-08T13:45:16.657 INFO:teuthology.orchestra.run.smithi032.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.318851.log.gz 2023-10-08T13:45:16.657 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.42382.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.212041.log 2023-10-08T13:45:16.657 INFO:teuthology.orchestra.run.smithi032.stderr: 88.7%/var/log/ceph/ceph-osd.1.log: -- replaced with /var/log/ceph/ceph-client.admin.44942.log.gz 2023-10-08T13:45:16.657 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.203604.log 2023-10-08T13:45:16.659 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.212041.log: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.113217.log.gz 2023-10-08T13:45:16.660 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82541.log 2023-10-08T13:45:16.661 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.337381.log 2023-10-08T13:45:16.661 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.203604.log: /var/log/ceph/ceph-client.admin.82541.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.412439.log 2023-10-08T13:45:16.661 INFO:teuthology.orchestra.run.smithi032.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.394935.log.gz 2023-10-08T13:45:16.662 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.337381.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.320789.log 2023-10-08T13:45:16.662 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.412439.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93716.log 2023-10-08T13:45:16.663 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.320789.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.232410.log 2023-10-08T13:45:16.663 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.93716.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167685.log 2023-10-08T13:45:16.664 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.232410.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.36033.log.gz 2023-10-08T13:45:16.664 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.273442.log 2023-10-08T13:45:16.665 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.167685.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43122.log 2023-10-08T13:45:16.665 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.273442.log: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.398346.log.gz 2023-10-08T13:45:16.666 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120341.log 2023-10-08T13:45:16.666 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41258.log 2023-10-08T13:45:16.668 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.43122.log: /var/log/ceph/ceph-client.admin.120341.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43864.log 2023-10-08T13:45:16.669 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.41258.log: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.148651.log.gz 2023-10-08T13:45:16.670 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92900.log 2023-10-08T13:45:16.670 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.43864.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.336549.log.gz 2023-10-08T13:45:16.671 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92167.log 2023-10-08T13:45:16.671 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.92900.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95480.log 2023-10-08T13:45:16.672 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.92167.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.314410.log 2023-10-08T13:45:16.672 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.95480.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.281942.log 2023-10-08T13:45:16.673 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.314410.log: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.128363.log.gz 2023-10-08T13:45:16.673 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.225411.log 2023-10-08T13:45:16.674 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.281942.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.462757.log 2023-10-08T13:45:16.674 INFO:teuthology.orchestra.run.smithi032.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.386951.log.gz 2023-10-08T13:45:16.674 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.225411.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.343002.log 2023-10-08T13:45:16.675 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.462757.log: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.462757.log.gz 2023-10-08T13:45:16.676 INFO:teuthology.orchestra.run.smithi032.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.178104.log.gz 2023-10-08T13:45:16.676 INFO:teuthology.orchestra.run.smithi032.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.154067.log.gz 2023-10-08T13:45:16.676 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.451744.log 2023-10-08T13:45:16.676 INFO:teuthology.orchestra.run.smithi032.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.178903.log.gz 2023-10-08T13:45:16.677 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.376648.log 2023-10-08T13:45:16.677 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.343002.log: /var/log/ceph/ceph-client.admin.451744.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42986.log 2023-10-08T13:45:16.678 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.376648.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.396277.log 2023-10-08T13:45:16.678 INFO:teuthology.orchestra.run.smithi032.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.451744.log.gz 2023-10-08T13:45:16.679 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.42986.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.223796.log 2023-10-08T13:45:16.679 INFO:teuthology.orchestra.run.smithi032.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.130124.log.gz 2023-10-08T13:45:16.679 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.396277.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129875.log 2023-10-08T13:45:16.680 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.223796.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.291829.log 2023-10-08T13:45:16.680 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.129875.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.233637.log 2023-10-08T13:45:16.681 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose /var/log/ceph/ceph-client.admin.291829.log: -- /var/log/ceph/ceph-client.admin.193980.log 2023-10-08T13:45:16.681 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.233637.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.371906.log 2023-10-08T13:45:16.682 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.193980.log: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.392074.log.gz 2023-10-08T13:45:16.682 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.276261.log 2023-10-08T13:45:16.683 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.371906.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168540.log 2023-10-08T13:45:16.683 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.276261.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98806.log 2023-10-08T13:45:16.684 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.168540.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.420803.log 2023-10-08T13:45:16.684 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.98806.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.467378.log 2023-10-08T13:45:16.685 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.420803.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41719.log 2023-10-08T13:45:16.685 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.467378.log: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.79485.log.gz 2023-10-08T13:45:16.686 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172420.log 2023-10-08T13:45:16.687 INFO:teuthology.orchestra.run.smithi032.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.159952.log.gz 2023-10-08T13:45:16.688 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.273433.log 2023-10-08T13:45:16.688 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.41719.log: /var/log/ceph/ceph-client.admin.172420.log: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.362820.log.gz 2023-10-08T13:45:16.688 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.286580.log 2023-10-08T13:45:16.689 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.273433.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.411633.log 2023-10-08T13:45:16.689 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.286580.log: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.366099.log.gz 2023-10-08T13:45:16.689 INFO:teuthology.orchestra.run.smithi032.stderr: 92.5% -- replaced with /var/log/ceph/ceph-client.admin.467378.log.gz 2023-10-08T13:45:16.690 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.461477.log 2023-10-08T13:45:16.691 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.411633.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181382.log 2023-10-08T13:45:16.691 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41036.log 2023-10-08T13:45:16.691 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.461477.log: /var/log/ceph/ceph-client.admin.181382.log: 79.1% -- replaced with /var/log/ceph/ceph-client.admin.183915.log.gz 2023-10-08T13:45:16.691 INFO:teuthology.orchestra.run.smithi032.stderr: 77.5% -- replaced with /var/log/ceph/ceph-client.admin.461477.log.gz 2023-10-08T13:45:16.691 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.422819.log 2023-10-08T13:45:16.692 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.41036.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.449103.log 2023-10-08T13:45:16.692 INFO:teuthology.orchestra.run.smithi032.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.369748.log.gz 2023-10-08T13:45:16.693 INFO:teuthology.orchestra.run.smithi032.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.183924.log.gz 2023-10-08T13:45:16.693 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.422819.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.243222.log 2023-10-08T13:45:16.693 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.449103.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35773.log 2023-10-08T13:45:16.694 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.243222.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.221370.log 2023-10-08T13:45:16.694 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.35773.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.197890.log 2023-10-08T13:45:16.695 INFO:teuthology.orchestra.run.smithi032.stderr: 79.4% -- replaced with /var/log/ceph/ceph-client.admin.412036.log.gz 2023-10-08T13:45:16.695 INFO:teuthology.orchestra.run.smithi032.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.312686.log.gz 2023-10-08T13:45:16.695 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.221370.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163822.log 2023-10-08T13:45:16.696 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.197890.log: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.420794.log.gz 2023-10-08T13:45:16.696 INFO:teuthology.orchestra.run.smithi032.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.399209.log.gz 2023-10-08T13:45:16.697 INFO:teuthology.orchestra.run.smithi032.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.420803.log.gz 2023-10-08T13:45:16.697 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.232006.log 2023-10-08T13:45:16.697 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.163822.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42736.log 2023-10-08T13:45:16.698 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.232006.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.219338.log 2023-10-08T13:45:16.698 INFO:teuthology.orchestra.run.smithi032.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.385748.log.gz 2023-10-08T13:45:16.698 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.42736.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.455557.log 2023-10-08T13:45:16.699 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.219338.log: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.386556.log.gz 2023-10-08T13:45:16.699 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.323121.log 2023-10-08T13:45:16.700 INFO:teuthology.orchestra.run.smithi032.stderr: 84.3% -- replaced with /var/log/ceph/ceph-client.admin.429171.log.gz 2023-10-08T13:45:16.700 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.455557.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105260.log 2023-10-08T13:45:16.701 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.323121.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130949.log 2023-10-08T13:45:16.701 INFO:teuthology.orchestra.run.smithi032.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.232410.log.gz 2023-10-08T13:45:16.701 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.105260.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.451735.log 2023-10-08T13:45:16.702 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.130949.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.402967.log 2023-10-08T13:45:16.702 INFO:teuthology.orchestra.run.smithi032.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.341333.log.gz 2023-10-08T13:45:16.703 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.451735.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.313967.log 2023-10-08T13:45:16.703 INFO:teuthology.orchestra.run.smithi032.stderr: 84.7% -- replaced with /var/log/ceph/ceph-client.admin.451735.log.gz 2023-10-08T13:45:16.703 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.402967.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.288214.log 2023-10-08T13:45:16.704 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.313967.log: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.247062.log.gz 2023-10-08T13:45:16.704 INFO:teuthology.orchestra.run.smithi032.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.343002.log.gz 2023-10-08T13:45:16.704 INFO:teuthology.orchestra.run.smithi032.stderr: 77.5% -- replaced with /var/log/ceph/ceph-client.admin.273433.log.gz 2023-10-08T13:45:16.705 INFO:teuthology.orchestra.run.smithi032.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.279092.log.gz 2023-10-08T13:45:16.705 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.475096.log 2023-10-08T13:45:16.706 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.288214.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.351418.log 2023-10-08T13:45:16.707 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.475096.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.475096.log.gz 2023-10-08T13:45:16.707 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172856.log 2023-10-08T13:45:16.708 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.351418.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.359573.log 2023-10-08T13:45:16.708 INFO:teuthology.orchestra.run.smithi032.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.281127.log.gz 2023-10-08T13:45:16.710 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.172856.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.387354.log 2023-10-08T13:45:16.710 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.359573.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151941.log 2023-10-08T13:45:16.711 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.387354.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44722.log 2023-10-08T13:45:16.711 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.151941.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.357528.log 2023-10-08T13:45:16.713 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.44722.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.465676.log 2023-10-08T13:45:16.714 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.357528.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.287408.log 2023-10-08T13:45:16.714 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.465676.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149460.log 2023-10-08T13:45:16.716 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.287408.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.199526.log 2023-10-08T13:45:16.716 INFO:teuthology.orchestra.run.smithi032.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.291829.log.gz 2023-10-08T13:45:16.716 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.149460.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.387765.log 2023-10-08T13:45:16.717 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.290224.log 2023-10-08T13:45:16.717 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.199526.log: /var/log/ceph/ceph-client.admin.387765.log: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.286580.log.gz 2023-10-08T13:45:16.717 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.346977.log 2023-10-08T13:45:16.717 INFO:teuthology.orchestra.run.smithi032.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.293452.log.gz 2023-10-08T13:45:16.718 INFO:teuthology.orchestra.run.smithi032.stderr: 77.8% -- replaced with /var/log/ceph/ceph-client.admin.337381.log.gz 2023-10-08T13:45:16.719 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.290224.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94156.log 2023-10-08T13:45:16.719 INFO:teuthology.orchestra.run.smithi032.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.465676.log.gz 2023-10-08T13:45:16.720 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.346977.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101232.log 2023-10-08T13:45:16.720 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.94156.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.279915.log 2023-10-08T13:45:16.720 INFO:teuthology.orchestra.run.smithi032.stderr: 79.0% -- replaced with /var/log/ceph/ceph-client.admin.203604.log.gz 2023-10-08T13:45:16.720 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.101232.log: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.405842.log.gz 2023-10-08T13:45:16.720 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.472043.log 2023-10-08T13:45:16.720 INFO:teuthology.orchestra.run.smithi032.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.221773.log.gz 2023-10-08T13:45:16.722 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.279915.log: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.225411.log.gz 2023-10-08T13:45:16.722 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.475013.log 2023-10-08T13:45:16.722 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.472043.log: 97.2% -- replaced with /var/log/ceph/ceph-client.admin.454681.log.gz 2023-10-08T13:45:16.723 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.219745.log 2023-10-08T13:45:16.723 INFO:teuthology.orchestra.run.smithi032.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.414922.log.gz 2023-10-08T13:45:16.723 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.475013.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176896.log 2023-10-08T13:45:16.724 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.219745.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.475013.log.gz 2023-10-08T13:45:16.724 INFO:teuthology.orchestra.run.smithi032.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.41719.log.gz 2023-10-08T13:45:16.724 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.214923.log 2023-10-08T13:45:16.726 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.176896.log: 92.5% -- replaced with /var/log/ceph/ceph-client.admin.472043.log.gz 2023-10-08T13:45:16.726 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.204420.log 2023-10-08T13:45:16.726 INFO:teuthology.orchestra.run.smithi032.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.42382.log.gz 2023-10-08T13:45:16.726 INFO:teuthology.orchestra.run.smithi032.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.415783.log.gz 2023-10-08T13:45:16.726 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.214923.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.358367.log 2023-10-08T13:45:16.728 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.204420.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.419112.log 2023-10-08T13:45:16.729 INFO:teuthology.orchestra.run.smithi032.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.42986.log.gz 2023-10-08T13:45:16.729 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.358367.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.451164.log 2023-10-08T13:45:16.729 INFO:teuthology.orchestra.run.smithi032.stderr: 78.9% -- replaced with /var/log/ceph/ceph-client.admin.179307.log.gz 2023-10-08T13:45:16.729 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.419112.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41255.log 2023-10-08T13:45:16.729 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.449496.log 2023-10-08T13:45:16.729 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.451164.log: /var/log/ceph/ceph-client.admin.41255.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103243.log 2023-10-08T13:45:16.729 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.449496.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.410664.log 2023-10-08T13:45:16.731 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.304758.log 2023-10-08T13:45:16.731 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.103243.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.42736.log.gz 2023-10-08T13:45:16.731 INFO:teuthology.orchestra.run.smithi032.stderr: 79.7% -- replaced with /var/log/ceph/ceph-client.admin.314410.log.gz 2023-10-08T13:45:16.732 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.410664.log: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.101232.log.gz 2023-10-08T13:45:16.732 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.229600.log 2023-10-08T13:45:16.732 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.304758.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.218923.log 2023-10-08T13:45:16.732 INFO:teuthology.orchestra.run.smithi032.stderr: 77.5% -- replaced with /var/log/ceph/ceph-client.admin.323121.log.gz 2023-10-08T13:45:16.732 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.229600.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.469070.log 2023-10-08T13:45:16.733 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.286169.log 2023-10-08T13:45:16.734 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.218923.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.275049.log 2023-10-08T13:45:16.734 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.469070.log: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.469070.log.gz 2023-10-08T13:45:16.734 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.286169.log: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.376648.log.gz 2023-10-08T13:45:16.734 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.428146.log 2023-10-08T13:45:16.734 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.346968.log 2023-10-08T13:45:16.734 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.275049.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.346561.log 2023-10-08T13:45:16.737 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.428146.log: /var/log/ceph/ceph-client.admin.346968.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.375182.log 2023-10-08T13:45:16.738 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.346561.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.220154.log 2023-10-08T13:45:16.738 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.375182.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184726.log 2023-10-08T13:45:16.739 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.220154.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.302110.log 2023-10-08T13:45:16.739 INFO:teuthology.orchestra.run.smithi032.stderr:gzip /var/log/ceph/ceph-client.admin.184726.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.339479.log 2023-10-08T13:45:16.740 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.302110.log: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.94156.log.gz 2023-10-08T13:45:16.740 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.308545.log 2023-10-08T13:45:16.742 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.339479.log: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.402967.log.gz 2023-10-08T13:45:16.742 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.460668.log 2023-10-08T13:45:16.742 INFO:teuthology.orchestra.run.smithi032.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.129562.log.gz 2023-10-08T13:45:16.742 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.340941.log 2023-10-08T13:45:16.742 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.308545.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.181382.log.gz 2023-10-08T13:45:16.743 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.460668.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.460668.log.gz 2023-10-08T13:45:16.743 INFO:teuthology.orchestra.run.smithi032.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.149460.log.gz 2023-10-08T13:45:16.743 INFO:teuthology.orchestra.run.smithi032.stderr: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.183089.log.gz 2023-10-08T13:45:16.743 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.297167.log 2023-10-08T13:45:16.745 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.340941.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.389477.log 2023-10-08T13:45:16.745 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.297167.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.279508.log 2023-10-08T13:45:16.745 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.389477.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.275457.log 2023-10-08T13:45:16.745 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.279508.log: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.236920.log.gz 2023-10-08T13:45:16.745 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.418699.log 2023-10-08T13:45:16.746 INFO:teuthology.orchestra.run.smithi032.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.359573.log.gz 2023-10-08T13:45:16.746 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.275457.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.370155.log 2023-10-08T13:45:16.749 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.418699.log: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.419112.log.gz 2023-10-08T13:45:16.749 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.461889.log 2023-10-08T13:45:16.753 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.370155.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.237787.log 2023-10-08T13:45:16.754 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.461889.log: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.396277.log.gz 2023-10-08T13:45:16.754 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.225004.log 2023-10-08T13:45:16.757 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.237787.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.441452.log 2023-10-08T13:45:16.757 INFO:teuthology.orchestra.run.smithi032.stderr: 78.8% -- replaced with /var/log/ceph/ceph-client.admin.351194.log.gz 2023-10-08T13:45:16.758 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.225004.log: 92.7% -- replaced with /var/log/ceph/ceph-client.admin.461889.log.gz 2023-10-08T13:45:16.758 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119491.log 2023-10-08T13:45:16.758 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.341735.log 2023-10-08T13:45:16.759 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.441452.log: /var/log/ceph/ceph-client.admin.119491.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.400411.log 2023-10-08T13:45:16.760 INFO:teuthology.orchestra.run.smithi032.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.219338.log.gz 2023-10-08T13:45:16.760 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.341735.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.351097.log 2023-10-08T13:45:16.760 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.400411.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.336540.log 2023-10-08T13:45:16.761 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.351097.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105655.log 2023-10-08T13:45:16.761 INFO:teuthology.orchestra.run.smithi032.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.441863.log.gz 2023-10-08T13:45:16.762 INFO:teuthology.orchestra.run.smithi032.stderr: 90.5%/var/log/ceph/ceph-client.admin.336540.log: -- replaced with /var/log/ceph/ceph-client.admin.219745.log.gz 2023-10-08T13:45:16.762 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42241.log 2023-10-08T13:45:16.763 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.105655.log: 79.1% -- replaced with /var/log/ceph/ceph-client.admin.225004.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41044.log 2023-10-08T13:45:16.763 INFO:teuthology.orchestra.run.smithi032.stderr: 2023-10-08T13:45:16.764 INFO:teuthology.orchestra.run.smithi032.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.220154.log.gz 2023-10-08T13:45:16.765 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.42241.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112785.log 2023-10-08T13:45:16.765 INFO:teuthology.orchestra.run.smithi032.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.232006.log.gz 2023-10-08T13:45:16.765 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129168.log 2023-10-08T13:45:16.765 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.41044.log: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.229600.log.gz 2023-10-08T13:45:16.765 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.112785.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100020.log 2023-10-08T13:45:16.766 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.129168.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.349148.log 2023-10-08T13:45:16.766 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.100020.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153636.log 2023-10-08T13:45:16.767 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.349148.log: 78.0% -- replaced with /var/log/ceph/ceph-client.admin.336540.log.gz 2023-10-08T13:45:16.767 INFO:teuthology.orchestra.run.smithi032.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.279915.log.gz 2023-10-08T13:45:16.768 INFO:teuthology.orchestra.run.smithi032.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.286169.log.gz 2023-10-08T13:45:16.768 INFO:teuthology.orchestra.run.smithi032.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.340941.log.gz 2023-10-08T13:45:16.768 INFO:teuthology.orchestra.run.smithi032.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.358367.log.gz 2023-10-08T13:45:16.768 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.449908.log 2023-10-08T13:45:16.768 INFO:teuthology.orchestra.run.smithi032.stderr: 92.0% -- replaced with /var/log/ceph/ceph-client.admin.243222.log.gz 2023-10-08T13:45:16.769 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.153636.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.349139.log 2023-10-08T13:45:16.769 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.449908.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.390816.log 2023-10-08T13:45:16.770 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.349139.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.408863.log 2023-10-08T13:45:16.770 INFO:teuthology.orchestra.run.smithi032.stderr: 78.7% -- replaced with /var/log/ceph/ceph-client.admin.411633.log.gz 2023-10-08T13:45:16.772 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.390816.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.295132.log 2023-10-08T13:45:16.772 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.450329.log 2023-10-08T13:45:16.772 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.408863.log: /var/log/ceph/ceph-client.admin.295132.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44780.log 2023-10-08T13:45:16.772 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.450329.log: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.275457.log.gz 2023-10-08T13:45:16.772 INFO:teuthology.orchestra.run.smithi032.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.214923.log.gz 2023-10-08T13:45:16.773 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.373527.log 2023-10-08T13:45:16.774 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.44780.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.442668.log 2023-10-08T13:45:16.774 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.373527.log: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.203201.log.gz 2023-10-08T13:45:16.775 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.202001.log 2023-10-08T13:45:16.775 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.442668.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.428769.log 2023-10-08T13:45:16.776 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.202001.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.204016.log.gz 2023-10-08T13:45:16.777 INFO:teuthology.orchestra.run.smithi032.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.204420.log.gz 2023-10-08T13:45:16.777 INFO:teuthology.orchestra.run.smithi032.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.172420.log.gz 2023-10-08T13:45:16.778 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.286178.log 2023-10-08T13:45:16.778 INFO:teuthology.orchestra.run.smithi032.stderr: 97.1% -- replaced with /var/log/ceph/ceph-client.admin.455991.log.gz 2023-10-08T13:45:16.778 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.428769.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97098.log 2023-10-08T13:45:16.778 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.286178.log: 77.4% -- replaced with /var/log/ceph/ceph-client.admin.172856.log.gz 2023-10-08T13:45:16.778 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.275859.log 2023-10-08T13:45:16.780 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.97098.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.424839.log 2023-10-08T13:45:16.780 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.275859.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.314885.log 2023-10-08T13:45:16.780 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.424839.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.402500.log 2023-10-08T13:45:16.780 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.314885.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.337838.log 2023-10-08T13:45:16.780 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.402500.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.41044.log.gz 2023-10-08T13:45:16.781 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44915.log 2023-10-08T13:45:16.781 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.337838.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82125.log 2023-10-08T13:45:16.782 INFO:teuthology.orchestra.run.smithi032.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.41638.log.gz 2023-10-08T13:45:16.782 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.44915.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.467794.log 2023-10-08T13:45:16.782 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.82125.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179316.log 2023-10-08T13:45:16.782 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.467794.log: 84.0% -- replaced with /var/log/ceph/ceph-client.admin.467794.log.gz 2023-10-08T13:45:16.783 INFO:teuthology.orchestra.run.smithi032.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.42790.log.gz 2023-10-08T13:45:16.784 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.475550.log 2023-10-08T13:45:16.784 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.179316.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.291838.log 2023-10-08T13:45:16.785 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.475550.log: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.100020.log.gz 2023-10-08T13:45:16.785 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.200733.log 2023-10-08T13:45:16.786 INFO:teuthology.orchestra.run.smithi032.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.475550.log.gz 2023-10-08T13:45:16.786 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.291838.log: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.104048.log.gz 2023-10-08T13:45:16.786 INFO:teuthology.orchestra.run.smithi032.stderr: 93.0% -- replaced with /var/log/ceph/ceph-client.admin.93312.log.gz 2023-10-08T13:45:16.787 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.228382.log 2023-10-08T13:45:16.787 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.200733.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110691.log 80.3% 2023-10-08T13:45:16.787 INFO:teuthology.orchestra.run.smithi032.stderr: -- replaced with /var/log/ceph/ceph-client.admin.302909.log.gz 2023-10-08T13:45:16.788 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.228382.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179710.log 2023-10-08T13:45:16.789 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.110691.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.475928.log 2023-10-08T13:45:16.789 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.179710.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.407494.log 2023-10-08T13:45:16.789 INFO:teuthology.orchestra.run.smithi032.stderr: 79.2% -- replaced with /var/log/ceph/ceph-client.admin.311874.log.gz 2023-10-08T13:45:16.789 INFO:teuthology.orchestra.run.smithi032.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.303820.log.gz 2023-10-08T13:45:16.789 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.236516.log 2023-10-08T13:45:16.791 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.475928.log: /var/log/ceph/ceph-client.admin.407494.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.475928.log.gz 2023-10-08T13:45:16.791 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.444268.log 2023-10-08T13:45:16.791 INFO:teuthology.orchestra.run.smithi032.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.390816.log.gz 2023-10-08T13:45:16.791 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85176.log 2023-10-08T13:45:16.791 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.236516.log: /var/log/ceph/ceph-client.admin.444268.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.473807.log 2023-10-08T13:45:16.791 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.85176.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.339470.log 2023-10-08T13:45:16.792 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.473807.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.401681.log 2023-10-08T13:45:16.792 INFO:teuthology.orchestra.run.smithi032.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.388171.log.gz 2023-10-08T13:45:16.793 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.339470.log: /var/log/ceph/ceph-client.admin.397936.log 2023-10-08T13:45:16.794 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.401681.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121160.log 2023-10-08T13:45:16.794 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.397936.log: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.392922.log.gz 2023-10-08T13:45:16.794 INFO:teuthology.orchestra.run.smithi032.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.105251.log.gz 2023-10-08T13:45:16.794 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.219736.log 2023-10-08T13:45:16.795 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.121160.log: 79.7% -- replaced with /var/log/ceph/ceph-client.admin.105655.log.gz 2023-10-08T13:45:16.795 INFO:teuthology.orchestra.run.smithi032.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.402500.log.gz 2023-10-08T13:45:16.796 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.475847.log 2023-10-08T13:45:16.797 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.219736.log: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.288214.log.gz 2023-10-08T13:45:16.797 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85645.log 2023-10-08T13:45:16.798 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.475847.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44448.log 2023-10-08T13:45:16.798 INFO:teuthology.orchestra.run.smithi032.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.475847.log.gz 2023-10-08T13:45:16.799 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.85645.log: 92.9% -- replaced with /var/log/ceph/ceph-client.admin.473807.log.gz 2023-10-08T13:45:16.799 INFO:teuthology.orchestra.run.smithi032.stderr: 78.4% -- replaced with /var/log/ceph/ceph-client.admin.290224.log.gz 2023-10-08T13:45:16.799 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.386547.log 2023-10-08T13:45:16.799 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.44448.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.284889.log 2023-10-08T13:45:16.800 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.386547.log: 90.5%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.129168.log.gz--verbose -- 2023-10-08T13:45:16.800 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.40342.log 2023-10-08T13:45:16.800 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.284889.log: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.351097.log.gz 2023-10-08T13:45:16.800 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42905.log 2023-10-08T13:45:16.801 INFO:teuthology.orchestra.run.smithi032.stderr: 78.4% -- replaced with /var/log/ceph/ceph-client.admin.370155.log.gz 2023-10-08T13:45:16.801 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.40342.log: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.418699.log.gz 2023-10-08T13:45:16.802 INFO:teuthology.orchestra.run.smithi032.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.369355.log.gz 2023-10-08T13:45:16.802 INFO:teuthology.orchestra.run.smithi032.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.442668.log.gz 2023-10-08T13:45:16.802 INFO:teuthology.orchestra.run.smithi032.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.450329.log.gz 2023-10-08T13:45:16.803 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112379.log 2023-10-08T13:45:16.803 INFO:teuthology.orchestra.run.smithi032.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.179710.log.gz 2023-10-08T13:45:16.803 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.42905.log: 78.9% -- replaced with /var/log/ceph/ceph-client.admin.219736.log.gz 2023-10-08T13:45:16.803 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.393329.log 2023-10-08T13:45:16.804 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.112379.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.282757.log 2023-10-08T13:45:16.804 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.393329.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44888.log 2023-10-08T13:45:16.805 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.282757.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.336142.log 2023-10-08T13:45:16.807 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.44888.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.355043.log 2023-10-08T13:45:16.807 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194849.log 2023-10-08T13:45:16.807 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.336142.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.243213.log 2023-10-08T13:45:16.808 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.355043.log: /var/log/ceph/ceph-client.admin.194849.log: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.202001.log.gz 2023-10-08T13:45:16.808 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43891.log 2023-10-08T13:45:16.809 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.243213.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.242793.log 2023-10-08T13:45:16.809 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.43891.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174472.log 2023-10-08T13:45:16.810 INFO:teuthology.orchestra.run.smithi032.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.441452.log.gz 2023-10-08T13:45:16.814 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.242793.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.374781.log 2023-10-08T13:45:16.815 INFO:teuthology.orchestra.run.smithi032.stderr:gzip /var/log/ceph/ceph-client.admin.174472.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.178508.log 2023-10-08T13:45:16.816 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.374781.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.443464.log 2023-10-08T13:45:16.816 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.178508.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.199133.log 2023-10-08T13:45:16.816 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.443464.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.471609.log 2023-10-08T13:45:16.817 INFO:teuthology.orchestra.run.smithi032.stderr: 84.2%/var/log/ceph/ceph-client.admin.199133.log: -- replaced with /var/log/ceph/ceph-client.admin.294726.log.gz 2023-10-08T13:45:16.817 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.272624.log 2023-10-08T13:45:16.818 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.471609.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.397490.log 2023-10-08T13:45:16.818 INFO:teuthology.orchestra.run.smithi032.stderr: 83.2% -- replaced with /var/log/ceph/ceph-client.admin.471609.log.gz 2023-10-08T13:45:16.819 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.272624.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174874.log 2023-10-08T13:45:16.819 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.212469.log 2023-10-08T13:45:16.820 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.397490.log: /var/log/ceph/ceph-client.admin.174874.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.302918.log 2023-10-08T13:45:16.820 INFO:teuthology.orchestra.run.smithi032.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.282757.log.gz 2023-10-08T13:45:16.820 INFO:teuthology.orchestra.run.smithi032.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.283675.log.gz 2023-10-08T13:45:16.820 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.212469.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.275466.log 2023-10-08T13:45:16.821 INFO:teuthology.orchestra.run.smithi032.stderr: 84.4% -- replaced with /var/log/ceph/ceph-client.admin.339470.log.gz 2023-10-08T13:45:16.821 INFO:teuthology.orchestra.run.smithi032.stderr: 77.8% -- replaced with /var/log/ceph/ceph-client.admin.339946.log.gz 2023-10-08T13:45:16.821 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41038.log 2023-10-08T13:45:16.822 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.302918.log: /var/log/ceph/ceph-client.admin.275466.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.205250.log 2023-10-08T13:45:16.823 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.41038.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35900.log 2023-10-08T13:45:16.823 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.222991.log 2023-10-08T13:45:16.823 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.205250.log: gzip -5 /var/log/ceph/ceph-client.admin.35900.log: --verbose -- /var/log/ceph/ceph-client.admin.109037.log 2023-10-08T13:45:16.823 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.279499.log 2023-10-08T13:45:16.823 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.222991.log: /var/log/ceph/ceph-client.admin.109037.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.201992.log 2023-10-08T13:45:16.824 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.279499.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113624.log 2023-10-08T13:45:16.824 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.201992.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.227875.log 2023-10-08T13:45:16.825 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.113624.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.204411.log 2023-10-08T13:45:16.826 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.227875.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.303345.log 2023-10-08T13:45:16.826 INFO:teuthology.orchestra.run.smithi032.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.199133.log.gz 2023-10-08T13:45:16.826 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.204411.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190201.log 2023-10-08T13:45:16.827 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.303345.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.223385.log 2023-10-08T13:45:16.829 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.190201.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.313492.log 2023-10-08T13:45:16.830 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.223385.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.342993.log 2023-10-08T13:45:16.830 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.374374.log 2023-10-08T13:45:16.831 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.313492.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.305681.log 2023-10-08T13:45:16.831 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.342993.log: /var/log/ceph/ceph-client.admin.374374.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162114.log 2023-10-08T13:45:16.832 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.305681.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186752.log 2023-10-08T13:45:16.833 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151089.log 2023-10-08T13:45:16.833 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.162114.log: /var/log/ceph/ceph-client.admin.186752.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.418290.log 2023-10-08T13:45:16.834 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.151089.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166392.log 2023-10-08T13:45:16.835 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.418290.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102840.log 2023-10-08T13:45:16.835 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.291436.log 2023-10-08T13:45:16.836 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.166392.log: /var/log/ceph/ceph-client.admin.102840.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.309839.log 2023-10-08T13:45:16.836 INFO:teuthology.orchestra.run.smithi032.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.236516.log.gz 2023-10-08T13:45:16.836 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.291436.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.308993.log 2023-10-08T13:45:16.837 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.309839.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44996.log 2023-10-08T13:45:16.838 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.308993.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.209635.log 2023-10-08T13:45:16.838 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.44996.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.377047.log 2023-10-08T13:45:16.839 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.209635.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.243653.log 2023-10-08T13:45:16.840 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.377047.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.454232.log 2023-10-08T13:45:16.840 INFO:teuthology.orchestra.run.smithi032.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.355043.log.gz 2023-10-08T13:45:16.841 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.243653.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193971.log 2023-10-08T13:45:16.842 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.454232.log: 79.9% -- replaced with /var/log/ceph/ceph-client.admin.454232.log.gz 2023-10-08T13:45:16.842 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41037.log 2023-10-08T13:45:16.842 INFO:teuthology.orchestra.run.smithi032.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.admin.321703.log.gz 2023-10-08T13:45:16.842 INFO:teuthology.orchestra.run.smithi032.stderr:gzip /var/log/ceph/ceph-client.admin.193971.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.94147.log 2023-10-08T13:45:16.843 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.41037.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45101.log 2023-10-08T13:45:16.843 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.94147.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81247.log 2023-10-08T13:45:16.844 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.45101.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.367310.log 2023-10-08T13:45:16.845 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.81247.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.214521.log 2023-10-08T13:45:16.845 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.367310.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40828.log 2023-10-08T13:45:16.846 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.214521.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.412907.log 2023-10-08T13:45:16.846 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.40828.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.272228.log 2023-10-08T13:45:16.847 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.412907.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44323.log 2023-10-08T13:45:16.847 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.272228.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41910.log 2023-10-08T13:45:16.848 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.44323.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41234.log 2023-10-08T13:45:16.848 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.41910.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.449899.log 2023-10-08T13:45:16.849 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.41234.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.364063.log 2023-10-08T13:45:16.850 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.449899.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.342161.log 2023-10-08T13:45:16.850 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.364063.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.416588.log 2023-10-08T13:45:16.851 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.298375.log 2023-10-08T13:45:16.851 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.342161.log: /var/log/ceph/ceph-client.admin.416588.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94558.log 2023-10-08T13:45:16.852 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.298375.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81256.log 2023-10-08T13:45:16.853 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.94558.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44888.log.gz 2023-10-08T13:45:16.853 INFO:teuthology.orchestra.run.smithi032.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43999.log.gz 88.7% 2023-10-08T13:45:16.853 INFO:teuthology.orchestra.run.smithi032.stderr: -- replaced with /var/log/ceph/ceph-client.admin.44915.log.gz 2023-10-08T13:45:16.853 INFO:teuthology.orchestra.run.smithi032.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.44215.log.gz 2023-10-08T13:45:16.853 INFO:teuthology.orchestra.run.smithi032.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44780.log.gz 2023-10-08T13:45:16.854 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154076.log 2023-10-08T13:45:16.854 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.81256.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97495.log 2023-10-08T13:45:16.855 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.154076.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.199928.log 2023-10-08T13:45:16.856 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.97495.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150679.log 2023-10-08T13:45:16.856 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.199928.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180122.log 2023-10-08T13:45:16.856 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.150679.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43810.log 2023-10-08T13:45:16.856 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.180122.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42844.log 2023-10-08T13:45:16.858 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.43810.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.385739.log 2023-10-08T13:45:16.858 INFO:teuthology.orchestra.run.smithi032.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.163822.log.gz 2023-10-08T13:45:16.858 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.463971.log 2023-10-08T13:45:16.858 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.42844.log: /var/log/ceph/ceph-client.admin.385739.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.40342.log.gz 2023-10-08T13:45:16.859 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.361591.log 2023-10-08T13:45:16.859 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.463971.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.244602.log 2023-10-08T13:45:16.859 INFO:teuthology.orchestra.run.smithi032.stderr: 82.6% -- replaced with /var/log/ceph/ceph-client.admin.463971.log.gz 2023-10-08T13:45:16.859 INFO:teuthology.orchestra.run.smithi032.stderr:gzip /var/log/ceph/ceph-client.admin.361591.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.312284.log 2023-10-08T13:45:16.859 INFO:teuthology.orchestra.run.smithi032.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.85645.log.gz 2023-10-08T13:45:16.860 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.244602.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122825.log 2023-10-08T13:45:16.860 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.312284.log: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.291035.log.gz 2023-10-08T13:45:16.860 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.222982.log 2023-10-08T13:45:16.862 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.122825.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.445072.log 2023-10-08T13:45:16.862 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.222982.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.340529.log 2023-10-08T13:45:16.862 INFO:teuthology.orchestra.run.smithi032.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.110691.log.gz 2023-10-08T13:45:16.862 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.445072.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160354.log 2023-10-08T13:45:16.862 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.340529.log: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.112379.log.gz 2023-10-08T13:45:16.863 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.416185.log 2023-10-08T13:45:16.866 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.160354.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157045.log 2023-10-08T13:45:16.866 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44612.log 2023-10-08T13:45:16.868 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.416185.log: /var/log/ceph/ceph-client.admin.157045.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.317053.log 2023-10-08T13:45:16.868 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.44612.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193063.log 2023-10-08T13:45:16.868 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.317053.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.448692.log 2023-10-08T13:45:16.868 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.193063.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41476.log 2023-10-08T13:45:16.870 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.448692.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109876.log 2023-10-08T13:45:16.870 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.41476.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.475523.log 2023-10-08T13:45:16.870 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.109876.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97089.log 2023-10-08T13:45:16.870 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.475523.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.475523.log.gz 2023-10-08T13:45:16.871 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.245443.log 2023-10-08T13:45:16.871 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.97089.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151510.log 2023-10-08T13:45:16.872 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.245443.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42355.log 2023-10-08T13:45:16.872 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.151510.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.201143.log 2023-10-08T13:45:16.873 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.42355.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.457688.log 2023-10-08T13:45:16.874 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.201143.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.213720.log 2023-10-08T13:45:16.874 INFO:teuthology.orchestra.run.smithi032.stderr: 78.8% -- replaced with /var/log/ceph/ceph-client.admin.174874.log.gz 2023-10-08T13:45:16.874 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.457688.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.399615.log 2023-10-08T13:45:16.875 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.213720.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.228796.log 2023-10-08T13:45:16.876 INFO:teuthology.orchestra.run.smithi032.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.457688.log.gz 2023-10-08T13:45:16.876 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.399615.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.434009.log 2023-10-08T13:45:16.877 INFO:teuthology.orchestra.run.smithi032.stderr: 78.8% -- replaced with /var/log/ceph/ceph-client.admin.386547.log.gz 2023-10-08T13:45:16.877 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.228796.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43783.log 2023-10-08T13:45:16.877 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.434009.log: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.386152.log.gz 2023-10-08T13:45:16.878 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155764.log 2023-10-08T13:45:16.878 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.43783.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.364878.log 2023-10-08T13:45:16.880 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.155764.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.462748.log 2023-10-08T13:45:16.880 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.364878.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174079.log 2023-10-08T13:45:16.880 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.462748.log: 93.0% -- replaced with /var/log/ceph/ceph-client.admin.387765.log.gz 2023-10-08T13:45:16.880 INFO:teuthology.orchestra.run.smithi032.stderr: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.462748.log.gz 2023-10-08T13:45:16.880 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.359968.log 2023-10-08T13:45:16.882 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.174079.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.447494.log 2023-10-08T13:45:16.882 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.359968.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43643.log 2023-10-08T13:45:16.882 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.447494.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182678.log 2023-10-08T13:45:16.884 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.43643.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40038.log 2023-10-08T13:45:16.884 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.182678.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149058.log 2023-10-08T13:45:16.884 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.40038.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122372.log 2023-10-08T13:45:16.884 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41019.log 2023-10-08T13:45:16.885 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.149058.log: /var/log/ceph/ceph-client.admin.122372.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172865.log 2023-10-08T13:45:16.885 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.41019.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.440810.log 2023-10-08T13:45:16.886 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.172865.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.290634.log 2023-10-08T13:45:16.886 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.440810.log: 97.1% -- replaced with /var/log/ceph/ceph-client.admin.455557.log.gz 2023-10-08T13:45:16.887 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.224606.log 2023-10-08T13:45:16.887 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.365276.log 2023-10-08T13:45:16.891 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.290634.log: /var/log/ceph/ceph-client.admin.224606.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105664.log 2023-10-08T13:45:16.891 INFO:teuthology.orchestra.run.smithi032.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.401288.log.gz 2023-10-08T13:45:16.891 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.365276.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120741.log 2023-10-08T13:45:16.891 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.415333.log /var/log/ceph/ceph-client.admin.105664.log: 2023-10-08T13:45:16.892 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.197083.log 2023-10-08T13:45:16.892 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.120741.log: /var/log/ceph/ceph-client.admin.415333.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.430377.log 2023-10-08T13:45:16.892 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.475177.log 2023-10-08T13:45:16.892 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.197083.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106069.log 2023-10-08T13:45:16.892 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.430377.log: /var/log/ceph/ceph-client.admin.475177.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.234039.log 2023-10-08T13:45:16.892 INFO:teuthology.orchestra.run.smithi032.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.475177.log.gz 2023-10-08T13:45:16.892 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42544.log 2023-10-08T13:45:16.892 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.106069.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164694.log 2023-10-08T13:45:16.893 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.234039.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.389018.log 2023-10-08T13:45:16.893 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.42544.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.284479.log 2023-10-08T13:45:16.893 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.164694.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.226225.log 2023-10-08T13:45:16.893 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.389018.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127431.log 2023-10-08T13:45:16.893 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.284479.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.195272.log 2023-10-08T13:45:16.893 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.226225.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.347884.log 2023-10-08T13:45:16.893 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.127431.log: gzip /var/log/ceph/ceph-client.admin.195272.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.95892.log 2023-10-08T13:45:16.897 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.405258.log 2023-10-08T13:45:16.897 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.347884.log: /var/log/ceph/ceph-client.admin.95892.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41827.log 2023-10-08T13:45:16.898 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.405258.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.360783.log 2023-10-08T13:45:16.898 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.41827.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.385286.log 2023-10-08T13:45:16.898 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.196689.log 2023-10-08T13:45:16.898 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.360783.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.466953.log 2023-10-08T13:45:16.898 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.385286.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96285.log 2023-10-08T13:45:16.898 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.196689.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.218932.log 2023-10-08T13:45:16.898 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.466953.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.218050.log 2023-10-08T13:45:16.899 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.96285.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.340932.log 2023-10-08T13:45:16.899 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.218932.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.207998.log 2023-10-08T13:45:16.899 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.218050.log: /var/log/ceph/ceph-client.admin.340932.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40612.log 2023-10-08T13:45:16.899 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.207998.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181813.log 2023-10-08T13:45:16.899 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80293.log 2023-10-08T13:45:16.899 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.40612.log: /var/log/ceph/ceph-client.admin.181813.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41449.log 2023-10-08T13:45:16.899 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.80293.log: 92.5% -- replaced with /var/log/ceph/ceph-client.admin.466953.log.gz 2023-10-08T13:45:16.899 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.458960.log 2023-10-08T13:45:16.900 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.41449.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.475340.log 2023-10-08T13:45:16.903 INFO:teuthology.orchestra.run.smithi032.stderr:gzip /var/log/ceph/ceph-client.admin.458960.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.402096.log 2023-10-08T13:45:16.904 INFO:teuthology.orchestra.run.smithi032.stderr: 81.2%/var/log/ceph/ceph-client.admin.475340.log: -- replaced with /var/log/ceph/ceph-client.admin.458960.log.gz 2023-10-08T13:45:16.904 INFO:teuthology.orchestra.run.smithi032.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.475340.log.gz 2023-10-08T13:45:16.904 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.309848.log 2023-10-08T13:45:16.904 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.402096.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.233628.log 2023-10-08T13:45:16.904 INFO:teuthology.orchestra.run.smithi032.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.200733.log.gz 2023-10-08T13:45:16.904 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.309848.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.350389.log 2023-10-08T13:45:16.904 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.233628.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.442266.log 2023-10-08T13:45:16.905 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 /var/log/ceph/ceph-client.admin.350389.log: --verbose -- /var/log/ceph/ceph-client.admin.106875.log 2023-10-08T13:45:16.905 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.416579.log 2023-10-08T13:45:16.905 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.442266.log: /var/log/ceph/ceph-client.admin.106875.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.345459.log 2023-10-08T13:45:16.905 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.416579.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41237.log 2023-10-08T13:45:16.905 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.345459.log: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.393329.log.gz 2023-10-08T13:45:16.906 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.469920.log 2023-10-08T13:45:16.906 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.365285.log 2023-10-08T13:45:16.906 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.41237.log: 77.9% -- replaced with /var/log/ceph/ceph-client.admin.189790.log.gz 2023-10-08T13:45:16.906 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.225013.log 2023-10-08T13:45:16.906 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.469920.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.469920.log.gz 2023-10-08T13:45:16.906 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.365285.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.428362.log 2023-10-08T13:45:16.906 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.236507.log 2023-10-08T13:45:16.906 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.225013.log: /var/log/ceph/ceph-client.admin.428362.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95489.log 2023-10-08T13:45:16.907 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.236507.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151950.log 2023-10-08T13:45:16.912 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.95489.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.216403.log 2023-10-08T13:45:16.912 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.151950.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174883.log 2023-10-08T13:45:16.912 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.397079.log 2023-10-08T13:45:16.912 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.216403.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.419917.log 2023-10-08T13:45:16.912 INFO:teuthology.orchestra.run.smithi032.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.193971.log.gz 2023-10-08T13:45:16.912 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.174883.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154498.log 2023-10-08T13:45:16.913 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.397079.log: /var/log/ceph/ceph-client.admin.419917.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.295141.log 2023-10-08T13:45:16.913 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.291427.log 2023-10-08T13:45:16.913 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.154498.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.281519.log 2023-10-08T13:45:16.913 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.295141.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189799.log 2023-10-08T13:45:16.913 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.291427.log: /var/log/ceph/ceph-client.admin.281519.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.414118.log 2023-10-08T13:45:16.913 INFO:teuthology.orchestra.run.smithi032.stderr: 78.7% -- replaced with /var/log/ceph/ceph-client.admin.308545.log.gz 2023-10-08T13:45:16.913 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.213316.log 2023-10-08T13:45:16.913 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.189799.log: 77.7% -- replaced with /var/log/ceph/ceph-client.admin.340932.log.gz 2023-10-08T13:45:16.914 INFO:teuthology.orchestra.run.smithi032.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.340529.log.gz 2023-10-08T13:45:16.914 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.414118.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43918.log 2023-10-08T13:45:16.914 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.213316.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148642.log 2023-10-08T13:45:16.914 INFO:teuthology.orchestra.run.smithi032.stderr: 80.9%/var/log/ceph/ceph-client.admin.43918.log: -- replaced with /var/log/ceph/ceph-client.admin.342993.log.gz 2023-10-08T13:45:16.914 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113615.log 2023-10-08T13:45:16.914 INFO:teuthology.orchestra.run.smithi032.stderr: 78.8%/var/log/ceph/ceph-client.admin.148642.log: -- replaced with /var/log/ceph/ceph-client.admin.97495.log.gz 2023-10-08T13:45:16.914 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.475442.log 2023-10-08T13:45:16.915 INFO:teuthology.orchestra.run.smithi032.stderr: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.412907.log.gz 2023-10-08T13:45:16.915 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.113615.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157923.log 2023-10-08T13:45:16.915 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.475442.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.475442.log.gz 2023-10-08T13:45:16.915 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.354644.log 2023-10-08T13:45:16.920 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.157923.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179719.log 2023-10-08T13:45:16.920 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.354644.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40369.log 2023-10-08T13:45:16.920 INFO:teuthology.orchestra.run.smithi032.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.399615.log.gz 2023-10-08T13:45:16.920 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.179719.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.321246.log 2023-10-08T13:45:16.920 INFO:teuthology.orchestra.run.smithi032.stderr: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.418708.log.gz 2023-10-08T13:45:16.920 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.40369.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.297964.log 2023-10-08T13:45:16.920 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.321246.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194840.log 2023-10-08T13:45:16.921 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.297964.log: gzip -5 --verbose -- 88.8%/var/log/ceph/ceph-client.admin.358358.log -- replaced with /var/log/ceph/ceph-client.admin.44448.log.gz 2023-10-08T13:45:16.921 INFO:teuthology.orchestra.run.smithi032.stderr: 2023-10-08T13:45:16.921 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose 79.4%-- -- replaced with /var/log/ceph/ceph-client.admin.222982.log.gz/var/log/ceph/ceph-client.admin.448298.log 2023-10-08T13:45:16.921 INFO:teuthology.orchestra.run.smithi032.stderr: 2023-10-08T13:45:16.921 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.194840.log: /var/log/ceph/ceph-client.admin.358358.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.457281.log 2023-10-08T13:45:16.921 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.448298.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192605.log 2023-10-08T13:45:16.922 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.457281.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.409266.log 2023-10-08T13:45:16.922 INFO:teuthology.orchestra.run.smithi032.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.197083.log.gz 2023-10-08T13:45:16.922 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.192605.log: 78.8% -- replaced with /var/log/ceph/ceph-client.admin.236507.log.gz 2023-10-08T13:45:16.922 INFO:teuthology.orchestra.run.smithi032.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.196689.log.gz 2023-10-08T13:45:16.922 INFO:teuthology.orchestra.run.smithi032.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.457281.log.gz 2023-10-08T13:45:16.922 INFO:teuthology.orchestra.run.smithi032.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.243653.log.gz 2023-10-08T13:45:16.922 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130517.log 2023-10-08T13:45:16.923 INFO:teuthology.orchestra.run.smithi032.stderr: 78.7% -- replaced with /var/log/ceph/ceph-client.admin.279906.log.gz 2023-10-08T13:45:16.923 INFO:teuthology.orchestra.run.smithi032.stderr: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.284077.log.gz 2023-10-08T13:45:16.923 INFO:teuthology.orchestra.run.smithi032.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.228796.log.gz 2023-10-08T13:45:16.923 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.409266.log: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.292233.log.gz 2023-10-08T13:45:16.923 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.207518.log 2023-10-08T13:45:16.923 INFO:teuthology.orchestra.run.smithi032.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.275466.log.gz 2023-10-08T13:45:16.923 INFO:teuthology.orchestra.run.smithi032.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.285374.log.gz 2023-10-08T13:45:16.924 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.130517.log: 83.3% -- replaced with /var/log/ceph/ceph-client.admin.212460.log.gz 2023-10-08T13:45:16.924 INFO:teuthology.orchestra.run.smithi032.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.361591.log.gz 2023-10-08T13:45:16.924 INFO:teuthology.orchestra.run.smithi032.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.354644.log.gz 2023-10-08T13:45:16.924 INFO:teuthology.orchestra.run.smithi032.stderr: 94.0% -- replaced with /var/log/ceph/ceph-client.admin.368114.log.gz 2023-10-08T13:45:16.924 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.475496.log 2023-10-08T13:45:16.924 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.207518.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.234432.log 2023-10-08T13:45:16.927 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.475496.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.475496.log.gz 2023-10-08T13:45:16.928 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.426932.log 2023-10-08T13:45:16.928 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.234432.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.204007.log 2023-10-08T13:45:16.928 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.426932.log: 93.0% -- replaced with /var/log/ceph/ceph-client.admin.364466.log.gz 2023-10-08T13:45:16.928 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.376309.log 2023-10-08T13:45:16.928 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.204007.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.359171.log 2023-10-08T13:45:16.928 INFO:teuthology.orchestra.run.smithi032.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.148239.log.gz 2023-10-08T13:45:16.928 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.376309.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.413321.log 2023-10-08T13:45:16.929 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.335726.log 2023-10-08T13:45:16.929 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.359171.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.345029.log 2023-10-08T13:45:16.929 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.413321.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.415324.log 2023-10-08T13:45:16.929 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.335726.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.234834.log 2023-10-08T13:45:16.929 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.345029.log: /var/log/ceph/ceph-client.admin.415324.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.466527.log 2023-10-08T13:45:16.929 INFO:teuthology.orchestra.run.smithi032.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.150679.log.gz 2023-10-08T13:45:16.929 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.234834.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.368944.log 2023-10-08T13:45:16.932 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.466527.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.397481.log 2023-10-08T13:45:16.933 INFO:teuthology.orchestra.run.smithi032.stderr: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.466527.log.gz 2023-10-08T13:45:16.933 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.368944.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-10-08T13:45:16.933 INFO:teuthology.orchestra.run.smithi032.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42905.log.gz 2023-10-08T13:45:16.933 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41854.log 2023-10-08T13:45:16.933 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.397481.log: /var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.377454.log 2023-10-08T13:45:16.933 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.335735.log 2023-10-08T13:45:16.933 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.41854.log: /var/log/ceph/ceph-client.admin.377454.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41773.log 2023-10-08T13:45:16.933 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.335735.log: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.121160.log.gz 2023-10-08T13:45:16.934 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40609.log 2023-10-08T13:45:16.934 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.41773.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41259.log 2023-10-08T13:45:16.936 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.40609.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111106.log 2023-10-08T13:45:16.936 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.41259.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.220968.log 2023-10-08T13:45:16.936 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.111106.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40201.log 2023-10-08T13:45:16.936 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.220968.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83416.log 2023-10-08T13:45:16.937 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.40201.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83425.log 2023-10-08T13:45:16.937 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.401279.log 2023-10-08T13:45:16.937 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.83416.log: gzip /var/log/ceph/ceph-client.admin.83425.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.475469.log 2023-10-08T13:45:16.938 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.401279.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.290233.log 2023-10-08T13:45:16.939 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.475469.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.475469.log.gz 2023-10-08T13:45:16.939 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.390423.log 2023-10-08T13:45:16.939 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.290233.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190594.log 2023-10-08T13:45:16.941 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.390423.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.334856.log 2023-10-08T13:45:16.941 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.190594.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.373943.log 2023-10-08T13:45:16.941 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.334856.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.393320.log 2023-10-08T13:45:16.941 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.373943.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.227884.log 2023-10-08T13:45:16.944 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.393320.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87707.log 2023-10-08T13:45:16.944 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.227884.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119086.log 2023-10-08T13:45:16.944 INFO:teuthology.orchestra.run.smithi032.stderr: 80.3% -- replaced with /var/log/ceph/ceph-client.admin.160354.log.gz 2023-10-08T13:45:16.944 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.87707.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42654.log 2023-10-08T13:45:16.944 INFO:teuthology.orchestra.run.smithi032.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.41041.log.gz 2023-10-08T13:45:16.945 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.119086.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.41237.log.gz 2023-10-08T13:45:16.945 INFO:teuthology.orchestra.run.smithi032.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.42355.log.gz 2023-10-08T13:45:16.945 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187729.log 2023-10-08T13:45:16.945 INFO:teuthology.orchestra.run.smithi032.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.41854.log.gz 2023-10-08T13:45:16.945 INFO:teuthology.orchestra.run.smithi032.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.86042.log.gz 2023-10-08T13:45:16.945 INFO:teuthology.orchestra.run.smithi032.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43918.log.gz 2023-10-08T13:45:16.945 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40604.log 2023-10-08T13:45:16.946 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.42654.log: /var/log/ceph/ceph-client.admin.187729.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.443866.log 2023-10-08T13:45:16.948 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.40604.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.296350.log 2023-10-08T13:45:16.948 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.443866.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.475955.log 2023-10-08T13:45:16.948 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.296350.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119500.log 2023-10-08T13:45:16.948 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.475955.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176082.log 2023-10-08T13:45:16.948 INFO:teuthology.orchestra.run.smithi032.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.42844.log.gz 2023-10-08T13:45:16.948 INFO:teuthology.orchestra.run.smithi032.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.475955.log.gz 2023-10-08T13:45:16.949 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.119500.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.281118.log 2023-10-08T13:45:16.949 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.176082.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43397.log 2023-10-08T13:45:16.950 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.281118.log: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.174079.log.gz 2023-10-08T13:45:16.951 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.198697.log 2023-10-08T13:45:16.951 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.43397.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86051.log 2023-10-08T13:45:16.951 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.198697.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.198706.log 2023-10-08T13:45:16.951 INFO:teuthology.orchestra.run.smithi032.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.87707.log.gz 2023-10-08T13:45:16.951 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.86051.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.438488.log 2023-10-08T13:45:16.952 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.198706.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.404388.log 2023-10-08T13:45:16.953 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.198294.log 2023-10-08T13:45:16.953 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.438488.log: /var/log/ceph/ceph-client.admin.404388.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.209644.log 2023-10-08T13:45:16.953 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.198294.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.207989.log 2023-10-08T13:45:16.955 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.209644.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.196235.log 2023-10-08T13:45:16.956 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120750.log 2023-10-08T13:45:16.956 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.207989.log: /var/log/ceph/ceph-client.admin.196235.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.339955.log 2023-10-08T13:45:16.956 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.120750.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.361997.log 2023-10-08T13:45:16.956 INFO:teuthology.orchestra.run.smithi032.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.107323.log.gz 2023-10-08T13:45:16.956 INFO:teuthology.orchestra.run.smithi032.stderr: 84.6% -- replaced with /var/log/ceph/ceph-client.admin.106875.log.gz 2023-10-08T13:45:16.956 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.217246.log 2023-10-08T13:45:16.956 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.339955.log: /var/log/ceph/ceph-client.admin.361997.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.351058.log 2023-10-08T13:45:16.957 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.217246.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184325.log 2023-10-08T13:45:16.957 INFO:teuthology.orchestra.run.smithi032.stderr:gzip /var/log/ceph/ceph-client.admin.351058.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.164262.log 2023-10-08T13:45:16.959 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.184325.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161200.log 2023-10-08T13:45:16.960 INFO:teuthology.orchestra.run.smithi032.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.414118.log.gz 2023-10-08T13:45:16.960 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2023-10-08T13:45:16.960 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.164262.log: /var/log/ceph/ceph-client.admin.161200.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.475367.log 2023-10-08T13:45:16.960 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.377463.log 2023-10-08T13:45:16.960 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40829.log 2023-10-08T13:45:16.960 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.475367.log: /var/log/ceph/ceph-client.admin.377463.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85636.log 2023-10-08T13:45:16.960 INFO:teuthology.orchestra.run.smithi032.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.475367.log.gz 2023-10-08T13:45:16.961 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.40829.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43289.log 2023-10-08T13:45:16.961 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.85636.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.235710.log 2023-10-08T13:45:16.961 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.43289.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.447092.log 2023-10-08T13:45:16.962 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.235710.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.273845.log 2023-10-08T13:45:16.964 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.447092.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.458083.log 2023-10-08T13:45:16.964 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.273845.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.298366.log 2023-10-08T13:45:16.965 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.458083.log: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.458083.log.gz 2023-10-08T13:45:16.965 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.406274.log 2023-10-08T13:45:16.966 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.298366.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.200340.log 2023-10-08T13:45:16.967 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.406274.log: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.377454.log.gz 2023-10-08T13:45:16.967 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112794.log 2023-10-08T13:45:16.967 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.200340.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.459853.log 2023-10-08T13:45:16.967 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.112794.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180113.log 2023-10-08T13:45:16.967 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.459853.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.416176.log 2023-10-08T13:45:16.968 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.180113.log: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.459853.log.gz 2023-10-08T13:45:16.968 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.456862.log 2023-10-08T13:45:16.968 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.416176.log: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.397481.log.gz 2023-10-08T13:45:16.970 INFO:teuthology.orchestra.run.smithi032.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.402096.log.gz 2023-10-08T13:45:16.970 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82954.log 2023-10-08T13:45:16.970 INFO:teuthology.orchestra.run.smithi032.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.397088.log.gz 2023-10-08T13:45:16.970 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.456862.log: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.456862.log.gz 2023-10-08T13:45:16.970 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.475874.log 2023-10-08T13:45:16.971 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.82954.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.391232.log 2023-10-08T13:45:16.976 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.475874.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.475874.log.gz 2023-10-08T13:45:16.976 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.231603.log 2023-10-08T13:45:16.976 INFO:teuthology.orchestra.run.smithi032.stderr: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.168117.log.gz 2023-10-08T13:45:16.976 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.391232.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44531.log 2023-10-08T13:45:16.976 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.231603.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.212907.log 2023-10-08T13:45:16.976 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.44531.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127860.log 2023-10-08T13:45:16.977 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.212907.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.452153.log 2023-10-08T13:45:16.977 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.127860.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.424848.log 2023-10-08T13:45:16.977 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.452153.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43729.log 2023-10-08T13:45:16.977 INFO:teuthology.orchestra.run.smithi032.stderr: 80.0% -- replaced with /var/log/ceph/ceph-client.admin.96285.log.gz 2023-10-08T13:45:16.977 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112388.log 2023-10-08T13:45:16.977 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.424848.log: /var/log/ceph/ceph-client.admin.43729.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.469929.log 2023-10-08T13:45:16.977 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.457272.log 2023-10-08T13:45:16.978 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.112388.log: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.452153.log.gz 2023-10-08T13:45:16.978 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150267.log 2023-10-08T13:45:16.978 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.469929.log: /var/log/ceph/ceph-client.admin.457272.log: 77.4% -- replaced with /var/log/ceph/ceph-client.admin.457272.log.gz 2023-10-08T13:45:16.978 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.246253.log 2023-10-08T13:45:16.978 INFO:teuthology.orchestra.run.smithi032.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.113615.log.gz 2023-10-08T13:45:16.978 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.150267.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.231612.log 2023-10-08T13:45:16.989 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.246253.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118258.log 2023-10-08T13:45:16.989 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.231612.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.447083.log 2023-10-08T13:45:16.989 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.118258.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.311472.log 2023-10-08T13:45:16.989 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.447083.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.345862.log 2023-10-08T13:45:16.989 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.311472.log: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.469929.log.gz 2023-10-08T13:45:16.989 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.309436.log 2023-10-08T13:45:16.989 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.345862.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169412.log 2023-10-08T13:45:16.990 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.309436.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40613.log 2023-10-08T13:45:16.990 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.169412.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99208.log 2023-10-08T13:45:16.990 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.40613.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96697.log 2023-10-08T13:45:16.990 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.99208.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.338644.log 2023-10-08T13:45:16.990 INFO:teuthology.orchestra.run.smithi032.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.120750.log.gz 2023-10-08T13:45:16.990 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.96697.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.403452.log 2023-10-08T13:45:16.990 INFO:teuthology.orchestra.run.smithi032.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.148642.log.gz 2023-10-08T13:45:16.991 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.338644.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97946.log 2023-10-08T13:45:16.991 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.403452.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.413723.log 2023-10-08T13:45:16.991 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.97946.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.407082.log 2023-10-08T13:45:16.991 INFO:teuthology.orchestra.run.smithi032.stderr: 78.7% -- replaced with /var/log/ceph/ceph-client.admin.111106.log.gz 2023-10-08T13:45:16.991 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.434780.log 2023-10-08T13:45:16.991 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.413723.log: /var/log/ceph/ceph-client.admin.407082.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.431622.log 2023-10-08T13:45:16.991 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.455115.log 2023-10-08T13:45:16.991 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.434780.log: /var/log/ceph/ceph-client.admin.431622.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.391223.log 2023-10-08T13:45:16.992 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.455115.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102438.log 2023-10-08T13:45:16.992 INFO:teuthology.orchestra.run.smithi032.stderr: 83.2% -- replaced with /var/log/ceph/ceph-client.admin.455115.log.gz 2023-10-08T13:45:16.992 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.391223.log: 93.5% -- replaced with /var/log/ceph/ceph-client.admin.154076.log.gz 2023-10-08T13:45:16.992 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104848.log 2023-10-08T13:45:16.992 INFO:teuthology.orchestra.run.smithi032.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.192605.log.gz 2023-10-08T13:45:16.993 INFO:teuthology.orchestra.run.smithi032.stderr: 80.0% 90.4% -- replaced with /var/log/ceph/ceph-client.admin.197486.log.gz 2023-10-08T13:45:16.993 INFO:teuthology.orchestra.run.smithi032.stderr: -- replaced with /var/log/ceph/ceph-client.admin.189799.log.gz 2023-10-08T13:45:16.993 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.102438.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.216412.log 2023-10-08T13:45:16.993 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.104848.log: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.198697.log.gz 2023-10-08T13:45:16.993 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.317887.log 2023-10-08T13:45:16.993 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.216412.log: 84.1%gzip -- replaced with /var/log/ceph/ceph-client.admin.368944.log.gz 2023-10-08T13:45:16.994 INFO:teuthology.orchestra.run.smithi032.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.80783.log 2023-10-08T13:45:16.994 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.317887.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.344611.log 2023-10-08T13:45:16.994 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 /var/log/ceph/ceph-client.admin.80783.log: --verbose -- /var/log/ceph/ceph-client.admin.289823.log 2023-10-08T13:45:16.994 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.344611.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42274.log 2023-10-08T13:45:16.994 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.289823.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.415324.log.gz 2023-10-08T13:45:17.010 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82550.log 2023-10-08T13:45:17.010 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.42274.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.2.42164.log 2023-10-08T13:45:17.010 INFO:teuthology.orchestra.run.smithi032.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.422416.log.gz 2023-10-08T13:45:17.011 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.468645.log 2023-10-08T13:45:17.011 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.82550.log: /var/log/ceph/ceph-client.2.42164.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.473354.log 2023-10-08T13:45:17.011 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.468645.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.475123.log 2023-10-08T13:45:17.011 INFO:teuthology.orchestra.run.smithi032.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.468645.log.gz 2023-10-08T13:45:17.011 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.460262.log 2023-10-08T13:45:17.011 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.473354.log: /var/log/ceph/ceph-client.admin.475123.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.475123.log.gz 90.4% 2023-10-08T13:45:17.011 INFO:teuthology.orchestra.run.smithi032.stderr: -- replaced with /var/log/ceph/ceph-client.admin.184325.log.gz 2023-10-08T13:45:17.011 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.315748.log 2023-10-08T13:45:17.012 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.460262.log: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.223394.log.gz 2023-10-08T13:45:17.012 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44188.log 2023-10-08T13:45:17.012 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.315748.log: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.207518.log.gz 2023-10-08T13:45:17.012 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.306083.log 2023-10-08T13:45:17.012 INFO:teuthology.orchestra.run.smithi032.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.225818.log.gz 2023-10-08T13:45:17.012 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.44188.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123276.log 2023-10-08T13:45:17.012 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.306083.log: 92.6% -- replaced with /var/log/ceph/ceph-client.admin.460262.log.gz 2023-10-08T13:45:17.012 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.276664.log 2023-10-08T13:45:17.013 INFO:teuthology.orchestra.run.smithi032.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.130517.log.gz 2023-10-08T13:45:17.013 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.123276.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128354.log 2023-10-08T13:45:17.013 INFO:teuthology.orchestra.run.smithi032.stderr: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.289823.log.gz 2023-10-08T13:45:17.013 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.276664.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189397.log 2023-10-08T13:45:17.013 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.128354.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.431181.log 2023-10-08T13:45:17.013 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.189397.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.476036.log 2023-10-08T13:45:17.013 INFO:teuthology.orchestra.run.smithi032.stderr: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.234432.log.gz 2023-10-08T13:45:17.013 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.431181.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42600.log 2023-10-08T13:45:17.014 INFO:teuthology.orchestra.run.smithi032.stderr: 92.9% -- replaced with /var/log/ceph/ceph-client.admin.473354.log.gz 2023-10-08T13:45:17.014 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.476036.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.476036.log.gz 2023-10-08T13:45:17.014 INFO:teuthology.orchestra.run.smithi032.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.293461.log.gz 2023-10-08T13:45:17.014 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172429.log 2023-10-08T13:45:17.014 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.42600.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.209207.log 2023-10-08T13:45:17.014 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.228787.log 2023-10-08T13:45:17.015 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.172429.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.441854.log 2023-10-08T13:45:17.015 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.209207.log: 79.6% -- replaced with /var/log/ceph/ceph-client.admin.290625.log.gz 2023-10-08T13:45:17.015 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.397927.log 2023-10-08T13:45:17.015 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.228787.log: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.290233.log.gz 2023-10-08T13:45:17.015 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.441854.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44558.log 2023-10-08T13:45:17.016 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.397927.log: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.335735.log.gz 2023-10-08T13:45:17.016 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.215388.log 2023-10-08T13:45:17.016 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.44558.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.448701.log 2023-10-08T13:45:17.016 INFO:teuthology.orchestra.run.smithi032.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.416176.log.gz 2023-10-08T13:45:17.016 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.215388.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.205690.log 2023-10-08T13:45:17.016 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.448701.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.411240.log 2023-10-08T13:45:17.016 INFO:teuthology.orchestra.run.smithi032.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.406274.log.gz 2023-10-08T13:45:17.016 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.205690.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103234.log 2023-10-08T13:45:17.017 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.411240.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193521.log 2023-10-08T13:45:17.017 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.103234.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.372324.log 2023-10-08T13:45:17.017 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.193521.log: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.231612.log.gz 2023-10-08T13:45:17.017 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.234441.log 2023-10-08T13:45:17.017 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.372324.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.247477.log 2023-10-08T13:45:17.017 INFO:teuthology.orchestra.run.smithi032.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.409266.log.gz 2023-10-08T13:45:17.017 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.234441.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.273836.log 2023-10-08T13:45:17.018 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.313501.log 2023-10-08T13:45:17.018 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.247477.log: /var/log/ceph/ceph-client.admin.273836.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.274249.log 2023-10-08T13:45:17.018 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.313501.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.373127.log 2023-10-08T13:45:17.018 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.274249.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.44612.log.gz 2023-10-08T13:45:17.018 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.475631.log 2023-10-08T13:45:17.018 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.373127.log: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.216412.log.gz 2023-10-08T13:45:17.018 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.245040.log 2023-10-08T13:45:17.019 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.475631.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43343.log 2023-10-08T13:45:17.019 INFO:teuthology.orchestra.run.smithi032.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.475631.log.gz 2023-10-08T13:45:17.019 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.245040.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.361181.log 2023-10-08T13:45:17.019 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.43343.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100427.log 2023-10-08T13:45:17.019 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.361181.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.387363.log 2023-10-08T13:45:17.019 INFO:teuthology.orchestra.run.smithi032.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.194840.log.gz 2023-10-08T13:45:17.019 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.100427.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162548.log 2023-10-08T13:45:17.020 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.199124.log 2023-10-08T13:45:17.020 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.387363.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.371915.log 2023-10-08T13:45:17.020 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.162548.log: /var/log/ceph/ceph-client.admin.199124.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.372315.log 2023-10-08T13:45:17.020 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.371915.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43670.log 2023-10-08T13:45:17.021 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.372315.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.438497.log 2023-10-08T13:45:17.021 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.43670.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.289832.log 2023-10-08T13:45:17.042 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.438497.log: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.372716.log.gz 2023-10-08T13:45:17.042 INFO:teuthology.orchestra.run.smithi032.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44558.log.gz 2023-10-08T13:45:17.043 INFO:teuthology.orchestra.run.smithi032.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.39870.log.gz 2023-10-08T13:45:17.043 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85167.log 2023-10-08T13:45:17.043 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.310659.log 2023-10-08T13:45:17.043 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.289832.log: /var/log/ceph/ceph-client.admin.85167.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.42274.log.gz 2023-10-08T13:45:17.043 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.358769.log 2023-10-08T13:45:17.043 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.320318.log 2023-10-08T13:45:17.044 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.310659.log: /var/log/ceph/ceph-client.admin.358769.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41611.log 2023-10-08T13:45:17.044 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167245.log 2023-10-08T13:45:17.044 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.320318.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110283.log 2023-10-08T13:45:17.044 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.41611.log: /var/log/ceph/ceph-client.admin.167245.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.42490.log.gz 2023-10-08T13:45:17.044 INFO:teuthology.orchestra.run.smithi032.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.42600.log.gz 2023-10-08T13:45:17.044 INFO:teuthology.orchestra.run.smithi032.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43289.log.gz 2023-10-08T13:45:17.044 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126515.log 2023-10-08T13:45:17.044 INFO:teuthology.orchestra.run.smithi032.stderr: 80.8% 88.2% -- replaced with /var/log/ceph/ceph-client.admin.85167.log.gz 2023-10-08T13:45:17.045 INFO:teuthology.orchestra.run.smithi032.stderr: -- replaced with /var/log/ceph/ceph-client.admin.43397.log.gz 2023-10-08T13:45:17.045 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.110283.log: gzip -5 --verbose -- 81.0%/var/log/ceph/ceph-client.admin.465250.log 2023-10-08T13:45:17.045 INFO:teuthology.orchestra.run.smithi032.stderr: -- replaced with /var/log/ceph/ceph-client.admin.87305.log.gz 2023-10-08T13:45:17.045 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.126515.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.357952.log 2023-10-08T13:45:17.045 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.465250.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44026.log 2023-10-08T13:45:17.045 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.357952.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120332.log 2023-10-08T13:45:17.045 INFO:teuthology.orchestra.run.smithi032.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.99208.log.gz 2023-10-08T13:45:17.045 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.44026.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.472458.log 2023-10-08T13:45:17.046 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.120332.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.470768.log 2023-10-08T13:45:17.046 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.472458.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.345020.log 2023-10-08T13:45:17.046 INFO:teuthology.orchestra.run.smithi032.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.100427.log.gz 2023-10-08T13:45:17.046 INFO:teuthology.orchestra.run.smithi032.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.472458.log.gz 2023-10-08T13:45:17.046 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.470768.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.354212.log 2023-10-08T13:45:17.046 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.345020.log: 92.5% -- replaced with /var/log/ceph/ceph-client.admin.465250.log.gz 2023-10-08T13:45:17.046 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.463980.log 2023-10-08T13:45:17.047 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.354212.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.283684.log 2023-10-08T13:45:17.047 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.463980.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.219329.log 2023-10-08T13:45:17.047 INFO:teuthology.orchestra.run.smithi032.stderr: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.470768.log.gz 2023-10-08T13:45:17.047 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.283684.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.456425.log 2023-10-08T13:45:17.048 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.219329.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.467369.log 2023-10-08T13:45:17.048 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.294271.log 2023-10-08T13:45:17.048 INFO:teuthology.orchestra.run.smithi032.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.40610.log.gz 2023-10-08T13:45:17.048 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.456425.log: /var/log/ceph/ceph-client.admin.467369.log: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.467369.log.gz 2023-10-08T13:45:17.048 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43756.log 2023-10-08T13:45:17.048 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.294271.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98397.log 2023-10-08T13:45:17.049 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.43756.log: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.456425.log.gz 2023-10-08T13:45:17.049 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185128.log 2023-10-08T13:45:17.049 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.224194.log 2023-10-08T13:45:17.049 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.98397.log: gzip /var/log/ceph/ceph-client.admin.185128.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.42878.log 2023-10-08T13:45:17.049 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.224194.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100418.log 2023-10-08T13:45:17.049 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.42878.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43181.log 2023-10-08T13:45:17.049 INFO:teuthology.orchestra.run.smithi032.stderr: 78.7% -- replaced with /var/log/ceph/ceph-client.admin.103234.log.gz 2023-10-08T13:45:17.050 INFO:teuthology.orchestra.run.smithi032.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.102438.log.gz 2023-10-08T13:45:17.050 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174070.log 2023-10-08T13:45:17.050 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.100418.log: /var/log/ceph/ceph-client.admin.43181.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.474230.log 2023-10-08T13:45:17.050 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.174070.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.398749.log 2023-10-08T13:45:17.050 INFO:teuthology.orchestra.run.smithi032.stderr:gzip /var/log/ceph/ceph-client.admin.474230.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.174481.log 2023-10-08T13:45:17.050 INFO:teuthology.orchestra.run.smithi032.stderr: 84.0% -- replaced with /var/log/ceph/ceph-client.admin.474230.log.gz 2023-10-08T13:45:17.050 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.398749.log: 78.5% -- replaced with /var/log/ceph/ceph-client.admin.104848.log.gz 2023-10-08T13:45:17.051 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.303811.log 2023-10-08T13:45:17.051 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.174481.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.354635.log 2023-10-08T13:45:17.051 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40147.log 2023-10-08T13:45:17.051 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.303811.log: /var/log/ceph/ceph-client.admin.354635.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.460677.log 2023-10-08T13:45:17.051 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.40147.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.343813.log 2023-10-08T13:45:17.051 INFO:teuthology.orchestra.run.smithi032.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.311070.log.gz 2023-10-08T13:45:17.051 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.460677.log: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.110283.log.gz 2023-10-08T13:45:17.051 INFO:teuthology.orchestra.run.smithi032.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.311472.log.gz 2023-10-08T13:45:17.052 INFO:teuthology.orchestra.run.smithi032.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.460677.log.gz 2023-10-08T13:45:17.052 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.217648.log 2023-10-08T13:45:17.052 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.343813.log: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.313501.log.gz 2023-10-08T13:45:17.052 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182252.log 2023-10-08T13:45:17.052 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.217648.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.435527.log 2023-10-08T13:45:17.052 INFO:teuthology.orchestra.run.smithi032.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.398749.log.gz 2023-10-08T13:45:17.052 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.182252.log: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.413723.log.gz 2023-10-08T13:45:17.052 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78884.log 2023-10-08T13:45:17.053 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.435527.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173677.log 2023-10-08T13:45:17.053 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.78884.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194407.log 2023-10-08T13:45:17.053 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.343404.log 2023-10-08T13:45:17.053 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.173677.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.386143.log 2023-10-08T13:45:17.053 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.194407.log: /var/log/ceph/ceph-client.admin.343404.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42763.log 2023-10-08T13:45:17.053 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.371088.log /var/log/ceph/ceph-client.admin.386143.log: 2023-10-08T13:45:17.054 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.42763.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.392083.log 2023-10-08T13:45:17.054 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.371088.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2023-10-08T13:45:17.054 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.392083.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.233227.log 2023-10-08T13:45:17.054 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log: /var/log/ceph/ceph-client.admin.295947.log 2023-10-08T13:45:17.054 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.233227.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.276673.log 2023-10-08T13:45:17.054 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.295947.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.461486.log 2023-10-08T13:45:17.054 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.276673.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.414127.log 2023-10-08T13:45:17.054 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.461486.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.461486.log.gz 2023-10-08T13:45:17.055 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.30912.log 2023-10-08T13:45:17.055 INFO:teuthology.orchestra.run.smithi032.stderr: 77.8% -- replaced with /var/log/ceph/ceph-client.admin.391223.log.gz 2023-10-08T13:45:17.055 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.414127.log: 78.3% -- replaced with /var/log/ceph/ceph-client.admin.193521.log.gz 2023-10-08T13:45:17.055 INFO:teuthology.orchestra.run.smithi032.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.354635.log.gz 2023-10-08T13:45:17.055 INFO:teuthology.orchestra.run.smithi032.stderr: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.171998.log.gz 2023-10-08T13:45:17.056 INFO:teuthology.orchestra.run.smithi032.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.343813.log.gz 2023-10-08T13:45:17.056 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119906.log 2023-10-08T13:45:17.056 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph.tmp-client.admin.30912.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.30912.log.gz 2023-10-08T13:45:17.056 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.362006.log 2023-10-08T13:45:17.056 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.119906.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.360774.log 2023-10-08T13:45:17.057 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171126.log 2023-10-08T13:45:17.057 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.362006.log: gzip -5 /var/log/ceph/ceph-client.admin.360774.log: --verbose -- /var/log/ceph/ceph-client.admin.278700.log 2023-10-08T13:45:17.057 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.171126.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.388180.log 2023-10-08T13:45:17.058 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.278700.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.437791.log 2023-10-08T13:45:17.058 INFO:teuthology.orchestra.run.smithi032.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.357952.log.gz 2023-10-08T13:45:17.058 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.350791.log 2023-10-08T13:45:17.058 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.388180.log: /var/log/ceph/ceph-client.admin.437791.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.389954.log 2023-10-08T13:45:17.059 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.350791.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188944.log 2023-10-08T13:45:17.104 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.389954.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.226234.log 2023-10-08T13:45:17.105 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161209.log 2023-10-08T13:45:17.105 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.188944.log: /var/log/ceph/ceph-client.admin.226234.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.214127.log 2023-10-08T13:45:17.105 INFO:teuthology.orchestra.run.smithi032.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.414127.log.gz 2023-10-08T13:45:17.105 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.161209.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169403.log 2023-10-08T13:45:17.105 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.214127.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.428155.log 2023-10-08T13:45:17.105 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.169403.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.429975.log 2023-10-08T13:45:17.106 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.428155.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178499.log 2023-10-08T13:45:17.106 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.429975.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.275058.log 2023-10-08T13:45:17.106 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.178499.log: 94.2% -- replaced with /var/log/ceph/ceph-client.admin.463980.log.gz 2023-10-08T13:45:17.106 INFO:teuthology.orchestra.run.smithi032.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.443473.log.gz 2023-10-08T13:45:17.106 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.394532.log 2023-10-08T13:45:17.106 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.275058.log: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.448701.log.gz 2023-10-08T13:45:17.106 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.341342.log 2023-10-08T13:45:17.107 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.394532.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.355460.log 2023-10-08T13:45:17.107 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.341342.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.308142.log 2023-10-08T13:45:17.107 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.355460.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40611.log 2023-10-08T13:45:17.107 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.308142.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.204815.log 2023-10-08T13:45:17.107 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.40611.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.473798.log 2023-10-08T13:45:17.107 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.204815.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.306494.log 2023-10-08T13:45:17.107 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.473798.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.431181.log.gz 2023-10-08T13:45:17.107 INFO:teuthology.orchestra.run.smithi032.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.473798.log.gz 2023-10-08T13:45:17.108 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.312677.log 2023-10-08T13:45:17.108 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165126.log 2023-10-08T13:45:17.108 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.306494.log: /var/log/ceph/ceph-client.admin.312677.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.302514.log 2023-10-08T13:45:17.108 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.345871.log 2023-10-08T13:45:17.108 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.165126.log: /var/log/ceph/ceph-client.admin.302514.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158403.log 2023-10-08T13:45:17.108 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.223787.log 2023-10-08T13:45:17.108 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.345871.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158403.log: /var/log/ceph/ceph-client.admin.404865.log 2023-10-08T13:45:17.108 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.223787.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.458492.log 2023-10-08T13:45:17.109 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.404865.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.282766.log 2023-10-08T13:45:17.109 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.458492.log: 77.4% -- replaced with /var/log/ceph/ceph-client.admin.458492.log.gz 2023-10-08T13:45:17.109 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.461080.log 2023-10-08T13:45:17.109 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.282766.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.202403.log 2023-10-08T13:45:17.109 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.461080.log: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.461080.log.gz 2023-10-08T13:45:17.109 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80792.log 2023-10-08T13:45:17.109 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.202403.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.288223.log 2023-10-08T13:45:17.110 INFO:teuthology.orchestra.run.smithi032.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.219329.log.gz 2023-10-08T13:45:17.110 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.80792.log: 79.6% -- replaced with /var/log/ceph/ceph-client.admin.223787.log.gz 2023-10-08T13:45:17.110 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.373118.log 2023-10-08T13:45:17.110 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.288223.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43507.log 2023-10-08T13:45:17.110 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.373118.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147436.log 2023-10-08T13:45:17.110 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.43507.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.429984.log 2023-10-08T13:45:17.110 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156166.log 2023-10-08T13:45:17.110 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.147436.log: /var/log/ceph/ceph-client.admin.429984.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40423.log 2023-10-08T13:45:17.111 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106467.log 2023-10-08T13:45:17.111 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.156166.log: /var/log/ceph/ceph-client.admin.40423.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.458969.log 2023-10-08T13:45:17.111 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.106467.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159961.log 2023-10-08T13:45:17.111 INFO:teuthology.orchestra.run.smithi032.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.35773.log.gz 2023-10-08T13:45:17.111 INFO:teuthology.orchestra.run.smithi032.stderr:gzip /var/log/ceph/ceph-client.admin.458969.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.308984.log 2023-10-08T13:45:17.111 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.159961.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150688.log 2023-10-08T13:45:17.111 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.308984.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.306485.log 2023-10-08T13:45:17.112 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.150688.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.366907.log 2023-10-08T13:45:17.112 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.306485.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129866.log 2023-10-08T13:45:17.112 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.366907.log: 91.9% -- replaced with /var/log/ceph/ceph-client.admin.458969.log.gz 2023-10-08T13:45:17.112 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.321255.log 2023-10-08T13:45:17.112 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.129866.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.392913.log 2023-10-08T13:45:17.112 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.452567.log 2023-10-08T13:45:17.112 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.321255.log: /var/log/ceph/ceph-client.admin.392913.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79878.log 2023-10-08T13:45:17.112 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.452567.log: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.452567.log.gz 2023-10-08T13:45:17.113 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.417018.log 2023-10-08T13:45:17.113 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.79878.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.422005.log 2023-10-08T13:45:17.113 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.417018.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.225827.log 2023-10-08T13:45:17.113 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.422005.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40450.log 2023-10-08T13:45:17.113 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186325.log 2023-10-08T13:45:17.113 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.225827.log: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.217648.log.gz 2023-10-08T13:45:17.113 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.40450.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.400018.log 2023-10-08T13:45:17.113 INFO:teuthology.orchestra.run.smithi032.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.289832.log.gz 2023-10-08T13:45:17.114 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.186325.log: 93.5% -- replaced with /var/log/ceph/ceph-client.admin.180529.log.gz 2023-10-08T13:45:17.114 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.288624.log 2023-10-08T13:45:17.114 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.400018.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.227452.log 2023-10-08T13:45:17.114 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.288624.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101634.log 2023-10-08T13:45:17.114 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104857.log 2023-10-08T13:45:17.114 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.227452.log: /var/log/ceph/ceph-client.admin.101634.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.319830.log 2023-10-08T13:45:17.114 INFO:teuthology.orchestra.run.smithi032.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.96697.log.gz 2023-10-08T13:45:17.114 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157515.log 2023-10-08T13:45:17.115 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.104857.log: /var/log/ceph/ceph-client.admin.319830.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.406265.log 2023-10-08T13:45:17.115 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.338241.log 2023-10-08T13:45:17.115 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.157515.log: /var/log/ceph/ceph-client.admin.406265.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.466944.log 2023-10-08T13:45:17.115 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.338241.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95883.log 2023-10-08T13:45:17.115 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.466944.log: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.466944.log.gz 2023-10-08T13:45:17.115 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.236104.log 2023-10-08T13:45:17.115 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.95883.log: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.362006.log.gz 2023-10-08T13:45:17.115 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186334.log 2023-10-08T13:45:17.116 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.236104.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152432.log 2023-10-08T13:45:17.116 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.186334.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.295544.log 2023-10-08T13:45:17.116 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.152432.log: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.275058.log.gz 2023-10-08T13:45:17.116 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.207527.log 2023-10-08T13:45:17.116 INFO:teuthology.orchestra.run.smithi032.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.276664.log.gz 2023-10-08T13:45:17.116 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.295544.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155773.log 2023-10-08T13:45:17.116 INFO:teuthology.orchestra.run.smithi032.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.276673.log.gz 2023-10-08T13:45:17.117 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.207527.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.349981.log 2023-10-08T13:45:17.117 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43534.log 2023-10-08T13:45:17.117 INFO:teuthology.orchestra.run.smithi032.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.214127.log.gz 2023-10-08T13:45:17.117 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.155773.log: /var/log/ceph/ceph-client.admin.349981.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.421610.log 2023-10-08T13:45:17.117 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.43534.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173271.log 2023-10-08T13:45:17.117 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.421610.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.299184.log 2023-10-08T13:45:17.117 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.373934.log 2023-10-08T13:45:17.117 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.173271.log: /var/log/ceph/ceph-client.admin.299184.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.229993.log 2023-10-08T13:45:17.118 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.373934.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.355888.log 2023-10-08T13:45:17.118 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.229993.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162557.log 2023-10-08T13:45:17.118 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.355888.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.203210.log 2023-10-08T13:45:17.118 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.162557.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.387756.log 2023-10-08T13:45:17.118 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.203210.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.412448.log 2023-10-08T13:45:17.118 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.387756.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.394130.log 2023-10-08T13:45:17.118 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.412448.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.400813.log 2023-10-08T13:45:17.118 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.394130.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.427462.log 2023-10-08T13:45:17.119 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.400813.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103645.log 2023-10-08T13:45:17.119 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.427462.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.281933.log 2023-10-08T13:45:17.119 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.374365.log 2023-10-08T13:45:17.119 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.103645.log: /var/log/ceph/ceph-client.admin.281933.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180951.log 2023-10-08T13:45:17.119 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.374365.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.445081.log 2023-10-08T13:45:17.119 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92891.log 2023-10-08T13:45:17.119 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.180951.log: /var/log/ceph/ceph-client.admin.445081.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.353407.log 2023-10-08T13:45:17.119 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.92891.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187326.log 2023-10-08T13:45:17.120 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.353407.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.446690.log 2023-10-08T13:45:17.120 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.187326.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42932.log 2023-10-08T13:45:17.120 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.446690.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.336967.log 2023-10-08T13:45:17.120 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.42932.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.464807.log 2023-10-08T13:45:17.120 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.336967.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121965.log 2023-10-08T13:45:17.120 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.464807.log: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.464807.log.gz 2023-10-08T13:45:17.120 INFO:teuthology.orchestra.run.smithi032.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.126515.log.gz 2023-10-08T13:45:17.120 INFO:teuthology.orchestra.run.smithi032.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.44188.log.gz 2023-10-08T13:45:17.121 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169834.log 2023-10-08T13:45:17.121 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.121965.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.429582.log 2023-10-08T13:45:17.121 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.169834.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.356715.log 2023-10-08T13:45:17.121 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.429582.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191801.log 2023-10-08T13:45:17.121 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167676.log 2023-10-08T13:45:17.121 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.356715.log: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.167245.log.gz 2023-10-08T13:45:17.121 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154901.log 2023-10-08T13:45:17.121 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.191801.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.41611.log.gz 2023-10-08T13:45:17.122 INFO:teuthology.orchestra.run.smithi032.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.42878.log.gz 2023-10-08T13:45:17.122 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.167676.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.473345.log 2023-10-08T13:45:17.122 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.154901.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.452961.log 2023-10-08T13:45:17.122 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.473345.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.243662.log 2023-10-08T13:45:17.122 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.452961.log: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.473345.log.gz 2023-10-08T13:45:17.122 INFO:teuthology.orchestra.run.smithi032.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.452961.log.gz 2023-10-08T13:45:17.122 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42214.log 2023-10-08T13:45:17.122 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.243662.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43208.log 2023-10-08T13:45:17.123 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.42214.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.306888.log 2023-10-08T13:45:17.123 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.43208.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.213711.log 2023-10-08T13:45:17.123 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.306888.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168981.log 2023-10-08T13:45:17.123 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.377056.log 2023-10-08T13:45:17.123 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.213711.log: /var/log/ceph/ceph-client.admin.168981.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157036.log 2023-10-08T13:45:17.123 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.377056.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.414931.log 2023-10-08T13:45:17.123 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180520.log 2023-10-08T13:45:17.124 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.157036.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46104.log 2023-10-08T13:45:17.124 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.414931.log: /var/log/ceph/ceph-client.admin.180520.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.413312.log 2023-10-08T13:45:17.124 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.46104.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87716.log 2023-10-08T13:45:17.124 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.447485.log 2023-10-08T13:45:17.124 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.413312.log: /var/log/ceph/ceph-client.admin.87716.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2023-10-08T13:45:17.124 INFO:teuthology.orchestra.run.smithi032.stderr:gzip /var/log/ceph/ceph-client.admin.447485.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.43154.log 2023-10-08T13:45:17.124 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42409.log 2023-10-08T13:45:17.124 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.43154.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.459437.log 2023-10-08T13:45:17.125 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.42409.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188131.log 2023-10-08T13:45:17.125 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.459437.log: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.459437.log.gz 2023-10-08T13:45:17.125 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44242.log 2023-10-08T13:45:17.125 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.188131.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.453838.log 2023-10-08T13:45:17.125 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.44242.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.229198.log 2023-10-08T13:45:17.125 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.453838.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.408397.log 2023-10-08T13:45:17.125 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.336976.log 2023-10-08T13:45:17.125 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.229198.log: /var/log/ceph/ceph-client.admin.408397.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.450743.log 2023-10-08T13:45:17.126 INFO:teuthology.orchestra.run.smithi032.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.453838.log.gz 2023-10-08T13:45:17.126 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.336976.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43616.log 2023-10-08T13:45:17.126 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.450743.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.445876.log 2023-10-08T13:45:17.126 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.43616.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40504.log 2023-10-08T13:45:17.126 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.445876.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91244.log 2023-10-08T13:45:17.126 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.40504.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.424044.log 2023-10-08T13:45:17.126 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.91244.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97504.log 2023-10-08T13:45:17.126 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.424044.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165519.log 2023-10-08T13:45:17.127 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.97504.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111521.log 2023-10-08T13:45:17.127 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194416.log 2023-10-08T13:45:17.127 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.165519.log: /var/log/ceph/ceph-client.admin.111521.log: /var/log/ceph/ceph-client.admin.194416.log: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.45050.log.gz 2023-10-08T13:45:17.129 INFO:teuthology.orchestra.run.smithi032.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.106467.log.gz 2023-10-08T13:45:17.129 INFO:teuthology.orchestra.run.smithi032.stderr: 93.1% -- replaced with /var/log/ceph/ceph-client.admin.315748.log.gz 2023-10-08T13:45:17.129 INFO:teuthology.orchestra.run.smithi032.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.394532.log.gz 2023-10-08T13:45:17.129 INFO:teuthology.orchestra.run.smithi032.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.79878.log.gz 2023-10-08T13:45:17.129 INFO:teuthology.orchestra.run.smithi032.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.186334.log.gz 2023-10-08T13:45:17.129 INFO:teuthology.orchestra.run.smithi032.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.191801.log.gz 2023-10-08T13:45:17.130 INFO:teuthology.orchestra.run.smithi032.stderr: 77.6% -- replaced with /var/log/ceph/ceph-client.admin.419515.log.gz 2023-10-08T13:45:17.130 INFO:teuthology.orchestra.run.smithi032.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.422005.log.gz 2023-10-08T13:45:17.130 INFO:teuthology.orchestra.run.smithi032.stderr: 84.7% -- replaced with /var/log/ceph/ceph-client.admin.436295.log.gz 2023-10-08T13:45:17.130 INFO:teuthology.orchestra.run.smithi032.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.421610.log.gz 2023-10-08T13:45:17.130 INFO:teuthology.orchestra.run.smithi032.stderr: 79.8% -- replaced with /var/log/ceph/ceph-client.admin.204815.log.gz 2023-10-08T13:45:17.130 INFO:teuthology.orchestra.run.smithi032.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.202403.log.gz 2023-10-08T13:45:17.130 INFO:teuthology.orchestra.run.smithi032.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.247468.log.gz 2023-10-08T13:45:17.130 INFO:teuthology.orchestra.run.smithi032.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.225827.log.gz 2023-10-08T13:45:17.133 INFO:teuthology.orchestra.run.smithi032.stderr: 78.1% -- replaced with /var/log/ceph/ceph-client.admin.281933.log.gz 2023-10-08T13:45:17.134 INFO:teuthology.orchestra.run.smithi032.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.288615.log.gz 2023-10-08T13:45:17.135 INFO:teuthology.orchestra.run.smithi032.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.293868.log.gz 2023-10-08T13:45:17.138 INFO:teuthology.orchestra.run.smithi032.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.295544.log.gz 2023-10-08T13:45:17.138 INFO:teuthology.orchestra.run.smithi032.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.408854.log.gz 2023-10-08T13:45:17.139 INFO:teuthology.orchestra.run.smithi032.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.356715.log.gz 2023-10-08T13:45:17.140 INFO:teuthology.orchestra.run.smithi032.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.338241.log.gz 2023-10-08T13:45:17.167 INFO:teuthology.orchestra.run.smithi032.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.409724.log.gz 2023-10-08T13:45:17.167 INFO:teuthology.orchestra.run.smithi032.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.407091.log.gz 2023-10-08T13:45:17.169 INFO:teuthology.orchestra.run.smithi032.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.121965.log.gz 2023-10-08T13:45:17.169 INFO:teuthology.orchestra.run.smithi032.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.359162.log.gz 2023-10-08T13:45:17.170 INFO:teuthology.orchestra.run.smithi032.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.372725.log.gz 2023-10-08T13:45:17.172 INFO:teuthology.orchestra.run.smithi032.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.167676.log.gz 2023-10-08T13:45:17.172 INFO:teuthology.orchestra.run.smithi032.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.169834.log.gz 2023-10-08T13:45:17.173 INFO:teuthology.orchestra.run.smithi032.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.40232.log.gz 2023-10-08T13:45:17.173 INFO:teuthology.orchestra.run.smithi032.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.40827.log.gz 2023-10-08T13:45:17.174 INFO:teuthology.orchestra.run.smithi032.stderr: 78.1% -- replaced with /var/log/ceph/ceph-client.admin.109028.log.gz 2023-10-08T13:45:17.176 INFO:teuthology.orchestra.run.smithi032.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.126524.log.gz 2023-10-08T13:45:17.176 INFO:teuthology.orchestra.run.smithi032.stderr: 91.9% -- replaced with /var/log/ceph/ceph-client.admin.119906.log.gz 2023-10-08T13:45:17.177 INFO:teuthology.orchestra.run.smithi032.stderr: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.123276.log.gz 2023-10-08T13:45:17.177 INFO:teuthology.orchestra.run.smithi032.stderr: 93.0% -- replaced with /var/log/ceph/ceph-client.admin.391232.log.gz 2023-10-08T13:45:17.178 INFO:teuthology.orchestra.run.smithi032.stderr: 91.9% -- replaced with /var/log/ceph/ceph-client.admin.401690.log.gz 2023-10-08T13:45:17.179 INFO:teuthology.orchestra.run.smithi032.stderr: 94.1% -- replaced with /var/log/ceph/ceph-client.admin.172429.log.gz 2023-10-08T13:45:17.179 INFO:teuthology.orchestra.run.smithi032.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.337829.log.gz 2023-10-08T13:45:17.179 INFO:teuthology.orchestra.run.smithi032.stderr: 81.4% 90.4% -- replaced with /var/log/ceph/ceph-client.admin.363652.log.gz -- replaced with /var/log/ceph/ceph-client.admin.197899.log.gz 2023-10-08T13:45:17.179 INFO:teuthology.orchestra.run.smithi032.stderr: 2023-10-08T13:45:17.181 INFO:teuthology.orchestra.run.smithi032.stderr: 92.9% -- replaced with /var/log/ceph/ceph-client.admin.392083.log.gz 2023-10-08T13:45:17.182 INFO:teuthology.orchestra.run.smithi032.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.43616.log.gz 2023-10-08T13:45:17.183 INFO:teuthology.orchestra.run.smithi032.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.428371.log.gz 2023-10-08T13:45:17.184 INFO:teuthology.orchestra.run.smithi032.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.429180.log.gz 2023-10-08T13:45:17.185 INFO:teuthology.orchestra.run.smithi032.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.430780.log.gz 2023-10-08T13:45:17.186 INFO:teuthology.orchestra.run.smithi032.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.435517.log.gz 2023-10-08T13:45:17.186 INFO:teuthology.orchestra.run.smithi032.stderr: 83.7% -- replaced with /var/log/ceph/ceph-client.admin.202394.log.gz 2023-10-08T13:45:17.192 INFO:teuthology.orchestra.run.smithi032.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.273030.log.gz 2023-10-08T13:45:17.192 INFO:teuthology.orchestra.run.smithi032.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.224203.log.gz 2023-10-08T13:45:17.193 INFO:teuthology.orchestra.run.smithi032.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.245049.log.gz 2023-10-08T13:45:17.197 INFO:teuthology.orchestra.run.smithi032.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.276270.log.gz 2023-10-08T13:45:17.198 INFO:teuthology.orchestra.run.smithi032.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.348736.log.gz 2023-10-08T13:45:17.198 INFO:teuthology.orchestra.run.smithi032.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.200331.log.gz 2023-10-08T13:45:17.248 INFO:teuthology.orchestra.run.smithi032.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.277890.log.gz 2023-10-08T13:45:17.259 INFO:teuthology.orchestra.run.smithi032.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.281528.log.gz 2023-10-08T13:45:17.281 INFO:teuthology.orchestra.run.smithi032.stderr: 77.4% -- replaced with /var/log/ceph/ceph-client.admin.120332.log.gz 2023-10-08T13:45:17.282 INFO:teuthology.orchestra.run.smithi032.stderr: 84.0% -- replaced with /var/log/ceph/ceph-client.admin.170265.log.gz 2023-10-08T13:45:17.282 INFO:teuthology.orchestra.run.smithi032.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.40315.log.gz 2023-10-08T13:45:17.283 INFO:teuthology.orchestra.run.smithi032.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42517.log.gz 2023-10-08T13:45:17.283 INFO:teuthology.orchestra.run.smithi032.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43702.log.gz 2023-10-08T13:45:17.283 INFO:teuthology.orchestra.run.smithi032.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.96688.log.gz 2023-10-08T13:45:17.284 INFO:teuthology.orchestra.run.smithi032.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.87314.log.gz 2023-10-08T13:45:17.296 INFO:teuthology.orchestra.run.smithi032.stderr: 79.4% -- replaced with /var/log/ceph/ceph-client.admin.391672.log.gz 2023-10-08T13:45:17.296 INFO:teuthology.orchestra.run.smithi032.stderr: 79.0% -- replaced with /var/log/ceph/ceph-client.admin.392510.log.gz 2023-10-08T13:45:17.298 INFO:teuthology.orchestra.run.smithi032.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.291026.log.gz 2023-10-08T13:45:17.305 INFO:teuthology.orchestra.run.smithi032.stderr: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.181391.log.gz 2023-10-08T13:45:17.308 INFO:teuthology.orchestra.run.smithi032.stderr: 80.3% -- replaced with /var/log/ceph/ceph-client.admin.157506.log.gz 2023-10-08T13:45:17.309 INFO:teuthology.orchestra.run.smithi032.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.154507.log.gz 2023-10-08T13:45:17.314 INFO:teuthology.orchestra.run.smithi032.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.183522.log.gz 2023-10-08T13:45:17.315 INFO:teuthology.orchestra.run.smithi032.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.153230.log.gz 2023-10-08T13:45:17.317 INFO:teuthology.orchestra.run.smithi032.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.197495.log.gz 2023-10-08T13:45:17.320 INFO:teuthology.orchestra.run.smithi032.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.349990.log.gz 2023-10-08T13:45:17.323 INFO:teuthology.orchestra.run.smithi032.stderr: 93.5% -- replaced with /var/log/ceph/ceph-client.admin.163831.log.gz 2023-10-08T13:45:17.324 INFO:teuthology.orchestra.run.smithi032.stderr: 79.3% -- replaced with /var/log/ceph/ceph-client.admin.353398.log.gz 2023-10-08T13:45:17.326 INFO:teuthology.orchestra.run.smithi032.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.357961.log.gz 2023-10-08T13:45:17.327 INFO:teuthology.orchestra.run.smithi032.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.360380.log.gz 2023-10-08T13:45:17.328 INFO:teuthology.orchestra.run.smithi032.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.417888.log.gz 2023-10-08T13:45:17.328 INFO:teuthology.orchestra.run.smithi032.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.417027.log.gz 2023-10-08T13:45:17.329 INFO:teuthology.orchestra.run.smithi032.stderr: 77.9% -- replaced with /var/log/ceph/ceph-client.admin.230799.log.gz 2023-10-08T13:45:17.331 INFO:teuthology.orchestra.run.smithi032.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.277071.log.gz 2023-10-08T13:45:17.331 INFO:teuthology.orchestra.run.smithi032.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.348745.log.gz 2023-10-08T13:45:17.332 INFO:teuthology.orchestra.run.smithi032.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.175287.log.gz 2023-10-08T13:45:17.334 INFO:teuthology.orchestra.run.smithi032.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.185932.log.gz 2023-10-08T13:45:17.336 INFO:teuthology.orchestra.run.smithi032.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.289026.log.gz 2023-10-08T13:45:17.342 INFO:teuthology.orchestra.run.smithi032.stderr: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.406672.log.gz 2023-10-08T13:45:17.343 INFO:teuthology.orchestra.run.smithi032.stderr: 93.4% -- replaced with /var/log/ceph/ceph-client.admin.320318.log.gz 2023-10-08T13:45:17.343 INFO:teuthology.orchestra.run.smithi032.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.151080.log.gz 2023-10-08T13:45:17.345 INFO:teuthology.orchestra.run.smithi032.stderr: 77.6% -- replaced with /var/log/ceph/ceph-client.admin.395745.log.gz 2023-10-08T13:45:17.347 INFO:teuthology.orchestra.run.smithi032.stderr: 93.0% -- replaced with /var/log/ceph/ceph-client.admin.204824.log.gz 2023-10-08T13:45:17.349 INFO:teuthology.orchestra.run.smithi032.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.208795.log.gz 2023-10-08T13:45:17.350 INFO:teuthology.orchestra.run.smithi032.stderr: 92.7% -- replaced with /var/log/ceph/ceph-client.admin.205259.log.gz 2023-10-08T13:45:17.354 INFO:teuthology.orchestra.run.smithi032.stderr: 78.2% -- replaced with /var/log/ceph/ceph-client.admin.287813.log.gz 2023-10-08T13:45:17.355 INFO:teuthology.orchestra.run.smithi032.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.287417.log.gz 2023-10-08T13:45:17.355 INFO:teuthology.orchestra.run.smithi032.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.287822.log.gz 2023-10-08T13:45:17.364 INFO:teuthology.orchestra.run.smithi032.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.376639.log.gz 2023-10-08T13:45:17.370 INFO:teuthology.orchestra.run.smithi032.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.42571.log.gz 2023-10-08T13:45:17.371 INFO:teuthology.orchestra.run.smithi032.stderr: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.92158.log.gz 2023-10-08T13:45:17.372 INFO:teuthology.orchestra.run.smithi032.stderr: 78.2% -- replaced with /var/log/ceph/ceph-client.admin.111914.log.gz 2023-10-08T13:45:17.372 INFO:teuthology.orchestra.run.smithi032.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.107332.log.gz 2023-10-08T13:45:17.374 INFO:teuthology.orchestra.run.smithi032.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.111512.log.gz 2023-10-08T13:45:17.378 INFO:teuthology.orchestra.run.smithi032.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.321694.log.gz 2023-10-08T13:45:17.380 INFO:teuthology.orchestra.run.smithi032.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44421.log.gz 2023-10-08T13:45:17.386 INFO:teuthology.orchestra.run.smithi032.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.394139.log.gz 2023-10-08T13:45:17.390 INFO:teuthology.orchestra.run.smithi032.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.400822.log.gz 2023-10-08T13:45:17.392 INFO:teuthology.orchestra.run.smithi032.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.150276.log.gz 2023-10-08T13:45:17.401 INFO:teuthology.orchestra.run.smithi032.stderr: 77.7% -- replaced with /var/log/ceph/ceph-client.admin.188935.log.gz 2023-10-08T13:45:17.402 INFO:teuthology.orchestra.run.smithi032.stderr: 78.5% -- replaced with /var/log/ceph/ceph-client.admin.344208.log.gz 2023-10-08T13:45:17.404 INFO:teuthology.orchestra.run.smithi032.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.366090.log.gz 2023-10-08T13:45:17.405 INFO:teuthology.orchestra.run.smithi032.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.368542.log.gz 2023-10-08T13:45:17.410 INFO:teuthology.orchestra.run.smithi032.stderr: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.429573.log.gz 2023-10-08T13:45:17.412 INFO:teuthology.orchestra.run.smithi032.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.419524.log.gz 2023-10-08T13:45:17.419 INFO:teuthology.orchestra.run.smithi032.stderr: 79.2% -- replaced with /var/log/ceph/ceph-client.admin.439230.log.gz 2023-10-08T13:45:17.423 INFO:teuthology.orchestra.run.smithi032.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.446681.log.gz 2023-10-08T13:45:17.443 INFO:teuthology.orchestra.run.smithi032.stderr: 93.7% -- replaced with /var/log/ceph/ceph-client.admin.284889.log.gz 2023-10-08T13:45:17.447 INFO:teuthology.orchestra.run.smithi032.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.272219.log.gz 2023-10-08T13:45:17.447 INFO:teuthology.orchestra.run.smithi032.stderr: 92.6% -- replaced with /var/log/ceph/ceph-client.admin.245855.log.gz 2023-10-08T13:45:17.447 INFO:teuthology.orchestra.run.smithi032.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.292635.log.gz 2023-10-08T13:45:17.448 INFO:teuthology.orchestra.run.smithi032.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.292242.log.gz 2023-10-08T13:45:17.450 INFO:teuthology.orchestra.run.smithi032.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.402976.log.gz 2023-10-08T13:45:17.451 INFO:teuthology.orchestra.run.smithi032.stderr: 92.5% -- replaced with /var/log/ceph/ceph-client.admin.459231.log.gz 2023-10-08T13:45:17.459 INFO:teuthology.orchestra.run.smithi032.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.432021.log.gz 2023-10-08T13:45:17.467 INFO:teuthology.orchestra.run.smithi032.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.176091.log.gz 2023-10-08T13:45:17.468 INFO:teuthology.orchestra.run.smithi032.stderr: 77.4% -- replaced with /var/log/ceph/ceph-client.admin.221361.log.gz 2023-10-08T13:45:17.475 INFO:teuthology.orchestra.run.smithi032.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.433999.log.gz 2023-10-08T13:45:17.475 INFO:teuthology.orchestra.run.smithi032.stderr: 92.9% -- replaced with /var/log/ceph/ceph-client.admin.237351.log.gz 2023-10-08T13:45:17.477 INFO:teuthology.orchestra.run.smithi032.stderr: 77.4% -- replaced with /var/log/ceph/ceph-client.admin.442659.log.gz 2023-10-08T13:45:17.486 INFO:teuthology.orchestra.run.smithi032.stderr: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.376300.log.gz 2023-10-08T13:45:17.487 INFO:teuthology.orchestra.run.smithi032.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46131.log.gz 2023-10-08T13:45:17.489 INFO:teuthology.orchestra.run.smithi032.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.305215.log.gz 2023-10-08T13:45:17.491 INFO:teuthology.orchestra.run.smithi032.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.307726.log.gz 2023-10-08T13:45:17.491 INFO:teuthology.orchestra.run.smithi032.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.40823.log.gz 2023-10-08T13:45:17.495 INFO:teuthology.orchestra.run.smithi032.stderr: 77.9% -- replaced with /var/log/ceph/ceph-client.admin.425718.log.gz 2023-10-08T13:45:17.497 INFO:teuthology.orchestra.run.smithi032.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.41258.log.gz 2023-10-08T13:45:17.497 INFO:teuthology.orchestra.run.smithi032.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.42627.log.gz 2023-10-08T13:45:17.511 INFO:teuthology.orchestra.run.smithi032.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.82541.log.gz 2023-10-08T13:45:17.512 INFO:teuthology.orchestra.run.smithi032.stderr: 77.4% -- replaced with /var/log/ceph/ceph-client.admin.98797.log.gz 2023-10-08T13:45:17.512 INFO:teuthology.orchestra.run.smithi032.stderr: 77.5% -- replaced with /var/log/ceph/ceph-client.admin.113208.log.gz 2023-10-08T13:45:17.513 INFO:teuthology.orchestra.run.smithi032.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.98806.log.gz 2023-10-08T13:45:17.513 INFO:teuthology.orchestra.run.smithi032.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.311481.log.gz 2023-10-08T13:45:17.522 INFO:teuthology.orchestra.run.smithi032.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.303354.log.gz 2023-10-08T13:45:17.522 INFO:teuthology.orchestra.run.smithi032.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.40824.log.gz 2023-10-08T13:45:17.524 INFO:teuthology.orchestra.run.smithi032.stderr: 78.8% -- replaced with /var/log/ceph/ceph-client.admin.403920.log.gz 2023-10-08T13:45:17.531 INFO:teuthology.orchestra.run.smithi032.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.43122.log.gz 2023-10-08T13:45:17.531 INFO:teuthology.orchestra.run.smithi032.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.183513.log.gz 2023-10-08T13:45:17.532 INFO:teuthology.orchestra.run.smithi032.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.175689.log.gz 2023-10-08T13:45:17.532 INFO:teuthology.orchestra.run.smithi032.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.191810.log.gz 2023-10-08T13:45:17.535 INFO:teuthology.orchestra.run.smithi032.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.177298.log.gz 2023-10-08T13:45:17.535 INFO:teuthology.orchestra.run.smithi032.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.343395.log.gz 2023-10-08T13:45:17.538 INFO:teuthology.orchestra.run.smithi032.stderr: 78.3% -- replaced with /var/log/ceph/ceph-client.admin.351145.log.gz 2023-10-08T13:45:17.539 INFO:teuthology.orchestra.run.smithi032.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.347479.log.gz 2023-10-08T13:45:17.539 INFO:teuthology.orchestra.run.smithi032.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.363220.log.gz 2023-10-08T13:45:17.541 INFO:teuthology.orchestra.run.smithi032.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.335260.log.gz 2023-10-08T13:45:17.541 INFO:teuthology.orchestra.run.smithi032.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.412439.log.gz 2023-10-08T13:45:17.542 INFO:teuthology.orchestra.run.smithi032.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.427471.log.gz 2023-10-08T13:45:17.543 INFO:teuthology.orchestra.run.smithi032.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.203613.log.gz 2023-10-08T13:45:17.547 INFO:teuthology.orchestra.run.smithi032.stderr: 93.8% -- replaced with /var/log/ceph/ceph-client.admin.209207.log.gz 2023-10-08T13:45:17.552 INFO:teuthology.orchestra.run.smithi032.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.246655.log.gz 2023-10-08T13:45:17.553 INFO:teuthology.orchestra.run.smithi032.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.278691.log.gz 2023-10-08T13:45:17.553 INFO:teuthology.orchestra.run.smithi032.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.223796.log.gz 2023-10-08T13:45:17.563 INFO:teuthology.orchestra.run.smithi032.stderr: 93.7% -- replaced with /var/log/ceph/ceph-client.admin.157923.log.gz 2023-10-08T13:45:17.563 INFO:teuthology.orchestra.run.smithi032.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.368953.log.gz 2023-10-08T13:45:17.633 INFO:teuthology.orchestra.run.smithi032.stderr: 92.6% -- replaced with /var/log/ceph/ceph-client.admin.293046.log.gz 2023-10-08T13:45:17.642 INFO:teuthology.orchestra.run.smithi032.stderr: 79.8% -- replaced with /var/log/ceph/ceph-client.admin.209198.log.gz 2023-10-08T13:45:17.647 INFO:teuthology.orchestra.run.smithi032.stderr: 92.7% -- replaced with /var/log/ceph/ceph-client.admin.130526.log.gz 2023-10-08T13:45:17.649 INFO:teuthology.orchestra.run.smithi032.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.216844.log.gz 2023-10-08T13:45:17.658 INFO:teuthology.orchestra.run.smithi032.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.320789.log.gz 2023-10-08T13:45:17.663 INFO:teuthology.orchestra.run.smithi032.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.305224.log.gz 2023-10-08T13:45:17.664 INFO:teuthology.orchestra.run.smithi032.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.40602.log.gz 2023-10-08T13:45:17.664 INFO:teuthology.orchestra.run.smithi032.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.41036.log.gz 2023-10-08T13:45:17.666 INFO:teuthology.orchestra.run.smithi032.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43316.log.gz 2023-10-08T13:45:17.669 INFO:teuthology.orchestra.run.smithi032.stderr: 79.2% -- replaced with /var/log/ceph/ceph-client.admin.371906.log.gz 2023-10-08T13:45:17.674 INFO:teuthology.orchestra.run.smithi032.stderr: 88.9% 90.9% -- replaced with /var/log/ceph/ceph-client.admin.43864.log.gz 2023-10-08T13:45:17.674 INFO:teuthology.orchestra.run.smithi032.stderr: -- replaced with /var/log/ceph/ceph-client.admin.79887.log.gz 2023-10-08T13:45:17.684 INFO:teuthology.orchestra.run.smithi032.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.273442.log.gz 2023-10-08T13:45:17.685 INFO:teuthology.orchestra.run.smithi032.stderr: 77.6% -- replaced with /var/log/ceph/ceph-client.admin.101223.log.gz 2023-10-08T13:45:17.685 INFO:teuthology.orchestra.run.smithi032.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.99614.log.gz 2023-10-08T13:45:17.741 INFO:teuthology.orchestra.run.smithi032.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.197890.log.gz 2023-10-08T13:45:17.741 INFO:teuthology.orchestra.run.smithi032.stderr: 77.4% -- replaced with /var/log/ceph/ceph-client.admin.346561.log.gz 2023-10-08T13:45:17.755 INFO:teuthology.orchestra.run.smithi032.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.299193.log.gz 2023-10-08T13:45:17.756 INFO:teuthology.orchestra.run.smithi032.stderr: 77.8% -- replaced with /var/log/ceph/ceph-client.admin.349578.log.gz 2023-10-08T13:45:17.759 INFO:teuthology.orchestra.run.smithi032.stderr: 80.1% -- replaced with /var/log/ceph/ceph-client.admin.448289.log.gz 2023-10-08T13:45:17.759 INFO:teuthology.orchestra.run.smithi032.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.184726.log.gz 2023-10-08T13:45:17.760 INFO:teuthology.orchestra.run.smithi032.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.441461.log.gz 2023-10-08T13:45:17.762 INFO:teuthology.orchestra.run.smithi032.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.93716.log.gz 2023-10-08T13:45:17.764 INFO:teuthology.orchestra.run.smithi032.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.95480.log.gz 2023-10-08T13:45:17.767 INFO:teuthology.orchestra.run.smithi032.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.281942.log.gz 2023-10-08T13:45:17.767 INFO:teuthology.orchestra.run.smithi032.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.287408.log.gz 2023-10-08T13:45:17.775 INFO:teuthology.orchestra.run.smithi032.stderr: 83.3% -- replaced with /var/log/ceph/ceph-client.admin.449496.log.gz 2023-10-08T13:45:17.775 INFO:teuthology.orchestra.run.smithi032.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.449103.log.gz 2023-10-08T13:45:17.790 INFO:teuthology.orchestra.run.smithi032.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.387354.log.gz 2023-10-08T13:45:17.796 INFO:teuthology.orchestra.run.smithi032.stderr: 77.8% -- replaced with /var/log/ceph/ceph-client.admin.299590.log.gz 2023-10-08T13:45:17.798 INFO:teuthology.orchestra.run.smithi032.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.147427.log.gz 2023-10-08T13:45:17.799 INFO:teuthology.orchestra.run.smithi032.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.149049.log.gz 2023-10-08T13:45:17.800 INFO:teuthology.orchestra.run.smithi032.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.148248.log.gz 2023-10-08T13:45:17.810 INFO:teuthology.orchestra.run.smithi032.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.103243.log.gz 2023-10-08T13:45:17.811 INFO:teuthology.orchestra.run.smithi032.stderr: 93.7% -- replaced with /var/log/ceph/ceph-client.admin.410138.log.gz 2023-10-08T13:45:17.813 INFO:teuthology.orchestra.run.smithi032.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.155333.log.gz 2023-10-08T13:45:17.818 INFO:teuthology.orchestra.run.smithi032.stderr: 93.7% -- replaced with /var/log/ceph/ceph-client.admin.155342.log.gz 2023-10-08T13:45:17.828 INFO:teuthology.orchestra.run.smithi032.stderr: 78.1% -- replaced with /var/log/ceph/ceph-client.admin.373527.log.gz 2023-10-08T13:45:17.834 INFO:teuthology.orchestra.run.smithi032.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.302110.log.gz 2023-10-08T13:45:17.848 INFO:teuthology.orchestra.run.smithi032.stderr: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.82125.log.gz 2023-10-08T13:45:17.852 INFO:teuthology.orchestra.run.smithi032.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.108176.log.gz 2023-10-08T13:45:17.853 INFO:teuthology.orchestra.run.smithi032.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.112785.log.gz 2023-10-08T13:45:17.853 INFO:teuthology.orchestra.run.smithi032.stderr: 91.9% -- replaced with /var/log/ceph/ceph-client.admin.244130.log.gz 2023-10-08T13:45:17.861 INFO:teuthology.orchestra.run.smithi032.stderr: 93.7% -- replaced with /var/log/ceph/ceph-client.admin.167685.log.gz 2023-10-08T13:45:17.883 INFO:teuthology.orchestra.run.smithi032.stderr: 79.1% -- replaced with /var/log/ceph/ceph-client.admin.153221.log.gz 2023-10-08T13:45:17.883 INFO:teuthology.orchestra.run.smithi032.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.317896.log.gz 2023-10-08T13:45:17.888 INFO:teuthology.orchestra.run.smithi032.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42959.log.gz 2023-10-08T13:45:17.890 INFO:teuthology.orchestra.run.smithi032.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.153636.log.gz 2023-10-08T13:45:17.890 INFO:teuthology.orchestra.run.smithi032.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.346968.log.gz 2023-10-08T13:45:17.891 INFO:teuthology.orchestra.run.smithi032.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.176896.log.gz 2023-10-08T13:45:17.897 INFO:teuthology.orchestra.run.smithi040.stderr: 94.7% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2023-10-08T13:45:17.897 INFO:teuthology.orchestra.run.smithi032.stderr: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.170274.log.gz 2023-10-08T13:45:17.911 INFO:teuthology.orchestra.run.smithi032.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.42241.log.gz 2023-10-08T13:45:17.913 INFO:teuthology.orchestra.run.smithi032.stderr: 78.5% -- replaced with /var/log/ceph/ceph-client.admin.275049.log.gz 2023-10-08T13:45:17.915 INFO:teuthology.orchestra.run.smithi032.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.276261.log.gz 2023-10-08T13:45:17.915 INFO:teuthology.orchestra.run.smithi032.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.275859.log.gz 2023-10-08T13:45:17.917 INFO:teuthology.orchestra.run.smithi032.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.205681.log.gz 2023-10-08T13:45:17.919 INFO:teuthology.orchestra.run.smithi032.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.284880.log.gz 2023-10-08T13:45:17.919 INFO:teuthology.orchestra.run.smithi032.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.279508.log.gz 2023-10-08T13:45:17.920 INFO:teuthology.orchestra.run.smithi032.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.105260.log.gz 2023-10-08T13:45:17.928 INFO:teuthology.orchestra.run.smithi032.stderr: 93.2% -- replaced with /var/log/ceph/ceph-client.admin.122825.log.gz 2023-10-08T13:45:17.930 INFO:teuthology.orchestra.run.smithi032.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.364869.log.gz 2023-10-08T13:45:17.937 INFO:teuthology.orchestra.run.smithi032.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.307735.log.gz 2023-10-08T13:45:17.942 INFO:teuthology.orchestra.run.smithi032.stderr: 93.5% -- replaced with /var/log/ceph/ceph-client.admin.308554.log.gz 2023-10-08T13:45:17.945 INFO:teuthology.orchestra.run.smithi032.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.297167.log.gz 2023-10-08T13:45:17.946 INFO:teuthology.orchestra.run.smithi032.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.297973.log.gz 2023-10-08T13:45:17.954 INFO:teuthology.orchestra.run.smithi032.stderr: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.180960.log.gz 2023-10-08T13:45:17.954 INFO:teuthology.orchestra.run.smithi032.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.214530.log.gz 2023-10-08T13:45:17.963 INFO:teuthology.orchestra.run.smithi032.stderr: 81.1% 92.2% -- replaced with /var/log/ceph/ceph-client.admin.304286.log.gz -- replaced with /var/log/ceph/ceph-client.admin.302505.log.gz 2023-10-08T13:45:17.964 INFO:teuthology.orchestra.run.smithi032.stderr: 2023-10-08T13:45:17.964 INFO:teuthology.orchestra.run.smithi032.stderr: 90.3% 83.4% -- replaced with /var/log/ceph/ceph-client.admin.375182.log.gz -- replaced with /var/log/ceph/ceph-client.admin.302101.log.gz 2023-10-08T13:45:17.965 INFO:teuthology.orchestra.run.smithi032.stderr: 2023-10-08T13:45:17.968 INFO:teuthology.orchestra.run.smithi032.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.41746.log.gz 2023-10-08T13:45:17.977 INFO:teuthology.orchestra.run.smithi032.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.86912.log.gz 2023-10-08T13:45:17.981 INFO:teuthology.orchestra.run.smithi032.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.41032.log.gz 2023-10-08T13:45:17.982 INFO:teuthology.orchestra.run.smithi032.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.314885.log.gz 2023-10-08T13:45:17.984 INFO:teuthology.orchestra.run.smithi032.stderr: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.79476.log.gz 2023-10-08T13:45:17.989 INFO:teuthology.orchestra.run.smithi032.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.394944.log.gz 2023-10-08T13:45:17.989 INFO:teuthology.orchestra.run.smithi032.stderr: 78.4% -- replaced with /var/log/ceph/ceph-client.admin.378257.log.gz 2023-10-08T13:45:17.993 INFO:teuthology.orchestra.run.smithi032.stderr: 78.9% -- replaced with /var/log/ceph/ceph-client.admin.400411.log.gz 2023-10-08T13:45:18.000 INFO:teuthology.orchestra.run.smithi032.stderr: 93.5% -- replaced with /var/log/ceph/ceph-client.admin.165960.log.gz 2023-10-08T13:45:18.002 INFO:teuthology.orchestra.run.smithi032.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.174472.log.gz 2023-10-08T13:45:18.011 INFO:teuthology.orchestra.run.smithi032.stderr: 93.2% -- replaced with /var/log/ceph/ceph-client.admin.127869.log.gz 2023-10-08T13:45:18.014 INFO:teuthology.orchestra.run.smithi032.stderr: 93.1% -- replaced with /var/log/ceph/ceph-client.admin.375585.log.gz 2023-10-08T13:45:18.015 INFO:teuthology.orchestra.run.smithi032.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.418290.log.gz 2023-10-08T13:45:18.019 INFO:teuthology.orchestra.run.smithi032.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.428769.log.gz 2023-10-08T13:45:18.019 INFO:teuthology.orchestra.run.smithi032.stderr: 84.9% -- replaced with /var/log/ceph/ceph-client.admin.440026.log.gz 2023-10-08T13:45:18.020 INFO:teuthology.orchestra.run.smithi032.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.443464.log.gz 2023-10-08T13:45:18.021 INFO:teuthology.orchestra.run.smithi032.stderr: 77.5% -- replaced with /var/log/ceph/ceph-client.admin.349139.log.gz 2023-10-08T13:45:18.024 INFO:teuthology.orchestra.run.smithi032.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.449505.log.gz 2023-10-08T13:45:18.027 INFO:teuthology.orchestra.run.smithi032.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.230808.log.gz 2023-10-08T13:45:18.027 INFO:teuthology.orchestra.run.smithi032.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.279499.log.gz 2023-10-08T13:45:18.030 INFO:teuthology.orchestra.run.smithi032.stderr: 77.6% -- replaced with /var/log/ceph/ceph-client.admin.274647.log.gz 2023-10-08T13:45:18.030 INFO:teuthology.orchestra.run.smithi032.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.272228.log.gz 2023-10-08T13:45:18.031 INFO:teuthology.orchestra.run.smithi032.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.295132.log.gz 2023-10-08T13:45:18.032 INFO:teuthology.orchestra.run.smithi032.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.296341.log.gz 2023-10-08T13:45:18.034 INFO:teuthology.orchestra.run.smithi032.stderr: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.424839.log.gz 2023-10-08T13:45:18.036 INFO:teuthology.orchestra.run.smithi032.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.209635.log.gz 2023-10-08T13:45:18.038 INFO:teuthology.orchestra.run.smithi032.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.408863.log.gz 2023-10-08T13:45:18.046 INFO:teuthology.orchestra.run.smithi032.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.234030.log.gz 2023-10-08T13:45:18.049 INFO:teuthology.orchestra.run.smithi032.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.346570.log.gz 2023-10-08T13:45:18.053 INFO:teuthology.orchestra.run.smithi032.stderr: 94.8% -- replaced with /var/log/ceph/ceph-client.0.45161.log.gz 2023-10-08T13:45:18.053 INFO:teuthology.orchestra.run.smithi032.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.337838.log.gz 2023-10-08T13:45:18.073 INFO:teuthology.orchestra.run.smithi032.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.303345.log.gz 2023-10-08T13:45:18.077 INFO:teuthology.orchestra.run.smithi032.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.40531.log.gz 2023-10-08T13:45:18.081 INFO:teuthology.orchestra.run.smithi032.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.41037.log.gz 2023-10-08T13:45:18.081 INFO:teuthology.orchestra.run.smithi032.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.41038.log.gz 2023-10-08T13:45:18.084 INFO:teuthology.orchestra.run.smithi032.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.286178.log.gz 2023-10-08T13:45:18.086 INFO:teuthology.orchestra.run.smithi032.stderr: 77.8% -- replaced with /var/log/ceph/ceph-client.admin.309839.log.gz 2023-10-08T13:45:18.100 INFO:teuthology.orchestra.run.smithi032.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.395346.log.gz 2023-10-08T13:45:18.108 INFO:teuthology.orchestra.run.smithi032.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.403929.log.gz 2023-10-08T13:45:18.117 INFO:teuthology.orchestra.run.smithi032.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.128756.log.gz 2023-10-08T13:45:18.117 INFO:teuthology.orchestra.run.smithi032.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.admin.427900.log.gz 2023-10-08T13:45:18.123 INFO:teuthology.orchestra.run.smithi032.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.182678.log.gz 2023-10-08T13:45:18.126 INFO:teuthology.orchestra.run.smithi032.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.349148.log.gz 2023-10-08T13:45:18.128 INFO:teuthology.orchestra.run.smithi032.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.117779.log.gz 2023-10-08T13:45:18.128 INFO:teuthology.orchestra.run.smithi032.stderr: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.444268.log.gz 2023-10-08T13:45:18.129 INFO:teuthology.orchestra.run.smithi032.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.422014.log.gz 2023-10-08T13:45:18.129 INFO:teuthology.orchestra.run.smithi032.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.448692.log.gz 2023-10-08T13:45:18.134 INFO:teuthology.orchestra.run.smithi032.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.242793.log.gz 2023-10-08T13:45:18.134 INFO:teuthology.orchestra.run.smithi032.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.41910.log.gz 2023-10-08T13:45:18.136 INFO:teuthology.orchestra.run.smithi032.stderr: 79.6% -- replaced with /var/log/ceph/ceph-client.admin.272624.log.gz 2023-10-08T13:45:18.136 INFO:teuthology.orchestra.run.smithi032.stderr: 79.1% -- replaced with /var/log/ceph/ceph-client.admin.283242.log.gz 2023-10-08T13:45:18.139 INFO:teuthology.orchestra.run.smithi032.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.289419.log.gz 2023-10-08T13:45:18.148 INFO:teuthology.orchestra.run.smithi032.stderr: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.151089.log.gz 2023-10-08T13:45:18.148 INFO:teuthology.orchestra.run.smithi032.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.213720.log.gz 2023-10-08T13:45:18.148 INFO:teuthology.orchestra.run.smithi032.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.40826.log.gz 2023-10-08T13:45:18.153 INFO:teuthology.orchestra.run.smithi032.stderr: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.169843.log.gz 2023-10-08T13:45:18.156 INFO:teuthology.orchestra.run.smithi032.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44722.log.gz 2023-10-08T13:45:18.158 INFO:teuthology.orchestra.run.smithi032.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.244602.log.gz 2023-10-08T13:45:18.161 INFO:teuthology.orchestra.run.smithi032.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.342161.log.gz 2023-10-08T13:45:18.162 INFO:teuthology.orchestra.run.smithi032.stderr: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.342568.log.gz 2023-10-08T13:45:18.165 INFO:teuthology.orchestra.run.smithi032.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45101.log.gz 2023-10-08T13:45:18.165 INFO:teuthology.orchestra.run.smithi032.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.45023.log.gz 2023-10-08T13:45:18.171 INFO:teuthology.orchestra.run.smithi032.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.35900.log.gz 2023-10-08T13:45:18.173 INFO:teuthology.orchestra.run.smithi032.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.205250.log.gz 2023-10-08T13:45:18.181 INFO:teuthology.orchestra.run.smithi032.stderr: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.201992.log.gz 2023-10-08T13:45:18.182 INFO:teuthology.orchestra.run.smithi032.stderr: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.315294.log.gz 2023-10-08T13:45:18.183 INFO:teuthology.orchestra.run.smithi032.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.149058.log.gz 2023-10-08T13:45:18.184 INFO:teuthology.orchestra.run.smithi032.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.397490.log.gz 2023-10-08T13:45:18.190 INFO:teuthology.orchestra.run.smithi032.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.397936.log.gz 2023-10-08T13:45:18.193 INFO:teuthology.orchestra.run.smithi032.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.155764.log.gz 2023-10-08T13:45:18.200 INFO:teuthology.orchestra.run.smithi032.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.156601.log.gz 2023-10-08T13:45:18.203 INFO:teuthology.orchestra.run.smithi032.stderr: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.151519.log.gz 2023-10-08T13:45:18.275 INFO:teuthology.orchestra.run.smithi032.stderr: 94.1% -- replaced with /var/log/ceph/ceph-client.admin.156610.log.gz 2023-10-08T13:45:18.275 INFO:teuthology.orchestra.run.smithi032.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.180122.log.gz 2023-10-08T13:45:18.276 INFO:teuthology.orchestra.run.smithi032.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.190201.log.gz 2023-10-08T13:45:18.276 INFO:teuthology.orchestra.run.smithi032.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.291436.log.gz 2023-10-08T13:45:18.276 INFO:teuthology.orchestra.run.smithi032.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.359968.log.gz 2023-10-08T13:45:18.277 INFO:teuthology.orchestra.run.smithi032.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.359977.log.gz 2023-10-08T13:45:18.277 INFO:teuthology.orchestra.run.smithi032.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.284086.log.gz 2023-10-08T13:45:18.277 INFO:teuthology.orchestra.run.smithi032.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.298769.log.gz 2023-10-08T13:45:18.277 INFO:teuthology.orchestra.run.smithi032.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.367310.log.gz 2023-10-08T13:45:18.278 INFO:teuthology.orchestra.run.smithi032.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.377047.log.gz 2023-10-08T13:45:18.278 INFO:teuthology.orchestra.run.smithi032.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.162114.log.gz 2023-10-08T13:45:18.278 INFO:teuthology.orchestra.run.smithi032.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42328.log.gz 2023-10-08T13:45:18.278 INFO:teuthology.orchestra.run.smithi032.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.43810.log.gz 2023-10-08T13:45:18.279 INFO:teuthology.orchestra.run.smithi032.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.81247.log.gz 2023-10-08T13:45:18.279 INFO:teuthology.orchestra.run.smithi032.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42544.log.gz 2023-10-08T13:45:18.279 INFO:teuthology.orchestra.run.smithi032.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.42709.log.gz 2023-10-08T13:45:18.279 INFO:teuthology.orchestra.run.smithi032.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.100820.log.gz 2023-10-08T13:45:18.280 INFO:teuthology.orchestra.run.smithi032.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.111115.log.gz 2023-10-08T13:45:18.280 INFO:teuthology.orchestra.run.smithi032.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.105664.log.gz 2023-10-08T13:45:18.280 INFO:teuthology.orchestra.run.smithi032.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.109876.log.gz 2023-10-08T13:45:18.280 INFO:teuthology.orchestra.run.smithi032.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.199928.log.gz 2023-10-08T13:45:18.292 INFO:teuthology.orchestra.run.smithi032.stderr: 77.7% -- replaced with /var/log/ceph/ceph-client.admin.410129.log.gz 2023-10-08T13:45:18.301 INFO:teuthology.orchestra.run.smithi032.stderr: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.166392.log.gz 2023-10-08T13:45:18.303 INFO:teuthology.orchestra.run.smithi032.stderr: 94.1% -- replaced with /var/log/ceph/ceph-client.admin.395754.log.gz 2023-10-08T13:45:18.305 INFO:teuthology.orchestra.run.smithi032.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.385739.log.gz 2023-10-08T13:45:18.312 INFO:teuthology.orchestra.run.smithi032.stderr: 93.5% -- replaced with /var/log/ceph/ceph-client.admin.153645.log.gz 2023-10-08T13:45:18.316 INFO:teuthology.orchestra.run.smithi032.stderr: 93.3% -- replaced with /var/log/ceph/ceph-client.admin.157045.log.gz 2023-10-08T13:45:18.331 INFO:teuthology.orchestra.run.smithi032.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.364878.log.gz 2023-10-08T13:45:18.331 INFO:teuthology.orchestra.run.smithi032.stderr: 93.5% -- replaced with /var/log/ceph/ceph-client.admin.410664.log.gz 2023-10-08T13:45:18.334 INFO:teuthology.orchestra.run.smithi032.stderr: 79.6% -- replaced with /var/log/ceph/ceph-client.admin.416579.log.gz 2023-10-08T13:45:18.335 INFO:teuthology.orchestra.run.smithi032.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.416185.log.gz 2023-10-08T13:45:18.337 INFO:teuthology.orchestra.run.smithi032.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.230395.log.gz 2023-10-08T13:45:18.337 INFO:teuthology.orchestra.run.smithi032.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.291427.log.gz 2023-10-08T13:45:18.338 INFO:teuthology.orchestra.run.smithi032.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.218050.log.gz 2023-10-08T13:45:18.353 INFO:teuthology.orchestra.run.smithi032.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.312284.log.gz 2023-10-08T13:45:18.353 INFO:teuthology.orchestra.run.smithi032.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.314419.log.gz 2023-10-08T13:45:18.356 INFO:teuthology.orchestra.run.smithi032.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.317053.log.gz 2023-10-08T13:45:18.359 INFO:teuthology.orchestra.run.smithi032.stderr: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.405258.log.gz 2023-10-08T13:45:18.383 INFO:teuthology.orchestra.run.smithi032.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.40612.log.gz 2023-10-08T13:45:18.384 INFO:teuthology.orchestra.run.smithi032.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.41449.log.gz 2023-10-08T13:45:18.385 INFO:teuthology.orchestra.run.smithi032.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.41476.log.gz 2023-10-08T13:45:18.385 INFO:teuthology.orchestra.run.smithi032.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.41800.log.gz 2023-10-08T13:45:18.386 INFO:teuthology.orchestra.run.smithi032.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43783.log.gz 2023-10-08T13:45:18.395 INFO:teuthology.orchestra.run.smithi032.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.106069.log.gz 2023-10-08T13:45:18.406 INFO:teuthology.orchestra.run.smithi032.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.277080.log.gz 2023-10-08T13:45:18.420 INFO:teuthology.orchestra.run.smithi032.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.385286.log.gz 2023-10-08T13:45:18.421 INFO:teuthology.orchestra.run.smithi032.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.396677.log.gz 2023-10-08T13:45:18.421 INFO:teuthology.orchestra.run.smithi032.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.397079.log.gz 2023-10-08T13:45:18.432 INFO:teuthology.orchestra.run.smithi032.stderr: 77.9% -- replaced with /var/log/ceph/ceph-client.admin.195272.log.gz 2023-10-08T13:45:18.434 INFO:teuthology.orchestra.run.smithi032.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.365285.log.gz 2023-10-08T13:45:18.435 INFO:teuthology.orchestra.run.smithi032.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.168108.log.gz 2023-10-08T13:45:18.435 INFO:teuthology.orchestra.run.smithi032.stderr: 77.9% -- replaced with /var/log/ceph/ceph-client.admin.430377.log.gz 2023-10-08T13:45:18.436 INFO:teuthology.orchestra.run.smithi032.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.40038.log.gz 2023-10-08T13:45:18.437 INFO:teuthology.orchestra.run.smithi032.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.40369.log.gz 2023-10-08T13:45:18.438 INFO:teuthology.orchestra.run.smithi032.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.440810.log.gz 2023-10-08T13:45:18.440 INFO:teuthology.orchestra.run.smithi032.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.447494.log.gz 2023-10-08T13:45:18.442 INFO:teuthology.orchestra.run.smithi032.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.448298.log.gz 2023-10-08T13:45:18.443 INFO:teuthology.orchestra.run.smithi032.stderr: 78.5% -- replaced with /var/log/ceph/ceph-client.admin.233628.log.gz 2023-10-08T13:45:18.444 INFO:teuthology.orchestra.run.smithi032.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.218932.log.gz 2023-10-08T13:45:18.445 INFO:teuthology.orchestra.run.smithi032.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.207998.log.gz 2023-10-08T13:45:18.446 INFO:teuthology.orchestra.run.smithi032.stderr: 77.5% -- replaced with /var/log/ceph/ceph-client.admin.281519.log.gz 2023-10-08T13:45:18.447 INFO:teuthology.orchestra.run.smithi032.stderr: 78.9% -- replaced with /var/log/ceph/ceph-client.admin.226225.log.gz 2023-10-08T13:45:18.451 INFO:teuthology.orchestra.run.smithi032.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.97089.log.gz 2023-10-08T13:45:18.453 INFO:teuthology.orchestra.run.smithi032.stderr: 93.8% -- replaced with /var/log/ceph/ceph-client.admin.415333.log.gz 2023-10-08T13:45:18.455 INFO:teuthology.orchestra.run.smithi032.stderr: 92.7% -- replaced with /var/log/ceph/ceph-client.admin.374374.log.gz 2023-10-08T13:45:18.457 INFO:teuthology.orchestra.run.smithi032.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.398355.log.gz 2023-10-08T13:45:18.463 INFO:teuthology.orchestra.run.smithi032.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.234039.log.gz 2023-10-08T13:45:18.473 INFO:teuthology.orchestra.run.smithi032.stderr: 79.2% -- replaced with /var/log/ceph/ceph-client.admin.350389.log.gz 2023-10-08T13:45:18.478 INFO:teuthology.orchestra.run.smithi032.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.213316.log.gz 2023-10-08T13:45:18.478 INFO:teuthology.orchestra.run.smithi032.stderr: 84.3% -- replaced with /var/log/ceph/ceph-client.admin.216403.log.gz 2023-10-08T13:45:18.497 INFO:teuthology.orchestra.run.smithi032.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.44323.log.gz 2023-10-08T13:45:18.510 INFO:teuthology.orchestra.run.smithi032.stderr: 84.4% -- replaced with /var/log/ceph/ceph-client.admin.80293.log.gz 2023-10-08T13:45:18.511 INFO:teuthology.orchestra.run.smithi032.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.161200.log.gz 2023-10-08T13:45:18.512 INFO:teuthology.orchestra.run.smithi032.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.40821.log.gz 2023-10-08T13:45:18.513 INFO:teuthology.orchestra.run.smithi032.stderr: 78.2% -- replaced with /var/log/ceph/ceph-client.admin.120741.log.gz 2023-10-08T13:45:18.514 INFO:teuthology.orchestra.run.smithi032.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.41259.log.gz 2023-10-08T13:45:18.514 INFO:teuthology.orchestra.run.smithi032.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.42682.log.gz 2023-10-08T13:45:18.524 INFO:teuthology.orchestra.run.smithi032.stderr: 92.7% -- replaced with /var/log/ceph/ceph-client.admin.93725.log.gz 2023-10-08T13:45:18.525 INFO:teuthology.orchestra.run.smithi032.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.95892.log.gz 2023-10-08T13:45:18.525 INFO:teuthology.orchestra.run.smithi032.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.95489.log.gz 2023-10-08T13:45:18.537 INFO:teuthology.orchestra.run.smithi032.stderr: 78.6% -- replaced with /var/log/ceph/ceph-client.admin.98388.log.gz 2023-10-08T13:45:18.540 INFO:teuthology.orchestra.run.smithi032.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.174883.log.gz 2023-10-08T13:45:18.540 INFO:teuthology.orchestra.run.smithi032.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.309848.log.gz 2023-10-08T13:45:18.541 INFO:teuthology.orchestra.run.smithi032.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.102429.log.gz 2023-10-08T13:45:18.542 INFO:teuthology.orchestra.run.smithi032.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.321246.log.gz 2023-10-08T13:45:18.544 INFO:teuthology.orchestra.run.smithi032.stderr: 93.8% -- replaced with /var/log/ceph/ceph-client.admin.319839.log.gz 2023-10-08T13:45:18.545 INFO:teuthology.orchestra.run.smithi032.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.390414.log.gz 2023-10-08T13:45:18.547 INFO:teuthology.orchestra.run.smithi032.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43014.log.gz 2023-10-08T13:45:18.552 INFO:teuthology.orchestra.run.smithi032.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.154498.log.gz 2023-10-08T13:45:18.553 INFO:teuthology.orchestra.run.smithi032.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.122372.log.gz 2023-10-08T13:45:18.558 INFO:teuthology.orchestra.run.smithi032.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.391681.log.gz 2023-10-08T13:45:18.559 INFO:teuthology.orchestra.run.smithi032.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.344217.log.gz 2023-10-08T13:45:18.562 INFO:teuthology.orchestra.run.smithi032.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.419917.log.gz 2023-10-08T13:45:18.562 INFO:teuthology.orchestra.run.smithi032.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.390423.log.gz 2023-10-08T13:45:18.570 INFO:teuthology.orchestra.run.smithi032.stderr: 79.2% -- replaced with /var/log/ceph/ceph-client.admin.428362.log.gz 2023-10-08T13:45:18.570 INFO:teuthology.orchestra.run.smithi032.stderr: 77.9% -- replaced with /var/log/ceph/ceph-client.admin.438488.log.gz 2023-10-08T13:45:18.571 INFO:teuthology.orchestra.run.smithi032.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.443866.log.gz 2023-10-08T13:45:18.580 INFO:teuthology.orchestra.run.smithi032.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.284488.log.gz 2023-10-08T13:45:18.580 INFO:teuthology.orchestra.run.smithi032.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.297964.log.gz 2023-10-08T13:45:18.655 INFO:teuthology.orchestra.run.smithi032.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.234834.log.gz 2023-10-08T13:45:18.659 INFO:teuthology.orchestra.run.smithi032.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.334856.log.gz 2023-10-08T13:45:18.660 INFO:teuthology.orchestra.run.smithi032.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.362404.log.gz 2023-10-08T13:45:18.694 INFO:teuthology.orchestra.run.smithi032.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.83416.log.gz 2023-10-08T13:45:18.698 INFO:teuthology.orchestra.run.smithi032.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.310668.log.gz 2023-10-08T13:45:18.698 INFO:teuthology.orchestra.run.smithi032.stderr: 78.5% -- replaced with /var/log/ceph/ceph-client.admin.312275.log.gz 2023-10-08T13:45:18.699 INFO:teuthology.orchestra.run.smithi032.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.112388.log.gz 2023-10-08T13:45:18.699 INFO:teuthology.orchestra.run.smithi032.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.309436.log.gz 2023-10-08T13:45:18.701 INFO:teuthology.orchestra.run.smithi032.stderr: 92.0% -- replaced with /var/log/ceph/ceph-client.admin.313088.log.gz 2023-10-08T13:45:18.705 INFO:teuthology.orchestra.run.smithi032.stderr: 93.7% -- replaced with /var/log/ceph/ceph-client.admin.318860.log.gz 2023-10-08T13:45:18.706 INFO:teuthology.orchestra.run.smithi032.stderr: 78.4% -- replaced with /var/log/ceph/ceph-client.admin.403452.log.gz 2023-10-08T13:45:18.706 INFO:teuthology.orchestra.run.smithi032.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.404388.log.gz 2023-10-08T13:45:18.707 INFO:teuthology.orchestra.run.smithi032.stderr: 93.2% 81.4% -- replaced with /var/log/ceph/ceph-client.admin.376023.log.gz 2023-10-08T13:45:18.707 INFO:teuthology.orchestra.run.smithi032.stderr: -- replaced with /var/log/ceph/ceph-client.admin.176082.log.gz 2023-10-08T13:45:18.707 INFO:teuthology.orchestra.run.smithi032.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.180113.log.gz 2023-10-08T13:45:18.708 INFO:teuthology.orchestra.run.smithi032.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.344611.log.gz 2023-10-08T13:45:18.728 INFO:teuthology.orchestra.run.smithi032.stderr: 80.3% -- replaced with /var/log/ceph/ceph-client.admin.207989.log.gz 2023-10-08T13:45:18.738 INFO:teuthology.orchestra.run.smithi032.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.246253.log.gz 2023-10-08T13:45:18.746 INFO:teuthology.orchestra.run.smithi032.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.296350.log.gz 2023-10-08T13:45:18.794 INFO:teuthology.orchestra.run.smithi032.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.198706.log.gz 2023-10-08T13:45:18.794 INFO:teuthology.orchestra.run.smithi032.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.220968.log.gz 2023-10-08T13:45:18.802 INFO:teuthology.orchestra.run.smithi032.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.200340.log.gz 2023-10-08T13:45:18.806 INFO:teuthology.orchestra.run.smithi032.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.227041.log.gz 2023-10-08T13:45:18.806 INFO:teuthology.orchestra.run.smithi032.stderr: 79.5% -- replaced with /var/log/ceph/ceph-client.admin.227443.log.gz 2023-10-08T13:45:18.831 INFO:teuthology.orchestra.run.smithi032.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.42654.log.gz 2023-10-08T13:45:18.834 INFO:teuthology.orchestra.run.smithi032.stderr: 78.7% -- replaced with /var/log/ceph/ceph-client.admin.451155.log.gz 2023-10-08T13:45:18.835 INFO:teuthology.orchestra.run.smithi032.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.43729.log.gz 2023-10-08T13:45:18.851 INFO:teuthology.orchestra.run.smithi032.stderr: 78.0% -- replaced with /var/log/ceph/ceph-client.admin.187729.log.gz 2023-10-08T13:45:18.859 INFO:teuthology.orchestra.run.smithi032.stderr: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.189388.log.gz 2023-10-08T13:45:18.859 INFO:teuthology.orchestra.run.smithi032.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.150267.log.gz 2023-10-08T13:45:18.860 INFO:teuthology.orchestra.run.smithi032.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.345020.log.gz 2023-10-08T13:45:18.860 INFO:teuthology.orchestra.run.smithi032.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.347470.log.gz 2023-10-08T13:45:18.860 INFO:teuthology.orchestra.run.smithi032.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.189397.log.gz 2023-10-08T13:45:18.867 INFO:teuthology.orchestra.run.smithi032.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.387363.log.gz 2023-10-08T13:45:18.868 INFO:teuthology.orchestra.run.smithi032.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.236113.log.gz 2023-10-08T13:45:18.870 INFO:teuthology.orchestra.run.smithi032.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.417495.log.gz 2023-10-08T13:45:18.875 INFO:teuthology.orchestra.run.smithi032.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.446287.log.gz 2023-10-08T13:45:18.876 INFO:teuthology.orchestra.run.smithi032.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.281118.log.gz 2023-10-08T13:45:18.882 INFO:teuthology.orchestra.run.smithi032.stderr: 93.7% -- replaced with /var/log/ceph/ceph-client.admin.345029.log.gz 2023-10-08T13:45:18.885 INFO:teuthology.orchestra.run.smithi032.stderr: 88.9% -- replaced with /var/log/ceph/ceph.log.gz 2023-10-08T13:45:18.887 INFO:teuthology.orchestra.run.smithi032.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.209644.log.gz 2023-10-08T13:45:18.894 INFO:teuthology.orchestra.run.smithi032.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.358358.log.gz 2023-10-08T13:45:18.894 INFO:teuthology.orchestra.run.smithi032.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.358760.log.gz 2023-10-08T13:45:18.894 INFO:teuthology.orchestra.run.smithi032.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.359171.log.gz 2023-10-08T13:45:18.895 INFO:teuthology.orchestra.run.smithi032.stderr: 78.5% -- replaced with /var/log/ceph/ceph-client.admin.361997.log.gz 2023-10-08T13:45:18.906 INFO:teuthology.orchestra.run.smithi032.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.43453.log.gz 2023-10-08T13:45:18.916 INFO:teuthology.orchestra.run.smithi032.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.274249.log.gz 2023-10-08T13:45:18.920 INFO:teuthology.orchestra.run.smithi032.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.40613.log.gz 2023-10-08T13:45:18.922 INFO:teuthology.orchestra.run.smithi032.stderr: 92.8% -- replaced with /var/log/ceph/ceph-client.admin.119086.log.gz 2023-10-08T13:45:18.933 INFO:teuthology.orchestra.run.smithi032.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.43670.log.gz 2023-10-08T13:45:18.934 INFO:teuthology.orchestra.run.smithi032.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.43756.log.gz 2023-10-08T13:45:18.934 INFO:teuthology.orchestra.run.smithi032.stderr: 77.5% -- replaced with /var/log/ceph/ceph-client.admin.100418.log.gz 2023-10-08T13:45:18.934 INFO:teuthology.orchestra.run.smithi032.stderr: 92.9% -- replaced with /var/log/ceph/ceph-client.admin.82550.log.gz 2023-10-08T13:45:18.934 INFO:teuthology.orchestra.run.smithi032.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.110700.log.gz 2023-10-08T13:45:18.942 INFO:teuthology.orchestra.run.smithi032.stderr: 95.3% -- replaced with /var/log/ceph/ceph-client.admin.376309.log.gz 2023-10-08T13:45:18.944 INFO:teuthology.orchestra.run.smithi032.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.2.42164.log.gz 2023-10-08T13:45:18.945 INFO:teuthology.orchestra.run.smithi032.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.78884.log.gz 2023-10-08T13:45:18.945 INFO:teuthology.orchestra.run.smithi032.stderr: 78.7% -- replaced with /var/log/ceph/ceph-client.admin.191398.log.gz 2023-10-08T13:45:18.946 INFO:teuthology.orchestra.run.smithi032.stderr: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.345862.log.gz 2023-10-08T13:45:18.947 INFO:teuthology.orchestra.run.smithi032.stderr: 84.0% -- replaced with /var/log/ceph/ceph-client.admin.367703.log.gz 2023-10-08T13:45:18.948 INFO:teuthology.orchestra.run.smithi032.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.40829.log.gz 2023-10-08T13:45:18.949 INFO:teuthology.orchestra.run.smithi032.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.411240.log.gz 2023-10-08T13:45:18.949 INFO:teuthology.orchestra.run.smithi032.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.127860.log.gz 2023-10-08T13:45:18.949 INFO:teuthology.orchestra.run.smithi032.stderr: 78.6% -- replaced with /var/log/ceph/ceph-client.admin.128354.log.gz 2023-10-08T13:45:18.952 INFO:teuthology.orchestra.run.smithi032.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.434780.log.gz 2023-10-08T13:45:18.952 INFO:teuthology.orchestra.run.smithi032.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.431622.log.gz 2023-10-08T13:45:18.953 INFO:teuthology.orchestra.run.smithi032.stderr: 92.8% -- replaced with /var/log/ceph/ceph-client.admin.431190.log.gz 2023-10-08T13:45:18.954 INFO:teuthology.orchestra.run.smithi032.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.444277.log.gz 2023-10-08T13:45:18.956 INFO:teuthology.orchestra.run.smithi032.stderr: 84.3% -- replaced with /var/log/ceph/ceph-client.admin.421601.log.gz 2023-10-08T13:45:18.959 INFO:teuthology.orchestra.run.smithi032.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.206083.log.gz 2023-10-08T13:45:18.961 INFO:teuthology.orchestra.run.smithi032.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.222588.log.gz 2023-10-08T13:45:18.962 INFO:teuthology.orchestra.run.smithi032.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.224194.log.gz 2023-10-08T13:45:18.965 INFO:teuthology.orchestra.run.smithi032.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.235265.log.gz 2023-10-08T13:45:18.967 INFO:teuthology.orchestra.run.smithi032.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.245040.log.gz 2023-10-08T13:45:18.971 INFO:teuthology.orchestra.run.smithi032.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.358769.log.gz 2023-10-08T13:45:18.975 INFO:teuthology.orchestra.run.smithi032.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.355052.log.gz 2023-10-08T13:45:18.978 INFO:teuthology.orchestra.run.smithi032.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.395337.log.gz 2023-10-08T13:45:18.996 INFO:teuthology.orchestra.run.smithi032.stderr: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.432030.log.gz 2023-10-08T13:45:18.999 INFO:teuthology.orchestra.run.smithi032.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.317887.log.gz 2023-10-08T13:45:19.003 INFO:teuthology.orchestra.run.smithi032.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.40147.log.gz 2023-10-08T13:45:19.007 INFO:teuthology.orchestra.run.smithi032.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43181.log.gz 2023-10-08T13:45:19.026 INFO:teuthology.orchestra.run.smithi032.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.149867.log.gz 2023-10-08T13:45:19.027 INFO:teuthology.orchestra.run.smithi032.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.389954.log.gz 2023-10-08T13:45:19.035 INFO:teuthology.orchestra.run.smithi032.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.371088.log.gz 2023-10-08T13:45:19.035 INFO:teuthology.orchestra.run.smithi032.stderr: 84.0% -- replaced with /var/log/ceph/ceph-client.admin.104039.log.gz 2023-10-08T13:45:19.038 INFO:teuthology.orchestra.run.smithi032.stderr: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.429975.log.gz 2023-10-08T13:45:19.039 INFO:teuthology.orchestra.run.smithi032.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.98397.log.gz 2023-10-08T13:45:19.040 INFO:teuthology.orchestra.run.smithi032.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.437791.log.gz 2023-10-08T13:45:19.042 INFO:teuthology.orchestra.run.smithi032.stderr: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.445474.log.gz 2023-10-08T13:45:19.044 INFO:teuthology.orchestra.run.smithi032.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.205690.log.gz 2023-10-08T13:45:19.045 INFO:teuthology.orchestra.run.smithi032.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.232015.log.gz 2023-10-08T13:45:19.047 INFO:teuthology.orchestra.run.smithi032.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.234441.log.gz 2023-10-08T13:45:19.048 INFO:teuthology.orchestra.run.smithi032.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.233227.log.gz 2023-10-08T13:45:19.048 INFO:teuthology.orchestra.run.smithi032.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.232419.log.gz 2023-10-08T13:45:19.048 INFO:teuthology.orchestra.run.smithi032.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.283684.log.gz 2023-10-08T13:45:19.049 INFO:teuthology.orchestra.run.smithi032.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.351409.log.gz 2023-10-08T13:45:19.050 INFO:teuthology.orchestra.run.smithi032.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.292644.log.gz 2023-10-08T13:45:19.052 INFO:teuthology.orchestra.run.smithi032.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.296745.log.gz 2023-10-08T13:45:19.058 INFO:teuthology.orchestra.run.smithi032.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.404865.log.gz 2023-10-08T13:45:19.071 INFO:teuthology.orchestra.run.smithi032.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.40450.log.gz 2023-10-08T13:45:19.077 INFO:teuthology.orchestra.run.smithi032.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.278700.log.gz 2023-10-08T13:45:19.083 INFO:teuthology.orchestra.run.smithi032.stderr: 79.3% -- replaced with /var/log/ceph/ceph-client.admin.354212.log.gz 2023-10-08T13:45:19.085 INFO:teuthology.orchestra.run.smithi032.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.44269.log.gz 2023-10-08T13:45:19.093 INFO:teuthology.orchestra.run.smithi032.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.165126.log.gz 2023-10-08T13:45:19.094 INFO:teuthology.orchestra.run.smithi032.stderr: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.372315.log.gz 2023-10-08T13:45:19.095 INFO:teuthology.orchestra.run.smithi032.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.371915.log.gz 2023-10-08T13:45:19.095 INFO:teuthology.orchestra.run.smithi032.stderr: 79.7% -- replaced with /var/log/ceph/ceph-client.admin.303811.log.gz 2023-10-08T13:45:19.098 INFO:teuthology.orchestra.run.smithi032.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.40065.log.gz 2023-10-08T13:45:19.099 INFO:teuthology.orchestra.run.smithi032.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.40611.log.gz 2023-10-08T13:45:19.101 INFO:teuthology.orchestra.run.smithi032.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.428155.log.gz 2023-10-08T13:45:19.102 INFO:teuthology.orchestra.run.smithi032.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.42301.log.gz 2023-10-08T13:45:19.107 INFO:teuthology.orchestra.run.smithi032.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.43589.log.gz 2023-10-08T13:45:19.108 INFO:teuthology.orchestra.run.smithi032.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43534.log.gz 2023-10-08T13:45:19.112 INFO:teuthology.orchestra.run.smithi032.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.42763.log.gz 2023-10-08T13:45:19.114 INFO:teuthology.orchestra.run.smithi032.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.306083.log.gz 2023-10-08T13:45:19.116 INFO:teuthology.orchestra.run.smithi032.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.308142.log.gz 2023-10-08T13:45:19.116 INFO:teuthology.orchestra.run.smithi032.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.308984.log.gz 2023-10-08T13:45:19.117 INFO:teuthology.orchestra.run.smithi032.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.306897.log.gz 2023-10-08T13:45:19.117 INFO:teuthology.orchestra.run.smithi032.stderr: 78.2% -- replaced with /var/log/ceph/ceph-client.admin.312677.log.gz 2023-10-08T13:45:19.117 INFO:teuthology.orchestra.run.smithi032.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.306494.log.gz 2023-10-08T13:45:19.118 INFO:teuthology.orchestra.run.smithi032.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.319830.log.gz 2023-10-08T13:45:19.119 INFO:teuthology.orchestra.run.smithi032.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.104857.log.gz 2023-10-08T13:45:19.122 INFO:teuthology.orchestra.run.smithi032.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.377056.log.gz 2023-10-08T13:45:19.132 INFO:teuthology.orchestra.run.smithi032.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.174481.log.gz 2023-10-08T13:45:19.132 INFO:teuthology.orchestra.run.smithi032.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.156166.log.gz 2023-10-08T13:45:19.134 INFO:teuthology.orchestra.run.smithi032.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.392913.log.gz 2023-10-08T13:45:19.136 INFO:teuthology.orchestra.run.smithi032.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.393737.log.gz 2023-10-08T13:45:19.136 INFO:teuthology.orchestra.run.smithi032.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.399200.log.gz 2023-10-08T13:45:19.141 INFO:teuthology.orchestra.run.smithi032.stderr: 79.1% -- replaced with /var/log/ceph/ceph-client.admin.367301.log.gz 2023-10-08T13:45:19.142 INFO:teuthology.orchestra.run.smithi032.stderr: 84.0% -- replaced with /var/log/ceph/ceph-client.admin.186325.log.gz 2023-10-08T13:45:19.143 INFO:teuthology.orchestra.run.smithi032.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.406265.log.gz 2023-10-08T13:45:19.145 INFO:teuthology.orchestra.run.smithi032.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.429984.log.gz 2023-10-08T13:45:19.146 INFO:teuthology.orchestra.run.smithi032.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.308151.log.gz 2023-10-08T13:45:19.146 INFO:teuthology.orchestra.run.smithi032.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.445081.log.gz 2023-10-08T13:45:19.148 INFO:teuthology.orchestra.run.smithi032.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.157515.log.gz 2023-10-08T13:45:19.150 INFO:teuthology.orchestra.run.smithi032.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.220552.log.gz 2023-10-08T13:45:19.151 INFO:teuthology.orchestra.run.smithi032.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.388180.log.gz 2023-10-08T13:45:19.152 INFO:teuthology.orchestra.run.smithi032.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.294262.log.gz 2023-10-08T13:45:19.156 INFO:teuthology.orchestra.run.smithi032.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.295947.log.gz 2023-10-08T13:45:19.157 INFO:teuthology.orchestra.run.smithi032.stderr: 79.3% -- replaced with /var/log/ceph/ceph-client.admin.299184.log.gz 2023-10-08T13:45:19.159 INFO:teuthology.orchestra.run.smithi032.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.341342.log.gz 2023-10-08T13:45:19.160 INFO:teuthology.orchestra.run.smithi032.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.450743.log.gz 2023-10-08T13:45:19.160 INFO:teuthology.orchestra.run.smithi032.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.356308.log.gz 2023-10-08T13:45:19.161 INFO:teuthology.orchestra.run.smithi032.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.417018.log.gz 2023-10-08T13:45:19.194 INFO:teuthology.orchestra.run.smithi032.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.44242.log.gz 2023-10-08T13:45:19.201 INFO:teuthology.orchestra.run.smithi032.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44134.log.gz 2023-10-08T13:45:19.203 INFO:teuthology.orchestra.run.smithi032.stderr: 93.5% -- replaced with /var/log/ceph/ceph-client.admin.171566.log.gz 2023-10-08T13:45:19.203 INFO:teuthology.orchestra.run.smithi032.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.373118.log.gz 2023-10-08T13:45:19.206 INFO:teuthology.orchestra.run.smithi032.stderr: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.374365.log.gz 2023-10-08T13:45:19.209 INFO:teuthology.orchestra.run.smithi032.stderr: 92.0% -- replaced with /var/log/ceph/ceph-client.admin.162557.log.gz 2023-10-08T13:45:19.210 INFO:teuthology.orchestra.run.smithi032.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43208.log.gz 2023-10-08T13:45:19.211 INFO:teuthology.orchestra.run.smithi032.stderr: 83.8% -- replaced with /var/log/ceph/ceph-client.admin.86903.log.gz 2023-10-08T13:45:19.213 INFO:teuthology.orchestra.run.smithi032.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.302514.log.gz 2023-10-08T13:45:19.218 INFO:teuthology.orchestra.run.smithi032.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.101634.log.gz 2023-10-08T13:45:19.227 INFO:teuthology.orchestra.run.smithi032.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.103645.log.gz 2023-10-08T13:45:19.233 INFO:teuthology.orchestra.run.smithi032.stderr: 94.9% -- replaced with /var/log/ceph/ceph-client.admin.160766.log.gz 2023-10-08T13:45:19.238 INFO:teuthology.orchestra.run.smithi032.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.396686.log.gz 2023-10-08T13:45:19.239 INFO:teuthology.orchestra.run.smithi032.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.150688.log.gz 2023-10-08T13:45:19.241 INFO:teuthology.orchestra.run.smithi032.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.147436.log.gz 2023-10-08T13:45:19.242 INFO:teuthology.orchestra.run.smithi032.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46104.log.gz 2023-10-08T13:45:19.248 INFO:teuthology.orchestra.run.smithi032.stderr: 79.5% -- replaced with /var/log/ceph/ceph-client.admin.193054.log.gz 2023-10-08T13:45:19.249 INFO:teuthology.orchestra.run.smithi032.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.155773.log.gz 2023-10-08T13:45:19.280 INFO:teuthology.orchestra.run.smithi032.stderr: 77.8% -- replaced with /var/log/ceph/ceph-client.admin.447485.log.gz 2023-10-08T13:45:19.281 INFO:teuthology.orchestra.run.smithi032.stderr: 90.4% 90.4% -- replaced with /var/log/ceph/ceph-client.admin.446690.log.gz -- replaced with /var/log/ceph/ceph-client.admin.443875.log.gz 2023-10-08T13:45:19.281 INFO:teuthology.orchestra.run.smithi032.stderr: 2023-10-08T13:45:19.363 INFO:teuthology.orchestra.run.smithi032.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.408397.log.gz 2023-10-08T13:45:19.367 INFO:teuthology.orchestra.run.smithi032.stderr: 94.1% -- replaced with /var/log/ceph/ceph-client.admin.162966.log.gz 2023-10-08T13:45:19.367 INFO:teuthology.orchestra.run.smithi032.stderr: 92.9% -- replaced with /var/log/ceph/ceph-client.admin.173271.log.gz 2023-10-08T13:45:19.379 INFO:teuthology.orchestra.run.smithi032.stderr: 77.9% -- replaced with /var/log/ceph/ceph-client.admin.237778.log.gz 2023-10-08T13:45:19.383 INFO:teuthology.orchestra.run.smithi032.stderr: 78.7% -- replaced with /var/log/ceph/ceph-client.admin.355451.log.gz 2023-10-08T13:45:19.383 INFO:teuthology.orchestra.run.smithi032.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.366907.log.gz 2023-10-08T13:45:19.392 INFO:teuthology.orchestra.run.smithi032.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.203210.log.gz 2023-10-08T13:45:19.397 INFO:teuthology.orchestra.run.smithi032.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.42932.log.gz 2023-10-08T13:45:19.402 INFO:teuthology.orchestra.run.smithi032.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.96294.log.gz 2023-10-08T13:45:19.415 INFO:teuthology.orchestra.run.smithi032.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.306485.log.gz 2023-10-08T13:45:19.419 INFO:teuthology.orchestra.run.smithi032.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.44053.log.gz 2023-10-08T13:45:19.419 INFO:teuthology.orchestra.run.smithi032.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.44026.log.gz 2023-10-08T13:45:19.422 INFO:teuthology.orchestra.run.smithi032.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43068.log.gz 2023-10-08T13:45:19.424 INFO:teuthology.orchestra.run.smithi032.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.194407.log.gz 2023-10-08T13:45:19.425 INFO:teuthology.orchestra.run.smithi032.stderr: 77.6% -- replaced with /var/log/ceph/ceph-client.admin.165519.log.gz 2023-10-08T13:45:19.426 INFO:teuthology.orchestra.run.smithi032.stderr: 79.7% -- replaced with /var/log/ceph/ceph-client.admin.92891.log.gz 2023-10-08T13:45:19.427 INFO:teuthology.orchestra.run.smithi032.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.121151.log.gz 2023-10-08T13:45:19.428 INFO:teuthology.orchestra.run.smithi032.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.111521.log.gz 2023-10-08T13:45:19.430 INFO:teuthology.orchestra.run.smithi032.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43154.log.gz 2023-10-08T13:45:19.432 INFO:teuthology.orchestra.run.smithi032.stderr: 84.4% -- replaced with /var/log/ceph/ceph-client.admin.422407.log.gz 2023-10-08T13:45:19.433 INFO:teuthology.orchestra.run.smithi032.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.393728.log.gz 2023-10-08T13:45:19.438 INFO:teuthology.orchestra.run.smithi032.stderr: 93.5% -- replaced with /var/log/ceph/ceph-client.admin.167254.log.gz 2023-10-08T13:45:19.439 INFO:teuthology.orchestra.run.smithi032.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.154901.log.gz 2023-10-08T13:45:19.440 INFO:teuthology.orchestra.run.smithi032.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.120341.log.gz 2023-10-08T13:45:19.441 INFO:teuthology.orchestra.run.smithi032.stderr: 79.3% -- replaced with /var/log/ceph/ceph-client.admin.201134.log.gz 2023-10-08T13:45:19.448 INFO:teuthology.orchestra.run.smithi032.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.400018.log.gz 2023-10-08T13:45:19.448 INFO:teuthology.orchestra.run.smithi032.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.184316.log.gz 2023-10-08T13:45:19.452 INFO:teuthology.orchestra.run.smithi032.stderr: 80.9% 90.5% -- replaced with /var/log/ceph/ceph-client.admin.424044.log.gz 2023-10-08T13:45:19.452 INFO:teuthology.orchestra.run.smithi032.stderr: -- replaced with /var/log/ceph/ceph-client.admin.441049.log.gz 2023-10-08T13:45:19.453 INFO:teuthology.orchestra.run.smithi032.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.157036.log.gz 2023-10-08T13:45:19.453 INFO:teuthology.orchestra.run.smithi032.stderr: 93.3% -- replaced with /var/log/ceph/ceph-client.admin.201546.log.gz 2023-10-08T13:45:19.458 INFO:teuthology.orchestra.run.smithi032.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.41665.log.gz 2023-10-08T13:45:19.459 INFO:teuthology.orchestra.run.smithi032.stderr: 79.2% -- replaced with /var/log/ceph/ceph-client.admin.348330.log.gz 2023-10-08T13:45:19.460 INFO:teuthology.orchestra.run.smithi032.stderr: 78.3% -- replaced with /var/log/ceph/ceph-client.admin.413714.log.gz 2023-10-08T13:45:19.461 INFO:teuthology.orchestra.run.smithi032.stderr: 77.7% -- replaced with /var/log/ceph/ceph-client.admin.364054.log.gz 2023-10-08T13:45:19.464 INFO:teuthology.orchestra.run.smithi032.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.95072.log.gz 2023-10-08T13:45:19.549 INFO:teuthology.orchestra.run.smithi032.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.277478.log.gz 2023-10-08T13:45:19.554 INFO:teuthology.orchestra.run.smithi032.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.121554.log.gz 2023-10-08T13:45:19.557 INFO:teuthology.orchestra.run.smithi032.stderr: 78.7% -- replaced with /var/log/ceph/ceph-client.admin.119491.log.gz 2023-10-08T13:45:19.557 INFO:teuthology.orchestra.run.smithi032.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.40825.log.gz 2023-10-08T13:45:19.558 INFO:teuthology.orchestra.run.smithi032.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42409.log.gz 2023-10-08T13:45:19.558 INFO:teuthology.orchestra.run.smithi032.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.42463.log.gz 2023-10-08T13:45:19.558 INFO:teuthology.orchestra.run.smithi032.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43262.log.gz 2023-10-08T13:45:19.559 INFO:teuthology.orchestra.run.smithi032.stderr: 93.1% -- replaced with /var/log/ceph/ceph-client.admin.97504.log.gz 2023-10-08T13:45:19.564 INFO:teuthology.orchestra.run.smithi032.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44693.log.gz 2023-10-08T13:45:19.567 INFO:teuthology.orchestra.run.smithi032.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.229198.log.gz 2023-10-08T13:45:19.576 INFO:teuthology.orchestra.run.smithi032.stderr: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.168549.log.gz 2023-10-08T13:45:19.580 INFO:teuthology.orchestra.run.smithi032.stderr: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.151941.log.gz 2023-10-08T13:45:19.582 INFO:teuthology.orchestra.run.smithi032.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.195731.log.gz 2023-10-08T13:45:19.585 INFO:teuthology.orchestra.run.smithi032.stderr: 78.2% -- replaced with /var/log/ceph/ceph-client.admin.188131.log.gz 2023-10-08T13:45:19.585 INFO:teuthology.orchestra.run.smithi032.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.177700.log.gz 2023-10-08T13:45:19.589 INFO:teuthology.orchestra.run.smithi032.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.191005.log.gz 2023-10-08T13:45:19.590 INFO:teuthology.orchestra.run.smithi032.stderr: 79.2% -- replaced with /var/log/ceph/ceph-client.admin.199526.log.gz 2023-10-08T13:45:19.593 INFO:teuthology.orchestra.run.smithi032.stderr: 93.5% -- replaced with /var/log/ceph/ceph-client.admin.170704.log.gz 2023-10-08T13:45:19.613 INFO:teuthology.orchestra.run.smithi032.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.366500.log.gz 2023-10-08T13:45:19.614 INFO:teuthology.orchestra.run.smithi032.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.414931.log.gz 2023-10-08T13:45:19.644 INFO:teuthology.orchestra.run.smithi032.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.342577.log.gz 2023-10-08T13:45:19.645 INFO:teuthology.orchestra.run.smithi032.stderr: 78.3% -- replaced with /var/log/ceph/ceph-client.admin.407920.log.gz 2023-10-08T13:45:19.647 INFO:teuthology.orchestra.run.smithi032.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.242802.log.gz 2023-10-08T13:45:19.649 INFO:teuthology.orchestra.run.smithi032.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.218923.log.gz 2023-10-08T13:45:19.651 INFO:teuthology.orchestra.run.smithi032.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.336142.log.gz 2023-10-08T13:45:19.654 INFO:teuthology.orchestra.run.smithi032.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.272633.log.gz 2023-10-08T13:45:19.658 INFO:teuthology.orchestra.run.smithi032.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.311061.log.gz 2023-10-08T13:45:19.660 INFO:teuthology.orchestra.run.smithi032.stderr: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.362811.log.gz 2023-10-08T13:45:19.664 INFO:teuthology.orchestra.run.smithi032.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.449908.log.gz 2023-10-08T13:45:19.714 INFO:teuthology.orchestra.run.smithi032.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.97098.log.gz 2023-10-08T13:45:19.714 INFO:teuthology.orchestra.run.smithi032.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.102840.log.gz 2023-10-08T13:45:19.725 INFO:teuthology.orchestra.run.smithi032.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.413312.log.gz 2023-10-08T13:45:19.728 INFO:teuthology.orchestra.run.smithi032.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.313958.log.gz 2023-10-08T13:45:19.730 INFO:teuthology.orchestra.run.smithi032.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.401681.log.gz 2023-10-08T13:45:19.733 INFO:teuthology.orchestra.run.smithi032.stderr: 95.1% -- replaced with /var/log/ceph/ceph-client.admin.339955.log.gz 2023-10-08T13:45:19.738 INFO:teuthology.orchestra.run.smithi032.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.106476.log.gz 2023-10-08T13:45:19.743 INFO:teuthology.orchestra.run.smithi032.stderr: 92.7% -- replaced with /var/log/ceph/ceph-client.admin.336976.log.gz 2023-10-08T13:45:19.743 INFO:teuthology.orchestra.run.smithi032.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.422819.log.gz 2023-10-08T13:45:19.744 INFO:teuthology.orchestra.run.smithi032.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.444679.log.gz 2023-10-08T13:45:19.744 INFO:teuthology.orchestra.run.smithi032.stderr: 78.0% -- replaced with /var/log/ceph/ceph-client.admin.218443.log.gz 2023-10-08T13:45:19.745 INFO:teuthology.orchestra.run.smithi032.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.194416.log.gz 2023-10-08T13:45:19.746 INFO:teuthology.orchestra.run.smithi032.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.130949.log.gz 2023-10-08T13:45:19.746 INFO:teuthology.orchestra.run.smithi032.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.232815.log.gz 2023-10-08T13:45:19.746 INFO:teuthology.orchestra.run.smithi032.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.221370.log.gz 2023-10-08T13:45:19.750 INFO:teuthology.orchestra.run.smithi032.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.280724.log.gz 2023-10-08T13:45:19.750 INFO:teuthology.orchestra.run.smithi032.stderr: 78.3% -- replaced with /var/log/ceph/ceph-client.admin.297562.log.gz 2023-10-08T13:45:19.752 INFO:teuthology.orchestra.run.smithi032.stderr: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.341735.log.gz 2023-10-08T13:45:19.752 INFO:teuthology.orchestra.run.smithi032.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.178508.log.gz 2023-10-08T13:45:19.753 INFO:teuthology.orchestra.run.smithi032.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.413321.log.gz 2023-10-08T13:45:19.756 INFO:teuthology.orchestra.run.smithi032.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.41045.log.gz 2023-10-08T13:45:19.766 INFO:teuthology.orchestra.run.smithi032.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.291838.log.gz 2023-10-08T13:45:19.769 INFO:teuthology.orchestra.run.smithi032.stderr: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.93303.log.gz 2023-10-08T13:45:19.795 INFO:teuthology.orchestra.run.smithi032.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.298375.log.gz 2023-10-08T13:45:19.801 INFO:teuthology.orchestra.run.smithi032.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.297571.log.gz 2023-10-08T13:45:19.814 INFO:teuthology.orchestra.run.smithi032.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.40828.log.gz 2023-10-08T13:45:19.815 INFO:teuthology.orchestra.run.smithi032.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43891.log.gz 2023-10-08T13:45:19.820 INFO:teuthology.orchestra.run.smithi032.stderr: 80.0% -- replaced with /var/log/ceph/ceph-client.admin.91701.log.gz 2023-10-08T13:45:19.827 INFO:teuthology.orchestra.run.smithi032.stderr: 78.4% -- replaced with /var/log/ceph/ceph-client.admin.106060.log.gz 2023-10-08T13:45:19.830 INFO:teuthology.orchestra.run.smithi032.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.375576.log.gz 2023-10-08T13:45:19.834 INFO:teuthology.orchestra.run.smithi032.stderr: 93.0% -- replaced with /var/log/ceph/ceph-client.admin.123285.log.gz 2023-10-08T13:45:19.840 INFO:teuthology.orchestra.run.smithi032.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.95081.log.gz 2023-10-08T13:45:19.842 INFO:teuthology.orchestra.run.smithi032.stderr: 93.8% -- replaced with /var/log/ceph/ceph-client.admin.129571.log.gz 2023-10-08T13:45:19.844 INFO:teuthology.orchestra.run.smithi032.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.179316.log.gz 2023-10-08T13:45:19.857 INFO:teuthology.orchestra.run.smithi032.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.194849.log.gz 2023-10-08T13:45:19.865 INFO:teuthology.orchestra.run.smithi032.stderr: 79.2% -- replaced with /var/log/ceph/ceph-client.admin.147837.log.gz 2023-10-08T13:45:19.866 INFO:teuthology.orchestra.run.smithi032.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.147846.log.gz 2023-10-08T13:45:19.875 INFO:teuthology.orchestra.run.smithi032.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.245443.log.gz 2023-10-08T13:45:19.877 INFO:teuthology.orchestra.run.smithi032.stderr: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.234843.log.gz 2023-10-08T13:45:19.878 INFO:teuthology.orchestra.run.smithi032.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.201143.log.gz 2023-10-08T13:45:19.878 INFO:teuthology.orchestra.run.smithi032.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.295141.log.gz 2023-10-08T13:45:19.881 INFO:teuthology.orchestra.run.smithi032.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.243213.log.gz 2023-10-08T13:45:19.882 INFO:teuthology.orchestra.run.smithi032.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.227875.log.gz 2023-10-08T13:45:19.902 INFO:teuthology.orchestra.run.smithi032.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.204411.log.gz 2023-10-08T13:45:19.903 INFO:teuthology.orchestra.run.smithi032.stderr: 78.4% -- replaced with /var/log/ceph/ceph-client.admin.284479.log.gz 2023-10-08T13:45:19.970 INFO:teuthology.orchestra.run.smithi032.stderr: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.171989.log.gz 2023-10-08T13:45:19.971 INFO:teuthology.orchestra.run.smithi032.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.41773.log.gz 2023-10-08T13:45:19.972 INFO:teuthology.orchestra.run.smithi032.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.160363.log.gz 2023-10-08T13:45:19.976 INFO:teuthology.orchestra.run.smithi032.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.168540.log.gz 2023-10-08T13:45:19.978 INFO:teuthology.orchestra.run.smithi032.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.85636.log.gz 2023-10-08T13:45:19.978 INFO:teuthology.orchestra.run.smithi032.stderr: 77.9% -- replaced with /var/log/ceph/ceph-client.admin.94549.log.gz 2023-10-08T13:45:19.979 INFO:teuthology.orchestra.run.smithi032.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.102036.log.gz 2023-10-08T13:45:19.981 INFO:teuthology.orchestra.run.smithi032.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44996.log.gz 2023-10-08T13:45:19.988 INFO:teuthology.orchestra.run.smithi032.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.401279.log.gz 2023-10-08T13:45:19.990 INFO:teuthology.orchestra.run.smithi032.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.44969.log.gz 2023-10-08T13:45:19.993 INFO:teuthology.orchestra.run.smithi032.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.221764.log.gz 2023-10-08T13:45:19.995 INFO:teuthology.orchestra.run.smithi032.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.222991.log.gz 2023-10-08T13:45:19.998 INFO:teuthology.orchestra.run.smithi032.stderr: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.193980.log.gz 2023-10-08T13:45:20.003 INFO:teuthology.orchestra.run.smithi032.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.441854.log.gz 2023-10-08T13:45:20.010 INFO:teuthology.orchestra.run.smithi032.stderr: 77.8% -- replaced with /var/log/ceph/ceph-client.admin.389477.log.gz 2023-10-08T13:45:20.012 INFO:teuthology.orchestra.run.smithi032.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.233637.log.gz 2023-10-08T13:45:20.012 INFO:teuthology.orchestra.run.smithi032.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.426521.log.gz 2023-10-08T13:45:20.017 INFO:teuthology.orchestra.run.smithi032.stderr: 78.8% -- replaced with /var/log/ceph/ceph-client.admin.424035.log.gz 2023-10-08T13:45:20.025 INFO:teuthology.orchestra.run.smithi032.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.177691.log.gz 2023-10-08T13:45:20.031 INFO:teuthology.orchestra.run.smithi032.stderr: 93.4% -- replaced with /var/log/ceph/ceph-client.admin.407494.log.gz 2023-10-08T13:45:20.035 INFO:teuthology.orchestra.run.smithi032.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.245452.log.gz 2023-10-08T13:45:20.042 INFO:teuthology.orchestra.run.smithi032.stderr: 93.4% -- replaced with /var/log/ceph/ceph-client.admin.154910.log.gz 2023-10-08T13:45:20.050 INFO:teuthology.orchestra.run.smithi032.stderr: 78.9% -- replaced with /var/log/ceph/ceph-client.admin.356706.log.gz 2023-10-08T13:45:20.056 INFO:teuthology.orchestra.run.smithi032.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.290634.log.gz 2023-10-08T13:45:20.091 INFO:teuthology.orchestra.run.smithi032.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.118258.log.gz 2023-10-08T13:45:20.111 INFO:teuthology.orchestra.run.smithi032.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.41827.log.gz 2023-10-08T13:45:20.111 INFO:teuthology.orchestra.run.smithi032.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.43643.log.gz 2023-10-08T13:45:20.120 INFO:teuthology.orchestra.run.smithi032.stderr: 92.5% -- replaced with /var/log/ceph/ceph-client.admin.92900.log.gz 2023-10-08T13:45:20.150 INFO:teuthology.orchestra.run.smithi032.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.121563.log.gz 2023-10-08T13:45:20.161 INFO:teuthology.orchestra.run.smithi032.stderr: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.127431.log.gz 2023-10-08T13:45:20.161 INFO:teuthology.orchestra.run.smithi032.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.417486.log.gz 2023-10-08T13:45:20.163 INFO:teuthology.orchestra.run.smithi032.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.40604.log.gz 2023-10-08T13:45:20.165 INFO:teuthology.orchestra.run.smithi032.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.41234.log.gz 2023-10-08T13:45:20.166 INFO:teuthology.orchestra.run.smithi032.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.41261.log.gz 2023-10-08T13:45:20.166 INFO:teuthology.orchestra.run.smithi032.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.204007.log.gz 2023-10-08T13:45:20.168 INFO:teuthology.orchestra.run.smithi032.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.212041.log.gz 2023-10-08T13:45:20.171 INFO:teuthology.orchestra.run.smithi032.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.364063.log.gz 2023-10-08T13:45:20.172 INFO:teuthology.orchestra.run.smithi032.stderr: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.365276.log.gz 2023-10-08T13:45:20.178 INFO:teuthology.orchestra.run.smithi032.stderr: 84.8% -- replaced with /var/log/ceph/ceph-client.admin.334847.log.gz 2023-10-08T13:45:20.180 INFO:teuthology.orchestra.run.smithi032.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44475.log.gz 2023-10-08T13:45:20.192 INFO:teuthology.orchestra.run.smithi032.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.449899.log.gz 2023-10-08T13:45:20.264 INFO:teuthology.orchestra.run.smithi032.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43343.log.gz 2023-10-08T13:45:20.264 INFO:teuthology.orchestra.run.smithi032.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43507.log.gz 2023-10-08T13:45:20.284 INFO:teuthology.orchestra.run.smithi032.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.103636.log.gz 2023-10-08T13:45:20.290 INFO:teuthology.orchestra.run.smithi032.stderr: 93.0% -- replaced with /var/log/ceph/ceph-client.admin.119500.log.gz 2023-10-08T13:45:20.291 INFO:teuthology.orchestra.run.smithi032.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.404397.log.gz 2023-10-08T13:45:20.291 INFO:teuthology.orchestra.run.smithi032.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.407082.log.gz 2023-10-08T13:45:20.298 INFO:teuthology.orchestra.run.smithi032.stderr: 93.2% -- replaced with /var/log/ceph/ceph-client.admin.302918.log.gz 2023-10-08T13:45:20.299 INFO:teuthology.orchestra.run.smithi032.stderr: 77.8% -- replaced with /var/log/ceph/ceph-client.admin.387756.log.gz 2023-10-08T13:45:20.303 INFO:teuthology.orchestra.run.smithi032.stderr: 84.6% -- replaced with /var/log/ceph/ceph-client.admin.447083.log.gz 2023-10-08T13:45:20.304 INFO:teuthology.orchestra.run.smithi032.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.441058.log.gz 2023-10-08T13:45:20.304 INFO:teuthology.orchestra.run.smithi032.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.447092.log.gz 2023-10-08T13:45:20.309 INFO:teuthology.orchestra.run.smithi032.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.232824.log.gz 2023-10-08T13:45:20.328 INFO:teuthology.orchestra.run.smithi032.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.298366.log.gz 2023-10-08T13:45:20.335 INFO:teuthology.orchestra.run.smithi032.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.412448.log.gz 2023-10-08T13:45:20.350 INFO:teuthology.orchestra.run.smithi032.stderr: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.335726.log.gz 2023-10-08T13:45:20.352 INFO:teuthology.orchestra.run.smithi032.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.231210.log.gz 2023-10-08T13:45:20.357 INFO:teuthology.orchestra.run.smithi032.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.350791.log.gz 2023-10-08T13:45:20.359 INFO:teuthology.orchestra.run.smithi032.stderr: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.236104.log.gz 2023-10-08T13:45:20.360 INFO:teuthology.orchestra.run.smithi032.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.235710.log.gz 2023-10-08T13:45:20.368 INFO:teuthology.orchestra.run.smithi032.stderr: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.199124.log.gz 2023-10-08T13:45:20.372 INFO:teuthology.orchestra.run.smithi032.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.374781.log.gz 2023-10-08T13:45:20.380 INFO:teuthology.orchestra.run.smithi032.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.273845.log.gz 2023-10-08T13:45:20.438 INFO:teuthology.orchestra.run.smithi032.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.376421.log.gz 2023-10-08T13:45:20.475 INFO:teuthology.orchestra.run.smithi032.stderr: 77.7% -- replaced with /var/log/ceph/ceph-client.admin.393320.log.gz 2023-10-08T13:45:20.481 INFO:teuthology.orchestra.run.smithi032.stderr: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.398758.log.gz 2023-10-08T13:45:20.482 INFO:teuthology.orchestra.run.smithi032.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.178499.log.gz 2023-10-08T13:45:20.483 INFO:teuthology.orchestra.run.smithi032.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.163392.log.gz 2023-10-08T13:45:20.490 INFO:teuthology.orchestra.run.smithi032.stderr: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.164262.log.gz 2023-10-08T13:45:20.491 INFO:teuthology.orchestra.run.smithi032.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.336967.log.gz 2023-10-08T13:45:20.495 INFO:teuthology.orchestra.run.smithi032.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.179719.log.gz 2023-10-08T13:45:20.497 INFO:teuthology.orchestra.run.smithi032.stderr: 93.9% -- replaced with /var/log/ceph/ceph-client.admin.182252.log.gz 2023-10-08T13:45:20.498 INFO:teuthology.orchestra.run.smithi032.stderr: 94.0% -- replaced with /var/log/ceph/ceph-client.admin.308993.log.gz 2023-10-08T13:45:20.499 INFO:teuthology.orchestra.run.smithi032.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.355888.log.gz 2023-10-08T13:45:20.506 INFO:teuthology.orchestra.run.smithi032.stderr: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.373943.log.gz 2023-10-08T13:45:20.506 INFO:teuthology.orchestra.run.smithi032.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.304758.log.gz 2023-10-08T13:45:20.508 INFO:teuthology.orchestra.run.smithi032.stderr: 77.6% -- replaced with /var/log/ceph/ceph-client.admin.229993.log.gz 2023-10-08T13:45:20.551 INFO:teuthology.orchestra.run.smithi032.stderr: 94.0% -- replaced with /var/log/ceph/ceph-client.admin.156175.log.gz 2023-10-08T13:45:20.553 INFO:teuthology.orchestra.run.smithi032.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.40201.log.gz 2023-10-08T13:45:20.554 INFO:teuthology.orchestra.run.smithi032.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.40423.log.gz 2023-10-08T13:45:20.555 INFO:teuthology.orchestra.run.smithi032.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.44531.log.gz 2023-10-08T13:45:20.557 INFO:teuthology.orchestra.run.smithi032.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.296754.log.gz 2023-10-08T13:45:20.564 INFO:teuthology.orchestra.run.smithi032.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.418299.log.gz 2023-10-08T13:45:20.576 INFO:teuthology.orchestra.run.smithi032.stderr: 93.1% -- replaced with /var/log/ceph/ceph-client.admin.195281.log.gz 2023-10-08T13:45:20.593 INFO:teuthology.orchestra.run.smithi032.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.279101.log.gz 2023-10-08T13:45:20.593 INFO:teuthology.orchestra.run.smithi032.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.191407.log.gz 2023-10-08T13:45:20.609 INFO:teuthology.orchestra.run.smithi032.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.178095.log.gz 2023-10-08T13:45:20.614 INFO:teuthology.orchestra.run.smithi032.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.196235.log.gz 2023-10-08T13:45:20.629 INFO:teuthology.orchestra.run.smithi032.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.417897.log.gz 2023-10-08T13:45:20.630 INFO:teuthology.orchestra.run.smithi032.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.423636.log.gz 2023-10-08T13:45:20.632 INFO:teuthology.orchestra.run.smithi032.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.316167.log.gz 2023-10-08T13:45:20.637 INFO:teuthology.orchestra.run.smithi032.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.273836.log.gz 2023-10-08T13:45:20.642 INFO:teuthology.orchestra.run.smithi032.stderr: 93.5% -- replaced with /var/log/ceph/ceph-client.admin.169412.log.gz 2023-10-08T13:45:20.659 INFO:teuthology.orchestra.run.smithi032.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.185128.log.gz 2023-10-08T13:45:20.681 INFO:teuthology.orchestra.run.smithi032.stderr: 94.2% -- replaced with /var/log/ceph/ceph-client.admin.350800.log.gz 2023-10-08T13:45:20.756 INFO:teuthology.orchestra.run.smithi032.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44666.log.gz 2023-10-08T13:45:20.764 INFO:teuthology.orchestra.run.smithi032.stderr: 78.1% -- replaced with /var/log/ceph/ceph-client.admin.316158.log.gz 2023-10-08T13:45:20.780 INFO:teuthology.orchestra.run.smithi032.stderr: 79.2% -- replaced with /var/log/ceph/ceph-client.admin.427462.log.gz 2023-10-08T13:45:20.781 INFO:teuthology.orchestra.run.smithi032.stderr: 78.6% -- replaced with /var/log/ceph/ceph-client.admin.445876.log.gz 2023-10-08T13:45:20.806 INFO:teuthology.orchestra.run.smithi032.stderr: 94.1% -- replaced with /var/log/ceph/ceph-client.admin.186752.log.gz 2023-10-08T13:45:20.812 INFO:teuthology.orchestra.run.smithi032.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.342170.log.gz 2023-10-08T13:45:20.812 INFO:teuthology.orchestra.run.smithi032.stderr: 95.2% -- replaced with /var/log/ceph/ceph-client.admin.351418.log.gz 2023-10-08T13:45:20.822 INFO:teuthology.orchestra.run.smithi032.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.224606.log.gz 2023-10-08T13:45:20.823 INFO:teuthology.orchestra.run.smithi032.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.225013.log.gz 2023-10-08T13:45:20.841 INFO:teuthology.orchestra.run.smithi032.stderr: 78.7% -- replaced with /var/log/ceph/ceph-client.admin.228787.log.gz 2023-10-08T13:45:21.033 INFO:teuthology.orchestra.run.smithi032.stderr: 93.5% -- replaced with /var/log/ceph/ceph-client.admin.171135.log.gz 2023-10-08T13:45:21.033 INFO:teuthology.orchestra.run.smithi032.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.162548.log.gz 2023-10-08T13:45:21.034 INFO:teuthology.orchestra.run.smithi032.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.445072.log.gz 2023-10-08T13:45:21.034 INFO:teuthology.orchestra.run.smithi032.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43480.log.gz 2023-10-08T13:45:22.553 INFO:teuthology.orchestra.run.smithi040.stderr: 95.4% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2023-10-08T13:45:25.536 INFO:teuthology.orchestra.run.smithi040.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2023-10-08T13:45:25.822 INFO:teuthology.orchestra.run.smithi032.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.180520.log.gz 2023-10-08T13:45:25.823 INFO:teuthology.orchestra.run.smithi032.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.186743.log.gz 2023-10-08T13:45:25.823 INFO:teuthology.orchestra.run.smithi032.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.445885.log.gz 2023-10-08T13:45:25.823 INFO:teuthology.orchestra.run.smithi032.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.365692.log.gz 2023-10-08T13:45:25.824 INFO:teuthology.orchestra.run.smithi032.stderr: 78.3% -- replaced with /var/log/ceph/ceph-client.admin.218041.log.gz 2023-10-08T13:45:25.824 INFO:teuthology.orchestra.run.smithi032.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.345459.log.gz 2023-10-08T13:45:25.824 INFO:teuthology.orchestra.run.smithi032.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.44807.log.gz 2023-10-08T13:45:25.824 INFO:teuthology.orchestra.run.smithi032.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.373934.log.gz 2023-10-08T13:45:25.824 INFO:teuthology.orchestra.run.smithi032.stderr: 83.4% -- replaced with /var/log/ceph/ceph-client.admin.446278.log.gz 2023-10-08T13:45:25.824 INFO:teuthology.orchestra.run.smithi032.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.389009.log.gz 2023-10-08T13:45:25.825 INFO:teuthology.orchestra.run.smithi032.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.426923.log.gz 2023-10-08T13:45:25.825 INFO:teuthology.orchestra.run.smithi032.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.343404.log.gz 2023-10-08T13:45:25.826 INFO:teuthology.orchestra.run.smithi032.stderr: 90.5% 90.4% -- replaced with /var/log/ceph/ceph-client.admin.411642.log.gz -- replaced with /var/log/ceph/ceph-client.admin.373127.log.gz 2023-10-08T13:45:25.826 INFO:teuthology.orchestra.run.smithi032.stderr: 2023-10-08T13:45:25.826 INFO:teuthology.orchestra.run.smithi032.stderr: 78.8% 90.5% -- replaced with /var/log/ceph/ceph-client.admin.246664.log.gz -- replaced with /var/log/ceph/ceph-client.admin.102831.log.gz 2023-10-08T13:45:25.826 INFO:teuthology.orchestra.run.smithi032.stderr: 2023-10-08T13:45:25.827 INFO:teuthology.orchestra.run.smithi032.stderr: 93.9% -- replaced with /var/log/ceph/ceph-client.admin.351203.log.gz 2023-10-08T13:45:25.827 INFO:teuthology.orchestra.run.smithi032.stderr: 95.6% -- replaced with /var/log/ceph/ceph-client.admin.207063.log.gz 2023-10-08T13:45:25.827 INFO:teuthology.orchestra.run.smithi032.stderr: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.99199.log.gz 2023-10-08T13:45:25.828 INFO:teuthology.orchestra.run.smithi032.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.42214.log.gz 2023-10-08T13:45:25.828 INFO:teuthology.orchestra.run.smithi032.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.217639.log.gz 2023-10-08T13:45:25.828 INFO:teuthology.orchestra.run.smithi032.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.220959.log.gz 2023-10-08T13:45:25.828 INFO:teuthology.orchestra.run.smithi032.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.442266.log.gz 2023-10-08T13:45:25.829 INFO:teuthology.orchestra.run.smithi032.stderr: 79.1% -- replaced with /var/log/ceph/ceph-client.admin.231603.log.gz 2023-10-08T13:45:25.829 INFO:teuthology.orchestra.run.smithi032.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.173677.log.gz 2023-10-08T13:45:25.829 INFO:teuthology.orchestra.run.smithi032.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.313492.log.gz 2023-10-08T13:45:25.829 INFO:teuthology.orchestra.run.smithi032.stderr: 79.8% -- replaced with /var/log/ceph/ceph-client.admin.196680.log.gz 2023-10-08T13:45:25.829 INFO:teuthology.orchestra.run.smithi032.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.360783.log.gz 2023-10-08T13:45:25.829 INFO:teuthology.orchestra.run.smithi032.stderr: 78.3% -- replaced with /var/log/ceph/ceph-client.admin.415774.log.gz 2023-10-08T13:45:25.829 INFO:teuthology.orchestra.run.smithi032.stderr: 79.6% -- replaced with /var/log/ceph/ceph-client.admin.169403.log.gz 2023-10-08T13:45:25.830 INFO:teuthology.orchestra.run.smithi032.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.316561.log.gz 2023-10-08T13:45:25.830 INFO:teuthology.orchestra.run.smithi032.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.310659.log.gz 2023-10-08T13:45:25.830 INFO:teuthology.orchestra.run.smithi032.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.187326.log.gz 2023-10-08T13:45:25.830 INFO:teuthology.orchestra.run.smithi032.stderr: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.163401.log.gz 2023-10-08T13:45:26.365 INFO:teuthology.orchestra.run.smithi032.stderr: 88.8% 80.5% -- replaced with /var/log/ceph/ceph-client.admin.175680.log.gz -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-10-08T13:45:26.366 INFO:teuthology.orchestra.run.smithi032.stderr: 2023-10-08T13:45:26.366 INFO:teuthology.orchestra.run.smithi032.stderr: 92.6% 90.5% -- replaced with /var/log/ceph/ceph-client.admin.353407.log.gz -- replaced with /var/log/ceph/ceph-client.admin.243662.log.gz 2023-10-08T13:45:26.366 INFO:teuthology.orchestra.run.smithi032.stderr: 2023-10-08T13:45:26.366 INFO:teuthology.orchestra.run.smithi032.stderr: 78.0% -- replaced with /var/log/ceph/ceph-client.admin.338635.log.gz 2023-10-08T13:45:26.366 INFO:teuthology.orchestra.run.smithi032.stderr: 93.6% 90.4% -- replaced with /var/log/ceph/ceph-client.admin.168981.log.gz -- replaced with /var/log/ceph/ceph-client.admin.288624.log.gz 2023-10-08T13:45:26.366 INFO:teuthology.orchestra.run.smithi032.stderr: 2023-10-08T13:45:26.367 INFO:teuthology.orchestra.run.smithi032.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.40504.log.gz 2023-10-08T13:45:26.367 INFO:teuthology.orchestra.run.smithi032.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.386960.log.gz 2023-10-08T13:45:26.367 INFO:teuthology.orchestra.run.smithi032.stderr: 77.9% -- replaced with /var/log/ceph/ceph-client.admin.180951.log.gz 2023-10-08T13:45:26.367 INFO:teuthology.orchestra.run.smithi032.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.306888.log.gz 2023-10-08T13:45:26.367 INFO:teuthology.orchestra.run.smithi032.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.181813.log.gz 2023-10-08T13:45:26.367 INFO:teuthology.orchestra.run.smithi032.stderr: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.361582.log.gz 2023-10-08T13:45:26.367 INFO:teuthology.orchestra.run.smithi032.stderr: 78.5% -- replaced with /var/log/ceph/ceph-client.admin.394130.log.gz 2023-10-08T13:45:26.367 INFO:teuthology.orchestra.run.smithi032.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.349587.log.gz 2023-10-08T13:45:26.368 INFO:teuthology.orchestra.run.smithi032.stderr: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.360774.log.gz 2023-10-08T13:45:26.368 INFO:teuthology.orchestra.run.smithi032.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.40093.log.gz 2023-10-08T13:45:26.368 INFO:teuthology.orchestra.run.smithi032.stderr: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.431613.log.gz 2023-10-08T13:45:26.368 INFO:teuthology.orchestra.run.smithi032.stderr: 80.8% 87.6% -- replaced with /var/log/ceph/ceph-client.admin.95883.log.gz 2023-10-08T13:45:26.368 INFO:teuthology.orchestra.run.smithi032.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.44861.log.gz -- replaced with /var/log/ceph/ceph-client.admin.174070.log.gz 2023-10-08T13:45:26.368 INFO:teuthology.orchestra.run.smithi032.stderr: 2023-10-08T13:45:26.368 INFO:teuthology.orchestra.run.smithi032.stderr: 94.0% -- replaced with /var/log/ceph/ceph-client.admin.235274.log.gz 2023-10-08T13:45:26.368 INFO:teuthology.orchestra.run.smithi032.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.345468.log.gz 2023-10-08T13:45:26.369 INFO:teuthology.orchestra.run.smithi032.stderr: 78.3% -- replaced with /var/log/ceph/ceph-client.admin.289017.log.gz 2023-10-08T13:45:26.369 INFO:teuthology.orchestra.run.smithi032.stderr: 77.9% 81.2% -- replaced with /var/log/ceph/ceph-client.admin.226634.log.gz -- replaced with /var/log/ceph/ceph-client.admin.190594.log.gz 2023-10-08T13:45:26.369 INFO:teuthology.orchestra.run.smithi032.stderr: 2023-10-08T13:45:26.369 INFO:teuthology.orchestra.run.smithi032.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.226234.log.gz 2023-10-08T13:45:26.369 INFO:teuthology.orchestra.run.smithi032.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.349981.log.gz 2023-10-08T13:45:26.369 INFO:teuthology.orchestra.run.smithi032.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.158394.log.gz 2023-10-08T13:45:26.369 INFO:teuthology.orchestra.run.smithi032.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.40609.log.gz 2023-10-08T13:45:26.369 INFO:teuthology.orchestra.run.smithi032.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.400813.log.gz 2023-10-08T13:45:26.370 INFO:teuthology.orchestra.run.smithi032.stderr: 80.8% 90.5% -- replaced with /var/log/ceph/ceph-client.admin.212907.log.gz -- replaced with /var/log/ceph/ceph-client.admin.228382.log.gz 2023-10-08T13:45:26.370 INFO:teuthology.orchestra.run.smithi032.stderr: 2023-10-08T13:45:26.370 INFO:teuthology.orchestra.run.smithi032.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.223385.log.gz 2023-10-08T13:45:26.370 INFO:teuthology.orchestra.run.smithi032.stderr: 77.9% -- replaced with /var/log/ceph/ceph-client.admin.171126.log.gz 2023-10-08T13:45:26.370 INFO:teuthology.orchestra.run.smithi032.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.161209.log.gz 2023-10-08T13:45:26.370 INFO:teuthology.orchestra.run.smithi032.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.361181.log.gz 2023-10-08T13:45:26.370 INFO:teuthology.orchestra.run.smithi032.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.274656.log.gz 2023-10-08T13:45:26.371 INFO:teuthology.orchestra.run.smithi032.stderr: 94.7% 80.7% -- replaced with /var/log/ceph/ceph-client.admin.129875.log.gz 2023-10-08T13:45:26.371 INFO:teuthology.orchestra.run.smithi032.stderr: -- replaced with /var/log/ceph/ceph-client.admin.213711.log.gz 2023-10-08T13:45:26.371 INFO:teuthology.orchestra.run.smithi032.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.198294.log.gz 2023-10-08T13:45:26.374 INFO:teuthology.orchestra.run.smithi032.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.159961.log.gz 2023-10-08T13:45:26.374 INFO:teuthology.orchestra.run.smithi032.stderr: 78.8% -- replaced with /var/log/ceph/ceph-client.admin.305681.log.gz 2023-10-08T13:45:26.374 INFO:teuthology.orchestra.run.smithi032.stderr: 84.0% -- replaced with /var/log/ceph/ceph-client.admin.80783.log.gz 2023-10-08T13:45:26.374 INFO:teuthology.orchestra.run.smithi032.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.151510.log.gz 2023-10-08T13:45:26.375 INFO:teuthology.orchestra.run.smithi032.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.397927.log.gz 2023-10-08T13:45:26.375 INFO:teuthology.orchestra.run.smithi032.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.429582.log.gz 2023-10-08T13:45:26.375 INFO:teuthology.orchestra.run.smithi032.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.217246.log.gz 2023-10-08T13:45:26.375 INFO:teuthology.orchestra.run.smithi032.stderr: 93.3% -- replaced with /var/log/ceph/ceph-client.admin.158403.log.gz 2023-10-08T13:45:26.375 INFO:teuthology.orchestra.run.smithi032.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.41019.log.gz 2023-10-08T13:45:26.375 INFO:teuthology.orchestra.run.smithi032.stderr: 77.5% -- replaced with /var/log/ceph/ceph-client.admin.94147.log.gz 2023-10-08T13:45:26.375 INFO:teuthology.orchestra.run.smithi032.stderr: 93.0% -- replaced with /var/log/ceph/ceph-client.admin.172865.log.gz 2023-10-08T13:45:26.375 INFO:teuthology.orchestra.run.smithi032.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.389018.log.gz 2023-10-08T13:45:26.376 INFO:teuthology.orchestra.run.smithi032.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.288223.log.gz 2023-10-08T13:45:26.376 INFO:teuthology.orchestra.run.smithi032.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.339067.log.gz 2023-10-08T13:45:26.376 INFO:teuthology.orchestra.run.smithi032.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.377463.log.gz 2023-10-08T13:45:26.376 INFO:teuthology.orchestra.run.smithi032.stderr: 77.4% -- replaced with /var/log/ceph/ceph-client.admin.428146.log.gz 2023-10-08T13:45:26.376 INFO:teuthology.orchestra.run.smithi032.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.122363.log.gz 2023-10-08T13:45:26.376 INFO:teuthology.orchestra.run.smithi032.stderr: 79.4% -- replaced with /var/log/ceph/ceph-client.admin.386143.log.gz 2023-10-08T13:45:26.376 INFO:teuthology.orchestra.run.smithi032.stderr: 94.0% -- replaced with /var/log/ceph/ceph-client.admin.318363.log.gz 2023-10-08T13:45:26.376 INFO:teuthology.orchestra.run.smithi032.stderr: 94.4% -- replaced with /var/log/ceph/ceph-client.admin.338644.log.gz 2023-10-08T13:45:26.377 INFO:teuthology.orchestra.run.smithi032.stderr: 95.9% -- replaced with /var/log/ceph/ceph-client.admin.188944.log.gz 2023-10-08T13:45:26.377 INFO:teuthology.orchestra.run.smithi032.stderr: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.129866.log.gz 2023-10-08T13:45:26.377 INFO:teuthology.orchestra.run.smithi032.stderr: 82.1% 81.0% -- replaced with /var/log/ceph/ceph-client.admin.320780.log.gz 2023-10-08T13:45:26.377 INFO:teuthology.orchestra.run.smithi032.stderr: -- replaced with /var/log/ceph/ceph-client.admin.185119.log.gz 2023-10-08T13:45:26.377 INFO:teuthology.orchestra.run.smithi032.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.42817.log.gz 2023-10-08T13:45:26.377 INFO:teuthology.orchestra.run.smithi032.stderr: 94.8% -- replaced with /var/log/ceph/ceph-client.admin.425283.log.gz 2023-10-08T13:45:26.377 INFO:teuthology.orchestra.run.smithi032.stderr: 93.7% -- replaced with /var/log/ceph/ceph-client.admin.351106.log.gz 2023-10-08T13:45:26.378 INFO:teuthology.orchestra.run.smithi032.stderr: 93.7% -- replaced with /var/log/ceph/ceph-client.admin.195740.log.gz 2023-10-08T13:45:26.378 INFO:teuthology.orchestra.run.smithi032.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.41255.log.gz 2023-10-08T13:45:26.378 INFO:teuthology.orchestra.run.smithi032.stderr: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.168972.log.gz 2023-10-08T13:45:26.378 INFO:teuthology.orchestra.run.smithi032.stderr: 92.5% -- replaced with /var/log/ceph/ceph-client.admin.355897.log.gz 2023-10-08T13:45:26.378 INFO:teuthology.orchestra.run.smithi032.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.43426.log.gz 2023-10-08T13:45:26.378 INFO:teuthology.orchestra.run.smithi032.stderr: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.162123.log.gz 2023-10-08T13:45:26.378 INFO:teuthology.orchestra.run.smithi032.stderr: 95.5% -- replaced with /var/log/ceph/ceph-client.admin.78893.log.gz 2023-10-08T13:45:26.378 INFO:teuthology.orchestra.run.smithi032.stderr: 94.6% -- replaced with /var/log/ceph/ceph-client.admin.319345.log.gz 2023-10-08T13:45:26.379 INFO:teuthology.orchestra.run.smithi032.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.41503.log.gz 2023-10-08T13:45:26.379 INFO:teuthology.orchestra.run.smithi032.stderr: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.245846.log.gz 2023-10-08T13:45:26.379 INFO:teuthology.orchestra.run.smithi032.stderr: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.315285.log.gz 2023-10-08T13:45:26.379 INFO:teuthology.orchestra.run.smithi032.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.44107.log.gz 2023-10-08T13:45:26.379 INFO:teuthology.orchestra.run.smithi032.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.403461.log.gz 2023-10-08T13:45:26.379 INFO:teuthology.orchestra.run.smithi032.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.214521.log.gz 2023-10-08T13:45:26.379 INFO:teuthology.orchestra.run.smithi032.stderr: 85.6% 77.4% -- replaced with /var/log/ceph/ceph-client.admin.366491.log.gz -- replaced with /var/log/ceph/ceph-client.admin.158920.log.gz 2023-10-08T13:45:26.379 INFO:teuthology.orchestra.run.smithi032.stderr: 2023-10-08T13:45:26.380 INFO:teuthology.orchestra.run.smithi032.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.91244.log.gz 2023-10-08T13:45:26.380 INFO:teuthology.orchestra.run.smithi032.stderr: 90.5% 90.4% -- replaced with /var/log/ceph/ceph-client.admin.354221.log.gz -- replaced with /var/log/ceph/ceph-client.admin.372324.log.gz 2023-10-08T13:45:26.380 INFO:teuthology.orchestra.run.smithi032.stderr: 2023-10-08T13:45:26.380 INFO:teuthology.orchestra.run.smithi032.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.197092.log.gz 2023-10-08T13:45:26.380 INFO:teuthology.orchestra.run.smithi032.stderr: 92.9% -- replaced with /var/log/ceph/ceph-client.admin.286982.log.gz 2023-10-08T13:45:26.380 INFO:teuthology.orchestra.run.smithi032.stderr: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.164694.log.gz 2023-10-08T13:45:26.380 INFO:teuthology.orchestra.run.smithi032.stderr: 94.3% -- replaced with /var/log/ceph/ceph-client.admin.357528.log.gz 2023-10-08T13:45:26.480 INFO:teuthology.orchestra.run.smithi032.stderr: 94.3% -- replaced with /var/log/ceph/ceph-client.admin.337390.log.gz 2023-10-08T13:45:30.289 INFO:teuthology.orchestra.run.smithi032.stderr: 93.0% 93.4% -- replaced with /var/log/ceph/ceph-client.admin.416588.log.gz -- replaced with /var/log/ceph/ceph-client.admin.294271.log.gz 2023-10-08T13:45:30.290 INFO:teuthology.orchestra.run.smithi032.stderr: 2023-10-08T13:45:30.290 INFO:teuthology.orchestra.run.smithi032.stderr: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.165528.log.gz 2023-10-08T13:45:30.290 INFO:teuthology.orchestra.run.smithi032.stderr: 93.5% -- replaced with /var/log/ceph/ceph-client.admin.166823.log.gz 2023-10-08T13:45:30.290 INFO:teuthology.orchestra.run.smithi032.stderr: 93.8% -- replaced with /var/log/ceph/ceph-client.admin.351058.log.gz 2023-10-08T13:45:30.290 INFO:teuthology.orchestra.run.smithi032.stderr: 93.7% -- replaced with /var/log/ceph/ceph-client.admin.351154.log.gz 2023-10-08T13:45:30.291 INFO:teuthology.orchestra.run.smithi032.stderr: 94.3% -- replaced with /var/log/ceph/ceph-client.admin.321255.log.gz 2023-10-08T13:45:30.866 INFO:teuthology.orchestra.run.smithi032.stderr: 94.6% -- replaced with /var/log/ceph/ceph-client.admin.80302.log.gz 2023-10-08T13:45:32.133 INFO:teuthology.orchestra.run.smithi032.stderr: 94.8% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2023-10-08T13:45:34.487 INFO:teuthology.orchestra.run.smithi032.stderr: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.92167.log.gz 2023-10-08T13:45:36.053 INFO:teuthology.orchestra.run.smithi032.stderr: 94.8% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2023-10-08T13:45:36.302 INFO:teuthology.orchestra.run.smithi032.stderr: 96.0% -- replaced with /var/log/ceph/ceph-client.admin.227452.log.gz 2023-10-08T13:45:37.187 INFO:teuthology.orchestra.run.smithi032.stderr: 94.5% -- replaced with /var/log/ceph/ceph-client.admin.346977.log.gz 2023-10-08T13:45:39.945 INFO:teuthology.orchestra.run.smithi032.stderr: 94.8% -- replaced with /var/log/ceph/ceph-client.admin.94558.log.gz 2023-10-08T13:45:41.427 INFO:teuthology.orchestra.run.smithi040.stderr: 92.0% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2023-10-08T13:45:41.481 INFO:teuthology.orchestra.run.smithi032.stderr: 94.2% -- replaced with /var/log/ceph/ceph-client.admin.215813.log.gz 2023-10-08T13:45:41.753 INFO:teuthology.orchestra.run.smithi032.stderr: 96.9% -- replaced with /var/log/ceph/ceph-client.admin.339479.log.gz 2023-10-08T13:45:52.223 INFO:teuthology.orchestra.run.smithi032.stderr: 95.8% -- replaced with /var/log/ceph/ceph-client.admin.193530.log.gz 2023-10-08T13:45:53.893 INFO:teuthology.orchestra.run.smithi032.stderr: 96.9% -- replaced with /var/log/ceph/ceph-client.admin.106884.log.gz 2023-10-08T13:45:54.463 INFO:teuthology.orchestra.run.smithi032.stderr: 97.1% -- replaced with /var/log/ceph/ceph-client.admin.215388.log.gz 2023-10-08T13:45:54.517 INFO:teuthology.orchestra.run.smithi032.stderr: 97.0% 97.0% -- replaced with /var/log/ceph/ceph-client.admin.91253.log.gz -- replaced with /var/log/ceph/ceph-client.admin.86051.log.gz 2023-10-08T13:45:54.518 INFO:teuthology.orchestra.run.smithi032.stderr: 2023-10-08T13:45:55.336 INFO:teuthology.orchestra.run.smithi032.stderr: 97.0% -- replaced with /var/log/ceph/ceph-client.admin.214932.log.gz 2023-10-08T13:45:55.390 INFO:teuthology.orchestra.run.smithi032.stderr: 96.9% -- replaced with /var/log/ceph/ceph-client.admin.81714.log.gz 2023-10-08T13:45:55.453 INFO:teuthology.orchestra.run.smithi032.stderr: 97.1% -- replaced with /var/log/ceph/ceph-client.admin.107739.log.gz 2023-10-08T13:45:55.454 INFO:teuthology.orchestra.run.smithi032.stderr: 97.1% -- replaced with /var/log/ceph/ceph-client.admin.108185.log.gz 2023-10-08T13:45:55.761 INFO:teuthology.orchestra.run.smithi032.stderr: 97.2% -- replaced with /var/log/ceph/ceph-client.admin.282349.log.gz 2023-10-08T13:45:56.464 INFO:teuthology.orchestra.run.smithi032.stderr: 97.1% -- replaced with /var/log/ceph/ceph-client.admin.196244.log.gz 2023-10-08T13:45:57.045 INFO:teuthology.orchestra.run.smithi032.stderr: 97.0% -- replaced with /var/log/ceph/ceph-client.admin.283251.log.gz 2023-10-08T13:45:57.660 INFO:teuthology.orchestra.run.smithi032.stderr: 97.1% -- replaced with /var/log/ceph/ceph-client.admin.109037.log.gz 2023-10-08T13:45:58.296 INFO:teuthology.orchestra.run.smithi032.stderr: 97.0% -- replaced with /var/log/ceph/ceph-client.admin.91710.log.gz 2023-10-08T13:45:58.866 INFO:teuthology.orchestra.run.smithi032.stderr: 97.1% -- replaced with /var/log/ceph/ceph-client.admin.313967.log.gz 2023-10-08T13:45:59.748 INFO:teuthology.orchestra.run.smithi032.stderr: 97.1% -- replaced with /var/log/ceph/ceph-client.admin.307299.log.gz 2023-10-08T13:45:59.967 INFO:teuthology.orchestra.run.smithi032.stderr: 95.3% -- replaced with /var/log/ceph/ceph-client.admin.405267.log.gz 2023-10-08T13:46:00.779 INFO:teuthology.orchestra.run.smithi032.stderr: 97.1% -- replaced with /var/log/ceph/ceph-client.admin.355460.log.gz 2023-10-08T13:46:01.582 INFO:teuthology.orchestra.run.smithi032.stderr: 97.2% -- replaced with /var/log/ceph/ceph-client.admin.82134.log.gz 2023-10-08T13:46:02.738 INFO:teuthology.orchestra.run.smithi032.stderr: 96.9% -- replaced with /var/log/ceph/ceph-client.admin.385295.log.gz 2023-10-08T13:46:06.885 INFO:teuthology.orchestra.run.smithi032.stderr: 95.9% -- replaced with /var/log/ceph/ceph-client.admin.192615.log.gz 2023-10-08T13:46:06.885 INFO:teuthology.orchestra.run.smithi032.stderr: 97.2% -- replaced with /var/log/ceph/ceph-client.admin.282766.log.gz 2023-10-08T13:46:07.291 INFO:teuthology.orchestra.run.smithi032.stderr: 97.0% -- replaced with /var/log/ceph/ceph-client.admin.83425.log.gz 2023-10-08T13:46:07.494 INFO:teuthology.orchestra.run.smithi032.stderr: 97.1% -- replaced with /var/log/ceph/ceph-client.admin.112794.log.gz 2023-10-08T13:46:07.560 INFO:teuthology.orchestra.run.smithi032.stderr: 97.2% -- replaced with /var/log/ceph/ceph-client.admin.244611.log.gz 2023-10-08T13:46:10.090 INFO:teuthology.orchestra.run.smithi032.stderr: 96.3% -- replaced with /var/log/ceph/ceph-client.admin.345871.log.gz 2023-10-08T13:46:11.322 INFO:teuthology.orchestra.run.smithi032.stderr: 95.6% -- replaced with /var/log/ceph/ceph-client.admin.87716.log.gz 2023-10-08T13:46:13.484 INFO:teuthology.orchestra.run.smithi032.stderr: 93.0% -- replaced with /var/log/ceph/ceph-client.admin.206092.log.gz 2023-10-08T13:46:20.978 INFO:teuthology.orchestra.run.smithi032.stderr: 96.8% -- replaced with /var/log/ceph/ceph-client.admin.212469.log.gz 2023-10-08T13:46:29.009 INFO:teuthology.orchestra.run.smithi032.stderr: 97.2% -- replaced with /var/log/ceph/ceph-client.admin.347884.log.gz 2023-10-08T13:46:29.018 INFO:teuthology.orchestra.run.smithi032.stderr: 93.9% -- replaced with /var/log/ceph/ceph-client.admin.426932.log.gz 2023-10-08T13:46:30.529 INFO:teuthology.orchestra.run.smithi040.stderr: 93.4% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2023-10-08T13:46:33.152 INFO:teuthology.orchestra.run.smithi032.stderr: 97.9% -- replaced with /var/log/ceph/ceph-client.admin.424848.log.gz 2023-10-08T13:46:41.426 INFO:teuthology.orchestra.run.smithi040.stderr: 92.3% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2023-10-08T13:46:49.244 INFO:teuthology.orchestra.run.smithi032.stderr: 95.0% -- replaced with /var/log/ceph/ceph-client.admin.210074.log.gz 2023-10-08T13:47:34.701 INFO:teuthology.orchestra.run.smithi032.stderr: 94.0% -- replaced with /var/log/ceph/ceph-client.admin.84947.log.gz 2023-10-08T13:47:46.727 INFO:teuthology.orchestra.run.smithi032.stderr: 97.6% -- replaced with /var/log/ceph/ceph-client.admin.97946.log.gz 2023-10-08T13:47:51.347 INFO:teuthology.orchestra.run.smithi032.stderr: 94.3% -- replaced with /var/log/ceph/ceph-client.admin.218452.log.gz 2023-10-08T13:48:04.790 INFO:teuthology.orchestra.run.smithi032.stderr: 94.5% -- replaced with /var/log/ceph/ceph-client.admin.151950.log.gz 2023-10-08T13:48:18.561 INFO:teuthology.orchestra.run.smithi032.stderr: 96.2% -- replaced with /var/log/ceph/ceph-client.admin.299599.log.gz 2023-10-08T13:48:26.757 INFO:teuthology.orchestra.run.smithi032.stderr: 94.5% -- replaced with /var/log/ceph/ceph-client.admin.117788.log.gz 2023-10-08T13:48:29.422 INFO:teuthology.orchestra.run.smithi032.stderr: 96.2% -- replaced with /var/log/ceph/ceph-client.admin.193063.log.gz 2023-10-08T13:49:40.266 INFO:teuthology.orchestra.run.smithi032.stderr: 94.4% -- replaced with /var/log/ceph/ceph-client.admin.152432.log.gz 2023-10-08T13:50:09.870 INFO:teuthology.orchestra.run.smithi032.stderr: 95.1% -- replaced with /var/log/ceph/ceph-client.admin.316570.log.gz 2023-10-08T13:50:13.809 INFO:teuthology.orchestra.run.smithi032.stderr: 94.6% -- replaced with /var/log/ceph/ceph-client.admin.126936.log.gz 2023-10-08T13:50:39.481 INFO:teuthology.orchestra.run.smithi032.stderr: 94.0% -- replaced with /var/log/ceph/ceph-client.admin.111923.log.gz 2023-10-08T13:50:41.221 INFO:teuthology.orchestra.run.smithi032.stderr: 91.9% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2023-10-08T13:50:55.175 INFO:teuthology.orchestra.run.smithi032.stderr: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.85176.log.gz 2023-10-08T13:52:56.413 INFO:teuthology.orchestra.run.smithi032.stderr: 96.2% -- replaced with /var/log/ceph/ceph-client.admin.161611.log.gz 2023-10-08T13:53:00.278 INFO:teuthology.orchestra.run.smithi040.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2023-10-08T13:53:02.952 INFO:teuthology.orchestra.run.smithi032.stderr: 95.1% -- replaced with /var/log/ceph/ceph-client.admin.80792.log.gz 2023-10-08T13:53:09.086 INFO:teuthology.orchestra.run.smithi040.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2023-10-08T13:53:44.379 INFO:teuthology.orchestra.run.smithi032.stderr: 94.1% -- replaced with /var/log/ceph/ceph-client.admin.130958.log.gz 2023-10-08T13:53:51.120 INFO:teuthology.orchestra.run.smithi040.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2023-10-08T13:53:51.123 INFO:teuthology.orchestra.run.smithi040.stderr: 2023-10-08T13:53:51.123 INFO:teuthology.orchestra.run.smithi040.stderr:real 8m35.065s 2023-10-08T13:53:51.124 INFO:teuthology.orchestra.run.smithi040.stderr:user 6m44.976s 2023-10-08T13:53:51.124 INFO:teuthology.orchestra.run.smithi040.stderr:sys 0m19.530s 2023-10-08T13:54:38.143 INFO:teuthology.orchestra.run.smithi032.stderr: 93.7% -- replaced with /var/log/ceph/ceph-client.admin.82954.log.gz 2023-10-08T13:57:27.777 INFO:teuthology.orchestra.run.smithi032.stderr: 93.8% -- replaced with /var/log/ceph/ceph-client.admin.440819.log.gz 2023-10-08T13:59:37.333 INFO:teuthology.orchestra.run.smithi032.stderr: 93.4% -- replaced with /var/log/ceph/ceph-client.admin.207527.log.gz 2023-10-08T14:03:00.844 INFO:teuthology.orchestra.run.smithi032.stderr: 96.2% -- replaced with /var/log/ceph/ceph-client.admin.323130.log.gz 2023-10-08T14:03:01.092 INFO:teuthology.orchestra.run.smithi032.stderr: 94.0% -- replaced with /var/log/ceph/ceph-client.admin.81256.log.gz 2023-10-08T14:03:10.410 INFO:teuthology.orchestra.run.smithi032.stderr: 96.7% -- replaced with /var/log/ceph/ceph-client.admin.227884.log.gz 2023-10-08T14:03:48.705 INFO:teuthology.orchestra.run.smithi032.stderr: 92.9% -- replaced with /var/log/ceph/ceph-client.admin.437054.log.gz 2023-10-08T14:03:52.060 INFO:teuthology.orchestra.run.smithi032.stderr: 90.2% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2023-10-08T14:04:45.587 INFO:teuthology.orchestra.run.smithi032.stderr: 93.0% -- replaced with /var/log/ceph/ceph-client.admin.436305.log.gz 2023-10-08T14:05:09.568 INFO:teuthology.orchestra.run.smithi032.stderr: 92.8% -- replaced with /var/log/ceph/ceph-client.admin.437800.log.gz 2023-10-08T14:05:19.183 INFO:teuthology.orchestra.run.smithi032.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.83884.log.gz 2023-10-08T14:07:55.031 INFO:teuthology.orchestra.run.smithi032.stderr: 92.9% -- replaced with /var/log/ceph/ceph-client.admin.438497.log.gz 2023-10-08T14:08:13.975 INFO:teuthology.orchestra.run.smithi032.stderr: 92.9% -- replaced with /var/log/ceph/ceph-client.admin.440035.log.gz 2023-10-08T14:08:54.792 INFO:teuthology.orchestra.run.smithi032.stderr: 92.9% -- replaced with /var/log/ceph/ceph-client.admin.435527.log.gz 2023-10-08T14:09:03.309 INFO:teuthology.orchestra.run.smithi032.stderr: 92.8% -- replaced with /var/log/ceph/ceph-client.admin.439240.log.gz 2023-10-08T14:09:30.631 INFO:teuthology.orchestra.run.smithi032.stderr: 95.6% -- replaced with /var/log/ceph/ceph-client.admin.247477.log.gz 2023-10-08T14:09:41.411 INFO:teuthology.orchestra.run.smithi032.stderr: 92.9% -- replaced with /var/log/ceph/ceph-client.admin.432463.log.gz 2023-10-08T14:09:45.840 INFO:teuthology.orchestra.run.smithi032.stderr: 92.9% -- replaced with /var/log/ceph/ceph-client.admin.434789.log.gz 2023-10-08T14:11:07.785 INFO:teuthology.orchestra.run.smithi032.stderr: 92.9% -- replaced with /var/log/ceph/ceph-client.admin.434009.log.gz 2023-10-08T14:18:03.884 INFO:teuthology.orchestra.run.smithi032.stderr: 95.1% -- replaced with /var/log/ceph/ceph-client.admin.158929.log.gz 2023-10-08T14:20:25.046 INFO:teuthology.orchestra.run.smithi032.stderr: 95.7% -- replaced with /var/log/ceph/ceph-client.admin.378266.log.gz 2023-10-08T14:27:00.770 INFO:teuthology.orchestra.run.smithi032.stderr: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.237787.log.gz 2023-10-08T14:28:13.816 INFO:teuthology.orchestra.run.smithi032.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2023-10-08T14:31:19.041 INFO:teuthology.orchestra.run.smithi032.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2023-10-08T14:32:32.753 INFO:teuthology.orchestra.run.smithi032.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2023-10-08T14:33:06.518 INFO:teuthology.orchestra.run.smithi032.stderr: 94.5% -- replaced with /var/log/ceph/ceph-client.admin.370164.log.gz 2023-10-08T14:33:34.354 INFO:teuthology.orchestra.run.smithi032.stderr: 94.5% -- replaced with /var/log/ceph/ceph-client.admin.371097.log.gz 2023-10-08T14:35:37.019 INFO:teuthology.orchestra.run.smithi032.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2023-10-08T14:38:31.421 INFO:teuthology.orchestra.run.smithi032.stderr: 93.5% -- replaced with /var/log/ceph/ceph-client.admin.123721.log.gz 2023-10-08T14:56:32.339 INFO:teuthology.orchestra.run.smithi032.stderr: 95.7% -- replaced with /var/log/ceph/ceph-client.admin.113624.log.gz 2023-10-08T15:03:10.915 INFO:teuthology.orchestra.run.smithi032.stderr: 91.8% -- replaced with /var/log/ceph/ceph-client.admin.451164.log.gz 2023-10-08T15:03:10.917 INFO:teuthology.orchestra.run.smithi032.stderr: 2023-10-08T15:03:10.917 INFO:teuthology.orchestra.run.smithi032.stderr:real 77m54.864s 2023-10-08T15:03:10.917 INFO:teuthology.orchestra.run.smithi032.stderr:user 50m53.242s 2023-10-08T15:03:10.918 INFO:teuthology.orchestra.run.smithi032.stderr:sys 2m38.462s 2023-10-08T15:03:10.919 INFO:tasks.ceph:Archiving logs... 2023-10-08T15:03:10.921 DEBUG:teuthology.misc:Transferring archived files from smithi032:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-10-07_14:05:27-fs-main-distro-default-smithi/7417362/remote/smithi032/log 2023-10-08T15:03:10.922 DEBUG:teuthology.orchestra.run.smithi032:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-08T15:09:00.805 DEBUG:teuthology.misc:Transferring archived files from smithi040:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-10-07_14:05:27-fs-main-distro-default-smithi/7417362/remote/smithi040/log 2023-10-08T15:09:00.806 DEBUG:teuthology.orchestra.run.smithi040:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-08T15:14:47.539 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-10-08T15:14:47.552 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-10-08T15:14:47.552 DEBUG:teuthology.orchestra.run.smithi032:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-08T15:14:47.557 DEBUG:teuthology.orchestra.run.smithi040:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-08T15:14:47.670 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-10-08T15:14:47.686 INFO:teuthology.task.clock:Checking final clock skew... 2023-10-08T15:14:47.686 DEBUG:teuthology.orchestra.run.smithi032:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-08T15:14:47.692 DEBUG:teuthology.orchestra.run.smithi040:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-08T15:14:47.772 INFO:teuthology.orchestra.run.smithi040.stdout: remote refid st t when poll reach delay offset jitter 2023-10-08T15:14:47.772 INFO:teuthology.orchestra.run.smithi040.stdout:============================================================================== 2023-10-08T15:14:47.773 INFO:teuthology.orchestra.run.smithi040.stdout:*hv01.front.sepi 44.4.53.2 2 u 560 1024 377 0.214 -2.378 3.058 2023-10-08T15:14:47.773 INFO:teuthology.orchestra.run.smithi040.stdout:+hv02.front.sepi 63.231.80.2 3 u 15 1024 377 0.199 -2.545 3.242 2023-10-08T15:14:47.773 INFO:teuthology.orchestra.run.smithi040.stdout:+hv03.front.sepi 74.6.168.72 3 u 441 1024 377 0.190 -3.032 4.223 2023-10-08T15:14:47.773 INFO:teuthology.orchestra.run.smithi040.stdout: hv04.front.sepi .INIT. 16 u - 1024 0 0.000 0.000 0.000 2023-10-08T15:14:47.788 INFO:teuthology.orchestra.run.smithi032.stdout: remote refid st t when poll reach delay offset jitter 2023-10-08T15:14:47.788 INFO:teuthology.orchestra.run.smithi032.stdout:============================================================================== 2023-10-08T15:14:47.788 INFO:teuthology.orchestra.run.smithi032.stdout:*hv01.front.sepi 44.4.53.2 2 u 895 1024 377 0.223 -0.513 0.978 2023-10-08T15:14:47.788 INFO:teuthology.orchestra.run.smithi032.stdout:+hv02.front.sepi 63.231.80.2 3 u 598 1024 377 0.233 -0.625 1.247 2023-10-08T15:14:47.788 INFO:teuthology.orchestra.run.smithi032.stdout:+hv03.front.sepi 74.6.168.72 3 u 587 1024 377 0.215 -0.978 1.950 2023-10-08T15:14:47.789 INFO:teuthology.orchestra.run.smithi032.stdout: hv04.front.sepi .INIT. 16 u - 1024 0 0.000 0.000 0.000 2023-10-08T15:14:47.790 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-10-08T15:14:47.811 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-10-08T15:14:47.811 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-10-08T15:14:47.828 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-10-08T15:14:47.838 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-10-08T15:14:47.849 INFO:teuthology.task.internal:Duration was 33317.532210 seconds 2023-10-08T15:14:47.850 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-10-08T15:14:47.863 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-10-08T15:14:47.863 DEBUG:teuthology.orchestra.run.smithi032:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-08T15:14:47.867 DEBUG:teuthology.orchestra.run.smithi040:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-08T15:14:48.054 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-10-08T15:14:48.054 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi032.front.sepia.ceph.com 2023-10-08T15:14:48.055 DEBUG:teuthology.orchestra.run.smithi032:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-08T15:14:48.088 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi040.front.sepia.ceph.com 2023-10-08T15:14:48.089 DEBUG:teuthology.orchestra.run.smithi040:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-08T15:14:48.111 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-10-08T15:14:48.112 DEBUG:teuthology.orchestra.run.smithi032:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-08T15:14:48.136 DEBUG:teuthology.orchestra.run.smithi040:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-08T15:14:48.294 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-10-08T15:14:48.294 DEBUG:teuthology.orchestra.run.smithi032:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-08T15:14:48.297 DEBUG:teuthology.orchestra.run.smithi040:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-08T15:14:48.981 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-10-08T15:14:49.004 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-10-08T15:14:49.005 DEBUG:teuthology.orchestra.run.smithi032:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-08T15:14:49.030 DEBUG:teuthology.orchestra.run.smithi040:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-08T15:14:49.068 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-10-08T15:14:49.094 DEBUG:teuthology.orchestra.run.smithi032:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-08T15:14:49.145 DEBUG:teuthology.orchestra.run.smithi040:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-08T15:14:49.161 INFO:teuthology.orchestra.run.smithi032.stdout:kernel.core_pattern = core 2023-10-08T15:14:49.170 INFO:teuthology.orchestra.run.smithi040.stdout:kernel.core_pattern = core 2023-10-08T15:14:49.199 DEBUG:teuthology.orchestra.run.smithi032:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-08T15:14:49.238 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T15:14:49.239 DEBUG:teuthology.orchestra.run.smithi040:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-08T15:14:49.244 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T15:14:49.245 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-10-08T15:14:49.257 INFO:teuthology.task.internal:Transferring archived files... 2023-10-08T15:14:49.301 DEBUG:teuthology.misc:Transferring archived files from smithi032:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-10-07_14:05:27-fs-main-distro-default-smithi/7417362/remote/smithi032 2023-10-08T15:14:49.301 DEBUG:teuthology.orchestra.run.smithi032:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-08T15:14:49.333 DEBUG:teuthology.misc:Transferring archived files from smithi040:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-10-07_14:05:27-fs-main-distro-default-smithi/7417362/remote/smithi040 2023-10-08T15:14:49.333 DEBUG:teuthology.orchestra.run.smithi040:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-08T15:14:49.357 INFO:teuthology.task.internal:Removing archive directory... 2023-10-08T15:14:49.361 DEBUG:teuthology.orchestra.run.smithi032:> rm -rf -- /home/ubuntu/cephtest/archive 2023-10-08T15:14:49.363 DEBUG:teuthology.orchestra.run.smithi040:> rm -rf -- /home/ubuntu/cephtest/archive 2023-10-08T15:14:49.401 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-10-08T15:14:49.413 INFO:teuthology.task.internal:Not uploading archives. 2023-10-08T15:14:49.433 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-10-08T15:14:49.443 INFO:teuthology.task.internal:Tidying up after the test... 2023-10-08T15:14:49.443 DEBUG:teuthology.orchestra.run.smithi032:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-08T15:14:49.446 DEBUG:teuthology.orchestra.run.smithi040:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-08T15:14:49.462 INFO:teuthology.orchestra.run.smithi032.stdout: 924112 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 8 15:14 /home/ubuntu/cephtest 2023-10-08T15:14:49.468 INFO:teuthology.orchestra.run.smithi040.stdout: 924113 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 8 15:14 /home/ubuntu/cephtest 2023-10-08T15:14:49.470 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-10-08T15:14:49.481 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-10-08T15:14:49.664 INFO:teuthology.nuke:Checking targets against current locks 2023-10-08T15:14:49.729 DEBUG:teuthology.nuke:shortname: smithi032 2023-10-08T15:14:49.741 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-08T15:14:49.771 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi032.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-07_14:05:27-fs-main-distro-default-smithi/7417362', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-08 05:50:09.739273', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='} 2023-10-08T15:14:49.773 DEBUG:teuthology.nuke:shortname: smithi040 2023-10-08T15:14:49.773 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-08T15:14:49.798 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi040.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-07_14:05:27-fs-main-distro-default-smithi/7417362', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-08 05:50:09.737406', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='} 2023-10-08T15:14:49.825 INFO:teuthology.orchestra.console.smithi032:Power off 2023-10-08T15:14:49.825 DEBUG:teuthology.orchestra.console.smithi032:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-08T15:14:49.848 DEBUG:teuthology.orchestra.console.smithi032:power off output: Chassis Power Control: Down/Off 2023-10-08T15:14:49.850 DEBUG:teuthology.orchestra.console.smithi032:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-08T15:14:49.868 INFO:teuthology.orchestra.console.smithi040:Power off 2023-10-08T15:14:49.869 DEBUG:teuthology.orchestra.console.smithi040:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-08T15:14:49.878 DEBUG:teuthology.orchestra.console.smithi032:check power output: Chassis Power is on 2023-10-08T15:14:49.891 DEBUG:teuthology.orchestra.console.smithi040:power off output: Chassis Power Control: Down/Off 2023-10-08T15:14:49.924 DEBUG:teuthology.orchestra.console.smithi040:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-08T15:14:49.948 DEBUG:teuthology.orchestra.console.smithi040:check power output: Chassis Power is on 2023-10-08T15:14:53.879 DEBUG:teuthology.orchestra.console.smithi032:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-08T15:14:53.949 DEBUG:teuthology.orchestra.console.smithi040:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-08T15:14:53.991 DEBUG:teuthology.orchestra.console.smithi032:check power output: Chassis Power is on 2023-10-08T15:14:54.060 DEBUG:teuthology.orchestra.console.smithi040:check power output: Chassis Power is on 2023-10-08T15:14:57.994 DEBUG:teuthology.orchestra.console.smithi032:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-08T15:14:58.076 DEBUG:teuthology.orchestra.console.smithi040:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-08T15:14:58.107 DEBUG:teuthology.orchestra.console.smithi032:check power output: Chassis Power is off 2023-10-08T15:14:58.188 DEBUG:teuthology.orchestra.console.smithi040:check power output: Chassis Power is off 2023-10-08T15:14:58.209 INFO:teuthology.orchestra.console.smithi032:Power off completed 2023-10-08T15:14:58.289 INFO:teuthology.orchestra.console.smithi040:Power off completed 2023-10-08T15:14:58.394 INFO:teuthology.run:Summary data: description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_20.04} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/xfstests-dev} duration: 33317.53220963478 failure_reason: 'Test failure: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev)' flavor: default owner: scheduled_yuriw@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=a03117dfe4c3476fb55570305733c8ce status: fail success: false 2023-10-08T15:14:58.395 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-08T15:14:58.472 INFO:teuthology.run:FAIL